token embeddings
token embeddings at Beyond Market Intelligence is a file of 2 stories. The newest of them: “Explore how AI sees Trump before context enters the picture” and “Explore GPT-2's vocabulary through a flyable hyperbolic tree of 32,070 tokens”. A single word, "Trump," behaves like two different neighbors depending on how you slice its embedding. Somewhere in the internet's endless sprawl, a reddit user got tired of flat maps. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work… The list below is every token embeddings story on Beyond Market Intelligence, newest first.

Explore how AI sees Trump before context enters the picture
A single word, "Trump," behaves like two different neighbors depending on how you slice its embedding. In GPT-2 Small's static table, discretizing the coordinates surfaces generic political names like Mitt and Pelosi. Keep the continuous values, and the same token clusters with family, staff, and rivals like Obama and Eisenhower. That gap is a quiet reminder that representation choices shape what models see.

Explore GPT-2's vocabulary through a flyable hyperbolic tree of 32,070 tokens
Somewhere in the internet's endless sprawl, a reddit user got tired of flat maps. So they built a better one. This isn't another 2D projection of GPT-2's vocabulary. It's a hyperbolic tree, housing all 32,070 tokens inside a Poincaré ball you can actually fly through. The layout is constructed exactly, with no optimisation or training involved. Trees don't fit well in flat space, but they embed naturally here. Drag, pinch, and tap to explore.