Anatomy

Diagrams of boxes and arrows describe an idea. These build it. Each piece is the real thing, running: a transformer you can type into, laid out in 3D from its own numbers; a web stack you can overload. The 3D dissections walk through a landmark paper or system component by component, trace every figure to its source, and end with experiments of their own.

4 models 2 AI & ML2 Architecture 540 parts and components 82 links into the libraries

All4 AI & ML2 Architecture2

Any Language models 2 Performance & capacity 1 Web & API systems 1

Any Working model 2 Simulation 2

Runs the real algorithm end to end on your own input.

2 models for “multi-head attention”.

Working model · 3D AI & ML · Language models

Anatomy of the Transformer

Attention Is All You Need, dissected: the whole encoder-decoder in 3D, every matrix a real one from a trained model running in your browser, every number from the paper traced to its sentence.

The 2017 Transformer, built in 3D from its own numbers: a trained miniature of the paper's exact encoder-decoder translates your English number into German while the camera walks through 29 steps, fr…

172 components · Intermediate 15 Oct 2026

Working model AI & ML · Language models

Anatomy of GPT-2

A real GPT-2, scaled down to 0.94 million parameters, running in your browser. Type anything and watch it think.

GPT-2 built as a type press: your prompt is a row of type slugs, four stepped tiers are the four transformer blocks with attention drawn as threads, and five plungers rise to the next-token probabili…

129 parts · Intermediate 15 Oct 2026