Anatomy

Diagrams of boxes and arrows describe an idea. These build it. Each piece is the real thing, running: a transformer you can type into, laid out in 3D from its own numbers; a web stack you can overload. The 3D dissections walk through a landmark paper or system component by component, trace every figure to its source, and end with experiments of their own.

8 models 4 AI & ML4 Architecture 762 parts and components 192 links into the libraries

All8 AI & ML4 Architecture4

Any Language models 2 Neural network foundations 2

Any Working model 4

2 models for “residual stream”.

Working model · 3D AI & ML · Language models

Anatomy of the Transformer

Attention Is All You Need, dissected: the whole encoder-decoder in 3D, every matrix a real one from a trained model running in your browser, every number from the paper traced to its sentence.

The 2017 Transformer, built in 3D from its own numbers: a trained miniature of the paper's exact encoder-decoder translates your English number into German while the camera walks through 29 steps, fr…

172 components · Intermediate 15 Oct 2026

Working model AI & ML · Language models

Anatomy of GPT-2

A real GPT-2, scaled down to 0.94 million parameters, running in your browser. Type anything and watch it think.

GPT-2 built as a type press: your prompt is a row of type slugs, four stepped tiers are the four transformer blocks with attention drawn as threads, and five plungers rise to the next-token probabili…

129 parts · Intermediate 15 Oct 2026