Anatomy

Diagrams of boxes and arrows describe an idea. These build it. Each model is a small, precise machine whose working is the concept: a transformer you can type into, a web stack you can overload. Every number on the readout comes from the same computation that moves the parts, so what you see is what the thing actually does.

2 models 1 AI & ML1 Architecture 244 drawn parts 40 links into the libraries

All2 AI & ML1 Architecture1

Any Language models 1 Performance & capacity 1

Any Working model 1 Simulation 1

1 model for “embeddings”.

Working model AI & ML · Language models

Anatomy of GPT-2

A real GPT-2, scaled down to 0.94 million parameters, running in your browser. Type anything and watch it think.

GPT-2 built as a type press: your prompt is a row of type slugs, four stepped tiers are the four transformer blocks with attention drawn as threads, and five plungers rise to the next-token probabili…

129 parts · Intermediate 15 Oct 2026