Anatomy

Diagrams of boxes and arrows describe an idea. These build it. Each piece is the real thing, running: a transformer you can type into, laid out in 3D from its own numbers; a web stack you can overload. The 3D dissections walk through a landmark paper or system component by component, trace every figure to its source, and end with experiments of their own.

13 models 6 AI & ML5 Architecture2 Mechanistic Interpretability 1,159 parts and components 306 links into the libraries

All13 AI & ML6 Architecture5 Mechanistic Interpretability2

Any Language models 3 Neural network foundations 2 Training & alignment 1 Performance & capacity 1 Web & API systems 1 Distributed systems 3 Causal methods 1 Hallucination & faithfulness 1

Any Working model 8 Simulation 5

1 model for “phase change”.

Working model · 3D AI & ML · Language models

Anatomy of Induction Heads

In-context Learning and Induction Heads, dissected: a two-layer attention-only Transformer in 3D, every matrix a real one from a model trained in the repository, with seven pre-registered hypotheses tested on 14 training runs.

A two-layer attention-only Transformer, built in 3D from its own numbers, completes [A][B] … [A] → [B] on your text while the camera walks the previous-token head, the K-composition and the induction…

56 components · Advanced 20 Oct 2026