Anatomy

Diagrams of boxes and arrows describe an idea. These build it. Each piece is the real thing, running: a transformer you can type into, laid out in 3D from its own numbers; a web stack you can overload. The 3D dissections walk through a landmark paper or system component by component, trace every figure to its source, and end with experiments of their own.

15 models 7 AI & ML5 Architecture3 Mechanistic Interpretability 1,222 parts and components 353 links into the libraries

All15 AI & ML7 Architecture5 Mechanistic Interpretability3

Any Language models 3 Neural network foundations 2 Training & alignment 2 Performance & capacity 1 Web & API systems 1 Distributed systems 3 Causal methods 2 Hallucination & faithfulness 1

Any Working model 10 Simulation 5

5 models for “pre-registered experiments”.

Working model · 3D AI & ML · Training & alignment

Anatomy of Neural Scaling Laws

Kaplan et al. said spend on size; Hoffmann et al. said spend on both. 108 trained miniatures, three estimators and one question: what does the answer depend on?

Eleven character-level Transformers and 562 training runs laid out as a landscape of loss; three estimators find the compute-optimal size on it. A pre-registered desk tests what moves the exponent: t…

32 components · Intermediate 23 Oct 2026

Working model · 3D Mechanistic Interpretability · Hallucination & faithfulness

Why 722 becomes 719

A real 0.5B language model opened up at the moment it copies a number from its context: the heads that carry the digit, the votes that choose it, the sampler that sometimes doesn't, and a guard that checks every digit as it is written.

Two people paste the same research notes into a small model and get 722 and 719. A 3D dissection of Qwen2.5-0.5B at the moment it copies the number, with pre-registered experiments on five models: wh…

24 components · Intermediate 18 Oct 2026

Simulation · 3D Architecture · Distributed systems

Anatomy of Raft

In Search of an Understandable Consensus Algorithm, dissected: five servers laid out in 3D with their terms, votes, logs and state machines, Figures 7 and 8 rebuilt from real blocks, and a research desk that reruns the paper's leader-election measurements.

Raft's Figure 2 as five servers in 3D: timers, votes, logs and messages computed live from a seeded simulation, with the paper's Figures 7 and 8 as real blocks and a research desk that reproduces its…

52 components · Intermediate 17 Oct 2026

Simulation · 3D Architecture · Distributed systems

Anatomy of Lamport Clocks

Time, Clocks, and the Ordering of Events, dissected: an execution laid out in 3D with its logical clocks, vector clocks, every pair of events, the mutual exclusion algorithm and a physical-clock synchroniser, all computed live and checked against what really happened before what.

Lamport's 1978 paper built from its own definitions: the paper's Figure 1 or a seeded execution in 3D, logical and vector clocks on every event, the mutual exclusion algorithm, physical clock skew ag…

45 components · Intermediate 16 Oct 2026

Working model · 3D AI & ML · Language models

Anatomy of the Transformer

Attention Is All You Need, dissected: the whole encoder-decoder in 3D, every matrix a real one from a trained model running in your browser, every number from the paper traced to its sentence.

The 2017 Transformer, built in 3D from its own numbers: a trained miniature of the paper's exact encoder-decoder translates your English number into German while the camera walks through 29 steps, fr…

172 components · Intermediate 15 Oct 2026