Portfolio ↗

Transformer Anatomy

The block, the stack, encoder vs decoder, MoE, and the design choices that separate model families.

14concepts
58flashcards
113minutes of reading
Start with Anatomy of a Transformer Block Drill the deck
All levels beginner intermediate advanced
  1. 01 Anatomy of a Transformer Block The exact sequence of operations inside one transformer block, from tensor shapes to parameter counts, and why every frontier model is just this same function stacked dozens of times. beginner 8m 5 cards