Open curriculum · No sign-up · No paywall

Learn how modern AI
actually works.

A structured path from linear algebra to production agents. Every concept is written to be read once and understood, then drilled with flashcards until it sticks, then extended with a deep dive that shows how it plays out in real systems.

The AI Editorial Inference & Economics 20 September 2026 8 min read New

Speed goes to whoever is easiest to predict

vLLM's September release lets a client ask, per request, what fraction of its tokens a small draft model guessed right. The same stack cuts the draft length to zero above 128 concurrent requests. Both are the same admission.

Speculative decoding never made a model faster; it converts a server's idle arithmetic into lower latency, and because batching spends that same arithmetic, the stack now rations the speedup to the most predictable requests first and to nobody once the machine is full.
Read the editorial → Argued from 8 linked sources, with 4 background concepts to read first.
Previously Every editorial →
2026-09-20

Learn four things today, then come back tomorrow.

A concept, a flashcard, a quiz and a deep dive, picked from the date itself so everybody sees the same four and a reload does not reshuffle them. Each one can be shared whole, with the link, to X, LinkedIn, WhatsApp or Substack.

Concept of the day intermediate
Pretraining Data Pipelines

PII Detection and Removal

Scrubbing personally identifiable information from web-scale corpora before LLM pretraining reduces memorisation risk and legal exposure, but every detection method trades recall against corpus damage.

Card of the day advanced
Forecast Evaluation at Scale
Quiz of the day name the concept
Information Theory for Language

_____ is one member of a family generated by a convex function, the choice of member decides whether your model covers the data or collapses onto a mode, and some tasks need a divergence that is not in the family at all.

Show the answer Hide the answer

A. N-Gram Models and Smoothing
The pre-neural language model that ruled for three decades, why counting words breaks the moment you hit a sequence you have never seen, and the smoothing tricks invented to patch that hole.

B. The Softmax Bottleneck
Why a standard softmax output layer is a low-rank approximation to the true distribution of language, the "bottleneck" that caps what any single softmax can express, and the mixture trick that breaks it.

C. f-Divergences Beyond KL the answer
KL is one member of a family generated by a convex function, the choice of member decides whether your model covers the data or collapses onto a mode, and some tasks need a divergence that is not in the family at all.

D. Channel Capacity and the Noisy Channel
Shannon's capacity theorem, why it says reliable communication is possible at any rate below capacity and impossible above it, and why the noisy-channel decomposition keeps reappearing in language modelling.

Deep dive of the day 42 min
Model Architecture

From Nano Banana to Vision Banana: How Google DeepMind Turned an Image Generator into a Generalist Vision System

Training a model to generate photorealistic images teaches it geometry, semantics, depth, and object relationships. Google DeepMind's Vision Banana proves that a lightweight instruction-tuning pass over an image generator can beat SAM 3 on segmentation and De…

The map

Eight domains, ordered from first principles up.

The order is deliberate. Domain 01 assumes nothing; domain 08 assumes the rest. You do not have to follow it, but if you are starting cold, start at the top.

01

Foundations

The mathematics and neural-network mechanics everything else assumes.

Mathematical FoundationsTensors & Neural PlumbingDeep Learning Building BlocksInformation Theory for Language
63 concepts 707 cards 8.4h reading
02

Transformer Internals

Open the box. How a language model actually turns text into predictions.

TokenisationEmbeddings & RepresentationsAttention InternalsPositional EncodingTransformer AnatomyTraining ObjectivesDecoding & GenerationContext & In-Context Learning
116 concepts 929 cards 14.6h reading
03

Training & Fine-Tuning

From raw web crawl to an aligned model — data, dynamics, scale and adaptation.

Pretraining Data PipelinesSynthetic DataTraining Dynamics & ScalingDistributed TrainingParameter-Efficient Fine-TuningAlignment & Post-Training
110 concepts 886 cards 14.2h reading
04

Reinforcement Learning

Classical RL, then the specific dialect of it that post-trains language models.

RL FoundationsRL for Language ModelsBandits & ExplorationOffline & Model-Based RLMulti-Agent RL
61 concepts 489 cards 7.7h reading
05

Inference, Systems & Hardware

Where the model meets the silicon, the memory bus and the latency budget.

Inference OptimisationAccelerator ArchitectureKernels & CompilersServing Systems
67 concepts 645 cards 9.0h reading
06

Applied LLM Engineering

Building things people use: retrieval, prompts, agents and production architecture.

Retrieval & RAGPrompt EngineeringAgents & Tool UseClaude Certified ArchitectLLM Application ArchitectureAI for Software Engineering
63 concepts 652 cards 8.2h reading
07

Reasoning, Evaluation & Safety

Models that think longer, the evals that measure them, and the failure modes that matter.

Reasoning ModelsEvaluation & MLOpsSafety & Alignment
54 concepts 748 cards 7.3h reading
08

Multimodal & Applications

Beyond text — vision, speech, robotics and scientific discovery.

Vision & MultimodalSpeech RecognitionSpeech SynthesisRobotics & Embodied AIAI for Science
74 concepts 669 cards 9.8h reading
09

Classical ML & Statistical Learning

The statistics and non-neural models that still decide most production predictions.

Statistical InferenceClassical Supervised LearningTrees & EnsemblesUnsupervised LearningBayesian MethodsFeature Engineering
43 concepts 885 cards 5.4h reading
10

Causal Inference & Experimentation

Telling correlation from cause, and measuring whether a change actually helped.

Causal FoundationsOnline ExperimentationObservational Causal MethodsPolicy Learning & Off-Policy Evaluation
28 concepts 557 cards 3.6h reading
11

Time Series & Forecasting

Data with an arrow of time, where shuffling the rows destroys the problem.

Time Series FoundationsForecasting at ScaleAnomaly & Changepoint DetectionOnline & Streaming Learning
32 concepts 377 cards 3.8h reading
12

Graphs, Recommenders & Structured Data

Learning over relations, catalogues and columns rather than free text.

Graph Neural NetworksKnowledge GraphsRecommender SystemsTabular Deep Learning
26 concepts 326 cards 3.2h reading
13

Generative Modelling Beyond Transformers

Diffusion, flows, adversarial games and state space models, and the theory that connects them.

Diffusion ModelsVariational & Flow ModelsAdversarial Generative ModelsState Space ModelsEnergy-Based & Score Models
37 concepts 388 cards 4.7h reading
14

Efficiency, Compression & Edge AI

Making a model smaller, cheaper and local without giving away the thing that made it useful.

QuantisationKnowledge DistillationSparsity & PruningEfficient ArchitecturesOn-Device & Edge AI
31 concepts 350 cards 3.7h reading
15

Search & Information Retrieval

Thirty years of ranking research that RAG rediscovered, usually the hard way.

Classical Information RetrievalLearning to RankQuery UnderstandingSearch EvaluationVector Databases
34 concepts 605 cards 4.1h reading
16

Data & Feature Engineering

The pipelines, formats and contracts that decide whether a model ever sees correct inputs.

Data Modelling & StorageBatch & Streaming PipelinesFeature StoresData Quality & ContractsData Governance & Lineage
37 concepts 381 cards 4.5h reading
17

MLOps & Platform Engineering

Everything between a notebook that works and a system that keeps working.

Experiment Tracking & ReproducibilityModel Registry & VersioningCI/CD for MLML Observability & DriftGPU Fleet & CapacityCost & FinOps for AI
37 concepts 419 cards 4.5h reading
18

Security, Privacy & Adversarial ML

Attacks on models, data and the supply chain, and the defences that survive contact.

Adversarial RobustnessPrivacy-Preserving MLLLM Application SecurityModel Provenance & WatermarkingML Supply Chain Security
32 concepts 349 cards 3.9h reading
19

Governance, Risk & Responsible AI

Frameworks, regulation and audit evidence, treated as engineering rather than paperwork.

AI Governance FrameworksAI Regulation & ComplianceFairness & BiasTransparency & DocumentationAI Assurance & Audit
33 concepts 340 cards 4.0h reading
20

Human-AI Interaction, Product & Economics

The people using the system, the product decisions around it, and what compute actually costs.

Interaction Design for AIAI Product ManagementTrust Calibration & RelianceHuman Data & AnnotationCompute EconomicsAI Diffusion & Labour
37 concepts 403 cards 4.4h reading
Start here

If you are new, these come first.

Beginner-level concepts that assume no prior machine learning.

Transformer Anatomy

Anatomy of a Transformer Block

The exact sequence of operations inside one transformer block, from tensor shapes to parameter counts, and why every frontier model is just this same function stacked dozens of times.

8 min · 5 cards
Attention Internals

Attention as Soft Dictionary Lookup

The mental model that makes attention click before the matrix algebra does - a lookup table where the key match is a matter of degree, not an exact hit or miss.

6 min · 5 cards
Speech Recognition

Audio Features and Spectrograms

Raw audio waveforms are rarely fed directly to speech models; this concept explains how and why they are first converted into spectrogram-based representations that compress perceptual information into a learnable 2-D grid.

8 min · 7 cards
Context & In-Context Learning

Autoregressive Generation

How a language model turns next-token prediction into a paragraph, and why generation is a loop that feeds its own output back as input.

6 min · 4 cards
Tensors & Neural Plumbing

Broadcasting and Vectorisation

Broadcasting is the rule that lets a bias vector add to every row of a batch without an explicit loop, and understanding its shape-matching logic prevents the class of bugs that produce wrong answers without an error.

6 min · 5 cards
Prompt Engineering

Chain of Thought Prompting

Why telling the model to think step by step radically improves reasoning, and when it actively hurts.

5 min · 3 cards
Statistical Inference

Confidence Intervals and Coverage

What the 95% in a 95% interval refers to, why the Wald interval for a proportion is badly behaved near zero, and how a confidence interval differs from the credible interval people usually think they are reading.

7 min · 32 cards
Embeddings & Representations

Cosine Similarity vs Dot Product

Two near-identical looking formulas that answer different questions, one measures direction alone, the other measures direction and magnitude together, and picking the wrong one silently breaks a search or ranking system.

6 min · 4 cards