Reasoning Models
Test-time compute, process reward models, the o-series, DeepSeek-R1 and contamination.
15concepts
196flashcards
122minutes of reading
- 01 Chain of Thought, Self-consistency, and Search at Inference A tour of the inference-time reasoning toolkit - from zero-shot CoT prompts to MCTS-decoded reasoning trees, and when each pays for itself.
- 02 Hybrid Reasoning Models One set of weights that can answer instantly or think at length, how mode switching and thinking budgets are trained in, and why the industry converged on hybrids over separate reasoning models.
- 03 OpenAI o1, o3 and the Reasoning-Model Family What is publicly known and what is speculated about OpenAI's reasoning line, why the chain of thought is hidden, and what o3's ARC-AGI result actually proved.
- 04 Reasoning Evals and the Contamination Problem A guided tour of the reasoning benchmark canon, why each saturated faster than the field expected, and the move to live held-out evals as the contamination crisis bites.
- 05 Test-time Compute Scaling Why "thinking longer" at inference can substitute for "training bigger", how the trade-off is operationalised as a token budget, and where the strategy stops paying.