Flashcards

2,671 cards in 36 decks, written from the same source as the concepts. Space to flip, arrows to move, K and R to sort what you know from what you do not. Progress lives in your browser.

All decks 01Foundations 02Transformer Internals 03Training & Fine-Tuning 04Reinforcement Learning 05Inference, Systems & Hardware 06Applied LLM Engineering 07Reasoning, Evaluation & Safety 08Multimodal & Applications

Reinforcement Learning

Classical RL, then the specific dialect of it that post-trains language models.

2decks

282cards

RL Foundations

MDPs, value functions, TD learning, policy gradients, actor-critic, TRPO and PPO.

140 cards 20 concepts

RL for Language Models

RLHF as an RL problem, KL-regularised objectives, GRPO, RLVR, and reward over-optimisation.

142 cards 21 concepts