Portfolio ↗

Decoding & Generation

Greedy, beam, temperature, top-k, nucleus, and constrained generation into structured formats.

12concepts
51flashcards
89minutes of reading
Start with Greedy Decoding Drill the deck
All levels beginner intermediate advanced
  1. 01 Min-p and Typical Sampling Two later refinements to nucleus sampling, one that scales the truncation threshold to the top token's own confidence, one that truncates by information content rather than raw probability rank. advanced 9m 4 cards