Inference & Serving
21 min
Diffusion Language Models: Writing Text by Denoising, Not Predicting the Next Token
Autoregressive models write left to right, one token at a time. Diffusion language models reveal a whole sequence at once and sharpen it over a handful of steps. That single change rewrites the latency math, and in 2025 it stoppe…