Model Architecture
22 min
Multi-Head Latent Attention: How DeepSeek Compressed the KV Cache Without Losing Quality
Every token an LLM generates forces it to reload the keys and values of every token that came before. Multi-Head Latent Attention rewrites that trade by caching one compressed vector instead of dozens of separate heads, cutting m…