Training & Alignment
3 min
How Much Data Is Enough? The Chinchilla Correction
For years the field raced to build bigger models. Then a 2022 study showed most of those giants were undertrained, and quietly redrew the map of how to spend a compute budget.