Knowledge Distillation
Soft targets and temperature, sequence-level and on-policy distillation, and when a student beats its teacher.
—
0 known
0 to review
Loading deck…
Space to flipSpace flip · ← → move · K known · R review · S shuffle