Training & Alignment
27 min
Model Merging: Why Averaging Weights Works, and Where the Free Lunch Ends
Three 7B models that each scored under 30% on Japanese maths were averaged into one that scored 52%. No gradient was computed. Weight-space arithmetic is the cheapest capability gain in the field and the easiest one to fool yours…