Reasoning & Evaluation
27 min
Editing Facts Into Weights: Why Knowledge Editing Keeps Losing to Retrieval
A rank-one update to one weight matrix can change what a model believes about the Eiffel Tower in under a second. Four years of benchmarks later, the same trick collapses after about 1,400 sequential edits, fails on the consequen…