Reasoning & Evaluation
24 min
The Curse of Dimensionality: Why Distances Stop Meaning Anything, and Why Learning Works Anyway
Scatter 1,000 random points in a 1,000-dimensional cube and the farthest one from a query is only about 12% farther away than the nearest. By that arithmetic nearest-neighbour search should be meaningless, and yet every vector da…