Platforms & Practice
24 min
BM25 Refuses to Die: The Probabilistic Relevance Framework Behind Search's Most Durable Baseline
In 2021 a benchmark of 18 retrieval datasets found that a scoring function from 1994 still beat most neural retrievers outside their training domain. BM25 is not a heuristic that got lucky. It is a deliberate approximation of a p…