Tagged “nlp”

2 posts.

All Model Architecture23 Training & Alignment22 Inference & Serving24 Agents & Orchestration13 Reasoning & Evaluation28 Safety, Security & Governance9 Platforms & Practice22

Platforms & Practice 24 min

Query Understanding Is the Hidden Half of Search: From Broder's Taxonomy to LLM Query Rewriting

An LLM-written pseudo-document lifts BM25 by 15 nDCG@10 points on TREC DL 2019, and turns a 16 ms search into one that waits over two seconds for the model. Query understanding decides what the engine searches for before ranking …

query-understanding information-retrieval retrieval rag ∑ ◫

Inference & Serving 27 min

The Mode Is Not the Answer: How Decoding Stopped Being a Search Problem

Run exact search over a trained translation model and, for more than half of a standard test set, the highest-scoring output is the empty string. Beam search works only because it fails to find what the model actually prefers. Th…

decoding generation sampling mbr ∑ ◫