Tagged “hallucination”

2 posts.

All Model Architecture19 Training & Alignment22 Inference & Serving20 Agents & Orchestration11 Reasoning & Evaluation27 Safety, Security & Governance7 Platforms & Practice22

Reasoning & Evaluation 23 min

Guarantees Without Calibration: Conformal Prediction and the Limits of LLM Confidence

A language model's stated confidence is a number, not a probability. Conformal prediction offers the opposite trade: it promises nothing about any single answer and something exact about the long run, from any scorer, with one as…

uncertainty evaluation calibration safety ∑ ◫

Platforms & Practice 24 min

What Structure Buys You: Knowledge Graphs in the Age of Language Models

In 2019 a masked language model recalled facts almost as well as a relation extractor with an oracle entity linker, and people asked whether knowledge graphs were finished. They were not, but the reason is narrower than their adv…

knowledge-graphs rag retrieval hybrid-retrieval ∑ ◫