Term Kind Topic What it is
Candidate Recall Ceiling First-Stage Recall, Retrieval Ceiling metric Reranking The share of queries whose correct passage appears anywhere in the first-stage candidate set - the hard upper bound on every later stage, since reranking reorders what was retrieved and cannot add to it.
Inference Cost per Interaction metric AI Cost Management The fully loaded token cost of one user interaction, including retrieval, retries, guardrails and agent loops, measured rather than estimated.
Quality Proxy Metric Implicit Quality Signal, Behavioural Quality Indicator metric AI Observability A continuously available production signal that moves when answer quality moves - abstention rate, regeneration rate, escalation rate - used to page someone in the hours before a labelled evaluation could ever run.