Term Kind Topic What it is
Inference Telemetry practice AI Observability Recording the full context of each model interaction — inputs, outputs, tokens, latency, model version and evaluation scores — so quality and cost can be investigated.
Model Drift Monitoring practice AI Observability Detecting that a deployed model's inputs or performance have shifted away from the conditions it was validated under.
Quality Proxy Metric Implicit Quality Signal, Behavioural Quality Indicator metric AI Observability A continuously available production signal that moves when answer quality moves - abstention rate, regeneration rate, escalation rate - used to page someone in the hours before a labelled evaluation could ever run.
Serving Path Divergence Per-Pool Quality Drift, Heterogeneous Fleet Skew concept AI Observability One configuration in a fleet of otherwise identical inference paths behaving differently from its peers - detectable by comparing paths against each other, and invisible to any metric averaged across them.