Term Kind Topic What it is
Inference Request Path concept LLM Application Architecture The sequence of stages an LLM application request passes through, each with distinct latency, cost and failure characteristics.