Term Kind Topic What it is
Model Cascade Tiered Inference, Escalation Ladder pattern Model Selection A cheap fast model handling the clear majority of cases with escalation to a larger model or a human for the uncertain ones - usually a large cost reduction with no quality loss, because the expensive path run…
Model Routing pattern Model Selection Directing each request to the cheapest model capable of handling it, rather than sending all traffic to the most capable one.
Small Model Routing Model Cascade, Tiered Inference practice Model Selection Sending each request to the smallest model that can handle it, escalating to a larger one only when needed.