Term Kind Topic What it is
AI Gateway Pattern LLM Proxy, Model Router pattern AI Gateways A single control point through which all model calls pass, providing routing, cost control, caching, logging, guardrails and provider abstraction.
Token Budget Enforcement practice AI Gateways Limiting token consumption per user, tenant, feature or time window at a central point, so cost cannot run away unobserved.