Cost per Request
Fully-loaded per-unit cost, including the lines usually left out.
5 to work through
-
intermediate
A communications platform of the kind Twilio operates bills its customers per message. Most of what it pays per message goes to carriers rather than to its own servers. The team commits to halving infrastructure cost per message this year. What does that buy, and what does it give up?
3 min answer -
intermediate Multiple choice
A marketplace's infrastructure spend rises with growth. How should it distinguish healthy growth from deteriorating efficiency?
2 min answer -
intermediate Multiple choice
Your infrastructure bill rose 40% this quarter. What do you need to know before deciding whether that is a problem?
2 min answer -
advanced
An inference platform's cost per request varies by two orders of magnitude between requests. What does that imply for pricing, capacity and engineering priorities?
2 min answer -
advanced
How do you build a cost-per-request model for a proposed architecture before writing code, and which cost terms are most often omitted?
2 min answer
3 terms in this topic
Cost per Request
Total cost divided by units of business value — the metric that makes cost comparable across time, scale and design options.
conceptIdle Cost
The portion of infrastructure spend incurred regardless of traffic, which determines how cost per request behaves as volume changes.
conceptPass-Through Cost of Goods Sold
The part of the cost of serving one unit that is paid to a third party per transaction, which infrastructure optimisation cannot reduce and which eve…
Neighbouring topics
Cost & FinOps
General material on the economics of an architecture.
Total Cost of Ownership
Lifetime cost including people, operations, upgrades and exit.
Cloud Pricing Models
On-demand, committed and spot, and the crossover arithmetic.
Reserved & Committed Capacity
Committing the baseline, laddering terms, and expiry as a silent failure.
Spot & Interruptible Capacity
Deep discounts for work that can be interrupted and resumed.
Unit Economics
Cost per request, per tenant, per transaction — the actionable number.
Storage Costs
Tiering, lifecycle policies, retrieval charges and minimum durations.
Network & Egress Costs
Cross-zone and cross-region transfer that appears on no diagram.
Compute Optimisation
Instance families, utilisation, and architecture that wastes less.
Rightsizing
Matching provisioned resources to observed demand rather than to a guess.
Cost Allocation
Tagging enforced at provisioning, and apportioning shared costs.
Showback & Chargeback
Making teams see, or own, the cost of what they run.
Architecture Cost Modelling
Pricing a design before building it, at expected and at ten times volume.
Cost vs Reliability
Each nine costing an order of magnitude, and pricing the failure instead.
Observability Cost
Telemetry bills, cardinality control and retention tiering.
Licence & Vendor Costs
Per-core, per-seat and per-environment terms that shape designs.
FinOps Practice
Inform, optimise, operate — and cost as a design-review criterion.
Waste Elimination
Idle environments, orphaned volumes, forgotten instances, dead data.
Cost Governance
Budgets, anomaly alerts, quotas and preventive policy.