Anatomy of a web stack under load
Every request a steel ball. Turn the traffic up until the queues fill, the p99 explodes and the load balancer starts refusing.A three-tier web stack built as a marble run: requests queue in a trough, app-server drums hold them for their service time, the cache answers most, and the rest wait for a database connection. Spike…