Autoscaling Controller  ·  View 21 of 37  ·  4 · Runtime

Stability and Oscillation Control

Five mechanisms in series, and the record that every suppression leaves behind.

Editable source SVG draw.io All views
Dead band Hysteresis 15% of setpoint Noise Below Band no change at all Persistence Sustain Out 2 intervals Sustain In 6 intervals Rate limit Growth Cap +100% / 60 s Reduction Cap -10% / 60 s Cooldown Scale-In Suppressed while still arriving Pending Capacity not yet serving Guard Oscillation Detector 3 reversals / 15 min Freeze and Alert names the signal Record Suppressed Decision a distinct outcome still becoming serving reversal 3 no change suppressed Stability — What Stops the Loop Fighting Itself Application we own Security / platform Decision point Risk / gap Data store synchronous event / async Scale-out and scale-in are deliberately asymmetric. Every suppression is journalled as its own outcome, so "nothing happened" is a fact with a reason rather than an absence. v 1.0 · owner Data & AI Global Practice · date 2026-09

The decision

  • Hysteresis, sustain windows and delta rate limits — timers and bands, not a control law.
  • Chosen for explainability: an operator at 3am can reason about "it waited six intervals" and cannot reason about a clamped integral term.
  • A PI controller with a clamped integral is kept as an alternative policy form for phase 3, for targets whose plant delay is stable enough to tune against.

Numbers, all stated assumptions

  • Dead band 15% of setpoint. Sustain 2 intervals out, 6 in.
  • Rate limit +100% growth, -10% reduction per 60 s window.
  • Oscillation freeze at 3 direction reversals in 15 minutes, naming the signal that reversed.
  • No target loses more than 10% of capacity in any 60 s window.

Why asymmetric

  • Being late to add capacity costs latency. Being wrong to remove it costs availability.
  • Scale-in is suppressed entirely while capacity added in the last cooldown window is still becoming serving, so the loop never reacts to its own unfinished actuation.