Autoscaling Controller  ·  View 27 of 37  ·  5 · Operations

Deployment Architecture

One region, three zones, and what surviving the loss of one of them actually means.

Editable source SVG draw.io All views
Azure · Sweden Central · control plane Zone 1 AKS System Pool 3 nodes Decision Pods shards 0-2 Reconciler Pods 4 replicas Zone 2 AKS System Pool 3 nodes Decision Pods shards 3-5 Reconciler Pods 4 replicas Zone 3 AKS System Pool 3 nodes Decision Pods standby shards Signal Collectors 6 replicas Zone-redundant regional services Authoritative state PostgreSQL Flexible sync standby · RPO 0 Lease Store etcd via AKS Signal and evidence Mimir 3 AZ · Blob backend Event Hubs zone redundant Data Explorer leader-follower Platform Key Vault private endpoint Grafana Alertmanager Managed VMSS Fleets 50k -> 200k instances Managed Node Pools the fleet under them desired write actuate remote write Deployment — One Region, Three Availability Zones Application we own Data store Security / platform Queue / topic External / third party synchronous event / async Losing one zone loses one third of the decision shards and no desired state. The remaining zones take the leases; already-declared capacity keeps converging throughout. v 1.0 · owner Data & AI Global Practice · date 2026-09

Decisions

  • Decision shards are spread across zones so losing one zone loses a third of the shards and no desired state.
  • PostgreSQL runs zone-redundant with a synchronous standby: RPO 0, RTO ≤ 60 s.
  • Already-declared capacity keeps converging throughout a zone loss, because the reconciler needs only the desired-state read.

Sizing

  • Controller infrastructure budgeted under 1.5% of managed fleet compute spend.
  • Signal collectors scale with sample rate, decision pods with target count, reconcilers with instance count — three independent axes.

Assumptions

  • The controller's own AKS node pool is statically sized and excluded from its own management, to avoid a loop that scales itself.
  • Private endpoints throughout; no public ingress to any control-plane component.