Service Mesh Platform  ·  View 08 of 31  ·  3 · Structure

Container Architecture — One Workload Cluster

What runs inside one of the twenty clusters, which pool each piece lives in, and the four things it reaches outside the cluster.

Editable source SVG draw.io All views
Cluster c07 · site A · Kubernetes Platform node pool Control plane Kubernetes API 3 × etcd istiod 3 replicas · HPA Admission guards Gatekeeper · VAP Identity SPIRE server 3 replicas SPIRE datastore CloudNativePG Workload node Pod · checkout checkout app unaware of mesh Envoy sidecar native sidecar Node agents · DaemonSets SPIRE agent Workload API OTel collector bounded queue Cilium agent eBPF · policy Gateway node pool East-west gateway BGP VIP · passthrough Egress gateway declared hosts OpenBao PKI site A Telemetry stores Thanos · Tempo · ClickHouse Remote clusters their east-west gateways watch delta xDS SVIDs localhost CA renewal OTLP mTLS · SNI Container Architecture — One Workload Cluster Security / platform Application we own Data store Interface / broker External / third party synchronous event / async Omitted for legibility: Argo CD applying to the API (view 14), sidecar to agent over SDS (view 16), sidecar to collector (view 15). v 1.0 · owner Platform Networking Architecture · date 2026-09

Decisions

  • Mesh control and identity run on a dedicated platform node pool with its own capacity reservation. A noisy tenant cannot starve istiod or the SPIRE server.
  • Every cluster has its own istiod and its own SPIRE server. That per-cluster split is how the control plane is sharded: no replica ever holds more than one cluster's 2,000 proxy connections.
  • The sidecar is a Kubernetes native sidecar (an init container that keeps running). The kubelet starts it before the app and stops it after, which removes the startup and shutdown races sidecars used to have.

Targets

  • istiod: three replicas across three rooms, any one sufficient for the cluster. SPIRE server: three replicas on a CloudNativePG datastore with a synchronous standby.

Risks

  • The SPIRE datastore is the one stateful component per cluster. It is backed up nightly and can be rebuilt from scratch in about an hour, because registration entries are derived from Kubernetes objects.