Real-Time Analytics Platform  ·  View 04 of 21  ·  Structure

Container Architecture

The deployable units, the technology each runs on, and the protocol on every hop — what an engineering team actually builds and owns.

Editable source SVG draw.io All views
Azure Subscription · rta-prod
Azure Subscription · rta-prod
Ingestion spoke · snet-ingest
Ingestion spoke · snet-ingest
Azure Front Door
WAF · TLS 1.3
Azure Front Door...
API Management
Premium · per-tenant quota
API Management...
Event Collector
Container Apps · FastAPI
Event Collector...
Azure IoT Hub
per-device certificates
Azure IoT Hub...
CDC Connector
Debezium on ACA
CDC Connector...
Event backbone · snet-events
Event backbone · snet-events
Azure Event Hubs
Dedicated · 6 hubs
Azure Event Hubs...
Schema Registry
Avro · BACKWARD
Schema Registry...
Event Hubs Capture
Parquet · 15 min
Event Hubs Capture...
Dead-Letter Hub
14 d retention
Dead-Letter Hub...
Processing spoke · snet-compute
Processing spoke · snet-compute
Azure Databricks
VNet-injected · no public IP
Azure Databricks...
Streaming Jobs
1 s micro-batch
Streaming Jobs...
Checkpoint Store
ADLS Gen2 ZRS
Checkpoint Store...
Reference Delta Tables
broadcast joins
Reference Delta Tables...
Serving spoke · snet-serve
Serving spoke · snet-serve
Azure Data Explorer
leader · 12 nodes
Azure Data Explorer...
ADX Follower
read-only · BI
ADX Follower...
Query API
Container Apps · autoscale
Query API...
Azure Cache for Redis
Premium 26 GB
Azure Cache for Redis...
Power BI
Power BI
Managed Grafana
Managed Grafana
Microsoft Entra ID
Microsoft Entra ID
Azure Key Vault
Azure Key Vault
Azure Monitor
Azure Monitor
Microsoft Purview
Microsoft Purview
HTTPS
HTTPS
AMQP publish
AMQP publish
Kafka protocol
Kafka protocol
consumer group
consumer group
streaming ingest
streaming ingest
poison event
poison event
follower attach
follower attach
KQL
KQL
DirectQuery
DirectQuery
Container Architecture — Deployable Units
Container Architecture — Deployable Units
Security / platform
Security / platform
Interface / broker
Interface / broker
Application we own
Application we own
Queue / topic
Queue / topic
Data store
Data store
External / third party
External / third party
synchronous
synchronous
event / async
event / async
failure / alternate
failure / alternate
Every service reaches Event Hubs, ADLS and Key Vault over private endpoints; public network access is disabled.
Every service reaches Event Hubs, ADLS and Key Vault over private endpoints; public network access is disabled.
v 1.0 · owner Data & AI Architecture · date 2026-08
v 1.0 · owner Data & AI Architecture · date 2026-08
Text is not SVG - cannot display

Component decisions

  • Event Collector on Container Apps rather than Functions: long-lived AMQP connections and KEDA scaling
  • Debezium on Container Apps rather than Data Factory: log-based CDC with sub-second latency
  • Event Hubs Dedicated rather than Premium: 3.2 billion events/day is past the Premium ceiling

Network posture

  • Public network access disabled on Event Hubs, ADLS, Key Vault, ADX and Redis
  • Every hop uses a private endpoint and a managed identity; no connection strings anywhere
  • Databricks is VNet-injected with secure cluster connectivity and no public IP

Deliberate omissions

  • Follower cluster topology and workload groups are drawn in the query and serving view
  • Retry, dead-letter and backpressure paths are drawn in the stream processing view
  • Availability zones and DR region are drawn in the deployment view