Real-Time Analytics Platform  ·  View 03 of 21  ·  Structure

Layered Architecture

What depends on what. Dependencies point downward only; platform services are consumed by every layer above them.

Editable source SVG draw.io All views
Consumption
Consumption
Power BI
Power BI
Managed Grafana
Managed Grafana
Analytics Applications
Analytics Applications
Alerting & Automation
Alerting & Automation
Serving
Serving
Query API
REST over KQL
Query API...
KQL Functions
semantic layer
KQL Functions...
Result Cache
Azure Cache for Redis
Result Cache...
Gold Event Topics
Gold Event Topics
Analytics store
Analytics store
Azure Data Explorer
Azure Data Explorer
Materialized Views
Materialized Views
External Tables
ADLS Delta
External Tables...
Processing
Processing
Streaming Jobs
Azure Databricks
Streaming Jobs...
Enrichment & Joins
Enrichment & Joins
Windowed Aggregation
Windowed Aggregation
Replay & Backfill
Replay & Backfill
Event log
Event log
Azure Event Hubs
Azure Event Hubs
Schema Registry
Schema Registry
Bronze Capture
ADLS Gen2
Bronze Capture...
Dead-Letter Hub
Dead-Letter Hub
Ingestion
Ingestion
API Management
API Management
Event Collector
Event Collector
Azure IoT Hub
Azure IoT Hub
CDC Connectors
CDC Connectors
Platform services
Platform services
Microsoft Entra ID
Microsoft Entra ID
Azure Key Vault
Azure Key Vault
Azure Monitor
Azure Monitor
Microsoft Purview
Microsoft Purview
Azure DevOps
Terraform
Azure DevOps...
HTTPS
HTTPS
KQL
KQL
ingest sink
ingest sink
consume
consume
publish
publish
push
push
Layered Architecture
Layered Architecture
External / third party
External / third party
Interface / broker
Interface / broker
Application we own
Application we own
Data store
Data store
Queue / topic
Queue / topic
Security / platform
Security / platform
synchronous
synchronous
event / async
event / async
Dependencies point downward only. Gold topics are the one sanctioned shortcut past the serving layer.
Dependencies point downward only. Gold topics are the one sanctioned shortcut past the serving layer.
v 1.0 · owner Data & AI Architecture · date 2026-08
v 1.0 · owner Data & AI Architecture · date 2026-08
Text is not SVG - cannot display

Dependency rule

  • A layer may call the layer directly below it and never the one above
  • Consumption never reaches past serving into the analytics store; no direct cluster access for BI users
  • Metric semantics live in versioned KQL functions, not in dashboard definitions

Why layered at all

  • Lets the hot store be replaced without renegotiating consumption contracts
  • Makes the blast radius of a change explicit before it is made
  • Gives each layer a distinct owning team and a distinct on-call rota

Known tension

  • Latency-critical consumers read gold event topics directly, bypassing the serving layer
  • That shortcut is explicit, contract-governed and rate-limited, not accidental coupling
  • Any new bypass requires an architecture decision record, not a configuration change