Customer 360 & Real-Time Risk Intelligence Platform  ·  View 02 of 20

High-Level Platform Architecture

The end-to-end shape in one picture: a Kafka event backbone and batch landing feeding a medallion lakehouse, orchestrated by Airflow, serving BI, APIs and event consumers.

Editable source SVG draw.io All views
Sources
Sources
Core / Cards / Loans
Oracle, DB2, Postgres
Core / Cards / Loans...
Digital Channels
Mobile, web, IVR
Digital Channels...
External Feeds
Bureau, sanctions
External Feeds...
Ingestion
Ingestion
CDC Connectors
Debezium
CDC Connectors...
Kafka Event Backbone
3 AZ, tiered storage
Kafka Event Backbone...
Batch & File Landing
SFTP, API pull
Batch & File Landing...
Processing
Processing
Stream Processing
Flink, enrich & dedup
Stream Processing...
Lakehouse Processing
Spark streaming
Lakehouse Processing...
Data Quality Gates
Expectations engine
Data Quality Gates...
Lakehouse
Lakehouse
Bronze — Raw
Immutable, replayable
Bronze — Raw...
Silver — Conformed
Deduped, SCD2
Silver — Conformed...
Gold — Customer 360
Marts & features
Gold — Customer 360...
Serving
Serving
SQL Warehouse
Serverless
SQL Warehouse...
Profile API
p99 under 50 ms
Profile API...
Gold Event Topics
Enriched, scored
Gold Event Topics...
Consumers
Consumers
Fraud & AML
Fraud & AML
BI & Analytics
BI & Analytics
ML & Data Science
ML & Data Science
sub-second
sub-second
enriched
enriched
under 2 s
under 2 s
profile cache
profile cache
High-Level Platform Architecture
High-Level Platform Architecture
External / third party
External / third party
Interface / broker
Interface / broker
Queue / topic
Queue / topic
Application we own
Application we own
Decision point
Decision point
Data store
Data store
event / async
event / async
synchronous
synchronous
Airflow orchestrates every batch and quality workflow; governance and security span all stages.
Airflow orchestrates every batch and quality workflow; governance and security span all stages.
v 1.0 · owner Enterprise Data Architecture · date 2026-08
v 1.0 · owner Enterprise Data Architecture · date 2026-08Text is not SVG - cannot display

Design stance

  • One backbone for both streaming and CDC traffic — no parallel integration estate
  • Bronze is the system of record for replay; everything downstream is rebuildable
  • Stream and batch converge on the same tables rather than on two competing stores

Latency budget

  • Producer to enriched topic: under 2 seconds at the 99th percentile
  • Enriched topic to silver table: under 5 minutes
  • Gold marts: 15-minute incremental, full rebuild nightly

Deliberate omissions

  • Governance, security and observability span every stage and are drawn separately
  • Retry, dead-letter and backpressure paths appear in the pipeline views
  • Per-source connector detail is in the onboarding-patterns view
Solution Architecture v1.0 · Enterprise Data Architecture · 2026-0802-high-level-architecture