Customer 360 Enterprise Data Platform — Denodo on Azure  ·  View 23 of 39  ·  Runtime

Real-Time Digital Activity

The one genuinely streaming path, and why Denodo does not read the stream.

Editable source SVG draw.io All views
Emit Web SDK page and product views Mobile SDK logins, taps Transport Event Hubs 32 partitions Schema Registry Avro, versioned Process Structured Streaming Databricks job ECID enrichment device to customer Sessionisation 30 min window Land Silver activity Delta, 13 months Checkpoints exactly once Unmatched holding device not yet resolved Expose bv_activity_delta federated, no cache Customer Digital Activity business view Consume Agent Desktop last activity AI Assistant Power BI hourly refresh 60 s target no ECID yet Real-Time Digital Activity — Sixty Seconds from Tap to the 360 External / third party Queue / topic Data store Application we own event / async failure / alternate Denodo reads the Delta table directly rather than the stream. Nothing in the logical layer is stateful, so an outage here shows as staleness, not as a broken view. v 1.0 · owner Data & AI Global Practice · date 2026-09

Decisions

  • Denodo reads the landed Delta table, not the Event Hub. Nothing in the logical layer is stateful, so a streaming outage shows up as staleness on one attribute rather than as a broken view.
  • Events whose device identifier has not yet resolved to an enterprise customer go to a holding table rather than being dropped or attached to a guess. They join the 360 on the next resolution pass.
  • Sessionisation happens once in the stream, not per query. Every consumer sees the same session boundaries.

Numbers

  • 60 seconds from tap to queryable on the 360; 32 partitions sized for a 4,000 events per second peak.
  • Silver activity retained 13 months; bronze landing 30 days.

Risks

  • The holding table grows if device-to-customer resolution degrades. It is monitored as a quality metric, not just as a pipeline metric, because a growing holding table means the 360 is quietly under-reporting activity.