Feature Store  ·  View 06 of 21  ·  Structure

Layered Architecture

Seven layers, with definition below materialisation because materialisation reads a compiled plan and never a live definition.

Editable source SVG draw.io All views
Experience Catalogue & search Feature health view Skew report Registry API Access Serving API gRPC Client SDK batching, no value cache On-demand runtime Training-set service Quotas & criticality Stores Online store latest value Offline store full history Training-set artefacts Serving log Materialisation Stream processor Batch engine Backfill runner isolated pool Contract guard Definition Definition repo Git Compiler Registry Lineage graph Duplicate detector Observability Freshness SLOs Skew replay Drift monitors Cost attribution Sources Event streams Warehouse Courier telemetry Weather & traffic compiled plans latest value append read as-of read sampled vectors Feature Store — Layered Architecture Application we own Interface / broker Security / platform Data store External / third party batch synchronous Definition sits below materialisation because materialisation reads a compiled plan, never a live definition. v 1.0 · owner Data Platform Architecture · date 2026-09

Decisions

  • Definition sits below materialisation deliberately. If materialisation read the registry live, a definition edit would silently change values mid-run.
  • Observability is a layer, not a sidecar: freshness SLOs, skew replay and drift attribution are how the platform proves its central claim.
  • The client SDK may cache immutable metadata and never feature values. A cached value is an undetectable staleness bug.

Assumptions

  • Compiled plans are cached locally by the serving tier, which is what lets serving survive 60 minutes of registry unavailability.

Deliberately omitted

  • Six of the fourteen inter-layer edges are drawn; the rest would restate what the layer order already says.