Streaming Video Encoding & Packaging Pipeline  ·  View 11 of 22  ·  Data

Storage Zones

Three zones ordered by what loss costs, and only the top one is backed up.

Editable source SVG draw.io All views
Irreplaceable — replicated, locked, never derived Master custody Mezzanine masters dual-region archive Retention lock 7 years Recipe custody Recipes immutable, addressed Encoder build registry pinned digests Evidence Audit log append-only, 7 y Gate scores BigQuery, 7 y Recoverable — RPO 5 s, rebuildable from the zone above Control state Job & chunk tasks Spanner Lane accounting Serving projection Catalogue projection rebuildable Manifest cache Memorystore, 30 s Disposable — no RPO by design, regenerated not restored Hot renditions Top-demand renditions standard class Encrypted segments content-addressed Cooling and absent Demoted renditions nearline / coldline Evicted renditions regenerate on demand Chunk scratch TTL 48 h regenerate rebuild Storage Zones — Ownership, Durability and Rebuildability Data store Security / platform Risk / gap event / async batch Zones are ordered by what loss costs. Only the top zone is backed up; the bottom zone is deliberately not. v 1.0 · owner Media Platform Architecture

The disposable zone is the point

  • Renditions and segments have no RPO by design. Loss is a regeneration, budgeted at 30 minutes p95 for a title's launch subset.
  • Stating that explicitly is what stops someone later adding dual-region replication to 1.2 million rendition sets and quietly tripling the storage bill to protect something regenerable.

Why evidence sits in the top zone

  • Gate scores and the audit log are irreplaceable for the same reason the recipe is: they record a decision, and a decision cannot be recomputed from the artefact it produced.
  • Seven-year retention on both, append-only, not writable by pipeline identities beyond append.

Recoverable, not irreplaceable

  • Job state and the catalogue projection carry RPO 5 s and RTO 15 min. The projection is rebuildable from job state, so it is replicated for speed rather than for survival.