Streaming Video Encoding & Packaging Pipeline  ·  View 05 of 22  ·  People and journeys

Journey — A Cold-Stored Title

The price of treating renditions as a cache, paid in the place where it is cheapest.

Editable source SVG draw.io All views
Viewer in the long tail 72% of hours, under 0.1% of viewing Goal — Watch an obscure title at the quality my screen deserves Trigger — A search, a deep link, a critic's list Done when — Plays within the same couple of seconds as anything else 1 · Find it search or deep link 2 · Press play ◆ moment of truth 3 · First segment ◆ moment of truth 4 · Keep watching What they do Opens the title page Presses play Waits, or does not notice Watches to the end What the platform does Manifest says what exists Cache miss on the top rung Request coalesced On-demand generation Nearest rung served Demand tier promoted How it feels Delighted Fine Frustrated Where it hurts p99 miss: 3.5 s to first byte What answers it Coalescing, so one encode serves all Fall back a rung rather than wait Second viewer gets a hit Journey — Viewer Plays a Cold-Stored Long-Tail Title This journey only exists because renditions are a cache. Its trough is the price of the critical design decision, paid where it is cheapest. v 1.0 · owner Media Platform Architecture

This journey is the cost of the design

  • An evicted rendition means a cache miss on a real viewer, and the honest answer is that the p99 of that miss is 3.5 seconds.
  • The architecture refuses to make them wait for it: past the budget they get the nearest resident rung, and the tier is promoted so the next viewer gets a hit.
  • A visible fallback is a deliberate trade. The alternative — pre-encoding the full ladder for 400,000 titles — is a storage bill paid for renditions that are never requested.

What makes it survivable

  • Coalescing: one generation serves every concurrent request for the same digest, so a sudden spike on an obscure title is one encode, not a thundering herd.
  • Content addressing: the digest the player's manifest asks for is exactly what the recipe will produce, so the miss is deterministic to fill.

Open

  • Where generation runs, and whether the fallback may be visible to the viewer at all, is Question 7 — the one question in the ask with a direct product consequence.