Batch & Streaming Pipelines
Event time versus processing time, watermarks, exactly-once semantics, backfills and orchestration.
5concepts
60flashcards
36minutes of reading
- 01 Exactly-Once Semantics, Precisely What "exactly once" actually guarantees, why it is a statement about effects rather than about deliveries, and the two mechanisms that provide it.
- 02 Watermarks and Allowed Lateness The heuristic that lets a streaming system decide a window is complete, why it is always wrong in one of two directions, and how triggers and lateness policies turn a single answer into a sequence of refinements.