Search the practice set
275 questions, 991 terms and 600 topics in 30 areas.
7 results for “Backfill & Reprocessing”
Backfill
Re-running a pipeline over historical periods to populate new data or correct a past error, and the operation that proves whether a pipeline is well designed.
Reprocessing Window
How far back a pipeline can be replayed, set by the shortest retention anywhere along the path rather than by intent.
Pipeline Orchestration
Coordinating the execution of data tasks by dependency rather than by clock, with retries, backfill and observability built in.
A logic bug means six months of a derived table are wrong. You must reprocess without disrupting live consumers. How?
Establish the blast radius first Which downstream tables, reports and extracts consumed the wrong data, and did any of it leave the organisation — a regulatory
A nightly pipeline failed halfway and the retry produced duplicate rows. Walk me through fixing this properly.
The immediate problem The task appends rather than replacing its window , so a partial run followed by a retry writes some rows twice. The data is now wrong in