Data Quality & Contracts
Expectations and assertions, schema evolution, producer-consumer contracts, and detecting silent corruption.
5concepts
62flashcards
35minutes of reading
- 01 Data Contracts as Producer Obligations Why moving the schema definition to the producer changes the economics of data quality, what a contract must contain beyond field types, and the organisational conditions under which contracts actually work.
- 02 Expectations, Assertions and Where to Put Them The categories of check a data pipeline can make, why the placement of a check matters more than the check itself, and the failure mode of testing only what is easy to test.