Term Kind Topic What it is
Absence-As-Delete Sync Full-Sync Delete Semantics, Destructive Sync concept Reverse ETL A synchronisation mode that treats a record's absence from the source query as an instruction to remove or clear it downstream - so any query returning fewer rows becomes a mass deletion in a live operational …
Analytical Estate Topology concept Data Platform Architecture The full picture of where analytical data lands, is transformed and is served, including the paths that bypass the intended one.
Attribute History Strategy concept Slowly Changing Dimensions The per-attribute decision about whether history is overwritten, versioned or kept alongside the current value, which is a business question rather than a technical one.
Batch Orchestration Workflow Orchestration, DAG Scheduling concept Batch Orchestration Running interdependent data jobs in the right order with retries, backfills and failure handling, expressed as a dependency graph rather than a schedule.
Bronze Layer Contract concept Medallion Architecture What the raw landing zone promises and refuses to promise — a faithful replayable copy of the source, with no correction applied.
Business Key Collision Hub Key Collision, False Identity Match concept Data Vault Modelling Two different real-world entities merging into one hub row because the key chosen for it is unique only inside one source system - a corruption that raises no error and is expensive to unpick.
Bytes Scanned Scan Volume, Data Processed concept Analytics Cost Control The volume of data a query reads - which in consumption-priced analytical systems is both the performance limit and the bill, making layout a cost control.
Clustering Decay Sort Order Drift, Layout Degradation concept Storage Layout & Partitioning The gradual loss of data-skipping as newly written files overlap the sort order of existing ones - so query cost rises month after month with no change to the query or the data volume.
Compute Isolation Boundary concept Data Platform Tenancy The line across which one domain's analytical workload cannot affect another's performance, cost attribution or access.
DAG Dependency concept Batch Orchestration The declared edge stating that one task must not start until another has succeeded, and the difference between that and merely running later.
Data Layout Partitioning and Clustering, File Organisation, Pruning Effectiveness concept Storage Layout & Partitioning How table data is physically organised into partitions and files, which determines how much can be skipped at query time - and is the dominant factor in analytical cost and performance, ahead of cluster size.
Data Platform Architecture Analytical Platform Architecture, Data Stack Architecture concept Data Platform Architecture The arrangement of ingestion, storage, transformation, serving and governance that decides whether analytical data arrives on time, means the same thing to everyone and costs a predictable amount.
Data Platform Tenancy concept Data Platform Tenancy How a shared data platform separates domains and customers across storage, compute, catalogue and access control.
Fact Grain Multiplication Join Fan-Out, Dimension Row Explosion concept Slowly Changing Dimensions Silent duplication of fact rows when a fact is joined to a versioned dimension without an effective-date predicate, inflating every additive measure in proportion to how often dimension members change.
Ingestion Pattern concept Ingestion Patterns The mechanism by which data leaves a source system, which determines freshness, source load and how faithfully change is captured.
Lakehouse concept Warehouse, Lake & Lakehouse An architecture combining a lake's cheap open storage with a warehouse's transactions, schema enforcement and query performance, through a table format layer.
Layer Contract Guarantee Not Position, Medallion Discipline concept Medallion Architecture The rule that a data layer is defined by the guarantee it makes to consumers, not by its position in a naming convention - without which the layers convey nothing.
Legitimate Divergence Expected Parallel-Run Difference, Correct-on-Both-Sides Delta concept Warehouse Migration The class of differences between an old and a new analytical platform that are correct on both sides, which a parallel run must classify and budget for rather than investigate as defects.
Metadata Read Amplification Planning-Time Amplification, Manifest Read Blow-Up concept Open Table Formats The number of small sequential metadata requests a table format issues before reading any data, which grows with file history and turns a modest storage slowdown into a large query slowdown.
Partition Pruning concept Storage Layout & Partitioning The query engine skipping entire partitions whose values cannot match the filter, which is where most large-table query performance comes from.
Predicate Pushdown Filter Pushdown, Pushdown Optimisation concept Data Virtualisation Sending a filter to the layer that holds the data rather than fetching rows and filtering afterwards, which is the difference between reading megabytes and reading a table.
Scheduler Control Plane concept Workflow Schedulers The orchestrator's own state and availability, which becomes a critical dependency for every pipeline it runs.
Silent Coercion Type Coercion on Ingest, Quiet Data Corruption concept Ingestion Patterns An ingestion pipeline converting a value it did not expect rather than rejecting it - the worst available failure mode, because the load succeeds and the data is wrong downstream with nothing indicating it.
Small File Problem concept File Formats & Compaction The severe query degradation caused by a table stored as very many tiny files, where per-file overhead dominates actual data reading.
SQL Transformation Model concept Transformation Frameworks A named, versioned, tested SELECT statement that declares its own dependencies, turning transformation logic into reviewable software.
Wall-Clock Schedule Hazard Local-Time Trigger Hazard, DST Schedule Ambiguity concept Batch Orchestration The class of batch faults caused by triggering work on a civil clock that repeats, skips or shifts, producing duplicate or missing runs that no job reports as an error.
Warehouse Concurrency Scaling concept Workload Isolation Adding compute clusters to absorb concurrent queries rather than queueing them, and the cost behaviour that turns a queue into a bill.
Zombie Task Orphaned Task, Heartbeat-Expired Task concept Batch Orchestration A task whose worker has stopped reporting to the scheduler but whose process may still be running and writing, so the orchestrator retries work that has not actually stopped.