Model Evaluation Service · View 10 of 21 · Data
Decisions
- Immutability is the comparability mechanism, not data hygiene. A correction is a superseding record; a dataset fix is a new version.
- Policy lives in Git, outside every database, so the source of truth for a gate is reviewable and cannot be edited in place.
- Human labels sit in their own project and their own zone because they are what the judge is measured against.
Retention
- Verdicts 7 y · scores 5 y · traces 400 d (3 y for gate-blocking runs) · dataset versions and labels indefinite (stated assumptions).
Known tension
- A user deletion request tombstones an example: content removed, identity and slice labels retained. Aggregate comparability survives; full reproducibility from artefacts does not. This is Core Architecture Question 7, and it is open.
