Model Evaluation Service  ·  View 15 of 21  ·  Runtime

Frame Change and Re-Baseline

Why editing one line of a rubric suspends gating and spends a day of compute.

Editable source SVG draw.io All views
Proposal Policy Change rubric · dataset · judge Quality Lead Review Impact Which Axis Moved 1 of 4 Re-Baseline Estimate suites × examples Decision Approve or Defer priced choice New frame Frame Registered Old Frame Retired artefacts kept Re-score Incumbent Re-Scored ≤ 12 h Charged to Budget Resume Gating Resumes Series Discontinuity Marked Frame Change — Why a Rubric Edit Costs a Re-Baseline External / third party Person or role Decision point Application we own Data store Security / platform Gating is suspended between frame registration and the incumbent's re-score. That pause is the honest cost of the critical design decision, and the reason the re-baseline budget is a standing line rather than an exception. v 1.0 · owner Data & AI Global Practice · date 2026-09

Decisions

  • Any of the four axes moving creates a new frame. The incumbent is re-scored; its stored number is never reinterpreted.
  • Gating is suspended between frame registration and the incumbent's re-score. The pause is declared, not discovered.
  • The old frame is retired but its artefacts are kept forever, so a past verdict stays reconstructible.

Cost

  • Re-baselining is a standing budget line, reported separately, so the price of a frame change is visible before it is approved (stated assumption: ≤ 12 h, ≤ $340 per gate-suite run).

Why it is worth it

  • The alternative is a quality chart assembled from measurements never taken the same way — confident numbers that mean nothing, produced indefinitely without ever erroring.