Multimodal RAG Platform  ·  View 12 of 16

CI/CD & Environment Promotion

How a change reaches production, and what stops a bad one — including a bad prompt.

Editable source SVG draw.io All views
Source
Source
Git Repository
trunk + short branches
Git Repository...
Infrastructure as Code
Infrastructure as Code
Prompt & Eval Assets
versioned with code
Prompt & Eval Assets...
Build
Build
CI Pipeline
CI Pipeline
Container Build
SBOM, signed
Container Build...
Unit & Contract Tests
Unit & Contract Tests
Gates
Gates
Security Scan
SAST, deps, image
Security Scan...
RAG Eval Gate
recall, groundedness
RAG Eval Gate...
Cost Guard
cost per query
Cost Guard...
Environments
Environments
Development
Development
Staging
production-like corpus
Staging...
Production
canary 10%
Production...
Operate
Operate
GitOps Sync
desired state
GitOps Sync...
Telemetry
Telemetry
Rollback
one revert commit
Rollback...
quality regression, block
quality regression, block
auto revert on SLO breach
auto revert on SLO breach
CI/CD and Environment Promotion
CI/CD and Environment Promotion
Application we own
Application we own
Decision point
Decision point
Security / platform
Security / platform
failure / alternate
failure / alternate
A prompt or chunking change goes through the same gates as a code change. Both move answer quality.
A prompt or chunking change goes through the same gates as a code change. Both move answer quality.
v 1.0 · owner Platform Engineering
v 1.0 · owner Platform Engineering
Text is not SVG - cannot display

Gates

  • Security scan — SAST, dependencies, container image
  • RAG eval gate — recall and groundedness against the golden set
  • Cost guard — cost per query must not regress

Promotion

  • Dev, then staging on a production-like corpus, then a 10% canary
  • GitOps sync from declared desired state
  • Rollback is one revert commit

The key discipline

  • Prompts, chunking config and eval sets are versioned with the code
  • A prompt change goes through the same gates as a code change
  • Both move answer quality, so both are release-controlled