AI Agent Orchestration Platform  ·  View 02 of 32  ·  1 · Context and scope

High-Level Architecture

The shape of the platform in one picture, for the reader who will see only one.

Editable source SVG draw.io All views
Entry Front Door WAF · anycast Platform API APIM · OIDC SDK, CLI, Console Python · .NET · TS Admission Admission Service resolve and pin Policy Engine OPA · signed bundle Budget Guard cost and token cap Orchestration Durable Orchestrator Durable Functions Scheduler priority classes Agent Coordinator multi-agent patterns Approval Service external events Agent runtime Agent Executor Container Apps Context Manager assemble · compress Guardrail Chain Content Safety Session Sandbox dynamic sessions Model and tool access AI Gateway APIM GenAI policy Tool Broker MCP · REST Memory Service scoped retrieval Evidence Execution Store Cosmos DB Trace and Cost Monitor · ADX Audit Ledger immutable blob checkpoint spans decision AI Agent Orchestration Platform — High-Level Architecture Interface / broker Application we own Security / platform Data store synchronous event / async One picture for the reader who sees only one. Tenancy, regions and failure paths are later views. v 1.0 · owner Data & AI Global Practice · date 2026-08

Decisions

  • Admission is a distinct stage: versions are pinned, policy is evaluated and budget is reserved before any orchestration starts
  • Every model and tool call leaves through a gateway, so metering, guardrails and egress control cannot be bypassed
  • Evidence is produced on the same path as work, not reconstructed afterwards from logs

Targets

  • Control plane availability 99.9 percent; tier-1 execution 99.9 percent, tier-2 99.5 percent
  • Orchestration overhead p95 under 120 ms per step, excluding model and tool latency
  • Streaming first token p95 under 900 ms; 5,000 concurrent executions at peak

Deliberately omitted

  • Regions and failure domains — see Deployment Topology
  • Tenant isolation — see Multi-Tenancy
  • Every failure path — see Durable Execution and Failure Modes
◀  System Context All views Control Plane and Execution Plane  ▶
Solution Architecture v1.0 · Data & AI Global Practice · 2026-08 · 32 views · Microsoft Azure02-high-level-architecture