Enterprise Generative Search — Azure and Open Source

Solution Architecture v1.0 · Data & AI Global Practice · 2026-09 · 41 views · Microsoft Azure and open source

A generative search platform is not an LLM in front of a search box. It is a retrieval system with a language model attached to the end of it, and almost every failure it has is a retrieval, authorisation or evidence failure wearing a model's clothes. This package architects one for 45,000 employees over 40 million documents drawn from Microsoft 365, Confluence, ServiceNow, a 12 TB scanned archive, governed Databricks tables and 40 external domains — hybrid retrieval, a bounded agentic loop, claim-level grounding, and continuous evaluation as a release gate.

41 views 41 HTML views41 SVG41 draw.io 1 document Updated 2026-09-06
Architecture views

41 views, each in three formats.

Open a view to read it in full. Every SVG carries its diagram source inside it, so it opens in diagrams.net fully editable with no import step; the draw.io files are the same diagrams as plain source.

  1. 01
    System Context

    Who asks, what the platform reads, and what it deliberately never writes to.

  2. 02
    High-Level Architecture

    The shape of a request in one picture: understand, plan, retrieve, rank, generate, assure.

  3. 03
    The Evidence Contract

    The three rules the rest of the architecture is a consequence of.

  4. 04
    Query Classes and Routing

    Six classes of question, and what each is allowed to spend before anything is generated.

  5. 05
    Actors and Their Core Journeys

    Who the platform is for, in their own words, and what each of them gets to do with it.

  6. 06
    Journey — Ask and Act

    What happens in the first four seconds, and why the trough is not latency.

  7. 07
    Journey — Multi-Hop Under Review

    Where an averaged answer is worse than no answer at all.

  8. 08
    Journey — Why Is My Document Not Found

    The journey that decides whether content owners trust the platform or blame it.

  9. 09
    Layered Architecture

    Eight layers, dependencies pointing down, and the single upward call drawn rather than hidden.

  10. 10
    Container Architecture

    The deployable units, their technology, and which of them hold GPUs or credentials.

  11. 11
    Query Understanding

    How a sentence becomes a typed, authorised, replayable plan.

  12. 12
    Retrieval Fabric

    Four backends behind one contract, and what that contract obliges each of them to accept and return.

  13. 13
    Integration Surface

    Four published interfaces, and every system the platform depends on.

  14. 14
    Source Connector Matrix

    How each of the six sources is read, authorised, refreshed and parsed.

  15. 15
    Model Portfolio

    Six model tasks, where each runs, what each costs, and what happens when it is unavailable.

  16. 16
    Knowledge Ingestion Pipeline

    From a change in a source system to a chunk that can be retrieved and cited.

  17. 17
    Storage Zones

    Four zones, and the only one of them that has a recovery point objective.

  18. 18
    Chunking and Representation

    Seven content types, seven strategies, and why one setting for all of them fails.

  19. 19
    Evidence Data Model

    Fifteen entities, and the one join that makes an answer auditable.

  20. 20
    Permission Propagation

    How authorisation travels from a source system to a filter, a cache key and an audit record.

  21. 21
    Freshness Lifecycle

    The loop that keeps the index honest about time, and publishes it when it is not.

  22. 22
    Ask to Answer — The Critical Path

    One request, twenty-one messages, and the re-retrieval that is the normal case rather than the exception.

  23. 23
    The Bounded Agentic Loop

    Where the model is allowed to decide, and the three things it never decides.

  24. 24
    Hybrid Retrieval and Fusion

    Three hundred candidates down to eight passages, and what each stage is allowed to remove.

  25. 25
    Context Assembly

    Six slots, their trust levels, their budgets, and what is sacrificed when the window is short.

  26. 26
    Grounding and Verification

    How a fluent draft becomes claims that either hold, get re-retrieved, or are withdrawn.

  27. 27
    Structured Retrieval and Tools

    The model names an intent; the broker and the guard decide what actually runs.

  28. 28
    Multimodal Retrieval

    Five modalities, how each is represented and matched, and the limit each one has.

  29. 29
    Degradation Ladder

    Five rungs down from a full answer, and why the bottom rung is still a working product.

  30. 30
    Deployment Architecture

    Two regions, four node pools, and a failover that does not depend on replicating a search index.

  31. 31
    CI/CD and Index Migration

    Code, prompts, index schemas and models through one path with the same gates.

  32. 32
    Evaluation Harness

    Six layers of measurement, what each blocks, and how often each runs.

  33. 33
    RAGOps Loop

    How one bad answer becomes a fixed system and a permanent test.

  34. 34
    Observability and Tracing

    One trace id across seven stages, so a wrong answer has a cause rather than an argument.

  35. 35
    Cost Model

    What a query costs, what each line scales with, and which lever actually moves the total.

  36. 36
    Security Zones

    Five trust zones, and every flow that crosses one.

  37. 37
    Identity and Authorisation

    Sixteen messages from a login to a filtered query, with no application identity anywhere in them.

  38. 38
    Untrusted Content and Prompt Injection

    Six concrete attacks, the control for each, and the residual risk stated rather than implied.

  39. 39
    Sensitive Data and Tenant Isolation

    Classified once at ingest, enforced everywhere afterwards by a filter.

  40. 40
    Governance and Audit

    From a written policy to evidence an auditor accepts, without a single interpretive step.

  41. 41
    Failure Modes

    Fifteen named failures across four planes, each with a detector and an owner.

Documents

The written architecture.

The package

Everything as it was delivered.

These files are served exactly as they were produced — the diagram pages keep their own house style because that is the artifact, not a rendering of it.