Enterprise Generative Search — Azure and Open Source
A generative search platform is not an LLM in front of a search box. It is a retrieval system with a language model attached to the end of it, and almost every failure it has is a retrieval, authorisation or evidence failure wearing a model's clothes. This package architects one for 45,000 employees over 40 million documents drawn from Microsoft 365, Confluence, ServiceNow, a 12 TB scanned archive, governed Databricks tables and 40 external domains — hybrid retrieval, a bounded agentic loop, claim-level grounding, and continuous evaluation as a release gate.
41 views, each in three formats.
Open a view to read it in full. Every SVG carries its diagram source inside it, so it opens in diagrams.net fully editable with no import step; the draw.io files are the same diagrams as plain source.
-
01
System Context
Who asks, what the platform reads, and what it deliberately never writes to.
-
02
High-Level Architecture
The shape of a request in one picture: understand, plan, retrieve, rank, generate, assure.
-
03
The Evidence Contract
The three rules the rest of the architecture is a consequence of.
-
04
Query Classes and Routing
Six classes of question, and what each is allowed to spend before anything is generated.
-
05
Actors and Their Core Journeys
Who the platform is for, in their own words, and what each of them gets to do with it.
-
06
Journey — Ask and Act
What happens in the first four seconds, and why the trough is not latency.
-
07
Journey — Multi-Hop Under Review
Where an averaged answer is worse than no answer at all.
-
08
Journey — Why Is My Document Not Found
The journey that decides whether content owners trust the platform or blame it.
-
09
Layered Architecture
Eight layers, dependencies pointing down, and the single upward call drawn rather than hidden.
-
10
Container Architecture
The deployable units, their technology, and which of them hold GPUs or credentials.
-
11
Query Understanding
How a sentence becomes a typed, authorised, replayable plan.
-
12
Retrieval Fabric
Four backends behind one contract, and what that contract obliges each of them to accept and return.
-
13
Integration Surface
Four published interfaces, and every system the platform depends on.
-
14
Source Connector Matrix
How each of the six sources is read, authorised, refreshed and parsed.
-
15
Model Portfolio
Six model tasks, where each runs, what each costs, and what happens when it is unavailable.
-
16
Knowledge Ingestion Pipeline
From a change in a source system to a chunk that can be retrieved and cited.
-
17
Storage Zones
Four zones, and the only one of them that has a recovery point objective.
-
18
Chunking and Representation
Seven content types, seven strategies, and why one setting for all of them fails.
-
19
Evidence Data Model
Fifteen entities, and the one join that makes an answer auditable.
-
20
Permission Propagation
How authorisation travels from a source system to a filter, a cache key and an audit record.
-
21
Freshness Lifecycle
The loop that keeps the index honest about time, and publishes it when it is not.
-
22
Ask to Answer — The Critical Path
One request, twenty-one messages, and the re-retrieval that is the normal case rather than the exception.
-
23
The Bounded Agentic Loop
Where the model is allowed to decide, and the three things it never decides.
-
24
Hybrid Retrieval and Fusion
Three hundred candidates down to eight passages, and what each stage is allowed to remove.
-
25
Context Assembly
Six slots, their trust levels, their budgets, and what is sacrificed when the window is short.
-
26
Grounding and Verification
How a fluent draft becomes claims that either hold, get re-retrieved, or are withdrawn.
-
27
Structured Retrieval and Tools
The model names an intent; the broker and the guard decide what actually runs.
-
28
Multimodal Retrieval
Five modalities, how each is represented and matched, and the limit each one has.
-
29
Degradation Ladder
Five rungs down from a full answer, and why the bottom rung is still a working product.
-
30
Deployment Architecture
Two regions, four node pools, and a failover that does not depend on replicating a search index.
-
31
CI/CD and Index Migration
Code, prompts, index schemas and models through one path with the same gates.
-
32
Evaluation Harness
Six layers of measurement, what each blocks, and how often each runs.
-
33
RAGOps Loop
How one bad answer becomes a fixed system and a permanent test.
-
34
Observability and Tracing
One trace id across seven stages, so a wrong answer has a cause rather than an argument.
-
35
Cost Model
What a query costs, what each line scales with, and which lever actually moves the total.
-
36
Security Zones
Five trust zones, and every flow that crosses one.
-
37
Identity and Authorisation
Sixteen messages from a login to a filtered query, with no application identity anywhere in them.
-
38
Untrusted Content and Prompt Injection
Six concrete attacks, the control for each, and the residual risk stated rather than implied.
-
39
Sensitive Data and Tenant Isolation
Classified once at ingest, enforced everywhere afterwards by a filter.
-
40
Governance and Audit
From a written policy to evidence an auditor accepts, without a single interpretive step.
-
41
Failure Modes
Fifteen named failures across four planes, each with a detector and an owner.
The written architecture.
Everything as it was delivered.
These files are served exactly as they were produced — the diagram pages keep their own house style because that is the artifact, not a rendering of it.