Search the practice set

126 questions, 454 terms and 400 topics in 20 areas.

8 results for “Research & Evaluation”

Terminology · 4

LLM Evaluation

A repeatable measurement of whether an AI system's outputs are good enough, on cases that reflect the actual task.

Architecture Trade-off Analysis Method

A structured evaluation that scores an architecture against prioritised quality-attribute scenarios and identifies the points where those attributes conflict.

Architecture Decision-Making term

Prompt Registry

A versioned store of production prompts with their model bindings, parameters and evaluation results, so a prompt change is a reviewable, traceable, reversible deployment.

AI-Era Architecture term

Prompt Versioning

Treating prompts as versioned, reviewed, tested artefacts rather than as strings edited in place.

AI-Era Architecture

Questions · 1

quiz

An LLM feature that worked last week now gives worse answers. Nothing was deployed. How do you find out what changed, and what should have been in place?

What the interviewer is testing Whether you treat an AI feature as a system with configuration and dependencies, or as a black box that mysteriously drifts. Wha

AI-Era Architecture

Topics · 3

topic

Research & Evaluation

Assessing a technology quickly without adopting it by accident.

The Architect's Meta-Skills — no content yet topic

LLM Evaluation

Held-out sets, rubric judging, CI gates and production sampling.

AI-Era Architecture — no content yet topic

Model Selection

Capability, latency, cost and the evaluation that decides between them.

AI-Era Architecture — no content yet