Portfolio ↗

Quiz

2908 questions of the kind that actually get asked — in interviews, in architecture review boards, and by the person who has to run the thing at 3 AM. Every answer states the trade-off rather than the slogan, and says when the obvious choice is the wrong one.

All areas2908 Architecture Fundamentals91 Distributed Systems101 Data Architecture90 Cloud Architecture87 Networking86 API & Integration Architecture87 Reliability & Resilience99 Observability92 Performance & Capacity Engineering100 Security Architecture95 Cost Architecture & FinOps102 Business Architecture103 Architecture Communication102 Enterprise Architecture100 Legacy Modernization92 AI-Era Architecture96 Software Architecture & Engineering93 Architecture Patterns94 Architecture Decision-Making101 The Architect's Meta-Skills102 Delivery & Release Engineering103 Platform Engineering & Developer Experience102 Testing & Quality Architecture102 Data Platform Architecture98 Streaming & Real-Time Data103 Data Governance & Semantics91 Frontend & Experience Architecture101 Edge, Mobile & IoT98 Regulatory & Data Protection Architecture99 Assurance, Audit & Model Risk98
Difficulty Any beginner intermediate advanced

2 questions in Model Selection.

  1. Model Selection advanced

    A cascade sends every request to a small model and escalates to the frontier model when the small model's self-reported confidence is low. Escalation ran at 18% in week one. After a prompt edit meant to stop the small model hedging, escalation fell to 2% and cost per request fell 40%. Three weeks later a customer audit finds a run of wrong answers. What failed, and which design decision allowed it?

    3 min answer model-selectioncascaderoutingquality-signals
  2. Model Selection advanced

    A platform must choose which model serves which request class. What should drive the decision, and what changes over time?

    2 min answer model-selectionroutingevaluationcost