Portfolio ↗

Quiz

2948 questions of the kind that actually get asked — in interviews, in architecture review boards, and by the person who has to run the thing at 3 AM. Every answer states the trade-off rather than the slogan, and says when the obvious choice is the wrong one.

All areas2948 Architecture Fundamentals91 Distributed Systems101 Data Architecture90 Cloud Architecture87 Networking96 API & Integration Architecture87 Reliability & Resilience99 Observability92 Performance & Capacity Engineering100 Security Architecture105 Cost Architecture & FinOps102 Business Architecture103 Architecture Communication102 Enterprise Architecture100 Legacy Modernization102 AI-Era Architecture106 Software Architecture & Engineering93 Architecture Patterns94 Architecture Decision-Making101 The Architect's Meta-Skills102 Delivery & Release Engineering103 Platform Engineering & Developer Experience102 Testing & Quality Architecture102 Data Platform Architecture98 Streaming & Real-Time Data103 Data Governance & Semantics91 Frontend & Experience Architecture101 Edge, Mobile & IoT98 Regulatory & Data Protection Architecture99 Assurance, Audit & Model Risk98
Difficulty Any beginner intermediate advanced

5 questions in Human in the Loop.

  1. Human in the Loop advanced

    A content pipeline auto-approves items above a confidence threshold and routes the rest to human review. Review queue p95 waiting time was 4 minutes and is now 70 minutes. Item volume is flat, reviewer headcount is unchanged, and the model has not been redeployed. Where is the time going?

    3 min answer human in the loopqueueingutilisationescalation rate
  2. Human in the Loop advanced

    A pipeline combines automated processing with human review at scale. How should the boundary between them be designed?

    2 min answer scale-aihuman-in-looproutingquality
  3. Human in the Loop intermediate

    A platform uses AI to propose substitutions when items are unavailable. Where should the human sit in the loop, and what determines it?

    2 min answer human-in-the-loopautonomyconfidenceescalation
  4. Human in the Loop advanced Multiple choice

    An AI system routes decisions to human review. The override rate is 0.3%. Is the oversight working?

    2 min answer oversightautomation-biasdesign
  5. Human in the Loop advanced

    Design the moderation path for user-generated content at high volume, where both false positives and false negatives are costly.

    2 min answer moderationmloversightdesign