Portfolio ↗

Quiz

2988 questions of the kind that actually get asked — in interviews, in architecture review boards, and by the person who has to run the thing at 3 AM. Every answer states the trade-off rather than the slogan, and says when the obvious choice is the wrong one.

All areas2988 Architecture Fundamentals91 Distributed Systems111 Data Architecture100 Cloud Architecture97 Networking96 API & Integration Architecture97 Reliability & Resilience99 Observability92 Performance & Capacity Engineering100 Security Architecture105 Cost Architecture & FinOps102 Business Architecture103 Architecture Communication102 Enterprise Architecture100 Legacy Modernization102 AI-Era Architecture106 Software Architecture & Engineering93 Architecture Patterns94 Architecture Decision-Making101 The Architect's Meta-Skills102 Delivery & Release Engineering103 Platform Engineering & Developer Experience102 Testing & Quality Architecture102 Data Platform Architecture98 Streaming & Real-Time Data103 Data Governance & Semantics91 Frontend & Experience Architecture101 Edge, Mobile & IoT98 Regulatory & Data Protection Architecture99 Assurance, Audit & Model Risk98
Difficulty Any beginner intermediate advanced

5 questions in Human-in-the-Loop Design.

  1. Human-in-the-Loop Design beginner Multiple choice

    A claims system shows the reviewer a risk score of 0.87, the recommendation Reject, and a confirm button with the recommendation already selected. Median time on screen is 4 seconds. Audit records this as human oversight. What is the smallest change that makes the oversight real?

    2 min answer human-in-the-loopautomation-biasoversightui-as-control
  2. Human-in-the-Loop Design advanced

    A fraud system routes flagged transactions to human reviewers, who approve or reject within a target of 4 minutes each. A campaign triples flagged volume overnight. Reviewer headcount is unchanged. What happens to the quality of the human oversight, and what should the design do about it?

    2 min answer human-in-the-loopautomation-biascapacityqueueing
  3. Human-in-the-Loop Design advanced

    A high-consequence decision requires human oversight of an automated recommendation. What makes that oversight meaningful rather than nominal?

    2 min answer human-oversightautomation-biasworkflowaccountability
  4. Human-in-the-Loop Design advanced Multiple choice

    An anti-fraud system routes flagged transactions to human reviewers. Audit shows reviewers approved 98% of cases with a median handling time of 3 seconds. The control is documented as human oversight. What is the most accurate finding?

    3 min answer human oversightautomation biasthroughputcontrols
  5. Human-in-the-Loop Design advanced

    An approval step has a 99.8% approval rate. What does that tell you and what would you change?

    2 min answer human-in-the-looprubber-stampingescalationautomation-bias