1. Human in the Loop advanced Multiple choice

    An AI system routes decisions to human review. The override rate is 0.3%. Is the oversight working?

    2 min answer oversightautomation-biasdesign
  2. Human in the Loop advanced

    Design the moderation path for user-generated content at high volume, where both false positives and false negatives are costly.

    2 min answer moderationmloversightdesign
  3. Human-in-the-Loop Design beginner Multiple choice

    A claims system shows the reviewer a risk score of 0.87, the recommendation Reject, and a confirm button with the recommendation already selected. Median time on screen is 4 seconds. Audit records this as human oversight. What is the smallest change that makes the oversight real?

    2 min answer human-in-the-loopautomation-biasoversightui-as-control
  4. Human-in-the-Loop Design advanced

    A fraud system routes flagged transactions to human reviewers, who approve or reject within a target of 4 minutes each. A campaign triples flagged volume overnight. Reviewer headcount is unchanged. What happens to the quality of the human oversight, and what should the design do about it?

    2 min answer human-in-the-loopautomation-biascapacityqueueing
  5. Human-in-the-Loop Design advanced

    A high-consequence decision requires human oversight of an automated recommendation. What makes that oversight meaningful rather than nominal?

    2 min answer human-oversightautomation-biasworkflowaccountability
  6. Human-in-the-Loop Design advanced Multiple choice

    An anti-fraud system routes flagged transactions to human reviewers. Audit shows reviewers approved 98% of cases with a median handling time of 3 seconds. The control is documented as human oversight. What is the most accurate finding?

    3 min answer human oversightautomation biasthroughputcontrols
  7. Human-in-the-Loop Design advanced

    An approval step has a 99.8% approval rate. What does that tell you and what would you change?

    2 min answer human-in-the-looprubber-stampingescalationautomation-bias
  8. Hydration Cost advanced

    A marketplace's pages paint quickly and feel unresponsive for several seconds after appearing. What is happening and how do you fix it?

    1 min answer hydrationinteractivityjavascriptperformance
  9. Hydration Cost advanced

    A page renders quickly and is unresponsive to input for several seconds on a low-end device. What is happening?

    2 min answer meeshohydrationinteractivityjavascript
  10. Hydration Cost advanced

    A page renders quickly but is unresponsive for several seconds after appearing. What is happening, and what are the architectural responses?

    2 min answer hydrationinteractivityjavascriptislands
  11. Hydration Cost advanced

    A server-rendered page uses islands: static HTML with independently hydrated interactive components. In production, one island's hydration throws because a third-party script mutated the DOM before React attached. What does the user see, and what stops it?

    3 min answer hydrationislandserror-boundariesthird-party
  12. Hydration Cost intermediate Multiple choice

    An article page is server-rendered React. Field p75 interaction to next paint is 420 ms on mid-range Android and the main thread is busy for roughly 1.9 seconds after the HTML arrives. Three widgets account for most of the client bundle - a comment thread a video player and a recommendation carousel. Fewer than 5% of readers open comments. Which change gets interaction to next paint under 200 ms with the least risk?

    2 min answer hydrationinpislandscore-web-vitals