1. Assurance, Audit & Model Risk advanced

    How would you provide assurance that controls are operating without a review board?

    2 min answer assurancepreventive-controlsevidenceautomation
  2. Assurance, Audit & Model Risk intermediate

    Zoom went from about 10 million daily meeting participants in December 2019 to more than 300 million in April 2020, then froze feature development for 90 days to work on security and privacy. What forced that, and which kinds of control break first when demand grows 30x in four months?

    2 min answer zoomsurgecontrolsfeature-freeze
  3. Audit Evidence intermediate

    An audit requires evidence that controls operated throughout the period. How should that evidence be produced?

    2 min answer chargebeeevidenceautomationsampling
  4. Audit Evidence advanced

    Preparing for an audit consumes weeks of engineering time every cycle. What should change architecturally?

    1 min answer audit-evidenceautomationprovenancelogging
  5. Audit Evidence beginner Multiple choice

    Your assurance report covers a twelve-month observation window ending 31 March. In February the assessor asks for the pipeline record of every production deploy in that window. CI build logs are kept 90 days and the cloud audit trail 90 days. What do you fix?

    3 min answer audit-evidenceretentionsoc2evidence-by-construction
  6. Audit Evidence intermediate

    Your organisation is preparing for its first SOC 2 audit. The security team is asking engineers for screenshots of configurations. What would you change, and what is the architectural argument?

    2 min answer complianceevidenceautomationcertification
  7. Bias & Fairness Controls advanced

    A lending model shows different approval rates across demographic groups. The business asks you to "make it fair". What do you do?

    2 min answer fairnessmlgovernance
  8. Bias & Fairness Controls intermediate

    A lending team's fairness dashboard shows approval-rate parity across protected groups, refreshed monthly, green for six months. Review it. What would you remove, what would you change, and what would you leave alone?

    3 min answer fairnessmetricsmonitoringproxies
  9. Bias & Fairness Controls advanced

    A model used in underwriting must be demonstrably fair. What controls are architectural, and what is the hard part?

    2 min answer digitfairnesssubgroupsproxies
  10. Bias & Fairness Controls advanced

    A model's outcomes differ across demographic groups. What can architecture actually do about it?

    2 min answer fairnessbiasmeasurementtradeoffs
  11. Bias & Fairness Controls beginner Multiple choice

    A team removes the ethnicity field from a credit model's training data and tells the risk committee the model can no longer discriminate. What is the most accurate response?

    2 min answer fairnessproxy-variablesunawarenessmonitoring
  12. Bias & Fairness Controls advanced

    An interviewer says — you run architecture for a consumer lending platform. The regulator expects evidence that your model is not producing disparate outcomes across ethnic groups. Legal tells you that you may not collect applicants' ethnicity. Where do you take this?

    3 min answer fairnessproxy-inferencebisgmeasurement