1. Testing in Production advanced

    "Testing in production" is either professional practice or negligence depending on what is meant. What are the legitimate forms, and what must be true for each?

    2 min answer testing-in-productioncanarysyntheticfeature-flags
  2. Testing in Production advanced

    A canary takes 5% of traffic on a new build and is compared with the baseline on error rate and p99. What happens if the load balancer sends only new connections to the canary?

    3 min answer canaryprogressive-deliverysampling-biasguardrails
  3. Testing in Production advanced

    A team wants to test in production. What does that legitimately mean, and what does it require first?

    2 min answer lineartesting-in-productioncanarysynthetic
  4. Testing in Production advanced

    On 1 August 2012 Knight Capital lost roughly $460M in about 45 minutes. The SEC's 2013 order records that new order-routing code had been rolled out to eight servers over several days and a technician did not copy it to one of them, where a flag reused by the new code reactivated dormant functionality. Every unit and integration test had passed. Which variable was never under test, and what check would you add?

    3 min answer knight-capitaldeploymentrelease-verificationblast-radius
  5. Testing in Production advanced

    What does testing in production genuinely mean, and what must exist before it is responsible?

    2 min answer testing-in-productionflagscanaryobservability
  6. Testing in Production advanced

    You propose shadow traffic and canary analysis. A risk officer says "you are testing on customers". How do you respond?

    2 min answer governanceriskcommunication