1. Performance Test Design advanced

    A load test shows p99 latency of 120 ms at 2,000 requests per second. Production at the same rate shows 900 ms. Why?

    2 min answer performanceload-testingmethodology
  2. Performance Test Design advanced

    A team must load test at 10× normal traffic and a scaled-down environment tells them nothing. How is load testing in production done safely, and what does it find that nothing else does?

    2 min answer flipkartload-testingproductionisolation
  3. Performance Test Design advanced

    What makes a performance test predictive of production behaviour, and what is the most common design flaw?

    2 min answer performance-testingdistributionrealismbreaking-point
  4. Quality Gates advanced

    A security vendor's release process gates sensor code behind staged rollout with canaries, and ships detection content through a separate path validated by a content checker and pushed to every customer within minutes. In July 2024 CrowdStrike's own root cause analysis describes exactly this shape, and a mismatch between 21 fields supplied and 20 fields read produced an out-of-bounds read that crashed around 8.5 million Windows hosts. Review the process. What would you remove, what would you add, and what would you leave alone?

    3 min answer crowdstrikerelease-gatesstaged-rolloutconfig-as-code
  5. Testing & Quality Architecture advanced

    A platform's quality is poor despite a large test suite. What does quality architecture address that more tests do not?

    2 min answer qualityarchitecturetestabilityfeedback
  6. Testing & Quality Architecture advanced

    How would you decide whether your test suite is worth what it costs?

    2 min answer testingvalueflakinessconfidence
  7. Security Testing in the Pipeline advanced

    You enable dependency scanning. It reports 4,200 vulnerabilities across the estate, 380 critical. What do you do on Monday?

    2 min answer securitytriagepipeline
  8. Service Virtualisation advanced

    A platform integrates with hundreds of external providers, and testing against them is slow, unreliable and sometimes impossible. What is the approach?

    2 min answer plaidvirtualisationmocksdrift
  9. Synthetic Data advanced Multiple choice

    A live-streaming platform at Twitch scale load tests its chat-history service against two billion synthetic messages whose channel IDs were drawn uniformly at random. The test reports p99 of 40 ms at 5000 requests per second. Production at 3000 requests per second shows p99 of 800 ms with one shard at 95% CPU while the rest sit near 20%. Which explanation fits the evidence?

    3 min answer twitchsynthetic-datakey-skewhot-partition
  10. Synthetic Data advanced

    Your synthetic test data generator produces valid records and the team says testing has got worse. What is likely wrong?

    1 min answer test-datagenerationquality
  11. Test Architecture Strategy advanced

    By around 2011 Etsy was deploying to production roughly 25 times a day, having published its deployment tool (Deployinator) and its metrics collector (StatsD). There was no separate multi-day regression phase before a release. What replaced it, what did the approach cost, and where would copying it be a mistake?

    3 min answer etsycontinuous-deploymentstatsdfeature-flags
  12. Test Architecture Strategy advanced

    Every release needs a two-day manual regression pass by four people, the team ships fortnightly, and leadership wants weekly releases. Walk me through where you start.

    2 min answer regressionrelease-strategyrollbackrisk-based-testing