Portfolio ↗

Quiz

2707 questions of the kind that actually get asked — in interviews, in architecture review boards, and by the person who has to run the thing at 3 AM. Every answer states the trade-off rather than the slogan, and says when the obvious choice is the wrong one.

All areas2707 Architecture Fundamentals81 Distributed Systems101 Data Architecture90 Cloud Architecture87 Networking86 API & Integration Architecture78 Reliability & Resilience88 Observability81 Performance & Capacity Engineering90 Security Architecture95 Cost Architecture & FinOps92 Business Architecture93 Architecture Communication91 Enterprise Architecture91 Legacy Modernization92 AI-Era Architecture96 Software Architecture & Engineering84 Architecture Patterns84 Architecture Decision-Making91 The Architect's Meta-Skills92 Delivery & Release Engineering93 Platform Engineering & Developer Experience92 Testing & Quality Architecture90 Data Platform Architecture98 Streaming & Real-Time Data93 Data Governance & Semantics91 Frontend & Experience Architecture91 Edge, Mobile & IoT88 Regulatory & Data Protection Architecture90 Assurance, Audit & Model Risk98
Difficulty Any beginner intermediate advanced

48 questions in Testing & Quality Architecture.

  1. End-to-End Test Economics advanced

    Your 800-test end-to-end suite takes 90 minutes and fails roughly half the time for reasons unrelated to the change. The team re-runs until green. What do you do?

    2 min answer testingreliabilitystrategy
  2. Environment Parity advanced

    A platform has already been through the failure Fastly published in 2021 - a defect shipped on 12 May that a customer's valid configuration armed on 8 June - and has since implemented per-point-of-presence staged activation of customer configurations plus grammar-based fuzzing of the configuration surface. Six months later the same class recurs in a different subsystem. Which gap did that action list never close?

    3 min answer fastlyenvironment-paritylatent-defectcontinuous-verification
  3. Environment Parity advanced

    On 14 March 2023 Reddit upgraded a Kubernetes cluster from 1.23 to 1.24 after the same upgrade had already succeeded elsewhere, and was down for 314 minutes. The upgrade removed a node label that a hand-configured Calico route reflector selected on. Which parity assumption failed?

    2 min answer redditkubernetesparityconfiguration-drift
  4. Integration Test Boundaries advanced

    Nine teams share one integration environment where all 34 services run together. The 900-test suite takes three hours and a red run is usually somebody else's deploy rather than a defect. You have been asked to move to per-service tests with virtualised dependencies without interrupting the fortnightly release train. What is the sequence, and where can it go wrong?

    3 min answer integration-test-boundariesshared-environmentmigrationtest-doubles
  5. Integration Test Boundaries advanced

    Where should integration tests draw their boundary - at the service, at the database, or at the external dependency?

    2 min answer temporalintegration-testsboundariesfakes
  6. Mutation Testing advanced

    A team adopts mutation testing to stop shipping defects in code that coverage says is tested. On a 40,000-line service with a 4-minute unit suite, what have they bought, what are they paying, and when does that bill arrive?

    3 min answer mutation-testingci-costassertion-strengthfeedback-loop
  7. Mutation Testing advanced

    A team has 85% line coverage and keeps shipping defects in tested code. What would reveal the gap?

    2 min answer digitmutation-testingcoverageassertions
  8. Mutation Testing advanced

    What does mutation testing reveal that coverage does not, and where is it worth the cost?

    2 min answer mutation-testingcoverageassertion-qualitycost
  9. Non-Functional Test Strategy advanced

    A trading platform's functional tests all pass and production fails under load. What should the non-functional test strategy contain?

    2 min answer zerodhaload-testingnfrsoak
  10. Non-Functional Test Strategy advanced

    ByteDance's Monolith paper (RecSys 2022) describes a recommendation system with minute-level parameter synchronisation whose training parameter servers are snapshotted only once a day, so a server failure loses up to a day of updates. The authors say they expected to need more frequent snapshots. What did they do instead of arguing about it, and what does that give a non-functional test strategy?

    3 min answer bytedancemonolithrecovery-objectivenfr
  11. Non-Functional Test Strategy advanced

    On 31 January 2017 a GitLab engineer removed the wrong PostgreSQL data directory, and the recovery mechanisms they believed they had turned out not to work. Roughly six hours of data was lost. Which property had never been tested, and what does that say about non-functional testing generally?

    2 min answer gitlabbackupsrestore-drilldr
  12. Non-Functional Test Strategy advanced

    Which non-functional properties can be tested pre-release, and which can only be verified in production?

    2 min answer non-functionalperformanceresilienceproduction