Portfolio ↗

Quiz

2827 questions of the kind that actually get asked — in interviews, in architecture review boards, and by the person who has to run the thing at 3 AM. Every answer states the trade-off rather than the slogan, and says when the obvious choice is the wrong one.

All areas2827 Architecture Fundamentals91 Distributed Systems101 Data Architecture90 Cloud Architecture87 Networking86 API & Integration Architecture87 Reliability & Resilience99 Observability92 Performance & Capacity Engineering90 Security Architecture95 Cost Architecture & FinOps92 Business Architecture93 Architecture Communication91 Enterprise Architecture100 Legacy Modernization92 AI-Era Architecture96 Software Architecture & Engineering93 Architecture Patterns84 Architecture Decision-Making101 The Architect's Meta-Skills92 Delivery & Release Engineering103 Platform Engineering & Developer Experience92 Testing & Quality Architecture102 Data Platform Architecture98 Streaming & Real-Time Data93 Data Governance & Semantics91 Frontend & Experience Architecture101 Edge, Mobile & IoT98 Regulatory & Data Protection Architecture99 Assurance, Audit & Model Risk98
Difficulty Any beginner intermediate advanced

102 questions in Testing & Quality Architecture.

  1. Service Virtualisation intermediate

    A travel platform of the kind Expedia operates in — dozens of supplier APIs, each rate-limited and slow — runs its test suite against recorded stubs of every supplier. The suite is fast and green. What happens over the following year, and how do you know before a customer does?

    3 min answer service virtualisationstubscontract driftintegration
  2. Service Virtualisation intermediate

    When should external dependencies be virtualised in testing, and what must the virtual service reproduce?

    2 min answer virtualisationstubsthird-partyfailure-modes
  3. Service Virtualisation intermediate

    You virtualised a mainframe dependency for testing. Six months later a production integration fails that all tests passed. What happened?

    2 min answer testingvirtualisationdrift
  4. Synthetic Data advanced Multiple choice

    A live-streaming platform at Twitch scale load tests its chat-history service against two billion synthetic messages whose channel IDs were drawn uniformly at random. The test reports p99 of 40 ms at 5000 requests per second. Production at 3000 requests per second shows p99 of 800 ms with one shard at 95% CPU while the rest sit near 20%. Which explanation fits the evidence?

    3 min answer twitchsynthetic-datakey-skewhot-partition
  5. Synthetic Data intermediate Multiple choice

    A payments company must build a test dataset for its fraud-scoring service. Production holds 400M transactions with about 0.2% labelled fraudulent; legal will not permit production data in test environments. The team needs the dataset to exercise the model's decision boundary and the pipeline's handling of awkward records. Which approach fits the requirement as stated?

    2 min answer synthetic-datafraudtest-dataprivacy
  6. Synthetic Data advanced

    Review this: a bank generates synthetic test data by taking a production dump and replacing names, emails, account numbers and dates of birth with random values. The data volume matches production, the schema is identical, and the compliance team has signed it off as anonymised. What would you change?

    4 min answer synthetic dataanonymisationre-identificationreferential integrity
  7. Synthetic Data intermediate

    When is synthetic data sufficient and when does it mislead?

    2 min answer synthetic-datadistributionsskewperformance-testing
  8. Synthetic Data advanced

    Your synthetic test data generator produces valid records and the team says testing has got worse. What is likely wrong?

    1 min answer test-datagenerationquality
  9. Test Architecture Strategy advanced

    "Our test pyramid is upside down — mostly end-to-end tests, few unit tests. How would you fix it?" Treat this as the interview prompt it is.

    4 min answer test pyramidtest strategyinterviewtrade-offs
  10. Test Architecture Strategy advanced

    By around 2011 Etsy was deploying to production roughly 25 times a day, having published its deployment tool (Deployinator) and its metrics collector (StatsD). There was no separate multi-day regression phase before a release. What replaced it, what did the approach cost, and where would copying it be a mistake?

    3 min answer etsycontinuous-deploymentstatsdfeature-flags
  11. Test Architecture Strategy advanced

    Every release needs a two-day manual regression pass by four people, the team ships fortnightly, and leadership wants weekly releases. Walk me through where you start.

    2 min answer regressionrelease-strategyrollbackrisk-based-testing
  12. Test Architecture Strategy intermediate

    What should a test strategy specify, and what makes strategies fail in practice?

    2 min answer test-strategyownershiplayersrisk