1. Metrics intermediate

    Etsy released StatsD in 2011: a small daemon that receives metric samples from applications over UDP, aggregates them in memory, and flushes to the metrics backend on a fixed interval. Why was UDP the right choice for that design, and what did it make permanently impossible?

    3 min answer etsystatsdmetricsudp
  2. Metrics intermediate

    Every service dashboard shows healthy metrics while users cannot complete a purchase. How is that possible and what would have detected it?

    2 min answer metricsbusiness-metricsdetectionblind-spots
  3. Migration Risk intermediate

    Review this migration plan. Cutover is staged by customer cohort at 2 percent then 10 then 50 then 100. Readiness for each step is "all automated tests green and no open P1 defects". The rehearsal ran against a 5 percent copy of production. The rollback step reads "restore from the pre-cutover snapshot if data integrity is compromised". What would you remove, what would you change, and what would you leave alone?

    3 min answer migration-riskcutoverabort-criteriarehearsal
  4. Migration Risk intermediate Multiple choice

    What is the single most important risk control in a migration, and why?

    2 min answer migration-riskreversibilityverificationblast-radius
  5. Migration Risk intermediate

    You want to replace a twelve-year-old monolith one capability at a time. The organisation releases that monolith once every six weeks on a Thursday evening, behind a change advisory board that meets fortnightly. Tell me what you would do first and why.

    3 min answer etsydeployment cadencestranglerchange advisory
  6. ML Platform intermediate

    A machine-learning platform must ingest telemetry from many concurrent training runs. What are the workload's distinguishing characteristics?

    2 min answer weights-biasesml-platformtelemetryingestion
  7. Mobile Release Strategy intermediate

    Mobile applications ship through app stores with review delays and users who do not update. How should this change backend and release architecture?

    2 min answer mobileversioningbackward-compatibilityfeature-flags
  8. Model Documentation intermediate

    A model makes decisions affecting people. What documentation is actually required, and who is it for?

    2 min answer gustomodel-documentationlimitationsaccountability
  9. Model Documentation intermediate Multiple choice

    A support assistant answers questions by retrieving from an internal wiki and a ticket archive and passing the result to a hosted model. Your model documentation template has a training-data section you cannot fill because you did not train the model. Which section should replace it?

    2 min answer model-documentationragcorpus-provenanceretention
  10. Model Documentation intermediate

    What should model documentation contain, and who is it actually for?

    1 min answer model-documentationtransparencylimitationsreuse
  11. Model Documentation intermediate

    Your model documentation for a customer-facing assistant records the provider's model version it was validated against and the evaluation scores from that run. The Azure deployment of that hosted model is set to auto-update to the provider's default version. Overnight the provider's default changes. What happens next?

    3 min answer model-documentationversioningvalidationazure
  12. Model Selection intermediate Multiple choice

    A client wants a model that follows their specific document formatting conventions and answers from their knowledge base. What do you recommend?

    2 min answer ragfine-tuningarchitecture