1. Mobile Release Strategy beginner Multiple choice

    A mobile app ships a release with a defect that crashes on launch for users in one country. The team is confident because the release included a remote kill switch for the new feature. It does not help. Which mistake does this most likely reflect?

    3 min answer kill-switchfeature-flagsmobilestartup
  2. Mobile Release Strategy advanced

    A mobile application cannot be updated instantly and a bad release is in the store. What should the architecture provide?

    2 min answer physics-wallahmobilefeature-flagsrollout
  3. Mobile Release Strategy advanced

    A mobile team adopts server-driven UI so screens can change without an app release. What have they bought, and when does the bill arrive?

    2 min answer server-driven-uimobilecompatibilityrelease
  4. Mobile Release Strategy advanced

    A mobile team ships every two weeks, cannot roll back a released build, and regularly finds severe bugs in production. What would you change?

    2 min answer mobile-releasestaged-rolloutfeature-flagsforced-upgrade
  5. Mobile Release Strategy intermediate

    Mobile applications ship through app stores with review delays and users who do not update. How should this change backend and release architecture?

    2 min answer mobileversioningbackward-compatibilityfeature-flags
  6. Model Documentation intermediate

    A model makes decisions affecting people. What documentation is actually required, and who is it for?

    2 min answer gustomodel-documentationlimitationsaccountability
  7. Model Documentation intermediate Multiple choice

    A support assistant answers questions by retrieving from an internal wiki and a ticket archive and passing the result to a hosted model. Your model documentation template has a training-data section you cannot fill because you did not train the model. Which section should replace it?

    2 min answer model-documentationragcorpus-provenanceretention
  8. Model Documentation beginner

    A team is asked to produce documentation for a model that scores loan applications. They propose a technical write-up of the architecture and the training data. What is missing, who actually reads this document, and what is it not?

    2 min answer model-cardsdocumentationgovernanceintended-use
  9. Model Documentation intermediate

    What should model documentation contain, and who is it actually for?

    1 min answer model-documentationtransparencylimitationsreuse
  10. Model Documentation intermediate

    Your model documentation for a customer-facing assistant records the provider's model version it was validated against and the evaluation scores from that run. The Azure deployment of that hosted model is set to auto-update to the provider's default version. Overnight the provider's default changes. What happens next?

    3 min answer model-documentationversioningvalidationazure
  11. Model Evaluation & Red-Teaming advanced Multiple choice

    A generative assistant is about to be deployed to customer support, drafting replies that agents can edit before sending. Its retrieval corpus is the company's internal knowledge base. Which pre-deployment check most reduces the risk that actually matters here?

    2 min answer red-teamingevaluationragdeployment
  12. Model Evaluation & Red-Teaming advanced

    A team must demonstrate that a model behaves acceptably before deployment. What does evaluation need to cover, and what does red-teaming add?

    2 min answer scale-aievaluationred-teamsubgroups