1. Streaming SLOs intermediate

    Consumer lag has grown from 30 seconds to 4 minutes over a week. Throughput and error rates are normal. What is happening and how urgent is it?

    2 min answer streamingoperationscapacity
  2. Streaming SLOs advanced

    Tencent's DAGOR (SoCC 2018) detects overload in WeChat's microservice fleet from the average queuing time in a server's pending queue rather than from CPU, treats 20 ms as the overload threshold, and piggybacks the server's current admission level onto its responses so callers shed doomed work themselves. A streaming ingest tier has the same shape. What transfers, and where would copying it be a mistake?

    3 min answer tencentwechatload-sheddingadmission-control
  3. Streaming SLOs advanced

    What SLOs should a market-data streaming pipeline have, and what does each protect?

    2 min answer coindcxstreaming-slolagfreshness
  4. Streaming SLOs intermediate

    What SLOs should a streaming pipeline publish, and why is availability the wrong headline metric?

    2 min answer streaming-sloslagcompletenessfreshness
  5. Streaming SLOs intermediate

    You are handing a streaming pipeline to an operations team who have never run one. What must exist before they accept it?

    2 min answer streamingoperationshandoverrunbooks
  6. Streaming vs Batch advanced

    A business sponsor asks for a real-time data platform because "the competition has one". Reporting is currently a nightly batch that lands at 06:00 and nobody has complained. How do you handle this?

    2 min answer streamingbatchrequirementscost
  7. Streaming vs Batch intermediate

    A product manager asks for a "real-time" dashboard. How do you turn that into a design decision?

    2 min answer requirementslatencycost
  8. Streaming vs Batch intermediate

    A quick-commerce platform must decide whether a data flow should be streaming or batch. What actually decides it?

    2 min answer zeptostreamingbatchlatency
  9. Streaming vs Batch beginner Multiple choice

    An hourly batch job writes each hour's aggregate into a dt/hour partition and is safe to rerun after any crash. The team reimplements the same logic as a streaming job writing to the same table. The streaming job is at-least-once and now produces duplicate rows after every restart. What made the batch version's retries safe?

    2 min answer streamingbatchidempotencysinks
  10. Streaming vs Batch intermediate

    Which parts of a grocery platform's data processing genuinely require streaming, and which are better as batch?

    1 min answer streamingbatchfreshnesscost
  11. Watermarks & Late Data advanced

    A daily reconciliation shows the streaming aggregation is 2% below the batch equivalent. Both read the same source. Why?

    2 min answer streamingcorrectnesslate-data
  12. Watermarks & Late Data advanced

    A dispatch analytics pipeline computes per-minute aggregates and the numbers keep changing after the fact. What is happening, and what decisions must be made explicit?

    2 min answer swiggywatermarkslate-datawindowing