Tagged “streaming”

3 posts.

All Model Architecture20 Training & Alignment22 Inference & Serving21 Agents & Orchestration11 Reasoning & Evaluation27 Safety, Security & Governance8 Platforms & Practice22

Training & Alignment 26 min

The Alignment Problem in Speech Recognition: CTC, RNN-T, and the Cost of Not Waiting

A ten-second utterance is a thousand acoustic frames. Its transcript is forty characters. Nobody wrote down which frames make which character, and the number of ways to line them up is astronomical. Every major speech architectur…

speech asr ctc rnn-t ∑ ◫

Platforms & Practice 24 min

The Leak in Every Training Set: Feature Stores, Point-in-Time Joins, and the Train-Serve Contract

A fraud model can score perfect recall offline and block nothing in production, because its training join looked a few hours into the future. Feature stores exist to enforce one contract: a training row may only see what the serv…

feature-stores mlops feature-engineering data ∑ ◫

Reasoning & Evaluation 24 min

When Did the World Change? Changepoint Detection From Page's CUSUM to Bayesian Online Inference

CUSUM has been provably optimal since 1986, yet on the first human-annotated changepoint benchmark a detector that never reports a change beat most of the field under default settings. Seventy years of changepoint theory, from Pa…

anomaly-and-changepoint changepoint-detection anomaly-detection statistics ∑ ◫