Training & Alignment
26 min
The Alignment Problem in Speech Recognition: CTC, RNN-T, and the Cost of Not Waiting
A ten-second utterance is a thousand acoustic frames. Its transcript is forty characters. Nobody wrote down which frames make which character, and the number of ways to line them up is astronomical. Every major speech architectur…