Portfolio ↗

State Space Models

S4, Mamba, selective scan, the recurrence-convolution duality, and where linear-time sequence models pay off.

5concepts
58flashcards
36minutes of reading
Start with Hybrid Attention-SSM Architectures Drill the deck
All levels beginner intermediate advanced
  1. 01 Hybrid Attention-SSM Architectures Why the strongest linear-time models are not pure state space models, what a small number of full attention layers restores, and how to reason about the mixing ratio. intermediate 7m 12 cards