Tagged “mamba”

2 posts.

All Model Architecture19 Training & Alignment22 Inference & Serving18 Agents & Orchestration11 Reasoning & Evaluation26 Safety, Security & Governance7 Platforms & Practice20

Model Architecture 20 min

Half Mamba, Half Attention: Why Hybrid State-Space Models Took Over

Pure Mamba was supposed to replace attention. Instead the most efficient open models in 2025 are roughly seven-eighths Mamba and one-eighth attention. The reason is the KV cache, and what each layer can and cannot remember.

state-space-models mamba transformers long-context ∑ ◫

Model Architecture 24 min

The Kalman Filter: Sixty-Six Years of Bayes' Rule, One Observation at a Time

In the fall of 1960 Rudolf Kalman presented a paper at NASA Ames that engineers found hard to grasp; by early 1961 it was navigating simulated spacecraft around the Moon. The same recursion now computes the exact likelihood of ev…

time-series-foundations statistics forecasting state-space-models ∑ ◫