Tagged “optimization”

3 posts.

All Model Architecture19 Training & Alignment22 Inference & Serving18 Agents & Orchestration11 Reasoning & Evaluation26 Safety, Security & Governance7 Platforms & Practice20

Training & Alignment 21 min

Muon and MuonClip: The Optimizer That Broke Adam's Monopoly on LLM Pretraining

For eight years Adam owned every serious pretraining run. Then a competitive-speedrun optimizer that orthogonalizes its own gradient updates scaled from a 124M-parameter toy to a trillion-parameter model with zero loss spikes. He…

optimization llm-training muon adamw ∑ ◫

Training & Alignment 22 min

Prompts as Programs: What Changes When You Optimise the Prompt Instead of the Weights

A prompt optimiser that never touches a weight has been reported to beat GRPO by around six points using up to 35 times fewer rollouts. That result only makes sense once you stop treating the prompt as writing and start treating …

prompt-engineering llm optimization evaluation ∑ ◫

Inference & Serving 21 min

The Hidden Cost of AI: Why Inference Is the New Cloud Bill

Training a frontier model is a one-time expense measured in millions. Serving it to users is a perpetual expense measured in billions of tokens per day. For most organisations, inference is already the larger number, and the gap …

inference economics optimization finops ∑ ◫