Training & Alignment
22 min
Prompts as Programs: What Changes When You Optimise the Prompt Instead of the Weights
A prompt optimiser that never touches a weight has been reported to beat GRPO by around six points using up to 35 times fewer rollouts. That result only makes sense once you stop treating the prompt as writing and start treating …