Tagged “grpo”

2 posts.

All Model Architecture13 Training & Alignment8 Inference & Serving11 Agents & Orchestration10 Reasoning & Evaluation7 Safety, Security & Governance3 Platforms & Practice11

Training & Alignment 21 min

RL from Verifiable Rewards: Training Models on Answers That Can Be Checked

Replace the reward model with a function that simply checks the answer, and a frontier reasoning model falls out of pure reinforcement learning. The catch is what 'checkable' quietly assumes, and what the model learns to exploit.

rlvr reinforcement-learning reasoning grpo ∑ ◫

Training & Alignment 21 min

Why Token-Level RL Collapses: GSPO and Sequence-Level Importance Sampling

GRPO weights every token by its own importance ratio, and on long responses that single-sample estimator quietly poisons the gradient until the model collapses. GSPO moves the ratio up to the whole sequence, and Qwen3's largest m…

reinforcement-learning rlhf gspo grpo ∑ ◫