SDPG: Self-Distilled Policy Gradient for Sparse-Reward RL
SDPG adds a full-vocabulary self-distillation loss to verifier RL, learning from a hint-conditioned teacher. On Qwen3-4B it lifts AIME25 from 0.242 (GRPO) to 0.327 and AMC23 from 0.714 to 0.870 last-checkpoint.