12K GPU-Hour Reality Check: GRPO Outperforms 10 Self-Distillation Methods in Agentic RL
A large-scale empirical study comparing GRPO with 10 self-distillation methods across 4 tasks and 3 model sizes finds no method consistently beats GRPO; some methods show high final scores but suffer training instability, and compute-equivalent comparisons often reverse apparent gains.
