Machine Heart
Nov 17, 2026 · Artificial Intelligence
HKU NeurIPS 2026: Implicit Advantage Symmetry Explains GRPO's Dual Bottlenecks
Hong Kong University researchers identify implicit advantage symmetry as the root cause of GRPO's poor exploration and difficulty adaptation, proposing A-GRAE to dynamically break symmetry and achieve simultaneous gains in Pass@1 accuracy and Pass@k diversity across math and multimodal benchmarks without extra compute.
A-GRAEGRPOLLM post-training
0 likes · 13 min read
