ICML Oral: Left-to-Right Training Boosts Diffusion LLMs' Reasoning Despite Flexible Generation
Tsinghua researchers show that training diffusion language models with left-to-right token unmasking and GRPO significantly improves math and code reasoning performance, reducing entropy at logical branching points and outperforming flexible decoding strategies on GSM8K and MATH-500 benchmarks.
