PaperAgent

Nov 1, 2026 · Artificial Intelligence

CMU's Unified LLM Training: One Maximum Likelihood Objective for All Stages

CMU researchers propose a unified training paradigm where pre-training, mid-training, supervised fine-tuning, and reinforcement learning share a single maximum likelihood objective, using data mixing and scheduling instead of stage-specific algorithms, and show improved reasoning and continual learning on puzzles, math, and code benchmarks.