Data Party THU

Jun 18, 2026 · Artificial Intelligence

Why Large Language Models Are Short‑Sighted and How Next‑ToBE Unlocks Anticipatory Reasoning

The article examines the short‑sighted nature of current next‑token prediction in LLMs, presents the Next‑ToBE (Next Token‑Bag Exploitation) method that reshapes the training objective to expose latent future‑token awareness, and shows through extensive experiments that this approach improves anticipatory reasoning and downstream task performance.