NextLat: World Model Constrains LLM Reasoning, 3.3x Faster Speculative Decoding
Microsoft Research and MIT propose Next Latent Prediction Transformer (NextLat), which adds a latent state prediction loss during training to compress history into belief states, achieving 98.7% valid route generation on Manhattan taxi data, 54.8% accuracy on Countdown arithmetic, and up to 3.3x speculative decoding speedup on a 1.3B model.
