Machine Learning Algorithms & Natural Language Processing

Jun 18, 2026 · Artificial Intelligence

Why LLMs Miss Simple Addition: Geometric Mechanism Behind Arithmetic Errors

A recent ICML 2026 paper from Nanjing University reveals that large language models encode correct arithmetic information in structured geometric manifolds, yet errors arise from noisy quantization at decision boundaries, and proposes probing, Iso‑Raw‑Sum Trajectory, and a dual‑stream consistency check to diagnose and correct these mistakes.