AI Frontier Lectures
Nov 10, 2026 · Artificial Intelligence
Grammar-Constrained Decoding 75x Faster: Vocabulary Compression with Equivalence Classes
Saarland University researchers present a vocabulary compression technique for grammar-constrained decoding that groups tokens into equivalence classes, reducing per-step grammar engine overhead from scanning the full vocabulary to updating only class representatives, achieving up to 75x speedup on complex grammars like Bython while preserving byte-identical output to uncompressed XGrammar2.
BythonEMNLP 2026LLM inference
0 likes · 5 min read
