Skip to content
Tagged articles

grammar-constrained decoding

1 articles · Page 1 of 1
AI Frontier Lectures
AI Frontier Lectures
Nov 10, 2026 · Artificial Intelligence

Grammar-Constrained Decoding 75x Faster: Vocabulary Compression with Equivalence Classes

Saarland University researchers present a vocabulary compression technique for grammar-constrained decoding that groups tokens into equivalence classes, reducing per-step grammar engine overhead from scanning the full vocabulary to updating only class representatives, achieving up to 75x speedup on complex grammars like Bython while preserving byte-identical output to uncompressed XGrammar2.

BythonEMNLP 2026LLM inference
0 likes · 5 min read
Grammar-Constrained Decoding 75x Faster: Vocabulary Compression with Equivalence Classes