Machine Heart

Oct 15, 2026 · Artificial Intelligence

SpecTr-GBV: Unifying Multi-Draft and Block Verification for Faster Speculative Decoding

SpecTr-GBV unifies multi-draft generation and greedy block verification into a single speculative decoding framework using optimal transport, achieving optimal expected acceptance length under conditionally independent couplings and outperforming SpecTr and GBV across five benchmarks with higher block efficiency and speedup.