SpecTr-GBV: Unifying Multi-Draft and Block Verification for Faster Speculative Decoding
SpecTr-GBV unifies multi-draft generation and greedy block verification into a single speculative decoding framework using optimal transport, achieving optimal expected acceptance length under conditionally independent couplings and outperforming SpecTr and GBV across five benchmarks with higher block efficiency and speedup.
