Machine Heart

Nov 8, 2026 · Artificial Intelligence

DSpine: Depth-Wise Causal Injection for Parallel Speculative Decoding, 4x SGLang Throughput

Researchers from Tencent Youtu Lab, Shanghai Jiao Tong University, and Xiamen University introduce DSpine, a parallel speculative decoding method that embeds causal dependencies layer-by-layer in the draft network, achieving state-of-the-art acceptance length and up to 4x throughput on SGLang, with open-source code and models.