The DSpark system from DeepSeek combines batch decoding, speculative decoding, draft‑model tricks, Eagle‑MTP, DFlash parallelism, variable‑length scheduling and online confidence calibration to deliver up to 85% speedup and four‑fold throughput gains while maintaining generation quality.
DeepSpec, an open‑source framework from DeepSeek, accelerates large‑language‑model inference by 2–5× through speculative decoding, where a lightweight draft model generates candidate tokens that the target model validates in parallel, reducing the serial bottleneck of autoregressive decoding and offering a full‑stack pipeline from data preparation to evaluation.
DeepSeek V4’s DSpark adds a speculative decoding framework that combines a lightweight draft model, semi‑autoregressive generation, and confidence‑scheduled verification, delivering 60‑85% faster inference for Qwen3 and Gemma models while providing an open‑source DeepSpec toolkit for training and evaluation.
