Lao Guo's Learning Space
Oct 26, 2026 · Artificial Intelligence
61.9 tok/s on Mac mini M6: 6.1× Speculative Decoding Beats 170GB/s Bandwidth Wall
The article explains how TensorFold and DFlash2 enable speculative decoding on a 32GB Mac mini M6, achieving 61.9 tok/s (6.1× speedup) for Qwen3.8-27B 4-bit in code tasks despite a 170GB/s memory bandwidth limit, with lossless output verification and three-step replication commands.
Apple SiliconDFlash2LLM inference
0 likes · 12 min read