Old Zhang's AI Learning

Oct 20, 2026 · Artificial Intelligence

Deploying 552B DeepSeek-V4.1-Flash on Dual DGX Sparks: 130 tok/s, 2.9 bpw Quantization

MiaAI-Lab demonstrates running the 552B-parameter DeepSeek-V4.1-Flash-1017 model on two NVIDIA DGX Spark workstations (256GB unified memory) using a Zig-based runtime, ConnectX-7 200 Gb/s interconnect, EXL3 2.9 bpw quantization, and local NVMe storage with memory guards, achieving 75 tok/s single-stream and 130 tok/s 4-stream decode throughput with 512K context.