Tagged articles

DeepSeek-V4-Flash

2 articles · Page 1 of 1
Old Zhang's AI Learning
Old Zhang's AI Learning
Jul 8, 2026 · Artificial Intelligence

Deploying the Quantized DeepSeek‑V4‑Flash Locally: Performance, Benchmarks, and Tips

This article walks through DeepSeek‑V4‑Flash, a lightweight 284B MoE model with 13B active parameters and 1‑million‑token context, explains its three thinking modes, presents official benchmark results showing Flash can match Pro with higher reasoning budget, and provides step‑by‑step local deployment instructions using Unsloth’s GGUF quantization and llama.cpp fixes.

AIDeepSeek-V4-FlashGGUF
0 likes · 13 min read
Deploying the Quantized DeepSeek‑V4‑Flash Locally: Performance, Benchmarks, and Tips
Old Zhang's AI Learning
Old Zhang's AI Learning
May 17, 2026 · Artificial Intelligence

Why DeepSeek V4 Flash’s Quantized Model Is Gaining Traction

The DeepSeek V4 Flash quantized GGUF model and the dedicated ds4 inference engine, both released by antirez, offer dramatically reduced activation parameters, massive 1‑million‑token context windows, aggressive KV‑cache compression and hardware‑specific quantizations that enable smooth local inference on high‑memory Macs and CUDA machines, while sacrificing generality for performance.

DS4DeepSeek-V4-FlashGGUF
0 likes · 11 min read
Why DeepSeek V4 Flash’s Quantized Model Is Gaining Traction