Skip to content
Tagged articles

M5 Max

4 articles · Page 1 of 1
Lao Guo's Learning Space
Lao Guo's Learning Space
Oct 26, 2026 · Artificial Intelligence

M5 Max 128GB: Running 125B Qwen3.8-Flash-Next at 60 tok/s with MLX & MTP

This guide details running Qwen3.8-Flash-Next 125B MoE on Apple M5 Max 128GB, covering hardware bandwidth limits, memory constraints, framework selection (MLX vs llama.cpp), command-level optimizations including MTP speculative decoding and GPU memory limit tuning, and realistic performance expectations of 45–60 tok/s with MTP enabled.

Apple SiliconLLM inferenceM5 Max
0 likes · 9 min read
M5 Max 128GB: Running 125B Qwen3.8-Flash-Next at 60 tok/s with MLX & MTP
AI Engineering
AI Engineering
Jun 30, 2026 · Artificial Intelligence

Running DeepSeek V4 on M5 Max: 5 tps Speedup Without Large Memory

Developer Anemll demonstrates that the DS4 IQ2_Q2 version of DeepSeek V4 on an Apple M5 Max gains a 5‑tps throughput boost, using SSD‑streamed MoE sidecar loading to run large models without requiring high memory, and provides full build and execution instructions.

AI inferenceApple SiliconDS4
0 likes · 8 min read
Running DeepSeek V4 on M5 Max: 5 tps Speedup Without Large Memory