Lao Guo's Learning Space

Oct 21, 2026 · Artificial Intelligence

Splash 1.4.0: 120 tok/s on 64GB M5 Pro, 3x Faster Than Ollama

Inco AI's open-source inference engine Splash 1.4.0 achieves 120 tokens/second decode and 1.3K tokens/second prefill on a 64GB M5 Pro running Qwen3.8-Flash-Next, outperforming Ollama by 3x and Strata by 30%, with MoE activation efficiency enabling large models on modest memory.