Skip to content
Tagged articles

M5 Ultra

9 articles · Page 1 of 1
Lao Guo's Learning Space
Lao Guo's Learning Space
Nov 12, 2026 · Industry Insights

M5 Ultra 512GB Arrives: 768GB Vaporware, 384GB GPU Limit, Which Memory for Your LLM?

Apple's M5 Ultra Mac Studio now offers a 512GB unified memory option priced from $22,299 with 10-12 week delivery, but the 768GB tier remains unconfirmed vaporware; macOS defaults GPU wired memory to 384GB, so extra capacity only helps run larger models, not speed, and buyers should match memory to specific model sizes.

Apple SiliconGPU wired limitLLM inference
0 likes · 16 min read
M5 Ultra 512GB Arrives: 768GB Vaporware, 384GB GPU Limit, Which Memory for Your LLM?
Lao Guo's Learning Space
Lao Guo's Learning Space
Oct 31, 2026 · Artificial Intelligence

552B DeepSeek on M5 Ultra 256GB: 3883 Prefill, 92 Decode Tok/s – Local Full-Scale LLM Achieved

Community developers benchmarked the 552B DeepSeek V4.1-Flash model at 3bpw quantization on a Mac Studio M5 Ultra with 256GB unified memory, achieving 3883 tok/s prefill, 92 tok/s decode, and up to 163 tok/s with speculative decoding, demonstrating that full-scale LLMs can run locally on consumer hardware.

Apple SiliconDeepSeekLLM inference
0 likes · 8 min read
552B DeepSeek on M5 Ultra 256GB: 3883 Prefill, 92 Decode Tok/s – Local Full-Scale LLM Achieved
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 23, 2026 · Artificial Intelligence

M5 Ultra 256GB vs RTX 5090 32GB: Local LLM Inference Compared

This article compares Apple M5 Ultra (256GB unified memory) and NVIDIA RTX 5090 (32GB GDDR7) for local LLM inference across 27B–100B+ models, measuring capacity limits, token throughput, power draw, and CUDA vs MLX ecosystems, concluding M5 Ultra excels beyond 32GB while RTX 5090 leads on smaller models.

CUDALLM inferenceM5 Ultra
0 likes · 10 min read
M5 Ultra 256GB vs RTX 5090 32GB: Local LLM Inference Compared
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 23, 2026 · Artificial Intelligence

M5 Ultra Mac Studio: The Dream Machine for Local AI Agents?

Federico Viticci's four-day deep test of the M5 Ultra Mac Studio (256GB unified memory) reveals 1.2TB/s bandwidth, 2.5x faster prefill, up to 93.5% faster long-context generation, and superior concurrency for 24/7 local AI agent workflows at near-zero cost, outperforming RTX 5090 in usability.

ConcurrencyM5 UltraMac Studio
0 likes · 12 min read
M5 Ultra Mac Studio: The Dream Machine for Local AI Agents?
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 22, 2026 · Industry Insights

M5 Ultra 256GB Benchmarks: 27B LLM 51 tok/s, GPU +82% in Cyberpunk 4K RT

Hands-on benchmarks of the M5 Ultra 256GB Mac Studio show 45.7% faster single-stream LLM decoding, 3.6x higher multi-user prefill throughput, 43.6% CPU multi-core gains, 67.8% GPU improvement, and 82.8% higher Cyberpunk 2077 4K ray-tracing frame rates versus M3 Ultra, with purchasing guidance.

GPU performanceLLM inferenceM3 Ultra
0 likes · 13 min read
M5 Ultra 256GB Benchmarks: 27B LLM 51 tok/s, GPU +82% in Cyberpunk 4K RT
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 21, 2026 · Artificial Intelligence

M5 Ultra 256GB: Which LLMs Fit? 27B to 200B+ Capacity Analysis

The article analyzes Apple M5 Ultra 256GB unified memory capacity for local LLM inference, showing Q4-quantized models from 27B to 200B+ fit, but KV cache overhead for long contexts reduces headroom; it compares with multi-GPU setups and advises on purchase decisions.

Apple SiliconKV CacheLLM inference
0 likes · 8 min read
M5 Ultra 256GB: Which LLMs Fit? 27B to 200B+ Capacity Analysis