Skip to content
Tagged articles

unified memory

30 articles · Page 1 of 1
Lao Guo's Learning Space
Lao Guo's Learning Space
Nov 17, 2026 · Artificial Intelligence

Mac Studio 512GB ($25K) 1.8x Slower Than RTX 5090 ($5K) on MiniMax H3

Benchmarking MiniMax H3 video generation across six hardware configurations reveals that the $25,799 Mac Studio 512GB is 1.3–1.8x slower than a $5,100 RTX 5090 for models fitting in 32GB VRAM, but the Mac and 96GB RTX PRO 6000 are the only options that can run 10-second 1344p clips without OOM errors.

Mac StudioMiniMax H3RTX 5090
0 likes · 14 min read
Mac Studio 512GB ($25K) 1.8x Slower Than RTX 5090 ($5K) on MiniMax H3
Lao Guo's Learning Space
Lao Guo's Learning Space
Nov 12, 2026 · Industry Insights

M5 Ultra 512GB Arrives: 768GB Vaporware, 384GB GPU Limit, Which Memory for Your LLM?

Apple's M5 Ultra Mac Studio now offers a 512GB unified memory option priced from $22,299 with 10-12 week delivery, but the 768GB tier remains unconfirmed vaporware; macOS defaults GPU wired memory to 384GB, so extra capacity only helps run larger models, not speed, and buyers should match memory to specific model sizes.

Apple SiliconGPU wired limitLLM inference
0 likes · 16 min read
M5 Ultra 512GB Arrives: 768GB Vaporware, 384GB GPU Limit, Which Memory for Your LLM?
Lao Guo's Learning Space
Lao Guo's Learning Space
Oct 28, 2026 · Artificial Intelligence

M6 Mac Memory Tiers: Max LLM Size & Speed for 16/24/32GB (Real Tests)

This article analyzes Apple M6 Mac memory configurations (16GB/153GB/s, 24GB/170GB/s, 32GB/170GB/s) for local LLM inference, using official specs and community benchmarks to determine which models (7B–32B) fit each tier, their token speeds, and buying recommendations for different user needs.

Apple M6Apple SiliconBuying Guide
0 likes · 8 min read
M6 Mac Memory Tiers: Max LLM Size & Speed for 16/24/32GB (Real Tests)
Lao Guo's Learning Space
Lao Guo's Learning Space
Oct 25, 2026 · Artificial Intelligence

Mac mini M6 LLM Guide: 32GB RAM, 170GB/s Bandwidth, Model Sizing & Software

This article analyzes Mac mini M6 and M5 Pro hardware for local LLM deployment, detailing memory constraints (32GB vs 64GB unified memory), bandwidth limits (170GB/s vs 307GB/s), model sizing using the 0.7 memory rule, recommended software stacks (Ollama, MLX, llama.cpp), three deployment tiers for 14B, 70B, and 100B+ models, and five practical pitfalls to avoid.

Apple SiliconM5 ProMac mini M6
0 likes · 13 min read
Mac mini M6 LLM Guide: 32GB RAM, 170GB/s Bandwidth, Model Sizing & Software
Lao Guo's Learning Space
Lao Guo's Learning Space
Oct 23, 2026 · Artificial Intelligence

128GB vs 256GB: Which LLMs Actually Fit on RTX Spark and Mac Studio M5 Ultra?

The article compares unified memory capacities of NVIDIA RTX Spark (128GB) and Apple Mac Studio M5 Ultra (256GB) for local LLM inference, calculating model fit at Q4 quantization (0.5 bytes/parameter), categorizing models by size, noting Spark's clustering via ConnectX-7 for scaling, and concluding capacity needs depend on target model size.

ConnectX-7LLM inferenceMac Studio M5 Ultra
0 likes · 6 min read
128GB vs 256GB: Which LLMs Actually Fit on RTX Spark and Mac Studio M5 Ultra?
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 29, 2026 · Artificial Intelligence

MiniMax H3 vs Wan 2.2: 33B RAM vs 14B VRAM for Local Deployment

This article compares MiniMax H3 and Wan 2.2 for local deployment, contrasting H3's 33B unified-memory multimodal system with native stereo audio against Wan 2.2's 14B MoE visual family requiring GPU VRAM, covering architecture, quality, licensing, hardware requirements, and a decision framework.

Apache 2.0MiniMax H3VRAM
0 likes · 12 min read
MiniMax H3 vs Wan 2.2: 33B RAM vs 14B VRAM for Local Deployment
Ops Development & AI Practice
Ops Development & AI Practice
Sep 26, 2026 · Artificial Intelligence

Mac mini M6 32GB LLM Inference: Real TPS, Bandwidth Limits & Hybrid Cloud Strategy

This analysis dissects the 32GB Mac mini M6's true LLM inference capabilities, revealing 170 GB/s unified memory bandwidth limits, GPU compute constraints versus AMD Strix Halo, measured tokens-per-second for 8B–32B models, and a cost-driven argument for hybrid local-cloud deployment over expensive local-only workstations.

Apple SiliconLLM inferenceM6 chip
0 likes · 21 min read
Mac mini M6 32GB LLM Inference: Real TPS, Bandwidth Limits & Hybrid Cloud Strategy
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 23, 2026 · Artificial Intelligence

Mac mini 16GB to Studio 256GB: Which Mac Runs Your LLMs Best?

This article analyzes Mac mini and Mac Studio configurations for local LLM inference, showing how unified memory capacity determines which models fit and memory bandwidth dictates token generation speed, with real-world benchmarks for 8B to 235B models across M6, M5 Pro, M5 Max, and M5 Ultra chips.

Apple SiliconLLM inferenceMac Studio
0 likes · 13 min read
Mac mini 16GB to Studio 256GB: Which Mac Runs Your LLMs Best?
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 23, 2026 · Artificial Intelligence

M5 Ultra 256GB vs RTX 5090 32GB: Local LLM Inference Compared

This article compares Apple M5 Ultra (256GB unified memory) and NVIDIA RTX 5090 (32GB GDDR7) for local LLM inference across 27B–100B+ models, measuring capacity limits, token throughput, power draw, and CUDA vs MLX ecosystems, concluding M5 Ultra excels beyond 32GB while RTX 5090 leads on smaller models.

CUDALLM inferenceM5 Ultra
0 likes · 10 min read
M5 Ultra 256GB vs RTX 5090 32GB: Local LLM Inference Compared
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 23, 2026 · Artificial Intelligence

M5 Ultra Mac Studio: The Dream Machine for Local AI Agents?

Federico Viticci's four-day deep test of the M5 Ultra Mac Studio (256GB unified memory) reveals 1.2TB/s bandwidth, 2.5x faster prefill, up to 93.5% faster long-context generation, and superior concurrency for 24/7 local AI agent workflows at near-zero cost, outperforming RTX 5090 in usability.

ConcurrencyM5 UltraMac Studio
0 likes · 12 min read
M5 Ultra Mac Studio: The Dream Machine for Local AI Agents?
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 22, 2026 · Industry Insights

M5 Ultra 256GB Benchmarks: 27B LLM 51 tok/s, GPU +82% in Cyberpunk 4K RT

Hands-on benchmarks of the M5 Ultra 256GB Mac Studio show 45.7% faster single-stream LLM decoding, 3.6x higher multi-user prefill throughput, 43.6% CPU multi-core gains, 67.8% GPU improvement, and 82.8% higher Cyberpunk 2077 4K ray-tracing frame rates versus M3 Ultra, with purchasing guidance.

GPU performanceLLM inferenceM3 Ultra
0 likes · 13 min read
M5 Ultra 256GB Benchmarks: 27B LLM 51 tok/s, GPU +82% in Cyberpunk 4K RT
Lao Guo's Learning Space
Lao Guo's Learning Space
Sep 21, 2026 · Artificial Intelligence

M5 Ultra 256GB: Which LLMs Fit? 27B to 200B+ Capacity Analysis

The article analyzes Apple M5 Ultra 256GB unified memory capacity for local LLM inference, showing Q4-quantized models from 27B to 200B+ fit, but KV cache overhead for long contexts reduces headroom; it compares with multi-GPU setups and advises on purchase decisions.

Apple SiliconKV CacheLLM inference
0 likes · 8 min read
M5 Ultra 256GB: Which LLMs Fit? 27B to 200B+ Capacity Analysis
Architects' Tech Alliance
Architects' Tech Alliance
Aug 26, 2026 · Artificial Intelligence

Inside Huawei’s Atlas 850E & 950 Supernodes: Key Technical Innovations

Huawei’s Atlas 850E wind‑cooled supernode delivers 14.27 PFLOPS, 768 GB HBM, 4 TB/s bandwidth and VCE phase‑change cooling for inference in standard data centers, while the Atlas 950 SuperPoD provides a flagship 1 EFLOPS FP8 training platform with 256 TB unified memory, 1.72 PB/s interconnect, sub‑3 µs RTT, full liquid cooling and scalability up to 8 192 NPU cards.

AI hardwareAtlas 850EAtlas 950
0 likes · 8 min read
Inside Huawei’s Atlas 850E & 950 Supernodes: Key Technical Innovations
Architects' Tech Alliance
Architects' Tech Alliance
Jul 20, 2026 · Artificial Intelligence

Supernode Architecture Explained: Definitions, Core Features, and Practical Use Cases

The whitepaper defines supernodes as high‑speed, tightly‑connected compute systems with unified memory addressing, microsecond‑level latency and terabyte‑per‑second bandwidth, outlines their physical, transaction, function and topology layers, demonstrates AI training and inference gains such as 80% communication reduction and 98.4% cluster scaling efficiency, and discusses industry impact, future scaling, standardization and green energy trends.

AI infrastructureSupernodehardware-software co-design
0 likes · 8 min read
Supernode Architecture Explained: Definitions, Core Features, and Practical Use Cases
Lao Guo's Learning Space
Lao Guo's Learning Space
Jun 3, 2026 · Industry Insights

Can Apple’s M5 Ultra Still Compete After NVIDIA’s RTX Spark Launch?

The RTX Spark desktop processor delivers 1 PFLOP of AI compute—about 14 times the M5 Ultra—while the M5 Ultra retains a three‑times higher memory bandwidth and twice the memory capacity, making it superior for certain inference workloads; the article breaks down specs, benchmarks, ecosystem differences, pricing and market positioning to show how each platform fits distinct AI use cases.

AI computeApple M5 UltraCUDA
0 likes · 12 min read
Can Apple’s M5 Ultra Still Compete After NVIDIA’s RTX Spark Launch?
Architects' Tech Alliance
Architects' Tech Alliance
Mar 7, 2024 · Industry Insights

How Nvidia GH200 and AMD MI300A Are Redefining CPU‑GPU Memory Integration

The article examines Nvidia’s GH200 and AMD’s MI300A processors, highlighting their unified memory domains that eliminate PCIe bottlenecks, detailing benchmark results, power‑measurement challenges, and the broader industry shift toward integrated CPU‑GPU architectures for high‑performance and generative‑AI workloads.

AMD MI300ACPU‑GPU IntegrationGenerative AI
0 likes · 11 min read
How Nvidia GH200 and AMD MI300A Are Redefining CPU‑GPU Memory Integration
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 6, 2021 · Big Data

Understanding Spark’s Memory Model: Unified Memory Management, On‑Heap and Off‑Heap Memory, and Configuration

This article explains Spark’s unified memory management model, detailing the division between on‑heap and off‑heap memory, the roles of execution, storage, user, and reserved memory, configuration parameters, dynamic allocation, and how these concepts affect performance and resource utilization.

Off‑HeapSparkStorage Memory
0 likes · 17 min read
Understanding Spark’s Memory Model: Unified Memory Management, On‑Heap and Off‑Heap Memory, and Configuration