How Nvidia GH200 and AMD MI300A Are Redefining CPU‑GPU Memory Integration

The article examines Nvidia’s GH200 and AMD’s MI300A processors, highlighting their unified memory domains that eliminate PCIe bottlenecks, detailing benchmark results, power‑measurement challenges, and the broader industry shift toward integrated CPU‑GPU architectures for high‑performance and generative‑AI workloads.

AMD MI300ACPU‑GPU IntegrationHPC

0 likes · 11 min read

How Nvidia GH200 and AMD MI300A Are Redefining CPU‑GPU Memory Integration

Data Thinking Notes

Oct 31, 2022 · Big Data

Mastering Spark’s Unified Memory Management: A Deep Dive into On‑Heap & Off‑Heap Tuning

This article explains Spark's unified memory manager, detailing on‑heap and off‑heap memory regions, dynamic memory sharing, task memory allocation, and practical tuning techniques to optimize performance and avoid common out‑of‑memory errors.

Big DataMemory ManagementUnified Memory

0 likes · 13 min read

Mastering Spark’s Unified Memory Management: A Deep Dive into On‑Heap & Off‑Heap Tuning

Big Data Technology & Architecture

Dec 6, 2021 · Big Data

Understanding Spark’s Memory Model: Unified Memory Management, On‑Heap and Off‑Heap Memory, and Configuration

This article explains Spark’s unified memory management model, detailing the division between on‑heap and off‑heap memory, the roles of execution, storage, user, and reserved memory, configuration parameters, dynamic allocation, and how these concepts affect performance and resource utilization.

Execution MemoryMemory ManagementOff-Heap

0 likes · 17 min read

Understanding Spark’s Memory Model: Unified Memory Management, On‑Heap and Off‑Heap Memory, and Configuration

Full-Stack Internet Architecture

Jul 17, 2020 · Big Data

Understanding Apache Spark Unified (Dynamic) Memory Management

This article explains Spark's transition from static to unified memory management, detailing on‑heap and off‑heap memory regions, key configuration parameters, dynamic allocation behavior, and legacy mode, helping users optimize executor memory usage for both batch and streaming workloads.

ExecutorMemory ManagementSpark

0 likes · 7 min read

Understanding Apache Spark Unified (Dynamic) Memory Management

Big Data Technology & Architecture

Jul 5, 2020 · Big Data

Understanding Spark Memory Management: On‑heap, Off‑heap, and Unified Memory

This article provides a comprehensive overview of Spark's memory management, covering executor memory architecture, the differences between on‑heap and off‑heap memory, static versus unified memory managers, storage and execution memory handling, and practical guidelines for optimizing Spark applications.

Big DataExecutorMemory Management

0 likes · 21 min read

Understanding Spark Memory Management: On‑heap, Off‑heap, and Unified Memory

Big Data Technology & Architecture

Jun 1, 2019 · Big Data

Understanding Spark Executor Memory Management: On‑Heap, Off‑Heap, and Unified Memory

This article explains Spark's executor memory architecture, covering on‑heap and off‑heap memory planning, static and unified memory managers, storage and execution memory allocation, RDD persistence, eviction policies, and shuffle memory usage, providing practical guidance for performance tuning.

Big DataExecutorMemory Management

0 likes · 23 min read

Understanding Spark Executor Memory Management: On‑Heap, Off‑Heap, and Unified Memory