Tagged articles

Unified Memory Manager

2 articles · Page 1 of 1

Apr 27, 2019 · Big Data

Understanding Spark Memory Management: On‑Heap and Off‑Heap Planning and Allocation

This article explains Spark's memory management architecture, covering on‑heap and off‑heap memory planning, the MemoryManager interface, static versus unified memory allocation strategies, and how dynamic borrowing improves resource utilization for Spark executors.

Memory ManagementSparkUnified Memory Manager

0 likes · 11 min read

Understanding Spark Memory Management: On‑Heap and Off‑Heap Planning and Allocation

ITPUB

Apr 11, 2017 · Big Data

Understanding Spark Executor Memory Management: On‑heap, Off‑heap, and Unified Approaches

This article explains Spark's executor memory architecture, covering on‑heap and off‑heap allocation, static versus unified memory managers, storage and execution memory handling, RDD persistence, eviction policies, and the role of Tungsten's page‑based management in optimizing performance.

Big DataExecutorMemory Management

0 likes · 23 min read

Understanding Spark Executor Memory Management: On‑heap, Off‑heap, and Unified Approaches