Tagged articles

On‑heap

2 articles · Page 1 of 1

Aug 19, 2019 · Big Data

Understanding Spark Unified Memory Management and Dynamic Allocation

This article explains Apache Spark's memory architecture, covering the shift from static to unified memory management, the roles of on‑heap and off‑heap memory, configurable parameters, dynamic memory sharing between execution and storage, and the legacy mode introduced in Spark 1.6.

Apache SparkExecutorMemory Management

0 likes · 7 min read

Understanding Spark Unified Memory Management and Dynamic Allocation

ITPUB

Apr 11, 2017 · Big Data

Understanding Spark Executor Memory Management: On‑heap, Off‑heap, and Unified Approaches

This article explains Spark's executor memory architecture, covering on‑heap and off‑heap allocation, static versus unified memory managers, storage and execution memory handling, RDD persistence, eviction policies, and the role of Tungsten's page‑based management in optimizing performance.

Big DataExecutorMemory Management

0 likes · 23 min read

Understanding Spark Executor Memory Management: On‑heap, Off‑heap, and Unified Approaches