Analysis of Apache Spark's Unified Memory Management Model (Spark 2.2.1)

This article analyzes Apache Spark's executor-side memory management model, focusing on the UnifiedMemoryManager in Spark 2.2.1, detailing on‑heap and off‑heap memory regions, dynamic execution/storage memory sharing, task memory allocation, and practical configuration examples.

Big DataExecutorMemory Management

0 likes · 10 min read

Analysis of Apache Spark's Unified Memory Management Model (Spark 2.2.1)

Big Data Technology Architecture

Aug 19, 2019 · Big Data

Understanding Spark Unified Memory Management and Dynamic Allocation

This article explains Apache Spark's memory architecture, covering the shift from static to unified memory management, the roles of on‑heap and off‑heap memory, configurable parameters, dynamic memory sharing between execution and storage, and the legacy mode introduced in Spark 1.6.

Apache SparkExecutorMemory Management

0 likes · 7 min read

Understanding Spark Unified Memory Management and Dynamic Allocation