Tag

On-Heap

0 views collected around this technical thread.

Big Data Technology Architecture

Aug 19, 2019 · Big Data

Understanding Spark Unified Memory Management and Dynamic Allocation

This article explains Apache Spark's memory architecture, covering the shift from static to unified memory management, the roles of on‑heap and off‑heap memory, configurable parameters, dynamic memory sharing between execution and storage, and the legacy mode introduced in Spark 1.6.

Apache SparkExecutorOff-heap

0 likes · 7 min read

Understanding Spark Unified Memory Management and Dynamic Allocation

Big Data Technology Architecture

Apr 27, 2019 · Big Data

Understanding Spark Memory Management: On‑Heap and Off‑Heap Planning and Allocation

This article explains Spark's memory management architecture, covering on‑heap and off‑heap memory planning, the MemoryManager interface, static versus unified memory allocation strategies, and how dynamic borrowing improves resource utilization for Spark executors.

Big DataOff-heapOn-Heap

0 likes · 11 min read

Understanding Spark Memory Management: On‑Heap and Off‑Heap Planning and Allocation