vivo Internet Technology

Mar 11, 2020 · Big Data

Understanding Spark Executor Memory Management and the Unified Memory Model

The article explains Spark’s executor memory layout under the UnifiedMemoryManager, detailing on‑heap and off‑heap divisions, the four memory regions, default fraction settings, how storage and execution memory share space, and provides heuristics and tuning tips for avoiding OOM and optimizing performance.