Data Thinking Notes

Dec 6, 2022 · Big Data

Why Did Multiple HDFS DataNodes Crash? Memory, GC, and Block Overload Explained

This article analyzes a midnight HDFS DataNode failure caused by excessive GC and OOM due to Spark batch jobs, examines how an unexpected surge in block count overloaded default memory settings, and presents concrete remediation steps and optimization recommendations to stabilize the cluster.