Big Data Technology Architecture

Jun 1, 2019 · Big Data

Impact of Excessive HBase Partitions and How to Calculate Reasonable Region Numbers

The article explains how excessive HBase partitions can cause frequent flushes, compaction storms, high memory usage, long master assignment times, and reduced MapReduce concurrency, and provides formulas and guidelines for calculating a reasonable number of regions per RegionServer.