Kafka Storage Deep Dive: Append-Only Logs, Sparse Indexes & Compact Traps
This article dissects Kafka's on-disk storage architecture, explaining partition segments, sparse indexes, page cache reliance, flush policies, delete vs. compact cleanup, and real-world incidents like index rebuild storms and misconfigured retention, with production configs and capacity formulas.
