dbaplus Community

Sep 13, 2017 · Big Data

How Kafka’s High‑Level Consumer Works, Rebalance Challenges, and the Next‑Gen Design

This article explains Kafka’s High‑Level and Low‑Level consumer models, the semantics of Consumer Groups, the rebalance algorithm and its drawbacks, and outlines the planned redesign in Kafka 0.9.x that introduces a central Coordinator to solve herd and split‑brain issues.