Big Data Technology & Architecture

Jul 25, 2020 · Big Data

Kafka Transactions, Replication Issues, HW/LEO Evolution, and Reliability Mechanisms

This article explains how Kafka implements transactions, handles under‑replicated partitions, manages high‑watermark and log‑end‑offset evolution, uses leader epochs for consistency, discusses read‑committed isolation, explains why read‑write separation is not supported, and describes delay queues, dead‑letter/retry queues, auditing, tracing, lag calculation, key metrics, and performance‑optimising design features.