Kafka Upgrade Guide and Version Changes Overview
This article provides a comprehensive guide to upgrading Apache Kafka across multiple versions, detailing rolling upgrade procedures, configuration adjustments, protocol changes, new features, deprecations, and performance considerations for Kafka brokers, producers, consumers, and Kafka Streams applications.
This guide outlines step‑by‑step rolling upgrade plans for Apache Kafka from older releases (0.7, 0.8.x, 0.9.x, 0.10.x, 0.11.x) to newer versions such as 1.0, 1.1, 2.0, covering required changes to server.properties (e.g., inter.broker.protocol.version, log.message.format.version), broker restarts, and protocol version switches.
It also lists significant changes introduced in each version, including new KIPs, API deprecations, default configuration updates, added metrics, security enhancements, and modifications to message formats, compression, and log handling.
Additional sections describe upgrade considerations for Kafka Streams applications, required code recompilation, configuration migrations (e.g., key.serde, value.serde, timestamp.extractor), and the impact of new features like exactly‑once semantics, transactional APIs, and header support.
The document concludes with practical notes on optional downtime upgrades, post‑upgrade verification steps, and references to further resources such as the Kafka Streams upgrade guide and KIP specifications.
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
Big Data Technology & Architecture
Wang Zhiwu, a big data expert, dedicated to sharing big data technology.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.