Tag

Apache Kafka

0 views collected around this technical thread.

Laravel Tech Community
Laravel Tech Community
Mar 23, 2025 · Big Data

Apache Kafka 4.0 Released: First Version Without ZooKeeper and New Features

Apache Kafka 4.0 has been officially released as the first major version that runs entirely without Apache ZooKeeper, introducing KRaft mode, a new consumer group protocol (KIP‑848), early‑access queue support (KIP‑932), updated Java requirements, and other enhancements aimed at improving scalability, operability, and messaging versatility.

Apache KafkaBig DataKIP-848
0 likes · 3 min read
Apache Kafka 4.0 Released: First Version Without ZooKeeper and New Features
Tencent Cloud Developer
Tencent Cloud Developer
Jul 16, 2024 · Big Data

In‑Depth Exploration of Apache Kafka: Architecture, High Reliability, and High Performance

Apache Kafka achieves high‑throughput, fault‑tolerant messaging by combining a partitioned log architecture with leader‑follower replication, asynchronous producer pipelines, configurable acknowledgments, page‑cache‑based sequential writes, zero‑copy transfers, batching, compression, and a multi‑reactor network model that together ensure scalability, reliability, and performance.

Apache KafkaDistributed SystemsStreaming
0 likes · 30 min read
In‑Depth Exploration of Apache Kafka: Architecture, High Reliability, and High Performance
FunTester
FunTester
Jan 5, 2024 · Big Data

An Overview of Apache Kafka and Kafka Streams Technical Features

This article introduces Apache Kafka as a high‑throughput, scalable, fault‑tolerant distributed streaming platform, explains why it is chosen for real‑time data pipelines, and details key Kafka Streams concepts such as stream processing, interactive queries, stateful processing, windowing, serialization, and testing.

Apache KafkaBig DataKafka Streams
0 likes · 13 min read
An Overview of Apache Kafka and Kafka Streams Technical Features
Java Architecture Diary
Java Architecture Diary
Jul 11, 2023 · Big Data

Redpanda vs Apache Kafka with KRaft: Why Redpanda Is Up to 10× Faster

This article presents a detailed benchmark comparing Redpanda 23.1 and Apache Kafka 3.4.0 (with and without KRaft) across multiple AWS instance types, showing how Redpanda consistently delivers higher throughput and dramatically lower end‑to‑end latency, often outperforming Kafka by 4‑20× even with extra hardware.

Apache KafkaBig DataKRaft
0 likes · 12 min read
Redpanda vs Apache Kafka with KRaft: Why Redpanda Is Up to 10× Faster
Architects Research Society
Architects Research Society
Jun 4, 2023 · Big Data

Understanding Transactions in Apache Kafka

This article explains the design, semantics, and practical usage of Apache Kafka's transaction API, covering why transactions are needed for exactly‑once processing, the underlying atomic multi‑partition writes, zombie fencing, consumer guarantees, Java API details, performance considerations, and operational best practices.

Apache KafkaDistributed SystemsJava
0 likes · 19 min read
Understanding Transactions in Apache Kafka
Big Data Technology Architecture
Big Data Technology Architecture
Oct 10, 2022 · Big Data

Apache Kafka 3.3 Release Highlights New KRaft Mode and Multiple KIP Enhancements

The Apache Kafka 3.3 release introduces production‑ready KRaft mode and a series of KIP enhancements across brokers, streams, and connect, detailing new metrics, API changes, and operational improvements while encouraging users to review the full release notes and try the updated platform.

Apache KafkaBig DataKIP
0 likes · 10 min read
Apache Kafka 3.3 Release Highlights New KRaft Mode and Multiple KIP Enhancements
vivo Internet Technology
vivo Internet Technology
Feb 23, 2022 · Big Data

Kafka-based Real-Time Data Warehouse: Architecture and Practice for Search

The article explains how Kafka serves as the core of a real‑time data warehouse for search, detailing its advantages over traditional databases, integration with Flink for low‑latency stream processing, architectural patterns such as Lambda/Kappa, scaling challenges, and comprehensive monitoring using Kafka Eagle.

Apache KafkaMonitoringSpark
0 likes · 15 min read
Kafka-based Real-Time Data Warehouse: Architecture and Practice for Search
IT Architects Alliance
IT Architects Alliance
Feb 13, 2022 · Big Data

Comprehensive Overview of Apache Kafka Architecture and Core Concepts

This article provides an in‑depth introduction to Apache Kafka, covering its distributed streaming platform fundamentals, message‑queue models, topic and partition design, broker and cluster roles, producer partitioning logic, reliability guarantees, consumer group assignors, offset management, and performance optimizations such as sequential disk writes and zero‑copy techniques.

Apache KafkaDistributed StreamingMessage Queues
0 likes · 25 min read
Comprehensive Overview of Apache Kafka Architecture and Core Concepts
Java Architect Essentials
Java Architect Essentials
Dec 7, 2021 · Big Data

Apache Kafka 3.0 Release Highlights and New Features

The article provides a comprehensive overview of Apache Kafka 3.0, detailing its core APIs, two main use‑cases, major feature additions, deprecations, KRaft consensus improvements, enhanced producer guarantees, and numerous KIP‑driven changes across the broker, client, Connect, Streams, and MirrorMaker components.

Apache KafkaBig DataEvent Streaming
0 likes · 14 min read
Apache Kafka 3.0 Release Highlights and New Features
IT Architects Alliance
IT Architects Alliance
Dec 3, 2021 · Big Data

Comprehensive Overview of Apache Kafka Architecture and Core Concepts

This article provides an in‑depth technical guide to Apache Kafka, covering its distributed streaming architecture, core concepts such as topics, partitions, brokers, producers and consumers, reliability guarantees, storage mechanisms, configuration parameters, and consumer assignment strategies, supplemented with Java code examples.

Apache KafkaConsumerDistributed Streaming
0 likes · 24 min read
Comprehensive Overview of Apache Kafka Architecture and Core Concepts
IT Architects Alliance
IT Architects Alliance
Sep 25, 2021 · Big Data

Apache Kafka 3.0.0 Release: New Features, API Changes, and KRaft Improvements

Apache Kafka 3.0.0 introduces numerous enhancements including deprecation of Java 8 and Scala 2.12 support, KRaft metadata snapshots, stronger default producer delivery guarantees, expanded Connect and Streams APIs, updated MirrorMaker 2 configuration, and many KIP-driven feature and API changes for improved streaming and event processing.

Apache KafkaKIPKRaft
0 likes · 15 min read
Apache Kafka 3.0.0 Release: New Features, API Changes, and KRaft Improvements
Laravel Tech Community
Laravel Tech Community
Apr 22, 2021 · Big Data

Apache Kafka 2.8.0 Release Highlights and New Features

Apache Kafka 2.8.0 introduces several significant enhancements, including a new group API, mutual TLS authentication for SASL_SSL listeners, JSON request/response logging, broker connection rate limiting, topic identifiers, self‑managed quorum replacing ZooKeeper, and numerous improvements to Streams and Connect APIs for more reliable real‑time data pipelines.

Apache KafkaBig DataDistributed Systems
0 likes · 2 min read
Apache Kafka 2.8.0 Release Highlights and New Features
vivo Internet Technology
vivo Internet Technology
Jan 13, 2021 · Big Data

An Introduction to Apache Kafka: Architecture, Concepts, and Operations

Apache Kafka is a distributed, fault‑tolerant streaming platform that uses broker clusters, topic partitions, and replicated logs to provide publish/subscribe and queue messaging, configurable retention, strong ordering within partitions, producer acknowledgments, consumer groups, and performance optimizations such as batching and zero‑copy for real‑time data pipelines.

Apache KafkaBig DataConsumer
0 likes · 26 min read
An Introduction to Apache Kafka: Architecture, Concepts, and Operations
Architects Research Society
Architects Research Society
Jan 9, 2021 · Big Data

Understanding Transactions in Apache Kafka: Semantics, API, and Practical Guidance

This article explains the purpose, semantics, and design of Apache Kafka’s transaction API, detailing how it enables exactly‑once processing for stream‑processing applications, the role of transaction coordinators and logs, Java API usage, performance considerations, and best‑practice guidance.

Apache KafkaBig DataJava API
0 likes · 19 min read
Understanding Transactions in Apache Kafka: Semantics, API, and Practical Guidance
Architects Research Society
Architects Research Society
Dec 10, 2020 · Big Data

Spring Cloud Stream with Apache Kafka – Overview, Programming Model, and Advanced Features (Part 2)

This article explains how Spring Cloud Stream integrates with Apache Kafka, covering its programming model, configuration, code examples, topic provisioning, consumer groups, partitioning, monitoring, error handling, schema evolution, and Kafka Streams support for building robust streaming microservices.

Apache KafkaBig DataJava
0 likes · 16 min read
Spring Cloud Stream with Apache Kafka – Overview, Programming Model, and Advanced Features (Part 2)
Architects Research Society
Architects Research Society
Dec 8, 2020 · Backend Development

Using Apache Kafka with Spring Boot: Error Handling, Deserialization, Multi‑Listener, and Transactions

This article explains how to integrate Apache Kafka with Spring Boot, covering error recovery with SeekToCurrentErrorHandler, deserialization handling, domain‑object conversion, multiple listener routing, and transaction support, while providing complete code examples for each feature.

Apache KafkaError HandlingMessage Conversion
0 likes · 10 min read
Using Apache Kafka with Spring Boot: Error Handling, Deserialization, Multi‑Listener, and Transactions
Architects Research Society
Architects Research Society
Jul 29, 2020 · Big Data

Static Members and Incremental Cooperative Rebalancing in Apache Kafka

Apache Kafka 2.3 introduced static members and incremental cooperative rebalancing to reduce disruptive global rebalances, allowing workers to retain assignments during failures, schedule delayed rebalances, and improve scalability for Kafka Connect clusters, balancing availability and fault tolerance.

Apache KafkaDistributed SystemsIncremental Rebalancing
0 likes · 12 min read
Static Members and Incremental Cooperative Rebalancing in Apache Kafka
Cloud Native Technology Community
Cloud Native Technology Community
Dec 30, 2019 · Big Data

Kafka 2.4.0 Release Summary: New Features, Improvements, and Bug Fixes

The article provides a comprehensive overview of Apache Kafka 2.4.0, detailing its major new capabilities such as consumer replica fetching, progressive cooperative rebalancing, MirrorMaker 2.0, new Java authentication APIs, and extensive bug fixes, along with upgrade considerations and related resources.

Apache KafkaBig DataKafka
0 likes · 26 min read
Kafka 2.4.0 Release Summary: New Features, Improvements, and Bug Fixes
Architects Research Society
Architects Research Society
Oct 20, 2019 · Big Data

Spring Cloud Data Flow: Building and Deploying Event Stream Pipelines with Apache Kafka (Part 3)

This article explains how Spring Cloud Data Flow, together with Spring Cloud Skipper, enables developers to design, deploy, and manage event‑stream pipelines on Apache Kafka, covering ecosystem overview, pipeline components, Docker‑based local setup, stream creation, debugging, monitoring, and integration of Kafka Streams applications.

Apache KafkaDockerEvent Streaming
0 likes · 15 min read
Spring Cloud Data Flow: Building and Deploying Event Stream Pipelines with Apache Kafka (Part 3)
Architects Research Society
Architects Research Society
Oct 16, 2019 · Backend Development

Deep Dive into Using Apache Kafka with Spring Boot: Error Handling, Message Conversion, and Transaction Support

This article explains how to integrate Apache Kafka with Spring Boot, covering error handling with SeekToCurrentErrorHandler, deserialization error handling, type‑inferred message conversion, multi‑listener routing, and transactional message processing, providing code examples and configuration details for each feature.

Apache KafkaError HandlingJava
0 likes · 10 min read
Deep Dive into Using Apache Kafka with Spring Boot: Error Handling, Message Conversion, and Transaction Support