Tagged articles
Kafka Streams
22 articles · Page 1 of 1

java1234Oct 26, 2026 · Backend Development
Kafka 4.2 introduces Share Groups (KIP-932) allowing multiple consumers to process records from the same partition concurrently using fetch locks and explicit acknowledgments (ACCEPT, RELEASE, REJECT, RENEW), while Kafka Streams gains server-side rebalancing (KIP-1071) and dead-letter queues (KIP-1034); version 4.2.2 adds 33 fixes including exactly-once checkpoint cleanup, deadlock resolution, and latency metric corrections.
Dead Letter QueueKIP-1034KIP-1071
0 likes · 17 min read

This article introduces Apache Kafka as a distributed streaming platform, detailing its core advantages—high throughput via sequential writes and zero-copy, horizontal scalability through partitions, durability with 7-day retention and replication—and key use cases including log aggregation, event-driven architectures, real-time analytics, and big data integration with tools like Flink and Spark Streaming.
KafkaKafka Streamsbig-data-integration
0 likes · 5 min read

This article analyzes Kafka's 2026 AI integration including the official MCP Server (KIP-1318) for natural language cluster management, Real-Time Context Engine for low-latency stream queries, Kafka Streams for agent session memory via KTables, A2A cross-platform agent collaboration, and three integration patterns with code examples, plus pros, cons, and use-case recommendations.
A2A ProtocolAI agentsApache Kafka
0 likes · 25 min read

This article provides a comprehensive guide to integrating Apache Kafka Streams with Spring Boot for production-grade stream processing, covering core concepts, state storage with RocksDB, window aggregation strategies, exactly-once semantics, interactive queries, multi-tenancy isolation, and operational best practices.
Interactive QueriesKafka StreamsMulti-tenancy
0 likes · 16 min read

Kafka Streams is a client library that enables low‑latency, fault‑tolerant real‑time processing of Kafka data through configurable topologies, time semantics, and state stores, and the article explains its architecture, essential configurations, monitoring‑focused ETL example, performance tuning, and strategies for handling partition skew.
ETLJavaKafka Streams
0 likes · 25 min read

This article introduces Apache Kafka as a high‑throughput, scalable, fault‑tolerant distributed streaming platform, explains why it is chosen for real‑time data pipelines, and details key Kafka Streams concepts such as stream processing, interactive queries, stateful processing, windowing, serialization, and testing.
Apache KafkaKafka Streamsbig data
0 likes · 13 min read

Event sourcing models state changes as immutable logs, and when combined with CQRS and Kafka Streams, it enables scalable, fault‑tolerant architectures where write and read paths are decoupled, supporting local or external state stores, interactive queries, and zero‑downtime upgrades.
Kafka Streamsbackend architecturecqrs
0 likes · 21 min read

This article explains how event sourcing models state changes as immutable logs, discusses the trade‑offs of the pattern, and shows how Apache Kafka and Kafka Streams enable CQRS and interactive queries for building scalable, resilient backend applications.
Kafka Streamsbackend architecturecqrs
0 likes · 20 min read

This article explores how stream computing systems achieve correct results by addressing data integrity, distinguishing consistency from correctness, formalizing integrity inference, and comparing implementations across major engines such as Flink, Kafka Streams, MillWheel, and Spark Structured Streaming.
FlinkKafka Streamscorrectness
0 likes · 28 min read

The Apache Kafka 3.3 release introduces production‑ready KRaft mode and a series of KIP enhancements across brokers, streams, and connect, detailing new metrics, API changes, and operational improvements while encouraging users to review the full release notes and try the updated platform.
Apache KafkaKIPKafka Connect
0 likes · 10 min read

This article describes the design, implementation, and performance of ShouQianBa's advertising billing system, detailing the migration from Apache Druid to Kafka Streams, the architecture for real‑time event processing, data aggregation, persistence, fault tolerance, and the achieved low‑latency, high‑throughput metrics.
AdvertisingData StreamingKafka Streams
0 likes · 15 min read

This article explains how to design and implement a terabyte‑level log monitoring platform using ELK Stack, FileBeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, visualization, and resource‑efficient processing for large‑scale microservice environments.
GrafanaKafka StreamsLogging
0 likes · 9 min read

This article explains how to build a terabyte‑level log monitoring platform for micro‑service environments by unifying log collection with FileBeat, enriching observability through Elastic APM, processing streams via Kafka Streams, and visualizing metrics with Grafana and Kibana, while addressing cost‑effective filtering and retention strategies.
ELK stackGrafanaKafka Streams
0 likes · 8 min read

This article explains Kafka's evolution—highlighting the introduction of Kafka Streams, the shift to a full distributed stream processing platform, practical learning paths, source‑code reading tips, common pitfalls, and the major new features introduced in Kafka 3.0.
KafkaKafka Streamsbig data
0 likes · 7 min read

This article explains how to design and implement a TB‑scale log monitoring solution using the ELK stack, FileBeat, Elastic APM, Kafka Streams, Prometheus and Grafana, detailing architecture, data collection, filtering, visualization, and the trade‑offs of resource usage in large‑scale microservice environments.
ELK stackGrafanaKafka Streams
0 likes · 8 min read

This article explains how to design and implement a TB‑level log monitoring system for microservice environments using the ELK stack, detailing log collection with FileBeat, tracing via Elastic APM, resource‑efficient processing with Kafka Streams, and visualization through Grafana and Kibana.
GrafanaKafka Streamselastic apm
0 likes · 8 min read

This article explains how to design and implement a TB‑level log monitoring platform for micro‑service environments using ELK Stack, Filebeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, storage, and visualization while addressing cost and resource constraints.
GrafanaKafka StreamsOperations
0 likes · 9 min read

This guide walks through setting up Kafka Streams with Spring Boot 2.3, covering environment configuration, core concepts, topology design, and multiple practical examples—including message sending, listening, transformations, aggregations, filtering, branching, and multi‑field grouping—complete with full code snippets and execution results.
JavaKafkaKafka Streams
0 likes · 13 min read

This article explains how event sourcing models state changes as immutable logs, discusses its advantages and drawbacks, shows how CQRS separates command and query responsibilities, and demonstrates how Apache Kafka and Kafka Streams enable scalable, fault‑tolerant implementations with real‑world examples.
Kafka Streamscqrsevent-sourcing
0 likes · 17 min read

In large‑scale microservice environments, centralized log collection, filtering, and visualization using Filebeat, Elastic APM, Kafka Streams, Grafana and Prometheus can turn scattered logs into actionable operational data while controlling resource costs.
GrafanaKafka StreamsOperations
0 likes · 9 min read

This article provides a comprehensive guide to upgrading Apache Kafka across multiple versions, detailing rolling upgrade procedures, configuration adjustments, protocol changes, new features, deprecations, and performance considerations for Kafka brokers, producers, consumers, and Kafka Streams applications.
Kafka StreamsUpgradebig-data
0 likes · 56 min read

The article describes an enterprise‑grade log monitoring solution that unifies log collection, filtering, cleaning, and visualization across hundreds of microservices using tools such as Filebeat, Elastic APM, Kafka Streams, Prometheus, Grafana and Kibana to improve troubleshooting, performance analysis, and operational efficiency.
GrafanaKafka Streamselastic apm
0 likes · 8 min read
