Tagged articles

Kafka Streams

20 articles · Page 1 of 1
Su San Talks Tech
Su San Talks Tech
Sep 12, 2026 · Artificial Intelligence

Kafka Goes AI-Native: MCP Server, Context Engine & Agent Memory Patterns

This article analyzes Kafka's 2026 AI integration including the official MCP Server (KIP-1318) for natural language cluster management, Real-Time Context Engine for low-latency stream queries, Kafka Streams for agent session memory via KTables, A2A cross-platform agent collaboration, and three integration patterns with code examples, plus pros, cons, and use-case recommendations.

A2A protocolAI AgentsApache Kafka
0 likes · 25 min read
Kafka Goes AI-Native: MCP Server, Context Engine & Agent Memory Patterns
Xiaolin Talks Programming
Xiaolin Talks Programming
Aug 11, 2026 · Backend Development

Building Stream Processing Apps with Spring Boot & Kafka Streams: State Stores, Windowing & Exactly-Once

This article provides a comprehensive guide to integrating Apache Kafka Streams with Spring Boot for production-grade stream processing, covering core concepts, state storage with RocksDB, window aggregation strategies, exactly-once semantics, interactive queries, multi-tenancy isolation, and operational best practices.

Exactly-OnceInteractive QueriesKafka Streams
0 likes · 16 min read
Building Stream Processing Apps with Spring Boot & Kafka Streams: State Stores, Windowing & Exactly-Once
vivo Internet Technology
vivo Internet Technology
Dec 18, 2024 · Big Data

Kafka Streams: Architecture, Configuration, and Monitoring Use Cases

Kafka Streams is a client library that enables low‑latency, fault‑tolerant real‑time processing of Kafka data through configurable topologies, time semantics, and state stores, and the article explains its architecture, essential configurations, monitoring‑focused ETL example, performance tuning, and strategies for handling partition skew.

ETLJavaKafka Streams
0 likes · 25 min read
Kafka Streams: Architecture, Configuration, and Monitoring Use Cases
FunTester
FunTester
Jan 5, 2024 · Big Data

An Overview of Apache Kafka and Kafka Streams Technical Features

This article introduces Apache Kafka as a high‑throughput, scalable, fault‑tolerant distributed streaming platform, explains why it is chosen for real‑time data pipelines, and details key Kafka Streams concepts such as stream processing, interactive queries, stateful processing, windowing, serialization, and testing.

Apache KafkaKafka StreamsStreaming
0 likes · 13 min read
An Overview of Apache Kafka and Kafka Streams Technical Features
Architects Research Society
Architects Research Society
Apr 18, 2023 · Backend Development

Event Sourcing, CQRS, and Stream Processing with Apache Kafka

Event sourcing models state changes as immutable logs, and when combined with CQRS and Kafka Streams, it enables scalable, fault‑tolerant architectures where write and read paths are decoupled, supporting local or external state stores, interactive queries, and zero‑downtime upgrades.

CQRSKafka Streamsbackend architecture
0 likes · 21 min read
Event Sourcing, CQRS, and Stream Processing with Apache Kafka
SQB Blog
SQB Blog
Sep 22, 2022 · Big Data

How We Built a Low‑Latency Advertising Billing System with Kafka Streams

This article describes the design, implementation, and performance of ShouQianBa's advertising billing system, detailing the migration from Apache Druid to Kafka Streams, the architecture for real‑time event processing, data aggregation, persistence, fault tolerance, and the achieved low‑latency, high‑throughput metrics.

AdvertisingData StreamingKafka Streams
0 likes · 15 min read
How We Built a Low‑Latency Advertising Billing System with Kafka Streams
Programmer DD
Programmer DD
Jan 11, 2022 · Operations

Building a TB‑Scale Log Monitoring System with ELK Stack and Kafka Streams

This article explains how to design and implement a terabyte‑level log monitoring platform using ELK Stack, FileBeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, visualization, and resource‑efficient processing for large‑scale microservice environments.

ELKGrafanaKafka Streams
0 likes · 9 min read
Building a TB‑Scale Log Monitoring System with ELK Stack and Kafka Streams
IT Architects Alliance
IT Architects Alliance
Nov 11, 2021 · Operations

Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack

This article explains how to build a terabyte‑level log monitoring platform for micro‑service environments by unifying log collection with FileBeat, enriching observability through Elastic APM, processing streams via Kafka Streams, and visualizing metrics with Grafana and Kibana, while addressing cost‑effective filtering and retention strategies.

ELK StackGrafanaKafka Streams
0 likes · 8 min read
Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack
MaGe Linux Operations
MaGe Linux Operations
Oct 29, 2021 · Operations

Building a Scalable TB‑Level Log Monitoring System with ELK Stack

This article explains how to design and implement a TB‑scale log monitoring solution using the ELK stack, FileBeat, Elastic APM, Kafka Streams, Prometheus and Grafana, detailing architecture, data collection, filtering, visualization, and the trade‑offs of resource usage in large‑scale microservice environments.

ELK StackGrafanaKafka Streams
0 likes · 8 min read
Building a Scalable TB‑Level Log Monitoring System with ELK Stack
Architecture Digest
Architecture Digest
Oct 21, 2021 · Operations

Building a TB‑Scale Log Monitoring System with ELK Stack

This article explains how to design and implement a TB‑level log monitoring system for microservice environments using the ELK stack, detailing log collection with FileBeat, tracing via Elastic APM, resource‑efficient processing with Kafka Streams, and visualization through Grafana and Kibana.

ELKGrafanaKafka Streams
0 likes · 8 min read
Building a TB‑Scale Log Monitoring System with ELK Stack
IT Architects Alliance
IT Architects Alliance
Oct 14, 2021 · Operations

How to Build a TB‑Scale Log Monitoring System with ELK Stack

This article explains how to design and implement a TB‑level log monitoring platform for micro‑service environments using ELK Stack, Filebeat, Elastic APM, Kafka Streams, Prometheus, and Grafana, covering data collection, filtering, storage, and visualization while addressing cost and resource constraints.

ELKFilebeatGrafana
0 likes · 9 min read
How to Build a TB‑Scale Log Monitoring System with ELK Stack
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Aug 12, 2021 · Backend Development

Master Kafka Streams in Spring Boot: Real‑Time Data Processing with Code Samples

This guide walks through setting up Kafka Streams with Spring Boot 2.3, covering environment configuration, core concepts, topology design, and multiple practical examples—including message sending, listening, transformations, aggregations, filtering, branching, and multi‑field grouping—complete with full code snippets and execution results.

JavaKafkaKafka Streams
0 likes · 13 min read
Master Kafka Streams in Spring Boot: Real‑Time Data Processing with Code Samples
Architects Research Society
Architects Research Society
Dec 18, 2020 · Backend Development

Event Sourcing, CQRS, and Kafka Streams: Architecture, Trade‑offs, and Practical Examples

This article explains how event sourcing models state changes as immutable logs, discusses its advantages and drawbacks, shows how CQRS separates command and query responsibilities, and demonstrates how Apache Kafka and Kafka Streams enable scalable, fault‑tolerant implementations with real‑world examples.

CQRSEvent SourcingKafka Streams
0 likes · 17 min read
Event Sourcing, CQRS, and Kafka Streams: Architecture, Trade‑offs, and Practical Examples
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 6, 2020 · Big Data

Kafka Upgrade Guide and Version Changes Overview

This article provides a comprehensive guide to upgrading Apache Kafka across multiple versions, detailing rolling upgrade procedures, configuration adjustments, protocol changes, new features, deprecations, and performance considerations for Kafka brokers, producers, consumers, and Kafka Streams applications.

Kafka StreamsPerformancebig-data
0 likes · 56 min read
Kafka Upgrade Guide and Version Changes Overview
Top Architect
Top Architect
Jul 5, 2020 · Operations

Enterprise Log Monitoring System Architecture for Microservice Environments

The article describes an enterprise‑grade log monitoring solution that unifies log collection, filtering, cleaning, and visualization across hundreds of microservices using tools such as Filebeat, Elastic APM, Kafka Streams, Prometheus, Grafana and Kibana to improve troubleshooting, performance analysis, and operational efficiency.

FilebeatGrafanaKafka Streams
0 likes · 8 min read
Enterprise Log Monitoring System Architecture for Microservice Environments