Tag

Kafka Streams

0 views collected around this technical thread.

vivo Internet Technology
vivo Internet Technology
Dec 18, 2024 · Big Data

Kafka Streams: Architecture, Configuration, and Monitoring Use Cases

Kafka Streams is a client library that enables low‑latency, fault‑tolerant real‑time processing of Kafka data through configurable topologies, time semantics, and state stores, and the article explains its architecture, essential configurations, monitoring‑focused ETL example, performance tuning, and strategies for handling partition skew.

Big DataJavaKafka Streams
0 likes · 25 min read
Kafka Streams: Architecture, Configuration, and Monitoring Use Cases
FunTester
FunTester
Jan 5, 2024 · Big Data

An Overview of Apache Kafka and Kafka Streams Technical Features

This article introduces Apache Kafka as a high‑throughput, scalable, fault‑tolerant distributed streaming platform, explains why it is chosen for real‑time data pipelines, and details key Kafka Streams concepts such as stream processing, interactive queries, stateful processing, windowing, serialization, and testing.

Apache KafkaBig DataKafka Streams
0 likes · 13 min read
An Overview of Apache Kafka and Kafka Streams Technical Features
Architects Research Society
Architects Research Society
Apr 18, 2023 · Backend Development

Event Sourcing, CQRS, and Stream Processing with Apache Kafka

Event sourcing models state changes as immutable logs, and when combined with CQRS and Kafka Streams, it enables scalable, fault‑tolerant architectures where write and read paths are decoupled, supporting local or external state stores, interactive queries, and zero‑downtime upgrades.

CQRSEvent SourcingKafka Streams
0 likes · 21 min read
Event Sourcing, CQRS, and Stream Processing with Apache Kafka
Architects Research Society
Architects Research Society
Feb 28, 2023 · Backend Development

Event Sourcing, CQRS, and Stream Processing with Apache Kafka

This article explains how event sourcing models state changes as immutable logs, discusses the trade‑offs of the pattern, and shows how Apache Kafka and Kafka Streams enable CQRS and interactive queries for building scalable, resilient backend applications.

CQRSEvent SourcingKafka Streams
0 likes · 20 min read
Event Sourcing, CQRS, and Stream Processing with Apache Kafka
Big Data Technology Architecture
Big Data Technology Architecture
Oct 10, 2022 · Big Data

Apache Kafka 3.3 Release Highlights New KRaft Mode and Multiple KIP Enhancements

The Apache Kafka 3.3 release introduces production‑ready KRaft mode and a series of KIP enhancements across brokers, streams, and connect, detailing new metrics, API changes, and operational improvements while encouraging users to review the full release notes and try the updated platform.

Apache KafkaBig DataKIP
0 likes · 10 min read
Apache Kafka 3.3 Release Highlights New KRaft Mode and Multiple KIP Enhancements
IT Architects Alliance
IT Architects Alliance
Nov 11, 2021 · Operations

Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack

This article explains how to build a terabyte‑level log monitoring platform for micro‑service environments by unifying log collection with FileBeat, enriching observability through Elastic APM, processing streams via Kafka Streams, and visualizing metrics with Grafana and Kibana, while addressing cost‑effective filtering and retention strategies.

ELK StackGrafanaKafka Streams
0 likes · 8 min read
Design and Implementation of a TB‑Scale Log Monitoring System Using the ELK Stack
Architecture Digest
Architecture Digest
Oct 21, 2021 · Operations

Building a TB‑Scale Log Monitoring System with ELK Stack

This article explains how to design and implement a TB‑level log monitoring system for microservice environments using the ELK stack, detailing log collection with FileBeat, tracing via Elastic APM, resource‑efficient processing with Kafka Streams, and visualization through Grafana and Kibana.

ELKFilebeatGrafana
0 likes · 8 min read
Building a TB‑Scale Log Monitoring System with ELK Stack
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Aug 12, 2021 · Backend Development

Master Kafka Streams in Spring Boot: Real‑Time Data Processing with Code Samples

This guide walks through setting up Kafka Streams with Spring Boot 2.3, covering environment configuration, core concepts, topology design, and multiple practical examples—including message sending, listening, transformations, aggregations, filtering, branching, and multi‑field grouping—complete with full code snippets and execution results.

JavaKafkaKafka Streams
0 likes · 13 min read
Master Kafka Streams in Spring Boot: Real‑Time Data Processing with Code Samples
Architects Research Society
Architects Research Society
Dec 18, 2020 · Backend Development

Event Sourcing, CQRS, and Kafka Streams: Architecture, Trade‑offs, and Practical Examples

This article explains how event sourcing models state changes as immutable logs, discusses its advantages and drawbacks, shows how CQRS separates command and query responsibilities, and demonstrates how Apache Kafka and Kafka Streams enable scalable, fault‑tolerant implementations with real‑world examples.

CQRSEvent SourcingKafka Streams
0 likes · 17 min read
Event Sourcing, CQRS, and Kafka Streams: Architecture, Trade‑offs, and Practical Examples
Top Architect
Top Architect
Jul 5, 2020 · Operations

Enterprise Log Monitoring System Architecture for Microservice Environments

The article describes an enterprise‑grade log monitoring solution that unifies log collection, filtering, cleaning, and visualization across hundreds of microservices using tools such as Filebeat, Elastic APM, Kafka Streams, Prometheus, Grafana and Kibana to improve troubleshooting, performance analysis, and operational efficiency.

FilebeatGrafanaKafka Streams
0 likes · 8 min read
Enterprise Log Monitoring System Architecture for Microservice Environments