Tagged articles
Kafka Connect
14 articles · Page 1 of 1
The article explains Java SPI’s purpose, how the thread context class loader overcomes parent‑delegation limits, and compares the standard JDK SPI with the extended mechanisms used by Kafka Connect, Elasticsearch, Dubbo, and Spring Boot, providing interview‑ready insights and concrete code examples.
DubboElasticsearchJava
0 likes · 14 min read

This guide walks through the challenges of ingesting high‑volume sales‑point data into ClickHouse, explains why a buffering layer like Kafka is essential, compares three integration approaches—ClickHouse Kafka engine, Kafka Connect, and an external writer—and provides concrete SQL and Terraform examples to help you choose the right solution.
ClickHouseExternal writerKafka
0 likes · 13 min read

The Apache Kafka 3.3 release introduces production‑ready KRaft mode and a series of KIP enhancements across brokers, streams, and connect, detailing new metrics, API changes, and operational improvements while encouraging users to review the full release notes and try the updated platform.
Apache KafkaKIPKafka Connect
0 likes · 10 min read

This article provides a thorough overview of Apache Kafka, covering its core streaming concepts, key components such as topics, partitions, producers and consumers, common use cases, step‑by‑step installation and multi‑broker configuration, fault‑tolerance testing, and an introduction to Kafka Connect for data import/export.
ConsumerKafkaKafka Connect
0 likes · 24 min read

This article provides a comprehensive guide to Apache Kafka, covering its core concepts, architecture, key APIs, topics and partitions, deployment steps, multi‑broker clustering, fault tolerance, and data integration using Kafka Connect, with detailed command‑line examples.
ConsumerKafkaKafka Connect
0 likes · 26 min read

This article introduces Kafka Connect, explaining its purpose as a scalable and reliable tool for moving data between Apache Kafka and external systems, detailing its core concepts, architecture, deployment modes, configuration files, and a step‑by‑step example that streams data from a file source to a file sink.
ETLKafka Connectdata integration
0 likes · 12 min read

This article explains how Debezium's MongoDB Source Connector captures change events from replica sets or sharded clusters, streams them to Kafka topics, and provides detailed configuration, deployment, monitoring, and troubleshooting steps for building reliable change‑data‑capture pipelines.
ConnectorDebeziumKafka Connect
0 likes · 11 min read

This article chronicles the four‑year evolution of Chehaoduo Group’s Kafka ecosystem—from its initial role as a simple data‑ingestion layer to becoming the core of the company’s large‑scale data pipeline—detailing cluster management, upgrade strategies, multi‑cluster deployment, AVRO schema handling, SDK development, and operational lessons learned.
KafkaKafka ConnectSDK
0 likes · 21 min read

Debezium is an open‑source distributed platform built on Apache Kafka that captures row‑level changes from databases via change data capture, providing source connectors, an optional embedded engine, and features like low‑latency streaming, snapshots, filtering, masking, and integration with various sink systems.
CDCDatabase StreamingDebezium
0 likes · 8 min read

Apache Kafka 2.3 introduced static members and incremental cooperative rebalancing to reduce disruptive global rebalances, allowing workers to retain assignments during failures, schedule delayed rebalances, and improve scalability for Kafka Connect clusters, balancing availability and fault tolerance.
Apache KafkaIncremental RebalancingKafka Connect
0 likes · 12 min read

This article introduces Kafka Connect, a framework for building scalable data pipelines between Kafka and other systems, covering its architecture, key concepts like connectors and tasks, and practical deployment examples.
ETLKafka Connectbackend development
0 likes · 20 min read

Debezium is an open‑source distributed platform built on Apache Kafka that turns existing databases into real‑time event streams by capturing row‑level changes via change data capture, offering source and embedded connectors, flexible topic routing, and features such as snapshots, filtering, masking, and monitoring.
CDCDebeziumKafka Connect
0 likes · 7 min read

This article compares the main Kafka distributions—Apache Kafka, Confluent Kafka, and CDH/HDP Kafka—examining their origins, feature sets, ecosystem support, and trade‑offs to help you choose the most suitable version for your streaming workloads.
Kafka Connectbig-dataconfluent
0 likes · 10 min read

This step‑by‑step guide walks you through installing Kafka, starting a single‑node broker, producing and consuming messages, configuring a multi‑node cluster with replication, testing fault tolerance, and using Kafka Connect to import and export data between files.
ClusterKafkaKafka Connect
0 likes · 8 min read
