This article explains how Zookeeper functions as an essential part of Kafka by managing broker status, controller election, quotas, ISR tracking, node and topic registration, as well as consumer offset storage and registration, providing a comprehensive overview for interview preparation.
This article lists frequent Apache Kafka exceptions such as UnknownTopicOrPartitionException, LEADER_NOT_AVAILABLE, NotLeaderForPartitionException, TimeoutException, RecordTooLargeException, and others, explaining each error message, typical reasons, and practical troubleshooting steps for producers and consumers.
This guide explains the basic RabbitMQ model, shows how to obtain a Java connection, demonstrates code for a producer to send messages and a consumer to receive them, and discusses the limitations of a simple queue setup.
This article provides a comprehensive overview of Apache Kafka's architecture, covering topics such as producer and consumer workflows, partition and replica management, leader election, offset handling, message delivery semantics, transaction support, and file organization, illustrating how Kafka achieves high performance and scalability.
This article explains how Apache Kafka implements transactional messaging, covering the atomic write guarantees across partitions, the role of TransactionCoordinator, transaction state management, producer and consumer handling, code examples, and the end‑to‑end workflow for exactly‑once semantics.
This article analyzes common production problems such as delayed or expired messages, full queues, and massive backlogs in message‑queue systems, and provides step‑by‑step emergency scaling and recovery strategies, including temporary consumer deployment and data re‑injection techniques.
This article explains the core concepts, components, design considerations, and common models of message queues—including point‑to‑point and publish/subscribe—while covering ordering, acknowledgment, transaction support, persistence, high availability, and practical selection guidance for high‑concurrency systems.
This article presents a comprehensive overview of several Go utilities—including golog for logging, shardmap for high‑performance map sharding, a custom redis wrapper, goconsumer for asynchronous queue processing, and the gobox‑demo project template—along with practical advice on structuring controllers, services, and overall project organization for backend development.
This article provides a comprehensive overview of Apache Kafka, comparing it with ActiveMQ, explaining its distributed architecture, topics, partitions, consumption models, high‑availability mechanisms, exactly‑once semantics, and includes detailed Java producer and consumer code examples for practical implementation.
This article explains Kafka’s High‑Level and Low‑Level consumer models, the semantics of Consumer Groups, the rebalance algorithm and its drawbacks, and outlines the planned redesign in Kafka 0.9.x that introduces a central Coordinator to solve herd and split‑brain issues.
This article demonstrates how to create a basic RabbitMQ consumer in C# by implementing a subscriber class with event handling, shows sample usage code, and explains the main exchange types (direct, fanout, topic) to help developers understand message routing and real‑time consumption.
This article provides a comprehensive overview of Kafka's core configuration options, detailing default values and descriptions for broker, producer, consumer, and topic‑level settings to help administrators fine‑tune performance, reliability, and resource usage.
Kafka, the open‑source distributed messaging system from LinkedIn, offers O(1) persistence, high throughput, partitioned topics, and flexible delivery guarantees, making it a cornerstone for modern big‑data pipelines and real‑time processing alongside Hadoop, Spark, and Storm.
This article explains Apache Kafka’s core concepts, high‑throughput design choices such as sequential I/O, PageCache, Sendfile, and partitioning, and provides practical performance tips and configuration recommendations for brokers, producers, and consumers in large‑scale data pipelines.
This article provides a comprehensive overview of Apache Kafka, covering its origin, core design goals, key terminology, architectural components, message routing, consumer groups, delivery guarantees, and a detailed comparison with other popular message queue systems.
This article provides a comprehensive overview of Kafka, covering its background, design goals, architecture, key terminology, message routing, consumer groups, delivery guarantees, and a comparison with other popular message queue systems such as RabbitMQ, Redis, ZeroMQ, and ActiveMQ.
