Topic

producer

Collection size
56 articles
Page 2 of 3
Top Architect
Top Architect
Mar 30, 2023 · Backend Development

Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates

This article explains why message duplication occurs in Kafka, describes the three delivery semantics, and provides practical solutions—including idempotent producers, transactions, and consumer-side idempotence—along with configuration tips and code examples to achieve exactly‑once delivery.

JavaKafkaMessage Duplication
0 likes · 11 min read
Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates
Top Architect
Top Architect
Mar 27, 2023 · Big Data

Kafka Architecture, Performance Optimization, and Production Deployment Guide

This article provides a comprehensive overview of Kafka’s core concepts, high‑performance design, cluster planning, resource evaluation, deployment steps, producer and consumer configurations, fault‑tolerance mechanisms, and operational tools, offering practical guidance for building and managing a high‑throughput Kafka production environment.

Cluster DeploymentConsumerJava
0 likes · 31 min read
Kafka Architecture, Performance Optimization, and Production Deployment Guide
Top Architect
Top Architect
Aug 31, 2022 · Big Data

Kafka Components and Architecture Overview

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication, leader/follower dynamics, and architectural diagrams, while also highlighting configuration details and operational considerations for building reliable distributed streaming systems.

BrokerConsumerKafka
0 likes · 9 min read
Kafka Components and Architecture Overview
Top Architect
Top Architect
Jul 21, 2022 · Big Data

Kafka Components and Architecture Explained

This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication strategies, and how they work together within a Kafka cluster to ensure reliable, scalable message streaming.

BrokerConsumerDistributed
0 likes · 8 min read
Kafka Components and Architecture Explained
Top Architect
Top Architect
Jun 25, 2022 · Big Data

Kafka Core Concepts: Basics, Producers & Consumers, Topics, Partitions, and Architecture

This article provides a visual and textual overview of Kafka's fundamental concepts—including its role as a streaming/message queue system, the producer‑consumer model, topics and partitions, consumer groups, and the cluster architecture managed by ZooKeeper—while also noting promotional offers and community links.

ConsumerKafkaMessage Queue
0 likes · 9 min read
Kafka Core Concepts: Basics, Producers & Consumers, Topics, Partitions, and Architecture
Top Architect
Top Architect
Nov 14, 2021 · Big Data

Kafka Core Concepts Illustrated: Basics, Producers/Consumers, Topics, Partitions, and Architecture

This article provides a visual walkthrough of Kafka's fundamental concepts—including its basic architecture, producer‑consumer model, topics, partitions, and cluster design—offering clear explanations and diagrams to help readers grasp how Kafka enables reliable, scalable message streaming in modern systems.

ConsumerKafkaMessage Streaming
0 likes · 5 min read
Kafka Core Concepts Illustrated: Basics, Producers/Consumers, Topics, Partitions, and Architecture
Top Architect
Top Architect
May 26, 2021 · Big Data

Comprehensive Introduction to Apache Kafka: Concepts, Architecture, Installation, and Usage

This article provides a comprehensive guide to Apache Kafka, covering its core concepts, architecture, key APIs, topics and partitions, deployment steps, multi‑broker clustering, fault tolerance, and data integration using Kafka Connect, with detailed command‑line examples.

ConsumerDistributed StreamingKafka
0 likes · 26 min read
Comprehensive Introduction to Apache Kafka: Concepts, Architecture, Installation, and Usage
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 22, 2025 · Big Data

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

This article details practical techniques for boosting Kafka producer throughput, covering batch sending optimization, linger.ms tuning, asynchronous send handling, compression options, and concurrent sending strategies, while providing code examples and performance considerations for high‑throughput streaming applications.

BatchingKafkaasynchronous
0 likes · 4 min read
Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 21, 2022 · Backend Development

12 Core Principles of Message Queues (MQ) – A Comprehensive Summary

This article provides a detailed overview of message queue fundamentals, covering producers, consumers, brokers, queue and topic models, delivery guarantees, acknowledgment mechanisms, ordering, persistence, high availability, and selection criteria, helping readers quickly grasp essential MQ concepts for distributed systems.

BrokerConsumerMessage Queue
0 likes · 9 min read
12 Core Principles of Message Queues (MQ) – A Comprehensive Summary
Architect's Guide
Architect's Guide
Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

BackendCluster PlanningConsumer Group
0 likes · 29 min read
Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning
Selected Java Interview Questions
Selected Java Interview Questions
Aug 7, 2022 · Backend Development

Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies

This article explains how RocketMQ reduces message loss and duplicate consumption through synchronous sending, retry mechanisms, multi‑master brokers, synchronous disk flushing, master‑slave replication, at‑least‑once delivery, and idempotent processing techniques.

BrokerConsumerDuplicate Consumption
0 likes · 10 min read
Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies
Selected Java Interview Questions
Selected Java Interview Questions
Jul 19, 2021 · Backend Development

Message Queue Concepts and Consumption Scenarios

This article explains the core concepts of message queues—including producers, consumers, messages, brokers, and push/pull delivery—and analyzes three consumption scenarios: at‑most‑once, at‑least‑once, and exactly‑once, detailing the required producer, broker, and consumer behaviors for each.

ConsumerMessage BrokerMessage Queue
0 likes · 6 min read
Message Queue Concepts and Consumption Scenarios
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Apr 12, 2021 · Big Data

Master Kafka’s Delivery Guarantees: At‑Most, At‑Least, and Exactly‑Once Explained

This article explains Kafka’s three delivery semantics—At most once, At least once, and Exactly once—from both producer and consumer perspectives, details the required configuration settings, and discusses how Kafka ensures idempotence, transaction support, and prevents data loss, duplication, and ordering issues.

ConsumerKafkadelivery guarantees
0 likes · 23 min read
Master Kafka’s Delivery Guarantees: At‑Most, At‑Least, and Exactly‑Once Explained
vivo Internet Technology
vivo Internet Technology
Mar 30, 2022 · Backend Development

Load Balancing Mechanism in RocketMQ Producer and Consumer

The article explains RocketMQ’s load‑balancing for producers and consumers, detailing how producers obtain routing info from the NameServer, select MessageQueues via round‑robin while avoiding failed brokers, and how consumers periodically rebalance queue allocation using strategies such as AllocateMessageQueueAveragely to ensure even distribution and customizable assignment.

ConsumerJavaMessage Queue
0 likes · 22 min read
Load Balancing Mechanism in RocketMQ Producer and Consumer
Qunar Tech Salon
Qunar Tech Salon
Mar 10, 2015 · Big Data

Kafka Overview: Architecture, Core Concepts, and Comparison with Other Message Queues

This article provides a comprehensive overview of Kafka, covering its background, design goals, architecture, key terminology, message routing, consumer groups, delivery guarantees, and a comparison with other popular message queue systems such as RabbitMQ, Redis, ZeroMQ, and ActiveMQ.

ConsumerKafkaMessage Queue
0 likes · 21 min read
Kafka Overview: Architecture, Core Concepts, and Comparison with Other Message Queues
360 Quality & Efficiency
360 Quality & Efficiency
Jul 23, 2021 · Big Data

Introduction to Apache Kafka: Architecture, APIs, Code Examples, and Optimization

This article provides a comprehensive overview of Apache Kafka, covering its definition, architecture, command‑line API usage, Java producer and consumer examples, core principles such as high availability and message ordering, configuration tuning, and a summary of its advantages as a high‑throughput, fault‑tolerant streaming platform.

ConsumerKafkaMessage Queue
0 likes · 12 min read
Introduction to Apache Kafka: Architecture, APIs, Code Examples, and Optimization
Big Data Technology Architecture
Big Data Technology Architecture
Apr 13, 2020 · Backend Development

Understanding Kafka Producer: Architecture, Data Structures, Serialization, Partitioning, and Buffering

This article provides a comprehensive overview of Kafka's Producer side, covering its architecture, the ProducerRecord data structure, serialization mechanisms, partitioning logic, and the accumulator buffer, while comparing old and new Producer clients and illustrating key configurations with code examples.

AccumulatorKafkaSerialization
0 likes · 9 min read
Understanding Kafka Producer: Architecture, Data Structures, Serialization, Partitioning, and Buffering
IT Architects Alliance
IT Architects Alliance
Jul 21, 2022 · Big Data

Explanation of Kafka Components and Architecture

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, log structures, replication mechanisms, and the system’s architecture, supplemented with practical visual illustrative diagrams.

ConsumerKafkaMessaging
0 likes · 8 min read
Explanation of Kafka Components and Architecture