BestHub
Sign in
Tag

Consumer Group

1 views collected around this technical thread.

Instant Consumer Technology Team
Instant Consumer Technology Team
Jun 5, 2025 · Big Data

Mastering Kafka in Production: Boost Throughput, Ensure Reliability, and Avoid Data Loss

This article shares practical Kafka production insights, covering architecture overview, producer throughput tuning, message loss prevention, broker and consumer configurations, duplicate consumption avoidance, backlog mitigation, ordering guarantees, and the mechanics of consumer group rebalancing, helping engineers build stable, high‑performance streaming pipelines.

Big DataConsumer GroupKafka
0 likes · 15 min read
Mastering Kafka in Production: Boost Throughput, Ensure Reliability, and Avoid Data Loss
Sohu Tech Products
Sohu Tech Products
Mar 12, 2025 · Databases

Understanding Redis Streams: Core Commands and SpringBoot Integration

The article introduces Redis Streams as a Kafka‑like messaging structure, explains its fundamental concepts and seven core commands (XADD, XRANGE, XREAD, XGROUP CREATE, XREADGROUP, XACK, XTRIM), demonstrates integration with Spring Boot, and evaluates its fit for lightweight, low‑backlog queue scenarios.

Consumer GroupMessage QueueRedis
0 likes · 14 min read
Understanding Redis Streams: Core Commands and SpringBoot Integration
Efficient Ops
Efficient Ops
Oct 7, 2023 · Big Data

Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture

This article explains Kafka's role as a messaging system, covering core concepts such as topics, partitions, producers, consumers, messages, cluster architecture, replicas, consumer groups, controller coordination with Zookeeper, and performance optimizations like sequential writes and zero‑copy networking.

Big DataConsumer GroupKafka
0 likes · 11 min read
Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture
Sanyou's Java Diary
Sanyou's Java Diary
Jun 26, 2023 · Big Data

Master Kafka Interview Questions: Architecture, Partitioning, and Reliability Explained

This article provides a comprehensive overview of Kafka, covering its core architecture, message queue models, communication process, partition selection, consumer groups, rebalancing strategies, partition assignment algorithms, reliability guarantees, replica synchronization, and reasons for removing Zookeeper in newer versions.

Consumer GroupInterviewKafka
0 likes · 20 min read
Master Kafka Interview Questions: Architecture, Partitioning, and Reliability Explained
Architect's Guide
Architect's Guide
Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

Cluster PlanningConsumer GroupKafka
0 likes · 29 min read
Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning
37 Interactive Technology Team
37 Interactive Technology Team
Aug 1, 2022 · Backend Development

Understanding Kafka Consumer Groups, Polling, and Offset Commit Strategies with kafka-go

The article demonstrates how kafka-go implements consumer groups by creating readers that spawn poll goroutines per partition, explains heartbeat‑driven rebalancing, and compares automatic versus manual offset‑commit strategies, highlighting their impact on throughput, reliability, and message‑processing semantics.

Consumer GroupGoKafka
0 likes · 15 min read
Understanding Kafka Consumer Groups, Polling, and Offset Commit Strategies with kafka-go
ByteDance Dali Intelligent Technology Team
ByteDance Dali Intelligent Technology Team
Aug 26, 2021 · Backend Development

Design and Implementation of a Distributed KV‑Based Message Queue

This article explains the core concepts and detailed design of a custom message queue built on a distributed key‑value store, covering terminology, architecture, broker metadata, topic metadata, message format, sending, storage, retrieval, delay handling, retry mechanisms, dead‑letter queues, and TTL policies.

Consumer GroupDelay MessageDistributed KV
0 likes · 13 min read
Design and Implementation of a Distributed KV‑Based Message Queue
IT Architects Alliance
IT Architects Alliance
Apr 24, 2021 · Big Data

Kafka Basics and Cluster Architecture Overview

This article explains Kafka's role as a decoupling message buffer, describes topics, partitions, replication, consumer groups, controller coordination with Zookeeper, and performance optimizations such as sequential writes, zero‑copy, log segmentation, and its reactor‑style network design.

Consumer GroupKafkaMessaging
0 likes · 10 min read
Kafka Basics and Cluster Architecture Overview
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jan 12, 2021 · Databases

Implementing Message Queues with Redis: List, Pub/Sub, and Streams

This article explains how Redis can be used as a lightweight message‑queue solution by leveraging its List, Pub/Sub, and Stream data structures, covering core commands, blocking consumption, acknowledgment mechanisms, consumer groups, and practical usage patterns for distributed systems.

Consumer GroupMessage QueuePub/Sub
0 likes · 20 min read
Implementing Message Queues with Redis: List, Pub/Sub, and Streams
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Oct 22, 2020 · Backend Development

Core Concepts and Architecture of RocketMQ

This article introduces RocketMQ’s core concepts, including its deployment architecture, naming server, broker and client roles, subscription model, consumption modes, queue allocation algorithms, rebalancing, offset storage, transaction and delayed messages, as well as filtering mechanisms, providing a solid foundation for further practice.

Consumer GroupMessage QueueQueue Allocation
0 likes · 13 min read
Core Concepts and Architecture of RocketMQ
Architects Research Society
Architects Research Society
Jul 28, 2020 · Big Data

Understanding Apache Kafka Rebalance Protocol: Fundamentals and Practical Details

This article explains the fundamentals of Apache Kafka's consumer group rebalance protocol, covering partitioning, group coordination, JoinGroup and SyncGroup requests, heartbeat handling, common pitfalls, and best‑practice warnings for reliable streaming data processing.

Consumer GroupKafkaRebalance
0 likes · 13 min read
Understanding Apache Kafka Rebalance Protocol: Fundamentals and Practical Details
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 10, 2020 · Backend Development

Understanding Kafka Consumer Groups, Repartition Triggers, and Consumption Guarantees

This article explains the relationship between Kafka consumers and consumer groups, when repartition occurs, how consumers interact with Zookeeper, the overall consumer workflow, and the three delivery semantics (at‑least‑once, at‑most‑once, exactly‑once) in a concise, technical overview.

Consumer GroupKafkaMessage Queue
0 likes · 8 min read
Understanding Kafka Consumer Groups, Repartition Triggers, and Consumption Guarantees
Laravel Tech Community
Laravel Tech Community
May 22, 2020 · Big Data

Understanding Kafka Architecture: Topics, Partitions, Consumption Model, Network and Storage

This article explains Kafka's core architecture, covering how topics and partitions are stored, the advantages of its consumption model, the internal network and threading design, and the high‑reliability distributed log storage and replication mechanisms that ensure data durability and scalability.

Consumer GroupDistributed MessagingHigh Availability
0 likes · 11 min read
Understanding Kafka Architecture: Topics, Partitions, Consumption Model, Network and Storage
Qunar Tech Salon
Qunar Tech Salon
Feb 27, 2018 · Big Data

Root Cause Analysis of Kafka Consumer Group Coordinator Failure and __consumer_offsets Compaction Issues

The article investigates a Kafka cluster outage where several brokers became unavailable and consumers could not join groups, explains the role of __consumer_offsets, analyzes the coordinator selection logic, identifies a stuck loadGroupsForPartition operation and compact thread failure, and documents the recovery steps taken.

Consumer GroupKafkaLog Compaction
0 likes · 11 min read
Root Cause Analysis of Kafka Consumer Group Coordinator Failure and __consumer_offsets Compaction Issues