BestHub
Sign in
Tagged articles
23 articles
Page 1 of 1
mikechen
mikechen
Sep 11, 2025 · Backend Development

How Does Kafka Guarantee Message Order? Key Mechanisms Explained

This article explains why message ordering is critical in scenarios such as financial transactions, e‑commerce order updates, audit logs, and IoT devices, then details Kafka’s core components—topics, partitions, offsets, producers, brokers, and consumer groups—and describes how single‑partition consumption and consistent key hashing ensure ordered processing while balancing throughput.

BackendKafkaMessage Ordering
0 likes · 5 min read
How Does Kafka Guarantee Message Order? Key Mechanisms Explained
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 25, 2024 · Big Data

Fundamental Concepts and File Layout of Paimon: Snapshots, Partitions, Buckets, Consistency, and Compaction

This article explains Paimon's core concepts—including snapshots, partitions, buckets, consistency guarantees, file layout, LSM‑tree organization, and compaction strategies—while also covering table management tasks such as snapshot expiration, rollback, partition expiration, and small‑file mitigation techniques.

Big DataBucketsLSM‑Tree
0 likes · 12 min read
Fundamental Concepts and File Layout of Paimon: Snapshots, Partitions, Buckets, Consistency, and Compaction
IT Architects Alliance
IT Architects Alliance
Aug 30, 2022 · Big Data

Understanding Kafka: Architecture, Topics, Partitions, Producers, Consumers, Offsets, Transactions, and Configuration

This article provides a comprehensive overview of Apache Kafka, explaining its distributed message‑queue architecture, the role of topics and partitions, producer and consumer workflows, leader election, offset management, consumer‑group rebalancing, delivery semantics, transaction processing, file organization, and key configuration settings.

Big DataDistributed MessagingKafka
0 likes · 17 min read
Understanding Kafka: Architecture, Topics, Partitions, Producers, Consumers, Offsets, Transactions, and Configuration
Top Architect
Top Architect
Aug 28, 2022 · Big Data

Understanding Kafka Architecture: Topics, Partitions, Producers, Consumers, Offsets, and Transactions

Kafka is a high‑performance distributed message queue that uses topics, partitions, and replicas for scalability, with producers writing messages, consumers reading them via consumer groups, and advanced features such as offset management, delivery semantics, rebalancing, and exactly‑once transactional processing, all coordinated by Zookeeper.

ConsumersDistributed MessagingExactly-Once
0 likes · 17 min read
Understanding Kafka Architecture: Topics, Partitions, Producers, Consumers, Offsets, and Transactions
Open Source Linux
Open Source Linux
Jul 19, 2022 · Backend Development

Master Kafka Basics: Visual Guide to Topics, Partitions, and Architecture

This article visually explains Kafka's core concepts—including producers, consumers, topics, partitions, consumer groups, and cluster architecture—so readers can clearly understand how messages flow, are stored, and remain fault‑tolerant within a distributed streaming system.

BackendKafkaMessage Queue
0 likes · 6 min read
Master Kafka Basics: Visual Guide to Topics, Partitions, and Architecture
MaGe Linux Operations
MaGe Linux Operations
Jun 19, 2022 · Big Data

Visualizing Kafka: Core Concepts Explained with Diagrams

This article provides a diagram‑driven walkthrough of Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—explaining how messages flow, are stored, and achieve reliability and ordering within a distributed streaming system.

Cluster ArchitectureKafkaPartitions
0 likes · 6 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
Efficient Ops
Efficient Ops
Jun 7, 2022 · Big Data

Visualizing Kafka: Core Concepts Explained with Diagrams

This article visually breaks down Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—so readers can grasp how messages flow, are stored, and achieve load balancing and ordering within a distributed streaming platform.

Distributed SystemsKafkaMessage Queue
0 likes · 6 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
Java High-Performance Architecture
Java High-Performance Architecture
May 23, 2022 · Big Data

Visualizing Kafka: Core Concepts, Topics, Partitions, and Architecture Explained

This article visually breaks down Kafka’s core concepts—including topics, partitions, producers, consumers, and cluster architecture—explaining how messages flow, how consumer groups achieve load balancing, and how ZooKeeper coordinates leaders and followers, providing a clear, illustrated guide for developers working with distributed streaming systems.

KafkaMessage QueuePartitions
0 likes · 6 min read
Visualizing Kafka: Core Concepts, Topics, Partitions, and Architecture Explained
Open Source Linux
Open Source Linux
Jul 17, 2021 · Big Data

Master Kafka Basics: Topics, Partitions, Producers & Consumers Explained

This article provides a clear, visual guide to Kafka’s core concepts—including producers, consumers, topics, partitions, consumer groups, message ordering, and the underlying ZooKeeper‑managed cluster architecture—helping readers grasp how Kafka enables reliable, scalable stream processing.

Big DataConsumersPartitions
0 likes · 6 min read
Master Kafka Basics: Topics, Partitions, Producers & Consumers Explained
MaGe Linux Operations
MaGe Linux Operations
May 12, 2021 · Big Data

Visualizing Kafka: Core Concepts Explained with Diagrams

This article visually breaks down Kafka’s core concepts—including producers, consumers, topics, partitions, consumer groups, and cluster architecture—explaining how messages flow, are stored, and replicated across partitions and nodes, while highlighting the role of ZooKeeper in managing metadata.

Distributed SystemsKafkaMessaging
0 likes · 5 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
Java High-Performance Architecture
Java High-Performance Architecture
Apr 26, 2021 · Fundamentals

Visualizing Kafka: Core Concepts Explained with Diagrams

This article provides a visual walkthrough of Kafka's fundamental concepts—including producers, consumers, topics, partitions, and cluster architecture—illustrated with diagrams to help readers clearly understand how messages flow and are stored in a distributed streaming system.

Distributed SystemsKafkaPartitions
0 likes · 6 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
Big Data Technology Architecture
Big Data Technology Architecture
Jul 9, 2019 · Big Data

Kafka Best Practices for High Throughput: 20 Recommendations

This article presents New Relic's 20 best‑practice recommendations for operating Apache Kafka at high throughput, covering partitions, consumers, producers, and brokers, and explains key concepts, configuration tuning, monitoring, and architectural considerations to ensure reliable, scalable streaming pipelines.

BrokersConsumersHigh Throughput
0 likes · 14 min read
Kafka Best Practices for High Throughput: 20 Recommendations
dbaplus Community
dbaplus Community
Nov 20, 2018 · Backend Development

20 Proven Kafka Best Practices for High‑Throughput Clusters

This guide presents New Relic’s 20 practical best‑practice recommendations—covering partitions, consumers, producers, and brokers—to help engineers design, tune, and monitor Apache Kafka deployments for reliable, high‑throughput performance.

BrokersConsumersHigh Throughput
0 likes · 15 min read
20 Proven Kafka Best Practices for High‑Throughput Clusters
ITPUB
ITPUB
Oct 27, 2018 · Fundamentals

Why Linux Treats Everything as a File: A Deep Dive into Its File System

This article explains how Linux models all resources—including disks, devices, and inter‑process communication—as files, describes the physical storage mechanisms of hard drives, and walks through the steps of partitioning, formatting, mounting, and navigating the Linux file system hierarchy.

LinuxMountingPartitions
0 likes · 24 min read
Why Linux Treats Everything as a File: A Deep Dive into Its File System
Programmer DD
Programmer DD
Oct 21, 2018 · Big Data

How to Choose the Right Number of Kafka Partitions for Optimal Throughput

This article explains how to determine the optimal Kafka partition count by balancing throughput gains, key‑based ordering requirements, file descriptor limits, and availability impacts, offering practical guidelines such as testing hardware limits and using broker‑count multiples for scalable deployments.

Big DataPartitionsThroughput
0 likes · 8 min read
How to Choose the Right Number of Kafka Partitions for Optimal Throughput