Tagged articles

Distributed Log

3 articles · Page 1 of 1

Aug 7, 2026 · Backend Development

Building a Trillion‑Message Queue: Kafka‑Level Architecture and Implementation

This article explains why and how to build a Kafka‑grade message‑queue kernel from scratch, detailing functional and non‑functional goals, core design principles, storage layout, replication, consumer‑group coordination, performance optimizations, deployment on Kubernetes, and a step‑by‑step roadmap to production‑grade reliability.

Distributed LogHigh ThroughputKafka

0 likes · 40 min read

Building a Trillion‑Message Queue: Kafka‑Level Architecture and Implementation

DataFunSummit

Jun 2, 2022 · Databases

An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases

This article provides a comprehensive technical overview of Apache BookKeeper, covering its role as a distributed append‑only log service, core concepts, high‑availability mechanisms, storage‑media evolution, comparisons with Raft, and community resources, while illustrating its use in Pulsar and large‑scale data platforms.

Apache BookKeeperData InfrastructureDistributed Log

0 likes · 12 min read

An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases

Tencent Cloud Middleware

Mar 19, 2021 · Fundamentals

How Apache Pulsar Stores, Acknowledges, and Retains Messages

This article explains Apache Pulsar’s core architecture—including its message model, producer and consumer behavior, subscription types, storage hierarchy, acknowledgment mechanisms, cursor handling, backlog concepts, retention policies, and storage size calculations—helping readers understand why storage size can exceed backlog size.

AcknowledgmentApache PulsarBacklog

0 likes · 14 min read

How Apache Pulsar Stores, Acknowledges, and Retains Messages