Why Kafka Can Achieve Million‑Message‑Per‑Second Throughput: Disk Sequential Write, Zero‑Copy, Page Cache, and Memory‑Mapped Files

The article explains how Kafka attains ultra‑high write throughput by leveraging disk sequential writes, zero‑copy data transfer, operating‑system page cache, and memory‑mapped files, detailing each technique’s impact on latency, CPU usage, and overall performance.

Sequential WriteZero Copybig-data

0 likes · 5 min read

Why Kafka Can Achieve Million‑Message‑Per‑Second Throughput: Disk Sequential Write, Zero‑Copy, Page Cache, and Memory‑Mapped Files

Su San Talks Tech

Jul 27, 2023 · Fundamentals

How Zero-Copy I/O Boosts Performance: From Theory to Java NIO

This article explains the traditional I/O read/write workflow, identifies its performance bottlenecks, introduces the concept of zero‑copy, and demonstrates practical zero‑copy implementations—including DMA, sendfile, shared memory, memory‑mapped files, and Java NIO techniques such as ByteBuffer, Channel, transferTo/transferFrom, and memory‑mapped files.

DMAI/OJava NIO

0 likes · 15 min read

How Zero-Copy I/O Boosts Performance: From Theory to Java NIO

Manbang Technology Team

Sep 13, 2018 · Mobile Development

Design and Implementation of a High‑Performance, High‑Availability Logging System for iOS Apps

This article describes the motivation, design choices, memory‑mapped implementation, performance evaluation, and practical lessons learned while building a lightweight, crash‑resilient logging framework for the 运满满 iOS client, highlighting its superiority over traditional file‑write approaches.

Mobile DevelopmentencryptioniOS

0 likes · 8 min read

Design and Implementation of a High‑Performance, High‑Availability Logging System for iOS Apps