Tagged articles

10 articles

Page 1 of 1

Aug 25, 2022 · Fundamentals

Unlocking mmap: How Memory‑Mapped Files Boost Linux Performance

This article explains the mmap system call’s core concepts, mapping process, kernel mechanisms, differences from traditional file I/O, performance benefits, and practical usage details, helping readers understand how memory‑mapped files work in Linux and why they’re advantageous for high‑performance applications.

Memory Mapped FilesVirtual Memorylinux

0 likes · 13 min read

Unlocking mmap: How Memory‑Mapped Files Boost Linux Performance

Su San Talks Tech

Nov 4, 2021 · Backend Development

How RocketMQ’s Storage Architecture Powers High Throughput and Low Latency

This article explains RocketMQ’s disk‑based storage design—including CommitLog, ConsumeQueue, and Index files—detailing sequential writes, memory‑mapped I/O, flexible flush strategies, and memory‑level read/write separation that together enable unlimited backlog, high throughput, and low latency messaging.

Memory Mapped FilesRocketMQSequential Write

0 likes · 13 min read

How RocketMQ’s Storage Architecture Powers High Throughput and Low Latency

Java Interview Crash Guide

Jul 19, 2021 · Backend Development

Mastering Zero-Copy in Java: Boost Performance with NIO, Netty, and More

Zero-copy techniques eliminate unnecessary data copying between user and kernel space, dramatically improving I/O performance; this article explains core I/O concepts, explores Java implementations like MappedByteBuffer, DirectByteBuffer, channel-to-channel transfers, and demonstrates Netty’s composite buffers, plus examples from Kafka and RocketMQ.

JavaMemory Mapped FilesNetty

0 likes · 14 min read

Mastering Zero-Copy in Java: Boost Performance with NIO, Netty, and More

Code Ape Tech Column

Feb 9, 2021 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files

This article demonstrates how to improve Java file compression performance by replacing unbuffered FileInputStream with BufferedInputStream, then leveraging NIO Channels, transferTo, memory‑mapped files, and Pipe, showing step‑by‑step code examples and timing results that reduce processing time from 30 seconds to about 1 second.

File CompressionJavaMemory Mapped Files

0 likes · 11 min read

Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files

Top Architect

Nov 15, 2020 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files

This article explains how to improve the performance of Java code that compresses multiple images into a zip archive by replacing unbuffered streams with buffered I/O, then using NIO channels, direct buffers, memory‑mapped files, and pipes, achieving a reduction from 30 seconds to about 1 second.

File CompressionJavaMemory Mapped Files

0 likes · 12 min read

Java Captain

Nov 12, 2020 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes

This article demonstrates how to dramatically reduce the time required to compress multiple large images in Java by progressively applying buffered streams, NIO channels, direct buffers, memory‑mapped files and pipe techniques, measuring each optimization and explaining the underlying I/O mechanisms.

File CompressionJavaMemory Mapped Files

0 likes · 13 min read

Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes

Architecture Digest

Jan 19, 2020 · Big Data

Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy

This article explains how Kafka achieves high throughput by using sequential disk writes, memory‑mapped files, batch compression, and zero‑copy sendfile for reads, while also covering data retention policies and the role of offsets in consumer processing.

Data StreamingHigh ThroughputMemory Mapped Files

0 likes · 10 min read

Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy

58 Tech

Jul 18, 2019 · Fundamentals

Analyzing Memory-Mapped File Memory Usage and Monitoring in Linux

This article explains how memory-mapped files are used in a search engine, describes the underlying Linux mechanisms such as page cache, multi-level page tables and radix trees, and presents practical methods—including mincore, /proc smaps, pagemap and system commands—to analyze and monitor their memory consumption at both kernel and process levels.

Memory Mapped FilesMemory analysislinux

0 likes · 14 min read

Analyzing Memory-Mapped File Memory Usage and Monitoring in Linux

ITPUB

Jul 1, 2019 · Big Data

Why Kafka Handles Millions of Writes per Second: I/O Secrets Revealed

This article explains how Kafka achieves ultra‑high throughput by using sequential disk writes, memory‑mapped files, zero‑copy sendfile reads, and batch compression, while also describing its data retention policies and the trade‑offs of synchronous versus asynchronous producer modes.

Batch CompressionHigh ThroughputMemory Mapped Files

0 likes · 9 min read

Why Kafka Handles Millions of Writes per Second: I/O Secrets Revealed

dbaplus Community

May 7, 2019 · Big Data

Why Kafka Achieves Million‑Level Throughput: Sequential Writes, mmap, and Zero‑Copy

This article explains how Kafka attains high throughput by using sequential disk writes, memory‑mapped files, sendfile zero‑copy, and batch compression, detailing both write and read path optimizations and their impact on performance.

Batch CompressionBig DataHigh Throughput

0 likes · 8 min read

Why Kafka Achieves Million‑Level Throughput: Sequential Writes, mmap, and Zero‑Copy