Tagged articles
Memory Mapped Files
10 articles · Page 1 of 1
This article explains the mmap system call’s core concepts, mapping process, kernel mechanisms, differences from traditional file I/O, performance benefits, and practical usage details, helping readers understand how memory‑mapped files work in Linux and why they’re advantageous for high‑performance applications.
LinuxMemory Mapped FilesVirtual Memory
0 likes · 13 min read

This article explains RocketMQ’s disk‑based storage design—including CommitLog, ConsumeQueue, and Index files—detailing sequential writes, memory‑mapped I/O, flexible flush strategies, and memory‑level read/write separation that together enable unlimited backlog, high throughput, and low latency messaging.
Memory Mapped FilesRocketMQSequential Write
0 likes · 13 min read

Zero-copy techniques eliminate unnecessary data copying between user and kernel space, dramatically improving I/O performance; this article explains core I/O concepts, explores Java implementations like MappedByteBuffer, DirectByteBuffer, channel-to-channel transfers, and demonstrates Netty’s composite buffers, plus examples from Kafka and RocketMQ.
JavaMemory Mapped FilesNIO
0 likes · 14 min read

This article demonstrates how to improve Java file compression performance by replacing unbuffered FileInputStream with BufferedInputStream, then leveraging NIO Channels, transferTo, memory‑mapped files, and Pipe, showing step‑by‑step code examples and timing results that reduce processing time from 30 seconds to about 1 second.
Buffered StreamsJavaMemory Mapped Files
0 likes · 11 min read

This article explains how to improve the performance of Java code that compresses multiple images into a zip archive by replacing unbuffered streams with buffered I/O, then using NIO channels, direct buffers, memory‑mapped files, and pipes, achieving a reduction from 30 seconds to about 1 second.
Buffered StreamsJavaMemory Mapped Files
0 likes · 12 min read

This article demonstrates how to dramatically reduce the time required to compress multiple large images in Java by progressively applying buffered streams, NIO channels, direct buffers, memory‑mapped files and pipe techniques, measuring each optimization and explaining the underlying I/O mechanisms.
Buffered StreamsJavaMemory Mapped Files
0 likes · 13 min read

This article explains how Kafka achieves high throughput by using sequential disk writes, memory‑mapped files, batch compression, and zero‑copy sendfile for reads, while also covering data retention policies and the role of offsets in consumer processing.
Data StreamingMemory Mapped FilesSequential Write
0 likes · 10 min read

This article explains how memory-mapped files are used in a search engine, describes the underlying Linux mechanisms such as page cache, multi-level page tables and radix trees, and presents practical methods—including mincore, /proc smaps, pagemap and system commands—to analyze and monitor their memory consumption at both kernel and process levels.
LinuxMemory Mapped FilesPage Cache
0 likes · 14 min read


ITPUBJul 1, 2019 · Big Data
This article explains how Kafka achieves ultra‑high throughput by using sequential disk writes, memory‑mapped files, zero‑copy sendfile reads, and batch compression, while also describing its data retention policies and the trade‑offs of synchronous versus asynchronous producer modes.
Memory Mapped Filesbatch compressionhigh-throughput
0 likes · 9 min read

This article explains how Kafka attains high throughput by using sequential disk writes, memory‑mapped files, sendfile zero‑copy, and batch compression, detailing both write and read path optimizations and their impact on performance.
KafkaMemory Mapped FilesSequential Write
0 likes · 8 min read
