Tag

sendfile

0 views collected around this technical thread.

Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 15, 2025 · Operations

Nginx High-Concurrency Optimization Techniques

This article explains how to achieve million‑level concurrent connections with Nginx by tuning OS limits, worker processes, epoll event handling, gzip compression, and zero‑copy file transfer, providing concrete configuration snippets and performance rationale for each optimization.

GzipHigh ConcurrencyLinux
0 likes · 4 min read
Nginx High-Concurrency Optimization Techniques
Lobster Programming
Lobster Programming
Feb 13, 2025 · Backend Development

Zero‑Copy Explained: From write+read to mmap, sendfile and splice

This article breaks down zero‑copy data transfer techniques—write+read, mmap+write, sendfile, sendfile + SG‑DMA, and splice—showing how they reduce CPU copies and context switches to boost I/O performance in modern operating systems.

BackendMMAPZero Copy
0 likes · 9 min read
Zero‑Copy Explained: From write+read to mmap, sendfile and splice
Deepin Linux
Deepin Linux
Jan 23, 2025 · Backend Development

Zero‑Copy Techniques in Linux: sendfile, mmap, splice and tee

This article explains the concept of zero‑copy in Linux, compares the four main system calls—sendfile, mmap, splice and tee—describes their APIs, internal mechanisms, performance characteristics, typical use‑cases and provides practical code examples for high‑performance network programming.

LinuxMMAPNetwork Programming
0 likes · 37 min read
Zero‑Copy Techniques in Linux: sendfile, mmap, splice and tee
Deepin Linux
Deepin Linux
Dec 12, 2024 · Backend Development

Understanding Zero‑Copy Architecture: Concepts, Techniques, and Applications

Zero‑copy eliminates CPU‑mediated data copies between user and kernel spaces by using DMA and memory‑mapping, dramatically improving I/O performance, reducing context switches, and enabling high‑throughput applications such as file servers, Kafka brokers, and Java networking frameworks.

DMAI/O optimizationJava
0 likes · 28 min read
Understanding Zero‑Copy Architecture: Concepts, Techniques, and Applications
macrozheng
macrozheng
Oct 10, 2024 · Fundamentals

How Zero‑Copy Boosts Data Transfer: IO Mechanisms, mmap, sendfile & splice Explained

This article explains the concept of zero‑copy, compares traditional I/O copying with mmap, sendfile, DMA scatter/gather and splice techniques, and shows how Java NIO leverages mmap and sendfile to achieve high‑performance data transfer while minimizing CPU involvement.

IOJava NIOLinux
0 likes · 15 min read
How Zero‑Copy Boosts Data Transfer: IO Mechanisms, mmap, sendfile & splice Explained
IT Services Circle
IT Services Circle
Aug 5, 2024 · Backend Development

Why RocketMQ Lags Behind Kafka in Performance: The Impact of Zero‑Copy Techniques

The article explains how RocketMQ’s reliance on mmap‑based zero‑copy leads to more data copies and system‑call overhead compared to Kafka’s sendfile approach, resulting in lower throughput, and discusses when to choose each message‑queue system based on functional needs and performance requirements.

KafkaMMAPMessage Queue
0 likes · 8 min read
Why RocketMQ Lags Behind Kafka in Performance: The Impact of Zero‑Copy Techniques
Top Architect
Top Architect
Nov 16, 2022 · Backend Development

Understanding Zero‑Copy in Java: Concepts, Mechanisms, and Implementations

This article explains the zero‑copy technique in Java, covering I/O fundamentals, kernel read/write flow, mmap+write and Sendfile methods, virtual memory mapping, MappedByteBuffer and DirectByteBuffer usage, channel‑to‑channel transfer, Netty composite buffers, and how frameworks like RocketMQ and Kafka leverage zero‑copy for performance.

Java NIOMMAPNetty
0 likes · 13 min read
Understanding Zero‑Copy in Java: Concepts, Mechanisms, and Implementations
Architect's Guide
Architect's Guide
Nov 6, 2022 · Backend Development

Zero‑Copy Techniques in Java: Buffers, MappedByteBuffer, Sendfile, and Netty

This article explains the concept of zero‑copy, how it eliminates redundant data copying in I/O operations, and demonstrates its implementation in Java through buffers, mmap+write, Sendfile, MappedByteBuffer, DirectByteBuffer, channel‑to‑channel transfers, and Netty’s composite buffers.

FileChannelJava NIOMappedByteBuffer
0 likes · 12 min read
Zero‑Copy Techniques in Java: Buffers, MappedByteBuffer, Sendfile, and Netty
Code Ape Tech Column
Code Ape Tech Column
Sep 23, 2022 · Fundamentals

Understanding Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O

This article explains how zero‑copy techniques such as DMA, sendfile, mmap and Direct I/O reduce data copies and context switches in Linux, compares their mechanisms, advantages and drawbacks, and shows typical use cases like Kafka for high‑performance I/O.

DMADirect I/OLinux
0 likes · 14 min read
Understanding Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O
Architect
Architect
Sep 13, 2022 · Backend Development

Understanding Zero‑Copy in Java I/O, NIO, Netty and Messaging Systems

This article explains the concept of zero‑copy, its benefits for I/O performance, and how Java NIO, Netty, Kafka, RocketMQ and related APIs such as mmap+write and sendfile implement zero‑copy to avoid unnecessary data copying between kernel and user space.

I/O performanceJava NIOMappedByteBuffer
0 likes · 13 min read
Understanding Zero‑Copy in Java I/O, NIO, Netty and Messaging Systems
Architects' Tech Alliance
Architects' Tech Alliance
Aug 4, 2022 · Fundamentals

Understanding Zero‑Copy I/O: DMA, Sendfile, mmap, and Direct I/O

The article explains how traditional I/O incurs four data copies and context switches, and how DMA, zero‑copy techniques such as sendfile, mmap, splice, and Direct I/O reduce copying and system calls, improving performance for disk‑to‑network data transfers in Linux.

DMADirect I/OI/O optimization
0 likes · 16 min read
Understanding Zero‑Copy I/O: DMA, Sendfile, mmap, and Direct I/O
Code Ape Tech Column
Code Ape Tech Column
Apr 13, 2022 · Fundamentals

Understanding Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O

This article explains the concept of zero‑copy I/O, how DMA offloads data movement between memory, disks and network cards, and compares practical implementations such as sendfile, mmap and Direct I/O, highlighting their benefits, limitations and typical use cases in Linux systems.

DMADirect I/OLinux
0 likes · 15 min read
Understanding Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O
Top Architect
Top Architect
Mar 24, 2022 · Fundamentals

Understanding Linux Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O

This article explains how Linux zero‑copy mechanisms such as DMA, sendfile, mmap and Direct I/O reduce data copies and context switches, detailing their operation, advantages, limitations, and real‑world usage in systems like Kafka and MySQL.

DMADirect I/OLinux
0 likes · 20 min read
Understanding Linux Zero‑Copy Techniques: DMA, sendfile, mmap and Direct I/O
Architects' Tech Alliance
Architects' Tech Alliance
Mar 18, 2022 · Fundamentals

Understanding Zero‑Copy I/O: DMA, Sendfile, mmap and Direct I/O

This article explains how zero‑copy techniques such as DMA, sendfile, mmap and Direct I/O reduce the four data copies and context switches normally required for disk‑to‑network transfers, improving performance for systems like Kafka and MySQL while outlining their trade‑offs.

DMADirect I/OLinux
0 likes · 15 min read
Understanding Zero‑Copy I/O: DMA, Sendfile, mmap and Direct I/O
Top Architect
Top Architect
Feb 22, 2022 · Fundamentals

Understanding DMA and Zero‑Copy Techniques in Linux

This article explains how DMA offloads memory‑to‑device data transfers, reduces the four data copies and context switches of traditional I/O, and introduces zero‑copy methods such as sendfile, mmap and Direct I/O, illustrating their mechanisms, advantages, limitations, and real‑world use cases like Kafka and MySQL.

DMADirect I/OI/O optimization
0 likes · 15 min read
Understanding DMA and Zero‑Copy Techniques in Linux
Architect
Architect
Feb 19, 2022 · Fundamentals

Understanding DMA and Zero‑Copy Techniques in Linux I/O

This article explains how DMA offloads memory‑to‑device data transfers, reduces the four data copies and context switches of traditional I/O, and introduces zero‑copy mechanisms such as sendfile, mmap and Direct I/O, with practical examples like Kafka and MySQL.

DMADirect I/OI/O optimization
0 likes · 15 min read
Understanding DMA and Zero‑Copy Techniques in Linux I/O
DeWu Technology
DeWu Technology
Jul 16, 2021 · Fundamentals

Zero-Copy I/O: Concepts, Traditional IO, and Implementation with mmap and sendfile

Zero‑copy I/O minimizes data copying by using DMA and kernel mechanisms such as mmap + write or the sendfile() system call, with sendfile achieving true zero‑copy through fewer system calls, context switches, and memory copies compared to traditional read/write paths.

DMAI/O optimizationLinux
0 likes · 8 min read
Zero-Copy I/O: Concepts, Traditional IO, and Implementation with mmap and sendfile
Top Architect
Top Architect
Jun 1, 2021 · Backend Development

Zero‑Copy Mechanisms in Operating Systems and Java

This article explains how zero‑copy techniques such as mmap, sendfile, and splice reduce CPU involvement in data transfer by avoiding memory copies between kernel and user spaces, and shows how Java NIO and Netty implement these mechanisms for high‑performance backend I/O.

BackendJava NIOMMAP
0 likes · 8 min read
Zero‑Copy Mechanisms in Operating Systems and Java
Architect
Architect
Jul 26, 2020 · Backend Development

Understanding Zero‑Copy in Java: I/O Concepts, mmap, Sendfile, and Netty

This article explains the zero‑copy technique in Java, covering basic I/O concepts, buffer management, mmap + write and Sendfile methods, and how frameworks like NIO, Netty, Kafka, and RocketMQ use these mechanisms to eliminate data copies and improve performance.

JavaMMAPNIO
0 likes · 11 min read
Understanding Zero‑Copy in Java: I/O Concepts, mmap, Sendfile, and Netty
Big Data Technology Architecture
Big Data Technology Architecture
Apr 26, 2020 · Backend Development

Understanding Zero‑Copy: DMA, mmap, sendfile and Java NIO Performance

This article explains how zero‑copy techniques such as DMA, mmap, and sendfile work, compares them with traditional file I/O, shows their Java NIO implementations, and presents performance test results demonstrating the advantages of mmap for small files and sendfile for large files.

DMAFile I/OJava NIO
0 likes · 9 min read
Understanding Zero‑Copy: DMA, mmap, sendfile and Java NIO Performance