Tagged articles
16 articles
Page 1 of 1
Liangxu Linux
Liangxu Linux
Aug 13, 2023 · Fundamentals

How Zero‑Copy and Async I/O Supercharge Large File Transfers

The article explains why the naïve approach of reading a file into a small user‑space buffer and sending it piece‑by‑piece is inefficient, and how zero‑copy, PageCache, asynchronous I/O and direct I/O can dramatically reduce context switches, memory copies, and CPU usage for high‑throughput file transfers.

Direct I/OPerformance OptimizationZero Copy
0 likes · 12 min read
How Zero‑Copy and Async I/O Supercharge Large File Transfers
Liangxu Linux
Liangxu Linux
Aug 9, 2023 · Fundamentals

How Zero‑Copy and PageCache Supercharge File Transfer Performance

This article explains why a naïve 32 KB‑chunk file transfer incurs excessive context switches and memory copies, and how zero‑copy, PageCache, asynchronous I/O, and direct I/O techniques dramatically reduce overhead and boost throughput for large‑scale data transfers.

Direct I/OPerformance Optimizationasync I/O
0 likes · 11 min read
How Zero‑Copy and PageCache Supercharge File Transfer Performance
Open Source Linux
Open Source Linux
Aug 4, 2023 · Backend Development

Boost File Transfer Speed: Zero‑Copy, PageCache, Async & Direct I/O Explained

This article examines traditional file transfer methods, highlights their performance drawbacks caused by excessive context switches and memory copies, and explains how zero‑copy, PageCache, asynchronous I/O, and direct I/O can dramatically improve throughput and reduce CPU usage in backend systems.

Backend DevelopmentDirect I/OPerformance Optimization
0 likes · 12 min read
Boost File Transfer Speed: Zero‑Copy, PageCache, Async & Direct I/O Explained
Top Architect
Top Architect
Feb 22, 2022 · Fundamentals

Understanding DMA and Zero‑Copy Techniques in Linux

This article explains how DMA offloads memory‑to‑device data transfers, reduces the four data copies and context switches of traditional I/O, and introduces zero‑copy methods such as sendfile, mmap and Direct I/O, illustrating their mechanisms, advantages, limitations, and real‑world use cases like Kafka and MySQL.

DMADirect I/OI/O optimization
0 likes · 15 min read
Understanding DMA and Zero‑Copy Techniques in Linux
Architect
Architect
Feb 19, 2022 · Fundamentals

Understanding DMA and Zero‑Copy Techniques in Linux I/O

This article explains how DMA offloads memory‑to‑device data transfers, reduces the four data copies and context switches of traditional I/O, and introduces zero‑copy mechanisms such as sendfile, mmap and Direct I/O, with practical examples like Kafka and MySQL.

DMADirect I/OI/O optimization
0 likes · 15 min read
Understanding DMA and Zero‑Copy Techniques in Linux I/O
Architects' Tech Alliance
Architects' Tech Alliance
Dec 10, 2021 · Fundamentals

How Does Linux System Call I/O Work? A Deep Dive into Read/Write, Buffers, and Performance

The article explains Linux’s traditional system‑call I/O path, detailing how read() and write() trigger multiple CPU and DMA copies and context switches, describes read and write workflows, explores network and disk I/O, examines the Linux I/O stack, page cache, buffering strategies, zero‑copy, mmap and Direct I/O, and discusses performance trade‑offs.

BufferingDirect I/OI/O
0 likes · 13 min read
How Does Linux System Call I/O Work? A Deep Dive into Read/Write, Buffers, and Performance
Liangxu Linux
Liangxu Linux
Sep 11, 2021 · Fundamentals

How DMA and Zero‑Copy Transform Linux I/O Performance

This article explains the costly four‑copy, four‑context‑switch data path in traditional Linux I/O, introduces DMA as a co‑processor that offloads memory transfers, describes zero‑copy techniques such as sendfile, mmap and Direct I/O, and shows how Kafka and MySQL leverage these methods to reduce CPU overhead and improve throughput.

DMADirect I/OKafka
0 likes · 16 min read
How DMA and Zero‑Copy Transform Linux I/O Performance