0 views collected around this technical thread.
This article explains the fundamentals of network I/O, covering hardware basics, process scheduling, blocking and non‑blocking models, multiplexed I/O techniques such as select/poll/epoll, asynchronous I/O, socket types, and the user‑kernel boundary, providing a comprehensive guide for backend developers.
The article presents a concise mind‑map of essential Linux performance tools and a flexible troubleshooting workflow, guiding backend developers through CPU, memory, disk, and network issues by using utilities such as top, oprofile, slabtop, iotop, netstat, and strace to quickly pinpoint and resolve bottlenecks.
This article explains how zero‑copy technology eliminates redundant memory copies and context switches during data transmission, compares traditional read‑send workflows with zero‑copy approaches such as Linux sendfile/splice and Java's FileChannel.transferTo, and discusses performance benefits and practical considerations.
To cope with soaring traffic on Bilibili’s effect‑advertising engine, the team systematically measured latency, eliminated redundant Redis calls, switched JSON to Protobuf, applied branch‑prediction hints, loop‑unrolling and AVX256 SIMD, introduced object‑pooling and an inverted‑index request format, cutting CPU usage by 21 % and boosting peak throughput 13 %.
This article explains the concept of Remote Procedure Call (RPC), compares it with other inter‑system communication methods, outlines the three core problems RPC must solve—call ID mapping, serialization, and network transport—and discusses high‑availability considerations and I/O models for building robust RPC frameworks.
The article analyzes the growing demands on network I/O, outlines Linux and x86 bottlenecks, and explains how DPDK’s user‑space bypass, UIO, PMD, and various optimization techniques such as HugePages, SIMD, and cache‑friendly design enable multi‑hundred‑million‑packet‑per‑second processing.
This article analyzes the evolving demands of network I/O, identifies Linux/x86 bottlenecks, explains DPDK’s bypass architecture and UIO mechanism, and presents practical high‑performance coding and compilation optimizations such as HugePages, SIMD, poll‑mode drivers, and ecosystem tools for modern backend systems.
This article explains in detail how Linux handles local network I/O for 127.0.0.1, comparing it with cross‑machine communication, describing the routing, device subsystem, driver code, and soft‑interrupt processing, and concluding with performance considerations and a discussion on eBPF acceleration.
This article provides a comprehensive analysis of the Linux kernel's handling of localhost network I/O, detailing how packets destined for 127.0.0.1 bypass physical network interfaces, traverse the routing table, and utilize the loopback virtual device and soft interrupts for efficient intra-machine communication.
This article summarizes the DBLE network module, describing its key classes such as NIOAcceptor, NIOReactor, and SocketWR, explaining how client connections are accepted and processed, and highlighting the importance of low‑level network I/O knowledge for middleware development.
This article explains the structure of Linux network I/O by detailing the OSI seven‑layer model, the role of each layer, MTU/PMTU concepts, IP fragmentation and reassembly, and key TCP mechanisms such as MSS, flow control, and congestion control, providing a comprehensive foundation for studying zero‑copy networking.
This article explains the Linux network I/O architecture, detailing how TCP sends and receives data, the role of socket buffers, SKB structures, QDisc and ring buffers, and compares various zero‑copy techniques such as read/write, mmap/write, sendfile, splice, tee, DPDK and DMA‑gather approaches.
This article explains how to assess, monitor, and tune system I/O performance by defining I/O models, selecting appropriate evaluation tools, tracking key metrics for disk and network I/O, and applying practical optimization strategies for both storage and network bottlenecks.
The article analyzes the growing demands on network I/O, explains Linux and x86 bottlenecks, introduces DPDK’s user‑space bypass architecture and its core optimizations such as hugepages, poll‑mode drivers, SIMD, and CPU‑specific tuning, and finally discusses the DPDK ecosystem and practical considerations for backend developers.
The article analyzes the evolving demands of network I/O, the limitations of traditional kernel‑based networking, and presents DPDK’s user‑space bypass architecture, UIO mechanism, and a series of low‑level optimizations—including HugePages, poll‑mode drivers, SIMD, and cache‑aware coding—to achieve multi‑gigabit packet processing performance on modern Linux servers.
This article delves into Kafka’s network layer implementation, explaining the Selector class’s role in registering socket channels, handling connection events, and orchestrating reads and writes via KafkaChannel and TransportLayer, while illustrating packet structures and providing code snippets for key functions like register, connect, poll, and send.
This article revisits fundamental network I/O concepts, clarifying the differences between blocking, non‑blocking, synchronous, asynchronous, and multiplexed models through clear explanations and illustrative diagrams, helping developers build a solid mental model of how data moves between processes and the kernel.