To overcome HBase’s weak availability and GC‑induced latency spikes, the DiDi team introduced a replication‑based client multi‑read (hedged‑read) mechanism and migrated to the Z Garbage Collector, which together dramatically cut maximum and 99.9th‑percentile latencies while keeping services online during region disruptions.
The article explains how a high‑frequency trading firm evaluated Java versus C++ for ultra‑low‑latency trading, discusses the challenges of JVM JIT compilation and garbage‑collection pauses, and shows how Azul Zing’s C4 collector delivers near‑C++ latency while preserving Java’s development productivity.
The ARC Car Cloud Control platform now streams the vehicle’s screen using Android’s Virtual Display and a C++‑based H.264 hardware encoder, sending raw video over a TCP socket to a server that adaptively adjusts bitrate and frame rate, while the web client decodes the fragmented MP4 via MSE, dramatically lowering CPU usage and latency on low‑end head‑units.
This article details Youku's membership marketing system architecture, covering complex marketing scenarios, high‑availability and low‑latency requirements, rule‑based QL engine, unified marketing framework, multi‑cache storage, multithreaded matching, asynchronous reward distribution, and distributed transaction mechanisms.
This article examines the Z Garbage Collector (ZGC) introduced in JDK 11, detailing its low‑pause design goals, underlying concurrent marking‑copy algorithm, colored pointer and read‑barrier techniques, practical tuning parameters, real‑world case studies, and the performance impact of upgrading from CMS/G1 to ZGC in high‑throughput, low‑latency services.
The article explains how Meituan’s risk‑control platform eliminated frequent 40 ms CMS pauses by adopting JDK 11’s ZGC—detailing its concurrent mark‑copy design, practical tuning parameters, real‑world case fixes, and measured latency reductions of up to 74 % while noting trade‑offs.
This article examines the rapid rise of live‑ecommerce during the 618 shopping festival, explains why the “live + ecommerce” model demands robust backend, streaming and CDN infrastructure, and details Tencent Cloud’s architectural solutions—including media processing, low‑latency protocols, bandwidth optimization and anti‑attack measures—to support massive concurrent traffic.
The article explains how the Secure Reliable Transport (SRT) protocol, combined with Tencent Video Cloud’s optimized infrastructure, overcame latency and packet‑loss challenges to deliver stable, high‑quality live streams for the 2020 LPL Mid‑Season Cup and other large‑scale events, and describes its broader applications through MediaConnect.
This article explains the design goals, architecture, key features, tuning options, and version history of Java's Z Garbage Collector (ZGC), highlighting its sub‑10 ms pause times for terabyte‑scale heaps, its use of colored pointers and load barriers, and the trade‑offs in throughput and configuration.
This article analyzes the challenges of low‑latency, stable, and cost‑effective online multiplayer games and explains how Tencent's Game Server Engine (GSE) provides elastic scaling, near‑by scheduling, stateful shrinkage, multi‑region disaster recovery, and zero‑downtime updates to meet those demands.
This article explains how Apache Hudi provides an incremental processing framework that enables efficient, low‑latency data ingestion, storage, and query capabilities on Hadoop, detailing its architecture, storage layout, compaction, write and read paths, and support for real‑time and batch analytics.
In an interview, iQIYI Live Cloud’s Chen Kunzhong explains how their WebRTC‑based RTCDN reduces encoding and transmission delay to achieve roughly 100 ms end‑to‑end latency for cloud‑gaming ads, supporting cross‑device play, instant click‑to‑play sessions, and future 5G‑enhanced high‑resolution experiences.
This article reviews the evolution of Alibaba's Aliware message engine, analyzes the low‑latency and high‑availability challenges faced during Double 11, and details the architectural, JVM, memory, rate‑limiting, and multi‑replica solutions that enabled RocketMQ to achieve sub‑millisecond write latency and five‑nine availability.
This article examines Pharos, Everbright Bank's home‑grown HBase indexing middleware, detailing why existing secondary‑index solutions fall short, the design goals of low latency, simple architecture and non‑intrusiveness, and the concrete storage, pagination, and transaction‑consistency techniques that enable fast complex queries on massive data.
This article explains edge computing, its distributed architecture, key advantages such as higher security, lower latency and reduced bandwidth costs, explores major application scenarios like smart manufacturing and autonomous driving, and analyzes how 5G both drives and benefits from edge computing development.
Youku’s low‑latency live‑streaming system replaces the traditional RTMP‑CDN pipeline with a controllable media‑transport architecture that combines private real‑time protocols, WebRTC, and edge nodes, cutting anchor‑to‑anchor latency below 300 ms and anchor‑to‑viewer latency to under 415 ms while preserving smooth playback.
Facing pandemic-driven remote teaching, Alibaba’s live streaming team redesigned their media pipeline, combining CDN, custom real-time protocols, WebRTC, and cloud-native techniques to control transmission and playback buffers, achieving sub-300 ms host-to-host latency and under-600 ms host-to-viewer latency while maintaining smooth playback.
FPGA, a reconfigurable hardware architecture, offers low latency and high efficiency compared to CPUs, GPUs, and ASICs, making it ideal for both compute‑intensive and communication‑intensive tasks, and Microsoft’s multi‑stage data‑center deployments illustrate its scalability, flexibility, and impact on cloud services.
This article explains how Apache Hudi enables efficient, low‑latency incremental data ingestion and processing on Hadoop by providing a unified service layer, describing its motivation, architecture, storage components, write and read paths, compaction, fault recovery, and incremental query capabilities.
Edge computing moves data collection and analysis closer to the source, reducing latency, bandwidth costs, and privacy risks, and is increasingly essential for IoT, industrial automation, autonomous vehicles, smart cities, and other latency‑sensitive applications.
This article provides an in‑depth technical analysis of integrating real‑time audio/video (RTC) with legacy PSTN, covering latency sources, protocol and codec differences, adaptation layers, system architecture, and optimization techniques such as jitter buffering, ARQ/FEC, and automatic failover.
The talk detailed Tencent Cloud’s low‑latency interactive live‑streaming techniques—using UDP‑accelerated RTMP, built‑in echo cancellation, cloud‑side video mixing, and scalable room management—to overcome latency, echo, and mixing challenges in multi‑host link‑mic scenarios, illustrated by the MLVBLiveRoom and TRTC large‑room solutions.
The article examines iQIYI’s 8K VR live‑streaming pipeline, detailing how 5G connectivity, tiled encoding, ROI‑focused transmission, and hardware‑accelerated processing reduce bitrate by 75 % and bring motion‑to‑photon latency down to zero, while addressing resolution, bandwidth, and latency challenges of immersive VR broadcasts.
This article explains how RDMA (Remote Direct Memory Access) technology, originating from InfiniBand and extended to Ethernet (RoCE) and TCP/IP (iWARP), provides ultra‑low latency, high throughput, and minimal CPU usage for high‑performance computing and big‑data applications by bypassing traditional OS and protocol stack processing.
Pravega, Dell’s native stream storage project, addresses the challenges of modern low‑latency, exactly‑once stream processing by combining tiered storage, Apache BookKeeper, and seamless Flink integration, offering a unified solution that reduces development, storage, and operational costs compared to traditional message systems like Kafka.
ZGC is a scalable, low‑latency Java garbage collector designed to keep pause times under 10 ms regardless of heap size, supporting up to 4 TB, and leveraging concurrent, region‑based, compacting, NUMA‑aware techniques, colored pointers, and load barriers, with detailed compilation and tuning guidance.
The article describes Alibaba's HAIL 5.1 data‑center network architecture introduced for the 2018 Double‑11 event, detailing its high‑availability de‑stacking design, low‑latency RDMA deployment, and future HAIL 2.0 evolution to support larger‑scale, intelligent, and high‑performance cloud networking.
This article reviews the evolution of Alibaba's Aliware message engine, analyzes the latency and availability challenges faced during Double‑11, and describes the low‑latency optimizations, capacity‑guarantee strategies, and multi‑replica high‑availability architecture implemented in RocketMQ to sustain trillion‑level message flows.
Alibaba unveiled an FPGA‑designed machine‑learning accelerator that achieves sub‑millisecond inference latency and thousands of frames‑per‑second throughput, demonstrating how integrated hardware‑software optimizations can deliver real‑time AI performance surpassing conventional GPU and ASIC solutions.
The article explains how Tencent Cloud’s Gaming Multimedia Engine (GME) introduces a built‑in real‑time voice‑changing feature for games, detailing the underlying pitch‑and‑timbre manipulation, latency‑reduction techniques that keep delay under 40 ms, and how developers can integrate the SDK to enrich player social interaction without external hardware.
PolarFS is a user‑space, ultra‑low‑latency distributed file system designed for POLARDB that leverages RDMA, NVMe SSDs, and a novel ParallelRaft protocol to deliver near‑local‑SSD performance, strong consistency, and seamless failover in a cloud‑native environment.
The article chronicles how Tencent Video Cloud built a low‑latency audio/video SDK for WeChat mini‑programs—using live‑pusher and live‑player components to capture, process, encode, and transmit streams via TCP/UDP, adding echo cancellation, QoS, and room‑based signaling to enable real‑time chat and multi‑party conferencing within a 500 ms end‑to‑end delay.
This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), detailing its underlying principles, performance advantages over traditional TCP/IP, various protocol families such as InfiniBand, RoCE, and iWARP, and their respective hardware and software requirements.
The article provides a comprehensive overview of RDMA technology, explaining its low‑latency, high‑throughput benefits, origins in InfiniBand, extensions like RoCE and iWARP, the Verbs API, communication models, and why it is poised for broader adoption in modern networking and storage systems.
This article describes the challenges and solutions behind designing a high‑availability, low‑latency ranking service that supports tens of thousands of leaderboards, optimizes storage engine choices, automates scheduling, and isolates resources using ZooKeeper, Redis, and container‑based deployments across multiple data centers.
This article explains how StreamSQL runs on the Slipstream engine in event‑driven mode, shows how to enable the mode, and provides step‑by‑step code examples for low‑latency stream processing, window aggregation, and joining multiple window streams.
This article reviews the evolution of Alibaba's middleware message engine, analyzes the low‑latency and high‑availability challenges faced during Double‑11, and details the optimization techniques, capacity‑guarantee strategies, and HA architecture that enable RocketMQ to handle massive traffic spikes with millisecond‑level latency.
With explosive OTT growth and soaring data traffic, traditional network acceleration falls short, so Huawei’s open network acceleration solution leverages REST APIs to dynamically speed up the UE‑to‑eNodeB link, cutting latency and boosting user experience across gaming, video, and e‑commerce.
This article recounts Alibaba's RocketMQ journey—from record‑breaking low‑latency performance during Double‑Eleven, through the challenges of open‑source donation, to its successful incubation at Apache and future plans for both community and commercial versions.
This article examines the rapid growth of personal live streaming, outlines major market players, compares cloud provider offerings, and dives into essential technologies such as RTMP variants, source‑side processing, low‑power encoding, fast startup, and methods to reduce stutter for a seamless viewer experience.
The paper presents a production‑grade, low‑cost mobile‑app exception monitoring platform built on Spark Streaming, Kafka, and Elasticsearch that achieves high availability through exactly‑once processing and checkpointing, minute‑level latency by decoupling raw and symbolized logs, high throughput via reservoir sampling, and dynamic scalability without code changes.
This article details the architecture, encoding choices, network‑level optimizations, transmission model, measurement methods, and practical pitfalls involved in building a 1080p real‑time video streaming solution that consistently keeps end‑to‑end latency below 500 ms for interactive online education.
The article presents a detailed overview of Bilibili's GOIM live chat architecture, covering its high‑stability, high‑availability, low‑latency design, component breakdown, memory and module optimizations, network improvements, and performance testing results to achieve scalable real‑time messaging.
mmtls is a custom, lightweight secure communication protocol designed for WeChat that encrypts all client‑to‑server traffic, offering confidentiality, integrity, low latency, scalability, and forward secrecy by adapting TLS 1.3 concepts with optimized handshake, key‑exchange, record, and replay‑protection mechanisms.
The article explains how building low‑latency applications relies on simplicity, minimizing data transformations, using lightweight libraries, and separating business from infrastructure code to achieve high performance, maintainability, and reduced operational costs.
This article explains the design, phases, and practical implications of the C4 concurrent continuously compacting garbage collector, comparing it with G1 and IBM's Balanced GC, and provides guidance on when to choose C4 for enterprise Java workloads requiring low pause times and high scalability.
