Tagged articles
latency reduction
14 articles · Page 1 of 1
China Postal Savings Bank transformed its serial number data upload pipeline from a four-tier architecture to a flat two-tier system using centralized control, direct device connections, and intelligent traffic scheduling, reducing processing time from 20 to 5 minutes and cutting operational overhead by 50%.
China Postal Savings Bankarchitecture transformationcentralized control
0 likes · 12 min read

The article introduces Jev, a fast, cheap AI model from TypeSafe that handles reflexive decisions while LLMs handle reasoning, showcasing five demos: context compression, ad analysis, real-time Mario gameplay, probability-based animations, and autonomous rocket landing — all at fractions of LLM cost and latency.
AI agentsCost OptimizationJev
0 likes · 7 min read

The article argues that current AI systems overuse powerful but slow System 2 models for all tasks, proposing a Kahneman-inspired System 1/2 layered architecture where fast, cheap models handle 80-90% of routine decisions while System 2 tackles complex reasoning, reducing cost 80% and latency from seconds to milliseconds.
AI ArchitectureAI EngineeringCost Optimization
0 likes · 16 min read

This article details AgentLoop's experience self-evolution: automatically mining success/failure patterns from agent run traces, injecting them via a recall skill, and using ablation experiments to optimize recall threshold (0.6), top-1 injection, context positioning, experience slimming, and guardrails—achieving 30-40% latency reduction, 20-47% cost reduction, and significant token/tool-call savings.
AgentLoopablation experimentagent optimization
0 likes · 12 min read

This report analyzes the memory bottleneck of DeepSeek‑V3.2‑Exp’s sparse‑attention decoder, proposes the Expanded Sparse Server (ESS) to offload the latent cache to CPU memory, and demonstrates through high‑fidelity simulation that the approach dramatically improves decode throughput while keeping latency within acceptable limits.
Cache offloadGPU memoryLLM inference
0 likes · 20 min read

This article provides a comprehensive guide to Linux network performance tuning, covering key metrics, TCP window adjustments, Fast Open, congestion control algorithms, kernel parameter optimizations, zero‑copy transmission, NIC bonding, connection limits, and essential monitoring tools to achieve higher bandwidth and lower latency.
LinuxTCP tuningbandwidth optimization
0 likes · 10 min read

This article explains why modern enterprises increasingly need specialized performance engineering teams, outlines their ROI through cost savings, latency reduction, scalability, and engineering efficiency, details the engineers' responsibilities, and provides practical hiring guidelines and real‑world case studies.
Cost Optimizationinfrastructure ROIlatency reduction
0 likes · 29 min read

By analyzing latency sources and introducing a pre‑loading ‘prepare’ step with new player APIs, the cloud‑editing team reduced audio start‑up delays by roughly 200 ms on average—cutting half‑second waits to under three‑hundred milliseconds and markedly improving streamer workflow.
cloud editingfrontendlatency reduction
0 likes · 12 min read

The paper presents a low‑latency streaming speech‑recognition solution that reframes latency reduction as a knowledge‑distillation task, using a simple peak‑first regularization term to shift CTC output probabilities leftward and achieve up to 200 ms average latency reduction without harming word error rate.
CTCPeak-First RegularizationSpeech Recognition
0 likes · 21 min read

Tencent Cloud’s OCR team cut average response time from 1.8 seconds to under one second and boosted throughput by over 50 % by redesigning the model with self‑attention, accelerating inference with a Tensor‑Network accelerator, shrinking RPC payloads, enabling asynchronous logging, and optimizing multi‑region GPU memory utilization.
AI ModelOCRcloud services
0 likes · 13 min read

This article details Meituan's large‑scale Kafka deployment, describing the current state, performance challenges such as slow nodes and disk imbalance, and the comprehensive optimizations applied—including read/write latency reductions, migration pipelines, fetcher isolation, SSD caching, RAID acceleration, cgroup isolation, full‑link monitoring, service lifecycle management, and TOR disaster recovery—to improve reliability and prepare for future growth.
KafkaMeituancluster management
0 likes · 21 min read

The article examines Microsoft's bold Natick project of placing servers on the ocean floor, highlighting how underwater data centers can cut cooling costs, reduce latency for coastal users, and address the growing energy and space challenges of traditional land‑based data centers.
Microsoft Natickdata center coolingenergy efficiency
0 likes · 4 min read

iQIYI and Huawei verified a 5G MEC + CDN edge‑acceleration solution that reduced end‑to‑end latency from 60 ms to under 10 ms, boosted 1080p/4K video download speeds by 400%, and paved the way for large‑scale VR, AR, and ultra‑HD streaming in the 5G era.
5GEdge ComputingMEC
0 likes · 4 min read

This article explains why video streams can still lag on high‑speed mobile networks, introduces the origin and principles of Content Delivery Networks (CDNs), and shows how CDNs reduce latency, improve user experience, and benefit both internet and telecom operators.
CDNContent Delivery NetworkEdge Computing
0 likes · 10 min read
