The article introduces Jev, a fast, cheap AI model from TypeSafe that handles reflexive decisions while LLMs handle reasoning, showcasing five demos: context compression, ad analysis, real-time Mario gameplay, probability-based animations, and autonomous rocket landing — all at fractions of LLM cost and latency.
This article details AgentLoop's experience self-evolution: automatically mining success/failure patterns from agent run traces, injecting them via a recall skill, and using ablation experiments to optimize recall threshold (0.6), top-1 injection, context positioning, experience slimming, and guardrails—achieving 30-40% latency reduction, 20-47% cost reduction, and significant token/tool-call savings.
This report analyzes the memory bottleneck of DeepSeek‑V3.2‑Exp’s sparse‑attention decoder, proposes the Expanded Sparse Server (ESS) to offload the latent cache to CPU memory, and demonstrates through high‑fidelity simulation that the approach dramatically improves decode throughput while keeping latency within acceptable limits.
This article provides a comprehensive guide to Linux network performance tuning, covering key metrics, TCP window adjustments, Fast Open, congestion control algorithms, kernel parameter optimizations, zero‑copy transmission, NIC bonding, connection limits, and essential monitoring tools to achieve higher bandwidth and lower latency.
This article explains why modern enterprises increasingly need specialized performance engineering teams, outlines their ROI through cost savings, latency reduction, scalability, and engineering efficiency, details the engineers' responsibilities, and provides practical hiring guidelines and real‑world case studies.
By analyzing latency sources and introducing a pre‑loading ‘prepare’ step with new player APIs, the cloud‑editing team reduced audio start‑up delays by roughly 200 ms on average—cutting half‑second waits to under three‑hundred milliseconds and markedly improving streamer workflow.
The paper presents a low‑latency streaming speech‑recognition solution that reframes latency reduction as a knowledge‑distillation task, using a simple peak‑first regularization term to shift CTC output probabilities leftward and achieve up to 200 ms average latency reduction without harming word error rate.
Tencent Cloud’s OCR team cut average response time from 1.8 seconds to under one second and boosted throughput by over 50 % by redesigning the model with self‑attention, accelerating inference with a Tensor‑Network accelerator, shrinking RPC payloads, enabling asynchronous logging, and optimizing multi‑region GPU memory utilization.
This article details Meituan's large‑scale Kafka deployment, describing the current state, performance challenges such as slow nodes and disk imbalance, and the comprehensive optimizations applied—including read/write latency reductions, migration pipelines, fetcher isolation, SSD caching, RAID acceleration, cgroup isolation, full‑link monitoring, service lifecycle management, and TOR disaster recovery—to improve reliability and prepare for future growth.
The article examines Microsoft's bold Natick project of placing servers on the ocean floor, highlighting how underwater data centers can cut cooling costs, reduce latency for coastal users, and address the growing energy and space challenges of traditional land‑based data centers.
iQIYI and Huawei verified a 5G MEC + CDN edge‑acceleration solution that reduced end‑to‑end latency from 60 ms to under 10 ms, boosted 1080p/4K video download speeds by 400%, and paved the way for large‑scale VR, AR, and ultra‑HD streaming in the 5G era.
This article explains why video streams can still lag on high‑speed mobile networks, introduces the origin and principles of Content Delivery Networks (CDNs), and shows how CDNs reduce latency, improve user experience, and benefit both internet and telecom operators.
