Tagged articles
traffic scheduling
14 articles · Page 1 of 1
Baidu Baige presents a three-layer stability framework for LLM inference services: tiered traffic control with minute-level autoscaling, dynamic request bucketing with cross-bucket KVCache migration boosting decode throughput 40-50%, and multi-level KV storage with global cache awareness keeping hit rates above 90% of theoretical maximum.
KVCacheLLM inferenceMulti-level Cache
0 likes · 21 min read

This article dissects why static DNS-based traffic scheduling fails at ten-million-QPS scale and how layered dynamic scheduling — across access, gateway, service, and data layers — combined with unitized routing, automated decision loops, and rigorous drill practices enables precise, reversible, and safe failover.
AnycastFailoverGSLB
0 likes · 33 min read

The article breaks down Alibaba’s same‑city active‑active high‑availability architecture, detailing its four design layers—traffic scheduling, stateless application services, data replication, and operational automation—while illustrating how each component ensures continuous service during data‑center failures.
Active-ActiveAlibabaHigh Availability
0 likes · 5 min read

This article details how Guotai Insurance tackled the high latency and cost of large‑model inference by deploying Alibaba Cloud's ACK Inference Gateway, which uses load‑aware, prefix‑aware routing, intelligent queuing, and comprehensive observability to boost efficiency threefold while reducing expenses.
ACK GatewayAI inferencecloud-native
0 likes · 18 min read

This article explains how to use Alibaba Cloud Service Mesh (ASM) traffic‑scheduling suite to implement rich traffic‑control scenarios such as per‑user rate limiting, request queuing and priority scheduling in a Kubernetes environment, providing step‑by‑step deployment, configuration and verification instructions.
ASMKubernetesmicroservices
0 likes · 14 min read

This article details the end‑to‑end migration of ByteDance's HTTPDNS service from a central cloud to edge nodes, covering technical challenges in service placement and traffic scheduling, the edge‑native solutions implemented with visualization models and GTM, and the resulting performance, cost and reliability gains.
HTTPDNSperformance optimizationtraffic scheduling
0 likes · 13 min read

This article analyzes the design of Vivo's push notification platform, detailing its high‑concurrency requirements, three‑region long‑connection deployment, traffic‑scheduling bypass layer, and layered storage disaster‑recovery solutions, while explaining the trade‑offs and performance metrics behind each architectural decision.
KafkaRediscloud-native
0 likes · 14 min read

The article explains blue‑green deployment as a release strategy that improves large‑scale microservice rollouts by extracting traffic from a blue cluster, incrementally shifting it to a green environment, using global and local traffic scheduling, central metadata, compatible components, and careful considerations such as idempotent consumption and version compatibility.
Continuous DeliveryOperationsblue-green-deployment
0 likes · 12 min read

iQIYI’s SDN‑based full‑network automatic traffic‑scheduling system dynamically balances inter‑ and intra‑province traffic using BGP and policy routing, integrates monitoring, flow collection, DFS backup‑path calculation, and real‑time Kafka/Flink processing, cutting fault‑handling time to minutes and boosting link availability to 99.9999 % while preparing for programmable‑switch and SR‑based extensions.
BGPSDNiQIYI
0 likes · 11 min read

Xiami’s SRE team overhauled its monitoring system by categorizing alerts, introducing fault, generic, and basic monitoring, optimizing alert paths with stream processing, and leveraging Alibaba’s traffic scheduling platform, dramatically reducing daily noise from thousands of alerts to a manageable few hundred critical notifications.
AlibabaSREalert optimization
0 likes · 9 min read

On March 23, a construction accident severed a fiber optic cable in Shanghai, causing widespread internet disruptions, but Tencent Cloud’s intelligent traffic scheduling system and four‑fiber‑three‑router high‑redundancy architecture automatically rerouted traffic, restoring services within two minutes and demonstrating robust cloud network resilience.
BGPHigh Availabilitycloud computing
0 likes · 6 min read

The article explains how Alibaba’s Edge Network, using the NetO intelligent traffic scheduling system, combines real‑time internet quality monitoring, SDN‑enhanced BGP routing, and extensive peering to optimize both inbound and outbound paths for millions of global Double 11 shoppers, ensuring a seamless user experience.
AlibabaBGPEdge Network
0 likes · 5 min read


ITPUBNov 25, 2015 · Operations
Meizu moved from a single‑datacenter to a multi‑datacenter architecture to improve reliability, reduce latency, and meet user proximity demands, detailing technical challenges, traffic scheduling, read‑heavy and read‑write balanced services, and GSLB‑based routing solutions.
GSLBmulti-datacenterread‑heavy services
0 likes · 10 min read

This article examines the characteristics and billing models of multi‑data‑center networks, analyzes external traffic patterns, identifies challenges in optimizing Internet‑facing bandwidth, and proposes practical scheduling strategies to better utilize idle bandwidth and reduce carrier costs.
Operationsbandwidth optimizationmulti-data-center
0 likes · 13 min read
