Tagged articles
Traffic Routing
41 articles · Page 1 of 1
This article details Spring Boot implementation of unit-based multi-active architecture, covering traffic routing with gateway filters and consistent hashing, data sharding via dynamic data sources and ShardingSphere, cross-unit synchronous/async calls with circuit breaking, data synchronization with conflict resolution, and failover switching with three-layer controls and graceful shutdown.
Circuit BreakerConsistent HashingCross-Unit Calls
0 likes · 43 min read

This article reveals seven critical pitfalls that can cripple Nginx+Lua gray‑release deployments—ranging from memory leaks and blocking I/O to uneven traffic hashing, configuration reload races, cross‑datacenter latency, session stickiness issues, and blind‑spot monitoring—while providing concrete Lua scripts, Nginx configurations, monitoring commands, and step‑by‑step remediation strategies.
DevOpsGray ReleaseLua
0 likes · 43 min read

This guide explains why gray (canary) releases are essential for production stability in internet companies, and provides step‑by‑step configurations using Istio’s VirtualService, Gateway, and DestinationRule resources to route traffic by percentage or request headers in a Kubernetes cluster.
IstioKubernetesTraffic Routing
0 likes · 6 min read

This article explains Envoy's request mirroring feature, shows how it copies live HTTP requests to a test backend without affecting the original response, and provides step‑by‑step configuration examples for mirroring all traffic, selective paths, percentage‑based sampling, and header‑driven routing, plus practical tips and typical use cases.
EnvoyRequest MirroringShadow Testing
0 likes · 11 min read

This article examines seven hidden risks when implementing gray releases with Nginx and Lua—memory leaks, blocking operations, uneven hash distribution, hot‑update atomicity, cross‑data‑center latency, session‑stickiness conflicts, and monitoring blind spots—and provides concrete Lua code fixes, Nginx configurations, monitoring scripts, and best‑practice recommendations to ensure reliable, performant deployments.
Gray ReleaseLuaNGINX
0 likes · 42 min read

This article explains how to use Nginx to implement gray release—gradually rolling out a new application version to a subset of users—by configuring header‑based, cookie‑based, and IP‑address‑based routing strategies, detailing the required Nginx directives, deployment steps, and verification process.
Gray ReleaseTomcatTraffic Routing
0 likes · 8 min read

This article explains how ByteDance’s TrafficRoute GTM, a DNS‑based global traffic routing service, uses GEO‑based routing, health‑check orchestration, and intelligent load‑balancing to achieve high stability, performance, and cost efficiency for ultra‑large‑scale traffic across multiple regions and CDN providers.
ByteDanceDNS Load BalancingGTM
0 likes · 11 min read

This article explains ByteDance’s multi‑region unitization approach, covering its core concepts, motivations, architectural challenges, traffic routing, data synchronization, cut‑over strategies, and future evolution for large‑scale, resilient services. It also discusses operational optimizations, risk controls, and the impact on cost and development efficiency.
Traffic Routingcloud nativedata synchronization
0 likes · 20 min read

This article explains how to use Alibaba Service Mesh (ASM) to register large language model (LLM) providers, configure LLMProvider and LLMRoute resources, and implement traffic routing, observability, and security for LLM services through step‑by‑step Kubernetes manifests and curl tests.
AIASMKubernetes
0 likes · 13 min read

The paper details a same‑city dual‑active architecture for a high‑traffic transaction platform, combining blue‑green and dual‑cluster deployment with zone‑aware routing, middleware transformations, and a gradual traffic‑coloring release process that achieved near‑50/50 traffic split, stable performance, minimal cost, and outlines remaining challenges.
High AvailabilityTraffic Routingcloud-native
0 likes · 20 min read

This article explains how to use Istio’s sourceLabels feature to achieve full‑chain gray deployments across multiple microservice versions, providing detailed configuration examples, deployment steps, testing procedures, and an analysis of its advantages and limitations.
Gray ReleaseIstioKubernetes
0 likes · 10 min read

This article describes how to use Istio Service Mesh, Kubernetes CRDs, and custom WASM Envoy filters to create isolated swim‑lane call chains that prevent branch conflicts, enable full‑link header propagation, and support features such as Java remote debugging, middleware deployment, and hot code reload.
CRDIstioSwimlane
0 likes · 26 min read

The article explains the stability challenges of modern microservice architectures, outlines the three governance domains (development/testing, change, runtime), and introduces OpenSergo’s open, cloud‑native specifications, control‑plane, and data‑plane solutions for traffic routing, gray‑release, and fault‑tolerance.
Gray ReleaseOpenSergoTraffic Routing
0 likes · 18 min read

This article explains the difficulties of performing gray releases in microservice architectures and presents full‑link gray release concepts, two implementation strategies—environment isolation and traffic routing—along with practical solutions using Istio, service‑discovery agents, tracing baggage, and Alibaba Cloud MSE integrated with ZadigX.
Gray ReleaseIstioMSE
0 likes · 10 min read

The article explains Baidu's Janus gateway—its motivations, three‑level routing design, variable and condition expression language, plugin implementations for disaster recovery and caching, and performance benchmarks—showing how it supports millions of QPS while remaining flexible and efficient.
BackendExpression LanguagePlugin Architecture
0 likes · 11 min read

This article describes how Zhaozhuan’s testing environment evolved through three versions—physical isolation, automatic‑IP‑tag routing, and manual‑tag routing—detailing the architectural background, implementation principles, advantages, drawbacks, and supporting tools that dramatically reduced deployment time and resource consumption while introducing new operational challenges.
OperationsService GovernanceTest Environment
0 likes · 23 min read

Janus is Baidu’s high‑throughput, multi‑purpose gateway that complements BFE, supporting traffic, business, and hybrid routing for dozens of internal services; the article explains its motivations, architecture, three‑tier routing rules, variable and conditional expressions, plugin system, performance benchmarks, and future extensions.
Traffic Routingbackend developmentgateway
0 likes · 12 min read

This article presents a comprehensive guide to microservice architecture evolution, covering routing, multi‑active deployment, gray releases, canary/rolling/blue‑green strategies, traffic shading, rate limiting, and practical implementation steps using cloud‑native gateways, service meshes, and Kubernetes labeling.
Multi-ActiveTraffic Routingcloud-native
0 likes · 19 min read

The article explains why Baidu built the high‑performance Janus gateway, its architecture and deployment topology, the three routing modes, the three‑level rule system with variable and condition expressions, plugin extensibility, performance benchmarks, and how the design can be generalized to other use cases.
BackendPlugin ArchitectureTraffic Routing
0 likes · 9 min read

This guide outlines the motivations, architectural guidelines, routing strategies, RPC and message replication techniques, storage synchronization methods, and traffic‑switching procedures needed to successfully implement a multi‑active, cross‑region system.
Cloud ArchitectureMulti-ActiveTraffic Routing
0 likes · 11 min read

This article explains the fundamentals of full‑chain gray releases in microservice architectures, covering service hierarchy, high‑cohesion low‑coupling design, deployment strategies with Kubernetes namespaces, traffic routing rules, and the essential infrastructure components needed for robust cloud‑native applications.
Gray ReleaseTraffic Routingmicroservices
0 likes · 9 min read

This article analyzes Baidu's Janus gateway—why it was built despite BFE, its architecture and deployment, three‑layer routing design, variable and condition expression languages, performance benchmarks versus raw Go code, and how its plugin system enables both generic and highly customized traffic‑dispatch solutions.
Traffic Routingbackend architecturegateway
0 likes · 11 min read

This article explains the concept of traffic routing in microservice governance, outlines the challenges of heterogeneous environments, introduces the OpenSergo project as a unified, multi‑language solution, and provides detailed CRD examples and demo steps for implementing tag, canary, and full‑link gray routing in Kubernetes.
CRDKubernetesOpenSergo
0 likes · 16 min read

This article explains the design and implementation steps for a multi‑active (geo‑distributed) system, covering data‑center segmentation, traffic scheduling, RPC routing, database and Redis sharding, distributed IDs, message queue handling, job coordination, and cut‑over procedures.
Multi-ActiveRPCRocketMQ
0 likes · 27 min read

On August 5, the ITCP Alliance hosted a four‑hour closed‑door technical exchange at ZhaiZhai Group where five member companies shared detailed traffic routing practices, discussed common challenges, and outlined future collaborative initiatives to improve service governance and operational efficiency.
ITCP AllianceService GovernanceTesting Environment
0 likes · 6 min read

This guide explains the concept of full‑link gray release in microservice architectures, introduces OpenSergo's unified governance standards, and provides step‑by‑step configurations—including traffic labeling, workload labeling, and database shadowing—to achieve seamless multi‑service version rollouts.
MSEOpenSergoTraffic Routing
0 likes · 11 min read

This article explains the concept of full‑link gray release in microservice architectures and provides step‑by‑step guidance on using OpenSergo's v1alpha1 traffic‑routing standard together with Apache APISIX and Alibaba Cloud MSE to achieve fine‑grained, multi‑service gray deployments.
Apache APISIXOpenSergoTraffic Routing
0 likes · 15 min read

This article explains how to use the ngx_lua module in Nginx to assign traffic tags, implement header‑based or domain‑based routing, and integrate with dynamic upstreams for parallel testing, load testing, and gray‑release scenarios, providing code examples and configuration details.
BackendLua scriptingTraffic Routing
0 likes · 9 min read

The article describes the “小得物” gray‑release environment—a single‑region, isolated production setup that adds dedicated SLBs and DLB routing, uses UID‑based user and staff segmentation via HTTP headers and message metadata, and enables daytime partial‑traffic releases for the online customer‑service system, dramatically improving stability and reducing incident rates.
Gray ReleaseTraffic Routingbackend architecture
0 likes · 10 min read

This article explains the challenges of releasing new microservice versions, compares traditional blue‑green and canary deployments, introduces the concept of full‑chain gray release, and provides detailed, practical solutions—including physical and logical isolation, label routing, traffic coloring, distributed tracing, and a hands‑on MSE cloud‑native gateway demo with code snippets.
KubernetesMSETraffic Routing
0 likes · 29 min read

This article details Xianyu's transition from a single‑site to a multi‑region deployment, covering scalability limits, disaster‑recovery strategies, traffic routing, data consistency decisions, service and database architecture, and the operational principles that enable low‑cost, high‑availability scaling across regions.
Cloud ArchitectureDatabase ReplicationTraffic Routing
0 likes · 19 min read

The migration of Xianyu’s legacy Idlecenter service split into code migration—defining clear RPC‑service boundaries, moving middleware together, and avoiding refactoring—and traffic migration using HSF routing to shift load transparently, enabling gray releases, observability, sub‑second rollbacks, cutting effort to one person‑week per service with zero faults and a reusable checklist.
HSFTraffic Routingbackend-migration
0 likes · 9 min read

The Xianyu recommendation service was re‑architected into an active‑active, multi‑region high‑availability system—using a unified access‑layer router, centralizing long‑tail dependencies, keeping data unsharded, refactoring caches and MySQL replication, and adhering to traffic‑closed‑loop and availability‑first principles—to overcome latency, improve scalability, and ensure low‑cost disaster recovery across two regions and three data centers.
Database ReplicationHigh AvailabilityTraffic Routing
0 likes · 15 min read

The article describes a virtual environment solution that uses traffic coloring and routing to enable independent branch testing for micro‑services, improving development efficiency, reducing test costs, and supporting HTTP, RPC, and MQ protocols within a cloud‑native infrastructure.
Traffic Routingcloud nativeservice mesh
0 likes · 15 min read

This article explains the concept of gray (canary) release, outlines a simple system architecture with essential components, details common traffic‑splitting strategies, and demonstrates both basic and complex implementation scenarios using Nginx, gateway services, and database migration techniques.
Database MigrationGray ReleaseTraffic Routing
0 likes · 6 min read

This article dissects Alipay's massive Double‑11 payment surge, explaining how its Logical Data Center (LDC) and unit‑based architecture—RZone, GZone, and CZone—scale to hundreds of thousands of transactions per second, manage traffic routing, implement disaster‑recovery, and navigate the CAP theorem using OceanBase and Paxos.
CAP theoremLDC architectureOceanBase
0 likes · 39 min read

This article describes how a microservice architecture uses IP‑tag traffic routing to separate dynamic test environments from stable ones, implements RPC and MQ routing, and introduces a custom Zipkin‑based distributed tracing system called Tianwang to improve deployment efficiency, resource utilization, and debugging in large‑scale backend services.
Distributed TracingMQRPC
0 likes · 12 min read

This article explains how Ele.me built a multi‑active, geographically distributed system that enables elastic scaling and data‑center‑level disaster recovery by partitioning services, routing traffic, replicating data in real time, and enforcing strict consistency and availability principles.
Multi-ActiveTraffic Routingdata replication
0 likes · 18 min read

This article describes how Dada Group tackled rapid micro‑service growth by designing a language‑agnostic, lightweight service governance and traffic routing engine that uses Consul metadata, configurable routing rules, and link‑based isolation to enable online pressure testing, parallel development, hot‑cold service separation, gray releases, and dynamic rate limiting.
Service GovernanceTraffic Routingbackend architecture
0 likes · 10 min read

This guide explains how to set up Istio across multiple Kubernetes clusters using a multi‑control‑plane topology, covering CA secret creation, control‑plane installation, DNS configuration, sample application deployment, ServiceEntry and DestinationRule creation, and cross‑cluster traffic routing verification.
IstioKubernetesMulti-Cluster
0 likes · 16 min read

The article explains how an API gateway serves as a unified, secure entry point for services, outlines the limitations of manual NGINX configurations, and describes a practical implementation using OpenResty/Nginx with the open‑source Orange framework—enhanced with dynamic routing, header‑based authentication, encryption, and high‑availability design, dubbed the Aegis gateway.
API gatewayOpenRestyTraffic Routing
0 likes · 7 min read
