This article explains how Istio provides comprehensive security for microservices by using traffic encryption, flexible access control, TLS, mutual authentication, JWT request validation, and fine‑grained authorization policies, enabling zero‑trust networking across Kubernetes and other environments.
This article explains how to use Alibaba Service Mesh (ASM) to register large language model (LLM) providers, configure LLMProvider and LLMRoute resources, and implement traffic routing, observability, and security for LLM services through step‑by‑step Kubernetes manifests and curl tests.
This article explains the fundamentals of distributed architecture, covering its key characteristics, microservice principles, Spring Cloud implementations, Service Mesh concepts, and essential components like distributed storage, caching, and transaction management for building scalable, resilient backend systems.
This article walks through the complete lifecycle of a single RPC call in Dubbo 3.x, covering demo setup, provider exposure, consumer referencing, parameter packaging, filter chains, cluster decision, routing, load balancing, communication and serialization protocols, and finally how the provider processes the request.
This article demonstrates how to protect large language model (LLM) requests in a cloud‑native environment by using Alibaba Cloud ASM service mesh and a custom Wasm plugin to dynamically inject API keys, enforce custom denial patterns, and optionally route requests through a private LLM for intelligent data‑leak detection.
This article explains how containerization and Kubernetes gave rise to micro‑services, why observability (metrics, logging, tracing, profiling) became essential for managing their complexity, and how OpenTelemetry’s unified data model enables seamless integration of these signals across modern cloud‑native stacks.
This article explains what Istio and its sidecar proxy are, how they are injected into Kubernetes pods, the iptables rules they use to hijack traffic, the xDS APIs that drive dynamic configuration, and how to inspect the resulting Envoy settings.
This article provides a comprehensive overview of Istio, explaining its role as an open‑source service mesh for cloud‑native microservices, detailing the data plane and control plane components, sidecar proxy functions, traffic management, security, and monitoring while also promoting related learning resources.
This article provides a detailed, English-language overview of Service Mesh, explaining its role in cloud‑native microservice architectures, the need for it, its core principles—including data and control planes—and key Istio components, while also offering promotional links to related resources.
This article explains the concept of Service Mesh, its sidecar architecture, and why it’s essential for cloud‑native microservices, then compares leading implementations such as Istio, Linkerd, and Envoy, highlighting their features and deployment models.
In 2024 the author reflects on a decade of backend evolution and shares a practical, experience‑driven guide to the cloud‑native stack—including Kubernetes, multi‑cloud strategies, DevOps tooling, service mesh, observability, and message‑queue choices—tailored to teams of different sizes.
This guide explains how to configure Istio locality‑based load balancing and failover across Kubernetes zones and regions, providing hands‑on scripts, YAML examples, and validation steps to ensure resilient microservice traffic routing in cloud‑native environments.
This article explains cloud native fundamentals, covering its definition, core characteristics such as microservices, containerization, automation, storage, and networking, and introduces key technologies like Docker, Kubernetes, service mesh, CI/CD, and monitoring, while showing how they enable modern applications in AI, IoT, and big data.
This article explains the relationship between API gateways and service meshes, compares four methods for exposing services inside an Istio mesh, and provides a step‑by‑step guide to using Nginx Ingress Controller as the mesh entry point.
This guide explains why distributed tracing is needed, how Istio uses Jaeger as the tracing backend, the required request‑header propagation, step‑by‑step deployment of Jaeger and the Bookinfo demo on Kubernetes, and how to inspect and interpret the generated spans.
This document details the motivation, technology selection, overall architecture, data‑plane and control‑plane design, key implementation challenges such as HTTPS interception, precise URL monitoring, and plugin extensibility, and outlines future directions for scaling service mesh within the organization.
This guide explains why multi‑cluster deployments are needed for high‑availability, describes Istio's flat and non‑flat network models with single or multiple control planes, and provides step‑by‑step scripts to create Kind clusters, install MetalLB, configure root CAs, deploy Istio, set up gateways, and verify regional load balancing and failover.
This article details how to transition a Dubbo 3.0 microservice architecture to an Istio service mesh on Kubernetes, covering code modifications, deployment configurations, sidecar injection, traffic management policies, and verification steps with practical YAML examples and log analysis.
This article explains how Istio automatically injects sidecar containers into Kubernetes pods, the iptables‑based traffic interception mechanism for inbound and outbound flows, and how to configure rules to exclude specific traffic from Envoy processing.
This article describes how to use Istio Service Mesh, Kubernetes CRDs, and custom WASM Envoy filters to create isolated swim‑lane call chains that prevent branch conflicts, enable full‑link header propagation, and support features such as Java remote debugging, middleware deployment, and hot code reload.
This article explains why keeping the client source IP in an Istio service mesh matters, outlines the reasons for IP loss, and provides step‑by‑step solutions for north‑south and east‑west traffic using Service settings, traffic policies, and Envoy headers.
This article walks through the complete lifecycle of a request handled by Envoy, covering terminology, network topology, configuration details, listener and filter chain processing, TLS transport sockets, HTTP/2 encoding/decoding, routing, load balancing, and post‑request cleanup, illustrated with diagrams and sample YAML configuration.
This guide walks through Istio's observability stack, showing how to configure Prometheus for metrics collection, deploy Jaeger for distributed tracing, and set up Kiali for visualizing the service mesh, while covering annotations, TLS settings, weighted routing, and configuration validation.
By introducing distributed and local shared variables that propagate user profiles via trace context and cache parallel requests, the iQIYI strategy engine cuts redundant DMP calls, reduces traffic up to 25%, lowers P99 latency by nearly 50%, and achieves a 90% cost saving compared to step‑function micro‑services.
This article provides a comprehensive guide to Meshery, an open‑source cloud‑native management platform, covering its architecture, deployment options, service‑mesh management, performance testing, and MeshMap visual collaboration features for Kubernetes environments.
This article explains how cloud‑native service mesh (Istio) can be used for service governance, detailing both local and global rate‑limiting implementations and circuit‑breaking strategies, and provides practical EnvoyFilter and DestinationRule configurations used in the Autohome migration.
This article explains why Istio runs on Kubernetes, compares their roles in cloud‑native architectures, details how Istio extends Kubernetes with Envoy sidecars and xDS, and examines traffic management, load balancing, and the advantages and drawbacks of using a service mesh alongside kube‑proxy.
The article walks through a real‑world online supermarket project, showing how a simple monolithic system evolves into a fully‑featured microservice architecture, detailing each refactoring stage, the problems encountered, and the concrete solutions such as service extraction, database sharding, monitoring, tracing, gateways, service discovery, reliability patterns, testing, and service‑mesh adoption.
This article walks through the journey of transforming a simple online supermarket from a monolithic application to a fully fledged microservice architecture, highlighting the motivations, design decisions, component breakdown, operational challenges, monitoring, tracing, resilience patterns, testing strategies, and the role of service meshes.
This guide walks you through creating a sidecarless AI demo on Alibaba Cloud Service Mesh ASM, covering environment setup, multi‑model serving with KServe, PVC storage, InferenceService configuration, business service deployment, gateway and waypoint creation, traffic routing rules, and OIDC single sign‑on integration.
This article walks through the step‑by‑step evolution of an online supermarket from a simple monolithic web app to a fully split microservice architecture, highlighting the problems encountered, the rationale for each refactoring decision, and the essential components such as service isolation, messaging, monitoring, tracing, gateway, service discovery, circuit breaking, testing, and service mesh.
Service Discoverycircuit breakerdistributed tracing
This article explains the evolution from classic sidecar‑based service mesh to Istio's Ambient sidecarless architecture, details ASM's control‑plane and data‑plane separation, L4 ztunnel and L7 Waypoint proxies, traffic flow, serverless components, and real‑world benefits such as reduced resource usage and operational overhead.
The article by delphisfang offers a concise, step‑by‑step guide to mastering Istio’s locality‑aware routing, explaining the three‑evidence learning method, the priority algorithm, required DestinationRule and outlier detection settings, how Envoy discovers locality, and tips for simplifying the Pilot‑Envoy mesh architecture.
To upgrade an Istio service mesh without overloading the cluster or causing downtime, the author recommends using Kubernetes’s built‑in kubectl rollout restart for each deployment—scaling replicas up then deleting old pods or simply invoking the command in a scripted loop—to safely perform a rolling restart of all sidecar‑proxied pods.
This article explains how the automotive platform accelerated its cloud‑native service‑mesh transformation by integrating Opentelemetry, Prometheus, and Grafana, then details the configuration and practical use of Grafana's unified alerting module—including installation, data source setup, alert rule definition, contact points, message templates, and silencing—to achieve comprehensive observability and automated incident response.
This guide explains what sidecars are in Kubernetes, why they matter, the challenges they introduce, and how the new sidecar KEP in Kubernetes 1.28—introducing an Always RestartPolicy for init containers—formalizes sidecars as first‑class API objects, reshaping service‑mesh implementations and operational practices.
The article analyzes how private keys for workloads uploaded via Istio Ingress gateways can be exposed in plaintext, stored in memory, and extracted using tools like OpenSSL and GDB, and discusses mitigation strategies such as Intel SGX‑based protection.
Developers and architects can compare Apache Dubbo, Spring Cloud, gRPC, and Istio across architecture, performance, scalability, and governance, gaining clear guidance on selecting the right micro‑service framework and understanding each tool’s strengths, protocol support, and integration patterns for enterprise‑grade cloud‑native applications.
This article examines the challenges of setting effective rate‑limiting thresholds for massive cloud‑native services, compares TPS and concurrency metrics, proposes stress‑testing and historical‑data‑ARMA forecasting methods, and presents a practical system that delivers reliable limits for both node‑wide and per‑service protection.
ARMA forecastingCloud Operationsperformance testing
Aeraki Mesh 1.4.0 (codename Heshun) released on August 13, 2023 adds Istio 1.18.x compatibility, removes Envoy Dubbo/Thrift filters, introduces extensive changelog updates, lists contributors from major tech firms, and provides reference links to the official site and GitHub repository.
This article explains how service mesh complements Kubernetes by providing advanced traffic management, observability, and security for microservices, discusses common distributed‑system fallacies and service‑governance challenges, compares Istio with FloMesh, and explores future trends such as Wasm sidecars, ambient mesh, and eBPF.
This guide explains how Alibaba Cloud Service Mesh ASM enables comprehensive observability for cloud‑native applications by configuring telemetry for logs, metrics, and distributed tracing, offering best‑practice recommendations, YAML examples, and integration with Prometheus, ARMS, and external tracing tools.
This article explains the difficulties of performing gray releases in microservice architectures and presents full‑link gray release concepts, two implementation strategies—environment isolation and traffic routing—along with practical solutions using Istio, service‑discovery agents, tracing baggage, and Alibaba Cloud MSE integrated with ZadigX.
This article walks through the step‑by‑step transformation of a simple online supermarket from a single‑node monolith to a fully fledged microservice architecture, highlighting the motivations, common pitfalls, component choices, monitoring, tracing, logging, resilience patterns, testing strategies, and the trade‑offs of frameworks versus service mesh.
This article traces the evolution of service mesh from its early concepts through microservice 1.0 and 2.0, analyzes the shortcomings of Envoy‑based sidecars, and explores future directions such as Go‑based data planes, WASM plugins, eBPF/VPP acceleration, QUIC transport, and on‑demand xDS delivery.
This article explains the role of API gateways in microservice architectures, outlines their four core functions, discusses design priorities such as high performance, availability, and scalability, and compares major open‑source gateway solutions like OpenResty, Kong, Zuul, and Spring Cloud Gateway.
Aeraki Mesh 1.3.0 (code‑named Dragonboat) adds Istio 1.16.x compatibility, introduces connection multiplexing, enables MetaProtocol routing on gateways, expands Dubbo service governance options, provides Redis traffic management, and migrates official images to GitHub Packages, with a detailed changelog and configuration examples.
An online supermarket startup evolves its simple monolithic website into a fully distributed microservice architecture, detailing each transformation stage, the challenges encountered—such as code duplication, database bottlenecks, deployment complexity—and the solutions like service decomposition, monitoring, tracing, circuit breaking, and service mesh.
This article explores the evolution of load‑balancing architectures from Alibaba’s early systems to modern micro‑service meshes, detailing DNS, hardware, and software solutions, common algorithms, and real‑world case studies such as Double‑11, China Railway 12306, WeChat red packets, and Douyin, highlighting performance, scalability, and reliability considerations.
This article explains MOSN v1.5.0's latency‑based load‑balancing algorithm, analyzes the sources of latency in distributed systems, describes mitigation techniques such as PeakEWMA and P2C, and presents a realistic simulation that shows the algorithm’s superiority over Round Robin and Least Request.
This article explains the three main use cases of API gateways—Open API platforms, microservice gateways, and API service management platforms—describes their position in enterprise architecture, outlines practical deployment scenarios, compares competing solutions, and provides criteria for choosing the right gateway for performance, scalability, extensibility, and cloud deployment.
This article walks through the evolution of a simple online supermarket from a monolithic architecture to a fully fledged microservice system, highlighting the challenges, component choices, database splitting, monitoring, tracing, logging, gateway, service discovery, resilience patterns, testing strategies, and the trade‑offs of using a custom framework versus a service mesh.
This article provides a comprehensive overview of the Kubernetes Gateway API, covering the constraints of Ingress resources, L4 routing methods, the role of SIG-NETWORK, reasons behind the API's development, and a preview of deeper technical details.
This article details the collaborative effort between Intel and F5 to redesign and implement dual‑stack networking support in Istio 1.17, covering the background challenges, new RFC design, key Envoy changes, step‑by‑step experimental setup, listener and endpoint modifications, and ways for the community to contribute.
This article breaks down the core concepts of Kubernetes—including its master‑worker architecture, pod scheduling, etcd storage, service exposure, scaling mechanisms, and controller interactions—through a series of clear questions and illustrated answers to help beginners grasp the platform’s complexity.
Viaduct, Airbnb’s data‑oriented service mesh built on GraphQL, replaces traditional procedural meshes by centralizing a schema that routes queries across thousands of micro‑services, enabling fine‑grained data access, serverless derived fields, automatic schema propagation, and improved observability, now handling most of Airbnb’s API traffic.
This article details the evolution of 58 Tongcheng's deep learning inference platform—from the initial WPAI‑based architecture to a cloud‑native, Istio‑powered design—covering its background, technical challenges, architectural redesign, traffic‑management features, adaptive rate limiting, model warm‑up, and observability improvements.
The article outlines Ctrip’s microservice journey from its 2013 inception, detailing the evolution of its frameworks, the complexities of operating multiple stacks, the challenges faced, and the design of a progressive cloud‑native service‑mesh architecture built on Istio, Envoy, and custom operators.
Facing rapid growth and complex service interactions, Huolala transitioned from a simple PHP‑based architecture to a self‑developed microservice framework, combining data and control planes, custom RPC protocols, and robust governance, while explaining why existing solutions like Dubbo and Istio were unsuitable.
This guide explains why and how to combine Tencent's open‑source Polaris service‑governance platform with the high‑performance dubbogo Go RPC framework, covering architecture, registration, discovery, dynamic routing and rate‑limiting, complete with configuration snippets and practical code examples.
This article explains Istio’s core networking concepts, detailing how sidecar and init containers are injected into a Kubernetes cluster, the roles of the data and control planes, and provides step‑by‑step commands and YAML examples for manual and automatic sidecar injection.
This article introduces Service Mesh fundamentals, traces its evolution to Istio, explains the Proxyless Mesh architecture that eliminates sidecar proxies, and provides a step‑by‑step Spring Cloud demo showing how to enable xDS‑based, sidecar‑free communication across multi‑language microservices on Alibaba Cloud MSE.
This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines core design ideas such as routing, service registration, load balancing, resilience and security, distinguishes traffic and business gateways, and compares major open‑source implementations like OpenResty, Kong, Zuul 1/2 and Spring Cloud Gateway.
The article explains why CTOs should adopt cloud‑native—gaining elasticity, cost savings, and rapid delivery—while acknowledging trade‑offs like provider lock‑in and security, and it details core technologies such as micro‑services, containers, Kubernetes orchestration, service meshes, observability tools, and DevOps practices for building resilient, scalable applications.
This tutorial explains the background of the Kubernetes Gateway API, compares it with the traditional Ingress API, and provides a hands‑on walkthrough for installing the Gateway API CRDs, configuring Istio to use a Gateway resource, exposing a sample httpbin service, updating routes, and cleaning up the environment.
This article explores Huolala’s evolution of application architecture—from a single monolithic system through RPC and SOA to microservices and service mesh—detailing the challenges, technical trade‑offs, and framework selections such as Dubbo, Spring Cloud, and Istio for robust backend governance.
This article explains the fundamental concepts of API gateways, why they are essential in micro‑service architectures, outlines core design ideas such as routing, load balancing, resilience and security, and compares popular open‑source implementations like OpenResty, Kong, Zuul and Spring Cloud Gateway.
The article reviews how Ant Financial’s Service Mesh has evolved after its double‑11 rollout, detailing the implementation of link encryption, adaptive rate limiting, fine‑grained traffic steering, and self‑healing mechanisms that improve security, performance, and reliability across large‑scale microservice deployments.
This article reviews how Ant Financial’s Service Mesh has matured since its 2019 Double‑11 rollout, detailing the design and implementation of link encryption, adaptive rate limiting, fine‑grained traffic steering, and service self‑healing, and explains the operational value these capabilities bring to large‑scale microservice systems.
The article explains why microservice governance is essential, introduces the OpenSergo project and its collaboration with ShardingSphere to create a unified, language‑agnostic standard for database governance, and provides concrete abstractions and YAML examples for implementing traffic, fault‑tolerance, and security policies.
This article provides an in‑depth overview of API gateways, explaining their basic concepts, design principles, key features such as request routing, service registration, load balancing, resilience and security, and compares popular gateway solutions like OpenResty, Kong, Zuul and Spring Cloud Gateway for microservice architectures.
This article explains how the Intel istio‑tcpip‑bypass plugin leverages eBPF to bypass the host TCP/IP stack for intra‑node pod communication, provides environment setup, step‑by‑step deployment commands, and shows benchmark results that demonstrate 40‑80% latency reduction and throughput improvement.
This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines core design ideas such as request routing, service registration, load balancing, resilience and security, and compares major open‑source gateways like OpenResty, Kong, Zuul 1/2 and Spring Cloud Gateway.
This article walks through the step‑by‑step transformation of a simple online supermarket from a monolithic web app to a fully‑featured microservice architecture, covering common pitfalls, component choices, monitoring, tracing, logging, service discovery, fault‑tolerance, testing, and deployment strategies.
This article walks through the evolution of a simple online supermarket from a monolithic website to a fully split microservice architecture, highlighting the challenges encountered—such as code duplication, database bottlenecks, and operational complexity—and presenting practical solutions like service decomposition, monitoring, tracing, gateway control, service discovery, circuit breaking, rate limiting, testing strategies, and the use of service meshes.
Google donated Istio to the CNCF, which was accepted as an incubating project, introducing the experimental Ambient Mesh mode while retaining sidecar support, and the article outlines Istio's architecture, history, community contributions, and industry perspectives on this cloud‑native milestone.
This article explains how to prepare Linkerd for production use by covering high‑availability deployment, Helm chart installation, Prometheus metric handling, external Prometheus integration, multi‑cluster communication, and additional operational best‑practices such as resource tuning and security considerations.
This article presents a comprehensive backend architecture guide covering microservice fundamentals, domain‑driven design, gateway patterns, service registration, configuration centers, observability pillars, service mesh options, and a detailed comparison of major message‑queue technologies.
Istio's ambient mesh introduces a shared‑node ztunnel and optional waypoint proxies to provide zero‑trust security and optional L7 features without sidecar injection, reducing invasiveness, resource waste, and operational complexity while maintaining full mesh functionality.
The article compares monolithic, clustered, and distributed architectures, examines the differences between Spring Cloud, Kubernetes, and Istio, discusses Spring Boot on K8s, and explains the benefits of Service Mesh and sidecar proxies for modern microservice deployments.
This article explains the transition from monolithic to microservice architecture using an online supermarket example, highlights the problems caused by rapid, unplanned scaling, and presents systematic solutions such as service decomposition, database sharding, monitoring, tracing, gateway, service discovery, circuit breaking, testing, and service mesh adoption.
By registering foreign clusters to the Tencent Distributed Cloud Center and linking them with Cloud Connect Network, the guide shows how to use Tencent Cloud Service Mesh to create a unified ingress gateway, configure DNS and Istio virtual services, and route traffic across multiple accounts and clusters securely.
Apache Dubbo 3.1.0 introduces native Service Mesh support, an error‑code troubleshooting guide, Fastjson2 serialization, single‑port multi‑protocol handling, and full compatibility with Dubbo 3.0, providing a lighter data‑plane and a more cohesive control‑plane for cloud‑native applications.
This article explains ByteDance’s evolution from monolithic services to a multi‑runtime microservice architecture, introduces four sidecar runtime models, details the ByteRuntime design with Mesh Pilot and governance layers, and shares performance‑boosting techniques such as PGO while comparing ByteRuntime with DAPR.
This article walks through the evolution of an online supermarket from a simple monolithic web app to a fully fledged microservice architecture, detailing the motivations, design decisions, component breakdown, common pitfalls, and essential practices such as monitoring, tracing, logging, service discovery, resilience patterns, testing, and the role of service meshes.
Consul 1.13 introduces a Kubernetes CNI plugin, enhanced Envoy troubleshooting CLI, upgraded terminating gateways, and a preview of cluster peering, enabling organizations to reduce operational complexity, securely connect services at scale, and integrate service mesh capabilities directly into their workflows.
The article explains how Intuit manages hundreds of Kubernetes clusters using multi‑control‑plane architectures and Admiral to automate Istio service‑mesh configuration, illustrating the challenges of large‑scale microservice deployment and sharing a domestic bank’s experience with similar cloud‑native adoption.
This article explores modern service governance in the microservice era, comparing traditional sidecar‑based Service Mesh solutions like Istio with emerging eBPF‑driven meshes and RSocket Broker architectures, highlighting their design, performance, operational, and security trade‑offs.
This guide explains how to connect Dubbo services to Aeraki Mesh using Dubbo2Istio or direct ServiceEntry definitions, covering configuration, environment variables, Kubernetes deployment, and client adjustments to achieve comprehensive L7 traffic routing, load balancing, and rate limiting within an Istio service mesh.
This tutorial demonstrates how to install Aeraki and Istio, deploy Dubbo sample services, define ServiceEntry and MetaRouter resources, route traffic to a primary version, mirror traffic to a secondary version, verify logs, and explain the underlying MetaProtocol proxy mechanism for traffic mirroring.
The article examines the evolution from monolithic to distributed systems, contrasts Spring Cloud with Kubernetes and Istio, explains how service‑mesh concepts like sidecar proxies decouple business logic from infrastructure, and discusses migration paths and the advantages of non‑intrusive, language‑agnostic platforms.
This tutorial walks through installing Aeraki Mesh and sample Dubbo/Thrift services, creating a MetaRouter resource to add custom request headers, verifying the changes via sidecar logs, and explains how Aeraki translates MetaRouter rules into MetaProtocol Proxy configurations delivered through its internal RDS server.
This tutorial explains how to install Aeraki Mesh sample applications, forward ports to Prometheus and Grafana, and use these tools to query and visualize L7 protocol metrics for Dubbo and Thrift services within an Istio service mesh.
This tutorial demonstrates how to install Aeraki Mesh, view its default Round Robin load balancing, and configure a Consistent Hash algorithm for Dubbo services using Istio DestinationRule metadata, then verifies the behavior and explains the underlying RDS routing configuration.
The article interviews Ant Group’s Trusted Native team, detailing their cloud‑native infrastructure roadmap—including middleware mesh, SOFAStack, secure container runtimes like Kata and MOSN, confidential‑computing platforms such as Occlum, HyperEnclave and KubeTEE—while highlighting open‑source strategy, security considerations, and productization efforts.
This article provides an extensive overview of microservice architecture, tracing its evolution from monolithic to distributed services, detailing the advantages and drawbacks of each stage, and presenting a practical technology stack—including service discovery, API gateways, containerization, orchestration, logging, monitoring, and CI/CD—to help engineers design, implement, and operate modern cloud‑native systems.
This tutorial walks through installing Aeraki Mesh and Istio on Kubernetes, deploying a fake Thrift service, configuring an Istio DestinationRule for outlier detection, and verifying that failed endpoints are automatically ejected to prevent cascade failures.
This tutorial explains how to set up Aeraki Mesh's global rate limiting for Dubbo and Thrift services in an Istio service mesh, covering the deployment of a rate‑limit server, configuration of rate‑limit rules, enabling limits via MetaRouter, and verifying the behavior with command‑line tools.