The latest MCP update abandons stateful handshakes for a stateless request/response model, easing scaling and load‑balancing, yet community complaints about context crowding and cost persist, revealing that solid architecture design and engineering practice remain the most limited assets in the AI era.
A SaaS platform’s consumer count surged from 200 to nearly 20,000, causing open‑source Higress authentication latency to jump 34‑fold and configuration size to balloon 8,457‑fold, while a local comparative test shows the Higress Enterprise Serverless edition maintains sub‑2 ms latency, 100 % success, tiny config footprints, and up to 90 % lower annual costs.
This article presents a complete, production‑grade microservice gateway architecture that combines Nacos for service discovery and configuration with Higress as a cloud‑native data‑plane, covering design principles, dynamic configuration, traffic governance, high‑availability deployment, code examples, and operational best practices.
This guide explains the challenges of managing multiple AI models in Dify, introduces the Higress AI Gateway plugin that provides unified model access, governance, and fine‑grained authentication, and walks through two practical demos—an Agent assistant and an image‑generation workflow—showing step‑by‑step configuration and usage.
When Kubernetes announced the deprecation of Ingress NGINX in March 2026, the author used OpenClaw AI to automatically analyze the existing 60‑plus Ingress resources, set up a Kind test cluster, generate compatible Higress configurations, create WASM plugins for custom snippets, and produce a verified migration handbook—all in less than two minutes of hands‑on work.
This article explains the challenges of managing hundreds of tools for AI agents, introduces a semantic‑driven tool selection approach via the Higress AI Gateway extension for AgentScope Java, and provides performance data, code examples, and a quick‑start guide for developers.
This guide details a private MCP gateway architecture using open‑source Higress as the MCP proxy and Nacos as the registry, enabling dynamic tool registration, real‑time Prompt updates, multi‑tenant isolation, and deployment on an air‑gapped Kubernetes cluster without Helm.
This guide provides a production‑ready, step‑by‑step solution for deploying a high‑availability microservice gateway using Nacos as a service‑registry and configuration center together with Higress as a cloud‑native gateway on Kubernetes, covering architecture, prerequisites, Helm commands, key values.yaml examples, observability, security, backup, upgrade, recovery runbooks, and common troubleshooting.
The article explains how the SOFA AI Gateway, built on the open‑source Higress kernel, evolves traditional API gateways into specialized AI gateways by adding intelligent routing, model proxy, agent proxy, and MCP market features to meet the unique latency, resource, and security demands of AI workloads.
Alibaba Cloud unveiled a fully open‑source AI middleware suite—including AgentScope‑Java, AI‑MQ (RocketMQ), Higress gateway, Nacos registration/configuration, and AI observability—to enable enterprise‑grade, multi‑Agent AI applications, addressing integration, scalability, and reliability challenges highlighted by recent Gartner forecasts.
Ctrip’s R&D team built an AI gateway using Higress to unify access to diverse large‑model services, addressing authentication, traffic control, fault tolerance, monitoring, and integration with internal MCP platforms, while sharing practical lessons and future plans.
The article explains how to replace manual MCP Server development with Higress AI Gateway's API‑to‑MCP feature, showing step‑by‑step Docker setup, configuration of a simple SpringBoot service, MCP tool definition, request‑template options, and the resulting zero‑code deployment for AI agents.
This article compares OpenRouter and Higress as emerging AI Gateways, examining their origins, target users, feature sets, deployment models, and pricing structures to show how the traditional gateway concept is being reshaped for AI‑driven cloud‑native applications.
This tutorial walks through deploying vLLM inference services on a GPU‑enabled Kubernetes cluster using llmaz, configuring Higress as an AI gateway for traffic control, observability, and fallback model switching, and demonstrates end‑to‑end request testing.
This article reviews a recent cloud‑native event, explains how Nacos 3.0 upgrades its architecture, introduces the MCP Registry for AI Agent development, and details zero‑trust security measures, while also showing integration patterns with Spring AI Alibaba and Higress for enterprise AI solutions.
This article explains how Alibaba engineers transformed millions of HSF microservices into MCP servers without code changes by leveraging the Higress AI gateway, detailing the ecosystem components, step‑by‑step migration process, challenges of rapid MCP evolution, and strategic insights for AI infrastructure teams.
This tutorial walks through building a Retrieval‑Augmented Generation (RAG) system by combining LangChain for document processing, Elasticsearch’s vector store with the ELSER v2 model for semantic search, and Higress as a cloud‑native AI gateway, complete with deployment scripts, code examples, and query testing.
This article explains how Alibaba engineers use the Higress AI gateway to offload MCP protocol and transform large‑scale HSF RPC services into MCP servers without modifying application code, covering challenges, required components, step‑by‑step migration, and practical insights for AI‑native infrastructure.
This guide explains how to convert legacy OpenAPI schemas into Model Context Protocol (MCP) configurations, route them through the Higress cloud‑native gateway, set up dual authentication, and finally expose the MCP tools to AI platforms such as Dify, enabling seamless AI‑driven access to both local and internet data sources.
The article explains how Nacos, acting as an MCP Registry, can transform existing service APIs into MCP‑compatible interfaces without code changes, detailing the integration with Higress, the underlying tool/list exposure, protocol conversion, deployment steps, and a weather‑query demo that showcases the end‑to‑end workflow.
Learn how to deploy the new QwQ‑32B inference model alongside DeepSeek‑R1 using the Higress AI gateway, covering environment setup, model configuration, routing, token‑level rate limiting, content safety, semantic caching, and advanced features like automatic fallback and internet‑search integration.
This guide shows how open‑source LLMs like DeepSeek can power cost‑effective intelligent Q&A services, and how the cloud‑native Higress API gateway adds real‑time web search, routing, security, and observability to create a production‑grade solution in just a few steps.
This guide walks through the recent DeepSeek R1 and Qwen2.5 releases, explains why running LLMs on a PC or phone saves compute and token costs, shows step‑by‑step installation of Ollama, building a Spring AI Alibaba chat app, and scaling the solution with the Higress cloud‑native API gateway for production use.
This guide explains how to install the Higress AI gateway, configure provider API keys, set up gray‑release routing between OpenAI and DeepSeek, use a Python client to call DeepSeek, and enable content security and observability features for safe, cost‑effective large‑model deployments.
Facing thousands of heterogeneous gateway configurations across multiple tech stacks, a Chinese cloud‑native platform consolidated its gateway layer by adopting Higress, Istio CRD, and APISIX, introducing a two‑tier rule model and automated migration tools that cut maintenance effort by 90% while preserving service continuity.
This article compares Kong, Gloo, and Higress on their AI‑related extensions—covering tech stacks, logging, proxy normalization, API‑key handling, caching, request/response rewriting, and RAG support—to help developers choose the most suitable gateway for emerging LLM workloads.
This tutorial walks through setting up a local k3d cluster, installing Higress, and using its AI plugins—including AI Proxy, AI JSON formatter, AI Agent, and AI Statistics—to integrate and observe Alibaba Cloud's Qwen large language models across various use cases such as weather and flight queries.
This article explains Prompt Engineering, introduces the AI Gateway concept, and demonstrates how to integrate a Geo‑IP plugin with an AI prompt‑modifying plugin in Higress using Go and Wasm, providing configuration examples, implementation details, and sample request‑response scenarios.
This article explains the AI Agent concept, introduces the AI Gateway plugin architecture, walks through zero‑code deployment of an AI Agent using Higress with AMap and Seniverse services, and details the ReAct‑based reasoning and tool‑calling implementation with code examples and workflow diagrams.
The author recounts how a university student discovered open‑source, joined the 2024 Tianchi Cloud Native Programming Challenge, used the AI assistant Tongyi Lingma to master GitHub Actions, built and published a Wasm plugin for Alibaba's Higress gateway, and successfully merged a PR after extensive testing and community feedback.
This guide explains how to set up a Higress gateway, compile a WebAssembly AI cache plugin, integrate Redis and DashVector for semantic caching of large‑model requests, and provides complete configuration and code examples for end‑to‑end deployment.
This guide shows how to use free AI translation tools—Immersive Translate and OpenAI Translator—together with the Higress cloud‑native AI‑proxy plugin, configuring Docker, model mappings, and custom dictionaries to efficiently translate computer‑science textbooks like Rust and Crafting Interpreters, while comparing machine and human translations.
This article walks through setting up a cloud‑native test environment using the open‑source NextChat UI and Higress API gateway to let Qwen‑2.5 masquerade as GPT‑4o, enabling a side‑by‑side comparison of their responses while showcasing Higress’s streaming, hot‑update, and security features for AI workloads.
The article details Higress's migration of its Wasm plugin runtime from V8 to the WebAssembly Micro Runtime (WAMR), showing up to 50% average performance gains and up to double speed for complex plugins, while outlining technical reasons, benchmark results, and migration steps.
Sealos public cloud faced massive multi‑tenant Ingress demands, security concerns, and performance bottlenecks, leading the team to systematically test Nginx, Envoy, APISIX, Cilium, Envoy Gateway, and finally adopt Higress for its stability, fast route activation, and low resource footprint.
This article details how a data‑compliance company evaluated several cloud‑native API gateways, selected Higress for its Kubernetes‑native architecture, built custom Wasm plugins, leveraged HTTP‑to‑Dubbo conversion, migrated from Nginx Ingress, and achieved higher performance and operational simplicity.
This article reviews how Spring Cloud Gateway modifies HTTP requests/responses with built‑in filters, introduces the Higress cloud‑native gateway’s Transformer plugin as a higher‑performance alternative, compares their CPU and memory usage, and provides step‑by‑step deployment and configuration instructions.
Meiqia, a global intelligent cloud‑customer‑service provider, replaced a tangled multi‑middleware routing stack with a unified Higress gateway, achieving hot‑reloadable routing, WebSocket stability, multi‑cloud deployment, and a clear control‑plane/data‑plane separation that dramatically reduced costs and operational complexity.
This guide explains how the cloud‑native Higress gateway can lower the expense of using AI large models by centralising API keys, applying rate‑limiting, request filtering, and usage monitoring, and demonstrates a complete OpenAI integration using a WASM plugin with code samples and configuration details.
This guide explains what Higress is, compares it with traditional gateways, and provides step‑by‑step instructions—including code snippets—to deploy Higress 1.1 as a standalone, non‑Kubernetes cloud‑native gateway, configure routes, and test migration from Spring Cloud Gateway for microservice applications.
This guide explains how to adopt Higress, a high‑performance C++‑based cloud‑native gateway, to replace traditional Java gateways in Spring Cloud ecosystems and demonstrates blue‑green, canary, and A/B testing deployments on Kubernetes using Nacos for service discovery.
This article explains how Higress replaces Nginx Ingress, Spring Cloud Gateway, Kong, and Istio Ingress Gateway with a single, high‑performance, cloud‑native ingress that reduces maintenance cost, improves traffic management, and integrates seamlessly with Kubernetes and service‑mesh APIs.
This step‑by‑step guide shows how to configure an Alibaba Cloud ACK cluster, install the Higress cloud‑native gateway with Helm, enable Prometheus monitoring via ARMS, and activate the built‑in WAF plugin to block a simulated SQL‑injection request, complete with screenshots and commands.
This article explains how the open‑source Higress gateway integrates with Nacos, outlines two major microservice‑gateway trends, and provides step‑by‑step configuration examples for service discovery, Ingress routing, canary releases, and custom Wasm extensions.
This article explains how to implement progressive delivery in cloud‑native environments using Higress as a unified gateway and Kruise Rollout for automated canary and A/B testing, providing step‑by‑step configurations, code examples, and practical deployment workflows to ensure zero‑downtime releases.
This article walks through building, compiling, containerizing, and deploying a simple mock‑response Wasm plugin for Higress on a Kubernetes cluster, explaining the code structure, configuration, plugin lifecycle, and the three revolutionary features of Wasm‑based gateway extensions.
