Tagged articles
Higress
51 articles · Page 1 of 1
The Higress community's November 2026 report details Higress v2.2.5-2.2.6 hardening access boundaries, AI/MCP request stability, and Helm migration controls, while HiRoute 0.6.0 introduces task-difficulty model routing cutting API costs 92%, a five-tier new-model trial framework, subscription-API fallback, and Omarchy Linux desktop support.
AI gatewayCost OptimizationHiRoute
0 likes · 14 min read

This article dissects the October 2026 LiteLLM 1.107.0 supply chain attack — where stolen GitHub tokens were used to inject malicious build artifacts that stole cloud credentials, SSH keys, and all upstream LLM API keys — and contrasts it with a March 2026 incident. It then demonstrates how Higress confines extension code in a Wasm sandbox with no filesystem, no environment access, no arbitrary network, and no process creation, while enforcing an immutable, digest-pinned release pipeline that prevents floating tags and unreviewed rebuilds.
Credential ManagementEnvoyHigress
0 likes · 33 min read

The article benchmarks Alibaba Cloud AI Gateway Serverless Enterprise Edition against self-hosted Higress, showing up to 97.1% lower gateway processing latency for 1MB requests and 90.2% for 10MB requests at 10-100 concurrency, attributing gains to native Envoy plugin optimizations reducing memory copies and Wasm linear memory limitations, while also comparing operational costs and maintenance trade-offs.
AI gatewayEnvoyHigress
0 likes · 10 min read

HiRoute is a local intelligent routing engine that dynamically assigns tasks between economical and powerful AI models, enables Agent collaboration, preserves KV cache via context holding, and integrates decision models like Jev, demonstrating over 90% cost reduction in real-world engineering tasks while maintaining quality.
Agent RoutingContextHoldCost Optimization
0 likes · 17 min read

This article details a two-level AI inference gateway architecture using Higress with a custom WASM plugin for cross-cluster instance routing and a modified vllm-router for intra-instance replica selection, featuring prefix-cache affinity, multi-signal scoring, RAII-guarded in-flight counting, and a soft_k_choice strategy to balance load and avoid thundering herd.
AI inference gatewayHigressRAII guard
0 likes · 29 min read

The latest MCP update abandons stateful handshakes for a stateless request/response model, easing scaling and load‑balancing, yet community complaints about context crowding and cost persist, revealing that solid architecture design and engineering practice remain the most limited assets in the AI era.
Agent IntegrationArchitecture DesignHTTP
0 likes · 7 min read

A SaaS platform’s consumer count surged from 200 to nearly 20,000, causing open‑source Higress authentication latency to jump 34‑fold and configuration size to balloon 8,457‑fold, while a local comparative test shows the Higress Enterprise Serverless edition maintains sub‑2 ms latency, 100 % success, tiny config footprints, and up to 90 % lower annual costs.
API GatewayCost OptimizationHigress
0 likes · 10 min read

This article presents a complete, production‑grade microservice gateway architecture that combines Nacos for service discovery and configuration with Higress as a cloud‑native data‑plane, covering design principles, dynamic configuration, traffic governance, high‑availability deployment, code examples, and operational best practices.
Configuration ManagementHigh AvailabilityHigress
0 likes · 32 min read

This guide explains the challenges of managing multiple AI models in Dify, introduces the Higress AI Gateway plugin that provides unified model access, governance, and fine‑grained authentication, and walks through two practical demos—an Agent assistant and an image‑generation workflow—showing step‑by‑step configuration and usage.
API GatewayDifyHigress
0 likes · 10 min read

When Kubernetes announced the deprecation of Ingress NGINX in March 2026, the author used OpenClaw AI to automatically analyze the existing 60‑plus Ingress resources, set up a Kind test cluster, generate compatible Higress configurations, create WASM plugins for custom snippets, and produce a verified migration handbook—all in less than two minutes of hands‑on work.
HigressWasm
0 likes · 16 min read

This article explains the challenges of managing hundreds of tools for AI agents, introduces a semantic‑driven tool selection approach via the Higress AI Gateway extension for AgentScope Java, and provides performance data, code examples, and a quick‑start guide for developers.
AI agentsHigressJava
0 likes · 9 min read

This guide details a private MCP gateway architecture using open‑source Higress as the MCP proxy and Nacos as the registry, enabling dynamic tool registration, real‑time Prompt updates, multi‑tenant isolation, and deployment on an air‑gapped Kubernetes cluster without Helm.
DockerHigressKubernetes
0 likes · 20 min read

This guide provides a production‑ready, step‑by‑step solution for deploying a high‑availability microservice gateway using Nacos as a service‑registry and configuration center together with Higress as a cloud‑native gateway on Kubernetes, covering architecture, prerequisites, Helm commands, key values.yaml examples, observability, security, backup, upgrade, recovery runbooks, and common troubleshooting.
GatewayHelmHigress
0 likes · 15 min read

The article explains how the SOFA AI Gateway, built on the open‑source Higress kernel, evolves traditional API gateways into specialized AI gateways by adding intelligent routing, model proxy, agent proxy, and MCP market features to meet the unique latency, resource, and security demands of AI workloads.
AI gatewayHigressMCP
0 likes · 12 min read

Alibaba Cloud unveiled a fully open‑source AI middleware suite—including AgentScope‑Java, AI‑MQ (RocketMQ), Higress gateway, Nacos registration/configuration, and AI observability—to enable enterprise‑grade, multi‑Agent AI applications, addressing integration, scalability, and reliability challenges highlighted by recent Gartner forecasts.
AI agentsAI middlewareAgentScope
0 likes · 18 min read

Ctrip’s R&D team built an AI gateway using Higress to unify access to diverse large‑model services, addressing authentication, traffic control, fault tolerance, monitoring, and integration with internal MCP platforms, while sharing practical lessons and future plans.
HigressMCP integrationobservability
0 likes · 14 min read

The article explains how to replace manual MCP Server development with Higress AI Gateway's API‑to‑MCP feature, showing step‑by‑step Docker setup, configuration of a simple SpringBoot service, MCP tool definition, request‑template options, and the resulting zero‑code deployment for AI agents.
AI gatewayAPI-to-MCPConfiguration
0 likes · 13 min read

This article compares OpenRouter and Higress as emerging AI Gateways, examining their origins, target users, feature sets, deployment models, and pricing structures to show how the traditional gateway concept is being reshaped for AI‑driven cloud‑native applications.
API ManagementHigressOpenRouter
0 likes · 11 min read

This tutorial walks through deploying vLLM inference services on a GPU‑enabled Kubernetes cluster using llmaz, configuring Higress as an AI gateway for traffic control, observability, and fallback model switching, and demonstrates end‑to‑end request testing.
Higressfallbackllmaz
0 likes · 15 min read

This article reviews a recent cloud‑native event, explains how Nacos 3.0 upgrades its architecture, introduces the MCP Registry for AI Agent development, and details zero‑trust security measures, while also showing integration patterns with Spring AI Alibaba and Higress for enterprise AI solutions.
HigressMCP RegistryNacos
0 likes · 12 min read

This article explains how Alibaba engineers transformed millions of HSF microservices into MCP servers without code changes by leveraging the Higress AI gateway, detailing the ecosystem components, step‑by‑step migration process, challenges of rapid MCP evolution, and strategic insights for AI infrastructure teams.
AI InfraHSFHigress
0 likes · 8 min read

This tutorial walks through building a Retrieval‑Augmented Generation (RAG) system by combining LangChain for document processing, Elasticsearch’s vector store with the ELSER v2 model for semantic search, and Higress as a cloud‑native AI gateway, complete with deployment scripts, code examples, and query testing.
AIHigressLangChain
0 likes · 15 min read

This article explains how Alibaba engineers use the Higress AI gateway to offload MCP protocol and transform large‑scale HSF RPC services into MCP servers without modifying application code, covering challenges, required components, step‑by‑step migration, and practical insights for AI‑native infrastructure.
AI gatewayHSFHigress
0 likes · 9 min read

This guide explains how to convert legacy OpenAPI schemas into Model Context Protocol (MCP) configurations, route them through the Higress cloud‑native gateway, set up dual authentication, and finally expose the MCP tools to AI platforms such as Dify, enabling seamless AI‑driven access to both local and internet data sources.
HigressMCPOpenAPI
0 likes · 10 min read

The article explains how Nacos, acting as an MCP Registry, can transform existing service APIs into MCP‑compatible interfaces without code changes, detailing the integration with Higress, the underlying tool/list exposure, protocol conversion, deployment steps, and a weather‑query demo that showcases the end‑to‑end workflow.
AIHigressMCP
0 likes · 17 min read

Learn how to deploy the new QwQ‑32B inference model alongside DeepSeek‑R1 using the Higress AI gateway, covering environment setup, model configuration, routing, token‑level rate limiting, content safety, semantic caching, and advanced features like automatic fallback and internet‑search integration.
DeepSeekHigressLLM integration
0 likes · 16 min read

This guide shows how open‑source LLMs like DeepSeek can power cost‑effective intelligent Q&A services, and how the cloud‑native Higress API gateway adds real‑time web search, routing, security, and observability to create a production‑grade solution in just a few steps.
DeepSeekHigressLLM
0 likes · 6 min read

This guide walks through the recent DeepSeek R1 and Qwen2.5 releases, explains why running LLMs on a PC or phone saves compute and token costs, shows step‑by‑step installation of Ollama, building a Spring AI Alibaba chat app, and scaling the solution with the Higress cloud‑native API gateway for production use.
DeepSeekHigressLLM
0 likes · 11 min read

This guide explains how to install the Higress AI gateway, configure provider API keys, set up gray‑release routing between OpenAI and DeepSeek, use a Python client to call DeepSeek, and enable content security and observability features for safe, cost‑effective large‑model deployments.
AI gatewayDeepSeekHigress
0 likes · 7 min read

Facing thousands of heterogeneous gateway configurations across multiple tech stacks, a Chinese cloud‑native platform consolidated its gateway layer by adopting Higress, Istio CRD, and APISIX, introducing a two‑tier rule model and automated migration tools that cut maintenance effort by 90% while preserving service continuity.
APISIXConfiguration ManagementGateway
0 likes · 14 min read

This article compares Kong, Gloo, and Higress on their AI‑related extensions—covering tech stacks, logging, proxy normalization, API‑key handling, caching, request/response rewriting, and RAG support—to help developers choose the most suitable gateway for emerging LLM workloads.
AI integrationAPI GatewayGloo
0 likes · 7 min read

This tutorial walks through setting up a local k3d cluster, installing Higress, and using its AI plugins—including AI Proxy, AI JSON formatter, AI Agent, and AI Statistics—to integrate and observe Alibaba Cloud's Qwen large language models across various use cases such as weather and flight queries.
AI gatewayAI pluginsHigress
0 likes · 30 min read


ArchitectSep 6, 2024 · Artificial Intelligence
This article explains Prompt Engineering, introduces the AI Gateway concept, and demonstrates how to integrate a Geo‑IP plugin with an AI prompt‑modifying plugin in Higress using Go and Wasm, providing configuration examples, implementation details, and sample request‑response scenarios.
AIGeo-IPHigress
0 likes · 11 min read

This article explains the AI Agent concept, introduces the AI Gateway plugin architecture, walks through zero‑code deployment of an AI Agent using Higress with AMap and Seniverse services, and details the ReAct‑based reasoning and tool‑calling implementation with code examples and workflow diagrams.
AI agentAPI GatewayHigress
0 likes · 16 min read

The author recounts how a university student discovered open‑source, joined the 2024 Tianchi Cloud Native Programming Challenge, used the AI assistant Tongyi Lingma to master GitHub Actions, built and published a Wasm plugin for Alibaba's Higress gateway, and successfully merged a PR after extensive testing and community feedback.
AI code assistantCI/CDGitHub Actions
0 likes · 7 min read

This guide explains how to set up a Higress gateway, compile a WebAssembly AI cache plugin, integrate Redis and DashVector for semantic caching of large‑model requests, and provides complete configuration and code examples for end‑to‑end deployment.
AI CacheHigressRedis
0 likes · 16 min read

This guide shows how to use free AI translation tools—Immersive Translate and OpenAI Translator—together with the Higress cloud‑native AI‑proxy plugin, configuring Docker, model mappings, and custom dictionaries to efficiently translate computer‑science textbooks like Rust and Crafting Interpreters, while comparing machine and human translations.
AI translationDockerHigress
0 likes · 11 min read

This article walks through setting up a cloud‑native test environment using the open‑source NextChat UI and Higress API gateway to let Qwen‑2.5 masquerade as GPT‑4o, enabling a side‑by‑side comparison of their responses while showcasing Higress’s streaming, hot‑update, and security features for AI workloads.
AI gatewayDockerGPT-4o
0 likes · 8 min read

The article details Higress's migration of its Wasm plugin runtime from V8 to the WebAssembly Micro Runtime (WAMR), showing up to 50% average performance gains and up to double speed for complex plugins, while outlining technical reasons, benchmark results, and migration steps.
AOTBackendHigress
0 likes · 10 min read

Sealos public cloud faced massive multi‑tenant Ingress demands, security concerns, and performance bottlenecks, leading the team to systematically test Nginx, Envoy, APISIX, Cilium, Envoy Gateway, and finally adopt Higress for its stability, fast route activation, and low resource footprint.
EnvoyHigressIngress
0 likes · 10 min read

This article details how a data‑compliance company evaluated several cloud‑native API gateways, selected Higress for its Kubernetes‑native architecture, built custom Wasm plugins, leveraged HTTP‑to‑Dubbo conversion, migrated from Nginx Ingress, and achieved higher performance and operational simplicity.
API GatewayHigressKubernetes
0 likes · 13 min read

This article reviews how Spring Cloud Gateway modifies HTTP requests/responses with built‑in filters, introduces the Higress cloud‑native gateway’s Transformer plugin as a higher‑performance alternative, compares their CPU and memory usage, and provides step‑by‑step deployment and configuration instructions.
HigressSpring Cloud GatewayTransformer Plugin
0 likes · 12 min read

Meiqia, a global intelligent cloud‑customer‑service provider, replaced a tangled multi‑middleware routing stack with a unified Higress gateway, achieving hot‑reloadable routing, WebSocket stability, multi‑cloud deployment, and a clear control‑plane/data‑plane separation that dramatically reduced costs and operational complexity.
API GatewayDevOpsHigress
0 likes · 10 min read

This guide explains how the cloud‑native Higress gateway can lower the expense of using AI large models by centralising API keys, applying rate‑limiting, request filtering, and usage monitoring, and demonstrates a complete OpenAI integration using a WASM plugin with code samples and configuration details.
AIAPI GatewayHigress
0 likes · 13 min read

This guide explains what Higress is, compares it with traditional gateways, and provides step‑by‑step instructions—including code snippets—to deploy Higress 1.1 as a standalone, non‑Kubernetes cloud‑native gateway, configure routes, and test migration from Spring Cloud Gateway for microservice applications.
Cloud Native GatewayHigressKubernetes
0 likes · 6 min read

This guide explains how to adopt Higress, a high‑performance C++‑based cloud‑native gateway, to replace traditional Java gateways in Spring Cloud ecosystems and demonstrates blue‑green, canary, and A/B testing deployments on Kubernetes using Nacos for service discovery.
A/B testingHigressKubernetes
0 likes · 15 min read

This article explains how Higress replaces Nginx Ingress, Spring Cloud Gateway, Kong, and Istio Ingress Gateway with a single, high‑performance, cloud‑native ingress that reduces maintenance cost, improves traffic management, and integrates seamlessly with Kubernetes and service‑mesh APIs.
API GatewayHigressIngress
0 likes · 11 min read

This step‑by‑step guide shows how to configure an Alibaba Cloud ACK cluster, install the Higress cloud‑native gateway with Helm, enable Prometheus monitoring via ARMS, and activate the built‑in WAF plugin to block a simulated SQL‑injection request, complete with screenshots and commands.
HigressIngressKubernetes
0 likes · 6 min read

This article explains how the open‑source Higress gateway integrates with Nacos, outlines two major microservice‑gateway trends, and provides step‑by‑step configuration examples for service discovery, Ingress routing, canary releases, and custom Wasm extensions.
Cloud Native GatewayHigressKubernetes
0 likes · 13 min read

This article explains how to implement progressive delivery in cloud‑native environments using Higress as a unified gateway and Kruise Rollout for automated canary and A/B testing, providing step‑by‑step configurations, code examples, and practical deployment workflows to ensure zero‑downtime releases.
HigressKruise Rolloutcloud-native
0 likes · 14 min read

This article walks through building, compiling, containerizing, and deploying a simple mock‑response Wasm plugin for Higress on a Kubernetes cluster, explaining the code structure, configuration, plugin lifecycle, and the three revolutionary features of Wasm‑based gateway extensions.
GoHigressIngress
0 likes · 13 min read
