This step‑by‑step guide shows how a complete beginner can install OpenClaw on Windows 10, obtain an Alibaba Cloud Qwen API key, configure the gateway, start the service, and interact with the AI model through the web UI, all within a few hours.
LiteLLM provides a single Python SDK and proxy server that let developers call more than 100 large‑language‑model APIs with a uniform OpenAI‑style interface, handling cost tracking, load balancing, rate limiting, and detailed logging to simplify multi‑model experimentation and production deployments.
This guide walks you through the overview, system requirements, step‑by‑step installation, custom model configuration, verification methods, core file locations, environment variables, hot‑reload options, common commands, and troubleshooting for OpenClaw, a self‑hosted AI assistant gateway.
The AgentX 2025 SECon AI‑native application track, co‑hosted by Alibaba Cloud and the Institute of Information, delivered deep technical insights on AI‑native architecture, the AgentScope 1.0 framework, AI gateway capabilities, and observability‑driven reliability for long‑cycle agents, summarised here for practitioners.
The article explains how the SOFA AI Gateway, built on the open‑source Higress kernel, evolves traditional API gateways into specialized AI gateways by adding intelligent routing, model proxy, agent proxy, and MCP market features to meet the unique latency, resource, and security demands of AI workloads.
This guide explains why Dify’s system components and model services become performance bottlenecks at scale, and how integrating the Higress AI gateway can provide protocol standardization, observability, security, and stability features to achieve full‑stack high availability for AI applications.
This article traces the evolution of API gateways and API management from early traffic and microservice gateways to cloud-native and AI-focused solutions, compares their core responsibilities, roles, and technical foundations, and outlines how they can be integrated and what future trends, such as AI gateways and MCP servers, may bring to modern software architectures.
This article explains the design of an AI gateway that centralizes LLM access, detailing its background, overall architecture, authentication, quota management, multi‑model routing, load‑balancing strategies, multi‑tenant isolation, observability features, and the supported API protocols for enterprise integration.
This article explains how Alibaba engineers use the Higress AI gateway to offload MCP protocol and transform large‑scale HSF RPC services into MCP servers without modifying application code, covering challenges, required components, step‑by‑step migration, and practical insights for AI‑native infrastructure.
This article explains the unique observability challenges of large language model (LLM) applications, outlines essential performance, cost, and safety metrics, and presents a comprehensive cloud‑native solution—including trace, metric, and log collection, domain‑specific dashboards, and step‑by‑step integration with Alibaba Cloud's Python Agent—to ensure reliable, efficient LLM deployments.
This article outlines eight practical AI gateway scenarios—from multi‑model services and consumer authentication to token rate limiting, content safety, semantic caching, and observability—explaining the business needs behind each and how Alibaba Cloud's cloud‑native API gateway provides concrete technical solutions.
This guide explains how to install the Higress AI gateway, configure provider API keys, set up gray‑release routing between OpenAI and DeepSeek, use a Python client to call DeepSeek, and enable content security and observability features for safe, cost‑effective large‑model deployments.
This tutorial walks through setting up a local k3d cluster, installing Higress, and using its AI plugins—including AI Proxy, AI JSON formatter, AI Agent, and AI Statistics—to integrate and observe Alibaba Cloud's Qwen large language models across various use cases such as weather and flight queries.
This article analyzes the emerging AI Gateway market, compares major products such as Kong, Gloo, Higress, Portkey, and OneAPI, and provides a detailed technical review of Cloudflare AI Gateway’s architecture, capabilities, advantages, limitations, and practical usage for LLM integration.
AI gateways have emerged as essential infrastructure for modern AI applications, offering specialized security, load balancing, cost management, and observability that go beyond traditional API gateways, and understanding their differences and deployment considerations is crucial for developers and ops teams.
This article walks through setting up a cloud‑native test environment using the open‑source NextChat UI and Higress API gateway to let Qwen‑2.5 masquerade as GPT‑4o, enabling a side‑by‑side comparison of their responses while showcasing Higress’s streaming, hot‑update, and security features for AI workloads.
