BestHub
Sign in
Tagged articles

AI Gateway

24 articles · Page 1 of 1
Alibaba Cloud Native
Alibaba Cloud Native
Aug 13, 2026 · Artificial Intelligence

Which Model Should Handle Your Request? Alibaba Cloud AI Gateway Intelligent Routing Goes Live

As the number of LLMs grows, developers face the dilemma of selecting the right model for each request; Alibaba Cloud’s AI Gateway introduces intelligent routing that evaluates model capabilities, cost, speed, and task suitability, making a single, optimal decision per request while preserving context in multi‑turn and Agent workflows.

AI GatewayAlibaba CloudCloud Native
0 likes · 11 min read
Which Model Should Handle Your Request? Alibaba Cloud AI Gateway Intelligent Routing Goes Live
Alibaba Cloud Native
Alibaba Cloud Native
Jul 29, 2026 · Artificial Intelligence

Launching a Multi‑Agent AI Platform in One Week with Alibaba Cloud AgentTeams and AI Gateway

In just one week, XinYongZhongHe partnered with Alibaba Cloud to build an enterprise‑grade multi‑agent AI platform using AgentTeams and the AI Gateway, enabling coordinated agents, unified model governance, secure access, cost control, and a range of internal services that move AI from simple Q&A to task execution.

AI GatewayAI governanceAgentTeams
0 likes · 10 min read
Launching a Multi‑Agent AI Platform in One Week with Alibaba Cloud AgentTeams and AI Gateway
AI Architecture Path
AI Architecture Path
Jul 5, 2026 · Artificial Intelligence

How to Get 1.6 B Free Tokens Monthly with OmniRoute: A Local AI Gateway that Replaces GPT/Claude APIs

OmniRoute v3.8.43 is an MIT‑licensed, locally deployed AI gateway that aggregates 231 model providers and over 50 free channels, delivering roughly 1.6 billion free tokens per month, applying up to 95% token compression, auto‑fallback routing, and multi‑IDE support, while offering detailed deployment guides and risk warnings.

AI GatewayIDE integrationOmniRoute
0 likes · 16 min read
How to Get 1.6 B Free Tokens Monthly with OmniRoute: A Local AI Gateway that Replaces GPT/Claude APIs
Tencent Cloud Middleware
Tencent Cloud Middleware
Jun 17, 2026 · Artificial Intelligence

How AI Gateway’s Intelligent Routing Ensures Stable Large‑Model Production

The article explains how Tencent Cloud’s AI Gateway uses intelligent routing and a three‑layer high‑availability design to distribute traffic, handle model failures, and support multi‑model, multi‑vendor, and compliance‑driven scenarios, ensuring large‑model services remain stable and continuously available in production.

AI GatewayIntelligent RoutingModel Failover
0 likes · 20 min read
How AI Gateway’s Intelligent Routing Ensures Stable Large‑Model Production
TechVision Expert Circle
TechVision Expert Circle
May 26, 2026 · Industry Insights

Why Your System Isn’t Truly Yours: The Harsh Reality CTOs Must Face

The article reveals that most so‑called “self‑built” enterprise systems are merely assemblies of third‑party components—databases, cloud services, SaaS tools—and explains how license changes, API disruptions, and vendor lock‑in can erode a CTO’s control, then outlines practical steps for regaining architectural decision‑making authority by 2026.

AI GatewayCTODependency Management
0 likes · 13 min read
Why Your System Isn’t Truly Yours: The Harsh Reality CTOs Must Face
TechVision Expert Circle
TechVision Expert Circle
May 12, 2026 · R&D Management

Why CTOs Should Adopt VC Thinking for Tech Stack Decisions

The article argues that technology selection is an investment decision, illustrating costly tech‑worship failures, outlining VC‑style evaluation criteria, and presenting a five‑step framework plus 2026 tech recommendations to help CTOs make financially disciplined choices.

AI GatewayVC mindsetcost modeling
0 likes · 12 min read
Why CTOs Should Adopt VC Thinking for Tech Stack Decisions
AI Explorer
AI Explorer
Mar 26, 2026 · Artificial Intelligence

LiteLLM: A Unified Gateway for Over 100 LLM APIs

LiteLLM provides a single Python SDK and proxy server that let developers call more than 100 large‑language‑model APIs with a uniform OpenAI‑style interface, handling cost tracking, load balancing, rate limiting, and detailed logging to simplify multi‑model experimentation and production deployments.

AI GatewayLLM IntegrationLiteLLM
0 likes · 6 min read
LiteLLM: A Unified Gateway for Over 100 LLM APIs
Su San Talks Tech
Su San Talks Tech
Feb 28, 2026 · Artificial Intelligence

How to Install and Configure OpenClaw: A Self‑Hosted AI Assistant Gateway

This guide walks you through the overview, system requirements, step‑by‑step installation, custom model configuration, verification methods, core file locations, environment variables, hot‑reload options, common commands, and troubleshooting for OpenClaw, a self‑hosted AI assistant gateway.

AI GatewayCLIConfiguration
0 likes · 10 min read
How to Install and Configure OpenClaw: A Self‑Hosted AI Assistant Gateway
Alibaba Cloud Native
Alibaba Cloud Native
Nov 25, 2025 · Artificial Intelligence

AI‑Native Architecture Insights: Highlights from AgentX 2025 SECon

The AgentX 2025 SECon AI‑native application track, co‑hosted by Alibaba Cloud and the Institute of Information, delivered deep technical insights on AI‑native architecture, the AgentScope 1.0 framework, AI gateway capabilities, and observability‑driven reliability for long‑cycle agents, summarised here for practitioners.

AI GatewayAI NativeAgentScope
0 likes · 7 min read
AI‑Native Architecture Insights: Highlights from AgentX 2025 SECon
Alibaba Cloud Native
Alibaba Cloud Native
Oct 28, 2025 · Artificial Intelligence

How SOFA AI Gateway Transforms Cloud‑Native AI Service Management

The article explains how the SOFA AI Gateway, built on the open‑source Higress kernel, evolves traditional API gateways into specialized AI gateways by adding intelligent routing, model proxy, agent proxy, and MCP market features to meet the unique latency, resource, and security demands of AI workloads.

AI GatewayCloud NativeHigress
0 likes · 12 min read
How SOFA AI Gateway Transforms Cloud‑Native AI Service Management
Ubiquitous Tech
Ubiquitous Tech
Aug 30, 2025 · Cloud Native

How Higress AI Gateway Turns Business APIs into an MCP Server

The article explains how to replace manual MCP Server development with Higress AI Gateway's API‑to‑MCP feature, showing step‑by‑step Docker setup, configuration of a simple SpringBoot service, MCP tool definition, request‑template options, and the resulting zero‑code deployment for AI agents.

AI GatewayAPI-to-MCPConfiguration
0 likes · 13 min read
How Higress AI Gateway Turns Business APIs into an MCP Server
Alibaba Cloud Native
Alibaba Cloud Native
Aug 19, 2025 · Artificial Intelligence

Boost Dify AI App Performance with Higress AI Gateway: A Full-Scale High‑Availability Guide

This guide explains why Dify’s system components and model services become performance bottlenecks at scale, and how integrating the Higress AI gateway can provide protocol standardization, observability, security, and stability features to achieve full‑stack high availability for AI applications.

AI GatewayCloud NativeDify
0 likes · 16 min read
Boost Dify AI App Performance with Higress AI Gateway: A Full-Scale High‑Availability Guide
Alibaba Cloud Developer
Alibaba Cloud Developer
May 29, 2025 · Cloud Native

API Gateway vs API Management: Evolution, Differences, and AI Gateway Rise

This article traces the evolution of API gateways and API management from early traffic and microservice gateways to cloud-native and AI-focused solutions, compares their core responsibilities, roles, and technical foundations, and outlines how they can be integrated and what future trends, such as AI gateways and MCP servers, may bring to modern software architectures.

AI GatewayAPI GatewayAPI Management
0 likes · 16 min read
API Gateway vs API Management: Evolution, Differences, and AI Gateway Rise
Bilibili Tech
Bilibili Tech
May 9, 2025 · Artificial Intelligence

How an AI Gateway Scales LLM Services: Architecture, Auth, Quotas, and Load Balancing

This article explains the design of an AI gateway that centralizes LLM access, detailing its background, overall architecture, authentication, quota management, multi‑model routing, load‑balancing strategies, multi‑tenant isolation, observability features, and the supported API protocols for enterprise integration.

AI GatewayAPI GatewayLLM
0 likes · 17 min read
How an AI Gateway Scales LLM Services: Architecture, Auth, Quotas, and Load Balancing
Alibaba Cloud Developer
Alibaba Cloud Developer
May 9, 2025 · Backend Development

How to Convert Alibaba HSF Services to MCP Servers Without Code Changes

This article explains how Alibaba engineers use the Higress AI gateway to offload MCP protocol and transform large‑scale HSF RPC services into MCP servers without modifying application code, covering challenges, required components, step‑by‑step migration, and practical insights for AI‑native infrastructure.

AI GatewayHSFHigress
0 likes · 9 min read
How to Convert Alibaba HSF Services to MCP Servers Without Code Changes
Alibaba Cloud Observability
Alibaba Cloud Observability
Mar 17, 2025 · Cloud Native

How to Master LLM Observability in Cloud‑Native Environments

This article explains the unique observability challenges of large language model (LLM) applications, outlines essential performance, cost, and safety metrics, and presents a comprehensive cloud‑native solution—including trace, metric, and log collection, domain‑specific dashboards, and step‑by‑step integration with Alibaba Cloud's Python Agent—to ensure reliable, efficient LLM deployments.

AI GatewayCloud NativeLLM observability
0 likes · 18 min read
How to Master LLM Observability in Cloud‑Native Environments
Alibaba Cloud Native
Alibaba Cloud Native
Mar 7, 2025 · Artificial Intelligence

8 Real-World AI Gateway Use Cases Every Enterprise Should Know

This article outlines eight practical AI gateway scenarios—from multi‑model services and consumer authentication to token rate limiting, content safety, semantic caching, and observability—explaining the business needs behind each and how Alibaba Cloud's cloud‑native API gateway provides concrete technical solutions.

AI GatewayCloud NativeModel Management
0 likes · 15 min read
8 Real-World AI Gateway Use Cases Every Enterprise Should Know
Alibaba Cloud Native
Alibaba Cloud Native
Jan 22, 2025 · Cloud Native

Seamlessly Migrate from OpenAI to DeepSeek with Higress AI Gateway

This guide explains how to install the Higress AI gateway, configure provider API keys, set up gray‑release routing between OpenAI and DeepSeek, use a Python client to call DeepSeek, and enable content security and observability features for safe, cost‑effective large‑model deployments.

AI GatewayDeepSeekHigress
0 likes · 7 min read
Seamlessly Migrate from OpenAI to DeepSeek with Higress AI Gateway
Ops Development Stories
Ops Development Stories
Sep 19, 2024 · Artificial Intelligence

How to Connect Qwen LLMs with Higress AI Gateway: A Hands‑On Guide

This tutorial walks through setting up a local k3d cluster, installing Higress, and using its AI plugins—including AI Proxy, AI JSON formatter, AI Agent, and AI Statistics—to integrate and observe Alibaba Cloud's Qwen large language models across various use cases such as weather and flight queries.

AI GatewayAI pluginsHigress
0 likes · 30 min read
How to Connect Qwen LLMs with Higress AI Gateway: A Hands‑On Guide
21CTO
21CTO
Jun 7, 2024 · Artificial Intelligence

Why AI Gateways Are the Next Evolution of API Gateways

AI gateways have emerged as essential infrastructure for modern AI applications, offering specialized security, load balancing, cost management, and observability that go beyond traditional API gateways, and understanding their differences and deployment considerations is crucial for developers and ops teams.

AI GatewayAI infrastructureAPI Gateway
0 likes · 10 min read
Why AI Gateways Are the Next Evolution of API Gateways
Alibaba Cloud Native
Alibaba Cloud Native
May 15, 2024 · Cloud Native

Build a Cloud‑Native Playground to Compare GPT‑4o and Qwen‑2.5 with NextChat and Higress

This article walks through setting up a cloud‑native test environment using the open‑source NextChat UI and Higress API gateway to let Qwen‑2.5 masquerade as GPT‑4o, enabling a side‑by‑side comparison of their responses while showcasing Higress’s streaming, hot‑update, and security features for AI workloads.

AI GatewayDockerGPT-4o
0 likes · 8 min read
Build a Cloud‑Native Playground to Compare GPT‑4o and Qwen‑2.5 with NextChat and Higress