Skip to content
Tagged articles

LLM Gateway

7 articles · Page 1 of 1
Smart Era Software Development
Smart Era Software Development
Nov 6, 2026 · Industry Insights

AI's Scarce Resource Isn't Compute—It's Human Judgment: 12 Agent Engineering Talks

This conference report analyzes 12 talks from AI Engineer Shanghai 2026, revealing that Agent engineering's real challenges are verification, context management, sandbox infrastructure, LLM gateways, data layers, and cost optimization—with human judgment becoming the ultimate scarce resource as automation scales.

Agent EngineeringContext ManagementCost Optimization
0 likes · 54 min read
AI's Scarce Resource Isn't Compute—It's Human Judgment: 12 Agent Engineering Talks
ByteDance SE Lab
ByteDance SE Lab
Oct 23, 2026 · Artificial Intelligence

OpenViking Gateway: Enable Agentic Memory for Any AI Client Without Plugins

The OpenViking Gateway sits between AI clients and model services, automatically retrieving and saving conversation memories so clients like Claude Code, Codex CLI, and Cherry Studio gain persistent memory without plugins—just change Base URL and API Key. It supports local or hosted deployment, provides a Studio UI for configuration, and handles multi-step tool calls transparently.

AI MemoryClaude CodeConfiguration
0 likes · 24 min read
OpenViking Gateway: Enable Agentic Memory for Any AI Client Without Plugins
Old Zhang's AI Learning
Old Zhang's AI Learning
Oct 20, 2026 · Backend Development

Free DeepSeek V4.1 Flash 1017 via Magpie Gateway: One-Click Setup for Any Coding Agent

This tutorial shows how to use the open-source Magpie gateway to aggregate free DeepSeek V4.1 Flash 1017 quotas from OpenCode Zen Free, Tencent Cloud WorkBuddy, and ByteDance Trae CN, enabling zero-cost integration with coding agents like Claude Code, Codex, and DeepSeek Harness via automatic protocol translation and multi-account failover.

API AggregationClaude CodeDeepSeek V4.1 Flash
0 likes · 9 min read
Free DeepSeek V4.1 Flash 1017 via Magpie Gateway: One-Click Setup for Any Coding Agent
Qborfy AI
Qborfy AI
Jul 3, 2026 · Operations

When to Deploy an LLM Gateway? Complete Guide to Architecture, Routing, Cost, and Security

This article analyzes why direct SDK integration breaks down as LLM usage scales, outlines the governance problems a gateway solves—including unified interfaces, smart routing, failover, cost control, security, and observability—compares major open‑source and hosted gateway solutions, and provides step‑by‑step guidance for building, configuring, and operating a production‑grade LLM gateway.

LLM GatewayLiteLLMOne API
0 likes · 23 min read
When to Deploy an LLM Gateway? Complete Guide to Architecture, Routing, Cost, and Security
TechVision Expert Circle
TechVision Expert Circle
Jun 1, 2026 · Cloud Native

Why Stability Is No Longer the CTO’s Top Priority in 2026

In 2026, rapid AI-driven market changes have squeezed the window for “stable iteration,” forcing CTOs to prioritize change‑response capability over traditional high‑availability metrics and to adopt modular, evolving architectures that isolate fast‑moving layers while keeping the infrastructure layer rock‑solid.

AI agentCTOLLM Gateway
0 likes · 12 min read
Why Stability Is No Longer the CTO’s Top Priority in 2026
Linyb Geek Road
Linyb Geek Road
Apr 27, 2026 · Artificial Intelligence

Designing a Production LLM Gateway: Architecture, Routing, and Fallback

The article outlines a production‑grade LLM Gateway architecture divided into ingress, decision, and egress layers, detailing capability‑based, cost‑aware, latency‑aware, and semantic routing, multi‑stage fallback mechanisms, specialized load‑balancing, protocol unification, semantic caching, observability, and evaluates open‑source solutions such as LiteLLM, RouteLLM, and Portkey.

LLM GatewayRoutingfallback
0 likes · 18 min read
Designing a Production LLM Gateway: Architecture, Routing, and Fallback
TonyBai
TonyBai
Feb 18, 2026 · Backend Development

Why We Chose Go Over Python for Building an LLM Gateway

The Bifrost team replaced Python with Go for their LLM gateway, achieving roughly 700× lower latency, 68% less memory usage, and three‑fold higher throughput, and the article explains the performance bottlenecks of Python, Go’s concurrency model, deployment advantages, and future AI infrastructure trends.

AI infrastructureConcurrencyGo
0 likes · 14 min read
Why We Chose Go Over Python for Building an LLM Gateway