Tagged articles

LLM routing

4 articles · Page 1 of 1

Jul 5, 2026 · Artificial Intelligence

Building L1 AI Infra: Model Gateways, Smart Routing, and High‑Performance Inference Engines

The article presents a comprehensive, production‑ready guide for the L1 layer of AI infrastructure, detailing how model gateways unify calls, intelligent routing selects the optimal model, inference engines maximize GPU throughput, and quantization and KV‑Cache techniques dramatically cut costs while maintaining performance.

AI infrastructureKV cacheLLM routing

0 likes · 25 min read

Building L1 AI Infra: Model Gateways, Smart Routing, and High‑Performance Inference Engines

AI Engineering

Jun 29, 2026 · Artificial Intelligence

How Coinbase Halved AI Costs While Token Usage Continued to Surge

In June, Coinbase CEO Brian Armstrong revealed an internal AI cost‑optimization program that cut the company's AI dollar spend by almost 50% while token consumption kept growing exponentially, achieved through five concrete measures involving model defaults, intelligent routing, cache reuse, context trimming, and transparent usage monitoring.

AI cost optimizationAI infrastructureCoinbase

0 likes · 9 min read

How Coinbase Halved AI Costs While Token Usage Continued to Surge

James' Growth Diary

May 15, 2026 · Artificial Intelligence

Five Intent Recognition Designs: From Keyword Matching to Classifier to LLM Self‑Routing – A Decision Tree to Choose the Right One

The article breaks down five production‑grade intent‑recognition designs—keyword matching, regex‑rule engine, embedding classifier, fine‑tuned small model, and zero‑shot LLM routing—provides code snippets, latency and cost benchmarks, decision‑making rules, and shows how a layered architecture can cut API costs from ¥80,000 to ¥3,000 while keeping accuracy above 90%.

LLM routingLayered ArchitectureRule Engine

0 likes · 16 min read

Five Intent Recognition Designs: From Keyword Matching to Classifier to LLM Self‑Routing – A Decision Tree to Choose the Right One

Efficient Ops

Mar 23, 2026 · Artificial Intelligence

7 Multi‑Agent Design Patterns Every AI Engineer Should Know

This article explains the seven core multi‑agent design patterns—workflow, routing, parallel, loop, aggregation, network, and hierarchical—detailing their mechanics, use cases, implementation tips, and why modern agent frameworks are essential for dynamic, cross‑system AI applications.

Agent FrameworksDynamic WorkflowLLM routing

0 likes · 12 min read

7 Multi‑Agent Design Patterns Every AI Engineer Should Know