Tagged articles

LLM routing

5 articles · Page 1 of 1

Aug 12, 2026 · Artificial Intelligence

Practical Multi‑Model Routing with Embabel: Mixing DeepSeek and Claude

The article explains why a single LLM cannot satisfy all stages of an AI pipeline, introduces Embabel's declarative routing that separates concerns across four layers, shows how a four‑dimensional decision matrix assigns cheap or best models to each step, and presents benchmark results demonstrating up to 70% cost reduction while retaining 95% of the quality of an all‑Claude solution.

ClaudeDeepSeekEmbabel

0 likes · 16 min read

Practical Multi‑Model Routing with Embabel: Mixing DeepSeek and Claude

ThinkingAgent

Jul 5, 2026 · Artificial Intelligence

Building L1 AI Infra: Model Gateways, Smart Routing, and High‑Performance Inference Engines

The article presents a comprehensive, production‑ready guide for the L1 layer of AI infrastructure, detailing how model gateways unify calls, intelligent routing selects the optimal model, inference engines maximize GPU throughput, and quantization and KV‑Cache techniques dramatically cut costs while maintaining performance.

AI InfrastructureKV CacheLLM routing

0 likes · 25 min read

Building L1 AI Infra: Model Gateways, Smart Routing, and High‑Performance Inference Engines

AI Engineering

Jun 29, 2026 · Artificial Intelligence

How Coinbase Halved AI Costs While Token Usage Continued to Surge

In June, Coinbase CEO Brian Armstrong revealed an internal AI cost‑optimization program that cut the company's AI dollar spend by almost 50% while token consumption kept growing exponentially, achieved through five concrete measures involving model defaults, intelligent routing, cache reuse, context trimming, and transparent usage monitoring.

AI InfrastructureAI cost optimizationCoinbase

0 likes · 9 min read

How Coinbase Halved AI Costs While Token Usage Continued to Surge

James' Growth Diary

May 15, 2026 · Artificial Intelligence

Five Intent Recognition Designs: From Keyword Matching to Classifier to LLM Self‑Routing – A Decision Tree to Choose the Right One

The article breaks down five production‑grade intent‑recognition designs—keyword matching, regex‑rule engine, embedding classifier, fine‑tuned small model, and zero‑shot LLM routing—provides code snippets, latency and cost benchmarks, decision‑making rules, and shows how a layered architecture can cut API costs from ¥80,000 to ¥3,000 while keeping accuracy above 90%.

LLM routingembedding classifierfine‑tune model

0 likes · 16 min read

Five Intent Recognition Designs: From Keyword Matching to Classifier to LLM Self‑Routing – A Decision Tree to Choose the Right One

Efficient Ops

Mar 23, 2026 · Artificial Intelligence

7 Multi‑Agent Design Patterns Every AI Engineer Should Know

This article explains the seven core multi‑agent design patterns—workflow, routing, parallel, loop, aggregation, network, and hierarchical—detailing their mechanics, use cases, implementation tips, and why modern agent frameworks are essential for dynamic, cross‑system AI applications.

LLM routingMulti-Agent Systemsagent frameworks

0 likes · 12 min read

7 Multi‑Agent Design Patterns Every AI Engineer Should Know