Skip to content
Tagged articles

session affinity

5 articles · Page 1 of 1
ThinkInAI Community
ThinkInAI Community
Sep 7, 2026 · Artificial Intelligence

Why Naive LLM Routing Can Cost More Than No Routing — And How to Fix It

The article explains why simple LLM routing — using a classifier to send easy tasks to cheap models and hard tasks to frontier models — often increases costs due to double inference fees, cache misses in agent loops, and brittle routing logic, and presents DigitalOcean's Inference Router with a specialized 1.5B router model, real-time candidate ranking, and session affinity to preserve prefix caching.

DigitalOcean Inference RouterLLM routingRouteLLM
0 likes · 25 min read
Why Naive LLM Routing Can Cost More Than No Routing — And How to Fix It
macrozheng
macrozheng
Oct 31, 2023 · Backend Development

Mastering Nginx Session Affinity: How ip_hash Ensures Sticky Sessions

This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, provides configuration examples, discusses practical pitfalls, and shares real‑world test results.

BackendIP Hashload balancing
0 likes · 9 min read
Mastering Nginx Session Affinity: How ip_hash Ensures Sticky Sessions
Architect
Architect
Sep 30, 2023 · Backend Development

Mastering Nginx ip_hash for Session Affinity and Its Common Pitfalls

This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, demonstrates configuration examples, analyzes behavior when servers go down, and discusses the method's limitations such as load imbalance and dynamic IP issues.

BackendIP HashPerformance
0 likes · 11 min read
Mastering Nginx ip_hash for Session Affinity and Its Common Pitfalls
Wukong Talks Architecture
Wukong Talks Architecture
Sep 26, 2023 · Backend Development

Implementing Session Affinity with Nginx ip_hash Directive

This article explains how to achieve session affinity using Nginx's ip_hash directive, covering the concept, configuration syntax, practical examples, common pitfalls, and test results for handling client IP‑based load balancing across backend servers.

BackendIP Hashload-balancing
0 likes · 9 min read
Implementing Session Affinity with Nginx ip_hash Directive
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 17, 2018 · Backend Development

Session Sharing Solutions in Distributed Environments

This article explains the concept of web sessions, the consistency challenges that arise in distributed server clusters, and evaluates four common solutions—session replication, session affinity, cookie‑based sessions, and dedicated session servers—detailing their use cases, advantages, and drawbacks.

Sessiondistributed systemssession affinity
0 likes · 6 min read
Session Sharing Solutions in Distributed Environments