Tagged articles
Cache Hit Rate
10 articles · Page 1 of 1
This article explores Caffeine's W-TinyLFU eviction algorithm, five-step hit-rate engineering methodology, and a real-world Spring Boot case study that improved cache hit rate from 62% to 98.7% through capacity weighting, refresh-after-write, and hot-key isolation.
AsyncCacheCache EvictionCache Hit Rate
0 likes · 19 min read

The article reviews the developer preview of DeepSeek Harness's official desktop client, highlighting its plugin-based architecture powered by Cordis, deep integration with DeepSeek V4.1 Flash model achieving 99% cache hit rate, and comparative performance against other harness integrations like Pi Agent.
AI agentCache Hit RateDeepSeek
0 likes · 5 min read


ArchitectSep 2, 2026 · Artificial Intelligence
This article analyzes how DeepSeek Harness achieves 99% prompt cache hit rates by enforcing deterministic request assembly, showing that cache hit rates serve as a diagnostic tool for runtime stability rather than just a cost metric.
Agent RuntimeCache Hit RateDeepSeek Harness
0 likes · 25 min read

Claude Code’s prompt‑caching delivers a 92% hit rate, slashing a 50‑round agent session cost from $6 to $1.15 by separating stable prefixes from dynamic tails, using a three‑layer cache architecture, exact token‑sequence matching, and three strict engineering rules that keep the cache hot and reliable.
Agent EngineeringCache Hit RateClaude Code
0 likes · 13 min read


ArchitectApr 21, 2026 · Artificial Intelligence
The article dissects Anthropic's Prompt Caching mechanism, explaining how a 92% cache‑hit rate dramatically reduces pre‑fill costs for long‑running AI agents by structuring stable and dynamic context, managing TTL, look‑back limits, and applying seven practical engineering checks.
AI agentsCache Hit RateClaude
0 likes · 22 min read

A prompt‑caching bug in Claude Code caused users' quota to deplete rapidly, prompting Anthropic to issue an emergency hotfix in version 2.1.62, reset rate limits, and publicly disclose the core architecture and five counter‑intuitive caching rules for building reliable AI agents.
AI agentsAgent ArchitectureAnthropic
0 likes · 12 min read

This article details how Kuaishou dramatically cut storage costs and improved cache efficiency for its core Photo data object by cleaning up redundant JSON fields, applying selective serialization, and performing large‑scale data cleaning, achieving a 25% size reduction, a 2% cache‑hit increase, and multi‑hundred‑TB savings.
Cache Hit RateKuaishouPhoto Object
0 likes · 20 min read

Explore comprehensive caching concepts—including client, server, and CDN caches—along with hit rate metrics, eviction methods, popular strategies like FIFO, LRU, LFU, and design patterns such as Cache‑Aside, Read/Write‑Through, and Write‑Behind, plus essential testing considerations for robust application performance.
Backend PerformanceCache EvictionCache Hit Rate
0 likes · 8 min read

Understanding CPU cache hierarchy, its speed advantages over memory, and the mechanics of cache lines, tags, and offsets reveals why code that maximizes cache hit rates—through sequential data access, branch prediction, and core affinity—can run dramatically faster on modern processors.
CPU cacheCache Hit RateLow-Level Programming
0 likes · 18 min read

This article explains what cache hit rate is, how to monitor it in Memcached and Redis, the key factors that influence it, and practical strategies for architects to improve hit rates and overall application performance.
Cache Hit RateCachingMemcached
0 likes · 7 min read
