BestHub
Sign in
Tagged articles

Prompt Caching

37 articles · Page 1 of 1
PaperAgent
PaperAgent
Jul 25, 2026 · Artificial Intelligence

Inside Claude Code and Codex: Dissecting the Six Core Components of a Coding Agent

The article breaks down the architecture of coding agents like Claude Code and Codex into six essential components—Live Repo Context, Prompt Cache, Tools, Context Management, Session Memory, and Bounded Subagents—explaining how each layer of the Agent Harness transforms similar LLMs into markedly different, more capable systems.

Agent HarnessCoding AgentContext Management
0 likes · 12 min read
Inside Claude Code and Codex: Dissecting the Six Core Components of a Coding Agent
Java Tech Enthusiast
Java Tech Enthusiast
Jul 13, 2026 · Artificial Intelligence

Can GPT‑5.6 Beat Claude 5 and Grok 4.5? A Live Head‑to‑Head Test

The article benchmarks OpenAI's newly released GPT‑5.6 (Sol, Terra, Luna) against Anthropic's Claude Fable 5 and SpaceXAI's Grok 4.5 by having each model independently develop a football web game in Cursor, comparing pricing, benchmark scores, development speed, bug‑fix cycles, code size, UI quality, and overall suitability for different tasks.

AI code generationClaude Fable 5Cursor
0 likes · 15 min read
Can GPT‑5.6 Beat Claude 5 and Grok 4.5? A Live Head‑to‑Head Test
Top Architecture Tech Stack
Top Architecture Tech Stack
Jul 10, 2026 · Artificial Intelligence

GPT-5.6 Released July 9: How to Use ChatGPT, Codex, API and Why It May Be Hidden

The article explains that GPT‑5.6 entered limited preview on June 26 and began a broader rollout on July 9, introduces the three model variants (Sol, Terra, Luna) with distinct capabilities and pricing, describes how to access the models via ChatGPT, Codex and the OpenAI API, and details why some users may not see the new models yet.

AI model rolloutChatGPTCodex
0 likes · 17 min read
GPT-5.6 Released July 9: How to Use ChatGPT, Codex, API and Why It May Be Hidden
AI Large Model Application Practice
AI Large Model Application Practice
Jul 6, 2026 · Artificial Intelligence

20 Must‑Know Agent Engineering Concepts for 2026 (Runtime Mechanisms)

This article breaks down the 20 core concepts essential for building enterprise agents in 2026, covering the agent definition, harness framework, execution models, loop engineering, state and context management, prompt caching, ontology, and live retrieval, each illustrated with practical examples and engineering tips.

AgentExecution ModelHarness
0 likes · 17 min read
20 Must‑Know Agent Engineering Concepts for 2026 (Runtime Mechanisms)
Machine Heart
Machine Heart
Jun 27, 2026 · Artificial Intelligence

GPT-5.6 Launch: Sol, Terra, Luna Beat Mythos Yet Stay Behind Paywall

OpenAI’s surprise preview of GPT‑5.6 introduces three tiered models—Sol, Terra and Luna—with Sol offering max and ultra modes that deliver top‑tier performance in programming, biology and cybersecurity benchmarks, lower pricing, a new prompt‑cache system, and a restricted rollout amid U.S. regulatory scrutiny.

AI safetyCerebrasGPT-5.6
0 likes · 7 min read
GPT-5.6 Launch: Sol, Terra, Luna Beat Mythos Yet Stay Behind Paywall
Architect's Guide
Architect's Guide
May 28, 2026 · Artificial Intelligence

How Claude Code Prompt Caching Cuts AI Costs by Up to 90% and Boosts Efficiency

Prompt Caching in Anthropic's Claude Code replaces repeated processing of identical prompt prefixes with a prefix‑hash cache, slashing input‑token costs by up to 90%, reducing first‑token latency by 79%, and improving throughput, while preserving model output exactly as if no cache were used.

AI engineeringCache InvalidationCache Metrics
0 likes · 30 min read
How Claude Code Prompt Caching Cuts AI Costs by Up to 90% and Boosts Efficiency
Architect
Architect
May 26, 2026 · Artificial Intelligence

Why Claude’s 17 New Capabilities Matter: Moving Agents from Chat to Real Workflows

Claude’s latest suite of 17 capabilities—Projects, Memory, Artifacts, Chrome, Cowork, Skills, and more—reframes the agent from a simple chat assistant into a workflow component, prompting architects to evaluate context entry, auditable outputs, permission boundaries, repeatable processes, and cost controls before deployment.

AI agentsArtifactsClaude
0 likes · 26 min read
Why Claude’s 17 New Capabilities Matter: Moving Agents from Chat to Real Workflows
AI Step-by-Step
AI Step-by-Step
May 26, 2026 · Artificial Intelligence

How Prompt Caching Works in LLMs and How to Write More Efficient Prompts

The article explains that LLM prompt caching reuses internal KV states rather than full answers, compares provider implementations, quantifies cost and latency savings, and provides concrete guidelines for structuring prompts to maximize cache hits, along with monitoring signals and a practical evaluation checklist.

AI inferenceLLMPrompt Caching
0 likes · 13 min read
How Prompt Caching Works in LLMs and How to Write More Efficient Prompts
AI Engineering
AI Engineering
May 19, 2026 · Artificial Intelligence

Claude Adds Prompt Cache Diagnostics to Pinpoint Token Cost Spikes

Claude's new Prompt Cache Diagnostics feature lets developers see exactly why a cache miss occurs and how many tokens were wasted, providing beta‑header usage, Python examples, supported miss reasons, limitations, and privacy guarantees to help optimize token costs.

AI DevelopmentAPI DiagnosticsAnthropic
0 likes · 9 min read
Claude Adds Prompt Cache Diagnostics to Pinpoint Token Cost Spikes
SuanNi
SuanNi
May 4, 2026 · Artificial Intelligence

Why Prompt Caching Is Everything for Claude Code

The article explains how Claude Code achieves extreme speed and low cost by building its architecture around a static prompt prefix, detailing the mechanics of prompt caching, safe model and tool switching, plan‑mode tooling, deferred loading, and cache‑safe context compression.

AI agentsAnthropicClaude Code
0 likes · 10 min read
Why Prompt Caching Is Everything for Claude Code
AI Tech Publishing
AI Tech Publishing
May 1, 2026 · Artificial Intelligence

5 Counterintuitive Design Principles for Prompt Caching in Claude Code

The article details five counterintuitive design principles for Claude Code's prompt caching—optimizing prompt layout, using message‑based updates, never switching models or tools mid‑conversation, safely compressing context, and monitoring cache health—backed by concrete examples and up to 90% cost savings.

AI engineeringClaude CodeContext Compression
0 likes · 10 min read
5 Counterintuitive Design Principles for Prompt Caching in Claude Code
Architect
Architect
Apr 30, 2026 · Artificial Intelligence

How Hermes Agent’s Memory System Fixes the Layered Misconception in OpenClaw

The article dissects Hermes Agent’s four‑layer memory architecture—hot memory, session search, skills, and optional Honcho—explaining how each layer’s cost and purpose differ from OpenClaw’s approach, and why careful placement of facts, history, procedures, and user models leads to more stable, cache‑aware agents.

Agent MemoryContext ManagementHermes Agent
0 likes · 25 min read
How Hermes Agent’s Memory System Fixes the Layered Misconception in OpenClaw
Architect
Architect
Apr 24, 2026 · Artificial Intelligence

How Hermes Agents Self‑Evolve: What Should Remain After a Task?

The article examines Hermes Agent’s three‑layer memory system—facts, session retrieval, and process assets—detailing how Skills are created, stored, patched, and secured at runtime, and argues that reliable self‑evolution requires disciplined versioning, evaluation, and access controls rather than unchecked automatic skill generation.

AI skillsHermes AgentProcess Assets
0 likes · 21 min read
How Hermes Agents Self‑Evolve: What Should Remain After a Task?
AI Architecture Hub
AI Architecture Hub
Apr 24, 2026 · Artificial Intelligence

How Claude Code Achieves a 92% Prompt Caching Hit Rate with Three Unbreakable Engineering Rules

Claude Code’s prompt‑caching delivers a 92% hit rate, slashing a 50‑round agent session cost from $6 to $1.15 by separating stable prefixes from dynamic tails, using a three‑layer cache architecture, exact token‑sequence matching, and three strict engineering rules that keep the cache hot and reliable.

Cache Hit RateClaude CodeLLM
0 likes · 13 min read
How Claude Code Achieves a 92% Prompt Caching Hit Rate with Three Unbreakable Engineering Rules
AI Architecture Hub
AI Architecture Hub
Apr 23, 2026 · Artificial Intelligence

Why Prompt Caching Is Critical: Lessons from Building Claude Code

Prompt caching, a prefix‑matching technique that reuses prior LLM interactions, proved essential for Claude Code’s low latency and cost, and the article details counter‑intuitive practices such as arranging static prompts first, updating info via messages, avoiding mid‑session model or tool changes, and ensuring cache‑safe context forks.

AI engineeringClaude CodeLLM agents
0 likes · 10 min read
Why Prompt Caching Is Critical: Lessons from Building Claude Code
AI Tech Publishing
AI Tech Publishing
Apr 20, 2026 · Artificial Intelligence

How Claude Code Achieves 92% Prompt Cache Hit Rate and Cuts Costs by 81% – A Deep Dive

This article explains the mechanics of prompt‑caching for large language models, breaks down static versus dynamic context, details KV‑cache operation and its pricing, and shows how Claude Code’s 30‑minute programming session reached a 92% cache hit rate that reduced inference costs by 81%, concluding with three production‑grade design rules.

AI agentsAnthropic APIClaude Code
0 likes · 13 min read
How Claude Code Achieves 92% Prompt Cache Hit Rate and Cuts Costs by 81% – A Deep Dive
Tencent Cloud Developer
Tencent Cloud Developer
Apr 15, 2026 · Artificial Intelligence

How Hermes Agent’s Skills System Enables Self‑Learning AI Agents

This article provides an in‑depth technical analysis of Hermes Agent’s Skills closed‑loop system, detailing its lifecycle from experience extraction and knowledge storage to intelligent retrieval, conditional activation, progressive disclosure, security scanning, and self‑improvement, while comparing it to academic prototypes like Voyager.

AI AgentHermes AgentPrompt Caching
0 likes · 27 min read
How Hermes Agent’s Skills System Enables Self‑Learning AI Agents
Machine Heart
Machine Heart
Apr 13, 2026 · Artificial Intelligence

What’s the Underlying Logic of Coding Agents and Why Do Claude Code Variants Outperform Others?

The article dissects coding agents by outlining their six core components, explaining how an agent harness orchestrates model inference, repository context, prompt caching, tool validation, context compression, structured memory, and bounded sub‑agents, and shows why these architectural choices give Claude Code a performance edge over plain LLMs.

Agent HarnessContext CompressionLLM
0 likes · 22 min read
What’s the Underlying Logic of Coding Agents and Why Do Claude Code Variants Outperform Others?
AI Tech Publishing
AI Tech Publishing
Apr 6, 2026 · Artificial Intelligence

Six Core Components of a Coding Agent Explained with Code

The article systematically breaks down the six essential building blocks of a programming agent—live repository context, prompt shape and cache reuse, structured tool access and validation, context reduction, structured session memory, and bounded sub‑agent delegation—illustrated with a Mini Coding Agent implementation and comparisons to Claude Code, Codex, and OpenClaw.

Coding AgentContext CompressionLLM
0 likes · 15 min read
Six Core Components of a Coding Agent Explained with Code
Machine Heart
Machine Heart
Apr 1, 2026 · Artificial Intelligence

Claude Code Source Leak: Inside the Accidental Open‑Source Release and New Buddy Feature

The accidental exposure of Claude Code’s TypeScript source via an npm source‑map mishap sparked a rapid community deep‑dive that uncovered anti‑distillation safeguards, a hidden Buddy pet, extensive prompt‑caching logic, undercover mode, auto‑compaction thresholds, and broader engineering trade‑offs, while Anthropic and its founder responded to the slip.

AI agentsClaude CodePrompt Caching
0 likes · 20 min read
Claude Code Source Leak: Inside the Accidental Open‑Source Release and New Buddy Feature
Architect
Architect
Mar 18, 2026 · Artificial Intelligence

Why Prompt Caching Is More Than a Cost‑Saving Trick: It Shapes Agent Architecture

The article explains that Prompt Cache is not merely a way to reduce token costs, but a fundamental mechanism that forces developers to redesign the context management of long‑running AI agents, turning caching considerations into core architectural decisions.

Prompt Cachingcontext engineeringlarge language models
0 likes · 25 min read
Why Prompt Caching Is More Than a Cost‑Saving Trick: It Shapes Agent Architecture
DataFunTalk
DataFunTalk
Mar 15, 2026 · Artificial Intelligence

How OpenClaw v2026.3.7 Boosts Enterprise AI Agent Efficiency and Cuts Costs

The OpenClaw v2026.3.7 upgrade introduces webhook compatibility fixes, typing‑feedback support, a 33% prompt‑caching cost reduction, smarter model routing with domestic model integration, and persistent bindings for container deployments, making the platform far more suitable for enterprise AI agent scenarios.

AI agentsContainer DeploymentCost Optimization
0 likes · 10 min read
How OpenClaw v2026.3.7 Boosts Enterprise AI Agent Efficiency and Cuts Costs
Shuge Unlimited
Shuge Unlimited
Mar 14, 2026 · Artificial Intelligence

Free OpenClaw Guide: Building an Automated AI Content Creation Workflow (Worth 5000 ¥)

This step‑by‑step tutorial shows how to install and configure the self‑hosted OpenClaw AI gateway, set up essential skills, connect Feishu, and create two practical workflows—curtain image generation and viral content dissection—while covering API setup, budgeting, troubleshooting, and pricing considerations.

AI WorkflowFeishu botOpenClaw
0 likes · 22 min read
Free OpenClaw Guide: Building an Automated AI Content Creation Workflow (Worth 5000 ¥)
High Availability Architecture
High Availability Architecture
Mar 12, 2026 · Artificial Intelligence

How Claude Code Hits 92% Prompt Cache Rate and Slashes AI Agent Costs by 81%

This article explains the prompt‑caching mechanism used by Claude Code, showing how separating static prefixes from dynamic tails and leveraging KV‑tensor caching reduces the O(n²) complexity of transformer pre‑fill to O(n), achieving a 92% cache hit rate and up to 81% cost savings in long‑running AI agent sessions.

AI agentsClaudeLLM Optimization
0 likes · 12 min read
How Claude Code Hits 92% Prompt Cache Rate and Slashes AI Agent Costs by 81%
Code Mala Tang
Code Mala Tang
Mar 9, 2026 · Artificial Intelligence

How Claude’s New Prompt Caching Cuts Token Costs by 90% for Long‑Running Agents

Claude’s API now automatically caches static parts of prompts—system instructions, tool definitions, and context—so repeated calls reuse these sections at only 10% of the standard token price, dramatically reducing costs for multi‑turn agents, but developers must manage prefixes and avoid cache‑breaking changes.

Claude APILLM engineeringPrompt Caching
0 likes · 15 min read
How Claude’s New Prompt Caching Cuts Token Costs by 90% for Long‑Running Agents
AI Code to Success
AI Code to Success
Mar 1, 2026 · Artificial Intelligence

How Prompt Caching Supercharges Long‑Running AI Agents: 5 Practical Lessons

This article explains how Claude Code’s Prompt Caching technique dramatically reduces latency and cost for long‑running AI agents, and shares five hard‑won engineering practices—including prompt layout, message‑based updates, avoiding mid‑conversation model or tool changes, and safe context forking—to help developers build efficient, cache‑friendly AI applications.

Context ManagementCost OptimizationPrompt Caching
0 likes · 10 min read
How Prompt Caching Supercharges Long‑Running AI Agents: 5 Practical Lessons
AI Waka
AI Waka
Feb 24, 2026 · Artificial Intelligence

How Claude’s New Auto‑Caching Cuts API Token Costs by 90%

By adding a single field to Claude API requests, developers can automatically cache static prompt parts, reducing token billing to just 10% of the original cost and dramatically lowering expenses for multi‑turn AI agents.

AI agentsClaude APIPrompt Caching
0 likes · 13 min read
How Claude’s New Auto‑Caching Cuts API Token Costs by 90%
PaperAgent
PaperAgent
Feb 1, 2026 · Artificial Intelligence

Why Clawdbot Burns Millions of Tokens and How to Slash Its Costs

The article provides a deep technical breakdown of the OpenClaw (formerly Clawdbot) AI agent’s token consumption patterns, identifies four major architectural token‑black‑holes, explains why they are hard to avoid, and offers concrete mitigation strategies such as prompt caching, workflow engines, context compaction, tool pruning, and model routing to dramatically reduce operational costs.

AI agentsPrompt CachingReAct Loop
0 likes · 12 min read
Why Clawdbot Burns Millions of Tokens and How to Slash Its Costs
JavaGuide
JavaGuide
Nov 19, 2025 · Artificial Intelligence

Spring AI 1.1 Released: Explosive New Features for Java AI Development

Spring AI 1.1.0 arrives with a major overhaul, adding out‑of‑the‑box Model Context Protocol support, five‑mode prompt caching that can cut LLM costs by up to 90%, reasoning APIs, recursive advisors, a broadened model ecosystem, enhanced vector‑store and chat‑memory options, and richer observability integrations.

AI integrationJavaMCP
0 likes · 9 min read
Spring AI 1.1 Released: Explosive New Features for Java AI Development