Tagged articles

Semantic Caching

3 articles · Page 1 of 1

Jun 17, 2026 · Artificial Intelligence

RedParrot’s Semantic Cache Accelerates Enterprise NL‑to‑DSL Analytics by 3.6×

RedParrot introduces a query‑semantic‑caching framework that compresses the multi‑stage LLM NL‑to‑DSL workflow into a short‑chain process, achieving an average 3.6× inference speedup and an 8.26% accuracy gain on real‑world business data while also delivering strong generalization on open NL‑to‑DSL benchmarks.

LLMNL-to-DSLPerformance Acceleration

0 likes · 19 min read

RedParrot’s Semantic Cache Accelerates Enterprise NL‑to‑DSL Analytics by 3.6×

Machine Heart

Jun 13, 2026 · Information Security

How a Harmless Query Can Hijack LLM Agents: The First Semantic Cache Key Collision Attack

A new study presented at ICML 2026 reveals that the fuzzy matching used in LLM semantic caching creates an integrity vulnerability, allowing attackers to craft adversarial suffixes that cause cache‑key collisions and achieve up to 86 % response‑hijacking success on major cloud services such as AWS and Azure.

AI AgentsLLM securitySemantic Caching

0 likes · 9 min read

How a Harmless Query Can Hijack LLM Agents: The First Semantic Cache Key Collision Attack

Wu Shixiong's Large Model Academy

Dec 18, 2025 · Artificial Intelligence

Why Text2SQL Must Be Integrated into AI Agents – An Interviewer's Guide

The article explains how Text2SQL should be treated as a read‑only tool within an AI Agent, covering its role in function calls, dynamic schema pruning, ambiguity handling, SQL safety checks, result validation, semantic caching, and logging to build a production‑grade system.

AI AgentFunction CallLLM

0 likes · 11 min read

Why Text2SQL Must Be Integrated into AI Agents – An Interviewer's Guide