Skip to content
Tagged articles

Latent Sparse Attention

1 articles · Page 1 of 1
Machine Heart
Machine Heart
Nov 16, 2026 · Artificial Intelligence

Latent Sparse Attention: 22x Speedup Over DeepSeek-Style at 10M Tokens

Prefrontal AI and ETH Zurich introduce Latent Sparse Attention (LSA), which clusters keys in a learned latent space and uses hierarchical bucket search to reduce indexer complexity from quadratic to O(T log T), achieving 22.7x prefill speedup over GLM-5.3-Flash and 72.4x over Qwen3.8-27B at 10M tokens while maintaining accuracy.

DeepSeekGLM-5.3-FlashLLM Inference
0 likes · 18 min read
Latent Sparse Attention: 22x Speedup Over DeepSeek-Style at 10M Tokens