Machine Heart
Nov 16, 2026 · Artificial Intelligence
Latent Sparse Attention: 22x Speedup Over DeepSeek-Style at 10M Tokens
Prefrontal AI and ETH Zurich introduce Latent Sparse Attention (LSA), which clusters keys in a learned latent space and uses hierarchical bucket search to reduce indexer complexity from quadratic to O(T log T), achieving 22.7x prefill speedup over GLM-5.3-Flash and 72.4x over Qwen3.8-27B at 10M tokens while maintaining accuracy.
DeepSeekGLM-5.3-FlashLLM Inference
0 likes · 18 min read
