Tagged articles

Efficient AI

3 articles · Page 1 of 1

Sep 19, 2026 · Artificial Intelligence

Random Attention: Random KV Cache Eviction Rivals Best Baselines, Boosts Throughput 43%

Salesforce and UIUC researchers propose Random Attention, a simple KV cache eviction method that randomly retains reasoning tokens while fully protecting the prompt, matching the accuracy of complex importance-based methods across multiple models and tasks while increasing inference throughput by 32-43% in vLLM serving.

Attention MechanismCache CompressionEfficient AI

0 likes · 18 min read

Random Attention: Random KV Cache Eviction Rivals Best Baselines, Boosts Throughput 43%

Data Party THU

Nov 4, 2025 · Artificial Intelligence

Can Tiny Networks Beat Giant LLMs? Inside the Tiny Recursive Model (TRM) Breakthrough

A recent study from Samsung's SAIL Montreal lab shows that a 7‑million‑parameter, two‑layer Tiny Recursive Model can surpass large language models on challenging reasoning benchmarks by using recursive self‑correction instead of attention, offering a new efficient path for AI inference.

Efficient AILLM comparisonMLP

0 likes · 7 min read

Can Tiny Networks Beat Giant LLMs? Inside the Tiny Recursive Model (TRM) Breakthrough

Alibaba Cloud Big Data AI Platform

Mar 18, 2024 · Artificial Intelligence

How MuLTI Achieves Memory‑Efficient Video‑Language Understanding with Text‑Guided MultiWay Sampling

The paper presents MuLTI, a multimodal video‑language model that tackles the memory and efficiency challenges of long video‑text sequences by introducing a Text‑Guided MultiWay Sampler and a Multiple Choice Modeling pre‑training task, achieving state‑of‑the‑art results on video QA and retrieval while drastically reducing GPU memory consumption.

Efficient AIFeature FusionPretraining

0 likes · 19 min read

How MuLTI Achieves Memory‑Efficient Video‑Language Understanding with Text‑Guided MultiWay Sampling