visual token redundancy — 2 Technical Articles

Apr 8, 2026 · Artificial Intelligence

How Dynamic Computation Cuts Redundancy in Decoder-Only Multimodal LLMs

This article examines the visual token redundancy in decoder-only multimodal large language models and introduces a training-free dynamic computation reduction framework—featuring Probe-Activated Dynamic FFN, Hollow Attention, and a Layer Ranking Algorithm—that significantly lowers inference cost while preserving performance.

Efficient Inferencedecoder-only architecturedynamic computation

0 likes · 12 min read

How Dynamic Computation Cuts Redundancy in Decoder-Only Multimodal LLMs

PaperAgent

Mar 31, 2026 · Artificial Intelligence

Can Dynamic Computation Reduction Slash Redundancy in Decoder‑Only Multimodal LLMs?

This article analyzes the visual token redundancy in decoder‑only multimodal large language models and presents a training‑free dynamic computation reduction framework—including Probe‑Activated Dynamic FFN, Hollow Attention, and a Layer Ranking Algorithm—that dramatically speeds up inference while preserving or even improving model performance.

decoder-only MLLMdynamic computationmultimodal AI

0 likes · 13 min read

Can Dynamic Computation Reduction Slash Redundancy in Decoder‑Only Multimodal LLMs?