Tagged articles

semantic redundancy

2 articles · Page 1 of 1

Sep 30, 2026 · Artificial Intelligence

ME-Decoding: Reframing LLM Decoding as Ensemble Pruning with Semantic Redundancy Control

Renmin University researchers propose ME-Decoding, a method that selects candidate tokens by jointly optimizing probability confidence and semantic diversity via Mahalanobis distance, outperforming probability-only truncation on reasoning and open-ended generation across multiple models and temperatures with only 3% latency overhead.

EMNLP 2026LLM decodingMahalanobis distance

0 likes · 11 min read

ME-Decoding: Reframing LLM Decoding as Ensemble Pruning with Semantic Redundancy Control

Machine Heart

Jul 16, 2026 · Artificial Intelligence

Brake Overthinking in Long‑Reasoning Models by Detecting Semantic Redundancy

Long‑thinking LLMs often waste 41‑52% of tokens after the final answer; the PUMA framework detects when reasoning stops producing new semantic information, enabling early exit that cuts average token usage by 26.2% while keeping accuracy stable and even improving speed across multiple benchmarks.

LLM inferencePUMAearly exit

0 likes · 9 min read

Brake Overthinking in Long‑Reasoning Models by Detecting Semantic Redundancy