Machine Heart
Nov 20, 2026 · Artificial Intelligence
NeurIPS 2026: Forward-Only LLM Adaptation During Inference via SVD Angle Concentration
A NeurIPS 2026 paper introduces a forward-only adaptation method for LLMs that uses angle concentration of SVD components to prune ranks during inference without backpropagation, achieving lower peak memory and higher speedup than gradient-based and exhaustive search methods across diverse models and tasks.
LLM adaptationNeurIPS 2026SVD
0 likes · 9 min read
