Tagged articles

information compression

3 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jul 9, 2026 · Artificial Intelligence

How Much Can Large Language Models Remember? ICML 2026 Finds ~3.6 bits per Parameter

An ICML 2026 award paper quantifies the memory capacity of GPT‑style language models, showing that each parameter stores roughly 3.6 bits of information, and explores how this capacity scales with model size, data volume, precision, and its impact on generalization and privacy risks.

GPTICML2026LLM
0 likes · 9 min read
How Much Can Large Language Models Remember? ICML 2026 Finds ~3.6 bits per Parameter
Tencent Advertising Technology
Tencent Advertising Technology
Nov 28, 2025 · Artificial Intelligence

How Retrv-R1 Redefines Universal Multimodal Retrieval with Reasoning‑Driven MLLM

Retrv‑R1, a reasoning‑driven multimodal large language model framework, tackles the precision‑efficiency dilemma of universal multimodal retrieval by introducing a two‑stage coarse‑to‑fine pipeline, an information‑compression module, a detail‑inspection mechanism, and a three‑stage training strategy, achieving SOTA performance across accuracy, efficiency, and generalization benchmarks.

MLLMdetail inspectionefficiency
0 likes · 21 min read
How Retrv-R1 Redefines Universal Multimodal Retrieval with Reasoning‑Driven MLLM
Model Perspective
Model Perspective
Jul 31, 2025 · Fundamentals

Why Modeling Is the Secret Weapon for Efficient Decision‑Making

The article explains how mathematical modeling compresses complex real‑world problems into clear, operable structures, enabling powerful inference through induction, deduction, and inversion, and demonstrates its impact with case studies in urban bike sharing and personalized education.

AICase studyModeling
0 likes · 9 min read
Why Modeling Is the Secret Weapon for Efficient Decision‑Making