BestHub
Sign in
Tagged articles
34 articles
Page 1 of 1
Model Perspective
Model Perspective
Apr 9, 2026 · Industry Insights

Why the Silly Big Personality Test Feels So Accurate: A 15‑Dimensional Clustering Analysis

The article dissects the Silly Big Personality Test (SBTI), explaining its 15‑dimensional Euclidean space, threshold‑based hierarchical clustering, statistical tricks like the Barnum effect, and its viral spread as a social meme, while highlighting the scientific limits of such entertainment‑focused assessments.

Barnum effectPsychologyclustering
0 likes · 7 min read
Why the Silly Big Personality Test Feels So Accurate: A 15‑Dimensional Clustering Analysis
Machine Heart
Machine Heart
Mar 30, 2026 · Artificial Intelligence

InfoTok: Information-Theoretic Adaptive Video Tokenizer Redefines Efficient Tokenization (ICLR 2026 Oral)

InfoTok, a collaborative effort by Stanford, NVIDIA Cosmos, and NUS, leverages information theory and an ELBO‑based router to allocate tokens adaptively, achieving 2.3× higher compression, 11× faster inference, and superior reconstruction quality on benchmarks such as TokenBench and DAVIS.

Computer VisionELBOICLR 2026
0 likes · 11 min read
InfoTok: Information-Theoretic Adaptive Video Tokenizer Redefines Efficient Tokenization (ICLR 2026 Oral)
PaperAgent
PaperAgent
Feb 14, 2026 · Artificial Intelligence

Can Self‑Evolving AI Societies Remain Safe? Exploring the Self‑Evolution Trilemma

An in‑depth analysis of the OpenClaw‑derived Moltbook AI agent network reveals a “Self‑Evolution Trilemma” where continuous self‑evolution, complete isolation, and perpetual safety cannot coexist, supported by information‑theoretic definitions, empirical observations of cognitive decay, alignment failures, communication collapse, and proposed thermodynamic mitigation strategies.

AI SafetySecuritySelf-Evolving Agents
0 likes · 9 min read
Can Self‑Evolving AI Societies Remain Safe? Exploring the Self‑Evolution Trilemma
Model Perspective
Model Perspective
Dec 3, 2025 · Fundamentals

Why Shannon’s 1948 Theory Still Powers Modern Communication

This article explains Claude Shannon’s groundbreaking 1948 mathematical theory of communication, covering the essence of communication, the classic Shannon model, bits and entropy, source and channel coding theorems, and why digitizing information remains the most efficient way to transmit data.

Shannoncoding theoremcommunication
0 likes · 9 min read
Why Shannon’s 1948 Theory Still Powers Modern Communication
Model Perspective
Model Perspective
Nov 27, 2025 · Operations

Uncovering Hidden Losses in Leadership Intent: A Mathematical Modeling Approach

This article builds a quantitative framework for analyzing leadership intent using vector representation, multi‑objective optimization, Shannon‑type information‑theoretic channel models, and signaling games, and illustrates the approach with three Chinese case studies that reveal how intent distortion, high entropy, and strategic misalignment affect execution.

Game TheoryLeadership IntentOrganizational Management
0 likes · 10 min read
Uncovering Hidden Losses in Leadership Intent: A Mathematical Modeling Approach
ITPUB
ITPUB
Nov 24, 2025 · Artificial Intelligence

Why Memory, Not Size, Is the Next Bottleneck for Large Language Models

In a detailed interview, the CTO of Memory Tensor (Shanghai) explains how limited memory capacity hampers large models, outlines the MemOS memory operating system, discusses information‑theoretic metrics, multimodal extensions, and reinforcement‑learning strategies for scalable, secure, and explainable AI memory management.

AI ArchitectureMultimodal AIinformation theory
0 likes · 23 min read
Why Memory, Not Size, Is the Next Bottleneck for Large Language Models
Model Perspective
Model Perspective
Sep 27, 2025 · Fundamentals

What Math Lies Hidden in Tang Poetry? A Modeling Exploration

This article examines classic Tang poems through modern mathematical modeling, revealing how geometric optics, probability, calculus, information theory, and network analysis can be applied to literary works to uncover the underlying mathematical structures and interdisciplinary insights.

GeometryTang Poetrycalculus
0 likes · 10 min read
What Math Lies Hidden in Tang Poetry? A Modeling Exploration
AI Algorithm Path
AI Algorithm Path
May 10, 2025 · Artificial Intelligence

Master KL Divergence: Definitions, Properties, and Real‑World Applications

This article explains the Kullback‑Leibler (KL) divergence for discrete and continuous distributions, outlines its non‑negativity and asymmetry, walks through a uniform‑distribution example, provides a simple Python demonstration, and discusses key applications in variational autoencoders, reinforcement‑learning policy optimization, and other machine‑learning contexts.

KL divergenceVariational Autoencoderinformation theory
0 likes · 7 min read
Master KL Divergence: Definitions, Properties, and Real‑World Applications
Model Perspective
Model Perspective
Feb 26, 2025 · Artificial Intelligence

How Do Large Language Models Compress Massive Data? Limits and Techniques

This article explains how large language models act like a super‑library by compressing vast amounts of text using information‑theoretic concepts, probability‑based coding, autoregressive neural networks, and arithmetic coding, while discussing accuracy, compression ratios, and theoretical limits.

AIarithmetic codingautoregressive networks
0 likes · 8 min read
How Do Large Language Models Compress Massive Data? Limits and Techniques
Model Perspective
Model Perspective
Nov 20, 2024 · Fundamentals

Can π Encode Anything? Unveiling Its Infinite Randomness and Information Power

π’s endless, non‑repeating decimal expansion behaves like a universal information reservoir: any finite digit sequence—birthdates, historic years, or arbitrary data—appears somewhere, and if the unproven normal‑number hypothesis holds, π could serve as an infinite random number generator for cryptography, art, and scientific modeling.

cryptographydata hidinginformation theory
0 likes · 6 min read
Can π Encode Anything? Unveiling Its Infinite Randomness and Information Power
Model Perspective
Model Perspective
Sep 7, 2024 · Fundamentals

How Choices Reduce Uncertainty: The Hidden Role of Information Entropy

Every daily decision—from picking clothes to selecting a menu item—acts as an entropy‑reducing process, and this article explains how information theory’s concepts of entropy, entropy reduction, and information gain illuminate the nature of choice, free will, and optimal decision‑making.

Information Gainchoice optimizationdecision making
0 likes · 7 min read
How Choices Reduce Uncertainty: The Hidden Role of Information Entropy
Model Perspective
Model Perspective
Mar 29, 2024 · Fundamentals

How Reducing Information Entropy Can Simplify Your Life

In an age of information overload, understanding and applying the concept of entropy to filter and reject unnecessary data helps lower uncertainty, reduce mental load, and enable more focused, efficient decision‑making for a simpler, higher‑quality life.

attention managemententropyinformation theory
0 likes · 9 min read
How Reducing Information Entropy Can Simplify Your Life
Bilibili Tech
Bilibili Tech
Jan 16, 2024 · Industry Insights

How Bilibili Cuts Video Bandwidth: Theory and Practice of Transcoding Optimization

This article analyzes the fundamental goals of video transcoding, presents an information‑theoretic framework for bitrate reduction, compares traditional and deep‑learning codecs, and shares Bilibili's practical system design, parameter‑decision strategies, and visual‑quality‑aware optimizations that dramatically lower bandwidth consumption.

VMAFVideo Transcodingbandwidth optimization
0 likes · 24 min read
How Bilibili Cuts Video Bandwidth: Theory and Practice of Transcoding Optimization
Bilibili Tech
Bilibili Tech
Dec 22, 2023 · Artificial Intelligence

Intelligent Media Technology and Innovative Applications: Information-Theoretic Principles for Transcoding System Optimization

The upcoming Shanghai Jiao‑Tong University seminar on Intelligent Media Technology will feature Bilibili’s Cai Chunlei presenting an information‑theoretic framework for jointly optimizing video transcoding pipelines, linking traditional coding, deep‑learning methods and future large‑model techniques to improve compression and guide practical system design.

AISeminarVideo processing
0 likes · 4 min read
Intelligent Media Technology and Innovative Applications: Information-Theoretic Principles for Transcoding System Optimization
Open Source Linux
Open Source Linux
Dec 18, 2023 · Fundamentals

From Bits to Brontobytes: Understanding Data Storage Units

This article explains the hierarchy of digital storage units—from the single bit up to speculative sizes like Brontobyte and beyond—detailing their values, typical examples, and real‑world analogies such as characters per byte and the amount of text each unit can hold.

bitsbytesdata storage
0 likes · 5 min read
From Bits to Brontobytes: Understanding Data Storage Units
21CTO
21CTO
Apr 7, 2023 · Cloud Computing

Beyond AI: First‑Principles Strategies for the Emerging Digital Age

In this thought‑leading talk, Microsoft China CTO Wei Qing explores how first‑principle thinking, information theory, and cloud‑native architectures can guide organizations through the unknown digital era, emphasizing practical engineering, data integration, and the shift from hype to real‑world technology empowerment.

Digital TransformationSystems Engineeringcloud computing
0 likes · 42 min read
Beyond AI: First‑Principles Strategies for the Emerging Digital Age
Model Perspective
Model Perspective
Oct 8, 2022 · Fundamentals

What Is Entropy? From Thermodynamics to Information Theory Explained

This article explores the concept of entropy, tracing its origins from the second law of thermodynamics through Shannon’s information entropy, illustrating its mathematical definition, physical meaning, and practical examples, and even discusses how the principle can be applied to personal growth and organizational management.

PhysicsShannon entropyentropy
0 likes · 13 min read
What Is Entropy? From Thermodynamics to Information Theory Explained
Code DAO
Code DAO
May 6, 2022 · Fundamentals

Information Theory Foundations for Machine Learning and Deep Learning

The article explains Shannon information content, entropy, cross‑entropy, KL‑divergence, conditional entropy and mutual information, illustrating each concept with coin‑flip and dice examples, visual formulas, and discusses their roles as loss functions and evaluation metrics in machine‑learning models.

KL divergencecross entropyentropy
0 likes · 8 min read
Information Theory Foundations for Machine Learning and Deep Learning
21CTO
21CTO
Apr 7, 2022 · R&D Management

How to Thrive in the Age of Complexity: Insights from Microsoft’s CTO

In an era dominated by black‑swan events and misinformation, the article explores how leaders can develop resilience through humility, first‑principles thinking, revisiting classic research, and collaborative sense‑making to navigate digital transformation and the challenges of a rapidly evolving information landscape.

Digital TransformationManagementcomplexity
0 likes · 10 min read
How to Thrive in the Age of Complexity: Insights from Microsoft’s CTO
Architect's Tech Stack
Architect's Tech Stack
Dec 14, 2021 · Fundamentals

The History and Impact of Jacob Ziv’s Universal Lossless Compression Algorithms

This article chronicles Jacob Ziv’s pioneering contributions to lossless data compression, tracing the evolution from early Morse code through Shannon‑Fano and Huffman to the groundbreaking LZ77 and LZ78 algorithms, and highlights his biography, major awards, and lasting influence on modern digital media and storage technologies.

Jacob ZivLZ77LZ78
0 likes · 9 min read
The History and Impact of Jacob Ziv’s Universal Lossless Compression Algorithms
21CTO
21CTO
Jul 24, 2021 · Fundamentals

How Jacob Ziv’s Lempel‑Ziv Algorithms Revolutionized Data Compression

Jacob Ziv, the 90‑year‑old Israeli pioneer honored with the 2021 IEEE Medal of Honor, co‑created the groundbreaking Lempel‑Ziv lossless compression algorithms that underpin modern formats like GIF, PNG and ZIP, and his century‑spanning career reshaped data storage, transmission, and information theory.

Jacob ZivLempel-Zivalgorithm history
0 likes · 10 min read
How Jacob Ziv’s Lempel‑Ziv Algorithms Revolutionized Data Compression
Alibaba Terminal Technology
Alibaba Terminal Technology
Apr 12, 2021 · Frontend Development

How AI Is Revolutionizing Frontend Development: Alibaba’s Three‑Year Journey

This article chronicles Alibaba’s three‑year evolution of frontend intelligence, detailing the origins of AI‑driven code generation, key technologies like imgCook, BizCook and UICook, the methodology, toolchain, organizational integration, and future directions for boosting development efficiency and business value.

AIAutomationCode Generation
0 likes · 26 min read
How AI Is Revolutionizing Frontend Development: Alibaba’s Three‑Year Journey
Programmer DD
Programmer DD
Sep 29, 2020 · Fundamentals

What Are the Ten Mathematical Challenges Shaping the Post‑Shannon Era?

Former Huawei strategist Xu Wenwei outlined ten critical mathematical problems—from lossy compression limits to DNN interpretability—that must be solved to advance communication technologies beyond Shannon’s limits, highlighting the pivotal role of mathematics in the emerging intelligent, fully connected society.

Huaweicommunicationinformation theory
0 likes · 5 min read
What Are the Ten Mathematical Challenges Shaping the Post‑Shannon Era?
21CTO
21CTO
Aug 27, 2018 · Artificial Intelligence

Can Evolutionary Algorithms Rival Physical Models? A Deep Dive into DNA as Code

This extensive essay critiques the book "Proving Darwin" while exploring configuration spaces, genetic and simulated‑annealing algorithms, their computational complexities, and how they compare to physical models, then delves into information theory, Turing machines, and philosophical reflections on evolution, life, and the universe.

Evolutionary Computationcomplexity analysisgenetic algorithms
0 likes · 31 min read
Can Evolutionary Algorithms Rival Physical Models? A Deep Dive into DNA as Code
21CTO
21CTO
Feb 7, 2018 · Artificial Intelligence

Demystifying Entropy: From Basic Concepts to Cross‑Entropy and KL Divergence

This article explains entropy, joint entropy, conditional entropy, and related measures such as KL divergence and cross‑entropy, using intuitive coin‑flip examples and mathematical formulas to show how they quantify uncertainty and information in probability distributions.

KL divergencecross entropyentropy
0 likes · 14 min read
Demystifying Entropy: From Basic Concepts to Cross‑Entropy and KL Divergence
21CTO
21CTO
Dec 16, 2017 · Artificial Intelligence

Unveiling the Mathematics Behind Deep Learning Success

This article reviews recent research that mathematically explains why deep learning, especially convolutional neural networks, achieve remarkable performance by examining core factors such as architecture, regularization, and optimization, and discusses properties like global optimality, geometric stability, and invariant representations.

Deep LearningGeneralizationNeural Networks
0 likes · 16 min read
Unveiling the Mathematics Behind Deep Learning Success
21CTO
21CTO
Sep 22, 2017 · Big Data

Why Big Data Is Driving the Next Technological Revolution

Big data’s explosive growth, fueled by the internet and massive data collection, has transformed AI methods, reshaped industries, and sparked a new intelligent revolution by turning uncertainty into actionable insight, illustrating how data volume, multidimensionality, and completeness fundamentally change technology and business models.

Data-driveninformation theorytechnology revolution
0 likes · 23 min read
Why Big Data Is Driving the Next Technological Revolution
We-Design
We-Design
Nov 16, 2015 · Fundamentals

How Information Shapes Reality: From CRISPR to Physics' Holy Grail

The essay explores how information, translation, and hierarchical structures underpin our perception of reality, linking bio‑hacking, physics, culture, and philosophy while highlighting the quest for a unified key to connect all levels of existence.

CRISPRPhysicsfundamentals
0 likes · 12 min read
How Information Shapes Reality: From CRISPR to Physics' Holy Grail