What Is Information Entropy? Definition, Calculation, and Decision Tree Applications

This article explains the concept of information entropy, its mathematical definition, how to compute it for simple events like coin flips and dice rolls, and demonstrates its role in decision‑tree learning by calculating information gain for a watermelon dataset.

Information Gaindecision treeinformation entropy

0 likes · 11 min read

What Is Information Entropy? Definition, Calculation, and Decision Tree Applications

Yuewen Technology

Apr 1, 2022 · Artificial Intelligence

Detecting Emerging Terms in Web Novels: PMI, Entropy, and TF‑IDF Methods

This article explores how to automatically discover new words in Chinese web novels by combining n‑gram statistics, pointwise mutual information, information entropy, and TF‑IDF filtering, presenting a practical, unsupervised pipeline that improves tokenization and search recall without manual labeling.

Chinese text miningNLPPMI

0 likes · 14 min read

Detecting Emerging Terms in Web Novels: PMI, Entropy, and TF‑IDF Methods

Alibaba Cloud Native

Dec 7, 2021 · Operations

How Information Entropy Powers AI‑Driven Alert Noise Reduction in Cloud‑Native Operations

This article explains how Shannon's information entropy and NLP are combined in Alibaba Cloud's ARMS intelligent noise reduction to quantify alert uncertainty, filter redundant notifications, and automatically prioritize critical incidents, offering a practical, self‑learning solution for modern monitoring environments.

Alert Noise ReductionNLPinformation entropy

0 likes · 11 min read

How Information Entropy Powers AI‑Driven Alert Noise Reduction in Cloud‑Native Operations