Skip to content
Tagged articles

Mixture of Experts

202 articles · Page 3 of 3
DataFunTalk
DataFunTalk
Aug 7, 2021 · Artificial Intelligence

Multi-Category Mixture-of-Experts Model for JD Search Ranking

This article presents a multi‑category Mixture‑of‑Experts (MoE) approach for e‑commerce search ranking, addressing category‑specific behavior and small‑category learning by introducing hierarchical soft constraints and adversarial regularization, and demonstrates significant AUC and NDCG gains on Amazon and JD in‑house datasets.

Adversarial RegularizationHierarchical Soft ConstraintMixture of Experts
0 likes · 10 min read
Multi-Category Mixture-of-Experts Model for JD Search Ranking
ITPUB
ITPUB
Jun 25, 2021 · Artificial Intelligence

How Alibaba’s Low‑Carbon M6 Model Trains a Trillion‑Parameter AI with 80% Less Energy

Alibaba’s DAMO Academy unveiled the low‑carbon M6 multimodal model, a trillion‑parameter AI trained on just 480 V100 GPUs, achieving over 80% energy reduction and 11‑fold speedup compared to prior trillion‑parameter efforts, and already powering e‑commerce and manufacturing design tools.

GPU efficiencyM6Mixture of Experts
0 likes · 5 min read
How Alibaba’s Low‑Carbon M6 Model Trains a Trillion‑Parameter AI with 80% Less Energy