MoBA | BestHub

Architecture Digest

Feb 24, 2025 · Artificial Intelligence

MoBA: Mixture of Block Attention for Long‑Context Large Language Models

The article introduces MoBA, a Mixture‑of‑Block‑Attention mechanism that applies Mixture‑of‑Experts principles to transformer attention, enabling efficient long‑context processing for large language models while maintaining performance comparable to full attention through sparse, trainable block selection and seamless switching.

LLMMixture of ExpertsMoBA

0 likes · 12 min read

MoBA: Mixture of Block Attention for Long‑Context Large Language Models

Tencent Cloud Developer

Aug 21, 2018 · Artificial Intelligence

Game AI Exploration – From AlphaGo to MOBA Games

The talk surveyed game‑AI evolution—from rule‑based systems to AlphaGo‑style reinforcement learning—highlighted industry and academic methods, detailed challenges of applying deep‑learning techniques to MOBA titles like Honor Kings, and proposed a hierarchical, multimodal framework with analysis and execution modules supported by robust simulation environments.

AI in GamesAlphaGoMoBA

0 likes · 10 min read

Game AI Exploration – From AlphaGo to MOBA Games