Tagged articles
5 articles
Page 1 of 1
Architect
Architect
Feb 24, 2025 · Artificial Intelligence

Inside MoBA: A Sparse Attention Framework for 10‑Million‑Token Contexts

The article details the development, architectural evolution, and practical challenges of MoBA—a sparse attention framework inspired by Mixture‑of‑Experts that scales LLM context length to 10 M tokens, supports seamless switching between full and sparse attention, and is now released as a minimal open‑source solution.

AI ArchitectureContext ParallelLLM training
0 likes · 13 min read
Inside MoBA: A Sparse Attention Framework for 10‑Million‑Token Contexts
Architecture Digest
Architecture Digest
Feb 24, 2025 · Artificial Intelligence

MoBA: Mixture of Block Attention for Long‑Context Large Language Models

The article introduces MoBA, a Mixture‑of‑Block‑Attention mechanism that applies Mixture‑of‑Experts principles to transformer attention, enabling efficient long‑context processing for large language models while maintaining performance comparable to full attention through sparse, trainable block selection and seamless switching.

Attention MechanismLLMMixture of Experts
0 likes · 12 min read
MoBA: Mixture of Block Attention for Long‑Context Large Language Models
NetEase Smart Enterprise Tech+
NetEase Smart Enterprise Tech+
Oct 19, 2023 · Artificial Intelligence

Unleashing Game AI: Inside NetEase’s Bray Distributed RL Framework

NetEase’s AI team reveals how their self‑developed distributed reinforcement‑learning platform, Bray, enables high‑level AI agents for the MOBA game Dream of Kingdom 2, covering GameCore integration, weighted random initialization, modular APIs, difficulty scaling, and cost‑effective training for realistic player experiences.

AI FrameworkDistributed TrainingMoBA
0 likes · 9 min read
Unleashing Game AI: Inside NetEase’s Bray Distributed RL Framework
Tencent Cloud Developer
Tencent Cloud Developer
Aug 21, 2018 · Artificial Intelligence

Game AI Exploration – From AlphaGo to MOBA Games

The talk surveyed game‑AI evolution—from rule‑based systems to AlphaGo‑style reinforcement learning—highlighted industry and academic methods, detailed challenges of applying deep‑learning techniques to MOBA titles like Honor Kings, and proposed a hierarchical, multimodal framework with analysis and execution modules supported by robust simulation environments.

AI in GamesAlphaGoDeep Learning
0 likes · 10 min read
Game AI Exploration – From AlphaGo to MOBA Games