Sep 5, 2026 · Artificial Intelligence

THD Packing & MTP Speculative Decoding Tame 64K Code Agent RL on Ascend NPUs

AReaL-Ascend v1.0.5 enables stable 64K-context Code Agent RL for Qwen3.6-27B on Ascend NPUs, using THD Sequence Packing to eliminate padding waste and MTP speculative decoding to accelerate rollout, achieving reward improvement from 0.56 to 0.94 over 120 steps with train-rollout consistency near 1.0.

AReaLAscend NPUCode Agent

0 likes · 12 min read

THD Packing & MTP Speculative Decoding Tame 64K Code Agent RL on Ascend NPUs

Huawei Cloud Developer Alliance

Aug 14, 2026 · Artificial Intelligence

How Huawei Cloud Optimizes the New Xiaohongshu Open‑Source Model dots3‑note Preview for Multimodal Inference

Huawei Cloud adapts and optimizes the 280B‑parameter dots3‑note preview model released by Xiaohongshu, detailing its mixed sparse attention, MoE enhancements, multimodal pre‑training pipelines, unified reward training, and a suite of inference‑time optimizations—including FlashComm, FUSED_MC2, and MTP speculative decoding—delivered via the vLLM Ascend framework for high‑throughput, low‑latency deployment.

Huawei CloudMTP Speculative DecodingMoE optimization

0 likes · 7 min read

How Huawei Cloud Optimizes the New Xiaohongshu Open‑Source Model dots3‑note Preview for Multimodal Inference