Tagged articles
AI Efficiency
22 articles · Page 1 of 1
The article examines the limits of Transformer models, outlines their three fundamental shortcomings, and evaluates the Mobius architecture that decouples knowledge and reasoning, showing up to four‑fold inference speed gains, comparable accuracy, and improved compositional generalisation.
AI EfficiencyContinual LearningMobius
0 likes · 14 min read

This article presents Kuaishou’s 2026 H1 comprehensive review of its AI productivity system, detailing the three‑year evolution, the three critical bottlenecks that hindered scaling (skill polarization, workflow friction, and AI‑human coordination), the historical banking analogy that shaped a new AI‑productivity paradigm, a five‑stage roadmap with three parallel execution tracks, and concrete case studies that demonstrate a 10% rise in per‑person demand delivery, an 11%+ reduction in cycle time, and a doubling of AI code‑generation rates across the organization.
AI EfficiencyAI ProductivityAI-native teams
0 likes · 33 min read

The article analyzes GLM‑5.2’s surprising performance—ranking first in front‑end web design, surpassing Claude Opus on Code Arena, and leveraging DeepSeek‑derived sparse attention and IndexShare optimizations—while noting its weaker long‑context engineering scores and highlighting hardware scarcity as the main bottleneck for Chinese LLMs.
AI EfficiencyDeepSeekGLM-5.2
0 likes · 11 min read

DeepSeek V4’s open‑source 1 M‑token MoE model delivers benchmark scores of MMLU 88.7, C‑Eval 92.1 and HumanEval 69.5, while its 4‑bit AWQ quantization, PagedAttention memory management and FlashAttention acceleration cut inference costs and latency, prompting rivals such as Anthropic, OpenAI, Baidu and Huawei to slash prices and boost efficiency in a fierce market battle.
AI EfficiencyMoEdeepseek-v4
0 likes · 9 min read

Google Research’s TurboQuant algorithm compresses large‑language‑model KV caches from 32‑bit to 3‑bit, achieving a six‑fold reduction in memory usage and an eight‑fold inference speedup on H100 GPUs while preserving 100 % accuracy, and it also improves vector search performance without requiring large codebooks.
AI EfficiencyLLM compressionTurboQuant
0 likes · 10 min read

Enterprises seeking AI‑driven efficiency often stumble into five common traps—poor selection, perfectionism, over‑control, fighting AI in its strong suits, and unvalidated delivery—each dramatically cutting ROI unless a disciplined, human‑centric process is applied across the AI lifecycle.
AI AdoptionAI EfficiencyAI pitfalls
0 likes · 15 min read

This article provides a comprehensive review of dataset distillation, explaining its motivation, core concepts, major algorithmic families, evaluation criteria, and practical applications such as continual learning, federated learning, neural architecture search, and privacy‑preserving AI.
AI EfficiencyDataset DistillationDistribution Matching
0 likes · 25 min read

SpecExit combines speculative sampling with a lightweight draft model to predict early‑exit signals, shortening large‑reasoning model chains by up to two‑thirds and achieving up to 2.5× end‑to‑end inference acceleration on vLLM without sacrificing accuracy.
AI EfficiencyInference OptimizationSpecExit
0 likes · 12 min read

SPEC‑RL introduces speculative rollouts that reuse verified historical rollouts as prefixes, cutting rollout time by 2–3× while maintaining or improving performance across various math and reasoning benchmarks, and works seamlessly with PPO, GRPO, DAPO and other on‑policy algorithms.
AI Efficiencylarge language modelsreinforcement learning
0 likes · 8 min read

This article evaluates whether autoregressive large language models can generate several tokens in a single inference step, describing a mask‑based multi‑token prediction framework, gated LoRA adaptation, experimental results on Tulu‑3‑8B showing up to 5.2× speedup, and discusses implications for future research.
AI EfficiencyLLMMulti-token generation
0 likes · 13 min read

The JD Exploration Institute paper introduces Omniforce, a human‑centered, cloud‑edge collaborative AutoML system that uses model distillation, dynamic data governance, Bayesian‑optimized training, and edge deployment to cut large‑model training costs by 70% and improve inference speed by 30%, powering the JoyBuild platform for broader AI adoption.
AI EfficiencyAutoMLJoyBuild
0 likes · 6 min read


JD TechMay 15, 2025 · Artificial Intelligence
The paper "Omniforce" from JD Exploration Research Institute presents a cloud‑edge collaborative AutoML system that uses model distillation, data governance, Bayesian training optimization, and cloud‑edge cooperation to reduce large‑model training costs by 70% and improve inference efficiency by an average of 30%, offering a reusable technical paradigm for scalable AI deployment.
AI EfficiencyJoyBuildcloud‑edge computing
0 likes · 6 min read

The report analyzes DeepSeek's latest V3 and R1 models, highlights their scaling‑law‑driven cost reductions, explains how Huawei Ascend optimizes inference by cutting KV‑Cache storage and improving compute efficiency, and surveys the model’s deployments across finance, government, manufacturing, and healthcare sectors.
AI EfficiencyAI inferenceDeepSeek
0 likes · 4 min read

This article examines DeepSeek's breakthrough AI techniques—including a revamped MoE architecture, aggressive data distillation, ultra‑low‑energy training, novel multi‑stage training strategies, and custom AI chips—that enable a 7B model to rival GPT‑4 while consuming a fraction of the resources.
AI EfficiencyData distillationDeepSeek
0 likes · 9 min read

This article examines DeepSeek R1’s large‑scale reinforcement‑learning approach, its training pipeline that combines rule‑based scaling and deep‑reasoning SFT data, and why its open‑source, low‑cost replication of OpenAI o1 marks a pivotal step toward more efficient, democratized AI models.
AI EfficiencyDeepSeekModel Scaling
0 likes · 18 min read


ArchitectFeb 9, 2025 · Artificial Intelligence
This article provides an in‑depth analysis of DeepSeek’s model distillation technology, covering its definition, core principles, innovative strategies, architecture design, training optimizations, benchmark results, efficiency gains, and the remaining challenges of applying distillation to large language models and multimodal data.
AI EfficiencyDeepSeekknowledge transfer
0 likes · 16 min read

This article explains knowledge distillation as used in DeepSeek's R1 model, detailing how a large teacher model transfers knowledge to a smaller student model via soft targets and loss functions like KL divergence, enabling efficient deployment on resource-constrained devices.
AI EfficiencyCross-Entropy LossDeepSeek-R1
0 likes · 6 min read


AntTechJun 12, 2024 · Artificial Intelligence
The article introduces the ICLR‑2024 paper C‑Poly, a multi‑task learning framework that boosts large‑model efficiency and resource utilization, aiming to make powerful AI models as accessible and convenient as everyday services like QR‑code payments.
AI EfficiencyC-PolyICLR2024
0 likes · 2 min read


ArchitectMay 5, 2024 · Artificial Intelligence
Amidst a growing trend that narrows performance gaps between large and small language models, researchers highlight the efficiency, adaptability, and specialized advantages of small language models (SLM), while also discussing the high costs, hallucinations, and security concerns that still challenge large‑scale LLMs.
AI EfficiencyEdge ComputingLLM
0 likes · 9 min read

The article examines how large AI models are moving toward a unified paradigm that reduces task‑algorithm coupling, outlines multi‑layer efficiency challenges—from model compression and sparsity to software and infrastructure optimization—and highlights NVIDIA’s GTC 2024 China AI Day sessions showcasing the latest LLM technologies and registration details.
AI EfficiencyNVIDIA GTCRetrieval-Augmented Generation
0 likes · 13 min read

This article examines the use of Mixture‑of‑Experts (MoE) sparse training for GPT models, detailing the architecture, training and inference efficiency gains, experimental comparisons with dense models, custom routing algorithms, and step‑by‑step deployment on Alibaba Cloud AI platforms.
AI EfficiencyGPT-MoEModel Training
0 likes · 26 min read

In this interview, NetEase AI expert Li Yuke shares how lightweight, cost‑effective AI solutions improve digital content risk control, audio‑video processing, and conversational systems, while discussing technical committees, data standards, and future AI trends such as multimodal and unsupervised learning.
AI EfficiencyAI productionQCon interview
0 likes · 11 min read
