Tagged articles
AI scaling
26 articles · Page 1 of 1
The article reveals that synthetic data, once touted as AI's infinite fuel, now costs up to thousands of yuan per high-quality reasoning sample due to MCTS exploration, formal verification, and expert review, while hitting diminishing returns from model collapse, boundary limits, and compute-cost divergence, pushing the industry toward embodied interaction and formal environments.
AI Product ManagementAI scalingEmbodied AI
0 likes · 9 min read

Ilya Sutskever’s new SSI engine uses Test‑Time Training to achieve unprecedented data efficiency, ten‑fold scaling, and persistent digital agents, marking a shift from static, large‑parameter models toward continuously learning systems while raising new safety and interpretability challenges.
AI scalingIlya SutskeverSSI
0 likes · 7 min read

The article argues that scaling AI pilots requires reusing validated capability packages—including business semantics, Skills, tool contracts, governance, evaluation assets, and operational mechanisms—rather than copying Agent instances, emphasizing stable core vs. configurable scenario adaptation, phased expansion with admission assessments, unified maintenance responsibilities, and metrics tracking reuse rates and cost reduction.
AI implementationAI scalingAgent reuse
0 likes · 15 min read

The article outlines a five‑layer framework for AI scaling—application‑level Discovery Loop, open‑source model advances, compute‑power financialization, autonomous chip production, and off‑grid energy—showing how capital, open‑source ecosystems, and infrastructure are reshaping the path toward AGI.
AI scalingDiscovery LoopTerafab
0 likes · 7 min read


21CTOAug 9, 2026 · Artificial Intelligence
ByteDance is reportedly pre‑training a 10‑trillion‑parameter AI model that dwarfs domestic rivals, uses a Mixture‑of‑Experts architecture with low activation ratios, demands roughly 36 000 Blackwell GPUs and $2.5 billion in hardware, and deliberately avoids distilling competitor models, raising questions about China’s AI frontier timeline.
AI scalingByteDanceDistillation avoidance
0 likes · 5 min read

The article examines the inherent limitations of the Transformer architecture—its three core shortcomings—and presents the Mobius framework, which decouples knowledge and reasoning to address these issues, offering up to four‑fold inference speed gains while maintaining accuracy and improving data efficiency.
AI scalingMobiusTransformer
0 likes · 14 min read

The article reports that the previously withdrawn Claude model Fable 5 resurfaced in an Android app, details how developers can invoke it, notes rising market bets on its return, and relays Anthropic co‑founder Jack Clark’s warning that the AI industry has only an accelerator and no brakes, citing observed alignment failures in Claude and the urgent need for coordinated slowdown.
AI safetyAI scalingAnthropic
0 likes · 7 min read

After SpaceX’s $60 billion acquisition of Cursor, the company announced a new 1.5‑trillion‑parameter model trained on over 100,000 GPUs, claiming parity in scale with Opus and GPT‑5.5, and discussed the competitive implications for Anthropic, OpenAI, Google, xAI and Meta.
AI scalingAnthropicCursor
0 likes · 6 min read

DeepMind co‑founder Shane Legg and a team of researchers released a 57‑page report that outlines four possible routes from artificial general intelligence to superintelligence, analyzes scaling, paradigm shifts, recursive self‑improvement and multi‑agent collaboration, and identifies six potential bottlenecks such as data limits and economic constraints.
AGIAI scalingASI
0 likes · 12 min read

DeepMind researchers outline three core concepts, enumerate digital intelligence’s innate advantages, detail the theoretical limits of ASI, and propose four plausible routes from human‑level AGI to superintelligence while identifying six potential walls that may impede or stop that transition.
AGIAI scalingAIXI
0 likes · 21 min read

A new arXiv paper introduces Incompressible Knowledge Probes that estimate large language model sizes via black‑box API calls, fitting a log‑linear relation on 89 open‑source models and producing controversial parameter estimates for GPT‑5.5, Claude Opus, Gemini and others, sparking heated community debate.
AI scalingClaude OpusGPT-5.5
0 likes · 7 min read

A Chinese research team’s 2024 "density law"—which predicts that the parameters needed for a given LLM performance halve every 3.5 months—has been independently validated by Meta’s scaling ladder, METR’s time‑horizon report, and subsequent analyses, revealing a unified exponential growth curve that reshapes expectations for inference cost, edge AI feasibility, and optimal model‑development strategies.
AI scalingLLM density lawMETR
0 likes · 11 min read

Meta has launched Muse Spark, its inaugural model from the newly formed Superintelligence Lab, showcasing multimodal capabilities, tool use, visual chain‑of‑thought, and multi‑agent orchestration, while detailing pretraining scaling gains, reinforcement‑learning improvements, and test‑time reasoning efficiencies.
AI scalingMetaMuse Spark
0 likes · 9 min read

A McKinsey report reveals that while two‑thirds of enterprises have tried agentic AI, less than 10% achieve scalable value, and robust, modern data architectures—built on seven concrete principles and a four‑step implementation plan—are the decisive factor.
AI scalingAgentic AIdata architecture
0 likes · 7 min read

The Scale‑SWE project combines a massive 100k‑sample software engineering dataset with a high‑concurrency sandbox infrastructure and a multi‑agent workflow to dramatically improve code‑agent training, evaluation, and real‑world performance, surpassing existing models on SWE‑bench benchmarks.
AI scalingCode AgentsSWE dataset
0 likes · 11 min read

MoCo is an open‑source Python framework that unifies 26 algorithms across four collaboration levels, enabling researchers to scale model ensembles from 2 to 16 LLMs, explore diversity benefits, and solve tasks that single models cannot handle.
AI scalingLLMMoCo
0 likes · 7 min read

The article analyzes how scaling laws still drive AI progress while product focus shifts toward low‑cost inference, explains how reasoning abilities create a positive feedback loop, and shows why token and power consumption have become the decisive factors for competitive AI services.
AI scalingindustry insightinference efficiency
0 likes · 9 min read

The article analyzes Epoch AI's token‑based framework for estimating AI‑generated digital workers, critiques its static assumptions, and proposes a dynamic, multi‑factor model that incorporates compute supply, hardware constraints, inference efficiency, task reliability, and economic value to forecast a wide range of possible future digital‑worker counts.
AIAI infrastructureAI scaling
0 likes · 27 min read

This article examines how WeChat’s Astra platform leverages the Ray distributed framework to manage million‑node AI workloads, addressing challenges of scale, heterogeneous GPU resources, operational complexity, and cost, and outlines the architecture that unifies Ray services across multiple Kubernetes clusters.
AI scalingAstra PlatformGPU Management
0 likes · 5 min read

This article examines how Tencent leverages the Ray distributed framework within the Astra platform to handle WeChat's massive AI workloads, addressing challenges of scale, heterogeneous GPU resources, operational complexity, and cost while outlining the architecture and practical benefits.
AI scalingAstra PlatformRay
0 likes · 5 min read

This article explains how Tencent's WeChat team built the Astra platform on Ray to manage millions of AI compute nodes, addressing challenges of massive scale, heterogeneous GPU resources, low‑priority node instability, deployment complexity, and cost, while detailing architecture, scheduling strategies, and practical usage examples.
AI scalingRayWeChat
0 likes · 21 min read

MiniMax’s latest M1 model, unveiled after a $300 million funding round, showcases a 4.56‑trillion‑parameter hybrid‑expert architecture with lightning attention, supporting up to one million tokens, and leverages reinforcement‑learning techniques to enhance long‑context handling, inference efficiency, and system‑2 reasoning capabilities.
AI scalingLong ContextReinforcement Learning
0 likes · 16 min read

This article explains the scaling laws behind large language models, the explosive growth of model sizes and compute demands, and why modern AI infrastructure must adopt SuperNode and SuperPOD architectures that combine high‑bandwidth Scale‑Up networks with flexible Scale‑Out networking to overcome bandwidth, latency, and power challenges.
AI scalingScaling LawsSuperPod
0 likes · 42 min read

The article analyzes how massive compute resources drive AI breakthroughs, highlighting Grok 3's top‑tier performance, DeepSeek's efficient engineering under constraints, and the emerging post‑training paradigm that reshapes competition among major AI players.
AI scalingCompute powerDeepSeek
0 likes · 7 min read

The article examines OpenAI’s 12‑day mini‑series, the emergence of o1 and Reinforcement Fine‑Tuning, and uses Epoch AI’s 2024 report to evaluate four critical constraints—power, chip capacity, data scarcity, and latency—that determine whether AI scaling laws can sustain the compute needed for a GPT‑5‑scale model by 2030.
AI scalingChip manufacturingData Scarcity
0 likes · 11 min read

The author shares a candid account of recent large‑model experiments, highlighting why most labs struggle to exceed 100 B parameters, how data and hardware constraints shape model iteration, and the practical engineering, safety, and multimodal challenges that dictate real‑world LLM deployment.
AI industryAI scalingLLM
0 likes · 6 min read
