BestHub
Sign in
Tagged articles

AI infrastructure

275 articles · Page 2 of 3
Machine Heart
Machine Heart
Apr 18, 2026 · Industry Insights

DeepSeek’s First Fundraise: $100B Valuation and $300M Target Amid Talent Exodus

DeepSeek, the Chinese AI startup behind the high‑efficiency DeepSeek‑R1 model, is reportedly seeking at least $300 million at a $100 billion valuation, while shifting to building its own data‑center infrastructure and seeing key researchers depart for rivals, signaling a new financing and operational phase for the company.

AI financingAI infrastructureDeepSeek
0 likes · 6 min read
DeepSeek’s First Fundraise: $100B Valuation and $300M Target Amid Talent Exodus
DataFunSummit
DataFunSummit
Apr 15, 2026 · Artificial Intelligence

How Relax Powers Scalable Multi‑Modal RL Training with Full Asynchrony

Relax, an open‑source RL training engine built on Megatron‑LM and SGLang, tackles data heterogeneity, system fragility, and role coupling by using a service‑oriented fault‑tolerant architecture, asynchronous pipelines, and multimodal‑native support, achieving up to 76% end‑to‑end speedup over veRL.

AI infrastructureMultimodalRL training
0 likes · 11 min read
How Relax Powers Scalable Multi‑Modal RL Training with Full Asynchrony
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Apr 13, 2026 · Industry Insights

How UALink 2.0 and CXL Are Redefining AI Scale‑Up Interconnects

At the 2026 Open AI Infra Summit, Alibaba Cloud showcased the evolution of the UALink 2.0 protocol and its integration with CXL, detailing new specifications, in‑network compute capabilities, and ecosystem developments that aim to overcome scale‑up bottlenecks in AI training and inference.

AI infrastructureCXLCloud Computing
0 likes · 8 min read
How UALink 2.0 and CXL Are Redefining AI Scale‑Up Interconnects
Machine Heart
Machine Heart
Apr 11, 2026 · Industry Insights

OpenAI’s Stargate Project Faces Leadership Exodus and Security Incident

After a Molotov cocktail was thrown at Sam Altman's home, OpenAI’s Stargate initiative suffered a shockwave of senior executive departures, a strategic pivot from self‑built data centers to partner‑driven cloud resources, massive funding commitments, and the suspension of its UK expansion, highlighting deep turmoil in the AI infrastructure race.

AI infrastructureCloud ComputingLeadership turnover
0 likes · 10 min read
OpenAI’s Stargate Project Faces Leadership Exodus and Security Incident
SuanNi
SuanNi
Apr 10, 2026 · Artificial Intelligence

How Claude Managed Agents Remove the Infrastructure Burden for Enterprise AI

Claude Managed Agents provide a pre‑built sandbox, orchestration, and session layers that let developers launch production‑grade AI agents in days instead of months, cutting costs, boosting success rates, and delivering real‑world enterprise case studies.

AI infrastructureClaudeEnterprise AI
0 likes · 8 min read
How Claude Managed Agents Remove the Infrastructure Burden for Enterprise AI
Top Architecture Tech Stack
Top Architecture Tech Stack
Apr 10, 2026 · Artificial Intelligence

How Claude Managed Agents Slash Agent Development Costs by 500×

Claude Managed Agents, Anthropic's new hosted execution layer, eliminates the infrastructure headaches of building AI agents by providing sandboxing, state persistence, error recovery, and orchestration, enabling developers to create complex, long‑running agents with dramatically lower cost and effort.

AI infrastructureAgent DevelopmentAnthropic
0 likes · 12 min read
How Claude Managed Agents Slash Agent Development Costs by 500×
AI Architecture Hub
AI Architecture Hub
Apr 10, 2026 · Artificial Intelligence

How Claude Managed Agents Turn AI Assistants into Production-Ready Cloud Workers

Claude Managed Agents, Anthropic's cloud‑hosted AI agent service, lets enterprises embed autonomous bug‑fixing, code‑writing, and reporting bots without building heavy infrastructure, offering managed runtimes, scalable sessions, and API integration while highlighting use‑case categories, architectural design, limitations, and industry impact.

AI AgentsAI infrastructureAnthropic
0 likes · 11 min read
How Claude Managed Agents Turn AI Assistants into Production-Ready Cloud Workers
Big Data Tech Team
Big Data Tech Team
Apr 9, 2026 · Industry Insights

Why Data Engineers Are the New AI Powerhouses: 4 Core Reasons & Actionable Tips

The article analyzes why data development engineers are becoming more valuable in the AI era, outlining four core reasons—including data‑driven AI limits, the rise of RAG architectures, heightened data compliance, and a talent shortage—while offering concrete advice on mastering real‑time pipelines, unstructured data, and AI infrastructure.

AI infrastructureRAGbig data
0 likes · 8 min read
Why Data Engineers Are the New AI Powerhouses: 4 Core Reasons & Actionable Tips
Design Hub
Design Hub
Mar 28, 2026 · Artificial Intelligence

Why Harness Engineering Is Emerging as a New Kind of Company

The AI community is shifting its focus from model performance to building runnable, observable, and scalable agent systems, a trend illustrated by the rise of Harness Engineering, Open Agents Company, and Agent Matrix across X discussions, GitHub projects, and developer meetups.

AI AgentsAI infrastructureAgent Matrix
0 likes · 14 min read
Why Harness Engineering Is Emerging as a New Kind of Company
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Mar 28, 2026 · Artificial Intelligence

Junyang Lin’s 10k‑Word Review: From Reasoning to Agentic Thinking in Large Models

In a detailed post‑departure analysis, Junyang Lin reviews two years of large‑model evolution, explains how o1 and DeepSeek‑R1 highlighted the limits of pure reasoning, and argues that the next breakthrough lies in agentic thinking that integrates environment interaction, tool use, and robust reinforcement‑learning infrastructure.

AI infrastructureagentic thinkinglarge language models
0 likes · 18 min read
Junyang Lin’s 10k‑Word Review: From Reasoning to Agentic Thinking in Large Models
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Mar 24, 2026 · Artificial Intelligence

How Hologres + Mem0 Deliver Low‑Cost, High‑Performance Long‑Memory for LLMs

This article explains how the combination of Hologres, a unified real‑time data warehouse, and Mem0, an open‑source LLM memory framework, overcomes the limited context window of large language models by providing scalable, low‑latency, and cost‑effective long‑term memory for AI applications.

AI infrastructureHologresLLM
0 likes · 11 min read
How Hologres + Mem0 Deliver Low‑Cost, High‑Performance Long‑Memory for LLMs
AI Explorer
AI Explorer
Mar 19, 2026 · Industry Insights

Nvidia Unveils Physical AI Infrastructure: Turning Virtual Thinkers into Real-World Actors

At GTC 2026, Nvidia introduced a comprehensive physical AI platform built on the upgraded Omniverse, aiming to bridge virtual simulations with real-world robotics, industrial automation, and autonomous vehicles, positioning the company as a systemic infrastructure provider for the emerging AI‑driven manufacturing era.

AI infrastructureDigital TwinNVIDIA
0 likes · 5 min read
Nvidia Unveils Physical AI Infrastructure: Turning Virtual Thinkers into Real-World Actors
AI Explorer
AI Explorer
Mar 16, 2026 · Artificial Intelligence

HyperOffload: A New Storage Paradigm Aiming to Break the AI Memory Wall

HyperOffload, a joint effort by Shanghai Jiao Tong University and Huawei’s MindSpore team, proposes a dynamic tensor offloading system that moves data between GPU memory, CPU RAM, and SSDs, aiming to overcome the “memory wall” that limits trillion‑parameter AI model training and deployment.

AI infrastructureAI memory wallGPU Memory Management
0 likes · 6 min read
HyperOffload: A New Storage Paradigm Aiming to Break the AI Memory Wall
JD Cloud Developers
JD Cloud Developers
Mar 16, 2026 · Operations

Why Traditional Monitoring Fails for AI Supercomputing and How to Build Next‑Gen Intelligent Monitoring

In the era of hundred‑thousand‑GPU clusters and trillion‑parameter models, conventional monitoring can no longer rely on simple alerts; it must become an observability system that quantifies training and inference performance, breaks data silos across data centers, servers, and networks, and provides business‑aware insights for AI infrastructure.

AI infrastructurelarge models
0 likes · 10 min read
Why Traditional Monitoring Fails for AI Supercomputing and How to Build Next‑Gen Intelligent Monitoring
Black & White Path
Black & White Path
Mar 13, 2026 · Information Security

Beware: Generative AI as a New Cybercrime Ally—13 Enterprise Attack Vectors

The article analyzes how generative AI is transforming cybercrime by enabling 13 distinct attack methods—from highly personalized phishing emails and AI‑assisted malware creation to automated vulnerability hunting, deep‑fake social engineering, malicious LLMs, and attacks on AI infrastructure—highlighting recent research data and real‑world examples that illustrate the heightened speed, stealth, and accessibility of modern threats.

AI infrastructureLLM securityMalware
0 likes · 13 min read
Beware: Generative AI as a New Cybercrime Ally—13 Enterprise Attack Vectors
AI Explorer
AI Explorer
Mar 12, 2026 · Industry Insights

Nvidia’s $26 B Bet on Open‑Source AI Models: Redefining the Industry’s Foundations

Nvidia is committing $26 billion to open‑source AI models, shifting from a pure hardware supplier to shaping the entire AI stack—from chips and system software to frameworks and applications—while raising questions about ecosystem lock‑in, competition with newcomers like DeepSeek, and the future of AI infrastructure.

AI ecosystemAI infrastructureAI strategy
0 likes · 7 min read
Nvidia’s $26 B Bet on Open‑Source AI Models: Redefining the Industry’s Foundations
AI Explorer
AI Explorer
Mar 11, 2026 · Industry Insights

Why AI Is Humanity’s Largest Infrastructure Project, Not Just an App

Jensen Huang argues that AI is a five‑layer infrastructure—from energy and chips to data centers, models and applications—forming the biggest construction effort in human history, reshaping jobs, demanding new technical talent, and accelerating growth through open‑source models.

AI ecosystemAI infrastructureEnergy
0 likes · 10 min read
Why AI Is Humanity’s Largest Infrastructure Project, Not Just an App
Didi Tech
Didi Tech
Mar 11, 2026 · Cloud Native

How Huatuo Now Monitors MetaX GPUs for Cloud‑Native AI Workloads

Huatuo, the open‑source deep‑observability platform backed by Didi, now supports real‑time monitoring of MetaX GPUs, offering detailed hardware metrics via Docker or Kubernetes deployments and exposing them through a /metrics endpoint for cloud‑native AI and operations use cases.

AI infrastructureGPU monitoringHuatuo
0 likes · 4 min read
How Huatuo Now Monitors MetaX GPUs for Cloud‑Native AI Workloads
AI Explorer
AI Explorer
Mar 6, 2026 · Artificial Intelligence

AReaL: Lightning‑Fast Asynchronous RL Engine for Building High‑Performance LLM Agents

AReaL, an open‑source, fully asynchronous reinforcement‑learning platform co‑developed by Tsinghua University and Ant Group, dramatically speeds up training of complex LLM agents, offering a simple, stable, and hardware‑flexible solution for developers seeking industrial‑grade AI agents.

AI infrastructureAReaLAsynchronous Training
0 likes · 7 min read
AReaL: Lightning‑Fast Asynchronous RL Engine for Building High‑Performance LLM Agents
AI Info Trend
AI Info Trend
Mar 6, 2026 · Industry Insights

Why AI Is Becoming the New Utility: Key Insights from Deloitte’s 2026 Tech Trends

Deloitte’s 2026 Technology Trends report reveals AI’s shift from experimental labs to essential infrastructure, outlines five major trends—including physical AI, AI agents, hybrid AI infrastructure, AI‑native organizations, and AI‑driven security—and offers actionable steps for enterprises to seize the emerging growth window.

AIAI infrastructuredigital transformation
0 likes · 8 min read
Why AI Is Becoming the New Utility: Key Insights from Deloitte’s 2026 Tech Trends
PaperAgent
PaperAgent
Mar 5, 2026 · Artificial Intelligence

Bridging Agent Runtime and RL: Inside the Claw‑R1 Training Framework

Claw‑R1, a new reinforcement‑learning framework from the USTC Cognitive Intelligence Lab, integrates the OpenClaw Agent Runtime with RL training to enable agents to learn directly in real environments, addressing the gap between simulated tasks and true tool‑calling, multi‑step reasoning, and stable long‑task execution.

AI infrastructureAgent RuntimeClaw-R1
0 likes · 10 min read
Bridging Agent Runtime and RL: Inside the Claw‑R1 Training Framework
SuanNi
SuanNi
Feb 27, 2026 · Artificial Intelligence

How Dual‑Channel Loading Doubles LLM Inference Throughput

The article analyzes the storage‑bandwidth bottleneck of agent‑style large language models, explains why traditional pre‑fill and decode architectures underutilize network resources, and details a dual‑channel loading and smart scheduling design that unlocks idle bandwidth, achieving up to 1.9× higher throughput in both offline and online inference workloads.

AI infrastructureDual-Channel LoadingKV-Cache
0 likes · 14 min read
How Dual‑Channel Loading Doubles LLM Inference Throughput
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Feb 27, 2026 · Artificial Intelligence

Can DeepSeek’s DualPath Break GPU Bottlenecks and Ignite an Agentic AI Surge?

DeepSeek’s new DualPath inference framework, co‑developed with leading Chinese universities, decouples compute from KV‑Cache memory access to eliminate I/O stalls in multi‑round agentic workloads, delivering up to nearly 2× higher throughput and dramatically reducing job‑completion time across several large‑scale LLMs.

AI infrastructureAgentic InferenceDeepSeek
0 likes · 13 min read
Can DeepSeek’s DualPath Break GPU Bottlenecks and Ignite an Agentic AI Surge?
Tencent Technical Engineering
Tencent Technical Engineering
Feb 27, 2026 · Artificial Intelligence

What Will AI Look Like in 2026? Insights from 8 Tech Giants

This article compiles and analyzes 2026 AI trend reports from eight leading technology companies, highlighting key themes such as AI agents, infrastructure, application scenarios, safety regulations, quantitative metrics, and shared consensus points to forecast the next phase of AI development.

2026 predictionsAI AgentsAI Governance
0 likes · 14 min read
What Will AI Look Like in 2026? Insights from 8 Tech Giants
Black & White Path
Black & White Path
Feb 26, 2026 · Information Security

13 Ways Attackers Leverage Generative AI to Exploit Systems

The article outlines thirteen distinct techniques by which cybercriminals exploit generative AI—from hyper‑personalized phishing and AI‑driven malware creation to AI‑coordinated espionage, deep‑fake social engineering, and attacks on AI infrastructure—backed by expert quotes, research findings, and concrete case studies.

AI AgentsAI infrastructureMalware
0 likes · 14 min read
13 Ways Attackers Leverage Generative AI to Exploit Systems
TonyBai
TonyBai
Feb 18, 2026 · Backend Development

Why We Chose Go Over Python for Building an LLM Gateway

The Bifrost team replaced Python with Go for their LLM gateway, achieving roughly 700× lower latency, 68% less memory usage, and three‑fold higher throughput, and the article explains the performance bottlenecks of Python, Go’s concurrency model, deployment advantages, and future AI infrastructure trends.

AI infrastructureConcurrencyGo
0 likes · 14 min read
Why We Chose Go Over Python for Building an LLM Gateway
Design Hub
Design Hub
Feb 16, 2026 · Industry Insights

Three AI Industry Shifts in Feb 2026: Open‑Source, Talent, and Infrastructure

In February 2026 three pivotal AI developments—OpenAI hiring OpenClaw founder Peter Steinberger, Alibaba unveiling the trillion‑parameter Qwen3‑Max‑Thinking model, and Cloudflare launching Markdown for Agents—illustrate how open‑source collaboration, talent mobility, and AI‑native infrastructure are reshaping the sector.

AI AgentsAI infrastructureCloudflare
0 likes · 14 min read
Three AI Industry Shifts in Feb 2026: Open‑Source, Talent, and Infrastructure
JD Tech Talk
JD Tech Talk
Jan 30, 2026 · Artificial Intelligence

How JD’s 9N‑LLM Engine Powers Scalable Generative Recommendation at Billion‑Scale

This article details JD Retail’s 9N‑LLM unified training engine, explaining the background of generative recommendation, the challenges of massive sparse and dense parameters, and the multi‑framework, multi‑hardware solutions—including efficient sample processing, large‑scale sparse embedding, dense scaling, UniAttention acceleration, and reinforcement‑learning integration—that enable industrial‑scale deployment.

AI infrastructureLarge‑Scale TrainingSparse Embedding
0 likes · 26 min read
How JD’s 9N‑LLM Engine Powers Scalable Generative Recommendation at Billion‑Scale
Tencent Technical Engineering
Tencent Technical Engineering
Jan 23, 2026 · Artificial Intelligence

Unlocking AI Infra: Distributed Inference, PD Separation, TileLang, and Next‑Gen Agent Infrastructure

This article surveys the 2025 AI infrastructure landscape, covering distributed inference with PD‑separation, dynamic DOPD scheduling, AFD attention‑FFN disaggregation, high‑bandwidth cross‑machine communication libraries, the TileLang programming model, RL train‑inference decoupling via SeamlessFlow, and secure, low‑latency agent infra designs for future large‑scale models.

AI infrastructureAgent SystemsGPU communication
0 likes · 27 min read
Unlocking AI Infra: Distributed Inference, PD Separation, TileLang, and Next‑Gen Agent Infrastructure
AI Engineering
AI Engineering
Jan 23, 2026 · Industry Insights

vLLM Core Team Launches Inferact, Secures $150M Seed Funding

The vLLM core maintainers have founded Inferact, raised a $150 million seed round led by Andreessen Horowitz and Lightspeed, and highlighted escalating inference challenges, the project's ecosystem dominance, and a continued commitment to open‑source development.

AI infrastructureInferactLLM inference
0 likes · 3 min read
vLLM Core Team Launches Inferact, Secures $150M Seed Funding
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 6, 2026 · Artificial Intelligence

How Tair‑KVCache‑HiSim Simulates LLM Inference 390 000× Faster with <5% Error

This article explains the design, challenges, and high‑fidelity architecture of Tair‑KVCache‑HiSim, a simulation tool that models multi‑level KV‑Cache behavior for large‑language‑model inference, predicts latency, throughput and cost under SLO constraints, and validates its predictions against real GPU deployments with sub‑5% error.

AI infrastructureCost OptimizationKVCache
0 likes · 32 min read
How Tair‑KVCache‑HiSim Simulates LLM Inference 390 000× Faster with <5% Error
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jan 5, 2026 · Artificial Intelligence

How Baidu Tianchi Supernodes Supercharge Large‑Model Inference: Architecture, Deployment, and Optimization

This article details Baidu's Tianchi supernode design and software tuning—covering hardware scale‑up, deployment planning, Prefill and Decode stage optimizations, quantization strategies, and communication schemes—to dramatically boost large‑model inference throughput and latency while lowering token‑cost.

AI infrastructureLarge Model InferenceParallelism
0 likes · 20 min read
How Baidu Tianchi Supernodes Supercharge Large‑Model Inference: Architecture, Deployment, and Optimization
Fighter's World
Fighter's World
Jan 2, 2026 · Artificial Intelligence

How AI Agents Are Redefining Systems of Record into Decision‑Making Engines

The article argues that AI agents will transform traditional Systems of Record, which only store outcomes, into next‑generation decision‑capturing Systems of Action by introducing event‑driven Context Graphs, addressing blind spots, technical challenges, and outlining strategic business paths for this paradigm shift.

AI AgentsAI infrastructureContext Graph
0 likes · 30 min read
How AI Agents Are Redefining Systems of Record into Decision‑Making Engines
Fighter's World
Fighter's World
Dec 26, 2025 · Industry Insights

Where Is AI Heading in 2026 After the 2025 Sprint?

The article analyzes the rapid weekly turnover of leading LLM benchmarks in 2025, declining compute costs, the shift from chatbots to multi‑step agents, the widening pilot‑to‑production gap, and predicts that 2026 will be defined by infrastructure constraints, AI‑first product design, and accelerated enterprise adoption.

AI Product StrategyAI TrendsAI infrastructure
0 likes · 25 min read
Where Is AI Heading in 2026 After the 2025 Sprint?
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 24, 2025 · Artificial Intelligence

Boosting LLM Inference: RoleBasedGroup & Mooncake for Stable, High‑Performance Service

Large language model inference faces memory pressure, but by externalizing KVCache with Mooncake and orchestrating roles via the Kubernetes‑native RoleBasedGroup (RBG), developers can achieve stable, high‑throughput, cost‑effective serving with seamless in‑place upgrades and topology‑aware performance.

AI infrastructureKVCacheKubernetes
0 likes · 21 min read
Boosting LLM Inference: RoleBasedGroup & Mooncake for Stable, High‑Performance Service
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Dec 24, 2025 · Artificial Intelligence

How Context Parallelism Slashes LLM First‑Token Latency by 80% for 128K Tokens

The article explains how the newly merged Context Parallelism (CP) technique in SGLang, combined with DeepSeek V3.2's Sparse Attention architecture, reduces first‑token latency by up to 80% and alleviates memory pressure for ultra‑long 128K‑token sequences, detailing both algorithmic innovations and engineering solutions.

AI infrastructureContext ParallelismLLM
0 likes · 10 min read
How Context Parallelism Slashes LLM First‑Token Latency by 80% for 128K Tokens
Amazon Cloud Developers
Amazon Cloud Developers
Dec 16, 2025 · Artificial Intelligence

Why Agent Prototypes Stall and How AgentCore Enables Scalable Enterprise AI

The article explains how the focus of enterprise AI has shifted to autonomous agents, why many prototypes fail to scale due to infrastructure gaps, and how Amazon Bedrock AgentCore combined with Anthropic's Claude provides the model capability and production‑grade services needed for real‑world deployments, illustrated by Cox Automotive and Druva case studies.

AI infrastructureAgentCoreAgentic AI
0 likes · 20 min read
Why Agent Prototypes Stall and How AgentCore Enables Scalable Enterprise AI
Fighter's World
Fighter's World
Nov 28, 2025 · Artificial Intelligence

Is Gemini 3 Pro Google’s New Starting Point? An In‑Depth Technical and Market Analysis

The article examines Google’s Gemini 3 Pro launch, highlighting its full‑stack vertical integration, advanced System 2 reasoning, dynamic compute budgeting, native multimodal architecture, TPU cost advantages, the Antigravity IDE platform, generative UI capabilities, and the strategic implications for Google’s AI ecosystem and competitive positioning.

AI infrastructureAntigravityGemini 3 Pro
0 likes · 32 min read
Is Gemini 3 Pro Google’s New Starting Point? An In‑Depth Technical and Market Analysis
Data Party THU
Data Party THU
Nov 25, 2025 · Artificial Intelligence

What $47,000 Taught Us About Deploying Multi‑Agent AI Systems

After spending $47,000 running four LangChain agents in production, we reveal the hidden costs of A2A communication and Anthropic’s MCP, expose seven common deployment pitfalls, and argue that dedicated AI infrastructure is essential for scalable multi‑agent systems.

A2A communicationAI infrastructureCost Optimization
0 likes · 13 min read
What $47,000 Taught Us About Deploying Multi‑Agent AI Systems
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Nov 25, 2025 · Artificial Intelligence

Why DeepSeek‑V3.2‑Exp Lost Performance and How a Simple RoPE Fix Restored It

The Baidu Baige team discovered that DeepSeek‑V3.2‑Exp’s long‑context performance lagged behind the official report, traced the issue to a subtle RoPE layout mismatch in the open‑source inference demo, collaborated with DeepSeek to fix it, and verified that the model’s speed and accuracy fully recovered across multiple benchmarks.

AI infrastructureDeepSeekLLM inference
0 likes · 9 min read
Why DeepSeek‑V3.2‑Exp Lost Performance and How a Simple RoPE Fix Restored It
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Nov 20, 2025 · Artificial Intelligence

Boost Multimodal Model Training Efficiency with Offline Sequence Packing and Mixed‑Modality Data

Baidu's Baige team introduces an extended multimodal data loader, automated ShareGPT format conversion, and offline sequence packing techniques that together double token throughput, cut SFT training time by up to six times, and improve GPU utilization and stability for large vision‑language models.

AI infrastructureAIAKGPU efficiency
0 likes · 7 min read
Boost Multimodal Model Training Efficiency with Offline Sequence Packing and Mixed‑Modality Data
Kuaishou Tech
Kuaishou Tech
Nov 12, 2025 · Artificial Intelligence

How KaiFG Lets Python Feature Engineering Run at C++ Speed

KaiFG, Kuaishou's self‑built AI Feature Generator, unifies fragmented feature extraction frameworks, replaces slow C++ compilation cycles with Python‑level development, and achieves near‑C++ performance through Codon‑based compilation, reference‑counted memory management, and aggressive LLVM optimizations, dramatically shortening iteration time.

AI infrastructureReference Countingfeature engineering
0 likes · 14 min read
How KaiFG Lets Python Feature Engineering Run at C++ Speed
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Nov 7, 2025 · Artificial Intelligence

From Big Data to 30,000‑GPU Clusters: The Evolution of China’s AI Infrastructure

In a deep interview, Baidu AI Computing chief scientist Wang Yanpeng and host Koji trace China's internet infrastructure from the early big‑data era through cloud computing to today's AI boom, highlighting the pivotal role of compute power, GPU acceleration, data scaling, and Baidu's Baige platform in shaping the AI arms race.

AI infrastructureBaidu BaigeCloud Computing
0 likes · 26 min read
From Big Data to 30,000‑GPU Clusters: The Evolution of China’s AI Infrastructure
21CTO
21CTO
Nov 4, 2025 · Cloud Computing

How OpenAI’s New Alliance with AWS Will Transform AI Computing

On November 3, OpenAI announced a strategic partnership with Amazon Web Services, committing $38 billion to run its AI workloads on AWS’s optimized infrastructure, including EC2 UltraServer GPU clusters, with plans to reach full capacity by the end of 2026, marking a shift from its previous Microsoft‑centric collaborations.

AI infrastructureAWSNVIDIA GPUs
0 likes · 3 min read
How OpenAI’s New Alliance with AWS Will Transform AI Computing
DataFunTalk
DataFunTalk
Nov 4, 2025 · Cloud Computing

How OpenAI’s $38B Deal with AWS Will Transform AI Cloud Computing

OpenAI announced a multi‑year strategic partnership with Amazon Web Services, worth $38 billion, granting OpenAI access to AWS’s massive GPU‑powered EC2 UltraServers and scalable CPU resources to accelerate its generative AI workloads, while leveraging AWS’s security, performance, and cost advantages.

AI infrastructureAWSCloud Computing
0 likes · 5 min read
How OpenAI’s $38B Deal with AWS Will Transform AI Cloud Computing
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Oct 29, 2025 · Cloud Native

How Alibaba Cloud’s Container Stack Evolves for the AI Era

Alibaba Cloud’s container experts unveiled a comprehensive, AI‑focused upgrade across its cloud‑native stack—introducing AMD compute, dynamic scaling, AI‑native scheduling, secure execution environments, and advanced GPU profiling—to make containers the native foundation for AI workloads and accelerate enterprise AI adoption.

AI infrastructureGPU Schedulingcontainer computing
0 likes · 9 min read
How Alibaba Cloud’s Container Stack Evolves for the AI Era
Architects' Tech Alliance
Architects' Tech Alliance
Oct 27, 2025 · Artificial Intelligence

How AI Super Nodes Are Redefining Scalable AI Infrastructure

The article examines the emerging AI Super Node ecosystem, detailing its core concepts, four‑layer architecture, key enabling technologies, current challenges such as compatibility and energy consumption, and future directions like quantum‑classic hybrids and green low‑carbon designs, illustrating how it overcomes scaling bottlenecks in modern AI deployments.

AI infrastructureDistributed ComputingSecure AI
0 likes · 13 min read
How AI Super Nodes Are Redefining Scalable AI Infrastructure
Fighter's World
Fighter's World
Oct 26, 2025 · Industry Insights

How Bitcoin Miners Are Turning Into AI Infrastructure Providers: An IREN Case Study

The article offers a comprehensive analysis of IREN's shift from Bitcoin mining to AI cloud services, detailing its dual‑engine business model, vertical integration advantages, ambitious 2025‑2028 roadmap, and the key supply‑chain, regulatory, execution, financial, and competitive risks it faces.

AI infrastructureBitcoin miningData center engineering
0 likes · 23 min read
How Bitcoin Miners Are Turning Into AI Infrastructure Providers: An IREN Case Study
BirdNest Tech Talk
BirdNest Tech Talk
Oct 24, 2025 · Backend Development

Bridging Go and Python with pyproc: Ultra‑Low‑Latency Interprocess Calls

This article introduces pyproc, a library that lets Go applications invoke Python functions via Unix Domain Sockets with sub‑45 µs latency, explaining the problem of mixing Go and Python ecosystems, the architecture, performance benefits, suitable use cases, and a step‑by‑step quick‑start guide with full code examples.

AI infrastructureGoHigh Performance
0 likes · 7 min read
Bridging Go and Python with pyproc: Ultra‑Low‑Latency Interprocess Calls
DataFunTalk
DataFunTalk
Oct 15, 2025 · Artificial Intelligence

Why OpenAI’s Massive AI Infrastructure Bet Could Redefine Computing

The article analyzes OpenAI’s recent strategic partnerships and massive AI infrastructure investments, detailing multi‑gigawatt data‑center plans, chip collaborations, soaring energy demands, and the broader implications for AI as the next global infrastructure platform.

AI chipsAI infrastructureCloud Computing
0 likes · 9 min read
Why OpenAI’s Massive AI Infrastructure Bet Could Redefine Computing
DataFunSummit
DataFunSummit
Oct 8, 2025 · Artificial Intelligence

How EasyRec Boosts Recommendation Training and Inference Performance

This article explains the EasyRec recommendation system’s training and inference architecture, detailing optimization techniques such as embedding parallelism, CPU/GPU placement, XLA and TRT fusion, online learning pipelines, network compression, and real‑world deployment results that dramatically improve throughput and latency.

AI infrastructureEasyRecinference optimization
0 likes · 15 min read
How EasyRec Boosts Recommendation Training and Inference Performance
Fighter's World
Fighter's World
Oct 7, 2025 · Industry Insights

How Many Digital Workers Could Future AI Deploy?

The article analyzes Epoch AI's token‑based framework for estimating AI‑generated digital workers, critiques its static assumptions, and proposes a dynamic, multi‑factor model that incorporates compute supply, hardware constraints, inference efficiency, task reliability, and economic value to forecast a wide range of possible future digital‑worker counts.

AIAI infrastructureAI scaling
0 likes · 27 min read
How Many Digital Workers Could Future AI Deploy?
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Sep 26, 2025 · Artificial Intelligence

How Alibaba’s UPN512 Redefines AI Scale‑Up Networking with Optical Interconnects

The UPN512 whitepaper details Alibaba Cloud's next‑generation AI infrastructure network, explaining the shift from dense to MoE models, the rise of train‑and‑inference integration, xPU scale‑up challenges, and how high‑radix Ethernet with LPO/NPO optical interconnects delivers ultra‑high bandwidth, low latency, cost‑effective, and reliable large‑scale AI compute clusters.

AI infrastructureUPN512high-performance computing
0 likes · 34 min read
How Alibaba’s UPN512 Redefines AI Scale‑Up Networking with Optical Interconnects
DevOps Cloud Academy
DevOps Cloud Academy
Sep 25, 2025 · Artificial Intelligence

How to Build Scalable MLOps Infrastructure for Enterprise AI Success

This article explains what MLOps is, why a robust MLOps framework is essential for businesses, outlines its core components, compares MLOps with AIOps, details the benefits of investing in MLOps, and provides a step‑by‑step guide to designing enterprise‑grade AI MLOps infrastructure.

AI infrastructureMLOpsMachine Learning Operations
0 likes · 17 min read
How to Build Scalable MLOps Infrastructure for Enterprise AI Success
DataFunTalk
DataFunTalk
Sep 24, 2025 · Artificial Intelligence

How OpenAI’s Quest for a Compute Empire Is Reshaping the AI Landscape

In a week OpenAI secured a $300 billion Oracle cloud deal, loosened its exclusive tie‑up with Microsoft, announced massive AI infrastructure projects, and revealed its own chip development, highlighting a strategic shift toward building an independent compute empire amid mounting financial and competitive pressures.

AI ComputeAI infrastructureOpenAI
0 likes · 22 min read
How OpenAI’s Quest for a Compute Empire Is Reshaping the AI Landscape
DataFunSummit
DataFunSummit
Sep 18, 2025 · Artificial Intelligence

How We Scaled WeChat AI Services with Ray: Lessons from Million‑Node Deployments

This article examines how Tencent's WeChat team leveraged the Ray distributed computing framework within the Astra platform to tackle massive AI workloads, addressing challenges of scale, GPU diversity, operational complexity, and cost while outlining their architecture and practical insights.

AI infrastructureAstra PlatformDistributed Computing
0 likes · 6 min read
How We Scaled WeChat AI Services with Ray: Lessons from Million‑Node Deployments
Architects' Tech Alliance
Architects' Tech Alliance
Sep 18, 2025 · Artificial Intelligence

How AI Model Training Is Redefining Data Center Scaling Strategies

Large‑scale AI model training now demands unprecedented bandwidth and latency performance, forcing data centers to adopt three scaling approaches—Scale‑up, Scale‑out, and Scale‑Across—while leveraging optical I/O, CPO, and optical circuit switching to overcome power, distance, and bandwidth limits.

AI infrastructureScale-Updata center scaling
0 likes · 11 min read
How AI Model Training Is Redefining Data Center Scaling Strategies
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Sep 9, 2025 · Artificial Intelligence

How Baidu Built a 32,000‑Card AI Super‑Compute Cluster and Boosted Efficiency by 50%

This article details Baidu Intelligent Cloud's journey in designing, constructing, and operating a 32,000‑card hybrid AI compute cluster, covering challenges in power, cooling, networking, multi‑cluster scheduling, and security, and explains how innovative hardware, software, and operational strategies achieved over 50% MFU improvement and industry‑first performance records.

AI infrastructureGPU clustershybrid cloud
0 likes · 15 min read
How Baidu Built a 32,000‑Card AI Super‑Compute Cluster and Boosted Efficiency by 50%
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Aug 22, 2025 · Artificial Intelligence

Building Scalable AI Infrastructure: Insights from Alibaba Cloud’s AI Tech Day

The AI Infra Solutions and Best Practices salon held by Alibaba Cloud in Beijing gathered technical leaders from leading AI companies to share comprehensive strategies on network, compute, and storage architectures that enable high‑efficiency, low‑latency, and elastic AI infrastructure for modern enterprise workloads.

AI OpsAI infrastructureCloud Computing
0 likes · 7 min read
Building Scalable AI Infrastructure: Insights from Alibaba Cloud’s AI Tech Day
Architects' Tech Alliance
Architects' Tech Alliance
Aug 18, 2025 · Artificial Intelligence

How Large Model Training Dominates Compute and What New Techniques Can Change It

This article explains why pre‑training large AI models consumes 90‑99% of total compute, describes the full training and inference pipelines, introduces resource‑saving strategies such as PD‑separation, and reviews market trends and infrastructure challenges shaping the next generation of AI systems.

AI infrastructureGPU architectureai-training
0 likes · 13 min read
How Large Model Training Dominates Compute and What New Techniques Can Change It
Baobao Algorithm Notes
Baobao Algorithm Notes
Aug 11, 2025 · Industry Insights

Why AI Infrastructure Must Be Close to Models and Hardware – Insights from Zhu Yibo

In a WAIC 2025 interview, Zhu Yibo, co‑founder of Jiejie Xingchen, shares deep insights on AI infrastructure, covering its evolution, the need for tight model‑hardware co‑design, cost‑efficiency metrics, industry challenges, and future directions for large‑scale AI systems.

AI infrastructurehardware optimizationindustry insights
0 likes · 36 min read
Why AI Infrastructure Must Be Close to Models and Hardware – Insights from Zhu Yibo
Architects' Tech Alliance
Architects' Tech Alliance
Aug 2, 2025 · Artificial Intelligence

How China’s Computing‑Power Strategy Is Powering the AI Future

China’s computing‑power industry is rapidly maturing as national policies, massive infrastructure investments, and domestic chip development converge to create a strategic high‑ground that fuels AI, data centers, and digital‑economy transformation, with clear upstream, mid‑stream, and downstream value chains.

AI infrastructureChina policycomputing power
0 likes · 9 min read
How China’s Computing‑Power Strategy Is Powering the AI Future
DataFunTalk
DataFunTalk
Jul 25, 2025 · Artificial Intelligence

How the U.S. AI Action Plan Aims to Lead the Global AI Race

The U.S. AI Action Plan outlines a three‑pillar strategy—accelerating AI innovation, building robust AI infrastructure, and asserting leadership in international AI diplomacy and security—to secure America’s technological dominance, protect national interests, and ensure AI benefits American workers and society.

AI GovernanceAI competitionAI infrastructure
0 likes · 44 min read
How the U.S. AI Action Plan Aims to Lead the Global AI Race
AI Info Trend
AI Info Trend
Jul 24, 2025 · Industry Insights

What’s Driving AI Adoption in 2025? Six Key Trends Uncovered

The AI Adoption Survey H1 2025 reveals that nearly half of organizations have deployed AI in production, engineering and R&D lead usage, Chinese LLMs gain overseas interest, and cost, reliability and intelligence remain the top challenges, while tool preferences and multimodal trends reshape the market.

AI AdoptionAI TrendsAI infrastructure
0 likes · 7 min read
What’s Driving AI Adoption in 2025? Six Key Trends Uncovered
Architects' Tech Alliance
Architects' Tech Alliance
Jul 22, 2025 · Artificial Intelligence

Will AI Backend Networks Exceed $100 B in Spending by 2029? The Ethernet Surge Explained

Driven by exploding AI workloads, the data‑center networking landscape is shifting toward four distinct networks—Compute Fabric, Backend, Front‑end, and DCI—with forecasts showing AI backend network spend surpassing $100 billion by 2029, Ethernet outpacing InfiniBand, and massive port‑speed upgrades reshaping the market.

AIAI infrastructureBackend
0 likes · 9 min read
Will AI Backend Networks Exceed $100 B in Spending by 2029? The Ethernet Surge Explained
Tencent Technical Engineering
Tencent Technical Engineering
Jul 18, 2025 · Artificial Intelligence

From CPUs to GPUs: How Traditional Backend Skills Power Modern AI Infrastructure

This article explores the evolution of AI infrastructure, comparing it with traditional backend systems, and details how hardware shifts to GPU-centric designs, software adaptations like deep learning frameworks, and engineering challenges in model training and inference can be addressed using established backend methodologies.

AI infrastructureGPU computingdeep learning
0 likes · 19 min read
From CPUs to GPUs: How Traditional Backend Skills Power Modern AI Infrastructure
Volcano Engine Developer Services
Volcano Engine Developer Services
Jul 17, 2025 · Artificial Intelligence

How Distributed KVCache (EIC) Revolutionizes Large‑Model Inference Performance

This article examines how Volcano Engine's Elastic Instant Cache (EIC) tackles the memory bottleneck, high‑concurrency latency, and cross‑node coordination challenges of large language model inference by decoupling storage and computation, pooling resources, and applying layered optimizations, ultimately boosting AI inference efficiency, scalability, and cost‑effectiveness across various deployment scenarios.

AI infrastructureKVCacheLLM inference
0 likes · 30 min read
How Distributed KVCache (EIC) Revolutionizes Large‑Model Inference Performance
Tencent Cloud Developer
Tencent Cloud Developer
Jul 17, 2025 · Artificial Intelligence

Why GPUs Are the New CPUs: Unpacking AI Infrastructure Challenges

This article explores how AI infrastructure has shifted from CPU‑centric designs to GPU‑driven architectures, detailing hardware evolution, software changes, and the engineering challenges of large‑model training and inference, while offering practical insights for traditional backend engineers transitioning to AI systems.

AI infrastructureGPU computingdeep learning
0 likes · 16 min read
Why GPUs Are the New CPUs: Unpacking AI Infrastructure Challenges
DataFunTalk
DataFunTalk
Jul 15, 2025 · Artificial Intelligence

Inside Scale AI: How a Data‑Labeling Startup Became a $29 B AI Powerhouse

This investigative article traces Scale AI’s evolution from a MIT‑dropout’s data‑annotation startup to a $29 billion AI infrastructure leader, detailing its founder Alexandr Wang, core products, government contracts, competitive advantages, and the strategic shift toward defense‑focused AI solutions.

AI infrastructureArtificial IntelligenceScale AI
0 likes · 15 min read
Inside Scale AI: How a Data‑Labeling Startup Became a $29 B AI Powerhouse
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jul 11, 2025 · Cloud Native

How Alibaba Cloud’s AI Infra Innovations Are Transforming Kubernetes Workloads

This article summarizes Alibaba Cloud’s key technical contributions at KubeCon China 2025, covering AI‑focused Kubernetes optimizations, Argo Workflows enhancements, storage strategies for large models, Fluid’s data orchestration, multi‑tenant security, and the RoleBasedGroup framework for PD‑separated AI inference.

AI infrastructureArgo WorkflowsFluid
0 likes · 20 min read
How Alibaba Cloud’s AI Infra Innovations Are Transforming Kubernetes Workloads
IT Services Circle
IT Services Circle
Jun 23, 2025 · Artificial Intelligence

How the Emerging Computing Power Internet Will Transform AI and Data Services

The article explains the concept, background, definition, challenges, roadmap, and key application scenarios of China's Computing Power Internet, highlighting its role in unifying fragmented compute resources, enabling on‑demand AI services, and driving nationwide digital transformation.

AI infrastructureCloud ComputingNetwork Architecture
0 likes · 11 min read
How the Emerging Computing Power Internet Will Transform AI and Data Services
AntTech
AntTech
Jun 18, 2025 · Artificial Intelligence

How Ant Group’s Baoling Models Push Toward AGI with MoE and Multimodal Innovations

In a detailed AICon talk, Ant Group’s Baoling team leader Zhou Jun outlines their latest large‑model training techniques, MoE architecture optimizations, multimodal breakthroughs, open‑source releases, and the strategic roadmap needed to turn AI into a ubiquitous, “scan‑code‑level” everyday assistant.

AI infrastructureMixture of Expertslarge language models
0 likes · 25 min read
How Ant Group’s Baoling Models Push Toward AGI with MoE and Multimodal Innovations
DataFunTalk
DataFunTalk
Jun 15, 2025 · Artificial Intelligence

Sam Altman Reveals the ‘Stargate’ AI Infrastructure Blueprint and Its $500B Future

In a Bloomberg Originals interview, OpenAI CEO Sam Altman discusses the massive “Stargate” infrastructure project, exploding demand for AI compute, multi‑partner collaborations, a projected $500 billion investment, GPU bottlenecks, and his vision for AI’s role in science, employment and humanity’s future.

AI fundingAI futureAI infrastructure
0 likes · 25 min read
Sam Altman Reveals the ‘Stargate’ AI Infrastructure Blueprint and Its $500B Future
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
May 23, 2025 · Artificial Intelligence

How Baidu’s Kunlun Supernode Redefines AI Compute Density and Performance

This article explains how Baidu’s Kunlun supernode, built on high‑density liquid‑cooled cabinets and a modular 1U 4‑card design, breaks traditional 8‑card limits, boosts compute density four‑fold, improves power and cooling efficiency, and provides a scalable foundation for large‑model AI training and inference.

AI infrastructureGPU clusterhigh-performance computing
0 likes · 13 min read
How Baidu’s Kunlun Supernode Redefines AI Compute Density and Performance
AntData
AntData
May 20, 2025 · Artificial Intelligence

How Vector Retrieval Powers AI: Challenges, Solutions, and VSAG’s Open‑Source Breakthrough

The article examines the rapid growth of unstructured data, explains the fundamentals and resource‑intensive nature of vector retrieval, presents Ant Group’s engineering practices—including hybrid HNSW‑DiskANN indexing, performance tricks like BSA pruning and memory prefetching, sparse‑vector and feedback‑driven recall improvements—and outlines the open‑source VSAG roadmap and ecosystem integrations.

AI infrastructurePerformance OptimizationVector Retrieval
0 likes · 18 min read
How Vector Retrieval Powers AI: Challenges, Solutions, and VSAG’s Open‑Source Breakthrough
AI Product Manager Community
AI Product Manager Community
May 20, 2025 · Industry Insights

How Nvidia Is Shaping the Future of AI Infrastructure and Physical AI

At the 2025 Taipei International Computer Expo, Nvidia CEO Jensen Huang outlined the company's shift from a chipmaker to an AI infrastructure leader, introduced the concept of physical AI, and detailed upcoming hardware, software, and strategic initiatives that could reshape data centers, robotics, and autonomous driving.

AI infrastructureArtificial IntelligenceNVIDIA
0 likes · 7 min read
How Nvidia Is Shaping the Future of AI Infrastructure and Physical AI
Architects' Tech Alliance
Architects' Tech Alliance
May 11, 2025 · Industry Insights

Why China’s Intelligent Computing Centers Are Poised for Explosive Growth

The article analyzes China’s rapid expansion of intelligent computing centers, covering market forecasts, government policies, regional deployment patterns, major telecom operators' strategies, the industry value chain, and future trends that together signal a sustained surge in AI‑focused compute infrastructure across the nation.

AI infrastructureChinaHPC
0 likes · 11 min read
Why China’s Intelligent Computing Centers Are Poised for Explosive Growth
Fighter's World
Fighter's World
May 2, 2025 · Industry Insights

Token Economics Reveals Nvidia’s New AI Factory Narrative

The article analyses Nvidia’s shift from a chip supplier to a full‑stack AI infrastructure provider called AI Factory, explains the token‑economics framework that measures intelligent output, details the hardware‑software stack and network fabric, quantifies token consumption of advanced agents, and evaluates the strategic opportunities and risks for Nvidia.

AI factoryAI infrastructureAgentic AI
0 likes · 29 min read
Token Economics Reveals Nvidia’s New AI Factory Narrative
Past Memory Big Data
Past Memory Big Data
Apr 19, 2025 · Artificial Intelligence

Databricks Acquires Fennel: Is Real-Time Computing + AI the Ultimate Data Platform?

The article examines Databricks' acquisition of the incremental computation engine Fennel, detailing how its unified batch‑stream processing, incremental updates, Python‑native development, and built‑in data governance can eliminate data silos, cut costs by up to 90 % and accelerate real‑time feature engineering for AI models, while also discussing industry impact and future roadmap.

AI infrastructureDatabricksFennel
0 likes · 6 min read
Databricks Acquires Fennel: Is Real-Time Computing + AI the Ultimate Data Platform?
Baidu Geek Talk
Baidu Geek Talk
Apr 14, 2025 · Artificial Intelligence

PaddlePaddle Framework 3.0: Five Core Breakthroughs Reshaping Large Model Development

PaddlePaddle Framework 3.0 delivers five breakthroughs—dynamic‑static unified automatic parallelism, integrated training‑inference pipelines, high‑order scientific differentiation, a neural‑network compiler with automatic operator fusion, and streamlined heterogeneous chip adaptation—drastically reducing development effort, boosting training speed, and expanding compatibility for large‑scale AI models.

AI infrastructureDistributed TrainingModel Inference Optimization
0 likes · 23 min read
PaddlePaddle Framework 3.0: Five Core Breakthroughs Reshaping Large Model Development
Fighter's World
Fighter's World
Mar 29, 2025 · Industry Insights

A Year in AI: Key Insights from the Unsupervised Learning & Latent Space Podcast

The podcast recap dissects a year of rapid AI change, highlighting surprise‑fast open‑source model releases, shifting foundation‑model dynamics, the rise of GPT wrappers, over‑hyped agents, undervalued memory, product‑market fit debates, infrastructure opportunities, and lingering mysteries like RL in non‑verifiable domains.

AI TrendsAI infrastructureAgents
0 likes · 22 min read
A Year in AI: Key Insights from the Unsupervised Learning & Latent Space Podcast
Baobao Algorithm Notes
Baobao Algorithm Notes
Mar 13, 2025 · Artificial Intelligence

Why EP Outperforms TP for Deepseek V3/R1 Inference: Cost, Performance, and Reliability

This article analyzes Deepseek's EP‑based inference architecture for V3/R1 models, comparing it with TP, detailing how EP reduces memory and compute overhead, boosts batch size, cuts GPU memory usage, and introduces reliability, scalability, and maintainability challenges for large‑scale deployments.

AI infrastructureExpert ParallelismGPU memory optimization
0 likes · 18 min read
Why EP Outperforms TP for Deepseek V3/R1 Inference: Cost, Performance, and Reliability
Architects' Tech Alliance
Architects' Tech Alliance
Mar 9, 2025 · Industry Insights

DeepSeek’s AI Ecosystem: From Core Tech to Market Impact

This article provides a comprehensive analysis of DeepSeek, covering its foundational AI research, technology stack, product offerings, and the broader upstream, midstream, and downstream AI industry landscape, including hardware, server, cloud, and market trends.

AI infrastructureArtificial IntelligenceDeepSeek
0 likes · 13 min read
DeepSeek’s AI Ecosystem: From Core Tech to Market Impact
AntData
AntData
Mar 5, 2025 · Cloud Native

DeepSeek 3FS Network Communication Module: Design, Implementation, and Impact on AI Infrastructure

This article provides an in‑depth analysis of DeepSeek's open‑source 3FS distributed storage system, focusing on its network communication module, RDMA‑based design, core classes such as IBSocket, Listener, and IOWorker, and how these innovations advance high‑performance AI infrastructure.

AI infrastructureFolly CoroutinesHigh Performance
0 likes · 15 min read
DeepSeek 3FS Network Communication Module: Design, Implementation, and Impact on AI Infrastructure
dbaplus Community
dbaplus Community
Feb 23, 2025 · Databases

Why Vector Databases Are Really Just Search Engines in Disguise

The article traces the evolution of embedding technology from a secret weapon of tech giants to a mainstream developer tool, explains the rapid rise and subsequent integration of vector databases into traditional search engines, and argues that vector databases are essentially search engines with added vector capabilities.

AI infrastructureEmbeddingsRAG
0 likes · 9 min read
Why Vector Databases Are Really Just Search Engines in Disguise
Architects' Tech Alliance
Architects' Tech Alliance
Feb 19, 2025 · Industry Insights

Why DeepSeek One‑Stop AI Machines Are Redefining Private Model Deployment

The surge in demand for private AI deployment has prompted multiple vendors to launch DeepSeek one‑stop machines—integrated hardware solutions that support the full DeepSeek model family, offering higher stability, easier setup, customization, cost savings, and data security across diverse industry scenarios.

AI hardwareAI infrastructureDeepSeek
0 likes · 7 min read
Why DeepSeek One‑Stop AI Machines Are Redefining Private Model Deployment
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jan 20, 2025 · Cloud Computing

2024 Alibaba Cloud Infrastructure Network Team: AI‑Scale Network Innovations, Academic Achievements, Open‑Source Contributions and Industry Outreach

The 2024 report of Alibaba Cloud's Infrastructure Network team details AI‑driven network breakthroughs, high‑performance protocol stacks, large‑scale monitoring systems, numerous top‑conference paper acceptances, open‑source ecosystem initiatives, and extensive industry outreach, highlighting the evolving AI infra landscape.

AI infrastructureConference PapersData Center Networking
0 likes · 19 min read
2024 Alibaba Cloud Infrastructure Network Team: AI‑Scale Network Innovations, Academic Achievements, Open‑Source Contributions and Industry Outreach
DataFunSummit
DataFunSummit
Dec 30, 2024 · Artificial Intelligence

Colossal-AI: A Scalable Framework for Distributed Training of Large Models

This presentation introduces the challenges of the large‑model era, describes the Colossal‑AI architecture—including N‑dimensional parallelism, heterogeneous storage, and zero‑code experience—shows benchmark results and real‑world use cases, and answers audience questions about its integration with PyTorch and advanced parallel strategies.

AI infrastructureBenchmarkColossal-AI
0 likes · 11 min read
Colossal-AI: A Scalable Framework for Distributed Training of Large Models
AI Cyberspace
AI Cyberspace
Dec 17, 2024 · Artificial Intelligence

Why AWS’s Self‑Designed Chips Are Redefining AI Infrastructure

At AWS re:Invent 2024, Amazon unveiled its self‑designed AI hardware trio—Graviton 4 CPU, Nitro 5 DPU, and Trainium 2 accelerator—explaining the innovation, efficiency, and cost advantages driving the strategy, and detailing how these chips power next‑generation cloud services, ultra‑high‑performance servers, and massive AI super‑computing clusters.

AI hardwareAI infrastructureAWS
0 likes · 20 min read
Why AWS’s Self‑Designed Chips Are Redefining AI Infrastructure
Alibaba Cloud Developer
Alibaba Cloud Developer
Nov 28, 2024 · Artificial Intelligence

Mooncake: Open-Source KVCache-Centric Architecture Boosting Large-Model Inference

Mooncake, an open-source KVCache-centric inference architecture co-developed by Alibaba Cloud and Tsinghua University's MADSys lab, dramatically improves large-model throughput and reduces cost by decoupling resources, standardizing cache pooling, and integrating with frameworks like vLLM, sparking broad industry interest.

AI infrastructureKVCachelarge language models
0 likes · 4 min read
Mooncake: Open-Source KVCache-Centric Architecture Boosting Large-Model Inference
DevOps
DevOps
Nov 27, 2024 · Artificial Intelligence

Elon Musk’s Colossus Supercomputer: Building 100,000 GPUs in 122 Days and Its Impact on AI Infrastructure

The article analyzes Elon Musk’s Colossus AI supercomputer—its 100,000 NVIDIA H100 GPUs, record‑fast 122‑day construction, vertical‑integration strategy, and the broader implications for U.S. AI infrastructure dominance and China’s competing challenges in funding and chip supply.

AI infrastructureAI strategyElon Musk
0 likes · 13 min read
Elon Musk’s Colossus Supercomputer: Building 100,000 GPUs in 122 Days and Its Impact on AI Infrastructure