This article analyzes Milvus—its open‑source origins, three deployment modes, four‑layer architecture, eight‑plus indexing algorithms, real‑world case studies, and a detailed comparison with competitors—highlighting its strengths, weaknesses, common pitfalls, and when it’s the right choice for large‑scale AI workloads.
Oracle claims a new era for MySQL by moving commercial‑only features to the community edition and adding AI‑focused vector functions, but developers question whether these promises are timely or sufficient, fearing continued neglect of the open‑source community.
The article analyzes NVIDIA's newly announced cuTile, a tile‑based Python DSL for GPU kernels, examining its technical differences from CUDA's SIMT model, its potential to reshape the GPU programming ecosystem, community reactions, competition with Triton, and the uncertain future that hinges on ecosystem maturity and migration tools.
Explore the 15 most impactful Kubernetes scenarios—from microservices and auto‑scaling to multi‑cloud deployments, AI workloads, edge computing, and compliance—detailing how they boost reliability, efficiency, and cost‑effectiveness, while also highlighting situations where Kubernetes may not be the right choice.
Fluid introduces a cloud‑native elastic data abstraction that lets AI workloads efficiently access, manage, and accelerate heterogeneous data sources across serverful and serverless environments, offering unified Dataset, Runtime, and DataOperation concepts, and has been recognized by CNCF’s 2024 Technology Radar.
This article presents a detailed comparison of major NVIDIA GPUs—including RTX 4090, RTX 4090 D, RTX 3090, A10, A40, A100, and H100—covering memory size, bandwidth, Tensor BF16/FP16/FP32 throughput, FP16/FP32 performance, power draw and release dates, and explains how these specs affect AI workload efficiency.
The article analyzes how Co‑Packaged Optics (CPO) and silicon photonics address exploding data‑center bandwidth demands, reduce power consumption, and enable AI‑driven workloads, while outlining industry roadmaps, major vendor contributions, and future technical challenges.
In an interview, Alibaba Cloud’s distributed cloud‑native platform lead explains how distributed cloud‑native addresses elasticity, high‑availability, and multi‑cluster management challenges, outlines the evolution of ACK One, and forecasts its role in AI and edge computing for modern enterprises.
The article explains the mGPU solution from Volcano Engine, detailing its kernel‑level GPU virtualization, container runtime hooks, and scheduling mechanisms that allow multiple containers to share a single NVIDIA GPU with isolated compute and memory resources, achieving near‑lossless performance and up to 50% higher utilization for AI tasks.
The article examines the rapid growth of AI‑driven compute demand, explains why conventional ECMP load balancing struggles with uneven, high‑bandwidth flows in data‑center networks, and compares advanced strategies such as Fat‑Tree design, VoQ, flow‑based, packet‑based, flowlet, and cell‑based approaches, including vendor implementations.
As AI workloads push intelligent compute power growth beyond 50% CAGR, data‑center networks face massive parallel paths, making traditional ECMP load‑balancing insufficient and causing severe congestion, while newer granular schemes such as packet‑spraying, flowlet, and cell‑based balancing offer higher bandwidth utilization and fairness.
This article explains how Kubernetes supports GPU workloads for AI and machine learning, covering device plugins, pod GPU requests, oversubscription, security isolation, cloud‑provider node setup, and protecting GPU nodes from non‑GPU pods.
Baidu Intelligent Cloud’s GPU Container Virtualization 2.0 combines user‑mode and kernel‑mode isolation in a dual‑engine design that unifies scheduling of AI compute, rendering and encoding, supports mixed deployment and multi‑scheduler integration, and boosts GPU utilization across inference, offline tasks, autonomous‑driving simulation, and cloud‑gaming workloads.
This article explains Baidu Intelligent Cloud’s GPU container virtualization 2.0, detailing its dual‑engine architecture, resource pooling, and scheduling innovations that isolate AI, rendering, and codec workloads, and showcases real‑world scenarios such as online inference, autonomous‑driving simulation, and cloud gaming to improve GPU utilization.
