Skip to content
Tagged articles

GPU

500 articles · Page 1 of 5
Frontline Investigation
Frontline Investigation
Nov 17, 2026 · Artificial Intelligence

What the CPU Does While AI Builds Your Spreadsheet

The article explains how AI agents divide spreadsheet tasks between language models on GPUs and traditional programs on CPUs, detailing the tool-use loop, data cleaning, file I/O, and why speeding up only the model yields limited overall gains.

AI agentsCPUGPU
0 likes · 11 min read
What the CPU Does While AI Builds Your Spreadsheet
MaGe Linux Operations
MaGe Linux Operations
Nov 7, 2026 · Artificial Intelligence

LoRA/QLoRA Fine-Tuning on a Single GPU: Practical Guide for 7B/13B Models

This comprehensive guide walks through efficient LoRA/QLoRA fine-tuning of 7B and 13B language models on a single 24GB GPU, covering memory budgeting, environment setup, data preparation, training configuration, evaluation strategies, model merging, deployment verification, and production best practices with concrete code examples and benchmarks.

Fine-tuningGPUHuggingFace
0 likes · 78 min read
LoRA/QLoRA Fine-Tuning on a Single GPU: Practical Guide for 7B/13B Models
Architects' Tech Alliance
Architects' Tech Alliance
Nov 6, 2026 · Artificial Intelligence

Harvard GPU Lecture Notes: Roofline Analysis of LLM Inference on Hopper & Blackwell

Harvard lecture notes explain GPU hardware principles for LLMs, using the Roofline model to contrast compute-bound prefill vs. memory-bound decode phases, detailing Hopper/Blackwell architectures, memory hierarchy, multi-GPU scaling, and comparing NVIDIA with AMD MI355X, Google TPU Ironwood, and AWS Trainium3 accelerators.

AI AcceleratorsBlackwell ArchitectureGPU
0 likes · 9 min read
Harvard GPU Lecture Notes: Roofline Analysis of LLM Inference on Hopper & Blackwell
IT Learning Made Simple
IT Learning Made Simple
Oct 31, 2026 · Fundamentals

How to Read PC Specs: CPU, Memory, GPU & Storage Explained

This guide explains key hardware specifications — CPU clock speed, cores, threads, cache, process node, TDP; memory capacity, DDR generation, frequency, timing, channels; GPU model, CUDA cores, VRAM, bus width; storage types and speeds — with generation comparisons and budget-based buying recommendations.

CPUGPUMemory
0 likes · 11 min read
How to Read PC Specs: CPU, Memory, GPU & Storage Explained
IT Learning Made Simple
IT Learning Made Simple
Oct 27, 2026 · Fundamentals

Why AI Requires GPUs: CPU vs GPU Architecture Deep Dive

This article explains the fundamental architectural differences between CPUs and GPUs, detailing why AI workloads rely on GPU parallelism, comparing core counts, memory bandwidth, and CUDA ecosystem dominance, while covering GPU types, key specifications, and future heterogeneous computing trends.

AICPUCUDA
0 likes · 10 min read
Why AI Requires GPUs: CPU vs GPU Architecture Deep Dive
Ops Community
Ops Community
Oct 24, 2026 · Operations

High Availability for LLM Inference: Health Checks, Warmup, Failover & Degradation

This article details a production-grade high-availability framework for vLLM-based LLM inference services on Kubernetes, covering layered health checks, multi-level model warmup, automated failover, degradation strategies, metrics-driven alerting, and troubleshooting patterns derived from real incidents.

FailoverGPUHigh Availability
0 likes · 57 min read
High Availability for LLM Inference: Health Checks, Warmup, Failover & Degradation
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Oct 8, 2026 · Artificial Intelligence

AI Large Model GPUs Explained: Parallel Computing, HBM & Chip Comparison

This article explains why GPUs are essential for AI large models, detailing their parallel computing architecture, high-bandwidth memory (HBM), and multi-GPU interconnect technologies, then compares mainstream AI chips including NVIDIA's H100, H200, B200, AMD's MI300X, MI350X, and Google TPU across architecture, memory, bandwidth, and target workloads.

AI large modelsAMD MI300XGPU
0 likes · 5 min read
AI Large Model GPUs Explained: Parallel Computing, HBM & Chip Comparison
MaGe Linux Operations
MaGe Linux Operations
Oct 4, 2026 · Operations

NVIDIA Container Toolkit Practical Guide: Enable GPU Access for Docker Containers

This comprehensive guide covers installing and configuring NVIDIA Container Toolkit for Docker GPU access, including version pinning, runtime registration, Compose deployment, image building, non-root execution, CDI, offline installation, capacity planning, and upgrade/rollback procedures with concrete commands and verification steps.

CUDAGPUOffline Deployment
0 likes · 50 min read
NVIDIA Container Toolkit Practical Guide: Enable GPU Access for Docker Containers
Architects' Tech Alliance
Architects' Tech Alliance
Aug 29, 2026 · Artificial Intelligence

How to Decode AI Chip Compute Units and Avoid Common Pitfalls

The article explains why a single GPU can show multiple compute figures, clarifies the meanings of FLOPS, TOPS, precision levels and structured sparsity, demonstrates calculations with RTX 5090 and H100, and provides practical guidance for interpreting theoretical peaks versus real‑world performance.

AIFLOPSGPU
0 likes · 13 min read
How to Decode AI Chip Compute Units and Avoid Common Pitfalls
Architects' Tech Alliance
Architects' Tech Alliance
Aug 23, 2026 · Industry Insights

GPU Prices Surge Over 15%: HBM Cost Spike and AI Infrastructure Impact

Nvidia has warned core customers that rising high‑bandwidth memory (HBM) costs will push prices of its Grace Blackwell and next‑gen Vera Rubin AI servers up by more than 15%, a hike that is already affecting major cloud providers, driving up server and compute‑as‑a‑service fees and prompting cloud vendors to accelerate their own chip development.

AI infrastructureGPUHBM
0 likes · 8 min read
GPU Prices Surge Over 15%: HBM Cost Spike and AI Infrastructure Impact
Ops Community
Ops Community
Aug 22, 2026 · Operations

Five Overlooked Runtime Risks When Deploying Large Language Models on Kubernetes

Deploying large‑model inference services on Kubernetes can hide five critical runtime risks—such as premature traffic before model loading, GPU memory overflow, LivenessProbe mis‑kills, slow HPA scaling, and missing logs—that only surface under production load, leading to timeouts, crashes, and costly debugging.

AIGPUHPA
0 likes · 33 min read
Five Overlooked Runtime Risks When Deploying Large Language Models on Kubernetes
Linyb Geek Road
Linyb Geek Road
Aug 13, 2026 · Artificial Intelligence

SRAM vs DRAM vs HBM: A Complete Memory Hierarchy for the AI Era

The article provides a detailed technical comparison of SRAM, DRAM and HBM, explains their roles in modern AI GPUs such as the H100, discusses training and inference memory placement, and evaluates emerging ideas like High‑Bandwidth SRAM and High‑Bandwidth Flash, concluding that all three memory types will coexist in future AI systems.

AI hardwareDRAMGPU
0 likes · 12 min read
SRAM vs DRAM vs HBM: A Complete Memory Hierarchy for the AI Era
Mike Chen Rui
Mike Chen Rui
Aug 11, 2026 · Artificial Intelligence

Why GPUs Power Today's AI Large Models: A Complete Technical Overview

The article explains how GPUs, originally built for graphics, have become the engine behind AI large models, detailing their advantages in matrix computation, memory bandwidth and interconnect, and reviewing the leading GPUs such as NVIDIA A100, H100, H200, B200, AMD Instinct MI300X and Intel Gaudi 3.

AIAMDGPU
0 likes · 4 min read
Why GPUs Power Today's AI Large Models: A Complete Technical Overview
Tencent Technical Engineering
Tencent Technical Engineering
Aug 5, 2026 · Artificial Intelligence

Advanced AI Infra: Making Large Language Models Produce Deterministic Outputs

This article analyzes why LLM inference often yields nondeterministic results, explains how floating‑point addition order, GEMM tiling, Split‑K, RMSNorm, FlashAttention, and NCCL all contribute to batch variance, and details the engineering steps vLLM takes to enforce batch‑invariant execution across GPUs.

Batch InvarianceDeterminismFlashAttention
0 likes · 52 min read
Advanced AI Infra: Making Large Language Models Produce Deterministic Outputs
Architects' Tech Alliance
Architects' Tech Alliance
Aug 3, 2026 · Artificial Intelligence

Understanding AI Workstations vs. AI Servers: Architecture, Use Cases, and Classification

The article explains what an AI workstation is, its key components such as GPUs or NPUs, large memory, high bandwidth and efficient cooling, how it bridges desktop PCs and rack servers, and classifies workstations by form factor and compute level while referencing a 2026 global AI compute report.

AI acceleratorAI workstationGPU
0 likes · 3 min read
Understanding AI Workstations vs. AI Servers: Architecture, Use Cases, and Classification
Golang Shines
Golang Shines
Aug 2, 2026 · Cloud Native

GPU Scheduling, Isolation, and Resource Allocation in Kubernetes Clusters

This guide explains why a GPU‑enabled node may show devices with nvidia‑smi yet keep Pods pending, walks through the complete node‑to‑container GPU path, and provides step‑by‑step procedures for device discovery, Device Plugin configuration, isolation models (full‑card, time‑slicing, MIG), scheduling constraints, quota management, multi‑GPU training, troubleshooting pending Pods, and monitoring with DCGM metrics.

Device PluginGPUKubernetes
0 likes · 33 min read
GPU Scheduling, Isolation, and Resource Allocation in Kubernetes Clusters
DeepHub IMBA
DeepHub IMBA
Aug 1, 2026 · Artificial Intelligence

Estimating the GPU Count Needed to Train a Large Language Model

The article presents a practical scaling‑law based method to estimate the total FLOPs, GPU throughput, and required number of GPUs for training a large language model, showing how to compute these values from model parameters, token count, and target training time, and discusses approximation limits and useful tools.

AICompute EstimationGPU
0 likes · 9 min read
Estimating the GPU Count Needed to Train a Large Language Model
IT Services Circle
IT Services Circle
Jul 27, 2026 · Industry Insights

Why the First GPU Freeze in 27 Years Might Actually Benefit Gamers

After NVIDIA announced a new round of price hikes for GPU cores and memory, the RTX 50 series faces soaring costs and delayed releases, but rapid software advances like DLSS 5, aggressive texture compression, and longer‑lasting hardware could turn the slowdown into a win for everyday gamers.

AI UpscalingDLSS 5GPU
0 likes · 13 min read
Why the First GPU Freeze in 27 Years Might Actually Benefit Gamers
Architects' Tech Alliance
Architects' Tech Alliance
Jul 26, 2026 · Industry Insights

Deep Reverse‑Engineering of Huawei Kirin 9030: Architecture, PPA, and N+3 Process Insights

SemiAnalysis’s STEEL lab dissects the Kirin 9030 SoC built on SMIC’s N+3 node, revealing its die layout, CPU/GPU/NPU micro‑architectural changes, performance‑per‑area trade‑offs, and the impact of export‑control‑driven process choices compared with TSMC N6‑based competitors such as the Helio G99, Apple, and Qualcomm.

GPUKirin 9030N+3 process
0 likes · 14 min read
Deep Reverse‑Engineering of Huawei Kirin 9030: Architecture, PPA, and N+3 Process Insights
Machine Heart
Machine Heart
Jul 23, 2026 · Fundamentals

Running CUDA Code on Apple GPU with Minimal Kernel Changes

A CUDA/HIP‑based 3‑D fluid simulation was ported to an Apple M3 Pro device via a Clang‑HIP → SPIR‑V → Vulkan → MoltenVK conversion pipeline, achieving roughly ten‑fold speedup without any Metal‑specific API changes and preserving numerical accuracy.

3D fluid simulationCUDAGPU
0 likes · 7 min read
Running CUDA Code on Apple GPU with Minimal Kernel Changes
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Jul 23, 2026 · Artificial Intelligence

HELMSMAN: Redefining Large-Scale Vector Retrieval on All‑Flash Servers (OSDI 2026)

HELMSMAN replaces DRAM‑heavy graph indexes with a clustering‑based, SSD‑first ANN system that uses a custom SPDK storage stack, adaptive LLSP pruning, and a GPU‑CPU construction pipeline, achieving 2‑16× throughput, up to 85% of in‑memory performance, and over 90% hardware cost reduction for billion‑scale search workloads.

Approximate Nearest NeighborGPULarge-Scale Retrieval
0 likes · 13 min read
HELMSMAN: Redefining Large-Scale Vector Retrieval on All‑Flash Servers (OSDI 2026)
Architects' Tech Alliance
Architects' Tech Alliance
Jul 23, 2026 · Industry Insights

June 2026 GPU Performance Rankings: Which Cards Lead the Pack?

The article presents a detailed June 2026 GPU performance ranking, dividing graphics cards into five tiers—from flagship 300X‑200X models like RTX 5090 and RX 7900 XTX for 4K/8K gaming and AI workloads, down to legacy integrated GPUs for basic office tasks—while also summarizing the strengths of Apple/Intel, NVIDIA, AMD, and APU solutions.

AI workloadsAMD RadeonGPU
0 likes · 6 min read
June 2026 GPU Performance Rankings: Which Cards Lead the Pack?
AI Engineering
AI Engineering
Jul 21, 2026 · Artificial Intelligence

Unsloth Adds AMD Support: Train LLMs on 3 GB VRAM GPUs

Unsloth now supports AMD GPUs with custom ROCm‑optimized Triton kernels, delivering up to double the training speed and 70% lower memory usage, enabling over 500 LLMs to be trained on as little as 3 GB VRAM and providing detailed performance benchmarks on MI300X.

AMDGPULLM
0 likes · 5 min read
Unsloth Adds AMD Support: Train LLMs on 3 GB VRAM GPUs
Architects' Tech Alliance
Architects' Tech Alliance
Jul 21, 2026 · Industry Insights

A Visual Breakdown of NVIDIA’s Vera Rubin AI Cabinet

The article analyzes NVIDIA’s Vera Rubin NVL72 AI cabinet, detailing its 72 Rubin GPUs, 36 Vera CPUs, 260 TB/s internal bandwidth, 100% liquid cooling, cost breakdown, component upgrades, and the broader industry impact as AI compute moves toward system‑level efficiency.

AI hardwareGPUNVIDIA
0 likes · 7 min read
A Visual Breakdown of NVIDIA’s Vera Rubin AI Cabinet
MaGe Linux Operations
MaGe Linux Operations
Jul 19, 2026 · Operations

How to Deploy vLLM for an OpenAI‑Compatible Inference Service

This guide walks through deploying vLLM on Linux with NVIDIA GPUs and Docker Compose, covering service boundaries, host and container checks, model directory validation, image and parameter verification, minimal startup, Compose configuration, API testing, concurrency tuning, multi‑GPU troubleshooting, Nginx exposure, upgrade/rollback procedures, and daily health checks.

GPUKV CacheLLM inference
0 likes · 18 min read
How to Deploy vLLM for an OpenAI‑Compatible Inference Service
Machine Heart
Machine Heart
Jul 18, 2026 · Artificial Intelligence

Why Faster Inference Makes Models Smarter: Jonathan Ross Explains GPU‑LPU Synergy

In a detailed interview, Groq founder Jonathan Ross argues that reducing inference latency not only speeds up responses but also expands large‑language‑model search depth, illustrating how complementary GPU and LPU architectures boost model intelligence, multi‑agent collaboration, and inform leadership practices in AI enterprises.

AI hardwareAlphaGoGPU
0 likes · 6 min read
Why Faster Inference Makes Models Smarter: Jonathan Ross Explains GPU‑LPU Synergy
Golang Shines
Golang Shines
Jul 18, 2026 · Cloud Native

Mastering GPU Scheduling, Isolation, and Resource Allocation in Kubernetes Clusters

This guide walks through the complete GPU resource path from node to container, explains how Kubernetes discovers and registers GPUs via the NVIDIA Device Plugin, and provides step‑by‑step procedures for environment inventory, pod specifications, scheduling constraints, isolation models, quota management, monitoring, troubleshooting, and safe upgrades.

Device PluginGPUKubernetes
0 likes · 36 min read
Mastering GPU Scheduling, Isolation, and Resource Allocation in Kubernetes Clusters
MaGe Linux Operations
MaGe Linux Operations
Jul 17, 2026 · Operations

How to Quickly Deploy an Enterprise LLM API Using SGLang

This guide walks through deploying SGLang on Linux with NVIDIA GPUs and Docker Compose, covering environment checks, image versioning, minimal foreground launch, Docker Compose configuration, health checks, troubleshooting, performance testing, security hardening, and upgrade/rollback procedures to reliably expose an OpenAI‑compatible large model API in production.

APIGPULLM
0 likes · 24 min read
How to Quickly Deploy an Enterprise LLM API Using SGLang
MaGe Linux Operations
MaGe Linux Operations
Jul 15, 2026 · Cloud Native

How to Schedule, Isolate, and Allocate GPUs in a Kubernetes Cluster

Even when GPU nodes show up with nvidia‑smi, Pods can stay pending, see all devices, or suffer memory spikes; this guide walks through the full GPU resource chain in Kubernetes, from PCIe detection and driver loading to Device Plugin registration, node labeling, affinity, taints, isolation levels, MIG, time‑slicing, quotas, monitoring, and safe upgrade procedures.

Cloud NativeDevice PluginGPU
0 likes · 34 min read
How to Schedule, Isolate, and Allocate GPUs in a Kubernetes Cluster
Architects' Tech Alliance
Architects' Tech Alliance
Jul 15, 2026 · Industry Insights

Will ASICs Overtake GPUs? How AWS and Google Are Set to Win

The article forecasts ASIC shipments reaching 7.7 million units in 2026 (45% market share) and surpassing GPUs by 2027 (58% share), analyzes TSMC's CoWoS capacity growth, details AWS's Nitro‑Graviton‑Trainium roadmap and network redesign, examines Google's TPU v1‑v8 evolution, and compares Alibaba's Pingtouge chips and revenue impacts across the cloud AI market.

AI AcceleratorsASICAWS
0 likes · 11 min read
Will ASICs Overtake GPUs? How AWS and Google Are Set to Win
Architects' Tech Alliance
Architects' Tech Alliance
Jul 10, 2026 · Industry Insights

China’s 2026 Domestic Compute Power Leaders: Top 30 Companies and Market Trends

In 2026 China's domestic compute capacity will shift from pilot substitution to large‑scale commercial use, driven by national network projects, East‑West computing phase II and mandatory domesticisation, resulting in three parallel technology routes, layered market segmentation, full‑stack autonomy requirements, booming peripheral components, and a rapid move toward compute‑as‑a‑service.

2026ChinaCompute
0 likes · 5 min read
China’s 2026 Domestic Compute Power Leaders: Top 30 Companies and Market Trends
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jul 4, 2026 · Artificial Intelligence

How Xpeng Built AI-Driven Cars on Alibaba Cloud: A Deep Dive

The article examines Xpeng Motors' cloud‑native AI strategy, detailing its 10‑thousand‑GPU cluster with over 95% utilization, AI‑powered digital employees in customer service and finance, AI Coding acceleration, and global 10 EFLOPS compute infrastructure that sustains high‑traffic car launches.

AIAI CodingAlibaba Cloud
0 likes · 7 min read
How Xpeng Built AI-Driven Cars on Alibaba Cloud: A Deep Dive
Black & White Path
Black & White Path
Jun 30, 2026 · Artificial Intelligence

A 27B Red‑Team AI Model That Runs on Just 12 GB VRAM

The BugTraceAI CORE Ultra 27B model, fine‑tuned on 2,541 real vulnerability reports, generates fully functional Nuclei templates, CVE PoCs, webshell bypasses, JWT cracking tools, and kernel exploits with a 0 % rejection rate, and its quantized Q4 version runs on a single 24 GB GPU, making advanced red‑team automation accessible.

BugTraceAIGPULLM
0 likes · 7 min read
A 27B Red‑Team AI Model That Runs on Just 12 GB VRAM
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jun 29, 2026 · Artificial Intelligence

How to Maximize Cosmos‑3 Training Throughput Without NVLink Using AI Infra Optimizations

By applying systematic AI Infra engineering—optimizing data loading, I/O pipelines, activation checkpointing, torch.compile, and multi‑node scaling—the Cosmos‑3‑Nano‑Policy‑DROID model achieved an 89× faster startup, 99.3% higher single‑node throughput, 0.42 MFU, and 98.3% scaling efficiency across 12 nodes, all without NVLink.

AI InfraActivation CheckpointingCosmos 3
0 likes · 13 min read
How to Maximize Cosmos‑3 Training Throughput Without NVLink Using AI Infra Optimizations
Geek Labs
Geek Labs
Jun 29, 2026 · Artificial Intelligence

DeepSpec Boosts Large-Model Inference Speed by 2–5× with Speculative Decoding

DeepSpec, an open‑source framework from DeepSeek, accelerates large‑language‑model inference by 2–5× through speculative decoding, where a lightweight draft model generates candidate tokens that the target model validates in parallel, reducing the serial bottleneck of autoregressive decoding and offering a full‑stack pipeline from data preparation to evaluation.

DeepSpecGPULarge Language Models
0 likes · 6 min read
DeepSpec Boosts Large-Model Inference Speed by 2–5× with Speculative Decoding
Machine Heart
Machine Heart
Jun 28, 2026 · Artificial Intelligence

When the Memory Wall Locks AI Compute, Is HBM the Key or Another Lock?

The article analyzes how the growing memory‑wall bottleneck forces GPUs to idle while waiting for data, compares on‑chip SRAM and high‑bandwidth memory (HBM) as remedies, and examines HBM’s technical advantages, supply constraints, and divergent manufacturing routes that may turn it into a new limitation.

AI computeGPUHBM
0 likes · 6 min read
When the Memory Wall Locks AI Compute, Is HBM the Key or Another Lock?
21CTO
21CTO
Jun 25, 2026 · Industry Insights

Can OpenAI’s Jalapeño Chip Disrupt Nvidia’s GPU Dominance?

OpenAI unveiled its custom AI inference chip Jalapeño, co‑designed with Broadcom, claiming far‑better power‑efficiency than existing high‑end GPUs and signaling a strategic shift that could erode Nvidia’s near‑monopoly in AI hardware.

AI chipASICBroadcom
0 likes · 9 min read
Can OpenAI’s Jalapeño Chip Disrupt Nvidia’s GPU Dominance?
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jun 17, 2026 · Artificial Intelligence

The Multimodal Model Battlefield Is Going Rogue – LoongForge’s ‘Dark Arts’ Framework

Facing mounting challenges of heterogeneous models, data, and hardware in multimodal training, Baidu’s open‑source LoongForge framework unifies LLM, VLM, VLA and diffusion workloads, delivering 1.15‑2.31× speedups and over 5× gains for DSA models while scaling linearly across thousands of GPUs and Kunlun XPU cards.

GPUKunlun XPULarge Language Models
0 likes · 8 min read
The Multimodal Model Battlefield Is Going Rogue – LoongForge’s ‘Dark Arts’ Framework
DeepHub IMBA
DeepHub IMBA
Jun 15, 2026 · Artificial Intelligence

Flash-KMeans: Fast, Memory-Efficient Exact K-Means for Billion-Scale Clustering on a Single GPU

Flash‑KMeans is a newly proposed framework that re‑designs exact K‑Means for GPUs by eliminating distance‑matrix materialization, using FlashAssign’s online argmin and Sort‑Inverse Update to cut memory bandwidth and atomic‑write contention, achieving up to 12.5× speedup and dramatically lower VRAM usage on billion‑point datasets.

FlashAssignGPUK-Means
0 likes · 23 min read
Flash-KMeans: Fast, Memory-Efficient Exact K-Means for Billion-Scale Clustering on a Single GPU
Ubuntu
Ubuntu
Jun 15, 2026 · Artificial Intelligence

Running AI/ML Models on WSL with CUDA Acceleration: A PyTorch Hands‑On Guide

This guide shows how to enable NVIDIA GPU passthrough in WSL 2, install the CUDA toolkit, set up a PyTorch GPU environment, verify GPU visibility, and run real‑world AI/ML workloads such as LLM inference, YOLO object detection, and Jupyter monitoring, while providing performance comparisons, optimization tips, and troubleshooting FAQs.

AICUDAGPU
0 likes · 13 min read
Running AI/ML Models on WSL with CUDA Acceleration: A PyTorch Hands‑On Guide
Old Zhang's AI Learning
Old Zhang's AI Learning
Jun 13, 2026 · Cloud Computing

Google’s Low‑Key Launch: The Google Colab CLI Brings Notebooks to the Terminal

The article introduces Google Colab CLI, a command‑line interface that moves Colab notebooks from the browser to the terminal, detailing its installation on Linux/macOS, authentication steps, core features like instant VM provisioning, kernel state persistence, shebang GPU scripts, and practical examples such as fine‑tuning Gemma 3‑1B.

AI agentsGPUGoogle Colab CLI
0 likes · 9 min read
Google’s Low‑Key Launch: The Google Colab CLI Brings Notebooks to the Terminal
Geek Labs
Geek Labs
Jun 12, 2026 · Artificial Intelligence

Boost Developer Productivity with NBD VRAM, Reg Factory, and vLLM Studio

This article introduces three open‑source tools that improve GPU‑centric development: NBD VRAM, which turns GPU memory into Linux swap space; Reg Factory, a scheduler and monitor for multi‑GPU clusters; and vLLM Studio, a web UI for deploying and managing large‑model inference.

GPUVRAMmodel deployment
0 likes · 4 min read
Boost Developer Productivity with NBD VRAM, Reg Factory, and vLLM Studio
Lao Guo's Learning Space
Lao Guo's Learning Space
Jun 10, 2026 · Artificial Intelligence

2026 Top 10 Local LLMs Ranked by Real Downloads, GPU Fit, and License Risks

The article analyzes why local large‑language‑model deployment is essential for privacy, offline use, and cost control, then ranks the ten most popular models in 2026 using Ollama download counts, GitHub stars, benchmark scores, and hardware requirements, and finally provides a GPU‑based selection guide, deployment‑tool comparison, license‑risk table, decision‑tree and quick‑start instructions.

BenchmarkGPULLM
0 likes · 19 min read
2026 Top 10 Local LLMs Ranked by Real Downloads, GPU Fit, and License Risks
Architects' Tech Alliance
Architects' Tech Alliance
Jun 7, 2026 · Industry Insights

2026 China GPU Chip Industry: Market Share, Technology Trends, and Future Outlook

The 2026 analysis shows China's GPU market capturing a growing share of the $1.12 trillion global AI GPU market, with Huawei Ascend leading at 44%, domestic firms leveraging 7nm processes, Chiplet and FP8 breakthroughs, while Nvidia and AMD face increasing competition from Chinese players expanding into inference, edge and enterprise segments.

AI chipsChinaChiplet
0 likes · 5 min read
2026 China GPU Chip Industry: Market Share, Technology Trends, and Future Outlook
Architects' Tech Alliance
Architects' Tech Alliance
Jun 4, 2026 · Industry Insights

2026 Global GPU Chip Landscape: Domestic AI Accelerators Surge Past 60% Share

In 2026 the GPU market pivots as domestic AI accelerators capture over 60% share, slashing Nvidia’s hold to roughly 8%, while companies like Huawei Ascend, Biren, Moore Threads, HaiGuang and MuXi compete with 7 nm chiplets, petaflop performance and emerging software ecosystems to chase the trillion‑dollar AI chip opportunity.

AI acceleratorBirenChiplet
0 likes · 6 min read
2026 Global GPU Chip Landscape: Domestic AI Accelerators Surge Past 60% Share
Lao Guo's Learning Space
Lao Guo's Learning Space
Jun 3, 2026 · Industry Insights

Can Apple’s M5 Ultra Still Compete After NVIDIA’s RTX Spark Launch?

The RTX Spark desktop processor delivers 1 PFLOP of AI compute—about 14 times the M5 Ultra—while the M5 Ultra retains a three‑times higher memory bandwidth and twice the memory capacity, making it superior for certain inference workloads; the article breaks down specs, benchmarks, ecosystem differences, pricing and market positioning to show how each platform fits distinct AI use cases.

AI computeApple M5 UltraCUDA
0 likes · 12 min read
Can Apple’s M5 Ultra Still Compete After NVIDIA’s RTX Spark Launch?
Machine Heart
Machine Heart
Jun 1, 2026 · Industry Insights

Nvidia Redefines PCs with the Ultra‑Efficient RTX Spark CPU

Nvidia and Microsoft unveiled the RTX Spark‑powered Windows PC, a thin‑and‑light laptop and desktop that combine an ARM‑based Vera CPU, a Blackwell RTX GPU with 6144 CUDA cores, up to 1 petaflop AI performance and 128 GB unified memory to enable local AI agents, high‑end creative workloads, and next‑gen gaming.

AI agentsARMCPU
0 likes · 8 min read
Nvidia Redefines PCs with the Ultra‑Efficient RTX Spark CPU
Architects' Tech Alliance
Architects' Tech Alliance
May 31, 2026 · Industry Insights

Huawei AI Data Center Reference Design – Downloadable Blueprint

The Huawei AI Data Center Reference Design offers a standardized, integrated, high‑performance compute infrastructure for large‑model training and inference, built on GB/T 50174, featuring modular GPU/HBM servers, 20–50 kW per rack, leaf‑spine 100/200/400 Gbps networking, liquid cooling, redundant power, and intelligent management, with a downloadable package for replication.

AIGPUHigh-Performance Computing
0 likes · 4 min read
Huawei AI Data Center Reference Design – Downloadable Blueprint
TonyBai
TonyBai
May 26, 2026 · Artificial Intelligence

Why NVIDIA Chose Go for Its GPU Cloud Platform: Inside the AI Infrastructure Rewrite

NVIDIA quietly rewrote its AI cloud platform using Go, open‑sourcing NVCF, AICR, and AIStore, where Go accounts for over 80% of the code, enabling a three‑plane architecture, scale‑to‑zero via NATS JetStream, and a cloud‑native stack that balances performance, maintainability, and rapid iteration.

AI infrastructureCloud NativeGPU
0 likes · 15 min read
Why NVIDIA Chose Go for Its GPU Cloud Platform: Inside the AI Infrastructure Rewrite
Machine Heart
Machine Heart
May 14, 2026 · Artificial Intelligence

How China’s MUSA GPU Backend Earned Native Support in SGLang’s Mainline

The recent SGLang × MUSA meetup revealed that MUSA’s GPU backend has been merged into SGLang’s official codebase, delivering zero‑learning‑cost integration, performance gains of up to 66 % on DeepSeek‑V4, and a growing ecosystem of adapters, high‑performance kernels, and distributed inference support.

AI inferenceDeepSeekGPU
0 likes · 12 min read
How China’s MUSA GPU Backend Earned Native Support in SGLang’s Mainline
Architects' Tech Alliance
Architects' Tech Alliance
May 14, 2026 · Artificial Intelligence

Jensen Huang’s China Visit: Could It Revive GPU Prospects? Inside Nvidia’s DGX H200 Cluster Design

The article reviews the US‑approved export of Nvidia's DGX H200, the lack of deliveries, Jensen Huang’s surprise China trip that may speed approvals, and then provides a detailed technical breakdown of the DGX H200 cluster’s compute and storage networking, topology, optical link choices, and cable count estimates.

AI infrastructureDGX H200Fat-Tree
0 likes · 8 min read
Jensen Huang’s China Visit: Could It Revive GPU Prospects? Inside Nvidia’s DGX H200 Cluster Design
Baidu Geek Talk
Baidu Geek Talk
May 13, 2026 · Artificial Intelligence

LoongForge Boosts Multimodal Training Speed by 45% on GPU and Kunlun XPU

LoongForge, Baidu Baige’s open‑source full‑modal training framework, unifies LLM, VLM and VLA workloads, runs unchanged on NVIDIA GPUs and Kunlun XPU, and delivers 15‑45% end‑to‑end speedups with up to 90% linear scaling on 5,000‑plus card clusters, while simplifying model integration via YAML.

AI infrastructureGPUKunlun XPU
0 likes · 23 min read
LoongForge Boosts Multimodal Training Speed by 45% on GPU and Kunlun XPU
Geek Labs
Geek Labs
May 13, 2026 · Artificial Intelligence

Two LLM Inference Acceleration Projects: A Mac‑Local Engine vs a Data‑Center Engine

This article compares two recent GitHub LLM inference engines—ds4.c, a Metal‑optimized engine for DeepSeek V4 Flash on Apple Silicon Macs, and TokenSpeed, a Python/C++‑based, data‑center‑grade engine for GPU clusters—detailing their design choices, performance numbers, usage instructions, and suitable scenarios.

DeepSeekGPULLM
0 likes · 8 min read
Two LLM Inference Acceleration Projects: A Mac‑Local Engine vs a Data‑Center Engine
21CTO
21CTO
May 11, 2026 · Artificial Intelligence

Mojo 1.0 Beta: A New Era of Python‑C++ Performance

Mojo 1.0 beta combines familiar Python syntax with C/Rust‑level speed, introduces API‑stabilizing language changes, expands cross‑vendor GPU support, and delivers measurable AI/ML performance gains, while offering a decision framework that weighs its early‑stage ecosystem against production needs.

AIC++GPU
0 likes · 10 min read
Mojo 1.0 Beta: A New Era of Python‑C++ Performance
Machine Heart
Machine Heart
May 10, 2026 · Artificial Intelligence

Why SRAM Is Key to Overcoming GPU Limits in Inference as Demand Soars

As large‑model inference demand outpaces training, the decode stage hits a memory‑wall that GPUs cannot efficiently cross; SRAM’s on‑chip bandwidth and low‑energy access open a path forward, though capacity and process limits still pose challenges.

AI hardwareGPUSRAM
0 likes · 7 min read
Why SRAM Is Key to Overcoming GPU Limits in Inference as Demand Soars
SuanNi
SuanNi
May 7, 2026 · Industry Insights

Musk Gives 220k GPUs to Claude; Anthropic’s $1.2T Valuation Crowned AI King

Elon Musk redirected 220,000 GPUs to Anthropic’s Claude, fueling a dramatic 80‑fold Q1 usage surge and a $1.2 trillion valuation that now eclipses OpenAI, while the article dissects the compute‑capacity crunch, Colossus data‑center dynamics, and the broader AI market power shift.

AI valuationAnthropicClaude
0 likes · 8 min read
Musk Gives 220k GPUs to Claude; Anthropic’s $1.2T Valuation Crowned AI King
大转转FE
大转转FE
May 7, 2026 · Artificial Intelligence

Running AI Inference Directly in the Browser with WebNN

WebNN brings hardware‑accelerated AI inference to web pages, letting developers run millisecond‑level face detection, real‑time filters, and semantic segmentation locally without cloud calls, while improving latency, privacy, and cost through a unified JavaScript API that maps to CPUs, GPUs or NPUs.

AI inferenceEdgeGPU
0 likes · 16 min read
Running AI Inference Directly in the Browser with WebNN
Old Zhang's AI Learning
Old Zhang's AI Learning
May 1, 2026 · Artificial Intelligence

NVIDIA’s Open‑Source Multimodal Nemotron 3 Nano Omni: Run Locally on Consumer GPUs (English‑Only)

NVIDIA’s Nemotron 3 Nano Omni 30B‑A3B‑Reasoning model, an open‑source multimodal LLM with 30 B parameters, 256K context and video‑audio‑image‑text capabilities, outperforms comparable models by up to 9.2× in video throughput, runs on consumer GPUs via 4‑bit GGUF quantization, but currently supports only English input.

GGUFGPUNVIDIA
0 likes · 17 min read
NVIDIA’s Open‑Source Multimodal Nemotron 3 Nano Omni: Run Locally on Consumer GPUs (English‑Only)
SuanNi
SuanNi
Apr 30, 2026 · Artificial Intelligence

Deploy a 24/7 Document Recognition Toolbox with the PaddleOCR Image on the Cloud

This guide explains how to use Baidu's open‑source PaddleOCR engine—its full OCR and layout analysis pipeline, multi‑language support, and output formats—to set up a continuously running document recognition service on the 算网 GPU cloud platform, including environment preparation, model configuration, and inference execution.

Document ProcessingGPUMagicMind
0 likes · 6 min read
Deploy a 24/7 Document Recognition Toolbox with the PaddleOCR Image on the Cloud
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Apr 24, 2026 · Artificial Intelligence

LoongForge: Open‑Source Multimodal Training Framework Runs on GPU and Kunlun XPU with 45% Speedup

LoongForge is an open‑source, Megatron‑based multimodal training framework that unifies LLM, VLM, VLA and diffusion models, runs seamlessly on NVIDIA GPUs and Baidu Kunlun XPU, and delivers 15%‑45% end‑to‑end training acceleration while scaling linearly on thousands of cards.

GPUKunlun XPULoongForge
0 likes · 23 min read
LoongForge: Open‑Source Multimodal Training Framework Runs on GPU and Kunlun XPU with 45% Speedup
DataFunTalk
DataFunTalk
Apr 19, 2026 · Industry Insights

Why Nvidia Still Rules AI Hardware: Inside Jensen Huang’s Strategic Interview

In a candid two‑hour podcast, Nvidia CEO Jensen Huang explains how the company’s focus on accelerated computing, a massive CUDA ecosystem, strategic supply‑chain partnerships and a philosophy of doing only what’s essential have built a durable moat that outpaces rivals like TPU, while also revealing why Nvidia prefers to empower cloud providers rather than become one itself.

AI hardwareGPUJensen Huang
0 likes · 36 min read
Why Nvidia Still Rules AI Hardware: Inside Jensen Huang’s Strategic Interview
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Apr 17, 2026 · Artificial Intelligence

Can Table Modeling Scale? Rethinking Tree Models in the Age of Massive Compute

The article examines how the dramatic increase in GPU compute power—illustrated by a single H100 GPU equaling about 200 Hadoop instances—challenges the dominance of tree‑based models for structured data, presents scaling‑law experiments with KMLP and FOUND, and argues that pre‑training can redefine the balance between compute, data, and algorithms.

FOUNDGPUKMLP
0 likes · 10 min read
Can Table Modeling Scale? Rethinking Tree Models in the Age of Massive Compute
Baidu Geek Talk
Baidu Geek Talk
Apr 13, 2026 · Artificial Intelligence

How Baidu’s 7th‑Gen AI Confidential VM Delivers Full‑Stack Secure Compute

Baidu Cloud’s 7th‑generation AI confidential virtual machine combines Intel TDX‑based CPU trusted execution, GPU confidential computing, and DPU‑offloaded I/O to provide end‑to‑end encrypted data paths, multi‑GPU scaling, and near‑native performance for high‑sensitivity AI workloads, redefining secure cloud AI infrastructure.

AIGPUTDX
0 likes · 15 min read
How Baidu’s 7th‑Gen AI Confidential VM Delivers Full‑Stack Secure Compute
Old Zhang's AI Learning
Old Zhang's AI Learning
Apr 12, 2026 · Artificial Intelligence

Deploy the Open‑Source MiniMax‑M2.7 Model Locally: Step‑by‑Step Guide

MiniMax‑M2.7, the newly open‑sourced 230‑billion‑parameter MoE model, offers self‑evolution, professional software engineering and agent capabilities, and can be deployed locally using Ollama, vLLM, SGLang or Docker with 4‑8 H200 GPUs, while the article details hardware needs, performance gains and tool‑calling/Thinking features.

GPULLMMiniMax-M2.7
0 likes · 11 min read
Deploy the Open‑Source MiniMax‑M2.7 Model Locally: Step‑by‑Step Guide
Old Zhang's AI Learning
Old Zhang's AI Learning
Apr 10, 2026 · Artificial Intelligence

How a 9B‑parameter Qwen3.5 model achieves full‑auto data analysis on a consumer GPU

The open‑source CoPaw‑Flash‑9B‑DataAnalyst‑LoRA model, fine‑tuned via LoRA, can autonomously load, explore, statistically analyze, visualize, and generate structured reports for CSV/Excel/JSON datasets, achieving a 90% success rate with an average of 26 iteration rounds, and it runs on a single consumer‑grade GPU using vLLM and the Data Analyst framework.

AgentData AnalystGPU
0 likes · 10 min read
How a 9B‑parameter Qwen3.5 model achieves full‑auto data analysis on a consumer GPU
Old Zhang's AI Learning
Old Zhang's AI Learning
Apr 7, 2026 · Artificial Intelligence

vLLM 0.19.0: HuggingFace v5 Support, Multimodal Boosts, and CPU KV Cache Offload

The vLLM 0.19.0 release adds first‑day Gemma 4 support, merges zero‑bubble asynchronous scheduling with speculative decoding, matures Model Runner V2, introduces full‑CUDA‑graph acceleration for ViT, generalizes DBO, brings CPU KV cache offload, and expands hardware and Transformers compatibility, offering substantial performance and flexibility gains for production LLM inference.

CPU KV offloadGPUGemma 4
0 likes · 18 min read
vLLM 0.19.0: HuggingFace v5 Support, Multimodal Boosts, and CPU KV Cache Offload