BestHub
Sign in
Tagged articles

GPU

587 articles · Page 4 of 6
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
May 31, 2024 · Cloud Native

Best Practices for Deploying AI Model Inference on Knative

This guide explains how to efficiently deploy AI model inference services on Knative by externalizing model data, using Fluid for accelerated loading, configuring secrets, ImageCache, graceful shutdown, probes, autoscaling parameters, mixed ECS/ECI resources, shared GPU scheduling, and observability features to achieve fast scaling, low cost, and high elasticity.

AI Model InferenceAutoscalingCloud Native
0 likes · 19 min read
Best Practices for Deploying AI Model Inference on Knative
Bilibili Tech
Bilibili Tech
May 24, 2024 · Cloud Computing

Understanding and Optimizing NCCL Collective Communication Libraries for Large‑Scale Model Training

The article explains how NCCL’s collective communication libraries enable efficient large‑scale model training by parsing GPU‑to‑NIC topology, forming flat‑ring and tree rings, improving logging and bandwidth metrics, detailing Ring AllReduce primitives, and proposing solutions to missing topology, metric, and mapping information for future optimization.

Distributed TrainingGPUNCCL
0 likes · 23 min read
Understanding and Optimizing NCCL Collective Communication Libraries for Large‑Scale Model Training
Open Source Linux
Open Source Linux
May 22, 2024 · Artificial Intelligence

Why GPUs Are the Powerhouse Behind Modern AI: A Deep Dive

This article explains how GPUs, with their parallel architecture and extensive software ecosystem, have become essential for accelerating AI training and inference, outperforming CPUs and shaping the future of artificial intelligence across various industries.

Artificial IntelligenceGPUHardware Acceleration
0 likes · 10 min read
Why GPUs Are the Powerhouse Behind Modern AI: A Deep Dive
Architects' Tech Alliance
Architects' Tech Alliance
May 15, 2024 · Artificial Intelligence

Detailed Overview of GPU Server Architectures: A100/A800 and H100/H800 Nodes

This article provides a comprehensive technical overview of large‑scale GPU server architectures, detailing the component topology of 8‑GPU A100/A800 and H100/H800 nodes, explaining storage network cards, NVSwitch interconnects, bandwidth calculations, and the trade‑offs between RoCEv2 and InfiniBand for AI workloads.

GPUNVLinkNVSwitch
0 likes · 13 min read
Detailed Overview of GPU Server Architectures: A100/A800 and H100/H800 Nodes
Architects' Tech Alliance
Architects' Tech Alliance
May 14, 2024 · Artificial Intelligence

Why GPUs Are Essential for Modern Artificial Intelligence and How They Compare with CPUs, ASICs, and FPGAs

This article explains the pivotal role of GPUs in today’s generative AI era, describes their architecture and applications, compares them with CPUs, ASICs, and FPGAs, and offers guidance on selecting the right processor for AI workloads while also noting related reference resources.

Artificial IntelligenceGPUHardware
0 likes · 12 min read
Why GPUs Are Essential for Modern Artificial Intelligence and How They Compare with CPUs, ASICs, and FPGAs
DataFunTalk
DataFunTalk
May 10, 2024 · Artificial Intelligence

GPU Performance Optimization Practices for Tencent PCG Recommendation Model Training Framework

This article presents a comprehensive overview of Tencent PCG's GPU‑based recommendation model training framework, detailing why GPU adoption is essential, the hardware and software challenges faced, the multi‑level data architecture, pipeline design, and a series of network, storage, and compute optimizations, followed by future directions.

Distributed TrainingGPUmodel training
0 likes · 13 min read
GPU Performance Optimization Practices for Tencent PCG Recommendation Model Training Framework
Architects' Tech Alliance
Architects' Tech Alliance
May 9, 2024 · Artificial Intelligence

AI Servers: Market Opportunities, Architecture, and Future Demand Driven by Generative AI

The article examines how the surge of generative AI (AIGC) is fueling rapid growth in AI server demand, detailing the emerging AIGC ecosystem, server hardware composition, model scaling, heterogeneous computing, training vs. inference workloads, market size forecasts, and the competitive landscape of AI server manufacturers.

AI infrastructureAI serversGPU
0 likes · 15 min read
AI Servers: Market Opportunities, Architecture, and Future Demand Driven by Generative AI
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
May 8, 2024 · Frontend Development

How We Halved Cloud Music Desktop Startup Time and Fixed UI Lag with a React Refactor

This article details the migration of the Cloud Music desktop client from a legacy NEJ‑CEF hybrid to a React‑based architecture, outlines four major performance challenges, and explains the step‑by‑step optimizations—including API preloading, render memoization, virtual‑list replacement, and resource‑usage reductions—that cut startup latency by 48%, eliminated interaction stutter, and dramatically lowered CPU, GPU, and memory consumption.

CPUGPUHybrid App
0 likes · 30 min read
How We Halved Cloud Music Desktop Startup Time and Fixed UI Lag with a React Refactor
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Apr 24, 2024 · Artificial Intelligence

Training MNIST with Burn on wgpu: From PyTorch to Rust Backend

This tutorial demonstrates how to train a MNIST digit‑recognition model using the Rust‑based Burn framework on top of the cross‑platform wgpu API, covering model export from PyTorch to ONNX, code generation, data loading, training loops, and performance comparison across CPU, GPU, and other backends.

BurnGPUMNIST
0 likes · 13 min read
Training MNIST with Burn on wgpu: From PyTorch to Rust Backend
Architects' Tech Alliance
Architects' Tech Alliance
Apr 21, 2024 · Fundamentals

Understanding RDMA: InfiniBand, RoCE, and Their Role in High‑Performance AI Model Training

This article explains how Remote Direct Memory Access (RDMA) technologies such as InfiniBand and RoCE bypass OS kernels to achieve ultra‑low latency and high bandwidth, discusses their hardware implementations, cost considerations, and their critical impact on large‑scale AI model training and HPC network design.

AIGPUHigh‑Performance Computing
0 likes · 11 min read
Understanding RDMA: InfiniBand, RoCE, and Their Role in High‑Performance AI Model Training
Architects' Tech Alliance
Architects' Tech Alliance
Apr 12, 2024 · Industry Insights

Why AI Server Demand Is Set to Explode by 2025 – Key Trends and Market Drivers

The article analyzes the rapid evolution of AI servers, detailing the shift from general‑purpose to GPU‑enhanced AI hardware, the split between training and inference workloads, cost structures, forecasted compute needs for large models like GPT‑4, and the impact of US export restrictions and domestic competition on the global market.

AI serversGPUIndustry Insights
0 likes · 6 min read
Why AI Server Demand Is Set to Explode by 2025 – Key Trends and Market Drivers
Architects' Tech Alliance
Architects' Tech Alliance
Apr 10, 2024 · Industry Insights

Inside the GPU Server: Architecture of A100/A800 and H100/H800 Nodes

This article provides a detailed technical breakdown of modern multi‑GPU server nodes, covering component composition, storage network cards, NVSwitch interconnects, bandwidth calculations, and the architectural differences between NVIDIA A100/A800 and H100/H800 configurations for AI training workloads.

A100AI trainingGPU
0 likes · 12 min read
Inside the GPU Server: Architecture of A100/A800 and H100/H800 Nodes
DataFunSummit
DataFunSummit
Apr 10, 2024 · Artificial Intelligence

Large Language Model Inference Overview and Performance Optimizations

This article presents a comprehensive overview of large language model inference, describing the prefill and decoding stages, key performance metrics such as throughput, latency and QPS, and detailing a series of system-level optimizations—including pipeline parallelism, dynamic batching, KV‑cache quantization, and hardware considerations—to significantly improve inference efficiency on modern GPUs.

GPUThroughputinference
0 likes · 23 min read
Large Language Model Inference Overview and Performance Optimizations
Python Programming Learning Circle
Python Programming Learning Circle
Apr 3, 2024 · Fundamentals

Accelerating Python Code with Taichi: Up to 100× Speed Boosts

This article introduces Taichi, a Python‑embedded DSL that compiles kernel functions for CPU and GPU execution, and demonstrates through three practical examples how importing the library and adding decorators can accelerate Python code by up to a hundredfold, with detailed performance numbers and installation instructions.

GPUPythonTaichi
0 likes · 7 min read
Accelerating Python Code with Taichi: Up to 100× Speed Boosts
360 Smart Cloud
360 Smart Cloud
Apr 3, 2024 · Backend Development

Understanding FFmpeg Hardware Acceleration Architecture and Implementation

FFmpeg provides a comprehensive, cross‑platform hardware acceleration framework that abstracts diverse GPU and dedicated video codec interfaces, defines HWContext types, device and frame contexts, and various codec configuration methods, enabling efficient video encoding, decoding, and filtering while addressing performance, compatibility, and pipeline complexity challenges.

FFmpegGPUHardware Acceleration
0 likes · 10 min read
Understanding FFmpeg Hardware Acceleration Architecture and Implementation
Architects' Tech Alliance
Architects' Tech Alliance
Mar 30, 2024 · Industry Insights

How NVIDIA’s B200 GPU Redefines AI Compute and What It Means for the Chip Market

The article analyzes the latest AI‑compute announcements from NVIDIA, AMD and Intel—including NVIDIA’s B200 GPU with 20 petaFLOPS FP4 performance, AMD’s MI300/MI400 roadmap, and Intel’s Gaudi 3 and Falcon Shores—while examining pricing, launch timelines, supply‑chain capacity, and the shifting market share among major cloud providers.

AI computeAMDGPU
0 likes · 10 min read
How NVIDIA’s B200 GPU Redefines AI Compute and What It Means for the Chip Market
Architects' Tech Alliance
Architects' Tech Alliance
Mar 20, 2024 · Industry Insights

What Nvidia’s B100 and GB200 Reveal About the Future of AI GPUs

The GTC 2024 recap highlights Nvidia’s upcoming B100 and GB200 GPUs, their BlackWell architecture, performance breakthroughs, embodied‑intelligence initiatives, and the expanding AI application ecosystem across industries, offering a clear view of the next wave in accelerated computing.

AIB100Embodied Intelligence
0 likes · 7 min read
What Nvidia’s B100 and GB200 Reveal About the Future of AI GPUs
21CTO
21CTO
Mar 20, 2024 · Artificial Intelligence

Nvidia Unveils Blackwell GPU: A Quantum Leap for Generative AI

Nvidia introduced the Blackwell GPU architecture at GTC, highlighting six breakthrough technologies, a 4nm process, massive performance gains, and its integration into DGX SuperPOD systems that promise to accelerate generative AI, data processing, and high‑performance computing across industries.

AIBlackwellGPU
0 likes · 14 min read
Nvidia Unveils Blackwell GPU: A Quantum Leap for Generative AI
Architects' Tech Alliance
Architects' Tech Alliance
Mar 18, 2024 · Industry Insights

Why Nvidia’s NVLink C2C Is Redefining GPU‑CPU Interconnects

The article provides an in‑depth technical analysis of Nvidia’s NVLink C2C interconnect, comparing its latency, bandwidth, power efficiency, density and cost against traditional SerDes solutions and examining its role in building SuperChip architectures with Grace CPUs and Hopper GPUs.

GPUNVLinkcost analysis
0 likes · 12 min read
Why Nvidia’s NVLink C2C Is Redefining GPU‑CPU Interconnects
Architects' Tech Alliance
Architects' Tech Alliance
Mar 17, 2024 · Industry Insights

Why GPUs Remain the Dominant AI Compute Engine: Trends, Risks, and Future Outlook

The article analyzes current AI hardware options, explains why GPUs continue to dominate model training due to architectural compatibility, ecosystem support, and market maturity, and outlines emerging trends such as model miniaturization, optical interconnects, and chiplet technology that will shape the next generation of AI compute.

AI computeChipletGPU
0 likes · 6 min read
Why GPUs Remain the Dominant AI Compute Engine: Trends, Risks, and Future Outlook
iQIYI Technical Product Team
iQIYI Technical Product Team
Mar 15, 2024 · Artificial Intelligence

Optimizing GPU Inference for CTR Models: Kernel Fusion, Multi‑Stream Execution, and Batch Merging

By fusing sparse‑feature operators, enabling multi‑stream execution, consolidating data copies, and merging inference batches, iQIYI reduced GPU CTR model latency to CPU‑level, boosted throughput over sixfold, and cut operational costs by more than 40%, overcoming launch‑overhead bottlenecks.

CTRGPUTensorFlow
0 likes · 10 min read
Optimizing GPU Inference for CTR Models: Kernel Fusion, Multi‑Stream Execution, and Batch Merging
Tencent Cloud Developer
Tencent Cloud Developer
Mar 14, 2024 · Mobile Development

Aurora Animation and 3D Penguin Effects in Mobile QQ: Noise Algorithms, Color Mapping, Performance Optimization, and Rendering Techniques

The new QQ 9.0 introduces aurora‑style animations generated by continuous, smoothed noise algorithms with uniform‑probability color mapping, and a spring‑driven 3D penguin rendered via Filament’s PBR materials and GPU compute shaders, achieving sub‑2 ms performance on most Android and iOS devices.

3DGPUShader
0 likes · 17 min read
Aurora Animation and 3D Penguin Effects in Mobile QQ: Noise Algorithms, Color Mapping, Performance Optimization, and Rendering Techniques
NewBeeNLP
NewBeeNLP
Mar 8, 2024 · Industry Insights

Why Building LLMs Is Like Buying a Hardware Lottery – Lessons from a Startup

The article recounts Yi Tay’s experience founding Reka and building large language models from scratch, highlighting the unpredictable quality of GPU clusters, the challenges of multi‑cluster orchestration, code‑base choices, and how startups must rely on fast, intuition‑driven experimentation to succeed.

Cluster ManagementGPUHardware
0 likes · 12 min read
Why Building LLMs Is Like Buying a Hardware Lottery – Lessons from a Startup
MaGe Linux Operations
MaGe Linux Operations
Mar 5, 2024 · Cloud Native

How to Run GPU‑Accelerated AI Workloads on Kubernetes

This article explains how Kubernetes supports GPU workloads for AI and machine learning, covering device plugins, pod GPU requests, oversubscription, security isolation, cloud‑provider node setup, and protecting GPU nodes from non‑GPU pods.

AI workloadsCloud NativeDevice Plugin
0 likes · 8 min read
How to Run GPU‑Accelerated AI Workloads on Kubernetes
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Mar 1, 2024 · Mobile Development

GPU Frequency Scaling on Qualcomm Adreno Using the Linux devfreq Framework

Using Qualcomm’s Adreno GPU as a case study, the article explains how the Linux devfreq framework enables GPU frequency scaling by creating a kgsl devfreq device and an msm‑adreno‑tz governor, detailing their initialization, event handling, target‑frequency computation, and the kernel callbacks that apply the new rates.

AdrenoGPULinux kernel
0 likes · 5 min read
GPU Frequency Scaling on Qualcomm Adreno Using the Linux devfreq Framework
DataFunTalk
DataFunTalk
Feb 19, 2024 · Artificial Intelligence

Large Language Model Inference Overview and Performance Optimizations

This article presents a comprehensive overview of large language model inference, detailing the prefill and decoding stages, key performance metrics such as throughput, latency and QPS, and a series of system-level optimizations—including pipeline parallelism, dynamic batching, specialized attention kernels, virtual memory allocation, KV‑cache quantization, and mixed‑precision strategies—to improve GPU utilization and overall inference efficiency.

GPULLMThroughput
0 likes · 24 min read
Large Language Model Inference Overview and Performance Optimizations
DataFunSummit
DataFunSummit
Feb 11, 2024 · Artificial Intelligence

GPU-Accelerated Model Service and Optimization Practices at Xiaohongshu

This article details Xiaohongshu's end‑to‑end GPU‑based transformation of its recommendation and search models, covering background, model characteristics, training and inference frameworks, system‑level and GPU‑level optimizations, compilation tricks, hardware upgrades, and future directions for large‑scale machine‑learning infrastructure.

GPUOptimizationlarge-scale systems
0 likes · 18 min read
GPU-Accelerated Model Service and Optimization Practices at Xiaohongshu
Architects' Tech Alliance
Architects' Tech Alliance
Jan 30, 2024 · Industry Insights

Why Computing Power Leasing Is Booming: 2024 Industry Framework & Trends

The article outlines the 2024 computing‑power leasing industry framework, explains three main rental models, highlights the surge in demand driven by generative AI, the shortage of high‑end GPUs, and provides an extensive collection of links to reports and analyses on GPU technology, market dynamics, and future development paths.

AICloud ComputingGPU
0 likes · 5 min read
Why Computing Power Leasing Is Booming: 2024 Industry Framework & Trends
DataFunTalk
DataFunTalk
Jan 26, 2024 · Artificial Intelligence

Efficient Deployment of Speech AI Models on GPUs

This article explains how to efficiently deploy speech AI models—including ASR and TTS—on GPUs using NVIDIA's Triton Inference Server and TensorRT, covering background challenges, GPU‑based solutions, decoding optimizations, Whisper acceleration with TensorRT‑LLM, streaming TTS improvements, voice‑cloning pipelines, future plans, and a Q&A session.

ASRGPUTTS
0 likes · 20 min read
Efficient Deployment of Speech AI Models on GPUs
Architects' Tech Alliance
Architects' Tech Alliance
Jan 14, 2024 · Fundamentals

Overview of CPU, GPU, and Storage Fundamentals in the Xinchuang Industry

This article introduces the Xinchuang (information technology innovation) industry, outlines its hardware components, and provides concise explanations of CPU concepts, instruction sets, GPU architecture and operation, as well as storage classifications, while also linking to related research reports and promotional resources.

CPUGPUHardware Fundamentals
0 likes · 8 min read
Overview of CPU, GPU, and Storage Fundamentals in the Xinchuang Industry
Architects' Tech Alliance
Architects' Tech Alliance
Jan 4, 2024 · Industry Insights

China’s 2023 Xinchuang Boom: Key Trends in CPUs, GPUs, DPU & Cloud

The 2023 Xinchuang industry report outlines how China's information‑technology innovation sector entered a rapid growth phase, highlighting market expansion, dominant keywords, the evolving hardware ecosystem—including CPUs, GPUs, AI chips, DPU and cloud databases—and the strategic shift toward full‑industry adoption across eight critical sectors.

CPUChinaCloud Computing
0 likes · 14 min read
China’s 2023 Xinchuang Boom: Key Trends in CPUs, GPUs, DPU & Cloud
Python Programming Learning Circle
Python Programming Learning Circle
Dec 21, 2023 · Artificial Intelligence

Introducing Streamlit: A Free Open‑Source Framework for Building Machine‑Learning Apps with Python

Streamlit is a free, open‑source Python framework that lets machine‑learning engineers quickly turn scripts into interactive web apps, featuring top‑to‑bottom script execution, widget‑as‑variable handling, caching, GPU support, and seamless integration with tools like Git.

App DevelopmentGPUOpen Source
0 likes · 9 min read
Introducing Streamlit: A Free Open‑Source Framework for Building Machine‑Learning Apps with Python
Architects' Tech Alliance
Architects' Tech Alliance
Dec 3, 2023 · Artificial Intelligence

Overview of the AI Chip Market: Architectures, Companies, and Performance Comparisons

The rapidly growing multi‑billion‑dollar AI chip market in 2023 is categorized by architecture (GPGPU, FPGA, ASIC, compute‑in‑memory) and deployment location (cloud, edge, terminal), with Chinese vendors advancing training and inference chips but still lagging behind leading Nvidia products in performance and bandwidth.

AI chipsASICChina AI
0 likes · 8 min read
Overview of the AI Chip Market: Architectures, Companies, and Performance Comparisons
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Nov 27, 2023 · Mobile Development

Understanding Android HWUI, Skia, and OpenGL Rendering Pipeline

The article explains Android’s graphics pipeline by detailing how HWUI and Skia translate view operations into OpenGL ES commands, describing RenderThread stages such as synchronization, dirty‑region calculation, buffer handling, and drawing, and comparing mobile GPU architectures like TBR, TBDR, and IMR.

AndroidGPUOpenGL
0 likes · 13 min read
Understanding Android HWUI, Skia, and OpenGL Rendering Pipeline
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2023 · Fundamentals

2023 GPU Graphics Card Industry Report: Market Overview, Mining Impact, and Future Trends

The 2023 GPU graphics‑card report provides a comprehensive overview of China's graphics‑card industry, detailing current development, OEM product lines, the evolution of mining, post‑Ethereum‑merge market shifts, full‑chain analysis, and forecasts for downstream demand across gaming, AI, data‑center, and automotive applications.

AIChinaGPU
0 likes · 15 min read
2023 GPU Graphics Card Industry Report: Market Overview, Mining Impact, and Future Trends
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2023 · Fundamentals

What You Need to Know About Server CPUs, GPUs, and Memory

This article provides a concise technical overview of server hardware, covering CPU architecture and platform options, GPU evolution and key specifications, and DDR4 memory compatibility rules, helping readers understand the essential components for building or upgrading a server.

CPUGPUHardware Fundamentals
0 likes · 6 min read
What You Need to Know About Server CPUs, GPUs, and Memory
php Courses
php Courses
Oct 10, 2023 · Artificial Intelligence

Microsoft to Unveil Its Own AI Chip "Athena" at Ignite Conference

Microsoft plans to announce its self‑developed AI processor, codenamed Athena, at the Ignite developer conference in mid‑November, aiming to reduce reliance on Nvidia GPUs and strengthen its AI services such as Azure AI, Bing Chat, and Copilot.

AI chipArtificial IntelligenceGPU
0 likes · 2 min read
Microsoft to Unveil Its Own AI Chip "Athena" at Ignite Conference
Architects' Tech Alliance
Architects' Tech Alliance
Sep 29, 2023 · Artificial Intelligence

AI Compute Landscape: GPUs, Networking, and Storage

The article analyzes the AI compute ecosystem—highlighting GPUs as the core engine, network bandwidth as a bottleneck, and storage memory walls—while also promoting comprehensive server and storage e‑books for deeper technical insight.

AIComputeE‑book
0 likes · 4 min read
AI Compute Landscape: GPUs, Networking, and Storage
DaTaobao Tech
DaTaobao Tech
Sep 27, 2023 · Artificial Intelligence

FlashAttention-2: Efficient Attention Algorithm for Transformer Acceleration and AIGC Applications

FlashAttention‑2 is an IO‑aware exact attention algorithm that cuts GPU HBM traffic through tiling and recomputation, optimizes non‑matmul FLOPs, expands sequence‑parallelism and warp‑level work distribution, delivering up to 2× speedup over FlashAttention, near‑GEMM efficiency, and enabling longer‑context Transformer training and inference for AIGC with fastunet and negligible accuracy loss.

AIGCAttention optimizationFlashAttention-2
0 likes · 20 min read
FlashAttention-2: Efficient Attention Algorithm for Transformer Acceleration and AIGC Applications
Architects' Tech Alliance
Architects' Tech Alliance
Sep 17, 2023 · Fundamentals

FPGA Overview: Architecture, Memory Hierarchy, and NoC Advantages

This article provides a comprehensive overview of FPGA technology, detailing its programmable logic cells, input/output blocks, switch matrices, historical evolution, flexibility versus ASIC and GPU, memory hierarchy including on‑chip and HBM2e, and the benefits of Network‑on‑Chip architectures for performance, power and design modularity.

ASICFPGAGPU
0 likes · 12 min read
FPGA Overview: Architecture, Memory Hierarchy, and NoC Advantages
Baobao Algorithm Notes
Baobao Algorithm Notes
Sep 12, 2023 · Artificial Intelligence

Why RTX 4090 Beats H100 for LLM Inference but Fails at Training

The article analyses the performance, memory, bandwidth and cost of NVIDIA H100, A100 and RTX 4090 GPUs, explains why the 4090 cannot handle large‑model training due to communication and memory limits, and shows how its high compute‑to‑price ratio makes it attractive for inference, backed by detailed parallelism calculations and cost‑per‑token estimates.

CostGPULLM
0 likes · 46 min read
Why RTX 4090 Beats H100 for LLM Inference but Fails at Training
Architects' Tech Alliance
Architects' Tech Alliance
Sep 4, 2023 · Artificial Intelligence

Overview of AI Chip Types, Architectures, and Market Trends

The article explains the various AI‑capable chips such as CPUs, GPUs, FPGAs, NPUs, and TPUs, compares their performance and efficiency, describes heterogeneous CPU+xPU solutions, and provides market share data while highlighting the growing adoption of specialized AI accelerators.

AI accelerationAI chipsCPU
0 likes · 7 min read
Overview of AI Chip Types, Architectures, and Market Trends
Architects' Tech Alliance
Architects' Tech Alliance
Sep 2, 2023 · Artificial Intelligence

NVIDIA L40S GPU Overview and Its Impact on Generative AI and Optical Modules

The NVIDIA L40S GPU, built on the Ada Lovelace architecture with 48 GB GDDR6 memory and 846 GB/s bandwidth, delivers over 1.45 PFLOPS tensor performance and superior FP16/FP32 efficiency for generative AI training and inference, while its lower power and GDDR6 design may influence demand for mid‑range optical modules in data centers.

Data CenterGPUL40S
0 likes · 8 min read
NVIDIA L40S GPU Overview and Its Impact on Generative AI and Optical Modules
JD Tech
JD Tech
Aug 4, 2023 · Artificial Intelligence

Deploying and Evaluating the Vicuna Open‑Source Large Language Model on a Single Machine

This article details a step‑by‑step guide to deploying the Vicuna open‑source LLM on a single server, covering model preparation, environment setup, dependency installation, GPU and CUDA configuration, inference commands, performance evaluation, and attempted fine‑tuning, while sharing practical observations and results.

Fine‑tuningGPULLM
0 likes · 16 min read
Deploying and Evaluating the Vicuna Open‑Source Large Language Model on a Single Machine
JD Tech
JD Tech
Jul 31, 2023 · Artificial Intelligence

Local Deployment, Fine‑tuning, and Inference of the Open‑source Alpaca‑LoRA Model on GPU Servers

This article details the step‑by‑step process of installing GPU drivers, setting up a Python environment, deploying the open‑source Alpaca‑LoRA large language model, fine‑tuning it with Chinese data on a multi‑GPU server, and running inference, while discussing practical challenges and performance observations.

AlpacaFine-tuningGPU
0 likes · 14 min read
Local Deployment, Fine‑tuning, and Inference of the Open‑source Alpaca‑LoRA Model on GPU Servers
Architects' Tech Alliance
Architects' Tech Alliance
Jul 29, 2023 · Artificial Intelligence

AI Server Market Overview and Technical Architecture

The article provides a comprehensive analysis of the AI server market, detailing server hardware components, cost distribution, logical architecture, firmware, rapid market growth, competitive landscape, AI-driven heterogeneous computing, and future industry trends, while highlighting key vendors and deployment configurations.

AI serversCloud providersGPU
0 likes · 10 min read
AI Server Market Overview and Technical Architecture
Liangxu Linux
Liangxu Linux
Jul 20, 2023 · Fundamentals

How to Choose the Right Desktop PC Components for Your Needs

This guide explains how to select desktop computer parts—including CPU, GPU, motherboard, memory, storage, power supply, and cooling—by evaluating usage, performance tiers, specifications, brand options, and compatibility, while also noting which components can be safely bought second‑hand.

CPUGPUHardware Selection
0 likes · 9 min read
How to Choose the Right Desktop PC Components for Your Needs
Architects' Tech Alliance
Architects' Tech Alliance
Jul 9, 2023 · Industry Insights

China’s GPU Landscape: Architecture, Performance, and Market Outlook

The report builds a comprehensive GPU research framework evaluating performance through micro‑architecture, process, core count and frequency, examines ecosystem dominance of CUDA, dissects NVIDIA Fermi and Hopper designs, analyzes competitive histories of Nvidia and AMD, and forecasts domestic GPU market opportunities in AI data centers, autonomous vehicles, and gaming.

AIChinaGPU
0 likes · 5 min read
China’s GPU Landscape: Architecture, Performance, and Market Outlook
MaGe Linux Operations
MaGe Linux Operations
Jul 6, 2023 · Fundamentals

Boost Python Performance: Top Tools and Techniques for Faster Code

This article surveys a range of Python acceleration tools—from NumPy, SciPy, and Pandas for efficient array operations to JIT compilers like PyPy and Pyston, GPU libraries such as PyCUDA, and C‑extension generators like Cython—explaining how each can dramatically speed up single‑processor or parallel code while balancing memory usage.

CythonGPUnumba
0 likes · 6 min read
Boost Python Performance: Top Tools and Techniques for Faster Code
58 Tech
58 Tech
Jul 6, 2023 · Artificial Intelligence

Design and Optimization of a Kaldi‑Based Speech Recognition Backend at 58.com

This article details the evolution from the initial Kaldi‑based speech recognition architecture (version 1.0) to a re‑engineered version 2.0, describing business background, service components, identified shortcomings, and a series of performance, concurrency, GPU, I/O, GC, and dispatch optimizations that dramatically improve resource utilization, latency, and reliability for large‑scale voice processing at 58.com.

AIBackend ArchitectureGPU
0 likes · 15 min read
Design and Optimization of a Kaldi‑Based Speech Recognition Backend at 58.com
Volcano Engine Developer Services
Volcano Engine Developer Services
Jun 30, 2023 · Cloud Native

Deploy Langchain‑ChatGLM on Volcengine VKE: A Step‑by‑Step Cloud‑Native Guide

This tutorial walks you through preparing a VKE cluster, pulling the Langchain‑ChatGLM container image, creating the necessary Deployment and Service resources, and adding a local knowledge base, enabling you to run a Langchain‑based ChatGLM service with GPU support on Volcengine’s cloud‑native platform.

AI deploymentChatGLMGPU
0 likes · 6 min read
Deploy Langchain‑ChatGLM on Volcengine VKE: A Step‑by‑Step Cloud‑Native Guide
58 Tech
58 Tech
Jun 21, 2023 · Artificial Intelligence

GPU Hotword Enhancement for WeNet End-to-End Speech Recognition

This article explains the design, implementation, and experimental evaluation of hot‑word augmentation in WeNet's GPU runtime, detailing how character‑ and word‑based language model scoring are extended to boost recognition of rare proper nouns in both streaming and non‑streaming ASR services.

ASRCTC decoderGPU
0 likes · 12 min read
GPU Hotword Enhancement for WeNet End-to-End Speech Recognition
Architects' Tech Alliance
Architects' Tech Alliance
Jun 20, 2023 · Fundamentals

Introducing NVIDIA DOCA GPUNetIO: GPU‑Initiated Communication for Real‑Time Packet Processing

NVIDIA's new DOCA GPUNetIO library enables GPU‑initiated communication, allowing packets to be received directly into GPU memory, processed by CUDA kernels, and sent without CPU involvement, offering lower latency, higher scalability, and detailed pipeline examples including IP checksum, HTTP filtering, traffic forwarding, and 5G Aerial SDK integration.

5GCUDADOCA
0 likes · 19 min read
Introducing NVIDIA DOCA GPUNetIO: GPU‑Initiated Communication for Real‑Time Packet Processing
Architects' Tech Alliance
Architects' Tech Alliance
Jun 14, 2023 · Artificial Intelligence

AI Compute Landscape: GPUs, Network, and Storage as Core Engines

The article analyzes how large language models like ChatGPT are reshaping the software ecosystem by positioning AI compute—driven by GPUs, high‑speed networking, and advanced storage solutions such as HBM and 3D‑stacked memory—as the foundational engine for future information systems, highlighting current market trends and technical challenges.

AIComputeGPU
0 likes · 4 min read
AI Compute Landscape: GPUs, Network, and Storage as Core Engines
Python Programming Learning Circle
Python Programming Learning Circle
Jun 13, 2023 · Fundamentals

Python Performance Optimization Tools and Techniques

This article introduces a variety of Python optimization tools—including NumPy, SciPy, Pandas, JIT compilers like PyPy, GPU libraries, Cython, Numba, and interfacing utilities—explaining how they can make code more concise, faster, and better suited for single‑processor or multi‑processor execution.

GPULibrariesPython
0 likes · 8 min read
Python Performance Optimization Tools and Techniques
Ctrip Technology
Ctrip Technology
Jun 8, 2023 · Frontend Development

Optimizing CSS Animation Performance: Techniques and Best Practices

This article explains how to improve CSS animation performance by understanding the browser rendering pipeline, using GPU‑accelerated transforms, avoiding costly properties and complex selectors, leveraging will‑change and requestAnimationFrame, and preferring CSS over JavaScript for smoother, lower‑latency visual effects.

CSSFrontendGPU
0 likes · 13 min read
Optimizing CSS Animation Performance: Techniques and Best Practices
Architects' Tech Alliance
Architects' Tech Alliance
Jun 1, 2023 · Fundamentals

Overview of the Xinchuang (Information Technology Innovation) Industry: CPU, GPU, and Storage Fundamentals

This article provides a comprehensive overview of the Xinchuang industry, detailing the fundamental concepts, architectures, and classifications of CPUs, GPUs, and storage devices, and explains how these core hardware components support the goal of achieving self‑controlled, secure information technology in China.

CPUGPUHardware
0 likes · 6 min read
Overview of the Xinchuang (Information Technology Innovation) Industry: CPU, GPU, and Storage Fundamentals
Open Source Linux
Open Source Linux
May 29, 2023 · Fundamentals

What Is a GPU? Understanding Its Role in Graphics, AI, and Computing

This article explains what a GPU (Graphics Processing Unit) is, how it differs from a CPU, its architecture and performance characteristics, and why it powers everything from real‑time rendering to AI inference, using examples like the NVIDIA RTX 3090.

CPU comparisonGPUGraphics Processing Unit
0 likes · 8 min read
What Is a GPU? Understanding Its Role in Graphics, AI, and Computing
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
May 29, 2023 · Artificial Intelligence

How PAI‑Blade Supercharges Stable Diffusion Inference on GPUs

This article explains how PAI‑Blade, built on the BladeDISC compiler and BlaDNN library, dramatically reduces latency and memory usage for Stable Diffusion inference, provides step‑by‑step usage examples with code, shows performance gains on A100 and A10 GPUs, and outlines future optimization directions.

GPUPAI-Bladeinference optimization
0 likes · 9 min read
How PAI‑Blade Supercharges Stable Diffusion Inference on GPUs
Tencent Cloud Developer
Tencent Cloud Developer
May 24, 2023 · Artificial Intelligence

Deploying Stable Diffusion on Tencent Cloud: A Step‑by‑Step Guide

Deploy Stable Diffusion on Tencent Cloud by building a Docker image, pushing it to TCR, creating a GPU‑enabled TKE cluster with CFS storage, configuring qGPU sharing, exposing the service via Cloud Native API Gateway, optimizing inference with TACO Kit, storing results in COS, and applying content moderation.

AI deploymentGPUKubernetes
0 likes · 19 min read
Deploying Stable Diffusion on Tencent Cloud: A Step‑by‑Step Guide
JD Retail Technology
JD Retail Technology
May 18, 2023 · Artificial Intelligence

Local Deployment, Inference, and Fine‑tuning of the Vicuna‑7B Large Language Model

This article details the step‑by‑step process of preparing the environment, merging weights, installing dependencies, running inference, evaluating Vicuna‑7B against other models, and attempting fine‑tuning, while highlighting performance results, encountered issues, and future work for large language model deployment.

Fine-tuningGPUModel deployment
0 likes · 11 min read
Local Deployment, Inference, and Fine‑tuning of the Vicuna‑7B Large Language Model
JD Retail Technology
JD Retail Technology
May 16, 2023 · Artificial Intelligence

Deploying and Fine‑Tuning the Alpaca‑LoRA Large Language Model on a Multi‑GPU Server

This guide details the end‑to‑end process of installing GPU drivers, setting up a Python environment, deploying the open‑source Alpaca‑LoRA model, fine‑tuning it with Chinese data on a multi‑GPU server, and performing inference, while highlighting practical challenges and performance observations.

Alpaca-LoRAFine-tuningGPU
0 likes · 11 min read
Deploying and Fine‑Tuning the Alpaca‑LoRA Large Language Model on a Multi‑GPU Server
ByteDance SYS Tech
ByteDance SYS Tech
May 12, 2023 · Fundamentals

Inside Intel GPU Render Engine: How 3D Rendering Works at the Hardware Level

This article explains the architecture and workflow of Intel's GPU render engine, covering the 3D pipeline, command streamer, fixed‑function units, execution units, URB handling, thread dispatch, shader stages, sampler state, and the Mesa driver implementation that translates OpenGL commands into hardware instructions.

GPUGraphics PipelineIntel
0 likes · 39 min read
Inside Intel GPU Render Engine: How 3D Rendering Works at the Hardware Level
Architects' Tech Alliance
Architects' Tech Alliance
May 11, 2023 · Fundamentals

Overview of ARM Processor Architectures and Their Evolution

This article provides a comprehensive overview of ARM's processor architectures—including the A, R, and M profiles—detailing the evolution of major Cortex‑A series CPUs, the big.LITTLE concept, and the Mali GPU families, while also offering references to related technical reports and resources.

ARMCPUCortex
0 likes · 13 min read
Overview of ARM Processor Architectures and Their Evolution