Tagged articles

CPU Offload

3 articles · Page 1 of 1

Aug 23, 2026 · Artificial Intelligence

FreeToken Runs a 35B MoE Model on an 8 GB GPU at 39 tokens/s – Is Local Freedom Real?

FreeToken, an open‑source MoE inference engine from UC Berkeley, enables a 35B model to run on an 8 GB GPU at 39.3 tokens per second by offloading weights to system memory and dynamically scheduling between CPU and GPU, offering a detailed performance analysis and community feedback.

CPU OffloadFreeTokenGPU

0 likes · 6 min read

FreeToken Runs a 35B MoE Model on an 8 GB GPU at 39 tokens/s – Is Local Freedom Real?

Baidu Geek Talk

Jun 1, 2026 · Cloud Computing

Cut Migration Time by 60%: How Baidu Cloud Scaled Intel Xeon 6 QAT‑Accelerated VM Live Migration

VM live migration in large cloud clusters suffers from high CPU load and long downtime; Baidu Cloud integrated Intel Xeon 6 processors with built‑in QuickAssist Technology to offload memory compression, achieving up to 60% reduction in migration duration, 20% lower CPU usage, and sub‑10 ms pause windows.

CPU OffloadCloud ComputingIntel QAT

0 likes · 10 min read

Cut Migration Time by 60%: How Baidu Cloud Scaled Intel Xeon 6 QAT‑Accelerated VM Live Migration

Architects' Tech Alliance

Mar 14, 2022 · Fundamentals

An Introduction to RDMA: Principles, Protocols, Advantages, and Programming Basics

This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), covering its definition, how it differs from traditional networking, core advantages such as zero‑copy and CPU offload, typical use cases, the three main RDMA protocols, deployment requirements, and essential programming concepts and terminology.

CPU OffloadRDMARemote Direct Memory Access

0 likes · 9 min read

An Introduction to RDMA: Principles, Protocols, Advantages, and Programming Basics

CPU Offload

FreeToken Runs a 35B MoE Model on an 8 GB GPU at 39 tokens/s – Is Local Freedom Real?

Cut Migration Time by 60%: How Baidu Cloud Scaled Intel Xeon 6 QAT‑Accelerated VM Live Migration

An Introduction to RDMA: Principles, Protocols, Advantages, and Programming Basics

FreeToken Runs a 35B MoE Model on an 8 GB GPU at 39 tokens/s – Is Local Freedom Real?

Cut Migration Time by 60%: How Baidu Cloud Scaled Intel Xeon 6 QAT‑Accelerated VM Live Migration