Tagged articles

FP8 KV cache

2 articles · Page 1 of 1

Aug 20, 2026 · Artificial Intelligence

Testing Qwen3.8-27B on Dual 4090 GPUs and Connecting to Claude Code for Unlimited Tokens

The article details a hands‑on deployment of Alibaba's Qwen3.8-27B model on a server with two 48 GB turbo‑variant RTX 4090 GPUs using vLLM, discusses hardware and software constraints, configuration tweaks like FP8 KV cache, and integration with Claude Code via a custom Anthropic‑compatible router, while sharing performance observations and community benchmark scores.

Anthropic APIClaude CodeFP8 KV cache

0 likes · 9 min read

Testing Qwen3.8-27B on Dual 4090 GPUs and Connecting to Claude Code for Unlimited Tokens

Old Zhang's AI Learning

Jul 11, 2026 · Artificial Intelligence

Unsloth’s Dynamic NVFP4 Makes Qwen3.6 Run 2.5× Faster Than NVIDIA’s Official Quantization

Unsloth’s Dynamic NVFP4 quantization (W4A4) lets Qwen3.6‑27B run up to 2.5× faster on Blackwell GPUs while keeping near‑BF16 accuracy, adds FP8 KV‑Cache calibration, provides detailed hardware requirements, benchmark tables, and step‑by‑step deployment guides via vLLM, SGLang or Unsloth Studio.

Blackwell GPUDynamic QuantizationFP8 KV cache

0 likes · 13 min read

Unsloth’s Dynamic NVFP4 Makes Qwen3.6 Run 2.5× Faster Than NVIDIA’s Official Quantization