Machine Heart

Oct 23, 2026 · Artificial Intelligence

Google Open-Sources TorchTPU: TPU Now Native in PyTorch, Challenging CUDA's Moat

Google open-sourced TorchTPU, a software stack enabling native PyTorch execution on TPUs via device_map="tpu", achieving 97% numerical parity with GPU across 4,917 models and performance within single-digit percentages of JAX, with integrations across vLLM, SGLang, Hugging Face, and TorchTitan.