Skip to content- Sources: primary, discussion
- Summary: Google announced at PyTorch Conference 2026 that TorchTPU is open source, with integrations for vLLM, SGLang, llm-d, TorchTitan, Ray, VeRL and Hugging Face Transformers v5 via device_map="tpu". Google reports up to 52% MFU on Qwen 3 8B with TorchTitan across up to 8,192 Ironwood TPUs.
- Why it matters: PyTorch teams can move existing training and serving code to TPUs without a JAX or XLA rewrite, which widens accelerator choice for capacity planning.