Google and Meta jointly launch TorchTPU, enabling PyTorch to run natively on TPUs
Google and Meta's PyTorch teams have collaborated to launch the open-source project TorchTPU, providing a native PyTorch backend for Google TPUs; migration only requires changing model.to("cuda") to model.to("tpu"). The project supports both eager and torch.compile modes, adds a new DeferAndFuse eager mode, covers about 450 Aten operators, and has been verified to run out of the box on 4,917 Hugging Face models, with a Tier 1 pass rate of 98% and Tier 2 numerical consistency relative to GPUs of 97%. According to the official announcement, it has already been used in the inference and training production workloads of some major Google Cloud customers, and is integrated with vLLM, SGLang, TorchTitan, Ray, and TorchRec.

Google and Meta's PyTorch teams have collaborated to launch the open-source project TorchTPU, providing a native PyTorch backend for Google TPUs; migration only requires changing model.to("cuda") to model.to("tpu"). The project supports both eager and torch.compile modes, adds a new DeferAndFuse eager mode, covers about 450 Aten operators, and has been verified to run out of the box on 4,917 Hugging Face models, with a Tier 1 pass rate of 98% and Tier 2 numerical consistency relative to GPUs of
Matched fieldsBody
