RadixArk 与 Google 合作将完整 SGLang 功能带到 TPU
SGLang 维护方 RadixArk 与 Google Cloud 达成合作,把 SGLang 推理框架带到 TPU 上。目前开发者可通过 SGL-JAX 在最新几代 TPU 上运行 SGLang,支持 Gemma、Qwen、DeepSeek、GLM、Kimi、MiniMax、Grok 等模型以及 Wan、Flux 等视频图像扩散模型。今年晚些时候 RadixArk 还将推出 PyTorch 原生的 SGL-torchtpu 后端,支持 eager 执行、PyTorch 生态兼容与 MPMD,并计划让新开源模型在 TPU 与 GPU 上同日可用。
or running workloads on their choice of hardware. SGLang is an open source inference framework built for high throughput and low latency at production scale. With more than 30,000 GitHub stars and over 1,700 contributors, it runs on hundreds of thousands of GPUs worldwide and generates trillions of tokens in production every day. RadixArk is a maintainer of the SGLang project. Currently, developers can run SGLang on the latest TPU generations through SGL-JAX, with support for major large languag
匹配字段正文







