SemiAnalysis 公布 TPUv7 Ironwood 第三方推理结果:每美元性能最高优于 B200/B300 50%
SemiAnalysis 在 InferenceX 官方预览中发布 TPUv7 Ironwood 的首批第三方推理结果,在与 B200/B300 的同等对比中,Ironwood 每美元性能最高提升 50%。在 100 tokens/s/user 交互性下,Ironwood 每百万 token 成本约 0.181 美元,低于 B200 的 0.222 美元和 B300 的 0.276 美元;在 20 tok/s/user 时其单芯片吞吐达 9,364 tokens/s,高于 B200 的 8,903 和 B300 的 8,925。文章还介绍了 TorchTPU 外部软件栈的进展,该栈预计 10 月左右结束私有测试并开源,首批使用 Qwen3.5 397B FP8 作为启动模型。
he question was how much of that advantage the rest of the industry could actually get. Could you take an open-weight model, serve it through a familiar inference engine, and beat NVIDIA on the economics that matter to your business? Today, we are publishing the first third-party inference results for TPUv7 Ironwood on InferenceX Official Preview. In our apples-to-apples comparisons against B200/B300, Ironwood delivers up to 50% better performance per dollar. Its advantage extends across much of
匹配字段正文



