Zyphra 预览 ZAYA1:首个完全在 AMD 平台端到端训练的模型
Zyphra 发布 ZAYA1 预览,称这是首个完全在 AMD 硬件、软件和网络栈上端到端训练的 AI 模型,配套技术报告已发布到 arXiv。ZAYA1-base 在 14T token 上训练,采用 Muon 优化器和 CCA 注意力、新型 MoE 路由等架构改进,基准表现与同规模 Qwen3 系列相当,并超过 SmolLM3、Phi4 等西方开源模型。训练集群由 Zyphra、AMD 和 IBM 合作搭建,使用 128 个节点、每节点 8 块 AMD MI300X GPU 与 AMD Pensando Pollara 网络,提供超过 750 PFLOPs 实际训练性能。

h the help of our close partners, we look forward to substantially scaling up our training efforts and training AI models that will deliver the next generation of breakthroughs in agentic capabilities, long term memory, and continual learning. In our accompanying technical report, we provide a deep dive into our experience and insights from our efforts pretraining on AMD hardware as well as describe our training framework and the hardware specific optimizations we perform in detail. We aim to di
匹配字段正文








