Fireworks 发布 ARCv3 权重增量压缩器,跨区域 RL 传输体积减半
Fireworks 发布 ARCv3,用于压缩从训练端发往 rollout 机器的 BF16 权重更新增量。在 1000 个生产 RL 权重更新增量上,ARCv3 的载荷比 ARCv2 小近 50%,平均增量约为原始 BF16 权重的 0.19%,低于此前的 0.36%,且可无损重建训练端的精确 BF16 权重。ARCv3 已通过 fireworks-delta-compression 在 Fireworks Training API 中提供,使用 Fireworks Trainer SDK 的用户默认启用,自带训练端的团队可安装该包接入。
o lose its edge over a single mega-cluster. How ARCv3 deltas move from trainer to rollouts. Each trainer shard uploads its slice of the compressed weight delta to shared object storage (S3) in parallel. Then, the Fireworks API signals every region that a new update is available, and each rollout region pulls the pieces it needs and reconstructs the updated model locally. The trainer never talks directly to the rollout fleet, which is what lets a globally distributed inference cluster stay in syn
匹配字段正文


