SGLang RL 团队实现 INT4 QAT 端到端 RL 训练,单张 H200 跑约 1TB 模型
SGLang RL 团队在 slime 框架上复现并落地了 INT4 QAT 端到端方案,训练侧用假量化加 STE,推理侧用 W4A16 真实量化,使约 1TB 规模的 K2 类模型可装入单张 H200(141GB)。消融实验显示,训练端假量化与推理端真实量化必须同时开启,否则训练与推理的 logprob 差异会明显增大;在 Qwen3-235B-A22B 和 Kimi-K2-Thinking 上,BF16 训练加 INT4 推理的奖励与评测分数走势与 BF16、FP8 方案基本重合。团队称 INT4 的主要收益来自显存压缩带来的单节点 rollout,因为 H 系列 GPU 没有原生 INT4 Tensor Core,其计算速度与 FP8 大致同档。

AM and bandwidth pressure, delivering rollout efficiency significantly higher than W8A8 (FP8 weights, FP8 activations) This project is jointly completed by the SGLang RL team, InfiXAI team, Ant Group Asystem & AQ Infra team, slime team, and RadixArk team. Related features and recipes have been synced to the slime and Miles communities. We welcome everyone to try them out and contribute. We are also further challenging ourselves with MXFP8 and NVFP4. We also gratefully acknowledge Verda Cloud for
匹配字段正文

