SGLang 与 Miles 为 Kimi K3 提供 Day-0 支持
SGLang 与 Miles 宣布在 Kimi K3 发布当天提供 Day-0 支持,前者负责推理、后者负责 RL 训练,与 Moonshot AI、NVIDIA 团队合作完成。K3 是首个 3 万亿参数级别的开源模型,实际为 2.8T 参数、1M token 上下文窗口并具备原生视觉理解,其 69 层 KDA 线性注意力与 24 层 MLA 交织的混合架构打破了常规服务栈的多项假设。文中给出统一显存池、DSpark 投机解码与 ReplaySSM、分阶段并行等方案,并报告在 16 节点 × 4 GB300 上做 DAPO 数学 RL 训练,AIME-2024 贪心评测在 12 小时内从 43.3% 升至 76.7%。
released. If that leaves a gap in the middle, a block from the end is moved into it so the free region stays in one piece. This layout gives us flexible page sizes and no memory fragmentation: a 54 MB KDA state block and a 27 KB MLA KV block draw from the same bytes with no common page size forced on them, and the moves above keep each end packed at a negligible cost for state movement, so the free space is always one contiguous region usable by either kind. Capacity therefore follows the workl
匹配字段正文





