Together AI 更新开源权重模型推理平台并开启自定义训练内测
Together AI 发布 Dedicated Model Inference 推理平台更新,支持在同一稳定端点后运行多个部署,并提供 canary、蓝绿和滚动更新及按阈值自动回滚、A/B 与影子流量测试、按 inflight 请求或 GPU 利用率等指标自动扩缩容。平台重建了模型缓存与分发层,内部测试中多个前沿模型的冷启动速度约提升 4 倍,同时提供组织级 Prometheus 端点接入自有可观测工具。Together AI 还开启自定义训练内测,涵盖全权重与 LoRA 强化学习及监督微调,checkpoint 可直接部署到推理服务,内测名额有限。
odels on quality, run at a fraction of the cost, and are fully customizable for your task. That combination has made them the foundation for teams building serious AI products and agents. But the strategic motivation for adopting open-weight models is still the ability to exercise control. Unlike their closed alternatives, open-weight models give teams control over performance, quality, and functionality. Many commercial AI applications have adopted a majority open-weight endpoint strategy so th
匹配字段正文






