Baseten 发布 Hosted Tools,首推网页搜索 Grounded Inference
Baseten 发布 Hosted Tools,首个工具为网页搜索 Baseten Grounded Inference,首批接入 Exa、Keenable、Parallel 和 You.com 四家搜索服务商。开发者只需在 Messages、Chat Completions 或 Responses 请求中加一项配置即可启用,搜索在 Baseten 推理栈内服务端执行,模型按原生工具调用能力自行决定是否检索并迭代。Baseten 称其基准测试中端到端延迟比客户端工具方案降低 15%,该功能目前以 playground 预览形式开放,限速 25 RPM 并赠送 2 美元额度。

ontext stays server-side, reducing parsing round trips; Eager and concurrent tool execution while model streams; Graceful failures; Live SSEs of every granular step and additional metadata for observability; Mixed tool support (client and hosted tools) One platform for models and agents Baseten has focused on making models fast, reliable, and easy to operate in production. Baseten Hosted Tools expands that foundation to the capabilities models use at inference time. Baseten Grounded Inference is
匹配字段正文

