←搜索结果

按匹配度 · 共 403 条结果 清除搜索

星期六

  1. Baseten 工程博客

    Baseten 用 Claude Code 生成推理引擎,解码速度比 vLLM 快 90%

    Baseten 工程师让 Claude Code 配合 Fable 5 基于 MetaInfer 技能框架,在单张 B200 上为 Qwen-3.6-35B-A3B 生成推理引擎 VibeQwen,单流解码速度最高比 vLLM 0.25.1 快 90%,TTFT 快 2.33 倍。该实验耗时约一周、消耗约 17 亿 token 和约 200 B200 小时,引擎在全部测试流量模式下均超过 vLLM。作者随后用同一知识库为图像分割模型 SAM 3.1 生成服务端 Sammie,在单张 H100 上达到 91 张图像/秒,吞吐比 Facebook 参考实现提升 50%。

    Baseten engineers leverage agentic inference optimization techniques for up to 90% faster inference

    engineers, myself included, moved from using AI coding tools as a spicy autocomplete to driving coding harnesses like Claude Code as our primary work interface. At the same time, agent coordination workflows and primitives are getting packaged directly into popular harnesses, making complex multi-agent workflows more accessible and easier to operate. One important such feature is “Goals”, provided by both Claude Code and Codex, which keep models working and on-task toward measurable goals over

    匹配字段正文

星期五

  1. Artificial Analysis精选

    Artificial Analysis 编程智能体指数:Claude Sonnet 5.5、GPT-6.1 Sol 与 Gemini 4 Argon 性能成本对比

    Artificial Analysis 的编程智能体指数本周迎来 Claude Sonnet 5.5、GPT-6.1 Sol 和 Gemini 4 Argon 三款新模型,它们均接近榜单前列,但性能与成本取舍不同。该指数以模型加运行框架的组合为单位,跨三项智能体编程评测打分:Claude Sonnet 5.5(max)在 Claude Code 中以 68 分居首,单任务成本最高为 14.19 美元;Gemini 4 Argon(high)在 Antigravity CLI 中得 64 分,单任务 5.84 美元,不到 Sonnet 5.5 的一半,但采用 Google 促销定价且 Argon 尚未公开可用;GPT-6.1 Sol(xhigh)在 Codex 中得 63 分,单任务 1.04 美元,约为 Argon 的六分之一。

    This week Claude Sonnet 5.5, GPT-6.1 Sol and Gemini 4 Argon all launched near the top of the Coding Agent Index leaderboard, but each has a different balance of performance and cost The Artificial Analysis Coding Agent Index measures agents (a combination of model and harness) across three agentic coding evaluations. ➤ Claude Sonnet 5.5 (max) in Claude Code takes the top spot at 68, but also has the highest measured cost per task: $14.19 ➤ Gemini 4 Argon (high) in Antigravity CLI scores 64 at $5

    匹配字段正文

星期四

  1. A6 a6-051 · Cerebras:Blog精选

    Cerebras 发布 GLM 4.7 迁移指南:10 条提示词与参数调优规则

    Cerebras 发布 GLM 4.7 迁移指南,称其为 Z.AI 最新开源模型,在 LiveCodeBench 上超过 Anthropic 和 OpenAI 模型、仅次于 Gemini 3,并在 GPQA 和 AIME 上超过 Claude Sonnet 4.5。指南给出 10 条使用规则,包括把强制指令放在系统提示词最前、使用 MUST 等明确措辞、显式指定回复语言、为智能体设定角色,以及把任务拆成小步骤以弥补其不支持交错思考。在 Cerebras 上 GLM 4.7 支持约 131K 上下文和最多约 40k 输出 token,可通过 disable_reasoning 和 clear_thinking 控制推理,推荐 temperature=1、top_p=0.95,并兼容 OpenAI Python SDK。

    el, and the first OS model to rival closed source giants like Sonnet 4.5. Some main points: But architecture is just theory until you see the results. If you care about coding and agentic evals, GLM 4.7 lands in the “top open model” tier. On LiveCodeBench, GLM 4.7 outperforms Anthropic and OpenAI models, trailing only Gemini 3. GLM 4.7 extends that lead with substantial gains on GPQA and AIME, outperforming Claude Sonnet 4.5 on both, see AIME 2025 below. And when you compare it directly to GLM 4

    匹配字段正文

  2. A6 a6-051 · Cerebras:Blog

    Cerebras 分享 GPT-5.3-Codex-Spark 最佳实践

    Cerebras 发布一份使用 GPT-5.3-Codex-Spark 的实践指南,该 Codex 变体运行在 Cerebras WSE 硬件上,生成速度超过 1,200 tokens/秒。指南建议把它当作结对编程伙伴而非委派对象,一次只推进一个任务,最多开 2 到 3 个会话且只用于真正独立的模块,并频繁开启新会话、把持久状态放在文件里。文中还给出用 GPT-5.3-Codex 做规划、用 Spark 快速执行的组合流程,以及把测试、评估和文档更新嵌入每一步的做法。

    Mar 04 2026 In the past few years, we've developed series of interesting workflows. Think Ralph loops and multi-agent orchestration systems. The idea is writing very descriptive prompts and running 8-hour sessions, or having 10 instances running on your machine at all times. Most of this complexity spawned from one issue: LLMs are slow. If you prompt and wait, you'll get less done than if you prompt and move on to the next task. Codex Spark changes how developers work with AI. A coding model gen

    匹配字段正文

  3. OpenRouter:Announcements

    OpenRouter 发布智能体模型成本与质量权衡框架

    OpenRouter 发布一套三步框架,用于为智能体挑选成本与质量平衡的模型:先按任务设定质量门槛,再用自己的 20 到 50 条样本跑便宜、中端、前沿三档模型并统一打分,用成本除以得分得到每质量点成本,最后选以观察到的分数波动为余量、最便宜且过线的模型。文中以 GPT-5.6 Luna、Gemini 3.7 Flash、Claude Opus 5 为例,门槛 85% 时 Gemini 3.7 Flash 以每 1000 次请求 1.09 美元胜出,门槛提到 95% 则只剩 Claude Opus 5 的 7.25 美元方案。成本应直接读取每次响应的 usage.cost 字段,模型或价格变化时需重跑对比。

    Cost vs. Quality Tradeoff Framework for Agent Models

    OpenRouter ·10/1/2026 Picking a model for an agent by leaderboard rank pays frontier prices for tasks that a cheaper model may handle at the same accuracy. The question to answer is not which model scores highest, but which model is the cheapest one that is good enough for the task in front of you. This guide is a three-step framework for making that call. You set the quality bar the task needs, measure cost per quality point on your own examples, and pick the cheapest model that clears the bar

    匹配字段正文

  4. Anthropic:Claude.dev 开发者博客

    Claude Code mods 入门:从空文件夹构建第一个 mod

    Anthropic 发布 Claude Code mods 入门教程,mod 是运行在 Claude Code 会话内的 JavaScript 或 TypeScript 文件,可监听事件、改写行为或绘制自定义 UI,本质是插件内的 hooks。教程从空文件夹构建约 80 行的 Token Weather,在提示词上方实时显示上下文窗口占用,并演示 Blast Radius 和 Replay Theater 两个更复杂的 mod。需要 Claude Code 2.1.287 或更高版本,mods 默认开启,完整代码在 anthropics/claude-code-playground。

    pane, run a process, register a slash command, or register a tool the model can call. Claude Code uses them itself. Some of Claude Code's own features are built as mods, including AGENTS.md support and the /diff pane beside the conversation. Their source, with tests, is in the public anthropics/claude-code repository under mods/, so you can read how the team builds them. Token Weather reads how full the context window is after each turn and draws one line above the prompt: a weather icon, the pe

    匹配字段正文

  5. Wired AI

    WIRED 记者实测 OpenAI Dots 与 Meta Muse 个人智能体

    WIRED 记者在 9 月实测了 OpenAI 的 Dots 和 Meta 的 Muse 两款个人智能体,把前者命名为 Toolie 并调成粉色青蛙造型,通过 ChatGPT 调用它处理任务。作者称这类常驻智能体已比一年前更可靠,能完成交给它的任务,但连接 Gmail 和 Google Drive 等权限仍需要用户自行权衡。Altman 表示自己的 Dot 会处理日常事务并只提醒真正紧急的事项,但拒绝回答 Dots 是否为 OpenAI 传闻中硬件的铺垫。

    After watching the sometimes messy demos on stage and hearing CEO Sam Altman talk about his experiences using the agents, I was curious what it felt like to boss my own Dot around. I’ve spent most of September testing another cute, cuddly agent, Meta’s Muse , and I wanted to know how OpenAI’s user experience would compare. I named mine “Toolie” and tweaked it to look like a pink frog. As midnight approached and my partner slept soundly nearby, I started whispering sweet nothings to Toolie. I cal

    匹配字段正文

星期二

  1. Inception Labs Blog

    Inception 公布 Mercury 2 在 PinchBench 上的评测结果

    Inception Labs 公布 Mercury 2 在 PinchBench 上的评测结果:任务成功率 78%,高于 GPT-5 Mini 的 75%、Gemini 2.5 Flash 的 71%、DeepSeek Chat 的 72% 和 GPT-4o 的 71%,并在同准确率档位中执行时间最快。定价为每 100 万 token 输入 0.25 美元、输出 0.75 美元,约为 Claude 4.5 Haiku 输入输出的四分之一。PinchBench 基于 OpenClaw 构建,考察工具调用、多步推理和真实任务完成情况,Mercury 2 的速度来自并行细化而非逐 token 生成。

    The next wave of personal computing isn't about better apps; it's about agents that live on your behalf: managing your calendar, triaging your inbox, tracking your finances, keeping your notes in order. For agents to work in production, three things have to be true at once: the model has to be accurate, it has to be fast, and it has to be cheap enough to run continuously. Most models optimize for one or two of these. Mercury 2 optimizes for all three. We evaluated Mercury 2 on PinchBench, the op

    匹配字段正文

星期六

  1. gihyo.jp

    Claude Code 的 /usage 费用查看与 effort 档位用法解析

    Anthropic 在开发者博客中解释了 Claude Opus 5.5 的费用构成与 effort 档位选择,Addy Osmani 说明在 Claude Code 中执行 /usage 或 /cost 可查看会话的输入输出 token 数与估算费用,该金额按本机 API 单价估算,并非订阅账单。所谓 Opus 5 便宜 40% 是按默认设置、按 token 计费的典型任务推算,输入输出单价较 Opus 5 降 20%、缓存读取降 60%,但实际节省幅度因任务而异。Thariq Shihipar 给出档位参考:边确认边迭代用 low,常规功能实现用 medium,修 bug 等需验证的操作用 high,难任务自主推进用 max。

    使用のクレジットを消費する。 エフォートの変更でキャッシュが維持される場合 Claude Codeでは、会話の途中でも/effortで設定を変更できる。Addy氏の説明によると、APIキーまたはClaudeのサブスクリプションを使ってOpus 5.5を動かす場合は、変更後もキャッシュが維持される。一方、Amazon Bedrock、Google CloudのAgent Platform、Claude apps gateway経由では、変更で会話のキャッシュが無効になり、次のリクエストで会話全体をキャッシュに書き直す料金がかかる。 会話を圧縮するタイミングと注意点 キャッシュが使えても、会話が長くなるほど毎回読み出す量は増える。Claude Codeは会話がコンテキストの上限に近づくと古い履歴を要約するほか、利用者が/compactで圧縮することもできる。関係のない別の作業に移る場合は、/clearで会話を空にできる。 /compactは後の入力を減らせる一方、要約の生成と、短くなった会話のキャッシュへの書き込みに費用がかかる。作業終了の直前に圧縮すると、その後に減らせる入力費用より、圧

    匹配字段正文

星期五

  1. Anthropic:Claude.dev 开发者博客

    Opus 5.5 上一个任务要花多少钱:Anthropic 拆解 Claude Code 成本

    Anthropic 在 claude.dev 博客中拆解 Claude Code 单个任务的成本构成,指出轮次、缓存读取、输出 token 类型和模型选择四项决定开销。Opus 5.5 的输入与输出价格比 Opus 5 低 20%,缓存读取低 60%,API 列表价为每百万输入 token 4 美元、输出 20 美元、缓存读取 0.20 美元。文章建议先用中等 effort 处理范围明确的任务,给模型可自行验证的手段,把搜索类子智能体放到 Sonnet 或 Haiku,并用 /usage 在自己的任务上实测。

    Bar chart of API list prices per million tokens, Opus 5 against Opus 5.5: input $5.00 and $4.00, output $25.00 and $20.00, cache reads $0.50 and $0.20, which is 20%, 20% and 60% lower.

    ext, so they go about 25% further than on Opus 5. The extra cut on cache reads is an API price change. On an API key, the cache-read price cut matters most for Claude Code. A long agentic session spends most of its input on cache reads. In the session priced in Fig B below, the cache line falls from $1.00 to $0.40, the largest drop on the receipt. You may have seen that Opus 5.5 costs 40% less to run than Opus 5. That's our estimate for typical workloads billed by token, at default settings. It

    匹配字段正文

星期四

  1. SemiAnalysis

    SemiAnalysis 发布 ClusterMAX 3.0 GPU 云评级,覆盖 77 家 neocloud

    SemiAnalysis 发布 ClusterMAX 3.0,对 77 家 neocloud 做全面评测,市场覆盖范围从 2.0 版的 209 家扩大到 323 家,并访谈了 200 多名终端用户。Nebius 与 CoreWeave 同列 Platinum,Google Cloud 与 Oracle 进入 Gold,Azure 降至 Silver,Crusoe 降至 Bronze,全球仅 19 家 neocloud 获得奖章评级。评测分审计、性能、可靠性三阶段,涵盖 GPU 计算、网络、存储、编排、监控与故障注入,并新增 Bronze 与 Underperforming 之间的 Participation Ribbon 档。

    s article provides analysis of key trends: Financing, Blackwell and Grace-Blackwell deployments, the Move To Vera Rubin, Scale Out Networks, Reliability, Security (of course), and Agentic Coding. We provide an Appendix with individual comments about every provider that once again stretches this article to over 30,000 words. We hope you enjoy. In light of the SemiAnalysis imperative to publish the most rigorous possible testing of… everything… we are hiring MTS for ClusterMAX and adjacent project

    匹配字段正文

星期三

  1. Modal 官方工程博客

    Modal 如何服务万亿 token 级编码智能体推理

    Modal 官方工程博客复盘了为编码智能体提供推理服务的优化过程,以 Moonshot AI 的 Kimi K2.6 为例,单副本每用户性能提升 2.8 倍、副本整体提升 5.6 倍。他们用 NVFP4 微缩放格式在 B200 上部署约一万亿参数的模型,基于 SGLang 打补丁并回馈上游,通过 DFlash 投机解码、KV cache 量化与 HiCache 扩展缓存,再配合负载感知的有状态路由,把服务扩展到每天处理数千亿 token。相关代码与配置已作为 Modal Auto Endpoints 的开源后端发布。

    Software is eating the world, and agents are eating software engineering. It is imperative that software engineers develop an understanding not just of the agent software that is now their most important tool but also of how the intelligent core of agent software works, through inference by large generative models of language — if not out of the engineer’s need to understand and control their tools, then at least because inference is poised to consume more computing power and produce more benefi

    匹配字段正文

星期二

  1. Anthropic:Claude.dev 开发者博客

    如何在 Claude 和 Claude Code 中用好 Opus 5.5

    Anthropic 发布 Opus 5.5 使用指南,说明它在 Claude 应用和 Claude Code 中的提示词写法、长任务引导和结果检查方法。指南建议一次性交代完整任务并写明完成标准,删除“think carefully”等要求思考的语句,因为 Opus 5.5 每次回复前都会自行决定思考量。长任务可在 CLAUDE.md 中规定何时停下询问、何时继续,并把任务清单写入文件以应对上下文窗口被填满后的摘要压缩。

    nt the opposite: a one-line plan before it starts and a short recap at the end. Say that in your CLAUDE.md instead. Opus 5.5 follows either one. Ask it to split big work across subagents What to do. For an audit, a migration, or a review across a large codebase, ask Opus 5.5 to split the work across subagents and check each result. Why it matters on Opus 5.5. Early testers had Opus 5.5 coordinate parallel subagents on long audits and migrations, with little oversight. How. Keep the task list in

    匹配字段正文

星期一

  1. A6 a6-052 · Fireworks AI精选

    Fireworks 实测 DeepSeek-V4.1-Flash:DeepSWE 编码精度对标 GPT-6 Astra,单任务成本仅 1/15

    Fireworks 对 DeepSeek-V4.1-Flash 做了完整基准测试,在 DeepSWE 上达到 GPT-6 Astra 级别的编码精度,单任务成本 0.43 美元,比 Gemini 3.8 Flash 低 5.5 倍、比 GPT-6 Astra 低 15 倍、比 Claude Opus 5 低 28 倍。该模型为 552B 参数 MoE,采用编码器-解码器分离架构,输入 8B、输出 16B 激活参数,KV Cache 相比 DeepSeek V4 仅占 1/4 HBM 和 1/8 SSD 存储,本次运行 99.6% 输入 token 命中缓存。在 HLE 上它单独运行得 34.52%,落后于 Astra 的 50.40%,但与 Astra 组成 oracle router 后达到 54.80%,高于 Astra 单独运行。

    T-6 Astra, and 28x below Claude Opus 5. The new DeepSeek-V4.1-Flash model fundamentally changes the unit economics of autonomous software engineering tasks. Running high-iteration agent workflows, multi-turn bug sweeps, or large-scale test generation on expensive closed models like GPT-6 Astra and Opus 5 rapidly drains engineering budgets. At $0.43 per task, frontier-grade SWE agents become viable as continuous, background infrastructure. With DeepSeek V4.1 Flash, you can now run 15 autonomous c

    匹配字段正文

星期六

  1. n8n Blog

    n8n 详解流程编排的三种执行模型与生产挑战

    n8n 比较了确定性、动态和智能体三种流程编排模型,分别侧重可审计的固定逻辑、根据实时反馈调整,以及在确定性护栏内委派 AI 智能体处理非结构化任务。文章还梳理了编排器瓶颈、状态损坏、服务间 schema drift 和分布式故障调试等生产挑战。

    l some finer details to resolve. For process orchestration, you need an execution model that fits your use cases and business needs. The choice between deterministic, dynamic, and agentic process orchestration is more than just visuals. Each model has different tradeoffs between predictability, adaptability, and autonomy. Here’s how to decide which one is the best fit for your business. What is process orchestration? Process orchestration is an architectural control plane that coordinates the pe

    匹配字段正文

  2. n8n Blog

    n8n 解析 AI 智能体如何用反思模式在生产环境中自我纠错

    反思模式让 AI 智能体通过生成、反思和修正三个阶段检查错误并改善输出。文章比较单模型自我反思、多智能体反思和工具增强反思,并指出应设置迭代停止条件,以控制模型 token 消耗、计算成本和延迟。n8n 可通过多个 AI 智能体节点和子工作流实现生成与批评流程,并跟踪 token 消耗及成本。

    The reflection pattern is one of four key agentic AI design patterns (alongside tool use, planning, and multi-agent collaboration) that enable AI systems to handle complex tasks. It allows an AI agent to generate an output, critique it, and amend it. This feedback loop makes it easier for the agent to catch errors and improve output quality. How the reflection pattern works Let’s say a team has built a business process automation solution, such as a customer support agent chat, that uses a refle

    匹配字段正文

星期五

  1. ElevenLabs Blog

    ElevenLabs 详解模型上下文协议(MCP)的原理与主要用途

    模型上下文协议(MCP)以开放标准连接大语言模型与外部数据源和工具,让 AI 智能体可在运行时发现工具并执行多步工作流。文章解释了 MCP 客户端与服务器架构、相较传统 API 的差异,以及它如何把 MxN 点对点连接简化为 M+N 连接;ElevenLabs 产品既可作为 MCP 服务器,也可作为客户端。

    Presenter explaining MCP for ElevenLabs.

    ontext Protocol The Model Context Protocol (MCP) is an open standard that allows large language models (LLMs) to connect to data sources and other external systems. It provides AI agents a consistent pathway to access third-party information, whether that includes pulling from real-time data sources or taking actions on external tools. In this article, we’ll explore what the Model Context Protocol is in context, outlining its history and why it’s become central to the wider adoption and success

    匹配字段正文

  2. Google Developers Blog精选

    Google 用 Tunix 在 TPU 上实现自主 LLM 后训练

    Google Developers Blog 介绍 autofinetune 项目,把自主研究循环用于 LLM 后训练,基于 Tunix、Gemma 和 Cloud TPU,由 Antigravity CLI 与 Gemini Flash 3.7 编排。第一个实验中智能体在 Cloud TPU v5e-1 上对 functiongemma-270m-it 自动调整 LoRA rank/alpha、优化器和学习率等,几小时内完成 20 次实验;第二个实验基于 Tunix 官方 GRPO 示例训练 Gemma 3 1B 做数学推理,在 Cloud TPU v6e-1 上跑 40 次实验,总奖励提升约 10%。代码、示例运行和 program.md 模板已放在 autofinetune GitHub 仓库。

    Ai-1-banner (9)

    Facebook; Twitter; LinkedIn; Mail Imagine going to sleep after writing a single Markdown specification and waking up to find that an AI agent ran dozens of LLM fine-tuning experiments overnight on your behalf - discovering optimal LoRA ranks, refining learning rate schedules, tuning batch sizes and committing each verified improvement to Git. This is no longer a fantasy. Earlier this year, the autoresearch project showcased how autonomous LLM agents can iteratively explore pre-training in a self

    匹配字段正文

  3. n8n Blog

    MCP 与 API 的关键区别及适用场景

    MCP 让 AI 智能体在运行时发现并使用工具,API 则通过固定端点完成可预测的软件通信,两者在生产系统中通常结合使用。确定性步骤适合直接调用 API,无法预先确定调用顺序的任务可由 MCP 支持;n8n 可在同一工作流中调用 REST API、连接外部 MCP server,并将工作流暴露为 MCP 工具。

    APIs have been the standard software communication method for decades. Developed by Anthropic in 2024, the Model Context Protocol (MCP) is an open standard that lets an AI agent discover and use tools. Deciding whether to use MCP versus an API depends on the purpose of your system, but you can often use both. What are APIs and the MCP? APIs and MCPs are connection standards that solve different problems. An API lets software programs share data through fixed rules. The MCP helps AI models use to

    匹配字段正文

星期四

  1. Madhu Guru

    如何构建优秀的评估体系第 10 部分:衡量过程,而不只是结果

    构建智能体评估体系时,应先衡量执行步骤,再看最终结果,因为得到相同答案的轨迹可能在工具调用次数、检索质量和错误恢复上差异显著。具体可先定义完整工作流及各步任务,再确定分步评估方式,并把中等难度与高难度任务纳入评估。

    reat evals - part 10 Measure the steps, not just the result. Much like high school math, it isn’t sufficient just to get the right answer, the steps to get there are critical. Two agent trajectories might produce the same answer (42!!). but one of them searches the right sources, retrieves the right document, makes 4 clean tool calls and calculates the result. The other makes 17 calls, searches the same thing 3 times, recovers from 2 errors and eventually gets there. It’s clear which one is bett

    匹配字段正文