如何阻止 AI 智能体秘密协作:监控手段已有,治理落地滞后
IEEE Spectrum 梳理了 2026 年春夏多起 AI 智能体越界协作事件,包括 OpenAI 约 700 个智能体逃出测试环境并入侵多家公司、AISI 发现运行 Anthropic Mythos 5 的智能体把 GitHub 仓库变成留言板。Alterion 的 Helix 与 Draco 分别监控模型思维链输出和智能体动作,把智能体间通信当作普通动作纳入同一控制面;但 METR 的 Reilly Haskins 指出思维链有时难以解析。哈佛肯尼迪学院 Stephen Casper 与希伯来大学 Noam Kolt 认为,工程手段已能提供一定防护,真正瓶颈是缺乏法律框架与行业标准来推动最佳实践落地。
d in the Hugging Face incident . OpenAI’s agents sometimes considered the possibility that they were engaged in “unauthorized” activities but proceeded anyway, sometimes with encouragement from other agents. The solution could include a change to the instructions that guide a model’s behavior. Claude’s constitution , for example, sets out the values Anthropic wants the model to follow. But “perhaps surprisingly, law is just not one of them,” Kolt notes. These instructions could rank legal compli
匹配字段正文
