Epoch AI:基准测试能帮助回答的 9 个大问题
Epoch AI 提出 9 个关于 AI 能力的大问题,涵盖 AI 能否胜任完整工作、网络安全与计算机使用等下一波能力突破、前沿与追赶模型差距、基准分数为何高度相关,以及 AI 能否做 AI 研发。文中提到 MirrorCode、Remote Labor Index、由 AI 智能体实际运营的咖啡馆 Andon Café 等评测尝试,以及将多基准分数合成单一指标的 Epoch Capabilities Index(ECI)。
ent area right now is cybersecurity: when will AI be able to hack almost any vulnerable system? Cybersecurity benchmarks arguably were already ringing alarm bells, even before the Hugging Face incident. Another area that comes to mind is computer use. Speaking proverbially, “my dad” uses AI all the time now, but only via chat apps — nothing agentic. My guess is that fast, reliable computer use will unlock another leg up for AI adoption, even if we can’t say exactly what degree of speed and relia
匹配字段正文



