字节 Seed 发布 EdgeBench:衡量智能体真实环境学习的超长时程基准
字节 Seed 发布 EdgeBench,一个衡量智能体从真实环境学习的超长时程基准,包含 134 项任务、覆盖六大能力领域,每项任务支持至少 12 小时连续运行。基于约 38000 小时环境交互,研究发现智能体在环境学习中的整体表现遵循 log-sigmoid 曲线,平均拟合优度 R² 达 0.998,且不同代际前沿模型的学习速度约每三个月翻倍。EdgeBench 已开源 51 项任务及完整评测框架。
zon benchmark built to measure learning from real-world environments . The benchmark comprises 134 realistic and diverse tasks spanning six major capability domains, each allowing agents to operate continuously for at least 12 hours. Based on long-horizon interaction runs across these tasks, we find that the overall agent performance in "environment learning" closely follows a log-sigmoid curve , with an average goodness of fit of R² = 0.998. Across frontier models from different generations, ag
匹配字段正文
