Amazon 与 AVERI 合作,通过独立第三方评审强化 AI 安全评估
Amazon 与独立非营利机构 AVERI 合作,对 Amazon 内部安全评估数据集开展第三方评审,检查测试本身的质量而非仅模型输出。AVERI 的独立评审确认了主题覆盖全面、测试方法多样、污染风险低三项优势,同时指出多语言覆盖和多步对抗提示词有待加强。Amazon 据此更新测试集、引入分级难度校准框架、建立季度评审机制,并将多语言提示词扩展到所有风险类别。
ce: engaging independent third parties to evaluate not just model outputs, but the quality of the evaluation process itself. As the AI safety field matures, we expect this kind of meta-evaluation to become an important complement to traditional red-teaming and benchmarking. The benefits are mutual: Amazon gains an independent check on our evaluation quality, while AVERI gains practical experience with the real-world challenges of assessing internal evaluation processes — insights that can inform
匹配字段正文




