返回 2026-08-22 编辑版
发现与解读中文优先 · EN 原文能力与基础设施

Einsia 发布:AI4AI-Bench 显示 Agent 改进训练算法的平均得分仅 0.166

1/ 递归自我改进(RSI)取决于代理改进AI系统的训练方式 ——不仅仅是调整超参数,还改进训练算法本身。 我们直接使用AI4AI-Bench 进行了测试:涵盖 10 个不同算法系列的 10 个真实研究存储库。 全面解析👇 GitHub:[https://github.com/Einsia/AI4AI-长凳] 论文链接:[https://arxiv.org/pdf/2608.20318] Einsia 网址:[https://lab.einsia.ai/ai4ai/] 📊 结果: 平均分仅为0.166。 即使是性能最好的型号 Opus 5,也只能达到 0.288。 每项任务的探索成本中位数从 1.69 美元上升到 34.60 美元。 #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_长凳

查看英文原文

1/ Recursive self-improvement (RSI) depends on agents improving how AI systems are trained —not just tuning hyperparameters, but improving the training algorithm itself. We tested this directly with AI4AI-Bench: 10 real research repositories spanning 10 distinct algorithm families. Full breakdown 👇 GitHub: [https://github.com/Einsia/AI4AI-Bench] Paper Link: [https://arxiv.org/pdf/2608.20318] Einsia Website:[https://lab.einsia.ai/ai4ai/] 📊 The results: The average score is just 0.166. Even the best-performing model, Opus 5, reaches only 0.288. The median exploration cost per task rises from $1.69 to $34.60. #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_Bench

1/ Recursive self-improvement (RSI) depends on agents improving how AI systems are trained —not just tuning hyperparameters, but improving the training algorithm itself. We tested this directly with AI4AI-Bench: 10 real research repositories spanning 10 distinct algorithm families. Full breakdown 👇 GitHub: [https://github.com/Einsia/AI4AI-Bench] Paper Link: [https://arxiv.org/pdf/2608.20318] Einsia Website:[https://lab.einsia.ai/ai4ai/] 📊 The results: The average score is just 0.166. Even the best-performing model, Opus 5, reaches only 0.288. The median exploration cost per task rises from $1.69 to $34.60. #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_Bench

Agent 能不能真干活,关键从生成代码转向可验证 Harness

为什么值得看

当模型能力趋同,任务分解、环境反馈、验证闭环与止损纪律会成为真实生产力的主要差异。

最强反方

两篇 Harness 文章主要是经验分析;AI4AI-Bench 的任务构造、评分与成本口径仍需回到研究资产复核。

原始出现与传播对照

1 条出现 · 本次 AIHOT 未精确命中

发现与解读

1/ 递归自我改进(RSI)取决于代理改进AI系统的训练方式 ——不仅仅是调整超参数,还改进训练算法本身。 我们直接使用AI4AI-Bench 进行了测试:涵盖 10 个不同算法系列的 10 个真实研究存储库。 全面解析👇…

1/ 递归自我改进(RSI)取决于代理改进AI系统的训练方式 ——不仅仅是调整超参数,还改进训练算法本身。 我们直接使用AI4AI-Bench 进行了测试:涵盖 10 个不同算法系列的 10 个真实研究存储库。 全面解析👇 GitHub:[https://github.com/Einsia/AI4AI-长凳] 论文链接:[https://arxiv.org/pdf/2608.20318] Einsia 网址:[https://lab.einsia.ai/ai4ai/] 📊 结果: 平均分仅为0.166。 即使是性能最好的型号 Opus 5,也只能达到 0.288。 每项任务的探索成本中位数从 1.69 美元上升到 34.60 美元。

查看英文原文

1/ Recursive self-improvement (RSI) depends on agents improving how AI systems are trained —not just tuning hyperparameters, but improving the training algorithm itself. We tested this directly with AI4AI-Bench: 10 real research repositories spanning 10 distinct algorithm families. Full breakdown 👇 GitHub: [https://github.com/Einsia/AI4AI-Bench] Paper Link: [https://arxiv.org/pdf/2608.20318] Einsia Website:[https://lab.einsia.ai/ai4ai/] 📊 The results: The average score is just 0.166. Even the best-performing model, Opus 5, reaches only 0.288. The median exploration cost per task rises from $1.69 to $34.60. #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_Bench

1/ Recursive self-improvement (RSI) depends on agents improving how AI systems are trained —not just tuning hyperparameters, but improving the training algorithm itself. We tested this directly with AI4AI-Bench: 10 real research repositories spanning 10 distinct algorithm families. Full breakdown 👇 GitHub: [https://github.com/Einsia/AI4AI-Bench] Paper Link: [https://arxiv.org/pdf/2608.20318] Einsia Website:[https://lab.einsia.ai/ai4ai/] 📊 The results: The average score is just 0.166. Even the best-performing model, Opus 5, reaches only 0.288. The median exploration cost per task rises from $1.69 to $34.60. #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_Bench

直接发布标题Einsia@EinsiaAI打开该层出处 ↗

1/ Recursive self-improvement (RSI) depends on agents improving how AI systems are trained —not just tuning hyperparameters, but improving the training algorithm itself. We tested this directly with AI4AI-Bench: 10 real research repositories spanning 10 distinct algorithm families. Full breakdown 👇 GitHub: [https://github.com/Einsia/AI4AI-Bench] Paper Link: [https://arxiv.org/pdf/2608.20318] Einsia Website:[https://lab.einsia.ai/ai4ai/] 📊 The results: The average score is just 0.166. Even the best-performing model, Opus 5, reaches only 0.288. The median exploration cost per task rises from $1.69 to $34.60. #AI4AI #RecursiveSelfImprovement #AIResearch #AI4AI_Bench

来源
X @_akhaliq · x-akhaliq
证据角色
x_project_network
时间状态
known
用户判决
未判
查看该来源原文raw/x-akhaliq.json40d524bfd5a69d9200a4c9022c83b7799693842b00af418e8b15b6fa87c32af9
Cluster IDevt_9f01f98a53332f6a5c14bdfd精确去重依据canonical_url事件状态未判