Agent评测

OSWorld 2.0 Agent评测

OpenGPT将10条公开记录保留在下方所示的OSWorld 2.0 评测版本与环境内。

任务
108
公开记录
10
来源数据日期
身份核验日期
历史记录

数据范围

task version v2026.06.24 · 500-step budget. long-horizon computer workflows. Desktop applications and operating-system workflows in reproducible VMs. 500 steps.

OpenGPT如何处理这些数据

OpenGPT保留发布方的指标、任务范围、环境、版本、配置字段与数据日期,不生成跨评测Agent总分。

可比边界

  • 更高结果只适用于所展示的评测版本与条件。
  • Agent结果反映完整系统,而不是基础模型单独能力。
  • 成本、稳定性、安全性或速度没有公开时保持未报告,不进行推测。
  • Rows preserve the version-pinned v2026.06.24 result as historical evidence. They are not relabeled as current because the active v2026.08.08 benchmark release changes task semantics and no matching current result snapshot is available.

task version v2026.06.24 · 500-step budget

展示10条公开记录中的10条;每项结果都保留来源评测与配置。

  1. OSWorld Agent · Claude Opus 4.8 · Max · Batched toolAnthropic · Claude Opus 4.8#1Binary completion: 20.6%OSWorld 2.0 computer-use agent
  2. OSWorld Agent · Claude Opus 4.8 · Max · StandardAnthropic · Claude Opus 4.8#2Binary completion: 18.52%OSWorld 2.0 computer-use agent
  3. OSWorld Agent · Claude Opus 4.7 · Max · Batched toolAnthropic · Claude Opus 4.7#3Binary completion: 18.2%OSWorld 2.0 computer-use agent
  4. OSWorld Agent · Claude Opus 4.7 · Max · StandardAnthropic · Claude Opus 4.7#4Binary completion: 13.9%OSWorld 2.0 computer-use agent
  5. OSWorld Agent · GPT-5.5 · Xhigh · Batch toolOpenAI · GPT-5.5#5Binary completion: 13.0%OSWorld 2.0 computer-use agent
  6. OSWorld Agent · Claude Sonnet 4.6 · Medium · StandardAnthropic · Claude Sonnet 4.6#6Binary completion: 9.3%OSWorld 2.0 computer-use agent
  7. OSWorld Agent · Claude Sonnet 4.6 · Max · StandardAnthropic · Claude Sonnet 4.6#7Binary completion: 8.3%OSWorld 2.0 computer-use agent
  8. OSWorld Agent · MiniMax M3 · Enabled · StandardMiniMax · MiniMax M3#8Binary completion: 4.6%OSWorld 2.0 computer-use agent
  9. OSWorld Agent · Kimi 2.6 · Enabled · StandardMoonshot AI · Kimi 2.6#8Binary completion: 4.6%OSWorld 2.0 computer-use agent
  10. OSWorld Agent · Qwen 3.7-Plus · Thinking · StandardAlibaba Qwen · Qwen 3.7-Plus#10Binary completion: 2.8%OSWorld 2.0 computer-use agent