Agent 評測
AssistantBench Agent 評測
OpenGPT 將15筆公開記錄保留在下方所示的 AssistantBench 評測版本與環境內。
- 工作
- 33
- 公開記錄
- 15
- 來源資料日期
- 身分核驗日期
- 歷史記錄
資料範圍
HAL verified snapshot · 33 public tasks · 1 scaffold. public, automatically verifiable browsing tasks. Live-web research and browsing tasks reproduced by the Holistic Agent Leaderboard. Source-specific; no normalized step or token limit published.
OpenGPT 如何處理這些資料
OpenGPT 保留發布方的指標、工作範圍、環境、版本、設定欄位與資料日期,不產生跨評測 Agent 總分。
可比範圍
- 更高結果只適用於所展示的評測版本與條件。
- Agent 結果反映完整系統,而不是基礎模型單獨能力。
- 成本、穩定性、安全性或速度沒有公開時保持未報告,不進行推測。
- HAL reproduced these rows and publishes traces, costs, and run counts. The leaderboard is a historical snapshot: HAL has paused adding new models, and reported costs do not include caching benefits.
HAL verified snapshot · 33 public tasks · 1 scaffold
展示15筆公開記錄中的15筆;每項結果都保留來源評測與設定。
- Browser-Use · o3 Medium (April 2025)Browser Use · o3 Medium (April 2025)#1Accuracy: 38.81%Browser-Use
- Browser-Use · GPT-5 Medium (August 2025)Browser Use · GPT-5 Medium (August 2025)#2Accuracy: 35.23%Browser-Use
- Browser-Use · o4-mini Low (April 2025)Browser Use · o4-mini Low (April 2025)#3Accuracy: 28.05%Browser-Use
- Browser-Use · o4-mini High (April 2025)Browser Use · o4-mini High (April 2025)#4Accuracy: 23.84%Browser-Use
- Browser-Use · GPT-4.1 (April 2025)Browser Use · GPT-4.1 (April 2025)#5Accuracy: 17.39%Browser-Use
- Browser-Use · Claude-3.7 Sonnet (February 2025)Browser Use · Claude-3.7 Sonnet (February 2025)#6Accuracy: 16.69%Browser-Use
- Browser-Use · Claude Opus 4.1 High (August 2025)Browser Use · Claude Opus 4.1 High (August 2025)#7Accuracy: 13.75%Browser-Use
- Browser-Use · Claude-3.7 Sonnet High (February 2025)Browser Use · Claude-3.7 Sonnet High (February 2025)#8Accuracy: 13.08%Browser-Use
- Browser-Use · Claude Sonnet 4.5 High (September 2025)Browser Use · Claude Sonnet 4.5 High (September 2025)#9Accuracy: 11.80%Browser-Use
- Browser-Use · DeepSeek R1 (May 2025)Browser Use · DeepSeek R1 (May 2025)#10Accuracy: 8.75%Browser-Use
- Browser-Use · Claude Opus 4.1 (August 2025)Browser Use · Claude Opus 4.1 (August 2025)#11Accuracy: 7.26%Browser-Use
- Browser-Use · Claude Sonnet 4.5 (September 2025)Browser Use · Claude Sonnet 4.5 (September 2025)#12Accuracy: 7.09%Browser-Use
- Browser-Use · Gemini 2.0 Flash (February 2025)Browser Use · Gemini 2.0 Flash (February 2025)#13Accuracy: 2.62%Browser-Use
- Browser-Use · DeepSeek V3 (March 2025)Browser Use · DeepSeek V3 (March 2025)#14Accuracy: 2.03%Browser-Use
- Browser-Use · DeepSeek R1 (January 2025)Browser Use · DeepSeek R1 (January 2025)#15Accuracy: 0.00%Browser-Use