OpenGPTAI decision intelligenceBinary completion18.52%Cost per successful taskNot publishedPublished result rangeNot published
Agent details →Shared benchmark scope · OSWorld 2.0
Same-benchmark agent comparison
The entries below share the same benchmark scope. Their exact scaffolds, model versions, dates, and original source values remain visible.
A higher source value only means better performance on this benchmark and configuration. It is not a cross-benchmark or production-readiness score.
Compare like with like
Decision overview
Only configurations from the same benchmark version and task scope can be placed in one comparison.
Binary completion20.6%Cost per successful taskNot publishedPublished result rangeNot published
Agent details →18 identical or entirely unreported fields hidden
| Agent system | OSWorld Agent · Claude Opus 4.8 · Max · Standard | OSWorld Agent · Claude Opus 4.8 · Max · Batched tool |
|---|---|---|
| Configuration | ||
| Tools | Standard computer-use tool | Batched computer-use tool |
| Outcome | ||
| Binary completion | 18.52% | 20.6% |
| Partial score | 49.33% | 54.8% |
| Source | ||
| Open source | Open source ↗ | Open source ↗ |
Configuration
OSWorld Agent · Claude Opus 4.8 · Max · Standard
- Tools
- Standard computer-use tool
OSWorld Agent · Claude Opus 4.8 · Max · Batched tool
- Tools
- Batched computer-use tool
Outcome
OSWorld Agent · Claude Opus 4.8 · Max · Standard
- Binary completion
- 18.52%
- Partial score
- 49.33%
OSWorld Agent · Claude Opus 4.8 · Max · Batched tool
- Binary completion
- 20.6%
- Partial score
- 54.8%
Source
OSWorld Agent · Claude Opus 4.8 · Max · Standard
OSWorld Agent · Claude Opus 4.8 · Max · Batched tool
Source-reported data; missing values remain unknown.
Validate before adoption
Public rankings create a shortlist. A small private trial decides whether the configuration fits your work.
- 1
Choose 10–20 representative tasks and define a clear pass condition.
- 2
Lock the agent, model, tools, permissions, and budget before testing.
- 3
Run each important task more than once; record success, cost, time, and takeovers.
- 4
Review failures and data-handling risks before a production decision.