OpenGPTEvidence-based model decisionsAgent configuration · SWE-bench Verified
live-SWE-agent + Gemini 3 Pro Preview (2025-11-18)
The ranked object: model, scaffold, tools, permissions, budget, and environment together.
System identity
Agent systemlive-SWE-agent + Gemini 3 Pro Preview (2025-11-18)
Base modelGemini 3 Pro Preview (2025-11-18)
Source model ID or labelgemini-3-pro-preview
Scaffoldlive-SWE-agent
Scaffold versionNot reported
ToolsNot reported
Comparability groupswe-bench-verified-full-500
Evaluation configuration
Source snapshotSWE-bench Verified · Verified · Full leaderboard · 500 tasks · Jul 30, 2026
Tasks500 human-validated GitHub issues
EnvironmentReproducible repository environments evaluated by SWE-bench
BudgetLimits vary by submitted configuration
Evaluation date
Data captured
Resolved77.4%
Partial scoreNot reported
Published evidence
Open sourceEvidenceListed by the benchmark publisher
SourceSWE-bench Verified
CostNot reported
Cost basisThe source does not report a comparable cost for this configuration
Comparable cost is not reported for this configuration, so it is not treated as a low-cost option.
What this result does not prove
This result applies to the exact system and source conditions shown here. It does not establish a universal best agent, production reliability, data governance, or performance on a different benchmark version.