Shared benchmark scope · τ³-Banking Knowledge

Same-benchmark agent comparison

The entries below share the same benchmark scope. Their exact scaffolds, model versions, dates, and original source values remain visible.

A higher source value only means better performance on this benchmark and configuration. It is not a cross-benchmark or production-readiness score.

Compare like with like

Decision overview

Only configurations from the same benchmark version and task scope can be placed in one comparison.

Source-reported data; missing values remain unknown.

Thinking Machines Labτ³ Banking AllTools · Inkling · max

Pass¹25.00%Cost per successful taskNot publishedPublished result rangeNot published

Qwenτ³ Banking AllTools · Qwen 3.8 Max · xhigh

Pass¹55.15%Cost per successful taskNot publishedPublished result rangeNot published

17 identical or entirely unreported fields hidden

Agent system	τ³ Banking AllTools · Inkling · max	τ³ Banking AllTools · Qwen 3.8 Max · xhigh
Configuration
Base model	Inkling	Qwen 3.8 Max
Source model ID or label	Inkling · max	Qwen 3.8 Max · xhigh
Outcome
Pass¹	25.00%	55.15%
Trust
Evaluation date	Jul 24, 2026	Aug 3, 2026
Source
Open source	Open source ↗	Open source ↗

Source-reported data; missing values remain unknown.

Public rankings create a shortlist. A small private trial decides whether the configuration fits your work.

1
Choose 10–20 representative tasks and define a clear pass condition.
2
Lock the agent, model, tools, permissions, and budget before testing.
3
Run each important task more than once; record success, cost, time, and takeovers.
4
Review failures and data-handling risks before a production decision.