Leaderboard Row

Terminal-Bench 4.1|330/330 trials completed|1 errors|avg reward 0.55
Completed
330 / 330
Errors
1
Retries
0
Cost
$1,914.80
Providers
1
Models
1
Avg reward
0.55
Job progress: 100%
329 completed1 error0 in progress0 pending
Tokens
Output (10,770,605)
Prompt (37,239,844)
Cached (1,003,874,758)
1,051,885,207 tokens

Evaluation Breakdown

Terminal-Bench 4.0 to Terminal Bench 4.1 Regrade · GPT-6 Astra / Codex · medium
330
1
0.55