Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-medium-sample_211
minnesotanlp/aar-dag-extreme-sample_176
minnesotanlp/aar-linear-easy-sample_028
minnesotanlp/aar-linear-medium-sample_094
minnesotanlp/aar-linear-hard-sample_180
minnesotanlp/aar-linear-extreme-sample_162
minnesotanlp/aar-dag-extreme-sample_233
minnesotanlp/aar-dag-hard-sample_096
minnesotanlp/aar-dag-medium-sample_025
minnesotanlp/aar-linear-hard-sample_130
minnesotanlp/aar-dag-easy-sample_189
minnesotanlp/aar-linear-easy-sample_105
minnesotanlp/aar-linear-medium-sample_195
minnesotanlp/aar-dag-hard-sample_112
minnesotanlp/aar-dag-hard-sample_148
minnesotanlp/aar-linear-medium-sample_199
minnesotanlp/aar-dag-easy-sample_064
minnesotanlp/aar-linear-extreme-sample_039
minnesotanlp/aar-linear-extreme-sample_113
minnesotanlp/aar-dag-easy-sample_206
minnesotanlp/aar-linear-hard-sample_039
minnesotanlp/aar-dag-hard-sample_180
minnesotanlp/aar-linear-medium-sample_193
minnesotanlp/aar-linear-easy-sample_056
minnesotanlp/aar-linear-hard-sample_201
minnesotanlp/aar-dag-hard-sample_164
minnesotanlp/aar-dag-hard-sample_234
minnesotanlp/aar-linear-hard-sample_148
minnesotanlp/aar-linear-extreme-sample_187
minnesotanlp/aar-dag-medium-sample_087
minnesotanlp/aar-linear-easy-sample_076
minnesotanlp/aar-linear-hard-sample_090
minnesotanlp/aar-linear-extreme-sample_233
minnesotanlp/aar-dag-easy-sample_182
minnesotanlp/aar-linear-extreme-sample_209
minnesotanlp/aar-dag-extreme-sample_082
minnesotanlp/aar-dag-easy-sample_037
minnesotanlp/aar-dag-extreme-sample_204
minnesotanlp/aar-linear-hard-sample_101
minnesotanlp/aar-linear-medium-sample_150
minnesotanlp/aar-linear-hard-sample_007
minnesotanlp/aar-dag-hard-sample_214
minnesotanlp/aar-dag-hard-sample_135
minnesotanlp/aar-linear-hard-sample_005
minnesotanlp/aar-linear-hard-sample_138
minnesotanlp/aar-dag-hard-sample_049
minnesotanlp/aar-dag-medium-sample_057
minnesotanlp/aar-linear-easy-sample_039
minnesotanlp/aar-linear-hard-sample_074
minnesotanlp/aar-dag-extreme-sample_145
minnesotanlp/aar-linear-easy-sample_027
minnesotanlp/aar-linear-extreme-sample_164
minnesotanlp/aar-linear-hard-sample_194
minnesotanlp/aar-dag-easy-sample_223
minnesotanlp/aar-linear-medium-sample_080
minnesotanlp/aar-linear-hard-sample_106
minnesotanlp/aar-linear-easy-sample_123
minnesotanlp/aar-linear-extreme-sample_012
minnesotanlp/aar-dag-extreme-sample_234
minnesotanlp/aar-linear-medium-sample_146
minnesotanlp/aar-linear-hard-sample_211
minnesotanlp/aar-dag-extreme-sample_236
minnesotanlp/aar-linear-extreme-sample_088
minnesotanlp/aar-linear-easy-sample_078
minnesotanlp/aar-linear-medium-sample_057
minnesotanlp/aar-linear-easy-sample_133
minnesotanlp/aar-linear-hard-sample_035
minnesotanlp/aar-dag-medium-sample_230
minnesotanlp/aar-linear-medium-sample_115
minnesotanlp/aar-linear-medium-sample_197
minnesotanlp/aar-linear-medium-sample_218
minnesotanlp/aar-linear-extreme-sample_108
minnesotanlp/aar-linear-hard-sample_046
minnesotanlp/aar-linear-easy-sample_171
minnesotanlp/aar-linear-extreme-sample_025
minnesotanlp/aar-linear-medium-sample_050
minnesotanlp/aar-linear-medium-sample_061
minnesotanlp/aar-linear-easy-sample_108
minnesotanlp/aar-linear-easy-sample_151
minnesotanlp/aar-linear-medium-sample_217
minnesotanlp/aar-linear-easy-sample_178
minnesotanlp/aar-linear-medium-sample_019
minnesotanlp/aar-linear-extreme-sample_061
minnesotanlp/aar-dag-medium-sample_003
minnesotanlp/aar-dag-hard-sample_225
minnesotanlp/aar-linear-easy-sample_113
minnesotanlp/aar-dag-hard-sample_078
minnesotanlp/aar-dag-extreme-sample_065
minnesotanlp/aar-linear-medium-sample_179
minnesotanlp/aar-linear-hard-sample_189
minnesotanlp/aar-linear-easy-sample_032
minnesotanlp/aar-linear-easy-sample_006
minnesotanlp/aar-dag-extreme-sample_202
minnesotanlp/aar-linear-hard-sample_113
minnesotanlp/aar-linear-medium-sample_083
minnesotanlp/aar-dag-hard-sample_060
minnesotanlp/aar-dag-medium-sample_147
minnesotanlp/aar-dag-medium-sample_009
minnesotanlp/aar-linear-easy-sample_219
minnesotanlp/aar-dag-hard-sample_156

Displaying 100 of 1,400 tasks