Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-dag-medium-sample_211
minnesotanlp/aar-linear-hard-sample_159
minnesotanlp/aar-linear-hard-sample_208
minnesotanlp/aar-dag-extreme-sample_047
minnesotanlp/aar-linear-medium-sample_116
minnesotanlp/aar-dag-hard-sample_028
minnesotanlp/aar-linear-medium-sample_030
minnesotanlp/aar-dag-medium-sample_091
minnesotanlp/aar-linear-extreme-sample_118
minnesotanlp/aar-linear-easy-sample_084
minnesotanlp/aar-dag-extreme-sample_245
minnesotanlp/aar-linear-extreme-sample_056
minnesotanlp/aar-dag-medium-sample_006
minnesotanlp/aar-linear-medium-sample_163
minnesotanlp/aar-dag-hard-sample_017
minnesotanlp/aar-linear-extreme-sample_145
minnesotanlp/aar-dag-medium-sample_224
minnesotanlp/aar-linear-hard-sample_061
minnesotanlp/aar-linear-medium-sample_005
minnesotanlp/aar-dag-easy-sample_038
minnesotanlp/aar-linear-medium-sample_006
minnesotanlp/aar-dag-extreme-sample_039
minnesotanlp/aar-linear-medium-sample_033
minnesotanlp/aar-dag-medium-sample_041
minnesotanlp/aar-linear-easy-sample_206
minnesotanlp/aar-linear-easy-sample_112
minnesotanlp/aar-linear-easy-sample_210
minnesotanlp/aar-dag-easy-sample_098
minnesotanlp/aar-dag-hard-sample_080
minnesotanlp/aar-dag-medium-sample_042
minnesotanlp/aar-linear-hard-sample_102
minnesotanlp/aar-dag-hard-sample_194
minnesotanlp/aar-linear-extreme-sample_224
minnesotanlp/aar-linear-easy-sample_195
minnesotanlp/aar-dag-hard-sample_101
minnesotanlp/aar-linear-easy-sample_110
minnesotanlp/aar-linear-extreme-sample_221
minnesotanlp/aar-linear-extreme-sample_084
minnesotanlp/aar-linear-medium-sample_064
minnesotanlp/aar-linear-extreme-sample_067
minnesotanlp/aar-dag-hard-sample_069
minnesotanlp/aar-dag-extreme-sample_031
minnesotanlp/aar-linear-medium-sample_092
minnesotanlp/aar-linear-hard-sample_234
minnesotanlp/aar-linear-hard-sample_042
minnesotanlp/aar-linear-hard-sample_099
minnesotanlp/aar-linear-medium-sample_144
minnesotanlp/aar-dag-medium-sample_020
minnesotanlp/aar-linear-hard-sample_150
minnesotanlp/aar-linear-medium-sample_041
minnesotanlp/aar-dag-easy-sample_033
minnesotanlp/aar-linear-medium-sample_209
minnesotanlp/aar-linear-medium-sample_108
minnesotanlp/aar-dag-hard-sample_050
minnesotanlp/aar-dag-hard-sample_004
minnesotanlp/aar-dag-medium-sample_153
minnesotanlp/aar-dag-hard-sample_178
minnesotanlp/aar-linear-medium-sample_207
minnesotanlp/aar-dag-extreme-sample_183
minnesotanlp/aar-linear-extreme-sample_072
minnesotanlp/aar-linear-hard-sample_155
minnesotanlp/aar-dag-hard-sample_083
minnesotanlp/aar-dag-hard-sample_075
minnesotanlp/aar-linear-hard-sample_221
minnesotanlp/aar-linear-extreme-sample_206
minnesotanlp/aar-linear-hard-sample_038
minnesotanlp/aar-linear-medium-sample_039
minnesotanlp/aar-linear-hard-sample_034
minnesotanlp/aar-dag-medium-sample_145
minnesotanlp/aar-dag-easy-sample_039
minnesotanlp/aar-dag-hard-sample_127
minnesotanlp/aar-dag-extreme-sample_172
minnesotanlp/aar-dag-extreme-sample_209
minnesotanlp/aar-linear-easy-sample_139
minnesotanlp/aar-dag-extreme-sample_109
minnesotanlp/aar-dag-extreme-sample_212
minnesotanlp/aar-dag-hard-sample_198
minnesotanlp/aar-linear-hard-sample_132
minnesotanlp/aar-dag-hard-sample_065
minnesotanlp/aar-linear-hard-sample_196
minnesotanlp/aar-linear-extreme-sample_154
minnesotanlp/aar-linear-easy-sample_090
minnesotanlp/aar-linear-hard-sample_062
minnesotanlp/aar-linear-easy-sample_216
minnesotanlp/aar-dag-extreme-sample_147
minnesotanlp/aar-linear-hard-sample_073
minnesotanlp/aar-dag-easy-sample_069
minnesotanlp/aar-dag-hard-sample_062
minnesotanlp/aar-linear-hard-sample_022
minnesotanlp/aar-dag-medium-sample_221
minnesotanlp/aar-linear-hard-sample_236
minnesotanlp/aar-dag-easy-sample_181
minnesotanlp/aar-linear-medium-sample_226
minnesotanlp/aar-dag-easy-sample_207
minnesotanlp/aar-linear-hard-sample_207
minnesotanlp/aar-linear-extreme-sample_161
minnesotanlp/aar-linear-extreme-sample_136
minnesotanlp/aar-dag-medium-sample_005
minnesotanlp/aar-dag-extreme-sample_015
minnesotanlp/aar-linear-extreme-sample_074

Displaying 100 of 1,400 tasks