Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-extreme-sample_191
minnesotanlp/aar-linear-hard-sample_085
minnesotanlp/aar-linear-hard-sample_020
minnesotanlp/aar-linear-easy-sample_053
minnesotanlp/aar-linear-easy-sample_169
minnesotanlp/aar-linear-hard-sample_213
minnesotanlp/aar-dag-extreme-sample_164
minnesotanlp/aar-linear-easy-sample_185
minnesotanlp/aar-linear-hard-sample_152
minnesotanlp/aar-linear-easy-sample_082
minnesotanlp/aar-dag-extreme-sample_244
minnesotanlp/aar-linear-extreme-sample_211
minnesotanlp/aar-dag-hard-sample_189
minnesotanlp/aar-linear-hard-sample_119
minnesotanlp/aar-linear-easy-sample_121
minnesotanlp/aar-linear-extreme-sample_099
minnesotanlp/aar-linear-medium-sample_038
minnesotanlp/aar-linear-medium-sample_152
minnesotanlp/aar-dag-hard-sample_171
minnesotanlp/aar-linear-extreme-sample_223
minnesotanlp/aar-dag-extreme-sample_163
minnesotanlp/aar-linear-easy-sample_188
minnesotanlp/aar-dag-extreme-sample_146
minnesotanlp/aar-dag-hard-sample_032
minnesotanlp/aar-dag-extreme-sample_043
minnesotanlp/aar-linear-hard-sample_173
minnesotanlp/aar-dag-medium-sample_231
minnesotanlp/aar-dag-extreme-sample_159
minnesotanlp/aar-linear-easy-sample_099
minnesotanlp/aar-linear-hard-sample_088
minnesotanlp/aar-dag-easy-sample_216
minnesotanlp/aar-linear-extreme-sample_015
minnesotanlp/aar-dag-extreme-sample_089
minnesotanlp/aar-linear-easy-sample_117
minnesotanlp/aar-dag-medium-sample_226
minnesotanlp/aar-linear-medium-sample_173
minnesotanlp/aar-linear-hard-sample_052
minnesotanlp/aar-linear-easy-sample_179
minnesotanlp/aar-linear-extreme-sample_091
minnesotanlp/aar-linear-hard-sample_204
minnesotanlp/aar-linear-easy-sample_156
minnesotanlp/aar-linear-medium-sample_110
minnesotanlp/aar-linear-easy-sample_106
minnesotanlp/aar-linear-hard-sample_100
minnesotanlp/aar-linear-medium-sample_129
minnesotanlp/aar-dag-hard-sample_239
minnesotanlp/aar-dag-hard-sample_092
minnesotanlp/aar-linear-medium-sample_128
minnesotanlp/aar-linear-easy-sample_170
minnesotanlp/aar-linear-hard-sample_055
minnesotanlp/aar-dag-extreme-sample_095
minnesotanlp/aar-dag-medium-sample_146
minnesotanlp/aar-dag-extreme-sample_248
minnesotanlp/aar-linear-easy-sample_073
minnesotanlp/aar-linear-hard-sample_089
minnesotanlp/aar-linear-extreme-sample_241
minnesotanlp/aar-dag-medium-sample_202
minnesotanlp/aar-dag-medium-sample_121
minnesotanlp/aar-linear-extreme-sample_192
minnesotanlp/aar-linear-hard-sample_124
minnesotanlp/aar-linear-medium-sample_002
minnesotanlp/aar-linear-extreme-sample_089
minnesotanlp/aar-linear-extreme-sample_190
minnesotanlp/aar-linear-easy-sample_207
minnesotanlp/aar-linear-extreme-sample_046
minnesotanlp/aar-dag-extreme-sample_113
minnesotanlp/aar-dag-medium-sample_182
minnesotanlp/aar-linear-extreme-sample_214
minnesotanlp/aar-dag-medium-sample_135
minnesotanlp/aar-linear-hard-sample_092
minnesotanlp/aar-dag-extreme-sample_105
minnesotanlp/aar-linear-hard-sample_067
minnesotanlp/aar-linear-hard-sample_178
minnesotanlp/aar-linear-extreme-sample_098
minnesotanlp/aar-dag-medium-sample_185
minnesotanlp/aar-dag-hard-sample_088
minnesotanlp/aar-dag-hard-sample_077
minnesotanlp/aar-dag-hard-sample_218
minnesotanlp/aar-dag-easy-sample_063
minnesotanlp/aar-linear-hard-sample_051
minnesotanlp/aar-linear-extreme-sample_222
minnesotanlp/aar-linear-extreme-sample_094
minnesotanlp/aar-linear-medium-sample_060
minnesotanlp/aar-dag-easy-sample_062
minnesotanlp/aar-linear-extreme-sample_216
minnesotanlp/aar-linear-medium-sample_213
minnesotanlp/aar-linear-extreme-sample_230
minnesotanlp/aar-linear-easy-sample_004
minnesotanlp/aar-linear-easy-sample_128
minnesotanlp/aar-dag-hard-sample_024
minnesotanlp/aar-linear-easy-sample_026
minnesotanlp/aar-dag-extreme-sample_097
minnesotanlp/aar-linear-medium-sample_081
minnesotanlp/aar-linear-easy-sample_109
minnesotanlp/aar-linear-easy-sample_122
minnesotanlp/aar-linear-extreme-sample_102
minnesotanlp/aar-linear-hard-sample_078
minnesotanlp/aar-linear-extreme-sample_109
minnesotanlp/aar-dag-hard-sample_010
minnesotanlp/aar-dag-medium-sample_167

Displaying 100 of 1,400 tasks