Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-dag-extreme-sample_196
minnesotanlp/aar-dag-easy-sample_212
minnesotanlp/aar-linear-extreme-sample_236
minnesotanlp/aar-linear-extreme-sample_022
minnesotanlp/aar-linear-easy-sample_119
minnesotanlp/aar-linear-hard-sample_065
minnesotanlp/aar-linear-easy-sample_166
minnesotanlp/aar-linear-medium-sample_118
minnesotanlp/aar-dag-medium-sample_021
minnesotanlp/aar-linear-extreme-sample_171
minnesotanlp/aar-dag-hard-sample_082
minnesotanlp/aar-linear-extreme-sample_170
minnesotanlp/aar-dag-extreme-sample_240
minnesotanlp/aar-dag-medium-sample_207
minnesotanlp/aar-linear-extreme-sample_144
minnesotanlp/aar-dag-hard-sample_221
minnesotanlp/aar-linear-extreme-sample_201
minnesotanlp/aar-dag-hard-sample_230
minnesotanlp/aar-linear-extreme-sample_080
minnesotanlp/aar-linear-easy-sample_083
minnesotanlp/aar-linear-medium-sample_015
minnesotanlp/aar-dag-easy-sample_066
minnesotanlp/aar-linear-medium-sample_186
minnesotanlp/aar-dag-extreme-sample_090
minnesotanlp/aar-linear-extreme-sample_023
minnesotanlp/aar-linear-medium-sample_042
minnesotanlp/aar-linear-medium-sample_210
minnesotanlp/aar-dag-hard-sample_193
minnesotanlp/aar-linear-easy-sample_174
minnesotanlp/aar-linear-medium-sample_156
minnesotanlp/aar-linear-extreme-sample_050
minnesotanlp/aar-dag-extreme-sample_073
minnesotanlp/aar-dag-extreme-sample_032
minnesotanlp/aar-dag-extreme-sample_011
minnesotanlp/aar-linear-hard-sample_021
minnesotanlp/aar-dag-hard-sample_143
minnesotanlp/aar-dag-hard-sample_104
minnesotanlp/aar-linear-easy-sample_173
minnesotanlp/aar-linear-easy-sample_048
minnesotanlp/aar-linear-medium-sample_102
minnesotanlp/aar-linear-hard-sample_058
minnesotanlp/aar-dag-medium-sample_043
minnesotanlp/aar-dag-extreme-sample_004
minnesotanlp/aar-linear-extreme-sample_053
minnesotanlp/aar-linear-hard-sample_216
minnesotanlp/aar-dag-hard-sample_022
minnesotanlp/aar-dag-extreme-sample_070
minnesotanlp/aar-linear-medium-sample_148
minnesotanlp/aar-linear-extreme-sample_055
minnesotanlp/aar-dag-hard-sample_215
minnesotanlp/aar-linear-hard-sample_112
minnesotanlp/aar-linear-hard-sample_183
minnesotanlp/aar-dag-easy-sample_171
minnesotanlp/aar-linear-easy-sample_102
minnesotanlp/aar-dag-easy-sample_156
minnesotanlp/aar-linear-medium-sample_169
minnesotanlp/aar-linear-hard-sample_202
minnesotanlp/aar-dag-easy-sample_004
minnesotanlp/aar-linear-easy-sample_205
minnesotanlp/aar-dag-medium-sample_232
minnesotanlp/aar-linear-easy-sample_074
minnesotanlp/aar-linear-easy-sample_189
minnesotanlp/aar-linear-extreme-sample_110
minnesotanlp/aar-dag-easy-sample_228
minnesotanlp/aar-linear-easy-sample_075
minnesotanlp/aar-linear-medium-sample_175
minnesotanlp/aar-dag-medium-sample_110
minnesotanlp/aar-linear-extreme-sample_079
minnesotanlp/aar-dag-easy-sample_072
minnesotanlp/aar-linear-easy-sample_159
minnesotanlp/aar-dag-medium-sample_129
minnesotanlp/aar-dag-hard-sample_027
minnesotanlp/aar-linear-extreme-sample_177
minnesotanlp/aar-dag-medium-sample_056
minnesotanlp/aar-dag-extreme-sample_237
minnesotanlp/aar-linear-extreme-sample_131
minnesotanlp/aar-dag-extreme-sample_034
minnesotanlp/aar-dag-hard-sample_111
minnesotanlp/aar-dag-easy-sample_204
minnesotanlp/aar-linear-medium-sample_010
minnesotanlp/aar-linear-extreme-sample_006
minnesotanlp/aar-linear-extreme-sample_185
minnesotanlp/aar-dag-easy-sample_133
minnesotanlp/aar-linear-extreme-sample_238
minnesotanlp/aar-dag-hard-sample_071
minnesotanlp/aar-dag-medium-sample_217
minnesotanlp/aar-linear-easy-sample_176
minnesotanlp/aar-dag-extreme-sample_054
minnesotanlp/aar-dag-easy-sample_218
minnesotanlp/aar-linear-hard-sample_116
minnesotanlp/aar-dag-hard-sample_038
minnesotanlp/aar-dag-medium-sample_201
minnesotanlp/aar-dag-medium-sample_177
minnesotanlp/aar-linear-medium-sample_073
minnesotanlp/aar-dag-medium-sample_083
minnesotanlp/aar-linear-easy-sample_180
minnesotanlp/aar-dag-extreme-sample_138
minnesotanlp/aar-linear-medium-sample_036
minnesotanlp/aar-linear-easy-sample_070
minnesotanlp/aar-linear-medium-sample_135

Displaying 100 of 1,400 tasks