Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-extreme-sample_008
minnesotanlp/aar-linear-hard-sample_215
minnesotanlp/aar-linear-hard-sample_109
minnesotanlp/aar-linear-extreme-sample_114
minnesotanlp/aar-dag-medium-sample_081
minnesotanlp/aar-dag-hard-sample_026
minnesotanlp/aar-dag-easy-sample_042
minnesotanlp/aar-dag-medium-sample_184
minnesotanlp/aar-linear-extreme-sample_237
minnesotanlp/aar-linear-easy-sample_181
minnesotanlp/aar-dag-extreme-sample_184
minnesotanlp/aar-linear-hard-sample_114
minnesotanlp/aar-linear-medium-sample_018
minnesotanlp/aar-dag-easy-sample_208
minnesotanlp/aar-linear-medium-sample_223
minnesotanlp/aar-dag-extreme-sample_191
minnesotanlp/aar-linear-medium-sample_004
minnesotanlp/aar-linear-hard-sample_082
minnesotanlp/aar-dag-medium-sample_169
minnesotanlp/aar-linear-easy-sample_191
minnesotanlp/aar-linear-hard-sample_044
minnesotanlp/aar-dag-medium-sample_039
minnesotanlp/aar-linear-hard-sample_043
minnesotanlp/aar-dag-easy-sample_117
minnesotanlp/aar-linear-medium-sample_082
minnesotanlp/aar-linear-extreme-sample_076
minnesotanlp/aar-dag-medium-sample_210
minnesotanlp/aar-dag-medium-sample_002
minnesotanlp/aar-dag-hard-sample_117
minnesotanlp/aar-linear-extreme-sample_014
minnesotanlp/aar-dag-medium-sample_064
minnesotanlp/aar-dag-hard-sample_093
minnesotanlp/aar-dag-medium-sample_038
minnesotanlp/aar-dag-extreme-sample_048
minnesotanlp/aar-linear-easy-sample_162
minnesotanlp/aar-linear-easy-sample_154
minnesotanlp/aar-linear-extreme-sample_128
minnesotanlp/aar-dag-hard-sample_105
minnesotanlp/aar-dag-extreme-sample_074
minnesotanlp/aar-dag-easy-sample_085
minnesotanlp/aar-linear-medium-sample_024
minnesotanlp/aar-linear-medium-sample_093
minnesotanlp/aar-linear-extreme-sample_033
minnesotanlp/aar-linear-easy-sample_131
minnesotanlp/aar-dag-medium-sample_106
minnesotanlp/aar-linear-easy-sample_029
minnesotanlp/aar-dag-extreme-sample_158
minnesotanlp/aar-linear-extreme-sample_194
minnesotanlp/aar-linear-hard-sample_231
minnesotanlp/aar-linear-easy-sample_196
minnesotanlp/aar-linear-medium-sample_178
minnesotanlp/aar-linear-extreme-sample_181
minnesotanlp/aar-linear-easy-sample_042
minnesotanlp/aar-dag-extreme-sample_235
minnesotanlp/aar-dag-easy-sample_056
minnesotanlp/aar-linear-medium-sample_075
minnesotanlp/aar-linear-hard-sample_118
minnesotanlp/aar-dag-extreme-sample_042
minnesotanlp/aar-linear-hard-sample_028
minnesotanlp/aar-dag-extreme-sample_064
minnesotanlp/aar-linear-medium-sample_227
minnesotanlp/aar-dag-extreme-sample_181
minnesotanlp/aar-linear-medium-sample_017
minnesotanlp/aar-linear-hard-sample_151
minnesotanlp/aar-linear-extreme-sample_186
minnesotanlp/aar-dag-extreme-sample_201
minnesotanlp/aar-linear-extreme-sample_196
minnesotanlp/aar-linear-medium-sample_026
minnesotanlp/aar-linear-extreme-sample_195
minnesotanlp/aar-linear-extreme-sample_203
minnesotanlp/aar-dag-hard-sample_099
minnesotanlp/aar-linear-extreme-sample_065
minnesotanlp/aar-linear-hard-sample_190
minnesotanlp/aar-dag-extreme-sample_096
minnesotanlp/aar-linear-easy-sample_141
minnesotanlp/aar-dag-hard-sample_149
minnesotanlp/aar-dag-easy-sample_134
minnesotanlp/aar-linear-hard-sample_013
minnesotanlp/aar-linear-medium-sample_003
minnesotanlp/aar-dag-easy-sample_067
minnesotanlp/aar-linear-extreme-sample_176
minnesotanlp/aar-linear-hard-sample_097
minnesotanlp/aar-linear-hard-sample_077
minnesotanlp/aar-dag-extreme-sample_094
minnesotanlp/aar-linear-easy-sample_184
minnesotanlp/aar-linear-hard-sample_209
minnesotanlp/aar-linear-easy-sample_023
minnesotanlp/aar-dag-hard-sample_197
minnesotanlp/aar-linear-medium-sample_011
minnesotanlp/aar-dag-extreme-sample_099
minnesotanlp/aar-linear-medium-sample_001
minnesotanlp/aar-linear-hard-sample_017
minnesotanlp/aar-dag-extreme-sample_106
minnesotanlp/aar-dag-extreme-sample_155
minnesotanlp/aar-linear-medium-sample_085
minnesotanlp/aar-dag-extreme-sample_115
minnesotanlp/aar-linear-medium-sample_013
minnesotanlp/aar-linear-extreme-sample_207
minnesotanlp/aar-dag-medium-sample_028
minnesotanlp/aar-linear-medium-sample_194

Displaying 100 of 1,400 tasks