Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-easy-sample_116
minnesotanlp/aar-linear-medium-sample_220
minnesotanlp/aar-linear-extreme-sample_137
minnesotanlp/aar-linear-medium-sample_141
minnesotanlp/aar-linear-easy-sample_071
minnesotanlp/aar-linear-extreme-sample_153
minnesotanlp/aar-dag-extreme-sample_194
minnesotanlp/aar-dag-extreme-sample_091
minnesotanlp/aar-linear-extreme-sample_235
minnesotanlp/aar-linear-extreme-sample_066
minnesotanlp/aar-linear-easy-sample_063
minnesotanlp/aar-dag-easy-sample_013
minnesotanlp/aar-linear-easy-sample_190
minnesotanlp/aar-dag-medium-sample_161
minnesotanlp/aar-dag-extreme-sample_192
minnesotanlp/aar-linear-medium-sample_225
minnesotanlp/aar-dag-hard-sample_079
minnesotanlp/aar-dag-medium-sample_097
minnesotanlp/aar-linear-extreme-sample_138
minnesotanlp/aar-linear-extreme-sample_090
minnesotanlp/aar-dag-extreme-sample_075
minnesotanlp/aar-dag-medium-sample_101
minnesotanlp/aar-dag-hard-sample_020
minnesotanlp/aar-dag-medium-sample_045
minnesotanlp/aar-linear-extreme-sample_082
minnesotanlp/aar-dag-extreme-sample_079
minnesotanlp/aar-dag-easy-sample_192
minnesotanlp/aar-linear-extreme-sample_217
minnesotanlp/aar-linear-extreme-sample_020
minnesotanlp/aar-dag-extreme-sample_066
minnesotanlp/aar-dag-hard-sample_057
minnesotanlp/aar-linear-easy-sample_208
minnesotanlp/aar-linear-hard-sample_161
minnesotanlp/aar-dag-easy-sample_217
minnesotanlp/aar-linear-easy-sample_050
minnesotanlp/aar-dag-medium-sample_117
minnesotanlp/aar-linear-hard-sample_096
minnesotanlp/aar-linear-hard-sample_011
minnesotanlp/aar-linear-extreme-sample_086
minnesotanlp/aar-dag-medium-sample_203
minnesotanlp/aar-dag-extreme-sample_107
minnesotanlp/aar-linear-hard-sample_153
minnesotanlp/aar-linear-extreme-sample_213
minnesotanlp/aar-dag-easy-sample_011
minnesotanlp/aar-linear-easy-sample_055
minnesotanlp/aar-dag-extreme-sample_033
minnesotanlp/aar-linear-medium-sample_096
minnesotanlp/aar-linear-hard-sample_094
minnesotanlp/aar-dag-extreme-sample_035
minnesotanlp/aar-dag-medium-sample_011
minnesotanlp/aar-linear-extreme-sample_142
minnesotanlp/aar-linear-medium-sample_028
minnesotanlp/aar-dag-easy-sample_090
minnesotanlp/aar-dag-extreme-sample_195
minnesotanlp/aar-dag-hard-sample_091
minnesotanlp/aar-dag-medium-sample_049
minnesotanlp/aar-dag-extreme-sample_208
minnesotanlp/aar-dag-hard-sample_216
minnesotanlp/aar-dag-easy-sample_220
minnesotanlp/aar-dag-medium-sample_139
minnesotanlp/aar-dag-easy-sample_054
minnesotanlp/aar-dag-medium-sample_090
minnesotanlp/aar-dag-hard-sample_089
minnesotanlp/aar-linear-extreme-sample_127
minnesotanlp/aar-dag-hard-sample_019
minnesotanlp/aar-linear-medium-sample_155
minnesotanlp/aar-linear-hard-sample_111
minnesotanlp/aar-linear-medium-sample_183
minnesotanlp/aar-linear-extreme-sample_011
minnesotanlp/aar-dag-extreme-sample_247
minnesotanlp/aar-dag-medium-sample_180
minnesotanlp/aar-linear-medium-sample_020
minnesotanlp/aar-dag-hard-sample_056
minnesotanlp/aar-dag-extreme-sample_081
minnesotanlp/aar-linear-easy-sample_165
minnesotanlp/aar-linear-easy-sample_033
minnesotanlp/aar-linear-hard-sample_002
minnesotanlp/aar-dag-extreme-sample_215
minnesotanlp/aar-linear-extreme-sample_133
minnesotanlp/aar-dag-easy-sample_170
minnesotanlp/aar-dag-hard-sample_222
minnesotanlp/aar-linear-extreme-sample_032
minnesotanlp/aar-linear-extreme-sample_071
minnesotanlp/aar-dag-medium-sample_082
minnesotanlp/aar-dag-extreme-sample_012
minnesotanlp/aar-linear-medium-sample_190
minnesotanlp/aar-linear-hard-sample_048
minnesotanlp/aar-dag-medium-sample_072
minnesotanlp/aar-linear-easy-sample_011
minnesotanlp/aar-dag-easy-sample_209
minnesotanlp/aar-linear-easy-sample_136
minnesotanlp/aar-dag-hard-sample_021
minnesotanlp/aar-linear-hard-sample_033
minnesotanlp/aar-linear-easy-sample_140
minnesotanlp/aar-dag-easy-sample_214
minnesotanlp/aar-linear-easy-sample_203
minnesotanlp/aar-linear-hard-sample_030
minnesotanlp/aar-dag-extreme-sample_216
minnesotanlp/aar-linear-extreme-sample_041
minnesotanlp/aar-dag-hard-sample_183

Displaying 100 of 1,400 tasks