Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-medium-sample_074
minnesotanlp/aar-dag-medium-sample_015
minnesotanlp/aar-dag-medium-sample_055
minnesotanlp/aar-linear-extreme-sample_005
minnesotanlp/aar-linear-extreme-sample_184
minnesotanlp/aar-dag-hard-sample_119
minnesotanlp/aar-dag-extreme-sample_227
minnesotanlp/aar-dag-medium-sample_151
minnesotanlp/aar-linear-easy-sample_049
minnesotanlp/aar-dag-medium-sample_198
minnesotanlp/aar-dag-medium-sample_086
minnesotanlp/aar-linear-hard-sample_060
minnesotanlp/aar-dag-medium-sample_174
minnesotanlp/aar-linear-hard-sample_168
minnesotanlp/aar-linear-medium-sample_053
minnesotanlp/aar-dag-medium-sample_004
minnesotanlp/aar-linear-medium-sample_009
minnesotanlp/aar-dag-medium-sample_099
minnesotanlp/aar-dag-extreme-sample_187
minnesotanlp/aar-dag-extreme-sample_182
minnesotanlp/aar-linear-extreme-sample_225
minnesotanlp/aar-dag-hard-sample_133
minnesotanlp/aar-linear-extreme-sample_244
minnesotanlp/aar-dag-medium-sample_186
minnesotanlp/aar-linear-easy-sample_002
minnesotanlp/aar-dag-easy-sample_197
minnesotanlp/aar-dag-medium-sample_014
minnesotanlp/aar-linear-medium-sample_040
minnesotanlp/aar-linear-medium-sample_054
minnesotanlp/aar-dag-extreme-sample_010
minnesotanlp/aar-linear-medium-sample_100
minnesotanlp/aar-linear-extreme-sample_028
minnesotanlp/aar-linear-easy-sample_167
minnesotanlp/aar-dag-medium-sample_007
minnesotanlp/aar-linear-easy-sample_091
minnesotanlp/aar-linear-hard-sample_031
minnesotanlp/aar-dag-extreme-sample_246
minnesotanlp/aar-dag-easy-sample_139
minnesotanlp/aar-linear-extreme-sample_010
minnesotanlp/aar-linear-extreme-sample_220
minnesotanlp/aar-linear-medium-sample_130
minnesotanlp/aar-dag-hard-sample_151
minnesotanlp/aar-linear-medium-sample_008
minnesotanlp/aar-dag-easy-sample_175
minnesotanlp/aar-dag-hard-sample_085
minnesotanlp/aar-linear-hard-sample_232
minnesotanlp/aar-dag-extreme-sample_056
minnesotanlp/aar-dag-hard-sample_200
minnesotanlp/aar-linear-easy-sample_145
minnesotanlp/aar-linear-hard-sample_122
minnesotanlp/aar-linear-medium-sample_099
minnesotanlp/aar-linear-easy-sample_147
minnesotanlp/aar-linear-hard-sample_009
minnesotanlp/aar-linear-hard-sample_228
minnesotanlp/aar-linear-hard-sample_050
minnesotanlp/aar-dag-medium-sample_168
minnesotanlp/aar-dag-extreme-sample_063
minnesotanlp/aar-dag-extreme-sample_228
minnesotanlp/aar-linear-easy-sample_158
minnesotanlp/aar-linear-medium-sample_034
minnesotanlp/aar-dag-medium-sample_183
minnesotanlp/aar-linear-extreme-sample_059
minnesotanlp/aar-linear-medium-sample_095
minnesotanlp/aar-dag-extreme-sample_193
minnesotanlp/aar-dag-extreme-sample_086
minnesotanlp/aar-linear-medium-sample_055
minnesotanlp/aar-linear-hard-sample_220
minnesotanlp/aar-linear-medium-sample_097
minnesotanlp/aar-linear-medium-sample_007
minnesotanlp/aar-linear-hard-sample_016
minnesotanlp/aar-linear-medium-sample_087
minnesotanlp/aar-linear-extreme-sample_097
minnesotanlp/aar-linear-medium-sample_044
minnesotanlp/aar-linear-easy-sample_192
minnesotanlp/aar-linear-extreme-sample_031
minnesotanlp/aar-linear-medium-sample_125
minnesotanlp/aar-dag-extreme-sample_170
minnesotanlp/aar-linear-extreme-sample_073
minnesotanlp/aar-dag-medium-sample_113
minnesotanlp/aar-linear-medium-sample_206
minnesotanlp/aar-linear-extreme-sample_200
minnesotanlp/aar-dag-easy-sample_154
minnesotanlp/aar-linear-hard-sample_133
minnesotanlp/aar-linear-easy-sample_212
minnesotanlp/aar-dag-hard-sample_107
minnesotanlp/aar-dag-medium-sample_191
minnesotanlp/aar-linear-extreme-sample_141
minnesotanlp/aar-dag-easy-sample_157
minnesotanlp/aar-linear-medium-sample_166
minnesotanlp/aar-linear-hard-sample_001
minnesotanlp/aar-linear-medium-sample_222
minnesotanlp/aar-linear-easy-sample_107
minnesotanlp/aar-linear-easy-sample_114
minnesotanlp/aar-linear-medium-sample_043
minnesotanlp/aar-dag-medium-sample_159
minnesotanlp/aar-linear-hard-sample_171
minnesotanlp/aar-dag-extreme-sample_108
minnesotanlp/aar-linear-extreme-sample_165
minnesotanlp/aar-dag-hard-sample_204
minnesotanlp/aar-linear-easy-sample_051

Displaying 100 of 1,400 tasks