Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-dag-easy-sample_229
minnesotanlp/aar-linear-extreme-sample_101
minnesotanlp/aar-dag-medium-sample_031
minnesotanlp/aar-linear-hard-sample_091
minnesotanlp/aar-linear-extreme-sample_135
minnesotanlp/aar-dag-extreme-sample_218
minnesotanlp/aar-dag-easy-sample_180
minnesotanlp/aar-linear-easy-sample_209
minnesotanlp/aar-linear-hard-sample_226
minnesotanlp/aar-dag-medium-sample_228
minnesotanlp/aar-linear-medium-sample_106
minnesotanlp/aar-dag-medium-sample_119
minnesotanlp/aar-dag-extreme-sample_005
minnesotanlp/aar-linear-medium-sample_132
minnesotanlp/aar-dag-hard-sample_039
minnesotanlp/aar-linear-medium-sample_198
minnesotanlp/aar-linear-extreme-sample_075
minnesotanlp/aar-linear-hard-sample_143
minnesotanlp/aar-dag-easy-sample_143
minnesotanlp/aar-linear-extreme-sample_205
minnesotanlp/aar-dag-medium-sample_013
minnesotanlp/aar-dag-extreme-sample_205
minnesotanlp/aar-linear-medium-sample_138
minnesotanlp/aar-dag-extreme-sample_211
minnesotanlp/aar-dag-hard-sample_150
minnesotanlp/aar-linear-medium-sample_188
minnesotanlp/aar-dag-easy-sample_222
minnesotanlp/aar-dag-medium-sample_209
minnesotanlp/aar-linear-medium-sample_201
minnesotanlp/aar-linear-extreme-sample_040
minnesotanlp/aar-dag-extreme-sample_102
minnesotanlp/aar-linear-medium-sample_140
minnesotanlp/aar-dag-medium-sample_205
minnesotanlp/aar-dag-extreme-sample_177
minnesotanlp/aar-linear-extreme-sample_069
minnesotanlp/aar-dag-easy-sample_194
minnesotanlp/aar-dag-medium-sample_206
minnesotanlp/aar-dag-easy-sample_052
minnesotanlp/aar-linear-easy-sample_054
minnesotanlp/aar-linear-easy-sample_218
minnesotanlp/aar-linear-medium-sample_189
minnesotanlp/aar-linear-extreme-sample_146
minnesotanlp/aar-linear-extreme-sample_132
minnesotanlp/aar-linear-medium-sample_058
minnesotanlp/aar-linear-hard-sample_054
minnesotanlp/aar-dag-extreme-sample_026
minnesotanlp/aar-linear-medium-sample_049
minnesotanlp/aar-linear-medium-sample_113
minnesotanlp/aar-dag-extreme-sample_167
minnesotanlp/aar-dag-extreme-sample_135
minnesotanlp/aar-linear-easy-sample_142
minnesotanlp/aar-linear-medium-sample_051
minnesotanlp/aar-dag-hard-sample_186
minnesotanlp/aar-dag-hard-sample_100
minnesotanlp/aar-linear-medium-sample_171
minnesotanlp/aar-dag-medium-sample_061
minnesotanlp/aar-dag-extreme-sample_078
minnesotanlp/aar-linear-extreme-sample_043
minnesotanlp/aar-linear-easy-sample_064
minnesotanlp/aar-dag-medium-sample_157
minnesotanlp/aar-dag-extreme-sample_213
minnesotanlp/aar-linear-hard-sample_115
minnesotanlp/aar-linear-extreme-sample_100
minnesotanlp/aar-dag-medium-sample_140
minnesotanlp/aar-linear-medium-sample_149
minnesotanlp/aar-dag-medium-sample_000
minnesotanlp/aar-linear-hard-sample_000
minnesotanlp/aar-linear-extreme-sample_042
minnesotanlp/aar-linear-easy-sample_146
minnesotanlp/aar-linear-hard-sample_225
minnesotanlp/aar-dag-easy-sample_003
minnesotanlp/aar-dag-medium-sample_077
minnesotanlp/aar-dag-easy-sample_173
minnesotanlp/aar-dag-extreme-sample_101
minnesotanlp/aar-linear-hard-sample_233
minnesotanlp/aar-dag-hard-sample_118
minnesotanlp/aar-dag-hard-sample_041
minnesotanlp/aar-linear-easy-sample_001
minnesotanlp/aar-dag-easy-sample_099
minnesotanlp/aar-dag-extreme-sample_118
minnesotanlp/aar-dag-easy-sample_097
minnesotanlp/aar-dag-medium-sample_092
minnesotanlp/aar-linear-extreme-sample_212
minnesotanlp/aar-linear-medium-sample_031
minnesotanlp/aar-linear-medium-sample_047
minnesotanlp/aar-linear-hard-sample_107
minnesotanlp/aar-linear-hard-sample_214
minnesotanlp/aar-dag-medium-sample_188
minnesotanlp/aar-linear-hard-sample_083
minnesotanlp/aar-linear-extreme-sample_167
minnesotanlp/aar-dag-easy-sample_225
minnesotanlp/aar-linear-extreme-sample_058
minnesotanlp/aar-dag-hard-sample_213
minnesotanlp/aar-linear-extreme-sample_064
minnesotanlp/aar-dag-extreme-sample_022
minnesotanlp/aar-dag-medium-sample_156
minnesotanlp/aar-linear-easy-sample_211
minnesotanlp/aar-linear-medium-sample_022
minnesotanlp/aar-linear-hard-sample_015
minnesotanlp/aar-dag-hard-sample_238

Displaying 100 of 1,400 tasks