Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-dag-extreme-sample_110
minnesotanlp/aar-dag-hard-sample_202
minnesotanlp/aar-linear-easy-sample_215
minnesotanlp/aar-dag-easy-sample_093
minnesotanlp/aar-linear-extreme-sample_215
minnesotanlp/aar-linear-easy-sample_204
minnesotanlp/aar-dag-hard-sample_007
minnesotanlp/aar-linear-hard-sample_026
minnesotanlp/aar-dag-medium-sample_030
minnesotanlp/aar-dag-medium-sample_200
minnesotanlp/aar-linear-medium-sample_147
minnesotanlp/aar-linear-hard-sample_117
minnesotanlp/aar-linear-hard-sample_049
minnesotanlp/aar-dag-extreme-sample_144
minnesotanlp/aar-dag-hard-sample_102
minnesotanlp/aar-linear-easy-sample_003
minnesotanlp/aar-dag-hard-sample_040
minnesotanlp/aar-linear-hard-sample_066
minnesotanlp/aar-linear-hard-sample_185
minnesotanlp/aar-dag-hard-sample_201
minnesotanlp/aar-linear-hard-sample_087
minnesotanlp/aar-linear-extreme-sample_123
minnesotanlp/aar-linear-medium-sample_168
minnesotanlp/aar-linear-hard-sample_186
minnesotanlp/aar-dag-easy-sample_019
minnesotanlp/aar-dag-hard-sample_168
minnesotanlp/aar-linear-hard-sample_081
minnesotanlp/aar-linear-hard-sample_075
minnesotanlp/aar-dag-extreme-sample_114
minnesotanlp/aar-dag-extreme-sample_174
minnesotanlp/aar-linear-medium-sample_167
minnesotanlp/aar-linear-easy-sample_120
minnesotanlp/aar-linear-easy-sample_067
minnesotanlp/aar-dag-hard-sample_074
minnesotanlp/aar-dag-hard-sample_174
minnesotanlp/aar-linear-extreme-sample_150
minnesotanlp/aar-dag-medium-sample_074
minnesotanlp/aar-linear-hard-sample_144
minnesotanlp/aar-dag-hard-sample_034
minnesotanlp/aar-linear-hard-sample_160
minnesotanlp/aar-dag-extreme-sample_200
minnesotanlp/aar-linear-extreme-sample_125
minnesotanlp/aar-linear-extreme-sample_018
minnesotanlp/aar-dag-medium-sample_024
minnesotanlp/aar-dag-extreme-sample_028
minnesotanlp/aar-dag-hard-sample_166
minnesotanlp/aar-linear-extreme-sample_180
minnesotanlp/aar-dag-hard-sample_061
minnesotanlp/aar-linear-medium-sample_023
minnesotanlp/aar-linear-easy-sample_059
minnesotanlp/aar-dag-extreme-sample_152
minnesotanlp/aar-dag-medium-sample_178
minnesotanlp/aar-linear-hard-sample_025
minnesotanlp/aar-dag-easy-sample_018
minnesotanlp/aar-linear-hard-sample_230
minnesotanlp/aar-dag-medium-sample_227
minnesotanlp/aar-linear-medium-sample_182
minnesotanlp/aar-dag-hard-sample_209
minnesotanlp/aar-dag-extreme-sample_067
minnesotanlp/aar-dag-hard-sample_232
minnesotanlp/aar-linear-medium-sample_029
minnesotanlp/aar-dag-easy-sample_144
minnesotanlp/aar-dag-extreme-sample_088
minnesotanlp/aar-linear-easy-sample_115
minnesotanlp/aar-linear-medium-sample_177
minnesotanlp/aar-dag-extreme-sample_226
minnesotanlp/aar-linear-easy-sample_088
minnesotanlp/aar-linear-extreme-sample_009
minnesotanlp/aar-dag-extreme-sample_190
minnesotanlp/aar-linear-medium-sample_070
minnesotanlp/aar-dag-hard-sample_013
minnesotanlp/aar-linear-hard-sample_056
minnesotanlp/aar-linear-medium-sample_014
minnesotanlp/aar-linear-medium-sample_021
minnesotanlp/aar-dag-medium-sample_078
minnesotanlp/aar-linear-medium-sample_119
minnesotanlp/aar-linear-extreme-sample_037
minnesotanlp/aar-linear-extreme-sample_219
minnesotanlp/aar-dag-easy-sample_230
minnesotanlp/aar-linear-easy-sample_168
minnesotanlp/aar-linear-easy-sample_043
minnesotanlp/aar-dag-extreme-sample_230
minnesotanlp/aar-dag-medium-sample_053
minnesotanlp/aar-linear-extreme-sample_004
minnesotanlp/aar-linear-easy-sample_124
minnesotanlp/aar-dag-hard-sample_237
minnesotanlp/aar-linear-easy-sample_104
minnesotanlp/aar-linear-medium-sample_204
minnesotanlp/aar-linear-easy-sample_008
minnesotanlp/aar-linear-extreme-sample_159
minnesotanlp/aar-dag-extreme-sample_125
minnesotanlp/aar-dag-extreme-sample_103
minnesotanlp/aar-linear-easy-sample_200
minnesotanlp/aar-linear-easy-sample_202
minnesotanlp/aar-dag-medium-sample_116
minnesotanlp/aar-linear-easy-sample_036
minnesotanlp/aar-dag-medium-sample_132
minnesotanlp/aar-linear-medium-sample_052
minnesotanlp/aar-linear-easy-sample_175
minnesotanlp/aar-linear-easy-sample_024

Displaying 100 of 1,400 tasks