Harbor Hub

minnesotanlp/aar

The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.

Published 4/5/2026 by

New Job
harbor run -d minnesotanlp/aar
Task
minnesotanlp/aar-linear-easy-sample_010
minnesotanlp/aar-linear-hard-sample_006
minnesotanlp/aar-linear-extreme-sample_019
minnesotanlp/aar-dag-hard-sample_090
minnesotanlp/aar-dag-extreme-sample_169
minnesotanlp/aar-dag-hard-sample_159
minnesotanlp/aar-dag-medium-sample_109
minnesotanlp/aar-linear-extreme-sample_063
minnesotanlp/aar-dag-extreme-sample_222
minnesotanlp/aar-dag-easy-sample_186
minnesotanlp/aar-dag-hard-sample_097
minnesotanlp/aar-dag-medium-sample_149
minnesotanlp/aar-linear-extreme-sample_210
minnesotanlp/aar-dag-hard-sample_094
minnesotanlp/aar-linear-hard-sample_098
minnesotanlp/aar-dag-extreme-sample_219
minnesotanlp/aar-linear-hard-sample_126
minnesotanlp/aar-linear-easy-sample_198
minnesotanlp/aar-dag-extreme-sample_221
minnesotanlp/aar-linear-medium-sample_016
minnesotanlp/aar-dag-extreme-sample_041
minnesotanlp/aar-dag-extreme-sample_224
minnesotanlp/aar-linear-extreme-sample_189
minnesotanlp/aar-dag-hard-sample_162
minnesotanlp/aar-dag-hard-sample_236
minnesotanlp/aar-dag-hard-sample_042
minnesotanlp/aar-dag-medium-sample_152
minnesotanlp/aar-linear-medium-sample_072
minnesotanlp/aar-linear-easy-sample_150
minnesotanlp/aar-dag-hard-sample_002
minnesotanlp/aar-linear-easy-sample_057
minnesotanlp/aar-linear-hard-sample_224
minnesotanlp/aar-dag-medium-sample_170
minnesotanlp/aar-linear-hard-sample_137
minnesotanlp/aar-dag-hard-sample_228
minnesotanlp/aar-linear-easy-sample_018
minnesotanlp/aar-linear-easy-sample_062
minnesotanlp/aar-dag-hard-sample_043
minnesotanlp/aar-linear-extreme-sample_030
minnesotanlp/aar-linear-easy-sample_060
minnesotanlp/aar-dag-medium-sample_071
minnesotanlp/aar-dag-hard-sample_154
minnesotanlp/aar-linear-extreme-sample_119
minnesotanlp/aar-linear-hard-sample_029
minnesotanlp/aar-dag-medium-sample_040
minnesotanlp/aar-dag-hard-sample_113
minnesotanlp/aar-dag-extreme-sample_093
minnesotanlp/aar-dag-extreme-sample_053
minnesotanlp/aar-linear-hard-sample_163
minnesotanlp/aar-dag-hard-sample_001
minnesotanlp/aar-linear-medium-sample_056
minnesotanlp/aar-linear-extreme-sample_081
minnesotanlp/aar-linear-medium-sample_212
minnesotanlp/aar-dag-extreme-sample_077
minnesotanlp/aar-dag-extreme-sample_019
minnesotanlp/aar-linear-hard-sample_093
minnesotanlp/aar-dag-easy-sample_114
minnesotanlp/aar-linear-medium-sample_035
minnesotanlp/aar-dag-hard-sample_051
minnesotanlp/aar-dag-medium-sample_080
minnesotanlp/aar-dag-easy-sample_196
minnesotanlp/aar-linear-medium-sample_066
minnesotanlp/aar-linear-medium-sample_090
minnesotanlp/aar-linear-hard-sample_156
minnesotanlp/aar-linear-easy-sample_037
minnesotanlp/aar-dag-hard-sample_227
minnesotanlp/aar-linear-hard-sample_222
minnesotanlp/aar-dag-extreme-sample_223
minnesotanlp/aar-linear-medium-sample_068
minnesotanlp/aar-dag-medium-sample_033
minnesotanlp/aar-linear-medium-sample_164
minnesotanlp/aar-dag-extreme-sample_217
minnesotanlp/aar-linear-extreme-sample_169
minnesotanlp/aar-linear-medium-sample_067
minnesotanlp/aar-linear-hard-sample_059
minnesotanlp/aar-dag-easy-sample_200
minnesotanlp/aar-dag-hard-sample_207
minnesotanlp/aar-linear-medium-sample_151
minnesotanlp/aar-linear-easy-sample_187
minnesotanlp/aar-dag-medium-sample_225
minnesotanlp/aar-dag-extreme-sample_165
minnesotanlp/aar-linear-extreme-sample_035
minnesotanlp/aar-linear-extreme-sample_158
minnesotanlp/aar-dag-easy-sample_089
minnesotanlp/aar-linear-medium-sample_221
minnesotanlp/aar-linear-easy-sample_144
minnesotanlp/aar-linear-hard-sample_198
minnesotanlp/aar-dag-hard-sample_044
minnesotanlp/aar-dag-hard-sample_006
minnesotanlp/aar-dag-extreme-sample_100
minnesotanlp/aar-linear-extreme-sample_107
minnesotanlp/aar-linear-medium-sample_122
minnesotanlp/aar-dag-hard-sample_144
minnesotanlp/aar-linear-easy-sample_129
minnesotanlp/aar-dag-hard-sample_000
minnesotanlp/aar-dag-easy-sample_227
minnesotanlp/aar-dag-hard-sample_081
minnesotanlp/aar-linear-hard-sample_193
minnesotanlp/aar-linear-easy-sample_103
minnesotanlp/aar-dag-extreme-sample_185

Displaying 100 of 1,400 tasks