minnesotanlp/aar
The Amazing Agent Race (AAR): 1400 multi-step scavenger-hunt puzzles for evaluating LLM agents on tool use, web navigation, and arithmetic reasoning. Includes linear (800) and DAG (600) variants across 4 difficulty levels.
harbor run -d minnesotanlp/aar| Task |
|---|
minnesotanlp/aar-linear-extreme-sample_116 |
minnesotanlp/aar-linear-easy-sample_085 |
minnesotanlp/aar-linear-medium-sample_112 |
minnesotanlp/aar-linear-easy-sample_095 |
minnesotanlp/aar-dag-hard-sample_011 |
minnesotanlp/aar-dag-extreme-sample_132 |
minnesotanlp/aar-linear-medium-sample_114 |
minnesotanlp/aar-linear-extreme-sample_026 |
minnesotanlp/aar-linear-hard-sample_149 |
minnesotanlp/aar-linear-medium-sample_098 |
minnesotanlp/aar-linear-hard-sample_164 |
minnesotanlp/aar-linear-medium-sample_111 |
minnesotanlp/aar-dag-extreme-sample_040 |
minnesotanlp/aar-linear-medium-sample_086 |
minnesotanlp/aar-linear-medium-sample_048 |
minnesotanlp/aar-linear-hard-sample_218 |
minnesotanlp/aar-linear-hard-sample_027 |
minnesotanlp/aar-dag-extreme-sample_186 |
minnesotanlp/aar-linear-easy-sample_132 |
minnesotanlp/aar-dag-extreme-sample_055 |
minnesotanlp/aar-linear-medium-sample_027 |
minnesotanlp/aar-linear-extreme-sample_227 |
minnesotanlp/aar-dag-easy-sample_219 |
minnesotanlp/aar-linear-easy-sample_016 |
minnesotanlp/aar-dag-hard-sample_161 |
minnesotanlp/aar-dag-hard-sample_167 |
minnesotanlp/aar-linear-medium-sample_139 |
minnesotanlp/aar-linear-hard-sample_166 |
minnesotanlp/aar-dag-medium-sample_222 |
minnesotanlp/aar-dag-hard-sample_152 |
minnesotanlp/aar-linear-easy-sample_157 |
minnesotanlp/aar-dag-medium-sample_212 |
minnesotanlp/aar-linear-easy-sample_138 |
minnesotanlp/aar-dag-extreme-sample_131 |
minnesotanlp/aar-linear-easy-sample_101 |
minnesotanlp/aar-linear-hard-sample_105 |
minnesotanlp/aar-linear-medium-sample_104 |
minnesotanlp/aar-dag-medium-sample_098 |
minnesotanlp/aar-linear-easy-sample_072 |
minnesotanlp/aar-linear-extreme-sample_070 |
minnesotanlp/aar-linear-extreme-sample_183 |
minnesotanlp/aar-linear-easy-sample_100 |
minnesotanlp/aar-linear-medium-sample_124 |
minnesotanlp/aar-dag-medium-sample_193 |
minnesotanlp/aar-linear-hard-sample_010 |
minnesotanlp/aar-linear-hard-sample_154 |
minnesotanlp/aar-linear-medium-sample_176 |
minnesotanlp/aar-linear-easy-sample_201 |
minnesotanlp/aar-dag-extreme-sample_180 |
minnesotanlp/aar-linear-easy-sample_152 |
minnesotanlp/aar-linear-hard-sample_212 |
minnesotanlp/aar-dag-extreme-sample_225 |
minnesotanlp/aar-linear-medium-sample_174 |
minnesotanlp/aar-linear-easy-sample_127 |
minnesotanlp/aar-linear-medium-sample_117 |
minnesotanlp/aar-linear-medium-sample_101 |
minnesotanlp/aar-linear-easy-sample_089 |
minnesotanlp/aar-dag-extreme-sample_014 |
minnesotanlp/aar-linear-easy-sample_172 |
minnesotanlp/aar-linear-easy-sample_080 |
minnesotanlp/aar-dag-easy-sample_053 |
minnesotanlp/aar-dag-medium-sample_229 |
minnesotanlp/aar-dag-easy-sample_147 |
minnesotanlp/aar-dag-hard-sample_130 |
minnesotanlp/aar-linear-hard-sample_235 |
minnesotanlp/aar-linear-easy-sample_040 |
minnesotanlp/aar-linear-medium-sample_046 |
minnesotanlp/aar-dag-easy-sample_224 |
minnesotanlp/aar-linear-extreme-sample_147 |
minnesotanlp/aar-dag-easy-sample_191 |
minnesotanlp/aar-linear-extreme-sample_105 |
minnesotanlp/aar-dag-medium-sample_096 |
minnesotanlp/aar-linear-medium-sample_045 |
minnesotanlp/aar-dag-extreme-sample_062 |
minnesotanlp/aar-dag-extreme-sample_238 |
minnesotanlp/aar-dag-easy-sample_211 |
minnesotanlp/aar-linear-hard-sample_170 |
minnesotanlp/aar-linear-extreme-sample_029 |
minnesotanlp/aar-dag-extreme-sample_057 |
minnesotanlp/aar-linear-extreme-sample_096 |
minnesotanlp/aar-linear-hard-sample_197 |
minnesotanlp/aar-linear-easy-sample_013 |
minnesotanlp/aar-dag-easy-sample_059 |
minnesotanlp/aar-dag-hard-sample_205 |
minnesotanlp/aar-linear-easy-sample_134 |
minnesotanlp/aar-linear-easy-sample_186 |
minnesotanlp/aar-linear-easy-sample_153 |
minnesotanlp/aar-dag-extreme-sample_085 |
minnesotanlp/aar-dag-extreme-sample_083 |
minnesotanlp/aar-linear-extreme-sample_198 |
minnesotanlp/aar-dag-hard-sample_114 |
minnesotanlp/aar-linear-extreme-sample_051 |
minnesotanlp/aar-dag-easy-sample_195 |
minnesotanlp/aar-linear-hard-sample_139 |
minnesotanlp/aar-linear-easy-sample_022 |
minnesotanlp/aar-dag-medium-sample_035 |
minnesotanlp/aar-linear-easy-sample_125 |
minnesotanlp/aar-dag-extreme-sample_203 |
minnesotanlp/aar-dag-medium-sample_029 |
minnesotanlp/aar-linear-medium-sample_091 |
Displaying 100 of 1,400 tasks