Loading dataset details…
harbor run -d sierra-research/tau3-benchharbor run -d sierra-research/tau3-benchtau3-bench is a simulation framework for evaluating customer service agents across multiple domains. It includes 375 tasks spanning four domains: airline, retail, telecom, and banking knowledge.
harbor run -d sierra-research/tau3-benchtau3-bench is a simulation framework for evaluating customer service agents across multiple domains. It includes 375 tasks spanning four domains: airline, retail, telecom, and banking knowledge.
harbor run -d sierra-research/tau3-bench@misc{barres2025tau2,
title={tau^2-Bench: Evaluating Conversational Agents in a Dual-Control Environment},
author={Victor Barres and Honghua Dong and Soham Ray and Xujie Si and Karthik Narasimhan},
year={2025},
eprint={2506.07982},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2506.07982}
}
@misc{yao2024tau,
title={tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains},
author={Shunyu Yao and Noah Shinn and Pedram Razavi and Karthik Narasimhan},
year={2024},
eprint={2406.12045},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2406.12045}
}
@article{shi2026tau,
title={tau-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge},
author={Shi, Quan and Zytek, Alexandra and Razavi, Pedram and Narasimhan, Karthik and Barres, Victor},
journal={arXiv preprint arXiv:2603.04370},
year={2026}
}
This adapter is developed and maintained by Ruofan Lu from the Harbor team.
Issues and Contributions:
API inference compute for running parity tests is generously supported by 2077AI (https://www.2077ai.com/).
@misc{barres2025tau2,
title={tau^2-Bench: Evaluating Conversational Agents in a Dual-Control Environment},
author={Victor Barres and Honghua Dong and Soham Ray and Xujie Si and Karthik Narasimhan},
year={2025},
eprint={2506.07982},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2506.07982}
}
@misc{yao2024tau,
title={tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains},
author={Shunyu Yao and Noah Shinn and Pedram Razavi and Karthik Narasimhan},
year={2024},
eprint={2406.12045},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2406.12045}
}
@article{shi2026tau,
title={tau-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge},
author={Shi, Quan and Zytek, Alexandra and Razavi, Pedram and Narasimhan, Karthik and Barres, Victor},
journal={arXiv preprint arXiv:2603.04370},
year={2026}
}
This adapter is developed and maintained by Ruofan Lu from the Harbor team.
Issues and Contributions:
API inference compute for running parity tests is generously supported by 2077AI (https://www.2077ai.com/).