sierra-research/tau3-bench

Citation

@misc{barres2025tau2,
  title={tau^2-Bench: Evaluating Conversational Agents in a Dual-Control Environment},
  author={Victor Barres and Honghua Dong and Soham Ray and Xujie Si and Karthik Narasimhan},
  year={2025},
  eprint={2506.07982},
  archivePrefix={arXiv},
  primaryClass={cs.AI},
  url={https://arxiv.org/abs/2506.07982}
}

@misc{yao2024tau,
  title={tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains},
  author={Shunyu Yao and Noah Shinn and Pedram Razavi and Karthik Narasimhan},
  year={2024},
  eprint={2406.12045},
  archivePrefix={arXiv},
  primaryClass={cs.AI},
  url={https://arxiv.org/abs/2406.12045}
}

@article{shi2026tau,
  title={tau-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge},
  author={Shi, Quan and Zytek, Alexandra and Razavi, Pedram and Narasimhan, Karthik and Barres, Victor},
  journal={arXiv preprint arXiv:2603.04370},
  year={2026}
}

Authors & Contributions

This adapter is developed and maintained by Ruofan Lu from the Harbor team.

Issues and Contributions:

• Submit issues and pull requests to the main Harbor repository.
• Follow the repository coding style and adapter conventions.

Acknowledgement

API inference compute for running parity tests is generously supported by 2077AI (https://www.2077ai.com/).