tau-bench
Tool-using agent talks to a simulated user in airline, retail and telecom domains
agents and tool usecrowded
Definition
- Version
- not in the notes
- Category
- agents and tool use
- Maintainer
- Sierra
- Status
- crowded
- Home page
- https://arxiv.org/abs/2406.12045
Sources
- $τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains arxiv.org https://arxiv.org/abs/2406.12045
Scores
| Model | Score | Who ran it | Setting | View or population | Date | Source |
|---|---|---|---|---|---|---|
 Claude 3.5 Sonnet (Oct '24) | 69.2 % | vendor-reported | retail domain | – | 22 Oct 2024 | anthropic.com |
| Claude 3.5 Sonnet (Oct '24) | 46 % | vendor-reported | airline domain | – | 22 Oct 2024 | anthropic.com |
Where this comes from
Scores from different settings, harnesses or dates are not directly comparable; the row says which. Sorted by score, highest first, as a reading aid, not a ranking.
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Tau-Bench", https://aurion.semai.id/benchmarks/tau-bench/, records of October 2026.