Project AURIONAI Use-Cases Research & Innovation

tau2-bench

Second version of tau-bench; rows mix domains and pass^k settings

agents and tool usecrowded
5scores
5models
1independent
0maintainer-run
4vendor-reported

Definition

Version
not in the notes
Category
agents and tool use
Maintainer
Sierra
Status
crowded
Home page
https://www.benchlm.ai/benchmarks/tau2-bench

Sources

  1. τ²-bench results Leaderboard & Scores , October 2026 benchlm.ai https://www.benchlm.ai/benchmarks/tau2-bench

Scores

5 of 5 scores shown tau2-bench-scores.csv
ModelScoreWho ran itSettingView or populationDateSource
Z.ai (Zhipu)GLM-5.299.1 %independentArtificial Analysis telecom runrank 1, BenchLM aggregator, top score10 Oct 2026benchlm.ai
SK TelecomA.X K298 %vendor-reportedThinking mode; TelecomA.X K2 model cardJul 2026huggingface.co
Arcee AITrinity-Large-Thinking94.7 %vendor-reportedTelecom domainTrinity-Large-Thinking model card1 Apr 2026huggingface.co
Motif TechnologiesMotif-394.7 %vendor-reportedtemperature 1.0, top-p 0.95, max sequence 262,144; TelecomMotif-3 model cardAug 2026huggingface.co
MeituanLongCat-Flash (LongCat-Flash-Chat)73.68 %vendor-reportedTelecom, avg@4LongCat-Flash-Chat model cardSep 2025huggingface.co
Where this comes from
Scores from different settings, harnesses or dates are not directly comparable; the row says which. Sorted by score, highest first, as a reading aid, not a ranking.

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "tau2-Bench", https://aurion.semai.id/benchmarks/tau2-bench/, records of October 2026.