TIR-Bench
Progress Over Time
Interactive timeline showing model performance evolution on TIR-Bench
TIR-Bench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | Alibaba Cloud / Qwen Team | — | 1.0M | $0.50 / $3.00 | ||
| 2 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.30 / $2.40 | ||
| 3 | Alibaba Cloud / Qwen Team | 35B | — | — | ||
| 4 | Alibaba Cloud / Qwen Team | 122B | — | — |
What is TIR-Bench?
A tool-calling and multimodal interaction benchmark for testing visual instruction following and execution reliability.
TIR-Bench is a multimodal benchmark evaluating models on multimodal, reasoning, agents, and tool calling tasks. LLM Stats tracks 4 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.6.
Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for agents and best AI for tool calling leaderboards.
Current leaders
Qwen3.6 Plus from Alibaba Cloud / Qwen Team currently leads the TIR-Bench leaderboard with a score of 0.616 across 4 evaluated AI models.
FAQ
Common questions about the TIR-Bench benchmark and leaderboard.