The AI arena is free today

Open Superagent

TIR-Bench

Progress Over Time

Interactive timeline showing model performance evolution on TIR-Bench

State-of-the-art frontier
Open
Proprietary

TIR-Bench Leaderboard

4 models
ContextCostLicense
1
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
1.0M$0.50 / $3.00
2
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
27B262K$0.30 / $2.40
3
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
35B
4
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
122B
Notice missing or incorrect data?
About this benchmark

What is TIR-Bench?

A tool-calling and multimodal interaction benchmark for testing visual instruction following and execution reliability.

TIR-Bench is a multimodal benchmark evaluating models on multimodal, reasoning, agents, and tool calling tasks. LLM Stats tracks 4 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.6.

Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for agents and best AI for tool calling leaderboards.

Current leaders

Qwen3.6 Plus from Alibaba Cloud / Qwen Team currently leads the TIR-Bench leaderboard with a score of 0.616 across 4 evaluated AI models.

1Qwen3.6 PlusAlibaba Cloud / Qwen Team61.6%
2Qwen3.5-27BAlibaba Cloud / Qwen Team59.8%
3Qwen3.5-35B-A3BAlibaba Cloud / Qwen Team55.5%

FAQ

Common questions about the TIR-Bench benchmark and leaderboard.

What is the TIR-Bench benchmark?

A tool-calling and multimodal interaction benchmark for testing visual instruction following and execution reliability.

What is the TIR-Bench leaderboard?

The TIR-Bench leaderboard ranks 4 AI models based on their performance on this benchmark. Currently, Qwen3.6 Plus by Alibaba Cloud / Qwen Team leads with a score of 0.616. The average score across all models is 0.575.

What is the highest TIR-Bench score?

The highest TIR-Bench score is 0.616, achieved by Qwen3.6 Plus from Alibaba Cloud / Qwen Team.

How many models are evaluated on TIR-Bench?

4 models have been evaluated on the TIR-Bench benchmark, with 0 verified results and 4 self-reported results.

What categories does TIR-Bench cover?

TIR-Bench is categorized under multimodal, reasoning, agents, and tool calling. The benchmark evaluates multimodal models.

What is the best open-source model on TIR-Bench?

Qwen3.5-27B by Alibaba Cloud / Qwen Team is the top-ranked open-source model on TIR-Bench, with a score of 0.598 (rank #2).

Which model offers the best value on TIR-Bench?

Among models scoring within 10% of the leader, Qwen3.5-27B from Alibaba Cloud / Qwen Team is the cheapest, at $0.30 per million input tokens with a score of 0.598.

How recent are the TIR-Bench leaderboard results?

The TIR-Bench leaderboard was last updated in August 2026 and currently includes 4 evaluated models.
TIR-Bench Leaderboard