The AI arena is free today

Open Superagent

AndroidWorld

Progress Over Time

Interactive timeline showing model performance evolution on AndroidWorld

State-of-the-art frontier
Open
Proprietary

AndroidWorld Leaderboard

6 models
ContextCostLicense
1
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
2.4T1.0M$1.65 / $4.95
2
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
125B
3
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
28B
4
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
5
Zhipu AI
Zhipu AI
6
Alibaba Cloud / Qwen Team
Alibaba Cloud / Qwen Team
28B262K$0.60 / $3.60
Notice missing or incorrect data?
About this benchmark

What is AndroidWorld?

AndroidWorld evaluates an agent's ability to operate in real Android GUI environments, completing multi-step tasks by perceiving screen content and executing touch/type actions.

AndroidWorld is a multimodal benchmark evaluating models on agents and vision tasks. LLM Stats tracks 6 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.

Compare leaders on the best AI for agents and best AI for vision leaderboards.

Current leaders

Qwen3.8 Max from Alibaba Cloud / Qwen Team currently leads the AndroidWorld leaderboard with a score of 0.853 across 6 evaluated AI models.

1Qwen3.8 MaxAlibaba Cloud / Qwen Team85.3%
2Qwen3.8-Flash-NextAlibaba Cloud / Qwen Team84.5%
3Qwen3.8-27BAlibaba Cloud / Qwen Team81.9%

FAQ

Common questions about the AndroidWorld benchmark and leaderboard.

What is the AndroidWorld benchmark?

AndroidWorld evaluates an agent's ability to operate in real Android GUI environments, completing multi-step tasks by perceiving screen content and executing touch/type actions.

What is the AndroidWorld leaderboard?

The AndroidWorld leaderboard ranks 6 AI models based on their performance on this benchmark. Currently, Qwen3.8 Max by Alibaba Cloud / Qwen Team leads with a score of 0.853. The average score across all models is 0.798.

What is the highest AndroidWorld score?

The highest AndroidWorld score is 0.853, achieved by Qwen3.8 Max from Alibaba Cloud / Qwen Team.

How many models are evaluated on AndroidWorld?

6 models have been evaluated on the AndroidWorld benchmark, with 0 verified results and 6 self-reported results.

What categories does AndroidWorld cover?

AndroidWorld is categorized under agents and vision. The benchmark evaluates multimodal models.

What is the best open-source model on AndroidWorld?

Qwen3.8 Max by Alibaba Cloud / Qwen Team is the top-ranked open-source model on AndroidWorld, with a score of 0.853 (rank #1).

Which model offers the best value on AndroidWorld?

Among models scoring within 10% of the leader, Qwen3.8 Max from Alibaba Cloud / Qwen Team is the cheapest, at $1.65 per million input tokens with a score of 0.853.

How recent are the AndroidWorld leaderboard results?

The AndroidWorld leaderboard was last updated in August 2026 and currently includes 6 evaluated models.