RealWorldQA
Progress Over Time
Interactive timeline showing model performance evolution on RealWorldQA
RealWorldQA Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Alibaba Cloud / Qwen Team | 125B | — | — | ||
| 1 | Alibaba Cloud / Qwen Team | 125B | 1.0M | $0.15 / $0.47 | ||
| 3 | Alibaba Cloud / Qwen Team | 2.4T | 1.0M | $1.65 / $4.95 | ||
| 4 | Alibaba Cloud / Qwen Team | — | — | — | ||
| 5 |  ByteDance | — | — | — | ||
| 6 | ByteDance | — | — | — | ||
| 7 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.40 / $3.00 | ||
| 8 | Alibaba Cloud / Qwen Team | — | 1.0M | $0.50 / $3.00 | ||
| 9 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.10 / $0.95 | ||
| 10 | Alibaba Cloud / Qwen Team | 122B | 262K | $0.29 / $2.40 | ||
| 11 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.32 / $3.20 | ||
| 11 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.14 / $1.00 | ||
| 13 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.26 / $2.60 | ||
| 14 | ByteDance | — | 256K | $0.10 / $0.40 | ||
| 15 | Alibaba Cloud / Qwen Team | 236B | — | — | ||
| 16 | Alibaba Cloud / Qwen Team | 236B | 262K | $0.20 / $0.88 | ||
| 17 | Alibaba Cloud / Qwen Team | 33B | — | — | ||
| 18 | Alibaba Cloud / Qwen Team | 33B | — | — | ||
| 19 | Alibaba Cloud / Qwen Team | 73B | — | — | ||
| 20 | Alibaba Cloud / Qwen Team | 31B | — | — | ||
| 21 | Alibaba Cloud / Qwen Team | 31B | 262K | $0.15 / $0.60 | ||
| 22 | Alibaba Cloud / Qwen Team | 9B | — | — | ||
| 23 | Alibaba Cloud / Qwen Team | 4B | — | — | ||
| 24 |  Liquid AI | 3B | — | — | ||
| 25 | Alibaba Cloud / Qwen Team | 9B | — | — | ||
| 26 | Alibaba Cloud / Qwen Team | 4B | — | — | ||
| 27 | Alibaba Cloud / Qwen Team | 7B | — | — | ||
| 28 |  xAI | — | — | — | ||
| 29 |  DeepSeek | 27B | — | — | ||
| 30 | DeepSeek | 16B | — | — | ||
| 31 | DeepSeek | 3B | — | — | ||
| 32 | 2B | — | — |
What is RealWorldQA?
RealWorldQA is a benchmark designed to evaluate basic real-world spatial understanding capabilities of multimodal models. The initial release consists of over 700 anonymized images taken from vehicles and other real-world scenarios, each accompanied by a question and easily verifiable answer. Released by xAI as part of their Grok-1.5 Vision preview to test models' ability to understand natural scenes and spatial relationships in everyday visual contexts.
RealWorldQA is a multimodal benchmark evaluating models on spatial reasoning and vision tasks. LLM Stats tracks 32 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.
Compare leaders on the best AI for spatial reasoning and best AI for vision leaderboards.
Current leaders
Qwen3.8-Flash-Next from Alibaba Cloud / Qwen Team currently leads the RealWorldQA leaderboard with a score of 0.885 across 32 evaluated AI models.
FAQ
Common questions about the RealWorldQA benchmark and leaderboard.