SimpleVQA
Progress Over Time
Interactive timeline showing model performance evolution on SimpleVQA
State-of-the-art frontier
Open
Proprietary
SimpleVQA Leaderboard
17 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  ByteDance | — | 256K | $0.25 / $2.00 | ||
| 2 |  Alibaba Cloud / Qwen Team | — | — | — | ||
| 3 |  Zhipu AI | — | — | — | ||
| 4 | ByteDance | — | — | — | ||
| 5 |  Meta | 816B | 1.0M | $1.25 / $4.25 | ||
| 6 | Meta | — | — | — | ||
| 7 |  Moonshot AI | 1.0T | — | — | ||
| 8 | ByteDance | — | — | — | ||
| 9 | ByteDance | — | 256K | $0.10 / $0.40 | ||
| 10 | Alibaba Cloud / Qwen Team | — | 1.0M | $0.50 / $3.00 | ||
| 11 | Alibaba Cloud / Qwen Team | 122B | 262K | $0.29 / $2.40 | ||
| 12 | Alibaba Cloud / Qwen Team | 236B | — | — | ||
| 13 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.10 / $0.95 | ||
| 14 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.14 / $1.00 | ||
| 15 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.32 / $3.20 | ||
| 16 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.26 / $2.60 | ||
| 17 |  Liquid AI | 3B | — | — |
Notice missing or incorrect data?
What is SimpleVQA?
SimpleVQA is a visual question answering benchmark focused on simple queries.
SimpleVQA is a multimodal benchmark evaluating models on image to text, multimodal, general, and vision tasks. LLM Stats tracks 17 models on this benchmark, scored on a 0–100 scale. The current average is 4.5, with the leader at 65.4.
Compare leaders on the best AI for image to text, best AI for multimodal, best AI for general and best AI for vision leaderboards.
Current leaders
Seed 1.8 from ByteDance currently leads the SimpleVQA leaderboard with a score of 65.400 across 17 evaluated AI models.
FAQ
Common questions about the SimpleVQA benchmark and leaderboard.