ZEROBench
Progress Over Time
Interactive timeline showing model performance evolution on ZEROBench
State-of-the-art frontier
Open
Proprietary
ZEROBench Leaderboard
15 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  ByteDance | — | 256K | $0.25 / $2.00 | ||
| 2 |  DeepSeek | 763B | 1.0M | $0.30 / $1.20 | ||
| 3 |  Meta | 816B | 1.0M | $1.25 / $4.25 | ||
| 4 | DeepSeek | 763B | 1.0M | $0.22 / $0.66 | ||
| 5 |  Moonshot AI | 2.8T | 1.0M | $2.85 / $14.25 | ||
| 6 | DeepSeek | — | 1.0M | $0.44 / $1.32 | ||
| 7 | Meta | — | — | — | ||
| 8 | ByteDance | — | — | — | ||
| 9 | ByteDance | — | — | — | ||
| 9 | Moonshot AI | 1.0T | — | — | ||
| 11 |  Alibaba Cloud / Qwen Team | 27B | 262K | $0.26 / $2.60 | ||
| 12 | Alibaba Cloud / Qwen Team | 122B | 262K | $0.29 / $2.40 | ||
| 13 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.14 / $1.00 | ||
| 14 | ByteDance | — | 256K | $0.10 / $0.40 | ||
| 15 | Alibaba Cloud / Qwen Team | 236B | — | — |
Notice missing or incorrect data?
Sub-benchmarks
What is ZEROBench?
ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.
ZEROBench is a image benchmark evaluating models on multimodal, reasoning, and vision tasks. LLM Stats tracks 15 models on this benchmark, scored on a 0–100 scale. The current average is 1.0, with the leader at 11.0.
Compare leaders on the best AI for multimodal, best AI for reasoning and best AI for vision leaderboards.
Current leaders
Seed 1.8 from ByteDance currently leads the ZEROBench leaderboard with a score of 11.000 across 15 evaluated AI models.
FAQ
Common questions about the ZEROBench benchmark and leaderboard.