ZEROBench
Progress Over Time
Interactive timeline showing model performance evolution on ZEROBench
ZEROBench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | Moonshot AI | 2.8T | 1.0M | $3.00 / $15.00 | ||
| 2 | DeepSeek | — | 1.0M | $0.22 / $0.66 | ||
| 3 | Meta | — | — | — | ||
| 4 | ByteDance | — | — | — | ||
| 5 | ByteDance | — | — | — | ||
| 5 | Moonshot AI | 1.0T | — | — | ||
| 7 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.30 / $2.40 | ||
| 8 | Alibaba Cloud / Qwen Team | 122B | — | — | ||
| 9 | Alibaba Cloud / Qwen Team | 35B | — | — | ||
| 10 | Alibaba Cloud / Qwen Team | 236B | — | — |
Sub-benchmarks
What is ZEROBench?
ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.
ZEROBench is a image benchmark evaluating models on multimodal, reasoning, and vision tasks. LLM Stats tracks 10 models on this benchmark, scored on a 0–100 scale. The current average is 0.2, with the leader at 0.4.
Compare leaders on the best AI for multimodal, best AI for reasoning and best AI for vision leaderboards.
Current leaders
Kimi K3 from Moonshot AI currently leads the ZEROBench leaderboard with a score of 0.410 across 10 evaluated AI models.
FAQ
Common questions about the ZEROBench benchmark and leaderboard.