IMO-AnswerBench
Progress Over Time
Interactive timeline showing model performance evolution on IMO-AnswerBench
IMO-AnswerBench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | 550B | 262K | $0.50 / $2.20 | |||
| 2 | Zhipu AI | 753B | 1.0M | $0.75 / $2.40 | ||
| 3 | Tencent | 295B | 262K | $0.14 / $0.58 | ||
| 3 | Alibaba Cloud / Qwen Team | — | 1.0M | $1.25 / $3.75 | ||
| 5 | DeepSeek | 1.6T | 1.0M | $1.30 / $2.60 | ||
| 6 | DeepSeek | 284B | 1.0M | $0.09 / $0.18 | ||
| 7 | Moonshot AI | 1.0T | 262K | $0.75 / $3.50 | ||
| 7 | Alibaba Cloud / Qwen Team | — | — | — | ||
| 9 | StepFun | 196B | 66K | $0.10 / $0.40 | ||
| 10 | DeepSeek | 284B | 1.0M | $0.09 / $0.18 | ||
| 11 | Alibaba Cloud / Qwen Team | 1.0T | 256K | $1.20 / $6.00 | ||
| 12 | Alibaba Cloud / Qwen Team | — | 1.0M | $0.50 / $3.00 | ||
| 12 | Zhipu AI | 754B | 203K | $1.05 / $3.50 | ||
| 14 | InclusionAI | 124B | 131K | $0.06 / $0.18 | ||
| 15 | Zhipu AI | 358B | 203K | $0.40 / $1.75 | ||
| 16 | Moonshot AI | 1.0T | — | — | ||
| 17 | Alibaba Cloud / Qwen Team | 397B | 262K | $0.45 / $3.00 | ||
| 18 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.32 / $3.20 | ||
| 19 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.10 / $0.95 | ||
| 20 | Meituan | 560B | — | — | ||
| 20 | Moonshot AI | 1.0T | — | — | ||
| 22 | DeepSeek | 685B | 164K | $0.26 / $0.38 |
What is IMO-AnswerBench?
IMO-AnswerBench is a benchmark for evaluating mathematical reasoning capabilities on International Mathematical Olympiad (IMO) problems, focusing on answer generation and verification.
IMO-AnswerBench is a text benchmark evaluating models on math and reasoning tasks. LLM Stats tracks 22 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.
Compare leaders on the best AI for math and best AI for reasoning leaderboards.
Current leaders
Nemotron 3 Ultra (550B A55B) from NVIDIA currently leads the IMO-AnswerBench leaderboard with a score of 0.923 across 22 evaluated AI models.
FAQ
Common questions about the IMO-AnswerBench benchmark and leaderboard.