AGIEval
Progress Over Time
Interactive timeline showing model performance evolution on AGIEval
AGIEval Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Mistral AI | 24B | — | — | ||
| 2 | Mistral AI | 14B | — | — | ||
| 3 | Mistral AI | 8B | — | — | ||
| 4 |  Nous Research | 70B | — | — | ||
| 5 |  Google | 27B | — | — | ||
| 6 | Google | 9B | — | — | ||
| 7 | Mistral AI | 3B | — | — | ||
| 8 | 8B | — | — | |||
| 9 | Mistral AI | 8B | — | — | ||
| 10 |  Baidu | 21B | — | — |
What is AGIEval?
A human-centric benchmark for evaluating foundation models on standardized exams including college entrance exams (Gaokao, SAT), law school admission tests (LSAT), math competitions, lawyer qualification tests, and civil service exams. Contains 20 tasks (18 multiple-choice, 2 cloze) designed to assess understanding, knowledge, reasoning, and calculation abilities in real-world academic and professional contexts.
AGIEval is a text benchmark evaluating models on legal, math, reasoning, and general tasks. LLM Stats tracks 10 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.7.
Compare leaders on the best AI for legal, best AI for math, best AI for reasoning and best AI for general leaderboards.
Current leaders
Mistral Small 3 24B Base from Mistral AI currently leads the AGIEval leaderboard with a score of 0.658 across 10 evaluated AI models.
FAQ
Common questions about the AGIEval benchmark and leaderboard.