GDPval-MM
Progress Over Time
Interactive timeline showing model performance evolution on GDPval-MM
GDPval-MM Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 2 | OpenAI | — | — | — | ||
| 3 | MiniMax | 230B | 1.0M | $0.30 / $1.20 |
What is GDPval-MM?
GDPval-MM is the multimodal variant of the GDPval benchmark, evaluating AI model performance on real-world economically valuable tasks that require processing and generating multimodal content including documents, slides, diagrams, spreadsheets, images, and other professional deliverables across diverse industries.
GDPval-MM is a multimodal benchmark evaluating models on multimodal, reasoning, finance, and general tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.8.
Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for finance and best AI for general leaderboards.
Current leaders
GPT-5.5 from OpenAI currently leads the GDPval-MM leaderboard with a score of 0.849 across 3 evaluated AI models.
Source paper
- Title
- GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks
- Authors
- Tejal Patwardhan, Rachel Dias, Elizabeth Proehl, Grace Kim, and 15 others
- Published
- arXiv
- 2510.04374
Abstract
We introduce GDPval, a benchmark evaluating AI model capabilities on real-world economically valuable tasks. GDPval covers the majority of U.S. Bureau of Labor Statistics Work Activities for 44 occupations across the top 9 sectors contributing to U.S. GDP (Gross Domestic Product). Tasks are constructed from the representative work of industry professionals with an average of 14 years of experience. We find that frontier model performance on GDPval is improving roughly linearly over time, and that the current best frontier models are approaching industry experts in deliverable quality. We analyze the potential for frontier models, when paired with human oversight, to perform GDPval tasks cheaper and faster than unaided experts. We also demonstrate that increased reasoning effort, increased task context, and increased scaffolding improves model performance on GDPval. Finally, we open-source a gold subset of 220 tasks and provide a public automated grading service at evals.openai.com to facilitate future research in understanding real-world model capabilities.
FAQ
Common questions about the GDPval-MM benchmark and leaderboard.