Agents' Last Exam
Progress Over Time
Interactive timeline showing model performance evolution on Agents' Last Exam
Agents' Last Exam Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  OpenAI | — | 1.1M | $10.00 / $50.00 | ||
| 2 | GPT-6 SolNew OpenAI | — | 1.1M | $2.00 / $10.00 | ||
| 3 | OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 4 |  Alibaba Cloud / Qwen Team | 2.4T | 1.0M | $1.65 / $4.95 | ||
| 5 | Alibaba Cloud / Qwen Team | 125B | — | — | ||
| 5 | Alibaba Cloud / Qwen Team | 125B | 1.0M | $0.15 / $0.47 | ||
| 7 | GPT-6 LunaNew OpenAI | — | 1.1M | $0.10 / $0.50 | ||
| 8 | OpenAI | — | 1.1M | $2.00 / $12.00 | ||
| 9 | OpenAI | — | 1.1M | $0.20 / $1.20 | ||
| 10 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.40 / $3.00 | ||
| 11 |  ByteDance | — | — | — | ||
| 12 |  DeepSeek | 763B | 1.0M | $0.22 / $0.66 | ||
| 13 |  Xiaomi | 1.0T | 1.0M | $0.43 / $0.87 | ||
| 14 |  Zhipu AI | 753B | 1.0M | $1.20 / $4.00 | ||
| 15 | Xiaomi | 309B | 1.0M | $0.14 / $0.28 | ||
| 16 | DeepSeek | — | 1.0M | $0.44 / $1.32 | ||
| 17 |  Google | — | 1.0M | $0.75 / $3.75 | ||
| 17 | Zhipu AI | 320B | 1.0M | $0.15 / $0.50 | ||
| 19 | DeepSeek | 1.6T | 1.0M | $1.30 / $2.60 | ||
| 20 | DeepSeek | 304B | 1.0M | $0.06 / $0.18 | ||
| 21 |  Tencent | 770B | — | — |
What is Agents' Last Exam?
Agents' Last Exam is a challenging benchmark for AI agents on hard, long-horizon tasks that test sustained reasoning, planning, and tool use, reported with and without tool access.
Agents' Last Exam is a text benchmark evaluating models on reasoning, agents, and tool calling tasks. LLM Stats tracks 21 models on this benchmark, scored on a 0–1 scale. The current average is 0.4, with the leader at 0.6.
Compare leaders on the best AI for reasoning, best AI for agents and best AI for tool calling leaderboards.
Current leaders
GPT-6 Astra from OpenAI currently leads the Agents' Last Exam leaderboard with a score of 0.593 across 21 evaluated AI models.
FAQ
Common questions about the Agents' Last Exam benchmark and leaderboard.