Agents' Last Exam
Progress Over Time
Interactive timeline showing model performance evolution on Agents' Last Exam
Agents' Last Exam Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | OpenAI | — | 1.1M | $1.00 / $5.00 | ||
| 2 | OpenAI | — | 1.1M | $10.00 / $50.00 | ||
| 3 | OpenAI | — | 1.1M | $2.00 / $10.00 | ||
| 4 | OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 5 | Alibaba Cloud / Qwen Team | 2.4T | 1.0M | $1.65 / $4.95 | ||
| 6 | Alibaba Cloud / Qwen Team | 125B | 1.0M | $0.15 / $0.47 | ||
| 6 | Alibaba Cloud / Qwen Team | 125B | — | — | ||
| 8 | OpenAI | — | 1.1M | $0.10 / $0.50 | ||
| 9 | OpenAI | — | 1.1M | $2.00 / $12.00 | ||
| 10 | OpenAI | — | 1.1M | $0.20 / $1.20 | ||
| 11 | Moonshot AI | 2.8T | 1.0M | $2.00 / $10.00 | ||
| 12 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.40 / $3.00 | ||
| 13 | ByteDance | — | — | — | ||
| 14 | Google | — | 1.0M | $2.00 / $10.00 | ||
| 15 | DeepSeek | 763B | 1.0M | $0.30 / $1.20 | ||
| 16 | DeepSeek | 763B | 1.0M | $0.22 / $0.66 | ||
| 17 | Xiaomi | 1.0T | 1.0M | $0.43 / $0.87 | ||
| 18 | MiniMax | — | 1.0M | $0.15 / $0.60 | ||
| 19 | Zhipu AI | 753B | 1.0M | $1.20 / $4.00 | ||
| 20 | Xiaomi | 309B | 1.0M | $0.14 / $0.28 | ||
| 21 | DeepSeek | — | 1.0M | $0.44 / $1.32 | ||
| 22 | Google | — | 1.0M | $0.75 / $3.75 | ||
| 22 | Zhipu AI | 320B | 1.0M | $0.15 / $0.50 | ||
| 24 | DeepSeek | 1.6T | 1.0M | $1.30 / $2.60 | ||
| 25 | DeepSeek | 304B | 1.0M | $0.06 / $0.18 | ||
| 26 | Tencent | 770B | — | — |
What is Agents' Last Exam?
Agents' Last Exam is a challenging benchmark for AI agents on hard, long-horizon tasks that test sustained reasoning, planning, and tool use, reported with and without tool access.
Agents' Last Exam is a text benchmark evaluating models on reasoning, agents, and tool calling tasks. LLM Stats tracks 26 models on this benchmark, scored on a 0–1 scale. The current average is 0.4, with the leader at 0.6.
Compare leaders on the best AI for reasoning, best AI for agents and best AI for tool calling leaderboards.
Current leaders
GPT-6.1 Terra from OpenAI currently leads the Agents' Last Exam leaderboard with a score of 0.600 across 26 evaluated AI models.
FAQ
Common questions about the Agents' Last Exam benchmark and leaderboard.