PaperBench
Progress Over Time
Interactive timeline showing model performance evolution on PaperBench
PaperBench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Alibaba Cloud / Qwen Team | 2.4T | 1.0M | $1.65 / $4.95 | ||
| 2 |  Moonshot AI | 1.0T | — | — | ||
| 3 |  MiniMax | 428B | 1.0M | $0.30 / $1.20 |
What is PaperBench?
PaperBench is a benchmark for evaluating AI agents on their ability to replicate research papers. It tests models on complex, multi-step workflows involving code implementation, experimentation, and reproducing scientific results from academic publications.
PaperBench is a text benchmark evaluating models on reasoning, agents, and code tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.7, with the leader at 0.9.
Compare leaders on the best AI for reasoning, best AI for agents and best AI for code leaderboards.
Current leaders
Qwen3.8 Max from Alibaba Cloud / Qwen Team currently leads the PaperBench leaderboard with a score of 0.930 across 3 evaluated AI models.
FAQ
Common questions about the PaperBench benchmark and leaderboard.