DSBench-Hard
Progress Over Time
Interactive timeline showing model performance evolution on DSBench-Hard
State-of-the-art frontier
Open
Proprietary
DSBench-Hard Leaderboard
3 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | DeepSeek | 1.6T | 1.0M | $0.43 / $0.87 | ||
| 2 | DeepSeek | — | 1.0M | $0.22 / $0.66 | ||
| 3 | DeepSeek | 304B | 1.0M | $0.09 / $0.18 |
Notice missing or incorrect data?
What is DSBench-Hard?
DSBench-Hard is DeepSeek's internal test set of difficult coding-agent problems.
DSBench-Hard is a text benchmark evaluating models on agents and code tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.7.
Compare leaders on the best AI for agents and best AI for code leaderboards.
Current leaders
DeepSeek-V4-Pro-0813 from DeepSeek currently leads the DSBench-Hard leaderboard with a score of 0.672 across 3 evaluated AI models.
FAQ
Common questions about the DSBench-Hard benchmark and leaderboard.