DeepSWE 1.0
Progress Over Time
Interactive timeline showing model performance evolution on DeepSWE 1.0
State-of-the-art frontier
Open
Proprietary
DeepSWE 1.0 Leaderboard
1 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Grok 4.5New xAI | — | 500K | $2.00 / $6.00 |
Notice missing or incorrect data?
What is DeepSWE 1.0?
DeepSWE 1.0 pass@1 benchmark as reported by Artificial Analysis using provider-specific harness runs.
DeepSWE 1.0 is a text benchmark evaluating models on agents and code tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.6.
Compare leaders on the best AI for agents and best AI for code leaderboards.
Current leaders
Grok 4.5 from xAI currently leads the DeepSWE 1.0 leaderboard with a score of 0.620 across 1 evaluated AI models.
FAQ
Common questions about the DeepSWE 1.0 benchmark and leaderboard.