DeepSWE 1.1
Progress Over Time
Interactive timeline showing model performance evolution on DeepSWE 1.1
State-of-the-art frontier
Open
Proprietary
DeepSWE 1.1 Leaderboard
2 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Meta | — | — | — | ||
| 2 |  xAI | — | 500K | $2.00 / $6.00 |
Notice missing or incorrect data?
What is DeepSWE 1.1?
DeepSWE 1.1 evaluates software engineering agents using the mini-swe-agent harness.
DeepSWE 1.1 is a text benchmark evaluating models on agents and code tasks. LLM Stats tracks 2 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.5.
Compare leaders on the best AI for agents and best AI for code leaderboards.
Current leaders
Muse Spark 1.1 from Meta currently leads the DeepSWE 1.1 leaderboard with a score of 0.533 across 2 evaluated AI models.
FAQ
Common questions about the DeepSWE 1.1 benchmark and leaderboard.