PinchBench
Progress Over Time
Interactive timeline showing model performance evolution on PinchBench
State-of-the-art frontier
Open
Proprietary
PinchBench Leaderboard
6 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | 550B | — | — | |||
| 2 | 30B | 262K | $0.05 / $0.20 | |||
| 3 |  Xiaomi | — | — | — | ||
| 4 | Xiaomi | 1.0T | — | — | ||
| 5 |  Zhipu AI | — | — | — | ||
| 6 |  Liquid AI | 3B | — | — |
Notice missing or incorrect data?
What is PinchBench?
PinchBench evaluates coding agents on real-world agentic coding tasks, measuring both best-case and average performance across complex software engineering scenarios.
PinchBench is a text benchmark evaluating models on agents and code tasks. LLM Stats tracks 6 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.
Compare leaders on the best AI for agents and best AI for code leaderboards.
Current leaders
Nemotron 3 Ultra (550B A55B) from NVIDIA currently leads the PinchBench leaderboard with a score of 0.900 across 6 evaluated AI models.
FAQ
Common questions about the PinchBench benchmark and leaderboard.