BenchCAD (with Python tool)
Progress Over Time
Interactive timeline showing model performance evolution on BenchCAD (with Python tool)
BenchCAD (with Python tool) Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | GPT-5.6 SolNew OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 2 | OpenAI | — | 1.1M | $2.50 / $15.00 | ||
| 3 | GPT-5.6 LunaNew OpenAI | — | 1.1M | $1.00 / $6.00 |
What is BenchCAD (with Python tool)?
BenchCAD variant evaluated with access to a Python tool for programmatic CAD reasoning.
BenchCAD (with Python tool) is a multimodal benchmark evaluating models on multimodal, reasoning, code, and vision tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.8.
Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for code and best AI for vision leaderboards.
Current leaders
GPT-5.6 Sol from OpenAI currently leads the BenchCAD (with Python tool) leaderboard with a score of 0.834 across 3 evaluated AI models.
FAQ
Common questions about the BenchCAD (with Python tool) benchmark and leaderboard.