BenchCAD (with Python tool)

Progress Over Time

Interactive timeline showing model performance evolution on BenchCAD (with Python tool)

State-of-the-art frontier
Open
Proprietary

BenchCAD (with Python tool) Leaderboard

3 models
ContextCostLicense
1
OpenAI
OpenAI
1.1M$5.00 / $30.00
2
OpenAI
OpenAI
1.1M$2.50 / $15.00
3
OpenAI
OpenAI
1.1M$1.00 / $6.00
Notice missing or incorrect data?
About this benchmark

What is BenchCAD (with Python tool)?

BenchCAD variant evaluated with access to a Python tool for programmatic CAD reasoning.

BenchCAD (with Python tool) is a multimodal benchmark evaluating models on multimodal, reasoning, code, and vision tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.8.

Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for code and best AI for vision leaderboards.

Current leaders

GPT-5.6 Sol from OpenAI currently leads the BenchCAD (with Python tool) leaderboard with a score of 0.834 across 3 evaluated AI models.

1GPT-5.6 SolOpenAI83.4%
2GPT-5.6 TerraOpenAI78.2%
3GPT-5.6 LunaOpenAI73.9%

FAQ

Common questions about the BenchCAD (with Python tool) benchmark and leaderboard.

What is the BenchCAD (with Python tool) benchmark?

BenchCAD variant evaluated with access to a Python tool for programmatic CAD reasoning.

What is the BenchCAD (with Python tool) leaderboard?

The BenchCAD (with Python tool) leaderboard ranks 3 AI models based on their performance on this benchmark. Currently, GPT-5.6 Sol by OpenAI leads with a score of 0.834. The average score across all models is 0.785.

What is the highest BenchCAD (with Python tool) score?

The highest BenchCAD (with Python tool) score is 0.834, achieved by GPT-5.6 Sol from OpenAI.

How many models are evaluated on BenchCAD (with Python tool)?

3 models have been evaluated on the BenchCAD (with Python tool) benchmark, with 0 verified results and 3 self-reported results.

What categories does BenchCAD (with Python tool) cover?

BenchCAD (with Python tool) is categorized under multimodal, reasoning, code, and vision. The benchmark evaluates multimodal models.

What's the difference between BenchCAD (with Python tool) and BenchCAD?

BenchCAD (with Python tool) is a variant of BenchCAD. See the BenchCAD leaderboard for the broader benchmark and per-model comparison.

Which model offers the best value on BenchCAD (with Python tool)?

Among models scoring within 10% of the leader, GPT-5.6 Terra from OpenAI is the cheapest, at $2.50 per million input tokens with a score of 0.782.

How recent are the BenchCAD (with Python tool) leaderboard results?

The BenchCAD (with Python tool) leaderboard was last updated in July 2026 and currently includes 3 evaluated models.