TroubleshootingBench
Progress Over Time
Interactive timeline showing model performance evolution on TroubleshootingBench
TroubleshootingBench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | OpenAI | — | — | $5.00 / $25.00 |
What is TroubleshootingBench?
TroubleshootingBench is an OpenAI internal short-answer benchmark built from expert-written wet-lab procedures and realistic execution errors to test tacit biological troubleshooting knowledge.
TroubleshootingBench is a text benchmark evaluating models on reasoning, safety, science, and healthcare tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.5.
Compare leaders on the best AI for reasoning, best AI for safety, best AI for science and best AI for healthcare leaderboards.
Current leaders
GPT-Rosalind from OpenAI currently leads the TroubleshootingBench leaderboard with a score of 0.533 across 1 evaluated AI models.
FAQ
Common questions about the TroubleshootingBench benchmark and leaderboard.