CyberGym
Progress Over Time
Interactive timeline showing model performance evolution on CyberGym
CyberGym Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Xiaomi | 309B | 1.0M | $0.14 / $0.28 | ||
| 2 | Xiaomi | 1.0T | 1.0M | $0.43 / $0.87 | ||
| 3 |  DeepSeek | 763B | 1.0M | $0.22 / $0.66 | ||
| 4 |  Google | — | — | — | ||
| 5 |  Zhipu AI | 753B | 1.0M | $1.20 / $4.00 | ||
| 6 | DeepSeek | 1.6T | 1.0M | $1.30 / $2.60 | ||
| 7 | Google | — | — | — | ||
| 8 |  Anthropic | — | — | — | ||
| 9 |  MiniMax | — | 1.0M | $0.15 / $0.60 | ||
| 10 |  Mistral AI | 1.1T | 1.0M | $0.68 / $2.09 | ||
| 11 |  OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 12 |  xAI | — | 500K | $2.00 / $6.00 | ||
| 13 | Anthropic | — | 1.0M | $5.00 / $25.00 | ||
| 14 |  Tencent | 770B | — | — | ||
| 15 | DeepSeek | 304B | 1.0M | $0.06 / $0.18 | ||
| 16 | Anthropic | — | 1.0M | $5.00 / $25.00 | ||
| 17 | Anthropic | — | 1.0M | $5.00 / $25.00 | ||
| 18 |  ByteDance | — | — | — | ||
| 19 | Zhipu AI | 754B | 203K | $1.05 / $3.50 | ||
| 20 | ByteDance | — | — | — | ||
| 21 |  Moonshot AI | 1.0T | — | — |
What is CyberGym?
CyberGym is a benchmark for evaluating AI agents on cybersecurity tasks, testing their ability to identify vulnerabilities, perform security analysis, and complete security-related challenges in a controlled environment.
CyberGym is a text benchmark evaluating models on safety, agents, and code tasks. LLM Stats tracks 21 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 1.0.
Compare leaders on the best AI for safety, best AI for agents and best AI for code leaderboards.
Current leaders
MiMo-V2.6-Flash from Xiaomi currently leads the CyberGym leaderboard with a score of 0.951 across 21 evaluated AI models.
FAQ
Common questions about the CyberGym benchmark and leaderboard.