Capture-the-Flag Challenges (Internal)
Progress Over Time
Interactive timeline showing model performance evolution on Capture-the-Flag Challenges (Internal)
Capture-the-Flag Challenges (Internal) Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  GPT-5.6 SolNew OpenAI | — | 1.1M | $5.00 / $30.00 | ||
| 2 | OpenAI | — | 1.1M | $2.50 / $15.00 | ||
| 3 | GPT-5.6 LunaNew OpenAI | — | 1.1M | $1.00 / $6.00 |
What is Capture-the-Flag Challenges (Internal)?
Capture-the-Flag Challenges is OpenAI's internal expansion of competitive, professional-level cybersecurity capture-the-flag tasks used to evaluate vulnerability identification and exploitation capability under the Preparedness Framework.
Capture-the-Flag Challenges (Internal) is a text benchmark evaluating models on safety, agents, and code tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.9, with the leader at 1.0.
Compare leaders on the best AI for safety, best AI for agents and best AI for code leaderboards.
Current leaders
GPT-5.6 Sol from OpenAI currently leads the Capture-the-Flag Challenges (Internal) leaderboard with a score of 0.967 across 3 evaluated AI models.
FAQ
Common questions about the Capture-the-Flag Challenges (Internal) benchmark and leaderboard.