The AI arena is free today

Open Superagent

Virology Capabilities Test

Paper

Progress Over Time

Interactive timeline showing model performance evolution on Virology Capabilities Test

State-of-the-art frontier
Open
Proprietary

Virology Capabilities Test Leaderboard

2 models
ContextCostLicense
1—500K$2.00 / $6.00
2———
Notice missing or incorrect data?
About this benchmark

What is Virology Capabilities Test?

Virology Capabilities Test (VCT) is an expert-level multiple-choice benchmark measuring the capability to troubleshoot complex virology laboratory protocols. It evaluates dual-use biological knowledge relevant to bioweapons development.

Virology Capabilities Test is a text benchmark evaluating models on safety and healthcare tasks. LLM Stats tracks 2 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.6.

Compare leaders on the best AI for safety and best AI for healthcare leaderboards.

Current leaders

Grok 4.7 from xAI currently leads the Virology Capabilities Test leaderboard with a score of 0.630 across 2 evaluated AI models.

1Grok 4.7xAI63.0%

Source paper

Title
Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark
Authors
Jasper Götting, Pedro Medeiros, Jon G Sanders, Nathaniel Li, and 5 others
Published
Abstract

We present the Virology Capabilities Test (VCT), a large language model (LLM) benchmark that measures the capability to troubleshoot complex virology laboratory protocols. Constructed from the inputs of dozens of PhD-level expert virologists, VCT consists of $322$ multimodal questions covering fundamental, tacit, and visual knowledge that is essential for practical work in virology laboratories. VCT is difficult: expert virologists with access to the internet score an average of $22.1\%$ on questions specifically in their sub-areas of expertise. However, the most performant LLM, OpenAI's o3, reaches $43.8\%$ accuracy, outperforming $94\%$ of expert virologists even within their sub-areas of specialization. The ability to provide expert-level virology troubleshooting is inherently dual-use: it is useful for beneficial research, but it can also be misused. Therefore, the fact that publicly available models outperform virologists on VCT raises pressing governance considerations. We propose that the capability of LLMs to provide expert-level troubleshooting of dual-use virology work should be integrated into existing frameworks for handling dual-use technologies in the life sciences.

FAQ

Common questions about the Virology Capabilities Test benchmark and leaderboard.

What is the Virology Capabilities Test benchmark?

Virology Capabilities Test (VCT) is an expert-level multiple-choice benchmark measuring the capability to troubleshoot complex virology laboratory protocols. It evaluates dual-use biological knowledge relevant to bioweapons development.

What is the Virology Capabilities Test leaderboard?

The Virology Capabilities Test leaderboard ranks 2 AI models based on their performance on this benchmark. Currently, Grok 4.7 by xAI leads with a score of 0.630. The average score across all models is 0.620.

What is the highest Virology Capabilities Test score?

The highest Virology Capabilities Test score is 0.630, achieved by Grok 4.7 from xAI.

How many models are evaluated on Virology Capabilities Test?

2 models have been evaluated on the Virology Capabilities Test benchmark, with 0 verified results and 2 self-reported results.

Where can I find the Virology Capabilities Test paper?

The Virology Capabilities Test paper is available at https://arxiv.org/abs/2504.16137. The paper details the methodology, dataset construction, and evaluation criteria.

What categories does Virology Capabilities Test cover?

Virology Capabilities Test is categorized under safety and healthcare. The benchmark evaluates text models.

Which model offers the best value on Virology Capabilities Test?

Among models scoring within 10% of the leader, Grok 4.7 from xAI is the cheapest, at $2.00 per million input tokens with a score of 0.630.

How recent are the Virology Capabilities Test leaderboard results?

The Virology Capabilities Test leaderboard was last updated in November 2026 and currently includes 2 evaluated models.