VideoHolmes
Progress Over Time
Interactive timeline showing model performance evolution on VideoHolmes
State-of-the-art frontier
Open
Proprietary
VideoHolmes Leaderboard
3 models
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  ByteDance | — | — | — | ||
| 2 | ByteDance | — | — | — | ||
| 3 |  Xiaomi | 311B | 1.0M | $0.17 / $0.34 |
Notice missing or incorrect data?
What is VideoHolmes?
VideoHolmes evaluates video understanding and reasoning capabilities in multimodal models.
VideoHolmes is a multimodal benchmark evaluating models on multimodal, reasoning, and video tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.7, with the leader at 0.7.
Compare leaders on the best AI for multimodal, best AI for reasoning and best AI for video leaderboards.
Current leaders
Seed 2.1 Pro from ByteDance currently leads the VideoHolmes leaderboard with a score of 0.682 across 3 evaluated AI models.
FAQ
Common questions about the VideoHolmes benchmark and leaderboard.