MLVU
Progress Over Time
Interactive timeline showing model performance evolution on MLVU
MLVU Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Alibaba Cloud / Qwen Team | — | — | — | ||
| 2 | Alibaba Cloud / Qwen Team | 122B | 262K | $0.29 / $2.40 | ||
| 3 | Alibaba Cloud / Qwen Team | — | 1.0M | $0.50 / $3.00 | ||
| 4 | Alibaba Cloud / Qwen Team | 28B | 262K | $0.32 / $3.20 | ||
| 5 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.10 / $0.95 | ||
| 6 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.26 / $2.60 | ||
| 7 | Alibaba Cloud / Qwen Team | 35B | 262K | $0.14 / $1.00 | ||
| 8 | Alibaba Cloud / Qwen Team | 236B | 262K | $0.20 / $0.88 | ||
| 9 | Alibaba Cloud / Qwen Team | 236B | — | — | ||
| 10 | Alibaba Cloud / Qwen Team | 8B | — | — |
What is MLVU?
A comprehensive benchmark for multi-task long video understanding that evaluates multimodal large language models on videos ranging from 3 minutes to 2 hours across 9 distinct tasks including reasoning, captioning, recognition, and summarization.
MLVU is a multimodal benchmark evaluating models on long context, multimodal, video, and vision tasks. LLM Stats tracks 10 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.
Compare leaders on the best AI for long context, best AI for multimodal, best AI for video and best AI for vision leaderboards.
Current leaders
Qwen3.7-Plus from Alibaba Cloud / Qwen Team currently leads the MLVU leaderboard with a score of 0.874 across 10 evaluated AI models.
FAQ
Common questions about the MLVU benchmark and leaderboard.