MMVU
Progress Over Time
Interactive timeline showing model performance evolution on MMVU
MMVU Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 | Zhipu AI | 320B | 1.0M | $0.15 / $0.50 | ||
| 2 | Moonshot AI | 1.0T | — | — | ||
| 3 | Alibaba Cloud / Qwen Team | 122B | — | — | ||
| 4 | Alibaba Cloud / Qwen Team | 27B | 262K | $0.30 / $2.40 | ||
| 5 | Alibaba Cloud / Qwen Team | 35B | — | — |
What is MMVU?
MMVU (Multimodal Multi-disciplinary Video Understanding) is a benchmark for evaluating multimodal models on video understanding tasks across multiple disciplines, testing comprehension and reasoning capabilities on video content.
MMVU is a multimodal benchmark evaluating models on multimodal, reasoning, video, and vision tasks. LLM Stats tracks 5 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.8.
Compare leaders on the best AI for multimodal, best AI for reasoning, best AI for video and best AI for vision leaderboards.
Current leaders
GLM-5.3-Flash from Zhipu AI currently leads the MMVU leaderboard with a score of 0.805 across 5 evaluated AI models.
FAQ
Common questions about the MMVU benchmark and leaderboard.