MTVQA
Progress Over Time
Interactive timeline showing model performance evolution on MTVQA
MTVQA Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Alibaba Cloud / Qwen Team | 73B | — | — |
What is MTVQA?
MTVQA (Multilingual Text-Centric Visual Question Answering) is the first benchmark featuring high-quality human expert annotations across 9 diverse languages, consisting of 6,778 question-answer pairs across 2,116 images. It addresses visual-textual misalignment problems in multilingual text-centric VQA.
MTVQA is a multimodal benchmark evaluating models on multimodal, text-to-image, and vision tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.3, with the leader at 0.3.
Compare leaders on the best AI for multimodal, best AI for text-to-image and best AI for vision leaderboards.
Current leaders
Qwen2-VL-72B-Instruct from Alibaba Cloud / Qwen Team currently leads the MTVQA leaderboard with a score of 0.309 across 1 evaluated AI models.
FAQ
Common questions about the MTVQA benchmark and leaderboard.