What is the RealWorldQA leaderboard?

The RealWorldQA leaderboard ranks 22 AI models based on their performance on this benchmark. Currently, Qwen3.6 Plus by Alibaba Cloud / Qwen Team leads with a score of 0.854. The average score across all models is 0.764.

What is the highest RealWorldQA score?

The highest RealWorldQA score is 0.854, achieved by Qwen3.6 Plus from Alibaba Cloud / Qwen Team.

How many models are evaluated on RealWorldQA?

22 models have been evaluated on the RealWorldQA benchmark, with 0 verified results and 22 self-reported results.

What categories does RealWorldQA cover?

RealWorldQA is categorized under spatial reasoning and vision. The benchmark evaluates multimodal models.

All benchmarks

RealWorldQA

RealWorldQA is a benchmark designed to evaluate basic real-world spatial understanding capabilities of multimodal models. The initial release consists of over 700 anonymized images taken from vehicles and other real-world scenarios, each accompanied by a question and easily verifiable answer. Released by xAI as part of their Grok-1.5 Vision preview to test models' ability to understand natural scenes and spatial relationships in everyday visual contexts.

Qwen3.6 Plus from Alibaba Cloud / Qwen Team currently leads the RealWorldQA leaderboard with a score of 0.854 across 22 evaluated AI models.