The AI arena is free today

Open Superagent

InterGPS

Paper

Progress Over Time

Interactive timeline showing model performance evolution on InterGPS

State-of-the-art frontier
Open
Proprietary

InterGPS Leaderboard

2 models
ContextCostLicense
16B
24B
Notice missing or incorrect data?
About this benchmark

What is InterGPS?

Interpretable Geometry Problem Solver (Inter-GPS) with Geometry3K dataset of 3,002 geometry problems with dense annotation in formal language using theorem knowledge and symbolic reasoning

InterGPS is a text benchmark evaluating models on math and spatial reasoning tasks. LLM Stats tracks 2 models on this benchmark, scored on a 0–1 scale. The current average is 0.4, with the leader at 0.5.

Compare leaders on the best AI for math and best AI for spatial reasoning leaderboards.

Current leaders

Phi-4-multimodal-instruct from Microsoft currently leads the InterGPS leaderboard with a score of 0.486 across 2 evaluated AI models.

Source paper

Title
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning
Authors
Pan Lu, Ran Gong, Shibiao Jiang, Liang Qiu, and 3 others
Published
Abstract

Geometry problem solving has attracted much attention in the NLP community recently. The task is challenging as it requires abstract problem understanding and symbolic reasoning with axiomatic knowledge. However, current datasets are either small in scale or not publicly available. Thus, we construct a new large-scale benchmark, Geometry3K, consisting of 3,002 geometry problems with dense annotation in formal language. We further propose a novel geometry solving approach with formal language and symbolic reasoning, called Interpretable Geometry Problem Solver (Inter-GPS). Inter-GPS first parses the problem text and diagram into formal language automatically via rule-based text parsing and neural object detecting, respectively. Unlike implicit learning in existing methods, Inter-GPS incorporates theorem knowledge as conditional rules and performs symbolic reasoning step by step. Also, a theorem predictor is designed to infer the theorem application sequence fed to the symbolic solver for the more efficient and reasonable searching path. Extensive experiments on the Geometry3K and GEOS datasets demonstrate that Inter-GPS achieves significant improvements over existing methods. The project with code and data is available at https://lupantech.github.io/inter-gps.

FAQ

Common questions about the InterGPS benchmark and leaderboard.

What is the InterGPS benchmark?

Interpretable Geometry Problem Solver (Inter-GPS) with Geometry3K dataset of 3,002 geometry problems with dense annotation in formal language using theorem knowledge and symbolic reasoning

What is the InterGPS leaderboard?

The InterGPS leaderboard ranks 2 AI models based on their performance on this benchmark. Currently, Phi-4-multimodal-instruct by Microsoft leads with a score of 0.486. The average score across all models is 0.424.

What is the highest InterGPS score?

The highest InterGPS score is 0.486, achieved by Phi-4-multimodal-instruct from Microsoft.

How many models are evaluated on InterGPS?

2 models have been evaluated on the InterGPS benchmark, with 0 verified results and 2 self-reported results.

Where can I find the InterGPS paper?

The InterGPS paper is available at https://arxiv.org/abs/2105.04165. The paper details the methodology, dataset construction, and evaluation criteria.

What categories does InterGPS cover?

InterGPS is categorized under math and spatial reasoning. The benchmark evaluates text models.

What is the best open-source model on InterGPS?

Phi-4-multimodal-instruct by Microsoft is the top-ranked open-source model on InterGPS, with a score of 0.486 (rank #1).

How recent are the InterGPS leaderboard results?

The InterGPS leaderboard was last updated in August 2026 and currently includes 2 evaluated models.