Multilingual MGSM (CoT)

Name: Multilingual MGSM (CoT) Leaderboard — AI Model Scores
Creator: LLM Stats
License: https://llm-stats.com/legal/terms-of-service

Paper

Progress Over Time

Interactive timeline showing model performance evolution on Multilingual MGSM (CoT)

State-of-the-art frontier

Open

Proprietary

Multilingual MGSM (CoT) Leaderboard

3 models

			Context	Cost
1	Llama 3.1 405B Instruct Meta	405B	—	—
2	Llama 3.1 70B Instruct Meta	70B	131K	$0.40 / $0.40
3	Llama 3.1 8B Instruct Meta	8B	131K	$0.02 / $0.04

Notice missing or incorrect data?

About this benchmark

What is Multilingual MGSM (CoT)?

Multilingual Grade School Math (MGSM) benchmark evaluates language models' chain-of-thought reasoning abilities across ten typologically diverse languages. Contains 250 grade-school math problems manually translated from GSM8K dataset into languages including Bengali and Swahili.

Multilingual MGSM (CoT) is a text benchmark evaluating models on math and reasoning tasks. LLM Stats tracks 3 models on this benchmark, scored on a 0–1 scale. The current average is 0.8, with the leader at 0.9.

Compare leaders on the best AI for math and best AI for reasoning leaderboards.

Current leaders

Llama 3.1 405B Instruct from Meta currently leads the Multilingual MGSM (CoT) leaderboard with a score of 0.916 across 3 evaluated AI models.

Llama 3.1 405B InstructMeta91.6%

Llama 3.1 70B InstructMeta86.9%

Llama 3.1 8B InstructMeta68.9%

FAQ

Common questions about the Multilingual MGSM (CoT) benchmark and leaderboard.

What is the Multilingual MGSM (CoT) benchmark?

What is the Multilingual MGSM (CoT) leaderboard?

The Multilingual MGSM (CoT) leaderboard ranks 3 AI models based on their performance on this benchmark. Currently, Llama 3.1 405B Instruct by Meta leads with a score of 0.916. The average score across all models is 0.825.

What is the highest Multilingual MGSM (CoT) score?

The highest Multilingual MGSM (CoT) score is 0.916, achieved by Llama 3.1 405B Instruct from Meta.

How many models are evaluated on Multilingual MGSM (CoT)?

3 models have been evaluated on the Multilingual MGSM (CoT) benchmark, with 0 verified results and 3 self-reported results.

Where can I find the Multilingual MGSM (CoT) paper?

The Multilingual MGSM (CoT) paper is available at https://arxiv.org/abs/2210.03057. The paper details the methodology, dataset construction, and evaluation criteria.

What categories does Multilingual MGSM (CoT) cover?

Multilingual MGSM (CoT) is categorized under math and reasoning. The benchmark evaluates text models with multilingual support.

Which model offers the best value on Multilingual MGSM (CoT)?

Among models scoring within 10% of the leader, Llama 3.1 70B Instruct from Meta is the cheapest, at $0.40 per million input tokens with a score of 0.869.

How recent are the Multilingual MGSM (CoT) leaderboard results?

The Multilingual MGSM (CoT) leaderboard was last updated in September 2026 and currently includes 3 evaluated models.