The AI arena is free today

Open Superagent

Gemma 2 9B vs Mistral Small 3.1 24B Instruct

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks.

Google · Mistral AI · Updated for 2026

Which is better?

Gemma 2 9B outperforms in 0 benchmarks, while Mistral Small 3.1 24B Instruct is better at 5 benchmarks (HumanEval, MATH, MBPP, MMLU, TriviaQA). Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Gemma 2 9B

  • you are already invested in the Google ecosystem

Choose Mistral Small 3.1 24B Instruct

  • you want the strongest raw capability — it leads on 5 of 5 shared benchmarks
  • you want the most recent training data — it shipped Mar 2025

At a glance

The differences that matter most.

Gemma 2 9B
Google
Mistral Small 3.1 24B Instruct
Mistral AI
Benchmark wins
0 of 5
5 of 5
Input price
— / M
— / M
Output price
— / M
— / M
Context window
—
—
Released
Jun 2024
Mar 2025
License
Gemma
Apache 2.0

Performance Benchmarks

Comparative analysis across standard metrics

5 benchmarks

Gemma 2 9B outperforms in 0 benchmarks, while Mistral Small 3.1 24B Instruct is better at 5 benchmarks (HumanEval, MATH, MBPP, MMLU, TriviaQA).

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks.

Tue Aug 25 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Model Size

Parameter count comparison

14.8B diff

Mistral Small 3.1 24B Instruct has 14.8B more parameters than Gemma 2 9B, making it 159.7% larger.

Google
Gemma 2 9B
9.2Bparameters
Mistral AI
Mistral Small 3.1 24B Instruct
24.0Bparameters
9.2B
Gemma 2 9B
24.0B
Mistral Small 3.1 24B Instruct

Input Capabilities

Supported data types and modalities

Mistral Small 3.1 24B Instruct supports multimodal inputs, whereas Gemma 2 9B does not.

Mistral Small 3.1 24B Instruct can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemma 2 9B

Text
Images
Audio
Video

Mistral Small 3.1 24B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 2 9B is licensed under Gemma, while Mistral Small 3.1 24B Instruct uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 2 9B

Gemma

Open weights

Mistral Small 3.1 24B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

Gemma 2 9B was released on 2024-06-27, while Mistral Small 3.1 24B Instruct was released on 2025-03-17.

Mistral Small 3.1 24B Instruct is 9 months newer than Gemma 2 9B.

Gemma 2 9B

Jun 27, 2024

2.2 years ago

Mistral Small 3.1 24B Instruct

Mar 17, 2025

1.4 years ago

8mo newer

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Gemma 2 9B and Mistral Small 3.1 24B Instruct side-by-side, then vote on the output you prefer.

Gemma 2 9B
✓ Preferred
Mistral Small 3.1 24B Instruct
Open in Playground

FAQ

Common questions about Gemma 2 9B vs Mistral Small 3.1 24B Instruct.

Which is better, Gemma 2 9B or Mistral Small 3.1 24B Instruct?

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks. Gemma 2 9B is made by Google and Mistral Small 3.1 24B Instruct is made by Mistral AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemma 2 9B compare to Mistral Small 3.1 24B Instruct in benchmarks?

Gemma 2 9B scores ARC-E: 88.0%, BoolQ: 84.2%, HellaSwag: 81.9%, PIQA: 81.7%, Winogrande: 80.6%. Mistral Small 3.1 24B Instruct scores HumanEval: 88.4%, MMLU: 80.6%, TriviaQA: 80.5%, MBPP: 74.7%, MATH: 69.3%.

What are the main differences between Gemma 2 9B and Mistral Small 3.1 24B Instruct?

Key differences include multimodal support (no vs yes), licensing (Gemma vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 2 9B and Mistral Small 3.1 24B Instruct?

Gemma 2 9B is developed by Google and Mistral Small 3.1 24B Instruct is developed by Mistral AI.

Related comparisons