Model Comparison

Mistral Small 3.1 24B Instruct vs Gemma 3n E4B Instructed LiteRT Preview

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks.

Performance Benchmarks

Comparative analysis across standard metrics

6 benchmarks

Mistral Small 3.1 24B Instruct outperforms in 6 benchmarks (GPQA, HumanEval, MBPP, MMLU, MMLU-Pro, TriviaQA), while Gemma 3n E4B Instructed LiteRT Preview is better at 0 benchmarks.

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks.

Sun May 10 2026 • llm-stats.com

Arena Performance

Human preference votes

Model Size

Parameter count comparison

22.1B diff

Mistral Small 3.1 24B Instruct has 22.1B more parameters than Gemma 3n E4B Instructed LiteRT Preview, making it 1156.5% larger.

Mistral AI
Mistral Small 3.1 24B Instruct
24.0Bparameters
Google
Gemma 3n E4B Instructed LiteRT Preview
1.9Bparameters
24.0B
Mistral Small 3.1 24B Instruct
1.9B
Gemma 3n E4B Instructed LiteRT Preview

Input Capabilities

Supported data types and modalities

Both Mistral Small 3.1 24B Instruct and Gemma 3n E4B Instructed LiteRT Preview support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Mistral Small 3.1 24B Instruct

Text
Images
Audio
Video

Gemma 3n E4B Instructed LiteRT Preview

Text
Images
Audio
Video

License

Usage and distribution terms

Mistral Small 3.1 24B Instruct is licensed under Apache 2.0, while Gemma 3n E4B Instructed LiteRT Preview uses Gemma.

License differences may affect how you can use these models in commercial or open-source projects.

Mistral Small 3.1 24B Instruct

Apache 2.0

Open weights

Gemma 3n E4B Instructed LiteRT Preview

Gemma

Open weights

Release Timeline

When each model was launched

Mistral Small 3.1 24B Instruct was released on 2025-03-17, while Gemma 3n E4B Instructed LiteRT Preview was released on 2025-05-20.

Gemma 3n E4B Instructed LiteRT Preview is 2 months newer than Mistral Small 3.1 24B Instruct.

Mistral Small 3.1 24B Instruct

Mar 17, 2025

1.1 years ago

Gemma 3n E4B Instructed LiteRT Preview

May 20, 2025

11 months ago

2mo newer

Knowledge Cutoff

When training data ends

Gemma 3n E4B Instructed LiteRT Preview has a documented knowledge cutoff of 2024-06-01, while Mistral Small 3.1 24B Instruct's cutoff date is not specified.

We can confirm Gemma 3n E4B Instructed LiteRT Preview's training data extends to 2024-06-01, but cannot make a direct comparison without Mistral Small 3.1 24B Instruct's cutoff date.

Mistral Small 3.1 24B Instruct

Gemma 3n E4B Instructed LiteRT Preview

Jun 2024

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Key Takeaways

Higher GPQA score (46.0% vs 23.7%)
Higher HumanEval score (88.4% vs 75.0%)
Higher MBPP score (74.7% vs 63.6%)
Higher MMLU score (80.6% vs 64.9%)
Higher MMLU-Pro score (66.8% vs 50.6%)
Higher TriviaQA score (80.5% vs 70.2%)

No standout differentiators in the data we have for this pair.

Detailed Comparison

FAQ

Common questions about Mistral Small 3.1 24B Instruct vs Gemma 3n E4B Instructed LiteRT Preview.

Which is better, Mistral Small 3.1 24B Instruct or Gemma 3n E4B Instructed LiteRT Preview?

Mistral Small 3.1 24B Instruct significantly outperforms across most benchmarks. Mistral Small 3.1 24B Instruct is made by Mistral AI and Gemma 3n E4B Instructed LiteRT Preview is made by Google. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Mistral Small 3.1 24B Instruct compare to Gemma 3n E4B Instructed LiteRT Preview in benchmarks?

Mistral Small 3.1 24B Instruct scores HumanEval: 88.4%, MMLU: 80.6%, TriviaQA: 80.5%, MBPP: 74.7%, MATH: 69.3%. Gemma 3n E4B Instructed LiteRT Preview scores ARC-E: 81.6%, BoolQ: 81.6%, PIQA: 81.0%, HellaSwag: 78.6%, HumanEval: 75.0%.

What are the main differences between Mistral Small 3.1 24B Instruct and Gemma 3n E4B Instructed LiteRT Preview?

Key differences include licensing (Apache 2.0 vs Gemma). See the full comparison above for benchmark-by-benchmark results.

Who makes Mistral Small 3.1 24B Instruct and Gemma 3n E4B Instructed LiteRT Preview?

Mistral Small 3.1 24B Instruct is developed by Mistral AI and Gemma 3n E4B Instructed LiteRT Preview is developed by Google.