Model Comparison

Mistral Small 3 24B Base vs Qwen2 7B Instruct

Mistral Small 3 24B Base shows notably better performance in the majority of benchmarks.

Performance Benchmarks

Comparative analysis across standard metrics

6 benchmarks

Mistral Small 3 24B Base outperforms in 4 benchmarks (GPQA, MBPP, MMLU, MMLU-Pro), while Qwen2 7B Instruct is better at 2 benchmarks (GSM8k, MATH).

Mistral Small 3 24B Base shows notably better performance in the majority of benchmarks.

Sat Jun 06 2026 • llm-stats.com

Arena Performance

Human preference votes

Model Size

Parameter count comparison

16.0B diff

Mistral Small 3 24B Base has 16.0B more parameters than Qwen2 7B Instruct, making it 209.7% larger.

Mistral AI
Mistral Small 3 24B Base
23.6Bparameters
Alibaba Cloud / Qwen Team
Qwen2 7B Instruct
7.6Bparameters
23.6B
Mistral Small 3 24B Base
7.6B
Qwen2 7B Instruct

Input Capabilities

Supported data types and modalities

Mistral Small 3 24B Base supports multimodal inputs, whereas Qwen2 7B Instruct does not.

Mistral Small 3 24B Base can handle both text and other forms of data like images, making it suitable for multimodal applications.

Mistral Small 3 24B Base

Text
Images
Audio
Video

Qwen2 7B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under Apache 2.0.

Both models share the same licensing terms, providing consistent usage rights.

Mistral Small 3 24B Base

Apache 2.0

Open weights

Qwen2 7B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

Mistral Small 3 24B Base was released on 2025-01-30, while Qwen2 7B Instruct was released on 2024-07-23.

Mistral Small 3 24B Base is 6 months newer than Qwen2 7B Instruct.

Mistral Small 3 24B Base

Jan 30, 2025

1.3 years ago

6mo newer
Qwen2 7B Instruct

Jul 23, 2024

1.9 years ago

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Base has a documented knowledge cutoff of 2023-10-01, while Qwen2 7B Instruct's cutoff date is not specified.

We can confirm Mistral Small 3 24B Base's training data extends to 2023-10-01, but cannot make a direct comparison without Qwen2 7B Instruct's cutoff date.

Mistral Small 3 24B Base

Oct 2023

Qwen2 7B Instruct

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Key Takeaways

Supports multimodal inputs
Higher GPQA score (34.4% vs 25.3%)
Higher MBPP score (69.6% vs 67.2%)
Higher MMLU score (80.7% vs 70.5%)
Higher MMLU-Pro score (54.4% vs 44.1%)
Alibaba Cloud / Qwen Team

Qwen2 7B Instruct

View details

Alibaba Cloud / Qwen Team

Higher GSM8k score (82.3% vs 80.7%)
Higher MATH score (49.6% vs 46.0%)

Detailed Comparison

AI Model Comparison Table
Feature
Mistral AI
Mistral Small 3 24B Base
Alibaba Cloud / Qwen Team
Qwen2 7B Instruct

FAQ

Common questions about Mistral Small 3 24B Base vs Qwen2 7B Instruct.

Which is better, Mistral Small 3 24B Base or Qwen2 7B Instruct?

Mistral Small 3 24B Base shows notably better performance in the majority of benchmarks. Mistral Small 3 24B Base is made by Mistral AI and Qwen2 7B Instruct is made by Alibaba Cloud / Qwen Team. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Mistral Small 3 24B Base compare to Qwen2 7B Instruct in benchmarks?

Mistral Small 3 24B Base scores ARC-C: 91.3%, GSM8k: 80.7%, MMLU: 80.7%, TriviaQA: 80.3%, MBPP: 69.6%. Qwen2 7B Instruct scores MT-Bench: 84.1%, GSM8k: 82.3%, HumanEval: 79.9%, C-Eval: 77.2%, AlignBench: 72.1%.

What are the main differences between Mistral Small 3 24B Base and Qwen2 7B Instruct?

Key differences include multimodal support (yes vs no). See the full comparison above for benchmark-by-benchmark results.

Who makes Mistral Small 3 24B Base and Qwen2 7B Instruct?

Mistral Small 3 24B Base is developed by Mistral AI and Qwen2 7B Instruct is developed by Alibaba Cloud / Qwen Team.