Model Comparison

Mistral Small 3 24B Instruct vs Phi 4 Reasoning

Phi 4 Reasoning shows notably better performance in the majority of benchmarks.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

4 benchmarks

Mistral Small 3 24B Instruct outperforms in 1 benchmarks (Arena Hard), while Phi 4 Reasoning is better at 3 benchmarks (GPQA, IFEval, MMLU-Pro).

Phi 4 Reasoning shows notably better performance in the majority of benchmarks.

Sat Jun 06 2026 • llm-stats.com

Arena Performance

Human preference votes

Model Size

Parameter count comparison

10.0B diff

Mistral Small 3 24B Instruct has 10.0B more parameters than Phi 4 Reasoning, making it 71.4% larger.

Mistral AI
Mistral Small 3 24B Instruct
24.0Bparameters
Microsoft
Phi 4 Reasoning
14.0Bparameters
24.0B
Mistral Small 3 24B Instruct
14.0B
Phi 4 Reasoning

Context Window

Maximum input and output token capacity

Only Mistral Small 3 24B Instruct specifies input context (32,000 tokens). Only Mistral Small 3 24B Instruct specifies output context (32,000 tokens).

Mistral AI
Mistral Small 3 24B Instruct
Input32,000 tokens
Output32,000 tokens
Microsoft
Phi 4 Reasoning
Input- tokens
Output- tokens
Sat Jun 06 2026 • llm-stats.com

License

Usage and distribution terms

Mistral Small 3 24B Instruct is licensed under Apache 2.0, while Phi 4 Reasoning uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Mistral Small 3 24B Instruct

Apache 2.0

Open weights

Phi 4 Reasoning

MIT

Open weights

Release Timeline

When each model was launched

Mistral Small 3 24B Instruct was released on 2025-01-30, while Phi 4 Reasoning was released on 2025-04-30.

Phi 4 Reasoning is 3 months newer than Mistral Small 3 24B Instruct.

Mistral Small 3 24B Instruct

Jan 30, 2025

1.3 years ago

Phi 4 Reasoning

Apr 30, 2025

1.1 years ago

3mo newer

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Instruct has a knowledge cutoff of 2023-10-01, while Phi 4 Reasoning has a cutoff of 2025-03-01.

Phi 4 Reasoning has more recent training data (up to 2025-03-01), making it potentially better informed about events through that date compared to Mistral Small 3 24B Instruct (2023-10-01).

Mistral Small 3 24B Instruct

Oct 2023

Phi 4 Reasoning

Mar 2025

1.4 yr newer

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

Mistral AI
Larger context window (32,000 tokens)
Higher Arena Hard score (87.6% vs 73.3%)
Microsoft
Higher GPQA score (65.8% vs 45.3%)
Higher IFEval score (83.4% vs 82.9%)
Higher MMLU-Pro score (74.3% vs 66.3%)

Detailed Comparison

AI Model Comparison Table
Feature
Mistral AI
Mistral Small 3 24B Instruct
Microsoft
Phi 4 Reasoning

FAQ

Common questions about Mistral Small 3 24B Instruct vs Phi 4 Reasoning.

Which is better, Mistral Small 3 24B Instruct or Phi 4 Reasoning?

Phi 4 Reasoning shows notably better performance in the majority of benchmarks. Mistral Small 3 24B Instruct is made by Mistral AI and Phi 4 Reasoning is made by Microsoft. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Mistral Small 3 24B Instruct compare to Phi 4 Reasoning in benchmarks?

Mistral Small 3 24B Instruct scores Arena Hard: 87.6%, HumanEval: 84.8%, MT-Bench: 83.5%, IFEval: 82.9%, MATH: 70.6%. Phi 4 Reasoning scores FlenQA: 97.7%, HumanEval+: 92.9%, IFEval: 83.4%, OmniMath: 76.6%, AIME 2024: 75.3%.

What are the context window sizes for Mistral Small 3 24B Instruct and Phi 4 Reasoning?

Mistral Small 3 24B Instruct supports 32K tokens and Phi 4 Reasoning supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Mistral Small 3 24B Instruct and Phi 4 Reasoning?

Key differences include licensing (Apache 2.0 vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Mistral Small 3 24B Instruct and Phi 4 Reasoning?

Mistral Small 3 24B Instruct is developed by Mistral AI and Phi 4 Reasoning is developed by Microsoft.