The AI arena is free today

Open Superagent

Llama 4 Scout vs Mistral Small 3.1 24B Instruct

Both models are evenly matched across the benchmarks.

Meta · Mistral AI · Updated for 2026

Which is better?

Llama 4 Scout outperforms in 3 benchmarks (GPQA, MMLU-Pro, MMMU), while Mistral Small 3.1 24B Instruct is better at 3 benchmarks (MATH, MBPP, MMLU). Both models are evenly matched across the benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Llama 4 Scout

  • you want the most recent training data — it shipped Apr 2025

Choose Mistral Small 3.1 24B Instruct

  • you are already invested in the Mistral AI ecosystem

At a glance

The differences that matter most.

Llama 4 Scout
Meta
Mistral Small 3.1 24B Instruct
Mistral AI
Benchmark wins
3 of 6
3 of 6
Input price
$0.08 / M
— / M
Output price
$0.30 / M
— / M
Context window
10,000,000
—
Released
Apr 2025
Mar 2025
License
Llama 4 Community License Agreement
Apache 2.0

Performance Benchmarks

Comparative analysis across standard metrics

6 benchmarks

Llama 4 Scout outperforms in 3 benchmarks (GPQA, MMLU-Pro, MMMU), while Mistral Small 3.1 24B Instruct is better at 3 benchmarks (MATH, MBPP, MMLU).

Both models are evenly matched across the benchmarks.

Wed Aug 26 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Model Size

Parameter count comparison

85.0B diff

Llama 4 Scout has 85.0B more parameters than Mistral Small 3.1 24B Instruct, making it 354.2% larger.

Meta
Llama 4 Scout
109.0Bparameters
Mistral AI
Mistral Small 3.1 24B Instruct
24.0Bparameters
109.0B
Llama 4 Scout
24.0B
Mistral Small 3.1 24B Instruct

Context Window

Maximum input and output token capacity

Only Llama 4 Scout specifies input context (10,000,000 tokens). Only Llama 4 Scout specifies output context (10,000,000 tokens).

Meta
Llama 4 Scout
Input10,000,000 tokens
Output10,000,000 tokens
Mistral AI
Mistral Small 3.1 24B Instruct
Input- tokens
Output- tokens
Wed Aug 26 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Both Llama 4 Scout and Mistral Small 3.1 24B Instruct support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Llama 4 Scout

Text
Images
Audio
Video

Mistral Small 3.1 24B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Llama 4 Scout is licensed under Llama 4 Community License Agreement, while Mistral Small 3.1 24B Instruct uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Llama 4 Scout

Llama 4 Community License Agreement

Open weights

Mistral Small 3.1 24B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

Llama 4 Scout was released on 2025-04-05, while Mistral Small 3.1 24B Instruct was released on 2025-03-17.

Llama 4 Scout is 1 month newer than Mistral Small 3.1 24B Instruct.

Llama 4 Scout

Apr 5, 2025

1.4 years ago

2w newer
Mistral Small 3.1 24B Instruct

Mar 17, 2025

1.4 years ago

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Llama 4 Scout and Mistral Small 3.1 24B Instruct side-by-side, then vote on the output you prefer.

Llama 4 Scout
✓ Preferred
Mistral Small 3.1 24B Instruct
Open in Playground

FAQ

Common questions about Llama 4 Scout vs Mistral Small 3.1 24B Instruct.

Which is better, Llama 4 Scout or Mistral Small 3.1 24B Instruct?

Both models are evenly matched across the benchmarks. Llama 4 Scout is made by Meta and Mistral Small 3.1 24B Instruct is made by Mistral AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Llama 4 Scout compare to Mistral Small 3.1 24B Instruct in benchmarks?

Llama 4 Scout scores DocVQA: 94.4%, MGSM: 90.6%, ChartQA: 88.8%, MMLU: 79.6%, MMLU-Pro: 74.3%. Mistral Small 3.1 24B Instruct scores HumanEval: 88.4%, MMLU: 80.6%, TriviaQA: 80.5%, MBPP: 74.7%, MATH: 69.3%.

What are the context window sizes for Llama 4 Scout and Mistral Small 3.1 24B Instruct?

Llama 4 Scout supports 10.0M tokens and Mistral Small 3.1 24B Instruct supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Llama 4 Scout and Mistral Small 3.1 24B Instruct?

Key differences include licensing (Llama 4 Community License Agreement vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Llama 4 Scout and Mistral Small 3.1 24B Instruct?

Llama 4 Scout is developed by Meta and Mistral Small 3.1 24B Instruct is developed by Mistral AI.

Related comparisons