The AI arena is free today

Open Superagent

GPT-4o vs Magistral Small 2506

GPT-4o and Magistral Small 2506 are closely matched at 14.3 and 10.9 on the LLM Stats Score.

OpenAI · Mistral AI · Updated for 2026

Which is better?

GPT-4o and Magistral Small 2506 are closely matched on the overall LLM Stats Score at 14.3 and 10.9.

The models split the 2 individual benchmarks reported for both models evenly.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose GPT-4o

  • you want predictable pricing at $2.50/M input and $10.00/M output

Choose Magistral Small 2506

  • you want the most recent training data — it shipped Jun 2025
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Core performance indexes
14.3
#226
10.9
#250
16.0
#207
11.2
#246
-0.3
#235
5.3
#194
Cost, coverage & limits
Benchmark wins
1 of 2
1 of 2
Input price
$2.50 / M
— / M
Output price
$10.00 / M
— / M
Context window
128,000

Capability indexes

Additional strengths measured across groups of related public benchmarks

1 shared
Index
GPT-4o
Magistral Small 2506
12.7#225
8.9#250
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

38 reported for GPT-4o · 4 for Magistral Small 2506

2 shared

GPT-4o outperforms in 1 benchmarks (GPQA), while Magistral Small 2506 is better at 1 benchmark (AIME 2024).

Both models are evenly matched across the benchmarks.

Sun Sep 06 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only GPT-4o specifies input context (128,000 tokens). Only GPT-4o specifies output context (16,384 tokens).

OpenAI
GPT-4o
Input128,000 tokens
Output16,384 tokens
Mistral AI
Magistral Small 2506
Input- tokens
Output- tokens
Sun Sep 06 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

GPT-4o supports multimodal inputs, whereas Magistral Small 2506 does not.

GPT-4o can handle both text and other forms of data like images, making it suitable for multimodal applications.

GPT-4o

Text
Images
Audio
Video

Magistral Small 2506

Text
Images
Audio
Video

License

Usage and distribution terms

GPT-4o is licensed under a proprietary license, while Magistral Small 2506 uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

GPT-4o

Proprietary

Closed source

Magistral Small 2506

Apache 2.0

Open weights

Release Timeline

When each model was launched

GPT-4o was released on 2024-08-06, while Magistral Small 2506 was released on 2025-06-10.

Magistral Small 2506 is 10 months newer than GPT-4o.

GPT-4o

Aug 6, 2024

2.1 years ago

Magistral Small 2506

Jun 10, 2025

1.2 years ago

10mo newer

Knowledge Cutoff

When training data ends

Magistral Small 2506 has a documented knowledge cutoff of 2025-06-01, while GPT-4o's cutoff date is not specified.

We can confirm Magistral Small 2506's training data extends to 2025-06-01, but cannot make a direct comparison without GPT-4o's cutoff date.

GPT-4o

Magistral Small 2506

Jun 2025

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against GPT-4o and Magistral Small 2506 side-by-side, then vote on the output you prefer.

GPT-4o
✓ Preferred
Magistral Small 2506
Open in Playground

FAQ

Common questions about GPT-4o vs Magistral Small 2506.

Which is better, GPT-4o or Magistral Small 2506?

GPT-4o and Magistral Small 2506 are closely matched on the LLM Stats Score at 14.3 and 10.9. GPT-4o is made by OpenAI and Magistral Small 2506 is made by Mistral AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does GPT-4o compare to Magistral Small 2506 in benchmarks?

GPT-4o scores AI2D: 94.2%, DocVQA: 92.8%, ChartQA: 85.7%, MMLU: 85.7%, CharXiv-D: 85.3%. Magistral Small 2506 scores AIME 2024: 70.7%, GPQA: 68.2%, AIME 2025: 62.8%, LiveCodeBench: 51.3%.

What are the context window sizes for GPT-4o and Magistral Small 2506?

GPT-4o supports 128K tokens and Magistral Small 2506 supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between GPT-4o and Magistral Small 2506?

Key differences include LLM Stats Score (14.3 vs 10.9), multimodal support (yes vs no), licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes GPT-4o and Magistral Small 2506?

GPT-4o is developed by OpenAI and Magistral Small 2506 is developed by Mistral AI.