The AI arena is free today

Open Superagent

Grok-4 Heavy vs Mistral Small 3.1 24B Base

Grok-4 Heavy significantly outperforms across most benchmarks.

xAI · Mistral AI · Updated for 2026

Which is better?

Grok-4 Heavy outperforms in 1 benchmarks (GPQA), while Mistral Small 3.1 24B Base is better at 0 benchmarks. Grok-4 Heavy significantly outperforms across most benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Grok-4 Heavy

  • you want the strongest raw capability — it leads on 1 of 1 shared benchmarks

Choose Mistral Small 3.1 24B Base

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Benchmark wins
1 of 1
0 of 1
Input price
— / M
$0.10 / M
Output price
— / M
$0.30 / M
Context window
128,000
Released
Mar 2025
License
Proprietary
Apache 2.0

Performance Benchmarks

Comparative analysis across standard metrics

1 benchmarks

Grok-4 Heavy outperforms in 1 benchmarks (GPQA), while Mistral Small 3.1 24B Base is better at 0 benchmarks.

Grok-4 Heavy significantly outperforms across most benchmarks.

Wed Aug 26 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Context Window

Maximum input and output token capacity

Only Mistral Small 3.1 24B Base specifies input context (128,000 tokens). Only Mistral Small 3.1 24B Base specifies output context (128,000 tokens).

xAI
Grok-4 Heavy
Input- tokens
Output- tokens
Mistral AI
Mistral Small 3.1 24B Base
Input128,000 tokens
Output128,000 tokens
Wed Aug 26 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Both Grok-4 Heavy and Mistral Small 3.1 24B Base support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Grok-4 Heavy

Text
Images
Audio
Video

Mistral Small 3.1 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

Grok-4 Heavy is licensed under a proprietary license, while Mistral Small 3.1 24B Base uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Grok-4 Heavy

Proprietary

Closed source

Mistral Small 3.1 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

Mistral Small 3.1 24B Base was released on 2025-03-17, while Grok-4 Heavy's release date is not specified.

We can confirm Mistral Small 3.1 24B Base's release timeline, but cannot make a direct age comparison without Grok-4 Heavy's release date.

Grok-4 Heavy

Mistral Small 3.1 24B Base

Mar 17, 2025

1.4 years ago

Knowledge Cutoff

When training data ends

Grok-4 Heavy has a documented knowledge cutoff of 2024-12-31, while Mistral Small 3.1 24B Base's cutoff date is not specified.

We can confirm Grok-4 Heavy's training data extends to 2024-12-31, but cannot make a direct comparison without Mistral Small 3.1 24B Base's cutoff date.

Grok-4 Heavy

Dec 2024

Mistral Small 3.1 24B Base

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Grok-4 Heavy and Mistral Small 3.1 24B Base side-by-side, then vote on the output you prefer.

Grok-4 Heavy
✓ Preferred
Mistral Small 3.1 24B Base
Open in Playground

FAQ

Common questions about Grok-4 Heavy vs Mistral Small 3.1 24B Base.

Which is better, Grok-4 Heavy or Mistral Small 3.1 24B Base?

Grok-4 Heavy significantly outperforms across most benchmarks. Grok-4 Heavy is made by xAI and Mistral Small 3.1 24B Base is made by Mistral AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Grok-4 Heavy compare to Mistral Small 3.1 24B Base in benchmarks?

Grok-4 Heavy scores AIME 2025: 100.0%, HMMT25: 96.7%, GPQA: 88.4%, LiveCodeBench: 79.4%, USAMO25: 61.9%. Mistral Small 3.1 24B Base scores MMLU: 81.0%, TriviaQA: 80.5%, MMMU: 59.3%, MMLU-Pro: 56.0%, GPQA: 37.5%.

What are the context window sizes for Grok-4 Heavy and Mistral Small 3.1 24B Base?

Grok-4 Heavy supports an unknown number of tokens and Mistral Small 3.1 24B Base supports 128K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-4 Heavy and Mistral Small 3.1 24B Base?

Key differences include licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-4 Heavy and Mistral Small 3.1 24B Base?

Grok-4 Heavy is developed by xAI and Mistral Small 3.1 24B Base is developed by Mistral AI.