Model Comparison

Grok-4 vs Mistral Small 3 24B Instruct

Grok-4 significantly outperforms across most benchmarks. Mistral Small 3 24B Instruct is 68.6x cheaper per token.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

1 benchmarks

Grok-4 outperforms in 1 benchmarks (GPQA), while Mistral Small 3 24B Instruct is better at 0 benchmarks.

Grok-4 significantly outperforms across most benchmarks.

Fri May 08 2026 • llm-stats.com

Arena Performance

Human preference votes

Pricing Analysis

Price comparison per million tokens

Mistral Small 3 24B Instruct costs less

For input processing, Grok-4 ($3.00/1M tokens) is 42.9x more expensive than Mistral Small 3 24B Instruct ($0.07/1M tokens).

For output processing, Grok-4 ($15.00/1M tokens) is 107.1x more expensive than Mistral Small 3 24B Instruct ($0.14/1M tokens).

In conclusion, Grok-4 is more expensive than Mistral Small 3 24B Instruct.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Fri May 08 2026 • llm-stats.com
xAI
Grok-4
Input tokens$3.00
Output tokens$15.00
Best providerxAI
Mistral AI
Mistral Small 3 24B Instruct
Input tokens$0.07
Output tokens$0.14
Best providerDeepinfra
Notice missing or incorrect data?Start an Issue→

Context Window

Maximum input and output token capacity

Grok-4 accepts 256,000 input tokens compared to Mistral Small 3 24B Instruct's 32,000 tokens. Mistral Small 3 24B Instruct can generate longer responses up to 32,000 tokens, while Grok-4 is limited to 8,000 tokens.

xAI
Grok-4
Input256,000 tokens
Output8,000 tokens
Mistral AI
Mistral Small 3 24B Instruct
Input32,000 tokens
Output32,000 tokens
Fri May 08 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Grok-4 supports multimodal inputs, whereas Mistral Small 3 24B Instruct does not.

Grok-4 can handle both text and other forms of data like images, making it suitable for multimodal applications.

Grok-4

Text
Images
Audio
Video

Mistral Small 3 24B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Grok-4 is licensed under a proprietary license, while Mistral Small 3 24B Instruct uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Grok-4

Proprietary

Closed source

Mistral Small 3 24B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

Grok-4 was released on 2025-07-09, while Mistral Small 3 24B Instruct was released on 2025-01-30.

Grok-4 is 5 months newer than Mistral Small 3 24B Instruct.

Grok-4

Jul 9, 2025

10 months ago

5mo newer
Mistral Small 3 24B Instruct

Jan 30, 2025

1.3 years ago

Knowledge Cutoff

When training data ends

Grok-4 has a knowledge cutoff of 2024-12-31, while Mistral Small 3 24B Instruct has a cutoff of 2023-10-01.

Grok-4 has more recent training data (up to 2024-12-31), making it potentially better informed about events through that date compared to Mistral Small 3 24B Instruct (2023-10-01).

Grok-4

Dec 2024

1.2 yr newer
Mistral Small 3 24B Instruct

Oct 2023

Provider Availability

Grok-4 is available from xAI. Mistral Small 3 24B Instruct is available from DeepInfra, Mistral AI.

Grok-4

xai logo
xAI
Input Price:Input: $3.00/1MOutput Price:Output: $15.00/1M

Mistral Small 3 24B Instruct

deepinfra logo
Deepinfra
Input Price:Input: $0.07/1MOutput Price:Output: $0.14/1M
mistral logo
Mistral
Input Price:Input: $0.10/1MOutput Price:Output: $0.30/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

xAI
Larger context window (256,000 tokens)
Supports multimodal inputs
Higher GPQA score (87.5% vs 45.3%)
Mistral AI
Less expensive input tokens
Less expensive output tokens
Has open weights
xAIGrok-4
Mistral AIMistral Small 3 24B Instruct
Compare in Playground

Detailed Comparison

AI Model Comparison Table
Feature
xAI
Grok-4
Mistral AI
Mistral Small 3 24B Instruct

FAQ

Common questions about Grok-4 vs Mistral Small 3 24B Instruct.

Which is better, Grok-4 or Mistral Small 3 24B Instruct?

Grok-4 significantly outperforms across most benchmarks. Grok-4 is made by xAI and Mistral Small 3 24B Instruct is made by Mistral AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Grok-4 compare to Mistral Small 3 24B Instruct in benchmarks?

Grok-4 scores AIME 2025: 91.7%, HMMT25: 90.0%, GPQA: 87.5%, LiveCodeBench: 79.0%, Humanity's Last Exam: 40.0%. Mistral Small 3 24B Instruct scores Arena Hard: 87.6%, HumanEval: 84.8%, MT-Bench: 83.5%, IFEval: 82.9%, MATH: 70.6%.

Is Grok-4 cheaper than Mistral Small 3 24B Instruct?

Mistral Small 3 24B Instruct is 42.9x cheaper for input tokens. Grok-4 costs $3.00/M input and $15.00/M output via xai. Mistral Small 3 24B Instruct costs $0.07/M input and $0.14/M output via deepinfra.

What are the context window sizes for Grok-4 and Mistral Small 3 24B Instruct?

Grok-4 supports 256K tokens and Mistral Small 3 24B Instruct supports 32K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-4 and Mistral Small 3 24B Instruct?

Key differences include context window (256K vs 32K), input pricing ($3.00 vs $0.07/M), multimodal support (yes vs no), licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-4 and Mistral Small 3 24B Instruct?

Grok-4 is developed by xAI and Mistral Small 3 24B Instruct is developed by Mistral AI.