The AI arena is free today

Open Superagent

GPT-5.1 Codex vs Mistral Small 3 24B Base

GPT-5.1 Codex leads the LLM Stats Score 29.5 to -0.3.

OpenAI · Mistral AI · Updated for 2026

Which is better?

GPT-5.1 Codex leads the overall LLM Stats Score 29.5 to -0.3, ranking #131 overall.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose GPT-5.1 Codex

  • overall performance matters — it scores 29.5 and ranks #131 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you want the most recent training data — it shipped Nov 2025

Choose Mistral Small 3 24B Base

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

GPT-5.1 Codex
OpenAI
Mistral Small 3 24B Base
Mistral AI
Core performance indexes
LLM Stats Score
29.5
#131
-0.3
#330
Reasoning
29.7
#123
-0.3
#324
Cost, coverage & limits
Benchmark wins
—
—
Input price
$1.25 / M
— / M
Output price
$10.00 / M
— / M
Context window
400,000
—

Individual benchmarks

3 reported for GPT-5.1 Codex · 9 for Mistral Small 3 24B Base

No common benchmarks found

GPT-5.1 Codex and Mistral Small 3 24B Basedon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only GPT-5.1 Codex specifies input context (400,000 tokens). Only GPT-5.1 Codex specifies output context (128,000 tokens).

OpenAI
GPT-5.1 Codex
Input400,000 tokens
Output128,000 tokens
Mistral AI
Mistral Small 3 24B Base
Input- tokens
Output- tokens
Tue Sep 22 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both GPT-5.1 Codex and Mistral Small 3 24B Base support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

GPT-5.1 Codex

Text
Images
Audio
Video

Mistral Small 3 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

GPT-5.1 Codex is licensed under a proprietary license, while Mistral Small 3 24B Base uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

GPT-5.1 Codex

Proprietary

Closed source

Mistral Small 3 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

GPT-5.1 Codex was released on 2025-11-19, while Mistral Small 3 24B Base was released on 2025-01-30.

GPT-5.1 Codex is 10 months newer than Mistral Small 3 24B Base.

GPT-5.1 Codex

Nov 19, 2025

10 months ago

9mo newer
Mistral Small 3 24B Base

Jan 30, 2025

1.6 years ago

Knowledge Cutoff

When training data ends

GPT-5.1 Codex has a knowledge cutoff of 2024-09-30, while Mistral Small 3 24B Base has a cutoff of 2023-10-01.

GPT-5.1 Codex has more recent training data (up to 2024-09-30), making it potentially better informed about events through that date compared to Mistral Small 3 24B Base (2023-10-01).

GPT-5.1 Codex

Sep 2024

11 mo newer
Mistral Small 3 24B Base

Oct 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against GPT-5.1 Codex and Mistral Small 3 24B Base side-by-side, then vote on the output you prefer.

GPT-5.1 Codex
✓ Preferred
Mistral Small 3 24B Base
Open in Playground

FAQ

Common questions about GPT-5.1 Codex vs Mistral Small 3 24B Base.

Which is better, GPT-5.1 Codex or Mistral Small 3 24B Base?

GPT-5.1 Codex leads the LLM Stats Score 29.5 to -0.3. GPT-5.1 Codex is made by OpenAI and Mistral Small 3 24B Base is made by Mistral AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does GPT-5.1 Codex compare to Mistral Small 3 24B Base in benchmarks?

GPT-5.1 Codex scores SWE-Bench Verified: 73.7%, SWE-Lancer: 66.3%, Terminal-Bench 2.0: 52.8%. Mistral Small 3 24B Base scores ARC-C: 91.3%, GSM8k: 80.7%, MMLU: 80.7%, TriviaQA: 80.3%, MBPP: 69.6%.

What are the context window sizes for GPT-5.1 Codex and Mistral Small 3 24B Base?

GPT-5.1 Codex supports 400K tokens and Mistral Small 3 24B Base supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between GPT-5.1 Codex and Mistral Small 3 24B Base?

Key differences include LLM Stats Score (29.5 vs -0.3), licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes GPT-5.1 Codex and Mistral Small 3 24B Base?

GPT-5.1 Codex is developed by OpenAI and Mistral Small 3 24B Base is developed by Mistral AI.

Related comparisons