The AI arena is free today

Open Superagent

Gemini 4 Hydrogen vs Mistral Small 3 24B Base

Gemini 4 Hydrogen leads the LLM Stats Score 48.8 to -0.8.

Google · Mistral AI · Updated for 2026

Which is better?

Gemini 4 Hydrogen leads the overall LLM Stats Score 48.8 to -0.8, ranking #29 overall.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemini 4 Hydrogen

  • overall performance matters — it scores 48.8 and ranks #29 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you want the most recent training data — it shipped Nov 2026

Choose Mistral Small 3 24B Base

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Core performance indexes
48.8
#29
-0.8
#378
47.2
#30
-0.9
#371
Cost, coverage & limits
Benchmark wins
—
—
Input price
$1.50 / M
— / M
Output price
$7.50 / M
— / M
Context window
1,048,576
—

Individual benchmarks

5 reported for Gemini 4 Hydrogen · 9 for Mistral Small 3 24B Base

No common benchmarks found

Gemini 4 Hydrogen and Mistral Small 3 24B Basedon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Gemini 4 Hydrogen specifies input context (1,048,576 tokens). Only Gemini 4 Hydrogen specifies output context (1,048,576 tokens).

Google
Gemini 4 Hydrogen
Input1,048,576 tokens
Output1,048,576 tokens
Mistral AI
Mistral Small 3 24B Base
Input- tokens
Output- tokens
Tue Nov 17 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Gemini 4 Hydrogen and Mistral Small 3 24B Base support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemini 4 Hydrogen

Text
Images
Audio
Video

Mistral Small 3 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

Gemini 4 Hydrogen is licensed under a proprietary license, while Mistral Small 3 24B Base uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Gemini 4 Hydrogen

Proprietary

Closed source

Mistral Small 3 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

Gemini 4 Hydrogen was released on 2026-11-12, while Mistral Small 3 24B Base was released on 2025-01-30.

Gemini 4 Hydrogen is 22 months newer than Mistral Small 3 24B Base.

Gemini 4 Hydrogen

Nov 12, 2026

4 days ago

1.8yr newer
Mistral Small 3 24B Base

Jan 30, 2025

1.8 years ago

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Base has a documented knowledge cutoff of 2023-10-01, while Gemini 4 Hydrogen's cutoff date is not specified.

We can confirm Mistral Small 3 24B Base's training data extends to 2023-10-01, but cannot make a direct comparison without Gemini 4 Hydrogen's cutoff date.

Gemini 4 Hydrogen

—

Mistral Small 3 24B Base

Oct 2023

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Gemini 4 Hydrogen and Mistral Small 3 24B Base side-by-side, then vote on the output you prefer.

Gemini 4 Hydrogen
✓ Preferred
Mistral Small 3 24B Base
Open in Playground

FAQ

Common questions about Gemini 4 Hydrogen vs Mistral Small 3 24B Base.

Which is better, Gemini 4 Hydrogen or Mistral Small 3 24B Base?

Gemini 4 Hydrogen leads the LLM Stats Score 48.8 to -0.8. Gemini 4 Hydrogen is made by Google and Mistral Small 3 24B Base is made by Mistral AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Gemini 4 Hydrogen compare to Mistral Small 3 24B Base in benchmarks?

Gemini 4 Hydrogen scores Vending-Bench 2: 100.0%, OSWorld 2.1 (partial): 77.6%, Agents' Last Exam: 71.6%, Chartography (no tools): 66.6%, Terminal-Bench-Science 0.1: 51.4%. Mistral Small 3 24B Base scores ARC-C: 91.3%, GSM8k: 80.7%, MMLU: 80.7%, TriviaQA: 80.3%, MBPP: 69.6%.

What are the context window sizes for Gemini 4 Hydrogen and Mistral Small 3 24B Base?

Gemini 4 Hydrogen supports 1.0M tokens and Mistral Small 3 24B Base supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemini 4 Hydrogen and Mistral Small 3 24B Base?

Key differences include LLM Stats Score (48.8 vs -0.8), licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemini 4 Hydrogen and Mistral Small 3 24B Base?

Gemini 4 Hydrogen is developed by Google and Mistral Small 3 24B Base is developed by Mistral AI.