The AI arena is free today

Open Superagent

Hermes 3 405B vs Mistral Small 3 24B Base

Hermes 3 405B and Mistral Small 3 24B Base are closely matched at 4.3 and -0.3 on the LLM Stats Score.

Nous Research · Mistral AI · Updated for 2026

Which is better?

Hermes 3 405B and Mistral Small 3 24B Base are closely matched on the overall LLM Stats Score at 4.3 and -0.3.

In the 4 individual benchmarks reported for both models, Mistral Small 3 24B Base wins 3; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Hermes 3 405B

  • you want predictable pricing at $1.00/M input and $1.00/M output

Choose Mistral Small 3 24B Base

  • you value its reported benchmark strengths — it wins 3 of 4 exact shared results
  • you want the most recent training data — it shipped Jan 2025

At a glance

The differences that matter most.

Hermes 3 405B
Nous Research
Mistral Small 3 24B Base
Mistral AI
Core performance indexes
LLM Stats Score
4.3
#300
-0.3
#326
Reasoning
3.7
#298
-0.3
#320
Cost, coverage & limits
Benchmark wins
1 of 4
3 of 4
Input price
$1.00 / M
— / M
Output price
$1.00 / M
— / M
Context window
131,072
—

Capability indexes

Additional strengths measured across groups of related public benchmarks

3 shared
Index
Hermes 3 405B
Mistral Small 3 24B Base
Math
6.7#268
4.5#280
Finance
7.5#158
4.9#172
Legal
8.7#137
8.4#139
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

13 reported for Hermes 3 405B · 9 for Mistral Small 3 24B Base

4 shared

Hermes 3 405B outperforms in 1 benchmarks (MMLU), while Mistral Small 3 24B Base is better at 3 benchmarks (AGIEval, ARC-C, MMLU-Pro).

Mistral Small 3 24B Base shows notably better performance in the majority of benchmarks.

Sat Sep 12 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Model Size

Parameter count comparison

381.4B diff

Hermes 3 405B has 381.4B more parameters than Mistral Small 3 24B Base, making it 1616.1% larger.

Nous Research
Hermes 3 405B
405.0Bparameters
Mistral AI
Mistral Small 3 24B Base
23.6Bparameters
405.0B
Hermes 3 405B
23.6B
Mistral Small 3 24B Base

Context Window

Maximum input and output token capacity

Only Hermes 3 405B specifies input context (131,072 tokens). Only Hermes 3 405B specifies output context (131,072 tokens).

Nous Research
Hermes 3 405B
Input131,072 tokens
Output131,072 tokens
Mistral AI
Mistral Small 3 24B Base
Input- tokens
Output- tokens
Sat Sep 12 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Mistral Small 3 24B Base supports multimodal inputs, whereas Hermes 3 405B does not.

Mistral Small 3 24B Base can handle both text and other forms of data like images, making it suitable for multimodal applications.

Hermes 3 405B

Text
Images
Audio
Video

Mistral Small 3 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under Apache 2.0.

Both models share the same licensing terms, providing consistent usage rights.

Hermes 3 405B

Apache 2.0

Open weights

Mistral Small 3 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

Hermes 3 405B was released on 2024-10-09, while Mistral Small 3 24B Base was released on 2025-01-30.

Mistral Small 3 24B Base is 4 months newer than Hermes 3 405B.

Hermes 3 405B

Oct 9, 2024

1.9 years ago

Mistral Small 3 24B Base

Jan 30, 2025

1.6 years ago

3mo newer

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Base has a documented knowledge cutoff of 2023-10-01, while Hermes 3 405B's cutoff date is not specified.

We can confirm Mistral Small 3 24B Base's training data extends to 2023-10-01, but cannot make a direct comparison without Hermes 3 405B's cutoff date.

Hermes 3 405B

—

Mistral Small 3 24B Base

Oct 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Hermes 3 405B and Mistral Small 3 24B Base side-by-side, then vote on the output you prefer.

Hermes 3 405B
✓ Preferred
Mistral Small 3 24B Base
Open in Playground

FAQ

Common questions about Hermes 3 405B vs Mistral Small 3 24B Base.

Which is better, Hermes 3 405B or Mistral Small 3 24B Base?

Hermes 3 405B and Mistral Small 3 24B Base are closely matched on the LLM Stats Score at 4.3 and -0.3. Hermes 3 405B is made by Nous Research and Mistral Small 3 24B Base is made by Mistral AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Hermes 3 405B compare to Mistral Small 3 24B Base in benchmarks?

Hermes 3 405B scores HellaSwag: 90.2%, MT-Bench: 89.3%, BoolQ: 88.9%, Winogrande: 86.3%, ARC-E: 86.2%. Mistral Small 3 24B Base scores ARC-C: 91.3%, GSM8k: 80.7%, MMLU: 80.7%, TriviaQA: 80.3%, MBPP: 69.6%.

What are the context window sizes for Hermes 3 405B and Mistral Small 3 24B Base?

Hermes 3 405B supports 131K tokens and Mistral Small 3 24B Base supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Hermes 3 405B and Mistral Small 3 24B Base?

Key differences include LLM Stats Score (4.3 vs -0.3), multimodal support (no vs yes). See the full comparison above for benchmark-by-benchmark results.

Who makes Hermes 3 405B and Mistral Small 3 24B Base?

Hermes 3 405B is developed by Nous Research and Mistral Small 3 24B Base is developed by Mistral AI.

Related comparisons