The AI arena is free today

Open Superagent

Hermes 3 405B vs Mistral Small 3.1 24B Base

Hermes 3 405B and Mistral Small 3.1 24B Base are closely matched at 4.3 and 0.3 on the LLM Stats Score. Mistral Small 3.1 24B Base is 6.7x cheaper per token.

Nous Research · Mistral AI · Updated for 2026

Which is better?

Hermes 3 405B and Mistral Small 3.1 24B Base are closely matched on the overall LLM Stats Score at 4.3 and 0.3.

The models split the 2 individual benchmarks reported for both models evenly.

On price, Mistral Small 3.1 24B Base is roughly 6.7x cheaper per token on a blended 3:1 input/output basis, which adds up quickly at production volume.

Hermes 3 405B also accepts a larger context window (131,072 input tokens), making it the stronger choice for long documents and large codebases.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Hermes 3 405B

  • you process long inputs — it offers a 131,072 token context window

Choose Mistral Small 3.1 24B Base

  • cost matters — it's about 6.7x cheaper per token
  • you want the most recent training data — it shipped Mar 2025

At a glance

The differences that matter most.

Hermes 3 405B
Nous Research
Mistral Small 3.1 24B Base
Mistral AI
Core performance indexes
LLM Stats Score
4.3
#300
0.3
#324
Reasoning
3.7
#298
0.5
#315
Cost, coverage & limits
Benchmark wins
1 of 2
1 of 2
Input price
$1.00 / M
$0.10 / M
Output price
$1.00 / M
$0.30 / M
Context window
131,072
128,000

Capability indexes

Additional strengths measured across groups of related public benchmarks

3 shared
Index
Hermes 3 405B
Mistral Small 3.1 24B Base
Math
6.7#268
4.7#279
Finance
7.5#158
5.3#168
Legal
8.7#137
5.3#154
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

13 reported for Hermes 3 405B · 5 for Mistral Small 3.1 24B Base

2 shared

Hermes 3 405B outperforms in 1 benchmarks (MMLU), while Mistral Small 3.1 24B Base is better at 1 benchmark (MMLU-Pro).

Both models are evenly matched across the benchmarks.

Mon Sep 14 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Pricing Analysis

Price comparison per million tokens

Mistral Small 3.1 24B Base costs less

For input processing, Hermes 3 405B ($1.00/1M tokens) is 10.0x more expensive than Mistral Small 3.1 24B Base ($0.10/1M tokens).

For output processing, Hermes 3 405B ($1.00/1M tokens) is 3.3x more expensive than Mistral Small 3.1 24B Base ($0.30/1M tokens).

In conclusion, Hermes 3 405B is more expensive than Mistral Small 3.1 24B Base.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Mon Sep 14 2026 • llm-stats.com
Nous Research
Hermes 3 405B
Input tokens$1.00
Output tokens$1.00
Best providerDeepinfra
Mistral AI
Mistral Small 3.1 24B Base
Input tokens$0.10
Output tokens$0.30
Best providerMistral
Notice missing or incorrect data?Start an Issue→

Model Size

Parameter count comparison

381.0B diff

Hermes 3 405B has 381.0B more parameters than Mistral Small 3.1 24B Base, making it 1587.5% larger.

Nous Research
Hermes 3 405B
405.0Bparameters
Mistral AI
Mistral Small 3.1 24B Base
24.0Bparameters
405.0B
Hermes 3 405B
24.0B
Mistral Small 3.1 24B Base

Context Window

Maximum input and output token capacity

Hermes 3 405B accepts 131,072 input tokens compared to Mistral Small 3.1 24B Base's 128,000 tokens. Hermes 3 405B can generate longer responses up to 131,072 tokens, while Mistral Small 3.1 24B Base is limited to 128,000 tokens.

Nous Research
Hermes 3 405B
Input131,072 tokens
Output131,072 tokens
Mistral AI
Mistral Small 3.1 24B Base
Input128,000 tokens
Output128,000 tokens
Mon Sep 14 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Mistral Small 3.1 24B Base supports multimodal inputs, whereas Hermes 3 405B does not.

Mistral Small 3.1 24B Base can handle both text and other forms of data like images, making it suitable for multimodal applications.

Hermes 3 405B

Text
Images
Audio
Video

Mistral Small 3.1 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under Apache 2.0.

Both models share the same licensing terms, providing consistent usage rights.

Hermes 3 405B

Apache 2.0

Open weights

Mistral Small 3.1 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

Hermes 3 405B was released on 2024-10-09, while Mistral Small 3.1 24B Base was released on 2025-03-17.

Mistral Small 3.1 24B Base is 5 months newer than Hermes 3 405B.

Hermes 3 405B

Oct 9, 2024

1.9 years ago

Mistral Small 3.1 24B Base

Mar 17, 2025

1.5 years ago

5mo newer

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Provider Availability

Hermes 3 405B is available from DeepInfra. Mistral Small 3.1 24B Base is available from Mistral AI.

Hermes 3 405B

deepinfra logo
Deepinfra
Input Price:Input: $1.00/1MOutput Price:Output: $1.00/1M

Mistral Small 3.1 24B Base

mistral logo
Mistral
Input Price:Input: $0.10/1MOutput Price:Output: $0.30/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Hermes 3 405B and Mistral Small 3.1 24B Base side-by-side, then vote on the output you prefer.

Hermes 3 405B
✓ Preferred
Mistral Small 3.1 24B Base
Open in Playground

FAQ

Common questions about Hermes 3 405B vs Mistral Small 3.1 24B Base.

Which is better, Hermes 3 405B or Mistral Small 3.1 24B Base?

Hermes 3 405B and Mistral Small 3.1 24B Base are closely matched on the LLM Stats Score at 4.3 and 0.3. Hermes 3 405B is made by Nous Research and Mistral Small 3.1 24B Base is made by Mistral AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Hermes 3 405B compare to Mistral Small 3.1 24B Base in benchmarks?

Hermes 3 405B scores HellaSwag: 90.2%, MT-Bench: 89.3%, BoolQ: 88.9%, Winogrande: 86.3%, ARC-E: 86.2%. Mistral Small 3.1 24B Base scores MMLU: 81.0%, TriviaQA: 80.5%, MMMU: 59.3%, MMLU-Pro: 56.0%, GPQA: 37.5%.

Is Hermes 3 405B cheaper than Mistral Small 3.1 24B Base?

Mistral Small 3.1 24B Base is 10.0x cheaper for input tokens. Hermes 3 405B costs $1.00/M input and $1.00/M output via deepinfra. Mistral Small 3.1 24B Base costs $0.10/M input and $0.30/M output via mistral.

What are the context window sizes for Hermes 3 405B and Mistral Small 3.1 24B Base?

Hermes 3 405B supports 131K tokens and Mistral Small 3.1 24B Base supports 128K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Hermes 3 405B and Mistral Small 3.1 24B Base?

Key differences include LLM Stats Score (4.3 vs 0.3), context window (131K vs 128K), input pricing ($1.00 vs $0.10/M), multimodal support (no vs yes). See the full comparison above for benchmark-by-benchmark results.

Who makes Hermes 3 405B and Mistral Small 3.1 24B Base?

Hermes 3 405B is developed by Nous Research and Mistral Small 3.1 24B Base is developed by Mistral AI.

Related comparisons