The AI arena is free today

Open Superagent

Devstral Medium vs Llama 3.1 405B Instruct

Devstral Medium and Llama 3.1 405B Instruct are closely matched at 13.9 and 14.8 on the LLM Stats Score. Devstral Medium is 1.1x cheaper per token.

Mistral AI · Meta · Updated for 2026

Which is better?

Devstral Medium and Llama 3.1 405B Instruct are closely matched on the overall LLM Stats Score at 13.9 and 14.8.

On price, Devstral Medium is roughly 1.1x cheaper per token on a blended 3:1 input/output basis, which adds up quickly at production volume.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Devstral Medium

  • cost matters — it's about 1.1x cheaper per token
  • you want the most recent training data — it shipped Jul 2025

Choose Llama 3.1 405B Instruct

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Core performance indexes
13.9
#230
14.8
#222
13.8
#224
13.9
#221
5.7
#189
11.6
#149
Cost, coverage & limits
Benchmark wins
Input price
$0.40 / M
$0.89 / M
Output price
$2.00 / M
$0.89 / M
Context window
128,000
128,000

Individual benchmarks

1 reported for Devstral Medium · 18 for Llama 3.1 405B Instruct

No common benchmarks found

Devstral Medium and Llama 3.1 405B Instructdon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Pricing Analysis

Price comparison per million tokens

Devstral Medium costs less

For input processing, Devstral Medium ($0.40/1M tokens) is 2.2x cheaper than Llama 3.1 405B Instruct ($0.89/1M tokens).

For output processing, Devstral Medium ($2.00/1M tokens) is 2.2x more expensive than Llama 3.1 405B Instruct ($0.89/1M tokens).

In conclusion, Llama 3.1 405B Instruct is more expensive than Devstral Medium.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Fri Sep 04 2026 • llm-stats.com
Mistral AI
Devstral Medium
Input tokens$0.40
Output tokens$2.00
Best providerMistral
Meta
Llama 3.1 405B Instruct
Input tokens$0.89
Output tokens$0.89
Best providerLambda
Notice missing or incorrect data?Start an Issue

Context Window

Maximum input and output token capacity

Both models have the same input context window of 128,000 tokens. Both models can generate responses up to 128,000 tokens.

Mistral AI
Devstral Medium
Input128,000 tokens
Output128,000 tokens
Meta
Llama 3.1 405B Instruct
Input128,000 tokens
Output128,000 tokens
Fri Sep 04 2026 • llm-stats.com

License

Usage and distribution terms

Devstral Medium is licensed under a proprietary license, while Llama 3.1 405B Instruct uses Llama 3.1 Community License.

License differences may affect how you can use these models in commercial or open-source projects.

Devstral Medium

Proprietary

Closed source

Llama 3.1 405B Instruct

Llama 3.1 Community License

Open weights

Release Timeline

When each model was launched

Devstral Medium was released on 2025-07-10, while Llama 3.1 405B Instruct was released on 2024-07-23.

Devstral Medium is 12 months newer than Llama 3.1 405B Instruct.

Devstral Medium

Jul 10, 2025

1.2 years ago

11mo newer
Llama 3.1 405B Instruct

Jul 23, 2024

2.1 years ago

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Provider Availability

Devstral Medium is available from Mistral AI. Llama 3.1 405B Instruct is available from Lambda, DeepInfra, Fireworks, Bedrock, Together, Hyperbolic, Google, Replicate.

Devstral Medium

mistral logo
Mistral
Input Price:Input: $0.40/1MOutput Price:Output: $2.00/1M

Llama 3.1 405B Instruct

lambda logo
Lambda
Input Price:Input: $0.89/1MOutput Price:Output: $0.89/1M
deepinfra logo
Deepinfra
Input Price:Input: $1.79/1MOutput Price:Output: $1.79/1M
fireworks logo
Fireworks
Input Price:Input: $3.00/1MOutput Price:Output: $3.00/1M
bedrock logo
AWS Bedrock
Input Price:Input: $3.00/1MOutput Price:Output: $3.00/1M
together logo
Together
Input Price:Input: $3.50/1MOutput Price:Output: $3.50/1M
hyperbolic logo
Hyperbolic
Input Price:Input: $4.00/1MOutput Price:Output: $4.00/1M
google logo
Google
Input Price:Input: $5.00/1MOutput Price:Output: $16.00/1M
replicate logo
Replicate
Input Price:Input: $9.50/1MOutput Price:Output: $9.50/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Devstral Medium and Llama 3.1 405B Instruct side-by-side, then vote on the output you prefer.

Devstral Medium
✓ Preferred
Llama 3.1 405B Instruct
Open in Playground

FAQ

Common questions about Devstral Medium vs Llama 3.1 405B Instruct.

Which is better, Devstral Medium or Llama 3.1 405B Instruct?

Devstral Medium and Llama 3.1 405B Instruct are closely matched on the LLM Stats Score at 13.9 and 14.8. Devstral Medium is made by Mistral AI and Llama 3.1 405B Instruct is made by Meta. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Devstral Medium compare to Llama 3.1 405B Instruct in benchmarks?

Devstral Medium scores SWE-Bench Verified: 61.6%. Llama 3.1 405B Instruct scores ARC-C: 96.9%, GSM8k: 96.8%, API-Bank: 92.0%, Multilingual MGSM (CoT): 91.6%, HumanEval: 89.0%.

Is Devstral Medium cheaper than Llama 3.1 405B Instruct?

Devstral Medium is 2.2x cheaper for input tokens. Devstral Medium costs $0.40/M input and $2.00/M output via mistral. Llama 3.1 405B Instruct costs $0.89/M input and $0.89/M output via lambda.

What are the context window sizes for Devstral Medium and Llama 3.1 405B Instruct?

Devstral Medium supports 128K tokens and Llama 3.1 405B Instruct supports 128K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Devstral Medium and Llama 3.1 405B Instruct?

Key differences include LLM Stats Score (13.9 vs 14.8), input pricing ($0.40 vs $0.89/M), licensing (Proprietary vs Llama 3.1 Community License). See the full comparison above for benchmark-by-benchmark results.

Who makes Devstral Medium and Llama 3.1 405B Instruct?

Devstral Medium is developed by Mistral AI and Llama 3.1 405B Instruct is developed by Meta.