Model Comparison

Devstral Medium vs Mistral Small 3 24B Base

Comparing Devstral Medium and Mistral Small 3 24B Base across benchmarks, pricing, and capabilities.

Performance Benchmarks

Comparative analysis across standard metrics

No common benchmarks found

Devstral Medium and Mistral Small 3 24B Base don't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Arena Performance

Human preference votes

Context Window

Maximum input and output token capacity

Only Devstral Medium specifies input context (128,000 tokens). Only Devstral Medium specifies output context (128,000 tokens).

Mistral AI
Devstral Medium
Input128,000 tokens
Output128,000 tokens
Mistral AI
Mistral Small 3 24B Base
Input- tokens
Output- tokens
Fri May 29 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Mistral Small 3 24B Base supports multimodal inputs, whereas Devstral Medium does not.

Mistral Small 3 24B Base can handle both text and other forms of data like images, making it suitable for multimodal applications.

Devstral Medium

Text
Images
Audio
Video

Mistral Small 3 24B Base

Text
Images
Audio
Video

License

Usage and distribution terms

Devstral Medium is licensed under a proprietary license, while Mistral Small 3 24B Base uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

Devstral Medium

Proprietary

Closed source

Mistral Small 3 24B Base

Apache 2.0

Open weights

Release Timeline

When each model was launched

Devstral Medium was released on 2025-07-10, while Mistral Small 3 24B Base was released on 2025-01-30.

Devstral Medium is 5 months newer than Mistral Small 3 24B Base.

Devstral Medium

Jul 10, 2025

10 months ago

5mo newer
Mistral Small 3 24B Base

Jan 30, 2025

1.3 years ago

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Base has a documented knowledge cutoff of 2023-10-01, while Devstral Medium's cutoff date is not specified.

We can confirm Mistral Small 3 24B Base's training data extends to 2023-10-01, but cannot make a direct comparison without Devstral Medium's cutoff date.

Devstral Medium

Mistral Small 3 24B Base

Oct 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Key Takeaways

Larger context window (128,000 tokens)
Supports multimodal inputs
Has open weights

Detailed Comparison

AI Model Comparison Table
Feature
Mistral AI
Devstral Medium
Mistral AI
Mistral Small 3 24B Base

FAQ

Common questions about Devstral Medium vs Mistral Small 3 24B Base.

Which is better, Devstral Medium or Mistral Small 3 24B Base?

Devstral Medium (Mistral AI) and Mistral Small 3 24B Base (Mistral AI) each have strengths in different areas. Compare their benchmark scores, pricing, context windows, and capabilities above to determine which fits your needs.

How does Devstral Medium compare to Mistral Small 3 24B Base in benchmarks?

Devstral Medium scores SWE-Bench Verified: 61.6%. Mistral Small 3 24B Base scores ARC-C: 91.3%, GSM8k: 80.7%, MMLU: 80.7%, TriviaQA: 80.3%, MBPP: 69.6%.

What are the context window sizes for Devstral Medium and Mistral Small 3 24B Base?

Devstral Medium supports 128K tokens and Mistral Small 3 24B Base supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Devstral Medium and Mistral Small 3 24B Base?

Key differences include multimodal support (no vs yes), licensing (Proprietary vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.