Model Comparison

MedGemma 4B IT vs Mistral Small 3 24B Instruct

Comparing MedGemma 4B IT and Mistral Small 3 24B Instruct across benchmarks, pricing, and capabilities.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

No common benchmarks found

MedGemma 4B IT and Mistral Small 3 24B Instruct don't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Arena Performance

Human preference votes

Model Size

Parameter count comparison

19.7B diff

Mistral Small 3 24B Instruct has 19.7B more parameters than MedGemma 4B IT, making it 458.1% larger.

Google
MedGemma 4B IT
4.3Bparameters
Mistral AI
Mistral Small 3 24B Instruct
24.0Bparameters
4.3B
MedGemma 4B IT
24.0B
Mistral Small 3 24B Instruct

Context Window

Maximum input and output token capacity

Only Mistral Small 3 24B Instruct specifies input context (32,000 tokens). Only Mistral Small 3 24B Instruct specifies output context (32,000 tokens).

Google
MedGemma 4B IT
Input- tokens
Output- tokens
Mistral AI
Mistral Small 3 24B Instruct
Input32,000 tokens
Output32,000 tokens
Wed May 06 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

MedGemma 4B IT supports multimodal inputs, whereas Mistral Small 3 24B Instruct does not.

MedGemma 4B IT can handle both text and other forms of data like images, making it suitable for multimodal applications.

MedGemma 4B IT

Text
Images
Audio
Video

Mistral Small 3 24B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

MedGemma 4B IT is licensed under Health AI Developer Foundations terms of use, while Mistral Small 3 24B Instruct uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

MedGemma 4B IT

Health AI Developer Foundations terms of use

Open weights

Mistral Small 3 24B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

MedGemma 4B IT was released on 2025-05-20, while Mistral Small 3 24B Instruct was released on 2025-01-30.

MedGemma 4B IT is 4 months newer than Mistral Small 3 24B Instruct.

MedGemma 4B IT

May 20, 2025

11 months ago

3mo newer
Mistral Small 3 24B Instruct

Jan 30, 2025

1.3 years ago

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Instruct has a documented knowledge cutoff of 2023-10-01, while MedGemma 4B IT's cutoff date is not specified.

We can confirm Mistral Small 3 24B Instruct's training data extends to 2023-10-01, but cannot make a direct comparison without MedGemma 4B IT's cutoff date.

MedGemma 4B IT

—

Mistral Small 3 24B Instruct

Oct 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

Google
Supports multimodal inputs
Mistral AI
Larger context window (32,000 tokens)

Detailed Comparison

AI Model Comparison Table
Feature
Google
MedGemma 4B IT
Mistral AI
Mistral Small 3 24B Instruct

FAQ

Common questions about MedGemma 4B IT vs Mistral Small 3 24B Instruct.

Which is better, MedGemma 4B IT or Mistral Small 3 24B Instruct?

MedGemma 4B IT (Google) and Mistral Small 3 24B Instruct (Mistral AI) each have strengths in different areas. Compare their benchmark scores, pricing, context windows, and capabilities above to determine which fits your needs.

How does MedGemma 4B IT compare to Mistral Small 3 24B Instruct in benchmarks?

MedGemma 4B IT scores MIMIC CXR: 88.9%, DermMCQA: 71.8%, PathMCQA: 69.8%, SlakeVQA: 62.3%, VQA-Rad: 49.9%. Mistral Small 3 24B Instruct scores Arena Hard: 87.6%, HumanEval: 84.8%, MT-Bench: 83.5%, IFEval: 82.9%, MATH: 70.6%.

What are the context window sizes for MedGemma 4B IT and Mistral Small 3 24B Instruct?

MedGemma 4B IT supports an unknown number of tokens and Mistral Small 3 24B Instruct supports 32K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between MedGemma 4B IT and Mistral Small 3 24B Instruct?

Key differences include multimodal support (yes vs no), licensing (Health AI Developer Foundations terms of use vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes MedGemma 4B IT and Mistral Small 3 24B Instruct?

MedGemma 4B IT is developed by Google and Mistral Small 3 24B Instruct is developed by Mistral AI.