The AI arena is free today

Open Superagent

Gemma 3 4B vs MedGemma 4B IT

Gemma 3 4B and MedGemma 4B IT are closely matched at -1.9 and -4.5 on the LLM Stats Score.

Google · Google · Updated for 2026

Which is better?

Gemma 3 4B and MedGemma 4B IT are closely matched on the overall LLM Stats Score at -1.9 and -4.5.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemma 3 4B

  • you want predictable pricing at $0.02/M input and $0.04/M output

Choose MedGemma 4B IT

  • you want the most recent training data — it shipped May 2025

At a glance

The differences that matter most.

Gemma 3 4B
Google
MedGemma 4B IT
Google
Core performance indexes
LLM Stats Score
-1.9
#345
-4.5
#357
Reasoning
-2.9
#342
-5.0
#354
Cost, coverage & limits
Benchmark wins
—
—
Input price
$0.02 / M
— / M
Output price
$0.04 / M
— / M
Context window
131,072
—

Capability indexes

Additional strengths measured across groups of related public benchmarks

2 shared
Index
Gemma 3 4B
MedGemma 4B IT
Vision
-11.8#214
-6.8#209
Multimodal
-9.5#174
-5.4#170
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

26 reported for Gemma 3 4B · 7 for MedGemma 4B IT

No common benchmarks found

Gemma 3 4B and MedGemma 4B ITdon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Model Size

Parameter count comparison

300.0M diff

MedGemma 4B IT has 0.3B more parameters than Gemma 3 4B, making it 7.5% larger.

Google
Gemma 3 4B
4.0Bparameters
Google
MedGemma 4B IT
4.3Bparameters
4.0B
Gemma 3 4B
4.3B
MedGemma 4B IT

Context Window

Maximum input and output token capacity

Only Gemma 3 4B specifies input context (131,072 tokens). Only Gemma 3 4B specifies output context (131,072 tokens).

Google
Gemma 3 4B
Input131,072 tokens
Output131,072 tokens
Google
MedGemma 4B IT
Input- tokens
Output- tokens
Tue Oct 06 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Gemma 3 4B and MedGemma 4B IT support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemma 3 4B

Text
Images
Audio
Video

MedGemma 4B IT

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 3 4B is licensed under Gemma, while MedGemma 4B IT uses Health AI Developer Foundations terms of use.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 3 4B

Gemma

Open weights

MedGemma 4B IT

Health AI Developer Foundations terms of use

Open weights

Release Timeline

When each model was launched

Gemma 3 4B was released on 2025-03-12, while MedGemma 4B IT was released on 2025-05-20.

MedGemma 4B IT is 2 months newer than Gemma 3 4B.

Gemma 3 4B

Mar 12, 2025

1.6 years ago

MedGemma 4B IT

May 20, 2025

1.4 years ago

2mo newer

Knowledge Cutoff

When training data ends

Gemma 3 4B has a documented knowledge cutoff of 2024-08-01, while MedGemma 4B IT's cutoff date is not specified.

We can confirm Gemma 3 4B's training data extends to 2024-08-01, but cannot make a direct comparison without MedGemma 4B IT's cutoff date.

Gemma 3 4B

Aug 2024

MedGemma 4B IT

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Gemma 3 4B and MedGemma 4B IT side-by-side, then vote on the output you prefer.

Gemma 3 4B
✓ Preferred
MedGemma 4B IT
Open in Playground

FAQ

Common questions about Gemma 3 4B vs MedGemma 4B IT.

Which is better, Gemma 3 4B or MedGemma 4B IT?

Gemma 3 4B and MedGemma 4B IT are closely matched on the LLM Stats Score at -1.9 and -4.5. Gemma 3 4B is made by Google and MedGemma 4B IT is made by Google. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Gemma 3 4B compare to MedGemma 4B IT in benchmarks?

Gemma 3 4B scores IFEval: 90.2%, GSM8k: 89.2%, DocVQA: 75.8%, MATH: 75.6%, AI2D: 74.8%. MedGemma 4B IT scores MIMIC CXR: 88.9%, DermMCQA: 71.8%, PathMCQA: 69.8%, SlakeVQA: 62.3%, VQA-Rad: 49.9%.

What are the context window sizes for Gemma 3 4B and MedGemma 4B IT?

Gemma 3 4B supports 131K tokens and MedGemma 4B IT supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 3 4B and MedGemma 4B IT?

Key differences include LLM Stats Score (-1.9 vs -4.5), licensing (Gemma vs Health AI Developer Foundations terms of use). See the full comparison above for benchmark-by-benchmark results.

Related comparisons