The AI arena is free today

Open Superagent

MedGemma 4B IT vs Mercury 3

Mercury 3 leads the LLM Stats Score 36.1 to -4.8.

Google · Inception · Updated for 2026

Which is better?

Mercury 3 leads the overall LLM Stats Score 36.1 to -4.8, ranking #98 overall.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose MedGemma 4B IT

  • you need open weights you can self-host or fine-tune

Choose Mercury 3

  • overall performance matters — it scores 36.1 and ranks #98 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you want the most recent training data — it shipped Oct 2026

At a glance

The differences that matter most.

MedGemma 4B IT
Google
Mercury 3
Inception
Core performance indexes
LLM Stats Score
-4.8
#374
36.1
#98
Reasoning
-5.2
#371
34.8
#103
Cost, coverage & limits
Benchmark wins
—
—
Input price
— / M
$0.10 / M
Output price
— / M
$0.35 / M
Context window
—
1,000,000

Individual benchmarks

7 reported for MedGemma 4B IT · 12 for Mercury 3

No common benchmarks found

MedGemma 4B IT and Mercury 3don't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

Google
MedGemma 4B IT
Input- tokens
Output- tokens
Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Fri Oct 23 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

MedGemma 4B IT supports multimodal inputs, whereas Mercury 3 does not.

MedGemma 4B IT can handle both text and other forms of data like images, making it suitable for multimodal applications.

MedGemma 4B IT

Text
Images
Audio
Video

Mercury 3

Text
Images
Audio
Video

License

Usage and distribution terms

MedGemma 4B IT is licensed under Health AI Developer Foundations terms of use, while Mercury 3 uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

MedGemma 4B IT

Health AI Developer Foundations terms of use

Open weights

Mercury 3

Proprietary

Closed source

Release Timeline

When each model was launched

MedGemma 4B IT was released on 2025-05-20, while Mercury 3 was released on 2026-10-19.

Mercury 3 is 17 months newer than MedGemma 4B IT.

MedGemma 4B IT

May 20, 2025

1.4 years ago

Mercury 3

Oct 19, 2026

0 days ago

1.4yr newer

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against MedGemma 4B IT and Mercury 3 side-by-side, then vote on the output you prefer.

MedGemma 4B IT
✓ Preferred
Mercury 3
Open in Playground

FAQ

Common questions about MedGemma 4B IT vs Mercury 3.

Which is better, MedGemma 4B IT or Mercury 3?

Mercury 3 leads the LLM Stats Score 36.1 to -4.8. MedGemma 4B IT is made by Google and Mercury 3 is made by Inception. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does MedGemma 4B IT compare to Mercury 3 in benchmarks?

MedGemma 4B IT scores MIMIC CXR: 88.9%, DermMCQA: 71.8%, PathMCQA: 69.8%, SlakeVQA: 62.3%, VQA-Rad: 49.9%. Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%.

What are the context window sizes for MedGemma 4B IT and Mercury 3?

MedGemma 4B IT supports an unknown number of tokens and Mercury 3 supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between MedGemma 4B IT and Mercury 3?

Key differences include LLM Stats Score (-4.8 vs 36.1), multimodal support (yes vs no), licensing (Health AI Developer Foundations terms of use vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes MedGemma 4B IT and Mercury 3?

MedGemma 4B IT is developed by Google and Mercury 3 is developed by Inception.

Related comparisons