The AI arena is free today

Open Superagent

Gemma 4 E2B vs Mercury 3

Mercury 3 leads the LLM Stats Score 36.1 to 6.3.

Google · Inception · Updated for 2026

Which is better?

Mercury 3 leads the overall LLM Stats Score 36.1 to 6.3, ranking #98 overall.

In the 1 individual benchmarks reported for both models, Mercury 3 wins 1; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemma 4 E2B

  • you need open weights you can self-host or fine-tune

Choose Mercury 3

  • overall performance matters — it scores 36.1 and ranks #98 on LLM Stats
  • your work emphasizes reasoning and agents — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 1 of 1 exact shared results
  • you want the most recent training data — it shipped Oct 2026

At a glance

The differences that matter most.

Core performance indexes
6.3
#317
36.1
#98
5.1
#318
34.8
#103
-3.6
#206
19.4
#84
Cost, coverage & limits
Benchmark wins
0 of 1
1 of 1
Input price
— / M
$0.10 / M
Output price
— / M
$0.35 / M
Context window
—
1,000,000

Individual benchmarks

11 reported for Gemma 4 E2B · 12 for Mercury 3

1 shared

Gemma 4 E2B outperforms in 0 benchmarks, while Mercury 3 is better at 1 benchmark (GPQA).

Mercury 3 significantly outperforms across most benchmarks.

Sat Oct 24 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

Google
Gemma 4 E2B
Input- tokens
Output- tokens
Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Sat Oct 24 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Gemma 4 E2B supports multimodal inputs, whereas Mercury 3 does not.

Gemma 4 E2B can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemma 4 E2B

Text
Images
Audio
Video

Mercury 3

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 4 E2B is licensed under Apache 2.0, while Mercury 3 uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 4 E2B

Apache 2.0

Open weights

Mercury 3

Proprietary

Closed source

Release Timeline

When each model was launched

Gemma 4 E2B was released on 2026-04-02, while Mercury 3 was released on 2026-10-19.

Mercury 3 is 7 months newer than Gemma 4 E2B.

Gemma 4 E2B

Apr 2, 2026

6 months ago

Mercury 3

Oct 19, 2026

1 days ago

6mo newer

Knowledge Cutoff

When training data ends

Gemma 4 E2B has a documented knowledge cutoff of 2025-01-01, while Mercury 3's cutoff date is not specified.

We can confirm Gemma 4 E2B's training data extends to 2025-01-01, but cannot make a direct comparison without Mercury 3's cutoff date.

Gemma 4 E2B

Jan 2025

Mercury 3

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Gemma 4 E2B and Mercury 3 side-by-side, then vote on the output you prefer.

Gemma 4 E2B
✓ Preferred
Mercury 3
Open in Playground

FAQ

Common questions about Gemma 4 E2B vs Mercury 3.

Which is better, Gemma 4 E2B or Mercury 3?

Mercury 3 leads the LLM Stats Score 36.1 to 6.3. Gemma 4 E2B is made by Google and Mercury 3 is made by Inception. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Gemma 4 E2B compare to Mercury 3 in benchmarks?

Gemma 4 E2B scores MMMLU: 67.4%, MMLU-Pro: 60.0%, MathVision: 52.4%, MMMU-Pro: 44.2%, LiveCodeBench v6: 44.0%. Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%.

What are the context window sizes for Gemma 4 E2B and Mercury 3?

Gemma 4 E2B supports an unknown number of tokens and Mercury 3 supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 4 E2B and Mercury 3?

Key differences include LLM Stats Score (6.3 vs 36.1), multimodal support (yes vs no), licensing (Apache 2.0 vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 4 E2B and Mercury 3?

Gemma 4 E2B is developed by Google and Mercury 3 is developed by Inception.