The AI arena is free today

Open Superagent

Gemma 4 12B vs Mercury 3

Mercury 3 leads the LLM Stats Score 36.1 to 21.6.

Google · Inception · Updated for 2026

Which is better?

Mercury 3 leads the overall LLM Stats Score 36.1 to 21.6, ranking #98 overall.

In the 1 individual benchmarks reported for both models, Mercury 3 wins 1; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemma 4 12B

  • you need open weights you can self-host or fine-tune

Choose Mercury 3

  • overall performance matters — it scores 36.1 and ranks #98 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 1 of 1 exact shared results
  • you want the most recent training data — it shipped Oct 2026

At a glance

The differences that matter most.

Core performance indexes
21.6
#205
36.1
#98
22.5
#192
34.8
#103
Cost, coverage & limits
Benchmark wins
0 of 1
1 of 1
Input price
— / M
$0.10 / M
Output price
— / M
$0.35 / M
Context window
—
1,000,000

Individual benchmarks

15 reported for Gemma 4 12B · 12 for Mercury 3

1 shared

Gemma 4 12B outperforms in 0 benchmarks, while Mercury 3 is better at 1 benchmark (GPQA).

Mercury 3 significantly outperforms across most benchmarks.

Tue Oct 27 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

Google
Gemma 4 12B
Input- tokens
Output- tokens
Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Tue Oct 27 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Gemma 4 12B supports multimodal inputs, whereas Mercury 3 does not.

Gemma 4 12B can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemma 4 12B

Text
Images
Audio
Video

Mercury 3

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 4 12B is licensed under Apache 2.0, while Mercury 3 uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 4 12B

Apache 2.0

Open weights

Mercury 3

Proprietary

Closed source

Release Timeline

When each model was launched

Gemma 4 12B was released on 2026-05-23, while Mercury 3 was released on 2026-10-19.

Mercury 3 is 5 months newer than Gemma 4 12B.

Gemma 4 12B

May 23, 2026

5 months ago

Mercury 3

Oct 19, 2026

1 weeks ago

4mo newer

Knowledge Cutoff

When training data ends

Gemma 4 12B has a documented knowledge cutoff of 2025-01-01, while Mercury 3's cutoff date is not specified.

We can confirm Gemma 4 12B's training data extends to 2025-01-01, but cannot make a direct comparison without Mercury 3's cutoff date.

Gemma 4 12B

Jan 2025

Mercury 3

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Gemma 4 12B and Mercury 3 side-by-side, then vote on the output you prefer.

Gemma 4 12B
✓ Preferred
Mercury 3
Open in Playground

FAQ

Common questions about Gemma 4 12B vs Mercury 3.

Which is better, Gemma 4 12B or Mercury 3?

Mercury 3 leads the LLM Stats Score 36.1 to 21.6. Gemma 4 12B is made by Google and Mercury 3 is made by Inception. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Gemma 4 12B compare to Mercury 3 in benchmarks?

Gemma 4 12B scores FLEURS: 93.1%, MMMLU: 83.4%, MathVision: 79.7%, GPQA: 78.8%, AIME 2026: 77.5%. Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%.

What are the context window sizes for Gemma 4 12B and Mercury 3?

Gemma 4 12B supports an unknown number of tokens and Mercury 3 supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 4 12B and Mercury 3?

Key differences include LLM Stats Score (21.6 vs 36.1), multimodal support (yes vs no), licensing (Apache 2.0 vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 4 12B and Mercury 3?

Gemma 4 12B is developed by Google and Mercury 3 is developed by Inception.