The AI arena is free today

Open Superagent

Grok-4 Heavy vs Mercury 3

Grok-4 Heavy and Mercury 3 are closely matched at 40.6 and 36.1 on the LLM Stats Score.

xAI · Inception · Updated for 2026

Which is better?

Grok-4 Heavy and Mercury 3 are closely matched on the overall LLM Stats Score at 40.6 and 36.1.

In the 1 individual benchmarks reported for both models, Mercury 3 wins 1; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Grok-4 Heavy

  • you are already invested in the xAI ecosystem

Choose Mercury 3

  • you value its reported benchmark strengths — it wins 1 of 1 exact shared results

At a glance

The differences that matter most.

Core performance indexes
40.6
#72
36.1
#98
38.9
#74
34.8
#103
17.5
#136
21.5
#105
Cost, coverage & limits
Benchmark wins
0 of 1
1 of 1
Input price
— / M
$0.10 / M
Output price
— / M
$0.35 / M
Context window
—
1,000,000

Individual benchmarks

6 reported for Grok-4 Heavy · 12 for Mercury 3

1 shared

Grok-4 Heavy outperforms in 0 benchmarks, while Mercury 3 is better at 1 benchmark (GPQA).

Mercury 3 significantly outperforms across most benchmarks.

Fri Oct 23 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

xAI
Grok-4 Heavy
Input- tokens
Output- tokens
Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Fri Oct 23 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Grok-4 Heavy supports multimodal inputs, whereas Mercury 3 does not.

Grok-4 Heavy can handle both text and other forms of data like images, making it suitable for multimodal applications.

Grok-4 Heavy

Text
Images
Audio
Video

Mercury 3

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Grok-4 Heavy

Proprietary

Closed source

Mercury 3

Proprietary

Closed source

Release Timeline

When each model was launched

Mercury 3 was released on 2026-10-19, while Grok-4 Heavy's release date is not specified.

We can confirm Mercury 3's release timeline, but cannot make a direct age comparison without Grok-4 Heavy's release date.

Grok-4 Heavy

—

Mercury 3

Oct 19, 2026

1 days ago

Knowledge Cutoff

When training data ends

Grok-4 Heavy has a documented knowledge cutoff of 2024-12-31, while Mercury 3's cutoff date is not specified.

We can confirm Grok-4 Heavy's training data extends to 2024-12-31, but cannot make a direct comparison without Mercury 3's cutoff date.

Grok-4 Heavy

Dec 2024

Mercury 3

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Grok-4 Heavy and Mercury 3 side-by-side, then vote on the output you prefer.

Grok-4 Heavy
✓ Preferred
Mercury 3
Open in Playground

FAQ

Common questions about Grok-4 Heavy vs Mercury 3.

Which is better, Grok-4 Heavy or Mercury 3?

Grok-4 Heavy and Mercury 3 are closely matched on the LLM Stats Score at 40.6 and 36.1. Grok-4 Heavy is made by xAI and Mercury 3 is made by Inception. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Grok-4 Heavy compare to Mercury 3 in benchmarks?

Grok-4 Heavy scores AIME 2025: 100.0%, HMMT25: 96.7%, GPQA: 88.4%, LiveCodeBench: 79.4%, USAMO25: 61.9%. Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%.

What are the context window sizes for Grok-4 Heavy and Mercury 3?

Grok-4 Heavy supports an unknown number of tokens and Mercury 3 supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-4 Heavy and Mercury 3?

Key differences include LLM Stats Score (40.6 vs 36.1), multimodal support (yes vs no). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-4 Heavy and Mercury 3?

Grok-4 Heavy is developed by xAI and Mercury 3 is developed by Inception.