The AI arena is free today

Open Superagent

Grok-3 vs Grok-4 Heavy

Grok-4 Heavy leads the LLM Stats Score 40.7 to 30.4.

xAI · xAI · Updated for 2026

Which is better?

Grok-4 Heavy leads the overall LLM Stats Score 40.7 to 30.4, ranking #54 overall.

In the 3 individual benchmarks reported for both models, Grok-4 Heavy wins 3; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Grok-3

  • you want predictable pricing at $3.00/M input and $15.00/M output

Choose Grok-4 Heavy

  • overall performance matters — it scores 40.7 and ranks #54 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 3 of 3 exact shared results

At a glance

The differences that matter most.

Core performance indexes
30.4
#117
40.7
#54
30.1
#117
39.0
#57
17.6
#116
17.7
#114
Cost, coverage & limits
Benchmark wins
0 of 3
3 of 3
Input price
$3.00 / M
— / M
Output price
$15.00 / M
— / M
Context window
128,000

Capability indexes

Additional strengths measured across groups of related public benchmarks

1 shared
Index
Grok-3
Grok-4 Heavy
29.3#87
41.5#6
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

5 reported for Grok-3 · 6 for Grok-4 Heavy

3 shared

Grok-3 outperforms in 0 benchmarks, while Grok-4 Heavy is better at 2 benchmarks (AIME 2025, GPQA).

Grok-4 Heavy shows notably better performance in the majority of benchmarks.

Sun Sep 13 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Grok-3 specifies input context (128,000 tokens). Only Grok-3 specifies output context (8,000 tokens).

xAI
Grok-3
Input128,000 tokens
Output8,000 tokens
xAI
Grok-4 Heavy
Input- tokens
Output- tokens
Sun Sep 13 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Grok-3 and Grok-4 Heavy support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Grok-3

Text
Images
Audio
Video

Grok-4 Heavy

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Grok-3

Proprietary

Closed source

Grok-4 Heavy

Proprietary

Closed source

Release Timeline

When each model was launched

Grok-3 was released on 2025-02-17, while Grok-4 Heavy's release date is not specified.

We can confirm Grok-3's release timeline, but cannot make a direct age comparison without Grok-4 Heavy's release date.

Grok-3

Feb 17, 2025

1.6 years ago

Grok-4 Heavy

Knowledge Cutoff

When training data ends

Grok-3 has a knowledge cutoff of 2024-11-17, while Grok-4 Heavy has a cutoff of 2024-12-31.

Grok-4 Heavy has more recent training data (up to 2024-12-31), making it potentially better informed about events through that date compared to Grok-3 (2024-11-17).

Grok-3

Nov 2024

Grok-4 Heavy

Dec 2024

1 mo newer

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Grok-3 and Grok-4 Heavy side-by-side, then vote on the output you prefer.

Grok-3
✓ Preferred
Grok-4 Heavy
Open in Playground

FAQ

Common questions about Grok-3 vs Grok-4 Heavy.

Which is better, Grok-3 or Grok-4 Heavy?

Grok-4 Heavy leads the LLM Stats Score 40.7 to 30.4. Grok-3 is made by xAI and Grok-4 Heavy is made by xAI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Grok-3 compare to Grok-4 Heavy in benchmarks?

Grok-3 scores AIME 2024: 93.3%, AIME 2025: 93.3%, GPQA: 84.6%, LiveCodeBench: 79.4%, MMMU: 78.0%. Grok-4 Heavy scores AIME 2025: 100.0%, HMMT25: 96.7%, GPQA: 88.4%, LiveCodeBench: 79.4%, USAMO25: 61.9%.

What are the context window sizes for Grok-3 and Grok-4 Heavy?

Grok-3 supports 128K tokens and Grok-4 Heavy supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-3 and Grok-4 Heavy?

Key differences include LLM Stats Score (30.4 vs 40.7). See the full comparison above for benchmark-by-benchmark results.