The AI arena is free today

Open Superagent

GPT-4.1 vs Grok-1.5

GPT-4.1 leads the LLM Stats Score 18.0 to -2.6.

OpenAI · xAI · Updated for 2026

Which is better?

GPT-4.1 leads the overall LLM Stats Score 18.0 to -2.6, ranking #214 overall.

In the 4 individual benchmarks reported for both models, GPT-4.1 wins 4; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose GPT-4.1

  • overall performance matters — it scores 18.0 and ranks #214 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 4 of 4 exact shared results
  • you want the most recent training data — it shipped Apr 2025

Choose Grok-1.5

  • you are already invested in the xAI ecosystem

At a glance

The differences that matter most.

Core performance indexes
18.0
#214
-2.6
#339
18.4
#206
-2.2
#329
5.0
#203
-0.9
#245
Cost, coverage & limits
Benchmark wins
4 of 4
0 of 4
Input price
$2.00 / M
— / M
Output price
$8.00 / M
— / M
Context window
1,047,576

Capability indexes

Additional strengths measured across groups of related public benchmarks

3 shared
Index
GPT-4.1
Grok-1.5
16.3#207
4.9#276
9.2#128
-5.2#201
15.1#89
-2.6#160
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

29 reported for GPT-4.1 · 9 for Grok-1.5

4 shared

GPT-4.1 outperforms in 4 benchmarks (GPQA, MathVista, MMLU, MMMU), while Grok-1.5 is better at 0 benchmarks.

GPT-4.1 significantly outperforms across most benchmarks.

Mon Sep 14 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only GPT-4.1 specifies input context (1,047,576 tokens). Only GPT-4.1 specifies output context (32,768 tokens).

OpenAI
GPT-4.1
Input1,047,576 tokens
Output32,768 tokens
xAI
Grok-1.5
Input- tokens
Output- tokens
Mon Sep 14 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

GPT-4.1 supports multimodal inputs, whereas Grok-1.5 does not.

GPT-4.1 can handle both text and other forms of data like images, making it suitable for multimodal applications.

GPT-4.1

Text
Images
Audio
Video

Grok-1.5

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

GPT-4.1

Proprietary

Closed source

Grok-1.5

Proprietary

Closed source

Release Timeline

When each model was launched

GPT-4.1 was released on 2025-04-14, while Grok-1.5 was released on 2024-03-28.

GPT-4.1 is 13 months newer than Grok-1.5.

GPT-4.1

Apr 14, 2025

1.4 years ago

1.0yr newer
Grok-1.5

Mar 28, 2024

2.5 years ago

Knowledge Cutoff

When training data ends

GPT-4.1 has a documented knowledge cutoff of 2024-06-01, while Grok-1.5's cutoff date is not specified.

We can confirm GPT-4.1's training data extends to 2024-06-01, but cannot make a direct comparison without Grok-1.5's cutoff date.

GPT-4.1

Jun 2024

Grok-1.5

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against GPT-4.1 and Grok-1.5 side-by-side, then vote on the output you prefer.

GPT-4.1
✓ Preferred
Grok-1.5
Open in Playground

FAQ

Common questions about GPT-4.1 vs Grok-1.5.

Which is better, GPT-4.1 or Grok-1.5?

GPT-4.1 leads the LLM Stats Score 18.0 to -2.6. GPT-4.1 is made by OpenAI and Grok-1.5 is made by xAI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does GPT-4.1 compare to Grok-1.5 in benchmarks?

GPT-4.1 scores MMLU: 90.2%, CharXiv-D: 87.9%, IFEval: 87.4%, MMMLU: 87.3%, MMMU: 74.8%. Grok-1.5 scores GSM8k: 90.0%, DocVQA: 85.6%, MMLU: 81.3%, HumanEval: 74.1%, MMMU: 53.6%.

What are the context window sizes for GPT-4.1 and Grok-1.5?

GPT-4.1 supports 1.0M tokens and Grok-1.5 supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between GPT-4.1 and Grok-1.5?

Key differences include LLM Stats Score (18.0 vs -2.6), multimodal support (yes vs no). See the full comparison above for benchmark-by-benchmark results.

Who makes GPT-4.1 and Grok-1.5?

GPT-4.1 is developed by OpenAI and Grok-1.5 is developed by xAI.