Model Comparison

Grok-1.5 vs Gemini 1.5 Pro

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

8 benchmarks

Grok-1.5 outperforms in 0 benchmarks, while Gemini 1.5 Pro is better at 8 benchmarks (GPQA, GSM8k, HumanEval, MATH, MathVista, MMLU, MMLU-Pro, MMMU).

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Wed May 13 2026 • llm-stats.com

Arena Performance

Human preference votes

Context Window

Maximum input and output token capacity

Only Gemini 1.5 Pro specifies input context (2,097,152 tokens). Only Gemini 1.5 Pro specifies output context (8,192 tokens).

xAI
Grok-1.5
Input- tokens
Output- tokens
Google
Gemini 1.5 Pro
Input2,097,152 tokens
Output8,192 tokens
Wed May 13 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Gemini 1.5 Pro supports multimodal inputs, whereas Grok-1.5 does not.

Gemini 1.5 Pro can handle both text and other forms of data like images, making it suitable for multimodal applications.

Grok-1.5

Text
Images
Audio
Video

Gemini 1.5 Pro

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Grok-1.5

Proprietary

Closed source

Gemini 1.5 Pro

Proprietary

Closed source

Release Timeline

When each model was launched

Grok-1.5 was released on 2024-03-28, while Gemini 1.5 Pro was released on 2024-05-01.

Gemini 1.5 Pro is 1 month newer than Grok-1.5.

Grok-1.5

Mar 28, 2024

2.1 years ago

Gemini 1.5 Pro

May 1, 2024

2.0 years ago

1mo newer

Knowledge Cutoff

When training data ends

Gemini 1.5 Pro has a documented knowledge cutoff of 2023-11-01, while Grok-1.5's cutoff date is not specified.

We can confirm Gemini 1.5 Pro's training data extends to 2023-11-01, but cannot make a direct comparison without Grok-1.5's cutoff date.

Grok-1.5

—

Gemini 1.5 Pro

Nov 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

xAI

No standout differentiators in the data we have for this pair.

Google
Larger context window (2,097,152 tokens)
Supports multimodal inputs
Higher GPQA score (59.1% vs 35.9%)
Higher GSM8k score (90.8% vs 90.0%)
Higher HumanEval score (84.1% vs 74.1%)
Higher MATH score (86.5% vs 50.6%)
Higher MathVista score (68.1% vs 52.8%)
Higher MMLU score (85.9% vs 81.3%)
Higher MMLU-Pro score (75.8% vs 51.0%)
Higher MMMU score (65.9% vs 53.6%)

Detailed Comparison

AI Model Comparison Table
Feature
xAI
Grok-1.5
Google
Gemini 1.5 Pro

FAQ

Common questions about Grok-1.5 vs Gemini 1.5 Pro.

Which is better, Grok-1.5 or Gemini 1.5 Pro?

Gemini 1.5 Pro significantly outperforms across most benchmarks. Grok-1.5 is made by xAI and Gemini 1.5 Pro is made by Google. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Grok-1.5 compare to Gemini 1.5 Pro in benchmarks?

Grok-1.5 scores GSM8k: 90.0%, DocVQA: 85.6%, MMLU: 81.3%, HumanEval: 74.1%, MMMU: 53.6%. Gemini 1.5 Pro scores XSTest: 98.8%, HellaSwag: 93.3%, GSM8k: 90.8%, BIG-Bench Hard: 89.2%, MGSM: 87.5%.

What are the context window sizes for Grok-1.5 and Gemini 1.5 Pro?

Grok-1.5 supports an unknown number of tokens and Gemini 1.5 Pro supports 2.1M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-1.5 and Gemini 1.5 Pro?

Key differences include multimodal support (no vs yes). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-1.5 and Gemini 1.5 Pro?

Grok-1.5 is developed by xAI and Gemini 1.5 Pro is developed by Google.