Model Comparison

Gemini 1.5 Pro vs Grok-1.5

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

8 benchmarks

Gemini 1.5 Pro outperforms in 8 benchmarks (GPQA, GSM8k, HumanEval, MATH, MathVista, MMLU, MMLU-Pro, MMMU), while Grok-1.5 is better at 0 benchmarks.

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Sat May 02 2026 • llm-stats.com

Arena Performance

Human preference votes

Context Window

Maximum input and output token capacity

Only Gemini 1.5 Pro specifies input context (2,097,152 tokens). Only Gemini 1.5 Pro specifies output context (8,192 tokens).

Google
Gemini 1.5 Pro
Input2,097,152 tokens
Output8,192 tokens
xAI
Grok-1.5
Input- tokens
Output- tokens
Sat May 02 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Gemini 1.5 Pro supports multimodal inputs, whereas Grok-1.5 does not.

Gemini 1.5 Pro can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemini 1.5 Pro

Text
Images
Audio
Video

Grok-1.5

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Gemini 1.5 Pro

Proprietary

Closed source

Grok-1.5

Proprietary

Closed source

Release Timeline

When each model was launched

Gemini 1.5 Pro was released on 2024-05-01, while Grok-1.5 was released on 2024-03-28.

Gemini 1.5 Pro is 1 month newer than Grok-1.5.

Gemini 1.5 Pro

May 1, 2024

2.0 years ago

1mo newer
Grok-1.5

Mar 28, 2024

2.1 years ago

Knowledge Cutoff

When training data ends

Gemini 1.5 Pro has a documented knowledge cutoff of 2023-11-01, while Grok-1.5's cutoff date is not specified.

We can confirm Gemini 1.5 Pro's training data extends to 2023-11-01, but cannot make a direct comparison without Grok-1.5's cutoff date.

Gemini 1.5 Pro

Nov 2023

Grok-1.5

—

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

Google
Larger context window (2,097,152 tokens)
Supports multimodal inputs
Higher GPQA score (59.1% vs 35.9%)
Higher GSM8k score (90.8% vs 90.0%)
Higher HumanEval score (84.1% vs 74.1%)
Higher MATH score (86.5% vs 50.6%)
Higher MathVista score (68.1% vs 52.8%)
Higher MMLU score (85.9% vs 81.3%)
Higher MMLU-Pro score (75.8% vs 51.0%)
Higher MMMU score (65.9% vs 53.6%)
xAI

No standout differentiators in the data we have for this pair.

Detailed Comparison

AI Model Comparison Table
Feature
Google
Gemini 1.5 Pro
xAI
Grok-1.5

FAQ

Common questions about Gemini 1.5 Pro vs Grok-1.5.

Which is better, Gemini 1.5 Pro or Grok-1.5?

Gemini 1.5 Pro significantly outperforms across most benchmarks. Gemini 1.5 Pro is made by Google and Grok-1.5 is made by xAI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemini 1.5 Pro compare to Grok-1.5 in benchmarks?

Gemini 1.5 Pro scores XSTest: 98.8%, HellaSwag: 93.3%, GSM8k: 90.8%, BIG-Bench Hard: 89.2%, MGSM: 87.5%. Grok-1.5 scores GSM8k: 90.0%, DocVQA: 85.6%, MMLU: 81.3%, HumanEval: 74.1%, MMMU: 53.6%.

What are the context window sizes for Gemini 1.5 Pro and Grok-1.5?

Gemini 1.5 Pro supports 2.1M tokens and Grok-1.5 supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemini 1.5 Pro and Grok-1.5?

Key differences include multimodal support (yes vs no). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemini 1.5 Pro and Grok-1.5?

Gemini 1.5 Pro is developed by Google and Grok-1.5 is developed by xAI.