Model Comparison

Grok-1.5 vs o3-mini

o3-mini significantly outperforms across most benchmarks.

Performance Benchmarks

Comparative analysis across standard metrics

3 benchmarks

Grok-1.5 outperforms in 0 benchmarks, while o3-mini is better at 3 benchmarks (GPQA, MATH, MMLU).

o3-mini significantly outperforms across most benchmarks.

Mon Jun 01 2026 • llm-stats.com

Arena Performance

Human preference votes

Context Window

Maximum input and output token capacity

Only o3-mini specifies input context (200,000 tokens). Only o3-mini specifies output context (100,000 tokens).

xAI
Grok-1.5
Input- tokens
Output- tokens
OpenAI
o3-mini
Input200,000 tokens
Output100,000 tokens
Mon Jun 01 2026 • llm-stats.com

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Grok-1.5

Proprietary

Closed source

o3-mini

Proprietary

Closed source

Release Timeline

When each model was launched

Grok-1.5 was released on 2024-03-28, while o3-mini was released on 2025-01-30.

o3-mini is 10 months newer than Grok-1.5.

Grok-1.5

Mar 28, 2024

2.2 years ago

o3-mini

Jan 30, 2025

1.3 years ago

10mo newer

Knowledge Cutoff

When training data ends

o3-mini has a documented knowledge cutoff of 2023-09-30, while Grok-1.5's cutoff date is not specified.

We can confirm o3-mini's training data extends to 2023-09-30, but cannot make a direct comparison without Grok-1.5's cutoff date.

Grok-1.5

o3-mini

Sep 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Key Takeaways

No standout differentiators in the data we have for this pair.

Larger context window (200,000 tokens)
Higher GPQA score (77.2% vs 35.9%)
Higher MATH score (97.9% vs 50.6%)
Higher MMLU score (86.9% vs 81.3%)

Detailed Comparison

AI Model Comparison Table
Feature
xAI
Grok-1.5
OpenAI
o3-mini

FAQ

Common questions about Grok-1.5 vs o3-mini.

Which is better, Grok-1.5 or o3-mini?

o3-mini significantly outperforms across most benchmarks. Grok-1.5 is made by xAI and o3-mini is made by OpenAI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Grok-1.5 compare to o3-mini in benchmarks?

Grok-1.5 scores GSM8k: 90.0%, DocVQA: 85.6%, MMLU: 81.3%, HumanEval: 74.1%, MMMU: 53.6%. o3-mini scores COLLIE: 98.7%, MATH: 97.9%, IFEval: 93.9%, MGSM: 92.0%, AIME 2024: 87.3%.

What are the context window sizes for Grok-1.5 and o3-mini?

Grok-1.5 supports an unknown number of tokens and o3-mini supports 200K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

Who makes Grok-1.5 and o3-mini?

Grok-1.5 is developed by xAI and o3-mini is developed by OpenAI.