Model Comparison

Claude Sonnet 4 vs Grok-1.5

Claude Sonnet 4 significantly outperforms across most benchmarks.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

2 benchmarks

Claude Sonnet 4 outperforms in 2 benchmarks (GPQA, MMMU), while Grok-1.5 is better at 0 benchmarks.

Claude Sonnet 4 significantly outperforms across most benchmarks.

Fri May 15 2026 • llm-stats.com

Arena Performance

Human preference votes

Context Window

Maximum input and output token capacity

Only Claude Sonnet 4 specifies input context (200,000 tokens). Only Claude Sonnet 4 specifies output context (64,000 tokens).

Anthropic
Claude Sonnet 4
Input200,000 tokens
Output64,000 tokens
xAI
Grok-1.5
Input- tokens
Output- tokens
Fri May 15 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Claude Sonnet 4 supports multimodal inputs, whereas Grok-1.5 does not.

Claude Sonnet 4 can handle both text and other forms of data like images, making it suitable for multimodal applications.

Claude Sonnet 4

Text
Images
Audio
Video

Grok-1.5

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

Claude Sonnet 4

Proprietary

Closed source

Grok-1.5

Proprietary

Closed source

Release Timeline

When each model was launched

Claude Sonnet 4 was released on 2025-05-22, while Grok-1.5 was released on 2024-03-28.

Claude Sonnet 4 is 14 months newer than Grok-1.5.

Claude Sonnet 4

May 22, 2025

11 months ago

1.2yr newer
Grok-1.5

Mar 28, 2024

2.1 years ago

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

Anthropic
Larger context window (200,000 tokens)
Supports multimodal inputs
Higher GPQA score (75.4% vs 35.9%)
Higher MMMU score (74.4% vs 53.6%)
xAI

No standout differentiators in the data we have for this pair.

AnthropicClaude Sonnet 4
xAIGrok-1.5
Compare in Playground

Detailed Comparison

AI Model Comparison Table
Feature
Anthropic
Claude Sonnet 4
xAI
Grok-1.5

FAQ

Common questions about Claude Sonnet 4 vs Grok-1.5.

Which is better, Claude Sonnet 4 or Grok-1.5?

Claude Sonnet 4 significantly outperforms across most benchmarks. Claude Sonnet 4 is made by Anthropic and Grok-1.5 is made by xAI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Claude Sonnet 4 compare to Grok-1.5 in benchmarks?

Claude Sonnet 4 scores MMMLU: 86.5%, TAU-bench Retail: 80.5%, GPQA: 75.4%, MMMU: 74.4%, SWE-Bench Verified: 72.7%. Grok-1.5 scores GSM8k: 90.0%, DocVQA: 85.6%, MMLU: 81.3%, HumanEval: 74.1%, MMMU: 53.6%.

What are the context window sizes for Claude Sonnet 4 and Grok-1.5?

Claude Sonnet 4 supports 200K tokens and Grok-1.5 supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Claude Sonnet 4 and Grok-1.5?

Key differences include multimodal support (yes vs no). See the full comparison above for benchmark-by-benchmark results.

Who makes Claude Sonnet 4 and Grok-1.5?

Claude Sonnet 4 is developed by Anthropic and Grok-1.5 is developed by xAI.