The AI arena is free today

Open Superagent

Grok-4 vs Phi 4

Grok-4 significantly outperforms across most benchmarks. Phi 4 is 68.6x cheaper per token.

xAI · Microsoft · Updated for 2026

Which is better?

Grok-4 outperforms in 1 benchmarks (GPQA), while Phi 4 is better at 0 benchmarks. Grok-4 significantly outperforms across most benchmarks.

On price, Phi 4 is roughly 68.6x cheaper per token on a blended 3:1 input/output basis, which adds up quickly at production volume.

Grok-4 also accepts a larger context window (256,000 input tokens), making it the stronger choice for long documents and large codebases.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Grok-4

  • you want the strongest raw capability — it leads on 1 of 1 shared benchmarks
  • you process long inputs — it offers a 256,000 token context window
  • you want the most recent training data — it shipped Jul 2025

Choose Phi 4

  • cost matters — it's about 68.6x cheaper per token
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Benchmark wins
1 of 1
0 of 1
Input price
$3.00 / M
$0.07 / M
Output price
$15.00 / M
$0.14 / M
Context window
256,000
16,000
Released
Jul 2025
Dec 2024
License
Proprietary
MIT

Performance Benchmarks

Comparative analysis across standard metrics

1 benchmarks

Grok-4 outperforms in 1 benchmarks (GPQA), while Phi 4 is better at 0 benchmarks.

Grok-4 significantly outperforms across most benchmarks.

Tue Aug 25 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Pricing Analysis

Price comparison per million tokens

Phi 4 costs less

For input processing, Grok-4 ($3.00/1M tokens) is 42.9x more expensive than Phi 4 ($0.07/1M tokens).

For output processing, Grok-4 ($15.00/1M tokens) is 107.1x more expensive than Phi 4 ($0.14/1M tokens).

In conclusion, Grok-4 is more expensive than Phi 4.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Tue Aug 25 2026 • llm-stats.com
xAI
Grok-4
Input tokens$3.00
Output tokens$15.00
Best providerxAI
Microsoft
Phi 4
Input tokens$0.07
Output tokens$0.14
Best providerDeepinfra
Notice missing or incorrect data?Start an Issue

Context Window

Maximum input and output token capacity

Grok-4 accepts 256,000 input tokens compared to Phi 4's 16,000 tokens. Phi 4 can generate longer responses up to 16,000 tokens, while Grok-4 is limited to 8,000 tokens.

xAI
Grok-4
Input256,000 tokens
Output8,000 tokens
Microsoft
Phi 4
Input16,000 tokens
Output16,000 tokens
Tue Aug 25 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Grok-4 supports multimodal inputs, whereas Phi 4 does not.

Grok-4 can handle both text and other forms of data like images, making it suitable for multimodal applications.

Grok-4

Text
Images
Audio
Video

Phi 4

Text
Images
Audio
Video

License

Usage and distribution terms

Grok-4 is licensed under a proprietary license, while Phi 4 uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Grok-4

Proprietary

Closed source

Phi 4

MIT

Open weights

Release Timeline

When each model was launched

Grok-4 was released on 2025-07-09, while Phi 4 was released on 2024-12-12.

Grok-4 is 7 months newer than Phi 4.

Grok-4

Jul 9, 2025

1.1 years ago

6mo newer
Phi 4

Dec 12, 2024

1.7 years ago

Knowledge Cutoff

When training data ends

Grok-4 has a knowledge cutoff of 2024-12-31, while Phi 4 has a cutoff of 2024-06-01.

Grok-4 has more recent training data (up to 2024-12-31), making it potentially better informed about events through that date compared to Phi 4 (2024-06-01).

Grok-4

Dec 2024

6 mo newer
Phi 4

Jun 2024

Provider Availability

Grok-4 is available from xAI. Phi 4 is available from DeepInfra.

Grok-4

xai logo
xAI
Input Price:Input: $3.00/1MOutput Price:Output: $15.00/1M

Phi 4

deepinfra logo
Deepinfra
Input Price:Input: $0.07/1MOutput Price:Output: $0.14/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Grok-4 and Phi 4 side-by-side, then vote on the output you prefer.

Grok-4
✓ Preferred
Phi 4
Open in Playground

FAQ

Common questions about Grok-4 vs Phi 4.

Which is better, Grok-4 or Phi 4?

Grok-4 significantly outperforms across most benchmarks. Grok-4 is made by xAI and Phi 4 is made by Microsoft. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Grok-4 compare to Phi 4 in benchmarks?

Grok-4 scores AIME 2025: 91.7%, HMMT25: 90.0%, GPQA: 87.5%, LiveCodeBench: 79.0%, Humanity's Last Exam: 40.0%. Phi 4 scores MMLU: 84.8%, HumanEval+: 82.8%, HumanEval: 82.6%, MGSM: 80.6%, MATH: 80.4%.

Is Grok-4 cheaper than Phi 4?

Phi 4 is 42.9x cheaper for input tokens. Grok-4 costs $3.00/M input and $15.00/M output via xai. Phi 4 costs $0.07/M input and $0.14/M output via deepinfra.

What are the context window sizes for Grok-4 and Phi 4?

Grok-4 supports 256K tokens and Phi 4 supports 16K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-4 and Phi 4?

Key differences include context window (256K vs 16K), input pricing ($3.00 vs $0.07/M), multimodal support (yes vs no), licensing (Proprietary vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-4 and Phi 4?

Grok-4 is developed by xAI and Phi 4 is developed by Microsoft.