The AI arena is free today

Open Superagent

Gemini 1.5 Pro vs Phi 4 Reasoning Plus

Phi 4 Reasoning Plus significantly outperforms across most benchmarks.

Google · Microsoft · Updated for 2026

Which is better?

Gemini 1.5 Pro outperforms in 0 benchmarks, while Phi 4 Reasoning Plus is better at 2 benchmarks (GPQA, MMLU-Pro). Phi 4 Reasoning Plus significantly outperforms across most benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Gemini 1.5 Pro

  • you want predictable pricing at $2.50/M input and $10.00/M output

Choose Phi 4 Reasoning Plus

  • you want the strongest raw capability — it leads on 2 of 2 shared benchmarks
  • you want the most recent training data — it shipped Apr 2025
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Benchmark wins
0 of 2
2 of 2
Input price
$2.50 / M
— / M
Output price
$10.00 / M
— / M
Context window
2,097,152
Released
May 2024
Apr 2025
License
Proprietary
MIT

Performance Benchmarks

Comparative analysis across standard metrics

2 benchmarks

Gemini 1.5 Pro outperforms in 0 benchmarks, while Phi 4 Reasoning Plus is better at 2 benchmarks (GPQA, MMLU-Pro).

Phi 4 Reasoning Plus significantly outperforms across most benchmarks.

Mon Aug 24 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Context Window

Maximum input and output token capacity

Only Gemini 1.5 Pro specifies input context (2,097,152 tokens). Only Gemini 1.5 Pro specifies output context (8,192 tokens).

Google
Gemini 1.5 Pro
Input2,097,152 tokens
Output8,192 tokens
Microsoft
Phi 4 Reasoning Plus
Input- tokens
Output- tokens
Mon Aug 24 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Gemini 1.5 Pro supports multimodal inputs, whereas Phi 4 Reasoning Plus does not.

Gemini 1.5 Pro can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemini 1.5 Pro

Text
Images
Audio
Video

Phi 4 Reasoning Plus

Text
Images
Audio
Video

License

Usage and distribution terms

Gemini 1.5 Pro is licensed under a proprietary license, while Phi 4 Reasoning Plus uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Gemini 1.5 Pro

Proprietary

Closed source

Phi 4 Reasoning Plus

MIT

Open weights

Release Timeline

When each model was launched

Gemini 1.5 Pro was released on 2024-05-01, while Phi 4 Reasoning Plus was released on 2025-04-30.

Phi 4 Reasoning Plus is 12 months newer than Gemini 1.5 Pro.

Gemini 1.5 Pro

May 1, 2024

2.3 years ago

Phi 4 Reasoning Plus

Apr 30, 2025

1.3 years ago

12mo newer

Knowledge Cutoff

When training data ends

Gemini 1.5 Pro has a knowledge cutoff of 2023-11-01, while Phi 4 Reasoning Plus has a cutoff of 2025-03-01.

Phi 4 Reasoning Plus has more recent training data (up to 2025-03-01), making it potentially better informed about events through that date compared to Gemini 1.5 Pro (2023-11-01).

Gemini 1.5 Pro

Nov 2023

Phi 4 Reasoning Plus

Mar 2025

1.3 yr newer

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Gemini 1.5 Pro and Phi 4 Reasoning Plus side-by-side, then vote on the output you prefer.

Gemini 1.5 Pro
✓ Preferred
Phi 4 Reasoning Plus
Open in Playground

FAQ

Common questions about Gemini 1.5 Pro vs Phi 4 Reasoning Plus.

Which is better, Gemini 1.5 Pro or Phi 4 Reasoning Plus?

Phi 4 Reasoning Plus significantly outperforms across most benchmarks. Gemini 1.5 Pro is made by Google and Phi 4 Reasoning Plus is made by Microsoft. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemini 1.5 Pro compare to Phi 4 Reasoning Plus in benchmarks?

Gemini 1.5 Pro scores XSTest: 98.8%, FLEURS: 93.3%, HellaSwag: 93.3%, GSM8k: 90.8%, BIG-Bench Hard: 89.2%. Phi 4 Reasoning Plus scores FlenQA: 97.9%, HumanEval+: 92.3%, IFEval: 84.9%, OmniMath: 81.9%, AIME 2024: 81.3%.

What are the context window sizes for Gemini 1.5 Pro and Phi 4 Reasoning Plus?

Gemini 1.5 Pro supports 2.1M tokens and Phi 4 Reasoning Plus supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemini 1.5 Pro and Phi 4 Reasoning Plus?

Key differences include multimodal support (yes vs no), licensing (Proprietary vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemini 1.5 Pro and Phi 4 Reasoning Plus?

Gemini 1.5 Pro is developed by Google and Phi 4 Reasoning Plus is developed by Microsoft.