The AI arena is free today

Open Superagent

Gemini 1.5 Pro vs Phi-3.5-MoE-instruct

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Google · Microsoft · Updated for 2026

Which is better?

Gemini 1.5 Pro outperforms in 9 benchmarks (BIG-Bench Hard, GPQA, GSM8k, HellaSwag, HumanEval, MATH, MGSM, MMLU, MMLU-Pro), while Phi-3.5-MoE-instruct is better at 0 benchmarks. Gemini 1.5 Pro significantly outperforms across most benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Gemini 1.5 Pro

  • you want the strongest raw capability — it leads on 9 of 9 shared benchmarks

Choose Phi-3.5-MoE-instruct

  • you want the most recent training data — it shipped Aug 2024
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Gemini 1.5 Pro
Google
Phi-3.5-MoE-instruct
Microsoft
Benchmark wins
9 of 9
0 of 9
Input price
$2.50 / M
— / M
Output price
$10.00 / M
— / M
Context window
2,097,152
—
Released
May 2024
Aug 2024
License
Proprietary
MIT

Performance Benchmarks

Comparative analysis across standard metrics

9 benchmarks

Gemini 1.5 Pro outperforms in 9 benchmarks (BIG-Bench Hard, GPQA, GSM8k, HellaSwag, HumanEval, MATH, MGSM, MMLU, MMLU-Pro), while Phi-3.5-MoE-instruct is better at 0 benchmarks.

Gemini 1.5 Pro significantly outperforms across most benchmarks.

Mon Aug 24 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Context Window

Maximum input and output token capacity

Only Gemini 1.5 Pro specifies input context (2,097,152 tokens). Only Gemini 1.5 Pro specifies output context (8,192 tokens).

Google
Gemini 1.5 Pro
Input2,097,152 tokens
Output8,192 tokens
Microsoft
Phi-3.5-MoE-instruct
Input- tokens
Output- tokens
Mon Aug 24 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Gemini 1.5 Pro supports multimodal inputs, whereas Phi-3.5-MoE-instruct does not.

Gemini 1.5 Pro can handle both text and other forms of data like images, making it suitable for multimodal applications.

Gemini 1.5 Pro

Text
Images
Audio
Video

Phi-3.5-MoE-instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Gemini 1.5 Pro is licensed under a proprietary license, while Phi-3.5-MoE-instruct uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Gemini 1.5 Pro

Proprietary

Closed source

Phi-3.5-MoE-instruct

MIT

Open weights

Release Timeline

When each model was launched

Gemini 1.5 Pro was released on 2024-05-01, while Phi-3.5-MoE-instruct was released on 2024-08-23.

Phi-3.5-MoE-instruct is 4 months newer than Gemini 1.5 Pro.

Gemini 1.5 Pro

May 1, 2024

2.3 years ago

Phi-3.5-MoE-instruct

Aug 23, 2024

2.0 years ago

3mo newer

Knowledge Cutoff

When training data ends

Gemini 1.5 Pro has a documented knowledge cutoff of 2023-11-01, while Phi-3.5-MoE-instruct's cutoff date is not specified.

We can confirm Gemini 1.5 Pro's training data extends to 2023-11-01, but cannot make a direct comparison without Phi-3.5-MoE-instruct's cutoff date.

Gemini 1.5 Pro

Nov 2023

Phi-3.5-MoE-instruct

—

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Gemini 1.5 Pro and Phi-3.5-MoE-instruct side-by-side, then vote on the output you prefer.

Gemini 1.5 Pro
✓ Preferred
Phi-3.5-MoE-instruct
Open in Playground

FAQ

Common questions about Gemini 1.5 Pro vs Phi-3.5-MoE-instruct.

Which is better, Gemini 1.5 Pro or Phi-3.5-MoE-instruct?

Gemini 1.5 Pro significantly outperforms across most benchmarks. Gemini 1.5 Pro is made by Google and Phi-3.5-MoE-instruct is made by Microsoft. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemini 1.5 Pro compare to Phi-3.5-MoE-instruct in benchmarks?

Gemini 1.5 Pro scores XSTest: 98.8%, FLEURS: 93.3%, HellaSwag: 93.3%, GSM8k: 90.8%, BIG-Bench Hard: 89.2%. Phi-3.5-MoE-instruct scores ARC-C: 91.0%, OpenBookQA: 89.6%, GSM8k: 88.7%, PIQA: 88.6%, RULER: 87.1%.

What are the context window sizes for Gemini 1.5 Pro and Phi-3.5-MoE-instruct?

Gemini 1.5 Pro supports 2.1M tokens and Phi-3.5-MoE-instruct supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemini 1.5 Pro and Phi-3.5-MoE-instruct?

Key differences include multimodal support (yes vs no), licensing (Proprietary vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemini 1.5 Pro and Phi-3.5-MoE-instruct?

Gemini 1.5 Pro is developed by Google and Phi-3.5-MoE-instruct is developed by Microsoft.

Related comparisons