The AI arena is free today

Open Superagent

Mercury 3 vs Phi 4 Reasoning

Mercury 3 leads the LLM Stats Score 36.1 to 11.5.

Inception · Microsoft · Updated for 2026

Which is better?

Mercury 3 leads the overall LLM Stats Score 36.1 to 11.5, ranking #98 overall.

In the 1 individual benchmarks reported for both models, Mercury 3 wins 1; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Mercury 3

  • overall performance matters — it scores 36.1 and ranks #98 on LLM Stats
  • your work emphasizes reasoning and coding — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 1 of 1 exact shared results
  • you want the most recent training data — it shipped Oct 2026

Choose Phi 4 Reasoning

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Mercury 3
Inception
Phi 4 Reasoning
Microsoft
Core performance indexes
LLM Stats Score
36.1
#98
11.5
#280
Reasoning
34.8
#103
12.1
#269
Coding
21.5
#105
6.2
#213
Cost, coverage & limits
Benchmark wins
1 of 1
0 of 1
Input price
$0.10 / M
— / M
Output price
$0.35 / M
— / M
Context window
1,000,000
—

Individual benchmarks

12 reported for Mercury 3 · 11 for Phi 4 Reasoning

1 shared

Mercury 3 outperforms in 1 benchmarks (GPQA), while Phi 4 Reasoning is better at 0 benchmarks.

Mercury 3 significantly outperforms across most benchmarks.

Sat Oct 24 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Microsoft
Phi 4 Reasoning
Input- tokens
Output- tokens
Sat Oct 24 2026 • llm-stats.com

License

Usage and distribution terms

Mercury 3 is licensed under a proprietary license, while Phi 4 Reasoning uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Mercury 3

Proprietary

Closed source

Phi 4 Reasoning

MIT

Open weights

Release Timeline

When each model was launched

Mercury 3 was released on 2026-10-19, while Phi 4 Reasoning was released on 2025-04-30.

Mercury 3 is 18 months newer than Phi 4 Reasoning.

Mercury 3

Oct 19, 2026

0 days ago

1.5yr newer
Phi 4 Reasoning

Apr 30, 2025

1.5 years ago

Knowledge Cutoff

When training data ends

Phi 4 Reasoning has a documented knowledge cutoff of 2025-03-01, while Mercury 3's cutoff date is not specified.

We can confirm Phi 4 Reasoning's training data extends to 2025-03-01, but cannot make a direct comparison without Mercury 3's cutoff date.

Mercury 3

—

Phi 4 Reasoning

Mar 2025

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Mercury 3 and Phi 4 Reasoning side-by-side, then vote on the output you prefer.

Mercury 3
✓ Preferred
Phi 4 Reasoning
Open in Playground

FAQ

Common questions about Mercury 3 vs Phi 4 Reasoning.

Which is better, Mercury 3 or Phi 4 Reasoning?

Mercury 3 leads the LLM Stats Score 36.1 to 11.5. Mercury 3 is made by Inception and Phi 4 Reasoning is made by Microsoft. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Mercury 3 compare to Phi 4 Reasoning in benchmarks?

Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%. Phi 4 Reasoning scores FlenQA: 97.7%, HumanEval+: 92.9%, IFEval: 83.4%, OmniMath: 76.6%, AIME 2024: 75.3%.

What are the context window sizes for Mercury 3 and Phi 4 Reasoning?

Mercury 3 supports 1.0M tokens and Phi 4 Reasoning supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Mercury 3 and Phi 4 Reasoning?

Key differences include LLM Stats Score (36.1 vs 11.5), licensing (Proprietary vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Mercury 3 and Phi 4 Reasoning?

Mercury 3 is developed by Inception and Phi 4 Reasoning is developed by Microsoft.

Related comparisons