Model Comparison
Phi-3.5-mini-instruct vs Phi 4
Phi 4 significantly outperforms across most benchmarks. Phi 4 is 1.1x cheaper per token.
Performance Benchmarks
Comparative analysis across standard metrics
Phi-3.5-mini-instruct outperforms in 0 benchmarks, while Phi 4 is better at 7 benchmarks (Arena Hard, GPQA, HumanEval, MATH, MGSM, MMLU, MMLU-Pro).
Phi 4 significantly outperforms across most benchmarks.
Arena Performance
Human preference votes
Pricing Analysis
Price comparison per million tokens
For input processing, Phi-3.5-mini-instruct ($0.10/1M tokens) is 1.4x more expensive than Phi 4 ($0.07/1M tokens).
For output processing, Phi-3.5-mini-instruct ($0.10/1M tokens) is 1.4x cheaper than Phi 4 ($0.14/1M tokens).
In conclusion, Phi-3.5-mini-instruct is more expensive than Phi 4.*
* Using a 3:1 ratio of input to output tokens
Model Size
Parameter count comparison
Phi 4 has 10.9B more parameters than Phi-3.5-mini-instruct, making it 286.8% larger.
Context Window
Maximum input and output token capacity
Phi-3.5-mini-instruct accepts 128,000 input tokens compared to Phi 4's 16,000 tokens. Phi-3.5-mini-instruct can generate longer responses up to 128,000 tokens, while Phi 4 is limited to 16,000 tokens.
License
Usage and distribution terms
Both models are licensed under MIT.
Both models share the same licensing terms, providing consistent usage rights.
MIT
Open weights
MIT
Open weights
Release Timeline
When each model was launched
Phi-3.5-mini-instruct was released on 2024-08-23, while Phi 4 was released on 2024-12-12.
Phi 4 is 4 months newer than Phi-3.5-mini-instruct.
Aug 23, 2024
1.7 years ago
Dec 12, 2024
1.4 years ago
3mo newerKnowledge Cutoff
When training data ends
Phi 4 has a documented knowledge cutoff of 2024-06-01, while Phi-3.5-mini-instruct's cutoff date is not specified.
We can confirm Phi 4's training data extends to 2024-06-01, but cannot make a direct comparison without Phi-3.5-mini-instruct's cutoff date.
—
Jun 2024
Provider Availability
Phi-3.5-mini-instruct is available from Azure. Phi 4 is available from DeepInfra.
Phi-3.5-mini-instruct
Phi 4
Outputs Comparison
Key Takeaways
Phi-3.5-mini-instruct
View detailsMicrosoft
Phi 4
View detailsMicrosoft
Detailed Comparison
| Feature |
|---|
FAQ
Common questions about Phi-3.5-mini-instruct vs Phi 4