Model Comparison
Nova Pro vs Phi-3.5-mini-instruct
Nova Pro significantly outperforms across most benchmarks. Phi-3.5-mini-instruct is 14.0x cheaper per token.
Performance Benchmarks
Comparative analysis across standard metrics
Nova Pro outperforms in 6 benchmarks (ARC-C, GPQA, GSM8k, HumanEval, MATH, MMLU), while Phi-3.5-mini-instruct is better at 1 benchmark (SQuALITY).
Nova Pro significantly outperforms across most benchmarks.
Arena Performance
Human preference votes
Pricing Analysis
Price comparison per million tokens
For input processing, Nova Pro ($0.80/1M tokens) is 8.0x more expensive than Phi-3.5-mini-instruct ($0.10/1M tokens).
For output processing, Nova Pro ($3.20/1M tokens) is 32.0x more expensive than Phi-3.5-mini-instruct ($0.10/1M tokens).
In conclusion, Nova Pro is more expensive than Phi-3.5-mini-instruct.*
* Using a 3:1 ratio of input to output tokens
Context Window
Maximum input and output token capacity
Nova Pro accepts 300,000 input tokens compared to Phi-3.5-mini-instruct's 128,000 tokens. Nova Pro can generate longer responses up to 300,000 tokens, while Phi-3.5-mini-instruct is limited to 128,000 tokens.
Input Capabilities
Supported data types and modalities
Nova Pro supports multimodal inputs, whereas Phi-3.5-mini-instruct does not.
Nova Pro can handle both text and other forms of data like images, making it suitable for multimodal applications.
Nova Pro
Phi-3.5-mini-instruct
License
Usage and distribution terms
Nova Pro is licensed under a proprietary license, while Phi-3.5-mini-instruct uses MIT.
License differences may affect how you can use these models in commercial or open-source projects.
Proprietary
Closed source
MIT
Open weights
Release Timeline
When each model was launched
Nova Pro was released on 2024-11-20, while Phi-3.5-mini-instruct was released on 2024-08-23.
Nova Pro is 3 months newer than Phi-3.5-mini-instruct.
Nov 20, 2024
1.4 years ago
2mo newerAug 23, 2024
1.6 years ago
Knowledge Cutoff
When training data ends
Neither model specifies a knowledge cutoff date.
Unable to compare the recency of their training data.
Provider Availability
Nova Pro is available from Bedrock. Phi-3.5-mini-instruct is available from Azure.
Nova Pro
Phi-3.5-mini-instruct
Outputs Comparison
Key Takeaways
Nova Pro
View detailsAmazon
Phi-3.5-mini-instruct
View detailsMicrosoft
Detailed Comparison
| Feature |
|---|
FAQ
Common questions about Nova Pro vs Phi-3.5-mini-instruct