Model Comparison
Claude 3 Haiku vs Qwen2.5 72B Instruct
Qwen2.5 72B Instruct significantly outperforms across most benchmarks. Qwen2.5 72B Instruct is 1.4x cheaper per token.
Performance Benchmarks
Comparative analysis across standard metrics
Claude 3 Haiku outperforms in 0 benchmarks, while Qwen2.5 72B Instruct is better at 4 benchmarks (GPQA, GSM8k, HumanEval, MATH).
Qwen2.5 72B Instruct significantly outperforms across most benchmarks.
Arena Performance
Human preference votes
Pricing Analysis
Price comparison per million tokens
For input processing, Claude 3 Haiku ($0.25/1M tokens) is 1.4x cheaper than Qwen2.5 72B Instruct ($0.35/1M tokens).
For output processing, Claude 3 Haiku ($1.25/1M tokens) is 3.1x more expensive than Qwen2.5 72B Instruct ($0.40/1M tokens).
In conclusion, Claude 3 Haiku is more expensive than Qwen2.5 72B Instruct.*
* Using a 3:1 ratio of input to output tokens
Context Window
Maximum input and output token capacity
Claude 3 Haiku accepts 200,000 input tokens compared to Qwen2.5 72B Instruct's 131,072 tokens. Claude 3 Haiku can generate longer responses up to 200,000 tokens, while Qwen2.5 72B Instruct is limited to 8,192 tokens.
Input Capabilities
Supported data types and modalities
Claude 3 Haiku supports multimodal inputs, whereas Qwen2.5 72B Instruct does not.
Claude 3 Haiku can handle both text and other forms of data like images, making it suitable for multimodal applications.
Claude 3 Haiku
Qwen2.5 72B Instruct
License
Usage and distribution terms
Claude 3 Haiku is licensed under a proprietary license, while Qwen2.5 72B Instruct uses Qwen.
License differences may affect how you can use these models in commercial or open-source projects.
Proprietary
Closed source
Qwen
Open weights
Release Timeline
When each model was launched
Claude 3 Haiku was released on 2024-03-13, while Qwen2.5 72B Instruct was released on 2024-09-19.
Qwen2.5 72B Instruct is 6 months newer than Claude 3 Haiku.
Mar 13, 2024
2.0 years ago
Sep 19, 2024
1.5 years ago
6mo newerKnowledge Cutoff
When training data ends
Neither model specifies a knowledge cutoff date.
Unable to compare the recency of their training data.
Provider Availability
Claude 3 Haiku is available from Anthropic, Bedrock, Google. Qwen2.5 72B Instruct is available from DeepInfra, Hyperbolic, Fireworks, Together.
Claude 3 Haiku
Qwen2.5 72B Instruct
Outputs Comparison
Key Takeaways
Claude 3 Haiku
View detailsAnthropic
Qwen2.5 72B Instruct
View detailsAlibaba Cloud / Qwen Team
Detailed Comparison
| Feature |
|---|
FAQ
Common questions about Claude 3 Haiku vs Qwen2.5 72B Instruct