Llama 3.1 70B Instruct
Overview
Llama 3.1 70B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks.
Llama 3.1 70B Instruct was released on July 23, 2024. API access is available through 9 providers, including Lambda, DeepInfra and others.
Performance
Timeline
Specifications
Related Models
Compare Llama 3.1 70B Instruct to other models by quality (GPQA score) vs cost. Higher scores and lower costs represent better value.
Performance visualization loading...
Gathering benchmark data from similar models
Benchmarks
Llama 3.1 70B Instruct Performance Across Datasets
Scores sourced from the model's scorecard, paper, or official blog posts
llm-stats.com - Sat Dec 20 2025Pricing
Pricing, performance, and capabilities for Llama 3.1 70B Instruct across different providers:
| Provider | Input ($/M) | Output ($/M) | Max Input | Max Output | Latency (s) | Throughput | Quantization | Input | Output |
|---|---|---|---|---|---|---|---|---|---|
 Lambda | $0.20 | $0.20 | 128.0K | 128.0K | 0.5 | 42.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 DeepInfra | $0.35 | $0.40 | 128.0K | 128.0K | 0.5 | 25.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Hyperbolic | $0.40 | $0.40 | 128.0K | 128.0K | 0.5 | 100.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Groq | $0.59 | $0.78 | 128.0K | 128.0K | 0.5 | 250.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Cerebras | $0.60 | $0.60 | 128.0K | 128.0K | 0.2 | 1204.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Together | $0.89 | $0.89 | 128.0K | 128.0K | 0.5 | 94.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Fireworks | $0.89 | $0.89 | 128.0K | 128.0K | 0.5 | 32.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Bedrock | $0.89 | $0.89 | 128.0K | 128.0K | 0.5 | 100.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
 Sambanova | $5.00 | $10.00 | 128.0K | 128.0K | 0.5 | 74.0 tok/s | — | Text Image Audio Video | Text Image Audio Video |
Price Comparison for Llama 3.1 70B Instruct
Price per 1M input tokens (USD), lower is better
llm-stats.com - Sat Dec 20 2025Throughput Comparison for Llama 3.1 70B Instruct
Tokens per second, higher is better
llm-stats.com - Sat Dec 20 2025Latency Comparison for Llama 3.1 70B Instruct
Time to first token (s), lower is better
llm-stats.com - Sat Dec 20 2025Llama 3.1 70B Instruct API Providers: Price vs Throughput
Example Outputs
Recent Posts
Recent Reviews
API Access
API Access Coming Soon
API access for Llama 3.1 70B Instruct will be available soon through our gateway.
FAQ
Common questions about Llama 3.1 70B Instruct