Llama 3.1 70B Instruct: API Pricing, Context Window & Benchmarks
Llama 3.1 70B Instruct is a language model from Meta, released in July 2024.
Llama 3.1 70B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks.
Llama 3.1 70B Instruct benchmarks
Rankings
Quality Tracker
Llama 3.1 70B Instruct Performance Across Datasets
Scores sourced from the model's scorecard, paper, or official blog posts
llm-stats.com - Sat Jul 18 2026Llama 3.1 70B Instruct pricing
Providers
Llama 3.1 70B Instruct starts at $0.200 per million input tokens and $0.200 per million output tokens via Lambda. See all 9 providers below with their per-token pricing, latency, throughput, and modality support.
| Provider | Input $/M | Output $/M | Workload 1M + 100K | Context in / out | TTFT p50 / p95 s | Output avg / p5 c/s | Success 7d | Modalities in / out |
|---|---|---|---|---|---|---|---|---|
 Lambda | $0.200 | $0.200 | $0.220 | 128.0K/128.0K | —/0.50 | 42/— | — | / |
 DeepInfra | $0.350 | $0.400 | $0.390 | 128.0K/128.0K | —/0.50 | 25/— | — | / |
 Hyperbolic | $0.400 | $0.400 | $0.440 | 128.0K/128.0K | —/0.50 | 100/— | — | / |
 Groq | $0.590 | $0.780 | $0.668 | 128.0K/128.0K | —/0.50 | 250/— | — | / |
 Cerebras | $0.600 | $0.600 | $0.660 | 128.0K/128.0K | —/0.20 | 1204/— | — | / |
 Together | $0.890 | $0.890 | $0.979 | 128.0K/128.0K | —/0.50 | 94/— | — | / |
 Fireworks | $0.890 | $0.890 | $0.979 | 128.0K/128.0K | —/0.50 | 32/— | — | / |
 Bedrock | $0.890 | $0.890 | $0.979 | 128.0K/128.0K | —/0.50 | 100/— | — | / |
 Sambanova | $5.00 | $10.00 | $6.00 | 128.0K/128.0K | —/0.50 | 74/— | — | / |
Workload cost uses 1M input tokens plus 100K output tokens at published list prices without assuming a cache hit. Cached input is the discounted price for prompt tokens served from a provider cache. TTFT is time to first token. Output is characters per second; p5 is the sustained floor exceeded by 95% of observed requests. Success is calculated from completed versus failed requests over the trailing seven days.
Llama 3.1 70B Instruct model size
Llama 3.1 70B Instruct has 70 billion parameters and was trained on 15 trillion tokens. See how it compares to other models in the same parameter range.
Llama 3.1 70B Instruct context window
Input and output token limits for Llama 3.1 70B Instruct, plus how it ranks on long-context understanding.
Llama 3.1 70B Instruct API
Available from the model provider
Llama 3.1 70B Instruct has an official provider API. It is not currently routed through the LLM Stats gateway.
Read the official API documentationLlama 3.1 70B Instruct latency
Llama 3.1 70B Instruct time to first token, sustained output throughput, and failed-request rate from live API traffic over the trailing 7 days.
Llama 3.1 70B Instruct examples
Recent arena outputs from Llama 3.1 70B Instruct, picked from the highest-ranked matchups.
Llama 3.1 70B Instruct license
Llama 3.1 70B Instruct is released under the Llama 3.1 Community License license, which restricts commercial use, has 70.0B parameters.
- License
- Llama 3.1 Community License
- Non-commercial
- Parameters
- 70.0B
Llama 3.1 70B Instruct resources
Official sources for Llama 3.1 70B Instruct: api documentation, paper or system card, official launch post, source repository, model weights.
Llama 3.1 70B Instruct vs other models
The most-compared alternatives to Llama 3.1 70B Instruct are Nova Lite, Mistral Large 2, Qwen2.5 32B Instruct. Open any pair side-by-side for benchmarks, pricing, context, and latency.
Models like Llama 3.1 70B Instruct
Models ranked just above and below Llama 3.1 70B Instruct by LLM Stats score.
FAQ
Common questions about Llama 3.1 70B Instruct.