MetaReleased on Jul 23, 2024

Llama 3.1 405B Instruct: Benchmarks, Pricing & Context Window

Llama 3.1 405B Instruct is a language model from Meta, released in July 2024.

Llama 3.1 405B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks. The model supports 8 languages and has a 128K

Input
Text
Output
Text
Speed
TTFT400ms
Throughput100char/s
Cost
$0.89/ 1M · 8:1 in:out
$0.89 in · $0.89 out

Llama 3.1 405B Instruct pricing

Providers

Llama 3.1 405B Instruct starts at $0.890 per million input tokens and $0.890 per million output tokens via Lambda. See all 8 providers below with their per-token pricing, latency, throughput, and modality support.

ProviderInput $/MOutput $/MMax InputMax OutputLatency sThroughputQuantInputOutput
Lambda logoLambda
$0.890$0.890128.0K128.0K
0.50
42 c/s
—
DeepInfra logoDeepInfra
$1.79$1.79128.0K128.0K
0.50
27 c/s
—
Fireworks logoFireworks
$3.00$3.00128.0K128.0K
0.50
78 c/s
—
Bedrock logoBedrock
$3.00$3.00128.0K128.0K
0.50
100 c/s
—
Together logoTogether
$3.50$3.50128.0K128.0K
0.50
35 c/s
—
Hyperbolic logoHyperbolic
$4.00$4.00128.0K128.0K
0.50
40 c/s
—
Google logoGoogle
$5.00$16.00128.0K128.0K
0.40
42 c/s
—
Replicate logoReplicate
$9.50$9.50128.0K128.0K
0.50
22 c/s
—
Loading chart...
Loading chart...
Loading chart...

Llama 3.1 405B Instruct API

API access coming soon

Llama 3.1 405B Instruct will be available through our gateway shortly.

Llama 3.1 405B Instruct examples

Recent arena outputs from Llama 3.1 405B Instruct, picked from the highest-ranked matchups.

Llama 3.1 405B Instruct license

Llama 3.1 405B Instruct is released under the Llama 3.1 Community License license, which restricts commercial use, has 405.0B parameters.

License
Llama 3.1 Community License
Non-commercial
Parameters
405.0B

FAQ

Common questions about Llama 3.1 405B Instruct.

When was Llama 3.1 405B Instruct released?

Llama 3.1 405B Instruct was released on July 23, 2024 by Meta. This is the official Llama 3.1 405B Instruct release date tracked on LLM Stats.

Is Llama 3.1 405B Instruct available via API?

Yes, Llama 3.1 405B Instruct is available via API. See the official documentation for authentication and endpoint details. It is served by 8 providers tracked on LLM Stats.

How many parameters does Llama 3.1 405B Instruct have?

Llama 3.1 405B Instruct has 405 billion parameters. It ships as an open-weight model, so you can download and run it on your own hardware.

Who created Llama 3.1 405B Instruct?

Llama 3.1 405B Instruct was created by Meta.

What is the license for Llama 3.1 405B Instruct?

Llama 3.1 405B Instruct is released under the Llama 3.1 Community License license. This is an open-source / open-weight license that permits self-hosting.

Where can I use Llama 3.1 405B Instruct?

Llama 3.1 405B Instruct is available through 8 providers including Lambda, DeepInfra, Fireworks, and 5 more.

Where is the Llama 3.1 405B Instruct paper or technical report?

Llama 3.1 405B Instruct has a paper or technical report available at https://ai.meta.com/blog/meta-llama-3-1/. Use that source for architecture, training, release and evaluation details.