NvidiaReleased on Oct 1, 2024

Llama 3.1 Nemotron 70B Instruct: Benchmarks, Pricing & Size

Llama 3.1 Nemotron 70B Instruct is a language model from Nvidia, released in October 2024.

A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.

Llama 3.1 Nemotron 70B Instruct model size

Llama 3.1 Nemotron 70B Instruct has 70 billion parameters. See how it compares to other models in the same parameter range.

Parameters
70B
Large (30–80B)
70B
1B7B70B405B

Llama 3.1 Nemotron 70B Instruct API

API access coming soon

Llama 3.1 Nemotron 70B Instruct will be available through our gateway shortly.

Llama 3.1 Nemotron 70B Instruct examples

Recent arena outputs from Llama 3.1 Nemotron 70B Instruct, picked from the highest-ranked matchups.

Llama 3.1 Nemotron 70B Instruct license

Llama 3.1 Nemotron 70B Instruct is released under the Llama 3.1 Community License license, which restricts commercial use, has 70.0B parameters, has a knowledge cutoff of December 2023.

License
Llama 3.1 Community License
Non-commercial
Parameters
70.0B
Knowledge cutoff
December 2023

FAQ

Common questions about Llama 3.1 Nemotron 70B Instruct.

When was Llama 3.1 Nemotron 70B Instruct released?

Llama 3.1 Nemotron 70B Instruct was released on October 1, 2024 by Nvidia. This is the official Llama 3.1 Nemotron 70B Instruct release date tracked on LLM Stats.

Is Llama 3.1 Nemotron 70B Instruct available via API?

Yes, Llama 3.1 Nemotron 70B Instruct is available via API. See the official documentation for authentication and endpoint details.

How big is Llama 3.1 Nemotron 70B Instruct?

Llama 3.1 Nemotron 70B Instruct has 70 billion parameters. It ships as an open-weight model, so you can download and run it on your own hardware.

Who created Llama 3.1 Nemotron 70B Instruct?

Llama 3.1 Nemotron 70B Instruct was created by Nvidia.

What is the license for Llama 3.1 Nemotron 70B Instruct?

Llama 3.1 Nemotron 70B Instruct is released under the Llama 3.1 Community License license. This is an open-source / open-weight license that permits self-hosting.

What is the knowledge cutoff date for Llama 3.1 Nemotron 70B Instruct?

Llama 3.1 Nemotron 70B Instruct has a knowledge cutoff of December 2023, meaning it was trained on data up to that point and may not know about events after it.

Where is the Llama 3.1 Nemotron 70B Instruct paper or technical report?

Llama 3.1 Nemotron 70B Instruct has a paper or technical report available at https://arxiv.org/abs/2410.01257. Use that source for architecture, training, release and evaluation details.