- Organizations
- Meta
- Llama 3.2 3B Instruct
Llama 3.2 3B Instruct: API Pricing, Context Window & Benchmarks
Llama 3.2 3B Instruct is a language model from Meta, released in September 2024.
Llama 3.2 3B Instruct is a large language model that supports a context length of 128K tokens and are state-of-the-art in their class for on-device use cases like summarization, instruction following, and rewriting tasks running locally at
Llama 3.2 3B Instruct benchmarks
Rankings
Quality Tracker
Llama 3.2 3B Instruct Performance Across Datasets
Scores sourced from the model's scorecard, paper, or official blog posts
Llama 3.2 3B Instruct pricing
Providers
Llama 3.2 3B Instruct starts at $0.0100 per million input tokens and $0.0200 per million output tokens via DeepInfra.
| Provider | Input $/M | Cached input $/M | Output $/M | Context in / out | TTFT p95 s | Output p5 c/s | Modalities in / out |
|---|---|---|---|---|---|---|---|
| $0.0100 | — | $0.0200 | 128.0K/128.0K | 0.24 | — | / |
Cached input is the discounted price for prompt tokens served from a provider cache. TTFT is time to first token. Output is characters per second; p5 is the sustained floor exceeded by 95% of observed requests.
Llama 3.2 3B Instruct model size
Llama 3.2 3B Instruct has 3.2 billion parameters and was trained on 9 trillion tokens. See how it compares to other models in the same parameter range.
Llama 3.2 3B Instruct context window
Input and output token limits for Llama 3.2 3B Instruct, plus how it ranks on long-context understanding.
Llama 3.2 3B Instruct API
Available from the model provider
Llama 3.2 3B Instruct has an official provider API. It is not currently routed through the LLM Stats gateway.
Read the official API documentationLlama 3.2 3B Instruct latency
Llama 3.2 3B Instruct time to first token, sustained output throughput, and failed-request rate from live API traffic over the trailing 7 days.
Llama 3.2 3B Instruct examples
Recent arena outputs from Llama 3.2 3B Instruct, picked from the highest-ranked matchups.
Llama 3.2 3B Instruct license
Llama 3.2 3B Instruct is released under the Llama 3.2 Community License license, which restricts commercial use, has 3.2B parameters.
- License
- Llama 3.2 Community License
- Non-commercial
- Parameters
- 3.2B
Llama 3.2 3B Instruct resources
Official sources for Llama 3.2 3B Instruct: api documentation, official playground, official launch post, model weights.
Llama 3.2 3B Instruct vs other models
The most-compared alternatives to Llama 3.2 3B Instruct are Claude 3 Haiku, Granite 3.3 8B Base, Llama 3.2 11B Instruct. Open any pair side-by-side for benchmarks, pricing, context, and latency.
Models like Llama 3.2 3B Instruct
Models ranked just above and below Llama 3.2 3B Instruct by LLM Stats score.
FAQ
Common questions about Llama 3.2 3B Instruct.