MicrosoftReleased on Aug 23, 2024

Phi-3.5-mini-instruct: API Pricing, Context Window & Benchmarks

Phi-3.5-mini-instruct is a language model from Microsoft, released in August 2024.

Phi-3.5-mini-instruct is a 3.8B-parameter model that supports up to 128K context tokens, with improved multilingual capabilities across over 20 languages. It underwent additional training and safety post-training to enhance

Input
Text
Output
Text

Phi-3.5-mini-instruct benchmarks

Rankings

Quality Tracker

Phi-3.5-mini-instruct Performance Across Datasets

Scores sourced from the model's scorecard, paper, or official blog posts

LLM Stats Logollm-stats.com - Mon Jul 20 2026
Notice missing or incorrect data?

Phi-3.5-mini-instruct pricing

Providers

Phi-3.5-mini-instruct starts at $0.100 per million input tokens and $0.100 per million output tokens via Azure.

ProviderInput $/MOutput $/MContext in / outTTFT p50 / p95 sOutput avg / p5 c/sSuccess 7dModalities in / out
Azure logoAzure
$0.100$0.100128.0K/128.0K
/0.52
23/
/

Cached input is the discounted price for prompt tokens served from a provider cache. TTFT is time to first token. Output is characters per second; p5 is the sustained floor exceeded by 95% of observed requests. Success is calculated from completed versus failed requests over the trailing seven days.

Phi-3.5-mini-instruct model size

Phi-3.5-mini-instruct has 3.8 billion parameters and was trained on 3.4 trillion tokens. See how it compares to other models in the same parameter range.

ParametersTraining tokens
3.8B
3.4Ttokens
895× tokens-to-params ratio
Small (3–10B)
3.8B
1B7B70B405B

Phi-3.5-mini-instruct context window

Input and output token limits for Phi-3.5-mini-instruct, plus how it ranks on long-context understanding.

InputOutput
128Ktokens
128Ktokens
192 pages of text
128K
8K128K1M

Phi-3.5-mini-instruct API

Available from the model provider

Phi-3.5-mini-instruct has an official provider API. It is not currently routed through the LLM Stats gateway.

Read the official API documentation

Phi-3.5-mini-instruct latency

Phi-3.5-mini-instruct time to first token, sustained output throughput, and failed-request rate from live API traffic over the trailing 7 days.

Phi-3.5-mini-instruct examples

Recent arena outputs from Phi-3.5-mini-instruct, picked from the highest-ranked matchups.

Phi-3.5-mini-instruct license

Phi-3.5-mini-instruct is released under the MIT license, which permits commercial use, has 3.8B parameters.

License
MIT
Commercial use allowed
Parameters
3.8B

MIT License - allows commercial use

Phi-3.5-mini-instruct resources

Official sources for Phi-3.5-mini-instruct: api documentation, paper or system card, official launch post.

Phi-3.5-mini-instruct vs other models

The most-compared alternatives to Phi-3.5-mini-instruct are Mistral NeMo Instruct, Hermes 3 70B, Llama 4 Scout. Open any pair side-by-side for benchmarks, pricing, context, and latency.

Models like Phi-3.5-mini-instruct

Models ranked just above and below Phi-3.5-mini-instruct by LLM Stats score.

 

Mistral NeMo Instruct

Score pending
 

Hermes 3 70B

Score pending
 

Llama 4 Scout

Score pending
 

Llama 3.1 8B Instruct

Score pending
 

Qwen2.5-Coder 32B Instruct

Score pending
 

Qwen2.5-Omni-7B

Score pending

FAQ

Common questions about Phi-3.5-mini-instruct.

When was Phi-3.5-mini-instruct released?

Phi-3.5-mini-instruct was released on August 23, 2024 by Microsoft. This is the official Phi-3.5-mini-instruct release date tracked on LLM Stats.

How much does Phi-3.5-mini-instruct cost?

Phi-3.5-mini-instruct pricing starts at $0.10 per million input tokens and $0.10 per million output tokens via Azure, the lowest price among tracked providers.

Is Phi-3.5-mini-instruct available via API?

Yes, Phi-3.5-mini-instruct is available via API. See the official documentation for authentication and endpoint details. It is served by 1 provider tracked on LLM Stats.

How big is Phi-3.5-mini-instruct?

Phi-3.5-mini-instruct has 3.8 billion parameters. It was trained on 3.4 trillion tokens. It ships as an open-weight model, so you can download and run it on your own hardware.

Who created Phi-3.5-mini-instruct?

Phi-3.5-mini-instruct was created by Microsoft.

What is the license for Phi-3.5-mini-instruct?

Phi-3.5-mini-instruct is released under the MIT license. This is an open-source / open-weight license that permits self-hosting.

What is Phi-3.5-mini-instruct latency?

Phi-3.5-mini-instruct p95 time to first token is 0.52 seconds via Azure over the trailing 7 days. Lower time to first token means the model begins responding sooner for chat, agents and API workloads.

Where can I use Phi-3.5-mini-instruct?

Phi-3.5-mini-instruct is available through 1 provider including Azure.

Where is the Phi-3.5-mini-instruct paper or technical report?

Phi-3.5-mini-instruct has a paper or technical report available at https://arxiv.org/abs/2404.14219. Use that source for architecture, training, release and evaluation details.

What models should I compare Phi-3.5-mini-instruct against?

Common Phi-3.5-mini-instruct comparisons include Phi-3.5-mini-instruct vs Mistral NeMo Instruct, Phi-3.5-mini-instruct vs Hermes 3 70B, Phi-3.5-mini-instruct vs Llama 4 Scout. Compare them side by side for benchmark scores, pricing, context window, latency and API availability.