Model Comparison

Gemma 3 27B vs Phi-4-multimodal-instruct

Phi-4-multimodal-instruct significantly outperforms across most benchmarks. Phi-4-multimodal-instruct is 2.0x cheaper per token.

Performance Benchmarks

Comparative analysis across standard metrics

5 benchmarks

Gemma 3 27B outperforms in 1 benchmarks (AI2D), while Phi-4-multimodal-instruct is better at 4 benchmarks (ChartQA, DocVQA, InfoVQA, TextVQA).

Phi-4-multimodal-instruct significantly outperforms across most benchmarks.

Sun May 31 2026 • llm-stats.com

Arena Performance

Human preference votes

Pricing Analysis

Price comparison per million tokens

Phi-4-multimodal-instruct costs less

For input processing, Gemma 3 27B ($0.10/1M tokens) is 2.0x more expensive than Phi-4-multimodal-instruct ($0.05/1M tokens).

For output processing, Gemma 3 27B ($0.20/1M tokens) is 2.0x more expensive than Phi-4-multimodal-instruct ($0.10/1M tokens).

In conclusion, Gemma 3 27B is more expensive than Phi-4-multimodal-instruct.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Sun May 31 2026 • llm-stats.com
Google
Gemma 3 27B
Input tokens$0.10
Output tokens$0.20
Best providerDeepinfra
Microsoft
Phi-4-multimodal-instruct
Input tokens$0.05
Output tokens$0.10
Best providerDeepinfra
Notice missing or incorrect data?Start an Issue

Model Size

Parameter count comparison

21.4B diff

Gemma 3 27B has 21.4B more parameters than Phi-4-multimodal-instruct, making it 382.1% larger.

Google
Gemma 3 27B
27.0Bparameters
Microsoft
Phi-4-multimodal-instruct
5.6Bparameters
27.0B
Gemma 3 27B
5.6B
Phi-4-multimodal-instruct

Context Window

Maximum input and output token capacity

Gemma 3 27B accepts 131,072 input tokens compared to Phi-4-multimodal-instruct's 128,000 tokens. Gemma 3 27B can generate longer responses up to 131,072 tokens, while Phi-4-multimodal-instruct is limited to 128,000 tokens.

Google
Gemma 3 27B
Input131,072 tokens
Output131,072 tokens
Microsoft
Phi-4-multimodal-instruct
Input128,000 tokens
Output128,000 tokens
Sun May 31 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Both Gemma 3 27B and Phi-4-multimodal-instruct support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemma 3 27B

Text
Images
Audio
Video

Phi-4-multimodal-instruct

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 3 27B is licensed under Gemma, while Phi-4-multimodal-instruct uses MIT.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 3 27B

Gemma

Open weights

Phi-4-multimodal-instruct

MIT

Open weights

Release Timeline

When each model was launched

Gemma 3 27B was released on 2025-03-12, while Phi-4-multimodal-instruct was released on 2025-02-01.

Gemma 3 27B is 1 month newer than Phi-4-multimodal-instruct.

Gemma 3 27B

Mar 12, 2025

1.2 years ago

1mo newer
Phi-4-multimodal-instruct

Feb 1, 2025

1.3 years ago

Knowledge Cutoff

When training data ends

Phi-4-multimodal-instruct has a documented knowledge cutoff of 2024-06-01, while Gemma 3 27B's cutoff date is not specified.

We can confirm Phi-4-multimodal-instruct's training data extends to 2024-06-01, but cannot make a direct comparison without Gemma 3 27B's cutoff date.

Gemma 3 27B

Phi-4-multimodal-instruct

Jun 2024

Provider Availability

Gemma 3 27B is available from DeepInfra, Novita. Phi-4-multimodal-instruct is available from DeepInfra.

Gemma 3 27B

deepinfra logo
Deepinfra
Input Price:Input: $0.10/1MOutput Price:Output: $0.20/1M
novita logo
Novita
Input Price:Input: $0.11/1MOutput Price:Output: $0.20/1M

Phi-4-multimodal-instruct

deepinfra logo
Deepinfra
Input Price:Input: $0.05/1MOutput Price:Output: $0.10/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Key Takeaways

Larger context window (131,072 tokens)
Higher AI2D score (84.5% vs 82.3%)
Less expensive input tokens
Less expensive output tokens
Higher ChartQA score (81.4% vs 78.0%)
Higher DocVQA score (93.2% vs 86.6%)
Higher InfoVQA score (72.7% vs 70.6%)
Higher TextVQA score (75.6% vs 65.1%)

Detailed Comparison

AI Model Comparison Table
Feature
Google
Gemma 3 27B
Microsoft
Phi-4-multimodal-instruct

FAQ

Common questions about Gemma 3 27B vs Phi-4-multimodal-instruct.

Which is better, Gemma 3 27B or Phi-4-multimodal-instruct?

Phi-4-multimodal-instruct significantly outperforms across most benchmarks. Gemma 3 27B is made by Google and Phi-4-multimodal-instruct is made by Microsoft. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemma 3 27B compare to Phi-4-multimodal-instruct in benchmarks?

Gemma 3 27B scores GSM8k: 95.9%, IFEval: 90.4%, MATH: 89.0%, HumanEval: 87.8%, BIG-Bench Hard: 87.6%. Phi-4-multimodal-instruct scores ScienceQA Visual: 97.5%, DocVQA: 93.2%, MMBench: 86.7%, POPE: 85.6%, OCRBench: 84.4%.

Is Gemma 3 27B cheaper than Phi-4-multimodal-instruct?

Phi-4-multimodal-instruct is 2.0x cheaper for input tokens. Gemma 3 27B costs $0.10/M input and $0.20/M output via deepinfra. Phi-4-multimodal-instruct costs $0.05/M input and $0.10/M output via deepinfra.

What are the context window sizes for Gemma 3 27B and Phi-4-multimodal-instruct?

Gemma 3 27B supports 131K tokens and Phi-4-multimodal-instruct supports 128K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 3 27B and Phi-4-multimodal-instruct?

Key differences include context window (131K vs 128K), input pricing ($0.10 vs $0.05/M), licensing (Gemma vs MIT). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 3 27B and Phi-4-multimodal-instruct?

Gemma 3 27B is developed by Google and Phi-4-multimodal-instruct is developed by Microsoft.