The AI arena is free today

Open Superagent

Gemma 4 31B vs GPT-5.4 mini

Gemma 4 31B and GPT-5.4 mini are closely matched at 33.1 and 30.1 on the LLM Stats Score. Gemma 4 31B is 11.1x cheaper per token.

Google · OpenAI · Updated for 2026

Which is better?

Gemma 4 31B and GPT-5.4 mini are closely matched on the overall LLM Stats Score at 33.1 and 30.1.

The models split the 4 individual benchmarks reported for both models evenly.

On price, Gemma 4 31B is roughly 11.1x cheaper per token on a blended 3:1 input/output basis, which adds up quickly at production volume.

GPT-5.4 mini also accepts a larger context window (400,000 input tokens), making it the stronger choice for long documents and large codebases.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemma 4 31B

  • cost matters — it's about 11.1x cheaper per token
  • you want the most recent training data — it shipped Apr 2026
  • you need open weights you can self-host or fine-tune

Choose GPT-5.4 mini

  • you process long inputs — it offers a 400,000 token context window

At a glance

The differences that matter most.

Core performance indexes
33.1
#101
30.1
#121
33.6
#94
31.9
#106
13.6
#91
19.3
#64
Cost, coverage & limits
Benchmark wins
2 of 4
2 of 4
Input price
$0.09 / M
$0.75 / M
Output price
$0.34 / M
$4.50 / M
Context window
262,144
400,000

Capability indexes

Additional strengths measured across groups of related public benchmarks

3 shared
Index
Gemma 4 31B
GPT-5.4 mini
19.6#72
20.2#69
16.7#45
7.8#90
22.4#59
22.8#58
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

12 reported for Gemma 4 31B · 15 for GPT-5.4 mini

4 shared

Gemma 4 31B outperforms in 2 benchmarks (MMMU-Pro, MRCR v2 (8-needle)), while GPT-5.4 mini is better at 2 benchmarks (GPQA, Humanity's Last Exam).

Both models are evenly matched across the benchmarks.

Mon Sep 21 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Pricing Analysis

Price comparison per million tokens

Gemma 4 31B costs less

For input processing, Gemma 4 31B ($0.09/1M tokens) is 8.3x cheaper than GPT-5.4 mini ($0.75/1M tokens).

For output processing, Gemma 4 31B ($0.34/1M tokens) is 13.2x cheaper than GPT-5.4 mini ($4.50/1M tokens).

In conclusion, GPT-5.4 mini is more expensive than Gemma 4 31B.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Mon Sep 21 2026 • llm-stats.com
Google
Gemma 4 31B
Input tokens$0.09
Output tokens$0.34
Best providerDeepinfra
OpenAI
GPT-5.4 mini
Input tokens$0.75
Output tokens$4.50
Best providerOpenAI
Notice missing or incorrect data?Start an Issue

Context Window

Maximum input and output token capacity

GPT-5.4 mini accepts 400,000 input tokens compared to Gemma 4 31B's 262,144 tokens. Gemma 4 31B can generate longer responses up to 262,144 tokens, while GPT-5.4 mini is limited to 128,000 tokens.

Google
Gemma 4 31B
Input262,144 tokens
Output262,144 tokens
OpenAI
GPT-5.4 mini
Input400,000 tokens
Output128,000 tokens
Mon Sep 21 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Gemma 4 31B and GPT-5.4 mini support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemma 4 31B

Text
Images
Audio
Video

GPT-5.4 mini

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 4 31B is licensed under Apache 2.0, while GPT-5.4 mini uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 4 31B

Apache 2.0

Open weights

GPT-5.4 mini

Proprietary

Closed source

Release Timeline

When each model was launched

Gemma 4 31B was released on 2026-04-02, while GPT-5.4 mini was released on 2026-03-17.

Gemma 4 31B is 1 month newer than GPT-5.4 mini.

Gemma 4 31B

Apr 2, 2026

5 months ago

2w newer
GPT-5.4 mini

Mar 17, 2026

6 months ago

Knowledge Cutoff

When training data ends

Gemma 4 31B has a knowledge cutoff of 2025-01-01, while GPT-5.4 mini has a cutoff of 2025-08-31.

GPT-5.4 mini has more recent training data (up to 2025-08-31), making it potentially better informed about events through that date compared to Gemma 4 31B (2025-01-01).

Gemma 4 31B

Jan 2025

GPT-5.4 mini

Aug 2025

7 mo newer

Provider Availability

Gemma 4 31B is available from DeepInfra, FriendliAI, Novita, Together. GPT-5.4 mini is available from OpenAI.

Gemma 4 31B

deepinfra logo
Deepinfra
Input Price:Input: $0.09/1MOutput Price:Output: $0.34/1M
friendli logo
FriendliAI
Input Price:Input: $0.14/1MOutput Price:Output: $0.40/1M
novita logo
Novita
Input Price:Input: $0.14/1MOutput Price:Output: $0.40/1M
together logo
Together
Input Price:Input: $0.39/1MOutput Price:Output: $0.97/1M

GPT-5.4 mini

openai logo
OpenAI
Input Price:Input: $0.75/1MOutput Price:Output: $4.50/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Gemma 4 31B and GPT-5.4 mini side-by-side, then vote on the output you prefer.

Gemma 4 31B
✓ Preferred
GPT-5.4 mini
Open in Playground

FAQ

Common questions about Gemma 4 31B vs GPT-5.4 mini.

Which is better, Gemma 4 31B or GPT-5.4 mini?

Gemma 4 31B and GPT-5.4 mini are closely matched on the LLM Stats Score at 33.1 and 30.1. Gemma 4 31B is made by Google and GPT-5.4 mini is made by OpenAI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Gemma 4 31B compare to GPT-5.4 mini in benchmarks?

Gemma 4 31B scores AIME 2026: 89.2%, MMMLU: 88.4%, t2-bench: 86.4%, MathVision: 85.6%, MMLU-Pro: 85.2%. GPT-5.4 mini scores Tau2 Telecom: 93.4%, GPQA: 88.0%, OmniDocBench 1.5: 87.4%, MMMU-Pro: 76.6%, Graphwalks BFS <128k: 76.3%.

Is Gemma 4 31B cheaper than GPT-5.4 mini?

Gemma 4 31B is 8.3x cheaper for input tokens. Gemma 4 31B costs $0.09/M input and $0.34/M output via deepinfra. GPT-5.4 mini costs $0.75/M input and $4.50/M output via openai.

What are the context window sizes for Gemma 4 31B and GPT-5.4 mini?

Gemma 4 31B supports 262K tokens and GPT-5.4 mini supports 400K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 4 31B and GPT-5.4 mini?

Key differences include LLM Stats Score (33.1 vs 30.1), context window (262K vs 400K), input pricing ($0.09 vs $0.75/M), licensing (Apache 2.0 vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 4 31B and GPT-5.4 mini?

Gemma 4 31B is developed by Google and GPT-5.4 mini is developed by OpenAI.