Model Comparison

GPT-4o mini vs Gemini 1.5 FlashWhich is better in 2026?

Gemini 1.5 Flash has a slight edge in benchmark performance. GPT-4o mini and Gemini 1.5 Flash cost the same.

Verdict: GPT-4o mini vs Gemini 1.5 Flash — which is better?

GPT-4o mini (by OpenAI) and Gemini 1.5 Flash (by Google) are two of the AI models people compare most. Here is how they stack up on benchmarks, price and capabilities, and which one to pick in 2026.

GPT-4o mini outperforms in 3 benchmarks (HumanEval, MGSM, MMLU), while Gemini 1.5 Flash is better at 4 benchmarks (GPQA, MATH, MathVista, MMMU). Gemini 1.5 Flash has a slight edge in benchmark performance.

Gemini 1.5 Flash also accepts a larger context window (1,048,576 input tokens), making it the stronger choice for long documents and large codebases.

Choose GPT-4o mini if…

  • you want the most recent training data — it shipped Jul 2024

Choose Gemini 1.5 Flash if…

  • you want the strongest raw capability — it leads on 4 of 7 shared benchmarks
  • you process long inputs — it offers a 1,048,576 token context window
Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

7 benchmarks

GPT-4o mini outperforms in 3 benchmarks (HumanEval, MGSM, MMLU), while Gemini 1.5 Flash is better at 4 benchmarks (GPQA, MATH, MathVista, MMMU).

Gemini 1.5 Flash has a slight edge in benchmark performance.

Tue Jun 16 2026 • llm-stats.com

Arena Performance

Human preference votes

Pricing Analysis

Price comparison per million tokens

For input processing, GPT-4o mini ($0.15/1M tokens) costs the same as Gemini 1.5 Flash ($0.15/1M tokens).

For output processing, GPT-4o mini ($0.60/1M tokens) costs the same as Gemini 1.5 Flash ($0.60/1M tokens).

In conclusion, GPT-4o mini and Gemini 1.5 Flash cost the same.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers
Tue Jun 16 2026 • llm-stats.com
OpenAI
GPT-4o mini
Input tokens$0.15
Output tokens$0.60
Best providerAzure
Google
Gemini 1.5 Flash
Input tokens$0.15
Output tokens$0.60
Best providerGoogle
Notice missing or incorrect data?Start an Issue→

Context Window

Maximum input and output token capacity

Gemini 1.5 Flash accepts 1,048,576 input tokens compared to GPT-4o mini's 128,000 tokens. GPT-4o mini can generate longer responses up to 16,384 tokens, while Gemini 1.5 Flash is limited to 8,192 tokens.

OpenAI
GPT-4o mini
Input128,000 tokens
Output16,384 tokens
Google
Gemini 1.5 Flash
Input1,048,576 tokens
Output8,192 tokens
Tue Jun 16 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Both GPT-4o mini and Gemini 1.5 Flash support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

GPT-4o mini

Text
Images
Audio
Video

Gemini 1.5 Flash

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under proprietary licenses.

Both models have usage restrictions defined by their respective organizations.

GPT-4o mini

Proprietary

Closed source

Gemini 1.5 Flash

Proprietary

Closed source

Release Timeline

When each model was launched

GPT-4o mini was released on 2024-07-18, while Gemini 1.5 Flash was released on 2024-05-01.

GPT-4o mini is 3 months newer than Gemini 1.5 Flash.

GPT-4o mini

Jul 18, 2024

1.9 years ago

2mo newer
Gemini 1.5 Flash

May 1, 2024

2.1 years ago

Knowledge Cutoff

When training data ends

GPT-4o mini has a knowledge cutoff of 2023-10-01, while Gemini 1.5 Flash has a cutoff of 2023-11-01.

Gemini 1.5 Flash has more recent training data (up to 2023-11-01), making it potentially better informed about events through that date compared to GPT-4o mini (2023-10-01).

GPT-4o mini

Oct 2023

Gemini 1.5 Flash

Nov 2023

1 mo newer

Provider Availability

GPT-4o mini is available from Azure. Gemini 1.5 Flash is available from Google.

GPT-4o mini

azure logo
Azure
Input Price:Input: $0.15/1MOutput Price:Output: $0.60/1M

Gemini 1.5 Flash

google logo
Google
Input Price:Input: $0.15/1MOutput Price:Output: $0.60/1M
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Key Takeaways

OpenAI
Higher HumanEval score (87.2% vs 74.3%)
Higher MGSM score (87.0% vs 82.6%)
Higher MMLU score (82.0% vs 78.9%)
Google
Larger context window (1,048,576 tokens)
Higher GPQA score (51.0% vs 40.2%)
Higher MATH score (77.9% vs 70.2%)
Higher MathVista score (65.8% vs 56.7%)
Higher MMMU score (62.3% vs 59.4%)
OpenAIGPT-4o mini
GoogleGemini 1.5 Flash
Compare in Playground

Detailed Comparison

AI Model Comparison Table
Feature
OpenAI
GPT-4o mini
Google
Gemini 1.5 Flash

FAQ

Common questions about GPT-4o mini vs Gemini 1.5 Flash.

Which is better, GPT-4o mini or Gemini 1.5 Flash?

Gemini 1.5 Flash has a slight edge in benchmark performance. GPT-4o mini is made by OpenAI and Gemini 1.5 Flash is made by Google. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does GPT-4o mini compare to Gemini 1.5 Flash in benchmarks?

GPT-4o mini scores HumanEval: 87.2%, MGSM: 87.0%, MMLU: 82.0%, DROP: 79.7%, MATH: 70.2%. Gemini 1.5 Flash scores XSTest: 97.0%, FLEURS: 90.4%, HellaSwag: 86.5%, GSM8k: 86.2%, BIG-Bench Hard: 85.5%.

Is GPT-4o mini cheaper than Gemini 1.5 Flash?

Both models cost $0.15 per million input tokens.

What are the context window sizes for GPT-4o mini and Gemini 1.5 Flash?

GPT-4o mini supports 128K tokens and Gemini 1.5 Flash supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between GPT-4o mini and Gemini 1.5 Flash?

Key differences include context window (128K vs 1.0M). See the full comparison above for benchmark-by-benchmark results.

Who makes GPT-4o mini and Gemini 1.5 Flash?

GPT-4o mini is developed by OpenAI and Gemini 1.5 Flash is developed by Google.

Related comparisons