The AI arena is free today

Open Superagent

Grok-3 Mini vs MedGemma 4B IT

Grok-3 Mini leads the LLM Stats Score 31.6 to -4.4.

xAI · Google · Updated for 2026

Which is better?

Grok-3 Mini leads the overall LLM Stats Score 31.6 to -4.4, ranking #103 overall.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Grok-3 Mini

  • overall performance matters — it scores 31.6 and ranks #103 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes

Choose MedGemma 4B IT

  • you want the most recent training data — it shipped May 2025
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Grok-3 Mini
xAI
MedGemma 4B IT
Google
Core performance indexes
LLM Stats Score
31.6
#103
-4.4
#337
Reasoning
31.2
#102
-4.9
#332
Cost, coverage & limits
Benchmark wins
—
—
Input price
$0.30 / M
— / M
Output price
$0.50 / M
— / M
Context window
128,000
—

Individual benchmarks

4 reported for Grok-3 Mini · 7 for MedGemma 4B IT

No common benchmarks found

Grok-3 Mini and MedGemma 4B ITdon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Grok-3 Mini specifies input context (128,000 tokens). Only Grok-3 Mini specifies output context (8,000 tokens).

xAI
Grok-3 Mini
Input128,000 tokens
Output8,000 tokens
Google
MedGemma 4B IT
Input- tokens
Output- tokens
Fri Sep 04 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Grok-3 Mini and MedGemma 4B IT support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Grok-3 Mini

Text
Images
Audio
Video

MedGemma 4B IT

Text
Images
Audio
Video

License

Usage and distribution terms

Grok-3 Mini is licensed under a proprietary license, while MedGemma 4B IT uses Health AI Developer Foundations terms of use.

License differences may affect how you can use these models in commercial or open-source projects.

Grok-3 Mini

Proprietary

Closed source

MedGemma 4B IT

Health AI Developer Foundations terms of use

Open weights

Release Timeline

When each model was launched

Grok-3 Mini was released on 2025-02-17, while MedGemma 4B IT was released on 2025-05-20.

MedGemma 4B IT is 3 months newer than Grok-3 Mini.

Grok-3 Mini

Feb 17, 2025

1.5 years ago

MedGemma 4B IT

May 20, 2025

1.3 years ago

3mo newer

Knowledge Cutoff

When training data ends

Grok-3 Mini has a documented knowledge cutoff of 2024-11-17, while MedGemma 4B IT's cutoff date is not specified.

We can confirm Grok-3 Mini's training data extends to 2024-11-17, but cannot make a direct comparison without MedGemma 4B IT's cutoff date.

Grok-3 Mini

Nov 2024

MedGemma 4B IT

—

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Grok-3 Mini and MedGemma 4B IT side-by-side, then vote on the output you prefer.

Grok-3 Mini
✓ Preferred
MedGemma 4B IT
Open in Playground

FAQ

Common questions about Grok-3 Mini vs MedGemma 4B IT.

Which is better, Grok-3 Mini or MedGemma 4B IT?

Grok-3 Mini leads the LLM Stats Score 31.6 to -4.4. Grok-3 Mini is made by xAI and MedGemma 4B IT is made by Google. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Grok-3 Mini compare to MedGemma 4B IT in benchmarks?

Grok-3 Mini scores AIME 2024: 95.8%, AIME 2025: 90.8%, GPQA: 84.0%, LiveCodeBench: 80.4%. MedGemma 4B IT scores MIMIC CXR: 88.9%, DermMCQA: 71.8%, PathMCQA: 69.8%, SlakeVQA: 62.3%, VQA-Rad: 49.9%.

What are the context window sizes for Grok-3 Mini and MedGemma 4B IT?

Grok-3 Mini supports 128K tokens and MedGemma 4B IT supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Grok-3 Mini and MedGemma 4B IT?

Key differences include LLM Stats Score (31.6 vs -4.4), licensing (Proprietary vs Health AI Developer Foundations terms of use). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-3 Mini and MedGemma 4B IT?

Grok-3 Mini is developed by xAI and MedGemma 4B IT is developed by Google.

Related comparisons