The AI arena is free today

Open Superagent

Aion 1.0 Instruct vs Gemma 3 4B

Aion 1.0 Instruct and Gemma 3 4B are closely matched at -6.6 and -2.5 on the LLM Stats Score.

Microsoft · Google · Updated for 2026

Which is better?

Aion 1.0 Instruct and Gemma 3 4B are closely matched on the overall LLM Stats Score at -6.6 and -2.5.

In the 4 individual benchmarks reported for both models, Gemma 3 4B wins 4; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Aion 1.0 Instruct

  • you want the most recent training data — it shipped Nov 2026

Choose Gemma 3 4B

  • you value its reported benchmark strengths — it wins 4 of 4 exact shared results

At a glance

The differences that matter most.

Core performance indexes
-6.6
#414
-2.5
#391
-10.1
#411
-3.4
#387
Cost, coverage & limits
Benchmark wins
0 of 4
4 of 4
Input price
— / M
$0.02 / M
Output price
— / M
$0.04 / M
Context window
—
131,072

Capability indexes

Additional strengths measured across groups of related public benchmarks

1 shared
Index
Aion 1.0 Instruct
Gemma 3 4B
-7.6#357
5.1#302
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

9 reported for Aion 1.0 Instruct · 26 for Gemma 3 4B

4 shared

Aion 1.0 Instruct outperforms in 0 benchmarks, while Gemma 3 4B is better at 4 benchmarks (GPQA, GSM8k, IFEval, MMLU-Pro).

Gemma 3 4B significantly outperforms across most benchmarks.

Fri Nov 20 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Model Size

Parameter count comparison

1.7B diff

Gemma 3 4B has 1.7B more parameters than Aion 1.0 Instruct, making it 74.8% larger.

Microsoft
Aion 1.0 Instruct
2.3Bparameters
Google
Gemma 3 4B
4.0Bparameters
2.3B
Aion 1.0 Instruct
4.0B
Gemma 3 4B

Context Window

Maximum input and output token capacity

Only Gemma 3 4B specifies input context (131,072 tokens). Only Gemma 3 4B specifies output context (131,072 tokens).

Microsoft
Aion 1.0 Instruct
Input- tokens
Output- tokens
Google
Gemma 3 4B
Input131,072 tokens
Output131,072 tokens
Fri Nov 20 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Gemma 3 4B supports multimodal inputs, whereas Aion 1.0 Instruct does not.

Gemma 3 4B can handle both text and other forms of data like images, making it suitable for multimodal applications.

Aion 1.0 Instruct

Text
Images
Audio
Video

Gemma 3 4B

Text
Images
Audio
Video

License

Usage and distribution terms

Aion 1.0 Instruct is licensed under MIT, while Gemma 3 4B uses Gemma.

License differences may affect how you can use these models in commercial or open-source projects.

Aion 1.0 Instruct

MIT

Open weights

Gemma 3 4B

Gemma

Open weights

Release Timeline

When each model was launched

Aion 1.0 Instruct was released on 2026-11-18, while Gemma 3 4B was released on 2025-03-12.

Aion 1.0 Instruct is 21 months newer than Gemma 3 4B.

Aion 1.0 Instruct

Nov 18, 2026

1 days ago

1.7yr newer
Gemma 3 4B

Mar 12, 2025

1.7 years ago

Knowledge Cutoff

When training data ends

Aion 1.0 Instruct has a knowledge cutoff of 2025-12-01, while Gemma 3 4B has a cutoff of 2024-08-01.

Aion 1.0 Instruct has more recent training data (up to 2025-12-01), making it potentially better informed about events through that date compared to Gemma 3 4B (2024-08-01).

Aion 1.0 Instruct

Dec 2025

1.3 yr newer
Gemma 3 4B

Aug 2024

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Aion 1.0 Instruct and Gemma 3 4B side-by-side, then vote on the output you prefer.

Aion 1.0 Instruct
✓ Preferred
Gemma 3 4B
Open in Playground

FAQ

Common questions about Aion 1.0 Instruct vs Gemma 3 4B.

Which is better, Aion 1.0 Instruct or Gemma 3 4B?

Aion 1.0 Instruct and Gemma 3 4B are closely matched on the LLM Stats Score at -6.6 and -2.5. Aion 1.0 Instruct is made by Microsoft and Gemma 3 4B is made by Google. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Aion 1.0 Instruct compare to Gemma 3 4B in benchmarks?

Aion 1.0 Instruct scores IFEval: 83.9%, GSM8k: 74.9%, Multi-IF: 64.7%, MMLU: 55.1%, MATH-500: 48.0%. Gemma 3 4B scores IFEval: 90.2%, GSM8k: 89.2%, DocVQA: 75.8%, MATH: 75.6%, AI2D: 74.8%.

What are the context window sizes for Aion 1.0 Instruct and Gemma 3 4B?

Aion 1.0 Instruct supports an unknown number of tokens and Gemma 3 4B supports 131K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Aion 1.0 Instruct and Gemma 3 4B?

Key differences include LLM Stats Score (-6.6 vs -2.5), multimodal support (no vs yes), licensing (MIT vs Gemma). See the full comparison above for benchmark-by-benchmark results.

Who makes Aion 1.0 Instruct and Gemma 3 4B?

Aion 1.0 Instruct is developed by Microsoft and Gemma 3 4B is developed by Google.