The AI arena is free today

Open Superagent

Gemma 3 4B vs LFM2.5-VL-3B

LFM2.5-VL-3B shows notably better performance in the majority of benchmarks.

Google · Liquid AI · Updated for 2026

Which is better?

Gemma 3 4B outperforms in 2 benchmarks (IFEval, MMMU (val)), while LFM2.5-VL-3B is better at 4 benchmarks (ChartQA, DocVQA, MathVista-Mini, TextVQA). LFM2.5-VL-3B shows notably better performance in the majority of benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Gemma 3 4B

  • you want predictable pricing at $0.02/M input and $0.04/M output

Choose LFM2.5-VL-3B

  • you want the strongest raw capability — it leads on 4 of 6 shared benchmarks
  • you want the most recent training data — it shipped Aug 2026

At a glance

The differences that matter most.

Gemma 3 4B
Google
LFM2.5-VL-3B
Liquid AI
Benchmark wins
2 of 6
4 of 6
Input price
$0.02 / M
— / M
Output price
$0.04 / M
— / M
Context window
131,072
—
Released
Mar 2025
Aug 2026
License
Gemma
LFM Open License v1.0

Performance Benchmarks

Comparative analysis across standard metrics

6 benchmarks

Gemma 3 4B outperforms in 2 benchmarks (IFEval, MMMU (val)), while LFM2.5-VL-3B is better at 4 benchmarks (ChartQA, DocVQA, MathVista-Mini, TextVQA).

LFM2.5-VL-3B shows notably better performance in the majority of benchmarks.

Mon Aug 24 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Model Size

Parameter count comparison

876.5M diff

Gemma 3 4B has 0.9B more parameters than LFM2.5-VL-3B, making it 28.1% larger.

Google
Gemma 3 4B
4.0Bparameters
Liquid AI
LFM2.5-VL-3B
3.1Bparameters
4.0B
Gemma 3 4B
3.1B
LFM2.5-VL-3B

Context Window

Maximum input and output token capacity

Only Gemma 3 4B specifies input context (131,072 tokens). Only Gemma 3 4B specifies output context (131,072 tokens).

Google
Gemma 3 4B
Input131,072 tokens
Output131,072 tokens
Liquid AI
LFM2.5-VL-3B
Input- tokens
Output- tokens
Mon Aug 24 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Both Gemma 3 4B and LFM2.5-VL-3B support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemma 3 4B

Text
Images
Audio
Video

LFM2.5-VL-3B

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 3 4B is licensed under Gemma, while LFM2.5-VL-3B uses LFM Open License v1.0.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 3 4B

Gemma

Open weights

LFM2.5-VL-3B

LFM Open License v1.0

Open weights

Release Timeline

When each model was launched

Gemma 3 4B was released on 2025-03-12, while LFM2.5-VL-3B was released on 2026-08-12.

LFM2.5-VL-3B is 17 months newer than Gemma 3 4B.

Gemma 3 4B

Mar 12, 2025

1.5 years ago

LFM2.5-VL-3B

Aug 12, 2026

1 weeks ago

1.4yr newer

Knowledge Cutoff

When training data ends

Gemma 3 4B has a documented knowledge cutoff of 2024-08-01, while LFM2.5-VL-3B's cutoff date is not specified.

We can confirm Gemma 3 4B's training data extends to 2024-08-01, but cannot make a direct comparison without LFM2.5-VL-3B's cutoff date.

Gemma 3 4B

Aug 2024

LFM2.5-VL-3B

—

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Gemma 3 4B and LFM2.5-VL-3B side-by-side, then vote on the output you prefer.

Gemma 3 4B
✓ Preferred
LFM2.5-VL-3B
Open in Playground

FAQ

Common questions about Gemma 3 4B vs LFM2.5-VL-3B.

Which is better, Gemma 3 4B or LFM2.5-VL-3B?

LFM2.5-VL-3B shows notably better performance in the majority of benchmarks. Gemma 3 4B is made by Google and LFM2.5-VL-3B is made by Liquid AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does Gemma 3 4B compare to LFM2.5-VL-3B in benchmarks?

Gemma 3 4B scores IFEval: 90.2%, GSM8k: 89.2%, DocVQA: 75.8%, MATH: 75.6%, AI2D: 74.8%. LFM2.5-VL-3B scores DocVQA: 91.1%, POPE: 88.7%, RefCOCO-avg: 87.9%, TextVQA: 84.3%, OCRBench: 84.2%.

What are the context window sizes for Gemma 3 4B and LFM2.5-VL-3B?

Gemma 3 4B supports 131K tokens and LFM2.5-VL-3B supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 3 4B and LFM2.5-VL-3B?

Key differences include licensing (Gemma vs LFM Open License v1.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 3 4B and LFM2.5-VL-3B?

Gemma 3 4B is developed by Google and LFM2.5-VL-3B is developed by Liquid AI.

Related comparisons