The AI arena is free today

Open Superagent

Grok-4 Heavy vs LFM2.5-VL-3B

Comparing Grok-4 Heavy and LFM2.5-VL-3B across benchmarks, pricing, and capabilities.

xAI · Liquid AI · Updated for 2026

Which is better?

Grok-4 Heavy and LFM2.5-VL-3B trade strengths across price, capabilities, and technical limits. The better choice depends on the workload.

Based on current benchmark, pricing, and model metadata for 2026.

Choose Grok-4 Heavy

  • you are already invested in the xAI ecosystem

Choose LFM2.5-VL-3B

  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Grok-4 Heavy
xAI
LFM2.5-VL-3B
Liquid AI
Benchmark wins
—
—
Input price
— / M
— / M
Output price
— / M
— / M
Context window
—
—
Released
—
Aug 2026
License
Proprietary
LFM Open License v1.0

Performance Benchmarks

Comparative analysis across standard metrics

No common benchmarks found

Grok-4 Heavy and LFM2.5-VL-3Bdon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Arena Performance

Playground indexes and blind preference scores

Input Capabilities

Supported data types and modalities

Both Grok-4 Heavy and LFM2.5-VL-3B support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Grok-4 Heavy

Text
Images
Audio
Video

LFM2.5-VL-3B

Text
Images
Audio
Video

License

Usage and distribution terms

Grok-4 Heavy is licensed under a proprietary license, while LFM2.5-VL-3B uses LFM Open License v1.0.

License differences may affect how you can use these models in commercial or open-source projects.

Grok-4 Heavy

Proprietary

Closed source

LFM2.5-VL-3B

LFM Open License v1.0

Open weights

Release Timeline

When each model was launched

LFM2.5-VL-3B was released on 2026-08-12, while Grok-4 Heavy's release date is not specified.

We can confirm LFM2.5-VL-3B's release timeline, but cannot make a direct age comparison without Grok-4 Heavy's release date.

Grok-4 Heavy

—

LFM2.5-VL-3B

Aug 12, 2026

1 weeks ago

Knowledge Cutoff

When training data ends

Grok-4 Heavy has a documented knowledge cutoff of 2024-12-31, while LFM2.5-VL-3B's cutoff date is not specified.

We can confirm Grok-4 Heavy's training data extends to 2024-12-31, but cannot make a direct comparison without LFM2.5-VL-3B's cutoff date.

Grok-4 Heavy

Dec 2024

LFM2.5-VL-3B

—

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Grok-4 Heavy and LFM2.5-VL-3B side-by-side, then vote on the output you prefer.

Grok-4 Heavy
✓ Preferred
LFM2.5-VL-3B
Open in Playground

FAQ

Common questions about Grok-4 Heavy vs LFM2.5-VL-3B.

Which is better, Grok-4 Heavy or LFM2.5-VL-3B?

Grok-4 Heavy (xAI) and LFM2.5-VL-3B (Liquid AI) each have strengths in different areas. Compare their benchmark scores, pricing, context windows, and capabilities above to determine which fits your needs.

How does Grok-4 Heavy compare to LFM2.5-VL-3B in benchmarks?

Grok-4 Heavy scores AIME 2025: 100.0%, HMMT25: 96.7%, GPQA: 88.4%, LiveCodeBench: 79.4%, USAMO25: 61.9%. LFM2.5-VL-3B scores DocVQA: 91.1%, POPE: 88.7%, RefCOCO-avg: 87.9%, TextVQA: 84.3%, OCRBench: 84.2%.

What are the main differences between Grok-4 Heavy and LFM2.5-VL-3B?

Key differences include licensing (Proprietary vs LFM Open License v1.0). See the full comparison above for benchmark-by-benchmark results.

Who makes Grok-4 Heavy and LFM2.5-VL-3B?

Grok-4 Heavy is developed by xAI and LFM2.5-VL-3B is developed by Liquid AI.

Related comparisons