The AI arena is free today

Open Superagent

LFM3-1.7B vs o4-mini

LFM3-1.7B and o4-mini are closely matched at 25.0 and 26.8 on the LLM Stats Score.

Liquid AI · OpenAI · Updated for 2026

Which is better?

LFM3-1.7B and o4-mini are closely matched on the overall LLM Stats Score at 25.0 and 26.8.

In the 3 individual benchmarks reported for both models, o4-mini wins 3; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose LFM3-1.7B

  • you want the most recent training data — it shipped Oct 2026
  • you need open weights you can self-host or fine-tune

Choose o4-mini

  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 3 of 3 exact shared results

At a glance

The differences that matter most.

Core performance indexes
25.0
#191
26.8
#177
20.8
#216
26.8
#171
7.4
#218
11.9
#181
18.1
#97
5.7
#176
Cost, coverage & limits
Benchmark wins
0 of 3
3 of 3
Input price
— / M
$1.10 / M
Output price
— / M
$4.40 / M
Context window
—
200,000

Capability indexes

Additional strengths measured across groups of related public benchmarks

2 shared
Index
LFM3-1.7B
o4-mini
7.6#285
27.3#109
14.3#119
11.3#138
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

20 reported for LFM3-1.7B · 14 for o4-mini

3 shared

LFM3-1.7B outperforms in 0 benchmarks, while o4-mini is better at 3 benchmarks (GPQA, Humanity's Last Exam, SWE-Bench Verified).

o4-mini significantly outperforms across most benchmarks.

Sat Nov 07 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only o4-mini specifies input context (200,000 tokens). Only o4-mini specifies output context (100,000 tokens).

Liquid AI
LFM3-1.7B
Input- tokens
Output- tokens
OpenAI
o4-mini
Input200,000 tokens
Output100,000 tokens
Sat Nov 07 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

o4-mini supports multimodal inputs, whereas LFM3-1.7B does not.

o4-mini can handle both text and other forms of data like images, making it suitable for multimodal applications.

LFM3-1.7B

Text
Images
Audio
Video

o4-mini

Text
Images
Audio
Video

License

Usage and distribution terms

LFM3-1.7B is licensed under LFM Open License v1.0, while o4-mini uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

LFM3-1.7B

LFM Open License v1.0

Open weights

o4-mini

Proprietary

Closed source

Release Timeline

When each model was launched

LFM3-1.7B was released on 2026-10-27, while o4-mini was released on 2025-04-16.

LFM3-1.7B is 19 months newer than o4-mini.

LFM3-1.7B

Oct 27, 2026

1 weeks ago

1.5yr newer
o4-mini

Apr 16, 2025

1.6 years ago

Knowledge Cutoff

When training data ends

o4-mini has a documented knowledge cutoff of 2024-05-31, while LFM3-1.7B's cutoff date is not specified.

We can confirm o4-mini's training data extends to 2024-05-31, but cannot make a direct comparison without LFM3-1.7B's cutoff date.

LFM3-1.7B

—

o4-mini

May 2024

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against LFM3-1.7B and o4-mini side-by-side, then vote on the output you prefer.

LFM3-1.7B
✓ Preferred
o4-mini
Open in Playground

FAQ

Common questions about LFM3-1.7B vs o4-mini.

Which is better, LFM3-1.7B or o4-mini?

LFM3-1.7B and o4-mini are closely matched on the LLM Stats Score at 25.0 and 26.8. LFM3-1.7B is made by Liquid AI and o4-mini is made by OpenAI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does LFM3-1.7B compare to o4-mini in benchmarks?

LFM3-1.7B scores IFEval: 96.7%, Multi-IF: 89.1%, LiveCodeBench v6: 73.5%, IFBench: 73.0%, BFCL-V4: 71.4%. o4-mini scores AIME 2024: 93.4%, AIME 2025: 92.7%, MathVista: 84.3%, MMMU: 81.6%, GPQA: 81.4%.

What are the context window sizes for LFM3-1.7B and o4-mini?

LFM3-1.7B supports an unknown number of tokens and o4-mini supports 200K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between LFM3-1.7B and o4-mini?

Key differences include LLM Stats Score (25.0 vs 26.8), multimodal support (no vs yes), licensing (LFM Open License v1.0 vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes LFM3-1.7B and o4-mini?

LFM3-1.7B is developed by Liquid AI and o4-mini is developed by OpenAI.