The AI arena is free today

Open Superagent

GPT-4o mini vs LFM3-1.7B

LFM3-1.7B leads the LLM Stats Score 25.0 to 3.1.

OpenAI · Liquid AI · Updated for 2026

Which is better?

LFM3-1.7B leads the overall LLM Stats Score 25.0 to 3.1, ranking #192 overall.

In the 2 individual benchmarks reported for both models, LFM3-1.7B wins 2; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose GPT-4o mini

  • you want predictable pricing at $0.15/M input and $0.60/M output

Choose LFM3-1.7B

  • overall performance matters — it scores 25.0 and ranks #192 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 2 of 2 exact shared results
  • you want the most recent training data — it shipped Oct 2026
  • you need open weights you can self-host or fine-tune

At a glance

The differences that matter most.

Core performance indexes
3.1
#348
25.0
#192
3.5
#337
20.8
#216
-0.9
#280
7.4
#218
Cost, coverage & limits
Benchmark wins
0 of 2
2 of 2
Input price
$0.15 / M
— / M
Output price
$0.60 / M
— / M
Context window
128,000
—

Capability indexes

Additional strengths measured across groups of related public benchmarks

1 shared
Index
GPT-4o mini
LFM3-1.7B
11.3#261
7.6#285
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

9 reported for GPT-4o mini · 20 for LFM3-1.7B

2 shared

GPT-4o mini outperforms in 0 benchmarks, while LFM3-1.7B is better at 2 benchmarks (GPQA, SWE-Bench Verified).

LFM3-1.7B significantly outperforms across most benchmarks.

Tue Nov 03 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only GPT-4o mini specifies input context (128,000 tokens). Only GPT-4o mini specifies output context (16,384 tokens).

OpenAI
GPT-4o mini
Input128,000 tokens
Output16,384 tokens
Liquid AI
LFM3-1.7B
Input- tokens
Output- tokens
Tue Nov 03 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

GPT-4o mini supports multimodal inputs, whereas LFM3-1.7B does not.

GPT-4o mini can handle both text and other forms of data like images, making it suitable for multimodal applications.

GPT-4o mini

Text
Images
Audio
Video

LFM3-1.7B

Text
Images
Audio
Video

License

Usage and distribution terms

GPT-4o mini is licensed under a proprietary license, while LFM3-1.7B uses LFM Open License v1.0.

License differences may affect how you can use these models in commercial or open-source projects.

GPT-4o mini

Proprietary

Closed source

LFM3-1.7B

LFM Open License v1.0

Open weights

Release Timeline

When each model was launched

GPT-4o mini was released on 2024-07-18, while LFM3-1.7B was released on 2026-10-27.

LFM3-1.7B is 28 months newer than GPT-4o mini.

GPT-4o mini

Jul 18, 2024

2.3 years ago

LFM3-1.7B

Oct 27, 2026

5 days ago

2.3yr newer

Knowledge Cutoff

When training data ends

GPT-4o mini has a documented knowledge cutoff of 2023-10-01, while LFM3-1.7B's cutoff date is not specified.

We can confirm GPT-4o mini's training data extends to 2023-10-01, but cannot make a direct comparison without LFM3-1.7B's cutoff date.

GPT-4o mini

Oct 2023

LFM3-1.7B

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against GPT-4o mini and LFM3-1.7B side-by-side, then vote on the output you prefer.

GPT-4o mini
✓ Preferred
LFM3-1.7B
Open in Playground

FAQ

Common questions about GPT-4o mini vs LFM3-1.7B.

Which is better, GPT-4o mini or LFM3-1.7B?

LFM3-1.7B leads the LLM Stats Score 25.0 to 3.1. GPT-4o mini is made by OpenAI and LFM3-1.7B is made by Liquid AI. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does GPT-4o mini compare to LFM3-1.7B in benchmarks?

GPT-4o mini scores HumanEval: 87.2%, MGSM: 87.0%, MMLU: 82.0%, DROP: 79.7%, MATH: 70.2%. LFM3-1.7B scores IFEval: 96.7%, Multi-IF: 89.1%, LiveCodeBench v6: 73.5%, IFBench: 73.0%, BFCL-V4: 71.4%.

What are the context window sizes for GPT-4o mini and LFM3-1.7B?

GPT-4o mini supports 128K tokens and LFM3-1.7B supports an unknown number of tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between GPT-4o mini and LFM3-1.7B?

Key differences include LLM Stats Score (3.1 vs 25.0), multimodal support (yes vs no), licensing (Proprietary vs LFM Open License v1.0). See the full comparison above for benchmark-by-benchmark results.

Who makes GPT-4o mini and LFM3-1.7B?

GPT-4o mini is developed by OpenAI and LFM3-1.7B is developed by Liquid AI.