The AI arena is free today

Open Superagent

LFM2.5-VL-3B vs Mistral Small 3 24B Instruct

Mistral Small 3 24B Instruct significantly outperforms across most benchmarks.

Liquid AI · Mistral AI · Updated for 2026

Which is better?

LFM2.5-VL-3B outperforms in 0 benchmarks, while Mistral Small 3 24B Instruct is better at 1 benchmark (IFEval). Mistral Small 3 24B Instruct significantly outperforms across most benchmarks.

Based on current benchmark, pricing, and model metadata for 2026.

Choose LFM2.5-VL-3B

  • you want the most recent training data — it shipped Aug 2026

Choose Mistral Small 3 24B Instruct

  • you want the strongest raw capability — it leads on 1 of 1 shared benchmarks

At a glance

The differences that matter most.

LFM2.5-VL-3B
Liquid AI
Mistral Small 3 24B Instruct
Mistral AI
Benchmark wins
0 of 1
1 of 1
Input price
— / M
$0.07 / M
Output price
— / M
$0.14 / M
Context window
—
32,000
Released
Aug 2026
Jan 2025
License
LFM Open License v1.0
Apache 2.0

Performance Benchmarks

Comparative analysis across standard metrics

1 benchmarks

LFM2.5-VL-3B outperforms in 0 benchmarks, while Mistral Small 3 24B Instruct is better at 1 benchmark (IFEval).

Mistral Small 3 24B Instruct significantly outperforms across most benchmarks.

Tue Aug 25 2026 • llm-stats.com

Arena Performance

Playground indexes and blind preference scores

Model Size

Parameter count comparison

20.9B diff

Mistral Small 3 24B Instruct has 20.9B more parameters than LFM2.5-VL-3B, making it 668.4% larger.

Liquid AI
LFM2.5-VL-3B
3.1Bparameters
Mistral AI
Mistral Small 3 24B Instruct
24.0Bparameters
3.1B
LFM2.5-VL-3B
24.0B
Mistral Small 3 24B Instruct

Context Window

Maximum input and output token capacity

Only Mistral Small 3 24B Instruct specifies input context (32,000 tokens). Only Mistral Small 3 24B Instruct specifies output context (32,000 tokens).

Liquid AI
LFM2.5-VL-3B
Input- tokens
Output- tokens
Mistral AI
Mistral Small 3 24B Instruct
Input32,000 tokens
Output32,000 tokens
Tue Aug 25 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

LFM2.5-VL-3B supports multimodal inputs, whereas Mistral Small 3 24B Instruct does not.

LFM2.5-VL-3B can handle both text and other forms of data like images, making it suitable for multimodal applications.

LFM2.5-VL-3B

Text
Images
Audio
Video

Mistral Small 3 24B Instruct

Text
Images
Audio
Video

License

Usage and distribution terms

LFM2.5-VL-3B is licensed under LFM Open License v1.0, while Mistral Small 3 24B Instruct uses Apache 2.0.

License differences may affect how you can use these models in commercial or open-source projects.

LFM2.5-VL-3B

LFM Open License v1.0

Open weights

Mistral Small 3 24B Instruct

Apache 2.0

Open weights

Release Timeline

When each model was launched

LFM2.5-VL-3B was released on 2026-08-12, while Mistral Small 3 24B Instruct was released on 2025-01-30.

LFM2.5-VL-3B is 19 months newer than Mistral Small 3 24B Instruct.

LFM2.5-VL-3B

Aug 12, 2026

1 weeks ago

1.5yr newer
Mistral Small 3 24B Instruct

Jan 30, 2025

1.6 years ago

Knowledge Cutoff

When training data ends

Mistral Small 3 24B Instruct has a documented knowledge cutoff of 2023-10-01, while LFM2.5-VL-3B's cutoff date is not specified.

We can confirm Mistral Small 3 24B Instruct's training data extends to 2023-10-01, but cannot make a direct comparison without LFM2.5-VL-3B's cutoff date.

LFM2.5-VL-3B

—

Mistral Small 3 24B Instruct

Oct 2023

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against LFM2.5-VL-3B and Mistral Small 3 24B Instruct side-by-side, then vote on the output you prefer.

LFM2.5-VL-3B
✓ Preferred
Mistral Small 3 24B Instruct
Open in Playground

FAQ

Common questions about LFM2.5-VL-3B vs Mistral Small 3 24B Instruct.

Which is better, LFM2.5-VL-3B or Mistral Small 3 24B Instruct?

Mistral Small 3 24B Instruct significantly outperforms across most benchmarks. LFM2.5-VL-3B is made by Liquid AI and Mistral Small 3 24B Instruct is made by Mistral AI. The best choice depends on your use case — compare their benchmark scores, pricing, and capabilities above.

How does LFM2.5-VL-3B compare to Mistral Small 3 24B Instruct in benchmarks?

LFM2.5-VL-3B scores DocVQA: 91.1%, POPE: 88.7%, RefCOCO-avg: 87.9%, TextVQA: 84.3%, OCRBench: 84.2%. Mistral Small 3 24B Instruct scores Arena Hard: 87.6%, HumanEval: 84.8%, MT-Bench: 83.5%, IFEval: 82.9%, MATH: 70.6%.

What are the context window sizes for LFM2.5-VL-3B and Mistral Small 3 24B Instruct?

LFM2.5-VL-3B supports an unknown number of tokens and Mistral Small 3 24B Instruct supports 32K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between LFM2.5-VL-3B and Mistral Small 3 24B Instruct?

Key differences include multimodal support (yes vs no), licensing (LFM Open License v1.0 vs Apache 2.0). See the full comparison above for benchmark-by-benchmark results.

Who makes LFM2.5-VL-3B and Mistral Small 3 24B Instruct?

LFM2.5-VL-3B is developed by Liquid AI and Mistral Small 3 24B Instruct is developed by Mistral AI.

Related comparisons