The AI arena is free today

Open Superagent

Mistral Small 3.1 24B Instruct vs Qwen3 VL 4B Thinking

Qwen3 VL 4B Thinking leads the LLM Stats Score 12.9 to 4.2.

Mistral AI · Alibaba Cloud / Qwen Team · Updated for 2026

Which is better?

Qwen3 VL 4B Thinking leads the overall LLM Stats Score 12.9 to 4.2, ranking #249 overall.

In the 3 individual benchmarks reported for both models, Qwen3 VL 4B Thinking wins 3; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Mistral Small 3.1 24B Instruct

  • you are already invested in the Mistral AI ecosystem

Choose Qwen3 VL 4B Thinking

  • overall performance matters — it scores 12.9 and ranks #249 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 3 of 3 exact shared results
  • you want the most recent training data — it shipped Sep 2025

At a glance

The differences that matter most.

Core performance indexes
4.2
#302
12.9
#249
4.2
#296
14.0
#231
Cost, coverage & limits
Benchmark wins
0 of 3
3 of 3
Input price
— / M
$0.10 / M
Output price
— / M
$1.00 / M
Context window
262,144

Capability indexes

Additional strengths measured across groups of related public benchmarks

3 shared
Index
Mistral Small 3.1 24B Instruct
Qwen3 VL 4B Thinking
7.9#261
15.6#216
7.3#160
16.5#112
7.3#142
15.9#98
Conservative TrueSkill rating · higher is betterHow scores work

Individual benchmarks

9 reported for Mistral Small 3.1 24B Instruct · 48 for Qwen3 VL 4B Thinking

3 shared

Mistral Small 3.1 24B Instruct outperforms in 0 benchmarks, while Qwen3 VL 4B Thinking is better at 3 benchmarks (GPQA, MMLU, MMLU-Pro).

Qwen3 VL 4B Thinking significantly outperforms across most benchmarks.

Sun Sep 20 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Model Size

Parameter count comparison

20.0B diff

Mistral Small 3.1 24B Instruct has 20.0B more parameters than Qwen3 VL 4B Thinking, making it 500.0% larger.

Mistral AI
Mistral Small 3.1 24B Instruct
24.0Bparameters
Alibaba Cloud / Qwen Team
Qwen3 VL 4B Thinking
4.0Bparameters
24.0B
Mistral Small 3.1 24B Instruct
4.0B
Qwen3 VL 4B Thinking

Context Window

Maximum input and output token capacity

Only Qwen3 VL 4B Thinking specifies input context (262,144 tokens). Only Qwen3 VL 4B Thinking specifies output context (262,144 tokens).

Mistral AI
Mistral Small 3.1 24B Instruct
Input- tokens
Output- tokens
Alibaba Cloud / Qwen Team
Qwen3 VL 4B Thinking
Input262,144 tokens
Output262,144 tokens
Sun Sep 20 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Mistral Small 3.1 24B Instruct and Qwen3 VL 4B Thinking support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Mistral Small 3.1 24B Instruct

Text
Images
Audio
Video

Qwen3 VL 4B Thinking

Text
Images
Audio
Video

License

Usage and distribution terms

Both models are licensed under Apache 2.0.

Both models share the same licensing terms, providing consistent usage rights.

Mistral Small 3.1 24B Instruct

Apache 2.0

Open weights

Qwen3 VL 4B Thinking

Apache 2.0

Open weights

Release Timeline

When each model was launched

Mistral Small 3.1 24B Instruct was released on 2025-03-17, while Qwen3 VL 4B Thinking was released on 2025-09-22.

Qwen3 VL 4B Thinking is 6 months newer than Mistral Small 3.1 24B Instruct.

Mistral Small 3.1 24B Instruct

Mar 17, 2025

1.5 years ago

Qwen3 VL 4B Thinking

Sep 22, 2025

12 months ago

6mo newer

Knowledge Cutoff

When training data ends

Neither model specifies a knowledge cutoff date.

Unable to compare the recency of their training data.

No cutoff dates available

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion

Judge for yourself.

Run your own prompts against Mistral Small 3.1 24B Instruct and Qwen3 VL 4B Thinking side-by-side, then vote on the output you prefer.

Mistral Small 3.1 24B Instruct
✓ Preferred
Qwen3 VL 4B Thinking
Open in Playground

FAQ

Common questions about Mistral Small 3.1 24B Instruct vs Qwen3 VL 4B Thinking.

Which is better, Mistral Small 3.1 24B Instruct or Qwen3 VL 4B Thinking?

Qwen3 VL 4B Thinking leads the LLM Stats Score 12.9 to 4.2. Mistral Small 3.1 24B Instruct is made by Mistral AI and Qwen3 VL 4B Thinking is made by Alibaba Cloud / Qwen Team. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Mistral Small 3.1 24B Instruct compare to Qwen3 VL 4B Thinking in benchmarks?

Mistral Small 3.1 24B Instruct scores HumanEval: 88.4%, MMLU: 80.6%, TriviaQA: 80.5%, MBPP: 74.7%, MATH: 69.3%. Qwen3 VL 4B Thinking scores DocVQAtest: 94.2%, ScreenSpot: 92.9%, MMBench-V1.1: 86.7%, MMLU-Redux: 86.0%, AI2D: 84.9%.

What are the context window sizes for Mistral Small 3.1 24B Instruct and Qwen3 VL 4B Thinking?

Mistral Small 3.1 24B Instruct supports an unknown number of tokens and Qwen3 VL 4B Thinking supports 262K tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Mistral Small 3.1 24B Instruct and Qwen3 VL 4B Thinking?

Key differences include LLM Stats Score (4.2 vs 12.9). See the full comparison above for benchmark-by-benchmark results.

Who makes Mistral Small 3.1 24B Instruct and Qwen3 VL 4B Thinking?

Mistral Small 3.1 24B Instruct is developed by Mistral AI and Qwen3 VL 4B Thinking is developed by Alibaba Cloud / Qwen Team.