The AI arena is free today

Open Superagent

Llama 3.1 Nemotron Ultra 253B v1 vs Mercury 3

Mercury 3 leads the LLM Stats Score 36.1 to 18.7.

NVIDIA · Inception · Updated for 2026

Which is better?

Mercury 3 leads the overall LLM Stats Score 36.1 to 18.7, ranking #98 overall.

In the 1 individual benchmarks reported for both models, Mercury 3 wins 1; this is a narrower head-to-head signal than the composite indexes.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Llama 3.1 Nemotron Ultra 253B v1

  • you need open weights you can self-host or fine-tune

Choose Mercury 3

  • overall performance matters — it scores 36.1 and ranks #98 on LLM Stats
  • your work emphasizes reasoning — it leads those capability indexes
  • you value its reported benchmark strengths — it wins 1 of 1 exact shared results
  • you want the most recent training data — it shipped Oct 2026

At a glance

The differences that matter most.

Llama 3.1 Nemotron Ultra 253B v1
NVIDIA
Mercury 3
Inception
Core performance indexes
LLM Stats Score
18.7
#232
36.1
#98
Reasoning
18.4
#230
34.8
#103
Coding
12.2
#166
21.5
#105
Cost, coverage & limits
Benchmark wins
0 of 1
1 of 1
Input price
— / M
$0.10 / M
Output price
— / M
$0.35 / M
Context window
—
1,000,000

Individual benchmarks

6 reported for Llama 3.1 Nemotron Ultra 253B v1 · 12 for Mercury 3

1 shared

Llama 3.1 Nemotron Ultra 253B v1 outperforms in 0 benchmarks, while Mercury 3 is better at 1 benchmark (GPQA).

Mercury 3 significantly outperforms across most benchmarks.

Thu Oct 22 2026 • llm-stats.com

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Only Mercury 3 specifies input context (1,000,000 tokens). Only Mercury 3 specifies output context (131,072 tokens).

NVIDIA
Llama 3.1 Nemotron Ultra 253B v1
Input- tokens
Output- tokens
Inception
Mercury 3
Input1,000,000 tokens
Output131,072 tokens
Thu Oct 22 2026 • llm-stats.com

License

Usage and distribution terms

Llama 3.1 Nemotron Ultra 253B v1 is licensed under Llama 3.1 Community License, while Mercury 3 uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

Llama 3.1 Nemotron Ultra 253B v1

Llama 3.1 Community License

Open weights

Mercury 3

Proprietary

Closed source

Release Timeline

When each model was launched

Llama 3.1 Nemotron Ultra 253B v1 was released on 2025-04-07, while Mercury 3 was released on 2026-10-19.

Mercury 3 is 19 months newer than Llama 3.1 Nemotron Ultra 253B v1.

Llama 3.1 Nemotron Ultra 253B v1

Apr 7, 2025

1.5 years ago

Mercury 3

Oct 19, 2026

0 days ago

1.5yr newer

Knowledge Cutoff

When training data ends

Llama 3.1 Nemotron Ultra 253B v1 has a documented knowledge cutoff of 2023-12-01, while Mercury 3's cutoff date is not specified.

We can confirm Llama 3.1 Nemotron Ultra 253B v1's training data extends to 2023-12-01, but cannot make a direct comparison without Mercury 3's cutoff date.

Llama 3.1 Nemotron Ultra 253B v1

Dec 2023

Mercury 3

—

Outputs Comparison

Notice missing or incorrect data?

Judge for yourself.

Run your own prompts against Llama 3.1 Nemotron Ultra 253B v1 and Mercury 3 side-by-side, then vote on the output you prefer.

Llama 3.1 Nemotron Ultra 253B v1
✓ Preferred
Mercury 3
Open in Playground

FAQ

Common questions about Llama 3.1 Nemotron Ultra 253B v1 vs Mercury 3.

Which is better, Llama 3.1 Nemotron Ultra 253B v1 or Mercury 3?

Mercury 3 leads the LLM Stats Score 36.1 to 18.7. Llama 3.1 Nemotron Ultra 253B v1 is made by NVIDIA and Mercury 3 is made by Inception. The best choice depends on your use case — compare their capability indexes, individual benchmarks, pricing, and limits above.

How does Llama 3.1 Nemotron Ultra 253B v1 compare to Mercury 3 in benchmarks?

Llama 3.1 Nemotron Ultra 253B v1 scores MATH-500: 97.0%, IFEval: 89.5%, GPQA: 76.0%, BFCL v2: 74.1%, AIME 2025: 72.5%. Mercury 3 scores GPQA: 89.2%, AA-LCR: 77.7%, IFBench: 76.8%, MRCR v2: 75.5%, DeepSearchQA: 71.3%.

What are the context window sizes for Llama 3.1 Nemotron Ultra 253B v1 and Mercury 3?

Llama 3.1 Nemotron Ultra 253B v1 supports an unknown number of tokens and Mercury 3 supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Llama 3.1 Nemotron Ultra 253B v1 and Mercury 3?

Key differences include LLM Stats Score (18.7 vs 36.1), licensing (Llama 3.1 Community License vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes Llama 3.1 Nemotron Ultra 253B v1 and Mercury 3?

Llama 3.1 Nemotron Ultra 253B v1 is developed by NVIDIA and Mercury 3 is developed by Inception.

Related comparisons