The AI arena is free today

Open Superagent
All benchmarks

HumanEval-Average

Paper

Progress Over Time

Interactive timeline showing model performance evolution on HumanEval-Average

State-of-the-art frontier
Open
Proprietary

HumanEval-Average Leaderboard

1 models
ContextCostLicense
1
Mistral AI
Codestral-22B
Mistral AI
22B——
Notice missing or incorrect data?
About this benchmark

What is HumanEval-Average?

A variant of the HumanEval benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics

HumanEval-Average is a text benchmark evaluating models on reasoning tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.6, with the leader at 0.6.

Compare leaders on the best AI for reasoning leaderboards.

Current leaders

Codestral-22B from Mistral AI currently leads the HumanEval-Average leaderboard with a score of 0.615 across 1 evaluated AI models.

1Codestral-22BMistral AI61.5%

FAQ

Common questions about the HumanEval-Average benchmark and leaderboard.

What is the HumanEval-Average benchmark?

A variant of the HumanEval benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics

What is the HumanEval-Average leaderboard?

The HumanEval-Average leaderboard ranks 1 AI models based on their performance on this benchmark. Currently, Codestral-22B by Mistral AI leads with a score of 0.615. The average score across all models is 0.615.

What is the highest HumanEval-Average score?

The highest HumanEval-Average score is 0.615, achieved by Codestral-22B from Mistral AI.

How many models are evaluated on HumanEval-Average?

1 models have been evaluated on the HumanEval-Average benchmark, with 0 verified results and 1 self-reported results.

Where can I find the HumanEval-Average paper?

The HumanEval-Average paper is available at https://arxiv.org/abs/2107.03374. The paper details the methodology, dataset construction, and evaluation criteria.

What categories does HumanEval-Average cover?

HumanEval-Average is categorized under reasoning. The benchmark evaluates text models.

How recent are the HumanEval-Average leaderboard results?

The HumanEval-Average leaderboard was last updated in September 2026 and currently includes 1 evaluated models.