All benchmarks

Repo Env

Progress Over Time

Interactive timeline showing model performance evolution on Repo Env

State-of-the-art frontier
Open
Proprietary

Repo Env Leaderboard

2 models
ContextCostLicense
1
ByteDance
Seed 2.1 ProNew
ByteDance
———
2
ByteDance
Seed 2.1 TurboNew
ByteDance
———
Notice missing or incorrect data?
About this benchmark

What is Repo Env?

Repo Env evaluates an agent's ability to set up, configure, and run real repositories, including dependency resolution and environment management.

Repo Env is a text benchmark evaluating models on agents and coding tasks. LLM Stats tracks 2 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.6.

Compare leaders on the best AI for agents and best AI for coding leaderboards.

Current leaders

Seed 2.1 Pro from ByteDance currently leads the Repo Env leaderboard with a score of 0.550 across 2 evaluated AI models.

1Seed 2.1 ProByteDance55.0%
2Seed 2.1 TurboByteDance46.7%

FAQ

Common questions about the Repo Env benchmark and leaderboard.

What is the Repo Env benchmark?

Repo Env evaluates an agent's ability to set up, configure, and run real repositories, including dependency resolution and environment management.

What is the Repo Env leaderboard?

The Repo Env leaderboard ranks 2 AI models based on their performance on this benchmark. Currently, Seed 2.1 Pro by ByteDance leads with a score of 0.550. The average score across all models is 0.509.

What is the highest Repo Env score?

The highest Repo Env score is 0.550, achieved by Seed 2.1 Pro from ByteDance.

How many models are evaluated on Repo Env?

2 models have been evaluated on the Repo Env benchmark, with 0 verified results and 2 self-reported results.

What categories does Repo Env cover?

Repo Env is categorized under agents and coding. The benchmark evaluates text models.

How recent are the Repo Env leaderboard results?

The Repo Env leaderboard was last updated in June 2026 and currently includes 2 evaluated models.