The AI arena is free today

Open Superagent

Siren AgentDojo Utility

Progress Over Time

Interactive timeline showing model performance evolution on Siren AgentDojo Utility

State-of-the-art frontier
Open
Proprietary

Siren AgentDojo Utility Leaderboard

1 models
ContextCostLicense
130B
Notice missing or incorrect data?
About this benchmark

What is Siren AgentDojo Utility?

Siren AgentDojo evaluates tool-using agents under adversarial prompt-injection attacks. This metric reports utility on the assigned tasks.

Siren AgentDojo Utility is a text benchmark evaluating models on safety, agents, and tool calling tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.9, with the leader at 0.9.

Compare leaders on the best AI for safety, best AI for agents and best AI for tool calling leaderboards.

Current leaders

Muse Glimmer-30B from Meta currently leads the Siren AgentDojo Utility leaderboard with a score of 0.942 across 1 evaluated AI models.

FAQ

Common questions about the Siren AgentDojo Utility benchmark and leaderboard.

What is the Siren AgentDojo Utility benchmark?

Siren AgentDojo evaluates tool-using agents under adversarial prompt-injection attacks. This metric reports utility on the assigned tasks.

What is the Siren AgentDojo Utility leaderboard?

The Siren AgentDojo Utility leaderboard ranks 1 AI models based on their performance on this benchmark. Currently, Muse Glimmer-30B by Meta leads with a score of 0.942. The average score across all models is 0.942.

What is the highest Siren AgentDojo Utility score?

The highest Siren AgentDojo Utility score is 0.942, achieved by Muse Glimmer-30B from Meta.

How many models are evaluated on Siren AgentDojo Utility?

1 models have been evaluated on the Siren AgentDojo Utility benchmark, with 0 verified results and 1 self-reported results.

What categories does Siren AgentDojo Utility cover?

Siren AgentDojo Utility is categorized under safety, agents, and tool calling. The benchmark evaluates text models.

What is the best open-source model on Siren AgentDojo Utility?

Muse Glimmer-30B by Meta is the top-ranked open-source model on Siren AgentDojo Utility, with a score of 0.942 (rank #1).

How recent are the Siren AgentDojo Utility leaderboard results?

The Siren AgentDojo Utility leaderboard was last updated in August 2026 and currently includes 1 evaluated models.