The AI arena is free today

Open Superagent
AI OrganizationMaintains 1 benchmark

Andon Labs: AI benchmarks & research

AI safety evaluation startup. Maintains Vending-Bench.

Maintained by Andon Labs

1 benchmark
  • Vending-Bench 2

    Vending-Bench 2 tests longer horizon planning capabilities by evaluating how well AI models can manage a simulated vending machine business over extended periods. The benchmark measures a model's ability to maintain consistent tool usage and decision-making for a full simulated year of operation, driving higher returns without drifting off task.

    Leader
    Gemini 4 Carbon1648400.0%
    Models scored
    5

In one line

Andon Labs maintains Vending-Bench 2 (counts toward the LLM Stats Score, 5 models scored). It ships no models of its own on LLM Stats.

FAQ

Common questions about Andon Labs.

What is Andon Labs?

AI safety evaluation startup. Maintains Vending-Bench. On LLM Stats it maintains 1 benchmark, led by Vending-Bench 2. It ships no models of its own; each score on its benchmarks carries its own provenance label on the model page.

Which Andon Labs benchmarks count toward the LLM Stats Score?

Vending-Bench 2 counts toward the LLM Stats Score. Only benchmarks admitted to the core set move the main leaderboard; the rest are shown for transparency.

Which models lead Andon Labs's benchmarks?

Gemini 4 Carbon leads Vending-Bench 2 at 1648400.0% (5 models scored). Each benchmark page lists the full ranking and how the results were produced.

Where are Andon Labs's official benchmark results?

Andon Labs's official site is https://andonlabs.com. Each benchmark page on LLM Stats links to that benchmark's own paper or leaderboard, and shows the scores next to every other benchmark so models can be compared on one page.