The AI arena is free today

Open Superagent
AI OrganizationMaintains 8 benchmarks

New York University: AI benchmarks & research

NYU Center for Data Science and courant groups. Maintains GPQA (with Cohere and Anthropic co-authors), SQuALITY and NYU CTF Bench, and co-maintains LiveBench.

Maintained by New York University

8 benchmarks

In one line

New York University maintains Cybersecurity CTFs (counts toward the LLM Stats Score, 3 models scored), GPQA (counts toward the LLM Stats Score, 265 models scored), GPQA Biology (counts toward the LLM Stats Score, 1 model scored), GPQA Chemistry (counts toward the LLM Stats Score, 1 model scored), GPQA Physics (counts toward the LLM Stats Score, 1 model scored), SQuALITY (counts toward the LLM Stats Score, 5 models scored), LiveBench (counts toward the LLM Stats Score, 38 models scored) and LiveBench 20241125 (counts toward the LLM Stats Score, 15 models scored). It ships no models of its own on LLM Stats.

FAQ

Common questions about New York University.

What is New York University?

NYU Center for Data Science and courant groups. Maintains GPQA (with Cohere and Anthropic co-authors), SQuALITY and NYU CTF Bench, and co-maintains LiveBench. On LLM Stats it maintains 8 benchmarks, led by GPQA, LiveBench and LiveBench 20241125. It ships no models of its own; each score on its benchmarks carries its own provenance label on the model page.

Which New York University benchmarks count toward the LLM Stats Score?

GPQA, LiveBench, LiveBench 20241125, SQuALITY, Cybersecurity CTFs, GPQA Biology and 2 more count toward the LLM Stats Score. Only benchmarks admitted to the core set move the main leaderboard; the rest are shown for transparency.

Which models lead New York University's benchmarks?

GPT-6 Astra leads GPQA at 96.0% (265 models scored), o3-mini leads LiveBench at 84.6% (38 models scored) and Qwen3 VL 235B A22B Thinking leads LiveBench 20241125 at 79.6% (15 models scored). Each benchmark page lists the full ranking and how the results were produced.

Where are New York University's official benchmark results?

New York University's official site is https://www.nyu.edu. Each benchmark page on LLM Stats links to that benchmark's own paper or leaderboard, and shows the scores next to every other benchmark so models can be compared on one page.