- Organizations
- TIGER-Lab
TIGER-Lab: AI benchmarks & research
University of Waterloo research group. Maintains MMLU-Pro and TheoremQA.
Maintained by TIGER-Lab
2 benchmarks- MMLU-Pro
A more robust and challenging multi-task language understanding benchmark that extends MMLU by expanding multiple-choice options from 4 to 10, eliminating trivial questions, and focusing on reasoning-intensive tasks. Features over 12,000 curated questions across 14 domains and causes a 16-33% accuracy drop compared to original MMLU.
- Leader
Sakana Namazu90.3%- Models scored
- 142
- TheoremQA
A theorem-driven question answering dataset containing 800 high-quality questions covering 350+ theorems from Math, Physics, EE&CS, and Finance. Designed to evaluate AI models' capabilities to apply theorems to solve challenging university-level science problems.
- Leader
Qwen2 72B Instruct44.4%- Models scored
- 6