LSAT

LSAT (Law School Admission Test) benchmark evaluating complex reasoning capabilities across three challenging tasks: analytical reasoning, logical reasoning, and reading comprehension. The LSAT measures skills considered essential for success in law school including critical thinking, reading comprehension of complex texts, and analysis of arguments.

Paper

Progress Over Time

Interactive timeline showing model performance evolution on LSAT

State-of-the-art frontier
Open
Proprietary

LSAT Leaderboard

1 models
ContextCostLicense
1
OpenAI
OpenAI
33K$30.00 / $60.00
Notice missing or incorrect data?

FAQ

Common questions about LSAT

LSAT (Law School Admission Test) benchmark evaluating complex reasoning capabilities across three challenging tasks: analytical reasoning, logical reasoning, and reading comprehension. The LSAT measures skills considered essential for success in law school including critical thinking, reading comprehension of complex texts, and analysis of arguments.
The LSAT paper is available at https://arxiv.org/abs/2108.00648. This paper provides detailed information about the benchmark methodology, dataset creation, and evaluation criteria.
The LSAT leaderboard ranks 1 AI models based on their performance on this benchmark. Currently, GPT-4 by OpenAI leads with a score of 0.880. The average score across all models is 0.880.
The highest LSAT score is 0.880, achieved by GPT-4 from OpenAI.
1 models have been evaluated on the LSAT benchmark, with 0 verified results and 1 self-reported results.
LSAT is categorized under general, legal, and reasoning. The benchmark evaluates text models.