TLDR9+ (test)

Paper

Progress Over Time

Interactive timeline showing model performance evolution on TLDR9+ (test)

State-of-the-art frontier
Open
Proprietary

TLDR9+ (test) Leaderboard

1 models
ContextCostLicense
13B
Notice missing or incorrect data?
About this benchmark

What is TLDR9+ (test)?

A large-scale summarization dataset containing over 9 million training instances extracted from Reddit, designed for extreme summarization (generating one-sentence summaries with high compression and abstraction). More than twice larger than previously proposed datasets.

TLDR9+ (test) is a text benchmark evaluating models on summarization and language tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.2, with the leader at 0.2.

Compare leaders on the best AI for summarization and best AI for language leaderboards.

Current leaders

Llama 3.2 3B Instruct from Meta currently leads the TLDR9+ (test) leaderboard with a score of 0.190 across 1 evaluated AI models.

Source paper

Title
TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts
Authors
Sajad Sotudeh, Hanieh Deilamsalehy, Franck Dernoncourt, Nazli Goharian
Published
Abstract

Recent models in developing summarization systems consist of millions of parameters and the model performance is highly dependent on the abundance of training data. While most existing summarization corpora contain data in the order of thousands to one million, generation of large-scale summarization datasets in order of couple of millions is yet to be explored. Practically, more data is better at generalizing the training patterns to unseen data. In this paper, we introduce TLDR9+ -- a large-scale summarization dataset -- containing over 9 million training instances extracted from Reddit discussion forum (https://github.com/sajastu/reddit_collector). This dataset is specifically gathered to perform extreme summarization (i.e., generating one-sentence summary in high compression and abstraction) and is more than twice larger than the previously proposed dataset. We go one step further and with the help of human annotations, we distill a more fine-grained dataset by sampling High-Quality instances from TLDR9+ and call it TLDRHQ dataset. We further pinpoint different state-of-the-art summarization models on our proposed datasets.

FAQ

Common questions about the TLDR9+ (test) benchmark and leaderboard.

What is the TLDR9+ (test) benchmark?

A large-scale summarization dataset containing over 9 million training instances extracted from Reddit, designed for extreme summarization (generating one-sentence summaries with high compression and abstraction). More than twice larger than previously proposed datasets.

What is the TLDR9+ (test) leaderboard?

The TLDR9+ (test) leaderboard ranks 1 AI models based on their performance on this benchmark. Currently, Llama 3.2 3B Instruct by Meta leads with a score of 0.190. The average score across all models is 0.190.

What is the highest TLDR9+ (test) score?

The highest TLDR9+ (test) score is 0.190, achieved by Llama 3.2 3B Instruct from Meta.

How many models are evaluated on TLDR9+ (test)?

1 models have been evaluated on the TLDR9+ (test) benchmark, with 0 verified results and 1 self-reported results.

Where can I find the TLDR9+ (test) paper?

The TLDR9+ (test) paper is available at https://arxiv.org/abs/2110.01159. The paper details the methodology, dataset construction, and evaluation criteria.

What categories does TLDR9+ (test) cover?

TLDR9+ (test) is categorized under summarization and language. The benchmark evaluates text models.

What is the best open-source model on TLDR9+ (test)?

Llama 3.2 3B Instruct by Meta is the top-ranked open-source model on TLDR9+ (test), with a score of 0.190 (rank #1).

How recent are the TLDR9+ (test) leaderboard results?

The TLDR9+ (test) leaderboard was last updated in July 2026 and currently includes 1 evaluated models.