CoVoST2
Progress Over Time
Interactive timeline showing model performance evolution on CoVoST2
CoVoST2 Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Amazon | — | — | — | ||
| 2 |  Google | — | — | — | ||
| 3 | Google | 12B | — | — | ||
| 4 | Google | — | — | — |
What is CoVoST2?
CoVoST 2 is a large-scale multilingual speech translation corpus derived from Common Voice, covering translations from 21 languages into English and from English into 15 languages. The dataset contains 2,880 hours of speech with 78K speakers for speech translation research.
CoVoST2 is a audio benchmark evaluating models on language, speech to text, and audio tasks. LLM Stats tracks 4 models on this benchmark, scored on a 0–1 scale. The current average is 0.4, with the leader at 0.4.
Compare leaders on the best AI for language, best AI for speech to text and best AI for audio leaderboards.
Current leaders
Nova 2 Omni from Amazon currently leads the CoVoST2 leaderboard with a score of 0.407 across 4 evaluated AI models.
Source paper
- Title
- CoVoST 2 and Massively Multilingual Speech-to-Text Translation
- Authors
- Changhan Wang, Anne Wu, Juan Pino
- Published
- arXiv
- 2007.10310
Abstract
Speech translation has recently become an increasingly popular topic of research, partly due to the development of benchmark datasets. Nevertheless, current datasets cover a limited number of languages. With the aim to foster research in massive multilingual speech translation and speech translation for low resource language pairs, we release CoVoST 2, a large-scale multilingual speech translation corpus covering translations from 21 languages into English and from English into 15 languages. This represents the largest open dataset available to date from total volume and language coverage perspective. Data sanity checks provide evidence about the quality of the data, which is released under CC0 license. We also provide extensive speech recognition, bilingual and multilingual machine translation and speech translation baselines with open-source implementation.
FAQ
Common questions about the CoVoST2 benchmark and leaderboard.