MEGA UDPOS
Progress Over Time
Interactive timeline showing model performance evolution on MEGA UDPOS
MEGA UDPOS Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Microsoft | 60B | — | — | ||
| 2 | Microsoft | 4B | — | — |
What is MEGA UDPOS?
Universal Dependencies POS tagging as part of the MEGA benchmark suite. A multilingual part-of-speech tagging dataset based on Universal Dependencies treebanks, utilizing the universal POS tag set of 17 tags across 38 diverse languages from different language families. Used for evaluating multilingual POS tagging systems.
MEGA UDPOS is a text benchmark evaluating models on language tasks. LLM Stats tracks 2 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.6.
Compare leaders on the best AI for language leaderboards.
Current leaders
Phi-3.5-MoE-instruct from Microsoft currently leads the MEGA UDPOS leaderboard with a score of 0.604 across 2 evaluated AI models.
Source paper
- Title
- Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection
- Authors
- Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Jan Hajič, and 5 others
- Published
- arXiv
- 2004.10643
Abstract
Universal Dependencies is an open community effort to create cross-linguistically consistent treebank annotation for many languages within a dependency-based lexicalist framework. The annotation consists in a linguistically motivated word segmentation; a morphological layer comprising lemmas, universal part-of-speech tags, and standardized morphological features; and a syntactic layer focusing on syntactic relations between predicates, arguments and modifiers. In this paper, we describe version 2 of the guidelines (UD v2), discuss the major changes from UD v1 to UD v2, and give an overview of the currently available treebanks for 90 languages.
FAQ
Common questions about the MEGA UDPOS benchmark and leaderboard.