Differences

This shows you the differences between two versions of the page.

--- nlp:multilinguality [2023/04/29 22:53] – added dataset ctoukmaj
+++ nlp:multilinguality [2024/06/19 15:43] (current) – [People] jmflanig
@@ Line 2: / Line 2: @@
   * [[http://proceedings.mlr.press/v119/hu20b/hu20b.pdf|Hu et al 2020 - XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization]]
+  * [[https://arxiv.org/pdf/2211.15649.pdf|Yu et al 2022 - Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resources]]
 ===== Datasets =====
-^ Name ^ Languages ^ Tasks ^ Size ^ Machine-Translated or Annotated? ^
+  * [[https://multilingual-dataset-survey.github.io/|Multilingual Dataset Survey]]
-| [[https://github.com/masakhane-io/masakhane-ner|MasakhaNER]] | Amharic, Hausa, Igbo, Kinyarwanda, Luganda, Luo, Naija Pidgin, Swahili, Wolof, Yorùbá| NER | 3.5 GB | Annotated |
-| [[https://arxiv.org/ftp/arxiv/papers/2003/2003.05002.pdf|TyDi QA]] | English, Arabic, Bengali, Finnish, Indonesian, Japanese, Kiswahili, Korean, Russian, Telugu, Thai | QA | 0.10 GB | Annotated |
 ===== People =====
   * [[https://scholar.google.com/citations?user=dLaR9lgAAAAJ&hl=en|Orhan Firat]]
+  * [[https://scholar.google.com/citations?user=wlosgkoAAAAJ&hl=en|Graham Neubig]]
 ===== Related Pages =====
   * [[Cross-Lingual Transfer]]
   * [[Machine Translation]]