NLP Wiki

User Tools

Site Tools

Trace: • distributed_training • zero-shot_learning • alternative_training_methods
ml:curriculum_learning

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
ml:curriculum_learning [2021/09/25 01:20] – [Papers] jmflanigml:curriculum_learning [2024/06/28 03:27] (current) – [Papers] jmflanig
Line 6: Line 6:
   * [[https://arxiv.org/pdf/2101.10382.pdf|Soviany et al 2021 - Curriculum Learning: A Survey]]   * [[https://arxiv.org/pdf/2101.10382.pdf|Soviany et al 2021 - Curriculum Learning: A Survey]]
   * [[https://www.aclweb.org/anthology/2020.acl-main.542.pdf|2020 - Curriculum Learning for Natural Language Understanding]]   * [[https://www.aclweb.org/anthology/2020.acl-main.542.pdf|2020 - Curriculum Learning for Natural Language Understanding]]
 +
 +===== Strategies for the Curriculum =====
 +  * In NLP
 +    * Length, word rarity
  
 ===== Papers ===== ===== Papers =====
Line 18: Line 22:
   * [[https://arxiv.org/pdf/2102.03554.pdf|Chang et al 2021 - Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learning]]   * [[https://arxiv.org/pdf/2102.03554.pdf|Chang et al 2021 - Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learning]]
   * [[https://arxiv.org/pdf/2108.02170.pdf|Campos et al 2021 - Curriculum Learning for Language Modeling]]   * [[https://arxiv.org/pdf/2108.02170.pdf|Campos et al 2021 - Curriculum Learning for Language Modeling]]
 +  * [[https://arxiv.org/pdf/2109.11177.pdf|Lu & Zhang 2021 - Exploiting Curriculum Learning in Unsupervised Neural Machine Translation]]
 +  * [[https://arxiv.org/pdf/2310.09518|Lee et al 2023 - Instruction Tuning with Human Curriculum]]
  
 ===== Theory ===== ===== Theory =====
Line 31: Line 37:
 ===== Papers using Curriculum Learning ===== ===== Papers using Curriculum Learning =====
   * [[https://arxiv.org/pdf/1410.4615.pdf|2014 - Learning to Execute]]   * [[https://arxiv.org/pdf/1410.4615.pdf|2014 - Learning to Execute]]
 +
 +===== Related Pages =====
 +  * [[Active Learning]]
 +  * [[nlp:Compositional Generalization]]
  
ml/curriculum_learning.1632532805.txt.gz · Last modified: 2023/06/15 07:36 (external edit)
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki