NLP Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.

====== Continual Learning ======

===== Overviews =====
  * [[https://arxiv.org/pdf/2302.00487|Wang et al 2023 - A Comprehensive Survey of Continual Learning: Theory, Method and Application]]
  * **In NLP**
    * [[https://dl.acm.org/doi/pdf/10.1145/3735633|Shi et al 2025 - Continual Learning of Large Language Models: A Comprehensive Survey]]
    * [[https://dl.acm.org/doi/pdf/10.1145/3716629|Zheng et al 2025 - Towards Lifelong Learning of Large Language Models: A Survey]]

===== Papers =====

==== In NLP ====
  * [[https://arxiv.org/pdf/2203.04640|Ermis et al 2022 - Memory Efficient Continual Learning with Transformers]]
  * [[https://arxiv.org/pdf/2501.13453|Zheng et al 2025 - Spurious Forgetting in Continual Learning of Language Models]] Argues that the drop in performance while doing continued training "often reflects a decline in task alignment rather than knowledge loss"

===== Related Pages =====
  * [[Catastrophic Forgetting]]
  * [[nlp:Lifelong Learning]]