====== Continual Learning ======

===== Overviews =====
  * [[https://arxiv.org/pdf/2302.00487|Wang et al 2023 - A Comprehensive Survey of Continual Learning: Theory, Method and Application]]

===== Papers =====

==== In NLP ====
  * [[https://arxiv.org/pdf/2203.04640|Ermis Memory Efficient Continual Learning with Transformers]]
  * [[https://arxiv.org/pdf/2501.13453|Zheng et al 2025 - Spurious Forgetting in Continual Learning of Language Models]] Argues that the drop in performance while doing continued training "often reflects a decline in task alignment rather than knowledge loss"

===== Related Pages =====
  * [[Catastrophic Forgetting]]
  * [[nlp:Lifelong Learning]]