Continual Learning

Wang et al 2023 - A Comprehensive Survey of Continual Learning: Theory, Method and Application

Ermis et al 2022 - Memory Efficient Continual Learning with Transformers

Zheng et al 2025 - Spurious Forgetting in Continual Learning of Language Models Argues that the drop in performance while doing continued training “often reflects a decline in task alignment rather than knowledge loss”

Catastrophic Forgetting

Lifelong Learning