Knowledge Editing

Meng et al 2022 - Locating and Editing Factual Associations in GPT Introduces ROME

Meng at el 2022 - Mass-Editing Memory in a Transformer Follow-up work of Meng 2022 allowing editing many facts at once. Great paper. Also shows that factual knowledge is distributed in the MLP layers

Wang et al 2025 - LoKI: Low-damage Knowledge Implanting of Large Language Models Connects mechanistic insights into LLM knowledge storage with editing.

Model Editing and Unlearning