Differences

This shows you the differences between two versions of the page.

--- ml:mechanistic_interpretability [2025/05/29 07:11] – [Sparse Autoencoders] jmflanig
+++ ml:mechanistic_interpretability [2026/08/05 06:19] (current) – [Overviews] jmflanig
@@ Line 4: / Line 4: @@
   * [[https://arxiv.org/pdf/2404.14082|Bereska & Gavves 2024 - Mechanistic Interpretability for AI Safety - A Review]]
   * [[https://arxiv.org/pdf/2407.02646|Rai et al 2024 - A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models]] paper list: [[https://github.com/Dakingrai/awesome-mechanistic-interpretability-lm-papers|github]]
+  * [[https://arxiv.org/pdf/2410.09087|Saphra & Wiegreffe 2024 - Mechanistic?]]
   * [[https://arxiv.org/pdf/2501.16496|Sharkey et al 2025 - Open Problems in Mechanistic Interpretability]]
   * [[https://arxiv.org/pdf/2502.17516|Lin et al 2025 - A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models]]
@@ Line 12: / Line 13: @@
   * [[https://arxiv.org/pdf/2211.00593|Wang et al 2022 - Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 Small]]
   * **[[https://arxiv.org/pdf/2304.14997|Conmy et al 2023 - Towards Automated Circuit Discovery for Mechanistic Interpretability]]**
+  * [[https://arxiv.org/pdf/2304.14767|Geva et al 2023 - Dissecting Recall of Factual Associations in Auto-Regressive Language Models]]
   * [[https://arxiv.org/pdf/2305.00586|Hanna et al 2023 - How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model]]
+  * [[https://arxiv.org/pdf/2312.02073|Monea et al 2023 - A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia]]
   * [[https://arxiv.org/pdf/2404.14349|Rajaram et al 2024 - Automatic Discovery of Visual Circuits]]
   * [[https://openreview.net/pdf?id=PRZ89QElAv|2025 - The role of Mechanistic Interpretability in ’unveiling’ the emergent representations of Large Language Models]] (This paper was rejected from TMLR, see [[https://openreview.net/forum?id=PRZ89QElAv|reviews]])
@@ Line 20: / Line 23: @@
     * [[https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html|Olsson et al 2022 - In-context Learning and Induction Heads]] See the first figure for the description of an induction head.
     * [[https://arxiv.org/pdf/2404.07129|Singh et al 2024 - What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation]] See figure 1a for an induction head example.
+    * [[https://arxiv.org/pdf/2504.00132|Bakalova et al 2025 - Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B]]
     * [[https://arxiv.org/pdf/2505.16694|Minegishi et al 2025 - Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence]]
     * [[https://arxiv.org/pdf/2505.20896|Wu et al 2025 - How Do Transformers Learn Variable Binding in Symbolic Programs?]]