ml:nn_sparsity

This is an old revision of the document!

Table of Contents

Sparsity in Neural Networks

Sparsity in Neural Networks

Overviews

Hoefler et al 2021 - Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks

Papers

Sparse Autoencoders

This section should maybe be moved into its own section, or moved to interpretability.

Cunningham et al 2023 - Sparse Autoencoders Find Highly Interpretable Features in Language Models
2023 - Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

Related Pages

ml/nn_sparsity.1742473185.txt.gz · Last modified: 2025/03/20 12:19 by jmflanig