====== Sparsity in Neural Networks ======

===== Overviews =====
  * [[https://arxiv.org/pdf/2102.00554|Hoefler et al 2021 - Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks]]

===== Papers =====
  * [[https://arxiv.org/pdf/2102.04010|Zhou et al 2021 - Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch]]

===== Related Pages =====
  * [[Model Compression]]
  * [[Model Compression#Pruning & Sparsification]]
  * [[mechanistic_interpretability#Sparse Autoencoders]]