Visualizing Neural Networks

Karpathy et al 2015 - Visualizing and Understanding Recurrent Networks

Strobelt et al 2016 - LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks demo

(Also the Transformer visualization demos at ACL 2020)

Tenney et al 2020 - The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Model

Langedijk et al 2023 - DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers

BERTViz Zekun used. Works in Colab.

LSTMViz (great)

Explainability

Probing Experiments