Word Embeddings

Goldberg & Levy 2014 - word2vec Explained: Deriving Mikolov et al.’s Negative-Sampling Word-Embedding Method

Pennington et al 2014 - GloVe: Global Vectors for Word Representation

GloVe Embeddings github For non-contextualized (fixed) word embeddings, GloVe is usually the best

Pretraining