Differences

This shows you the differences between two versions of the page.

--- nlp:bert_and_friends [2022/08/05 08:19] – [Interpretation and Properties (BERTology)] jmflanig
+++ nlp:bert_and_friends [2023/07/06 00:22] (current) – [Introductions to BERT] jmflanig
@@ Line 10: / Line 10: @@
   * Training from scratch
     * [[https://aclanthology.org/2021.emnlp-main.831.pdf|Izsak et al 2021 - How to Train BERT with an Academic Budget]]
+  * Retrospective Analyssis
+    * [[https://arxiv.org/pdf/2306.02870.pdf|Nityasya et al 2023 - On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research]]
 ===== Extensions =====