Differences

This shows you the differences between two versions of the page.

--- ml:nn_initialization [2021/06/08 08:46] – [Papers] jmflanig
+++ ml:nn_initialization [2023/06/15 07:36] (current) – external edit 127.0.0.1
@@ Line 5: / Line 5: @@
   * Section 8.4 in [[https://www.deeplearningbook.org/contents/optimization.html|Deep Learning Book Ch 8]]
   * Initialization section in [[https://ucsc.primo.exlibrisgroup.com/permalink/01CDL_SCR_INST/1kt68tt/alma991025070453104876|Chapter 11 of Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow (UCSC login required)]]
+  * [[https://classes.soe.ucsc.edu/nlp202/Winter22/slides/nn-training.pdf#page=9|NLP 202 Winter 2022 slides]]
 ===== Papers =====
@@ Line 21: / Line 22: @@
   * [[https://cs230.stanford.edu/section/4/|Stanford Xavier Initialization]]
   * Blog post about Glorot and He: [[https://pouannes.github.io/blog/initialization/|How to initialize deep neural networks? Xavier and Kaiming initialization]] It has some good math derivations for the methods
+===== Related Pages =====
+  * [[NN Training]]