ml:optimization

This is an old revision of the document!

Table of Contents

Optimization

Optimization

Lectures and Books

Theory

Agarwal, Leon Bottou 2015 - A Lower Bound for the Optimization of Finite Sums

Papers

2018 - Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates
2015 - Cyclical Learning Rates for Training Neural Networks
2020 - On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings
Lipschitz constant
- 2019 - Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networks
- 2018 - Lipschitz regularity of deep neural networks: analysis and efficient estimation

Courses

See also Courses and Seminars.

Blog Posts

Related Pages

ml/optimization.1614666074.txt.gz · Last modified: 2023/06/15 07:36 (external edit)