Differences

This shows you the differences between two versions of the page.

--- ml:hyperparameter_tuning [2022/11/18 23:18] – [Papers] jmflanig
+++ ml:hyperparameter_tuning [2025/03/06 10:20] (current) – [Overviews] jmflanig
@@ Line 4: / Line 4: @@
 ===== Overviews =====
   * [[https://en.wikipedia.org/wiki/Hyperparameter_optimization|Wikipedia - Hyperparameter Optimization]]
+  * [[https://arxiv.org/pdf/2007.15745|Yang & Shami 2020 - On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice]]
 ===== Papers =====
@@ Line 19: / Line 20: @@
 See also list of software in [[https://drive.google.com/uc?export=view&id=1UBPdRsJIy494_Go6KzCKLdHRYLbfMfMF#page=51|Ch 10, p. 322 (p. 51 in pdf)]] of [[book:HOML]].
   * [[https://docs.ray.io/en/latest/tune/index.html|Ray-Tune]] (for PyTorch) [[https://pytorch.org/tutorials/beginner/hyperparameter_tuning_tutorial.html|tutorial]]
+  * [[https://optuna.org/|Optuna]] Nicer interface than Ray-tune
   * Scikit-Optimize (skopt)
@@ Line 24: / Line 26: @@
   * [[nlp:Experimental Method]]
   * [[ml:optimizers#Gradient-Free Optimizers]]
+  * [[Scaling Laws]]