Quasi-potential as an implicit regularizer for the loss function in the stochastic gradient descentcs.LG
New quasi-potential function helps SGD navigate noisy optimization landscapes.
problem Optimizing noisy loss functions with SGD.
method Interpreted SGD as minimizing quasi-potential function, related to noise covariance structure via PDE.
result Anisotropic noise leads to faster escape from local minima.