ProxSPS improves on SPS for regularization tasks, offering better stability and performance.
problem Handling regularization terms in adaptive step size schemes for stochastic gradient descent.
method Developed a proximal variant of the stochastic Polyak step size (SPS) scheme.
result ProxSPS is easier to tune and more stable with regularization, and performs well in image classification tasks.