On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “AdaSVRG”

SVRG Meets AdaGrad: Painless Variance Reductioncs.LG

AdaSVRG combines adaptive gradient with SVRG for robust optimization.

problem Variance reduction in finite-sum minimization with unknown constants.

method AdaSVRG uses AdaGrad in SVRG's inner loop to make it robust.

result AdaSVRG achieves optimal gradient evaluations with no need for problem-dependent constants.

AdaSVRG Variance Reduction Adaptive Gradient SVRG Optimization

2021-02-18abs ↗pdf ↗

Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reductioncs.LG

New algorithms improve SGD convergence and reduce variance for over-parameterized models.

problem Slower convergence in non-interpolation settings for SGD variants.

method Proposed AdaSPS and AdaSLS with variance reduction for robust convergence.

result Achieves faster convergence rates and robustness in non-interpolation settings.

SGD Polyak stepsize Line-search Variance reduction Convergence

2023-08-11abs ↗pdf ↗