Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Nov 202319922001200920172026
2 results for “alpha-SVRG”
Convergence Analysis of alpha-SVRG under Strong Convexitycs.LG

Unified convergence analysis of alpha-SVRG under strong convexity.

problem Analyzing the convergence of alpha-SVRG in strongly convex environments.
method Unified convergence rate expression for alpha-SVRG under fixed learning rate, demonstrating faster convergence than SGD and SVRG.
result alpha-SVRG has a faster convergence rate compared to SGD and SVRG under suitable choice of alpha.
alpha-SVRGconvergence analysisstrong convexityvariance reductionstochastic optimization
2025-03-16abs ↗pdf ↗
A Coefficient Makes SVRG Effectivecs.LG

Improved SVRG with a coefficient reduces training loss in deep learning.

problem Demonstrating SVRG's effectiveness in deep learning.
method Introduced a multiplicative coefficient α to control SVRG's variance reduction strength and decay it linearly.
result α-SVRG consistently reduces training loss compared to baseline and standard SVRG across various model architectures and datasets.
SVRGDeep LearningGradient DescentOptimizationNeural Networks
2023-11-09abs ↗pdf ↗