A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Implicit Q-learning and SARSA adjust step-sizes automatically, improving stability and performance.
The paper analyzes fixed step-size SA schemes on Riemannian manifolds.
The paper analyzes and validates two step size schedules for SGD: exponential and cosine, proving their adaptivity and performance.
In this paper, we introduce a method for adapting the step-sizes of temporal difference (TD) learning. The performance of TD methods often depends on well chosen step-sizes, yet few algorithms have been developed for setting the step-size automatically for TD learning. An important limitation of current methods is that…
New algorithm improves stability of optimization algorithms by adapting step-size.
AutoStep MCMC adapts step size locally for better sampling efficiency.
The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the algorithm, where the importance of each step decreases with time. This article studies …
Adaptive step-size improves optimization in complex geometries.
Negative step sizes improve second-order methods for neural networks.
The practical performance of online stochastic gradient descent algorithms is highly dependent on the chosen step size, which must be tediously hand-tuned in many applications. The same is true for more advanced variants of stochastic gradients, such as SAGA, SVRG, or AdaGrad. Here we propose to adapt the step size by …
The main goal of this work is equipping convex and nonconvex problems with Barzilai-Borwein (BB) step size. With the adaptivity of BB step sizes granted, they can fail when the objective function is not strongly convex. To overcome this challenge, the key idea here is to bridge (non)convex problems and strongly convex …
New insights into SGD and SGD-M in high dimensions.
Improved variational inequality algorithms using adaptive step sizes.
We consider -dimensional linear stochastic approximation algorithms (LSAs) with a constant step-size and the so called Polyak-Ruppert (PR) averaging of iterates. LSAs are widely applied in machine learning and reinforcement learning (RL), where the aim is to compute an appropriate (that is a…
Sparse coding is typically solved by iterative optimization techniques, such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Unfolding and learning weights of ISTA using neural networks is a practical way to accelerate estimation. In this paper, we study the selection of adapted step sizes for ISTA. We show t…
New adaptive step-size method for convex optimization without tuning.
New step-size methods improve SHB convergence for stochastic optimization.
Adaptive step-size method improves compressed SGD performance in machine learning.
One of the major issues in stochastic gradient descent (SGD) methods is how to choose an appropriate step size while running the algorithm. Since the traditional line search technique does not apply for stochastic optimization algorithms, the common practice in SGD is either to use a diminishing step size, or to tune a…
Large SGD step sizes lead to sparse feature learning in neural networks.
A recent algorithmic family for distributed optimization, DIGing's, have been shown to have geometric convergence over time-varying undirected/directed graphs. Nevertheless, an identical step-size for all agents is needed. In this paper, we study the convergence rates of the Adapt-Then-Combine (ATC) variation of the DI…
Polyak step size GD reaches final radius of convergence after log iterations.
Develops a generalized version of Chung's Lemma for stochastic optimization methods.
The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search to tune parameters (step size and the number of iterations per inner loop) for optimal performance. This work introduces `…
We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide an asymptotic expansion up to explicit exponentially decaying terms. Our analysis…
Proposes a new adaptive learning rate for SGD.
Study optimizes step size for Metropolis algorithm in non-identifiable cases.
New convergence results for NGVI with various step sizes and sample sizes.
Proposes a neural network for learning step-size policies for L-BFGS optimization.
Sparse Polyak improves high-dimensional statistical estimation.
SGD converges almost surely in non-convex problems, avoiding saddle points and accelerating convergence.
Paper develops an online learning algorithm for functional data models.
Applying standard Markov chain Monte Carlo (MCMC) algorithms to large data sets is computationally infeasible. The recently proposed stochastic gradient Langevin dynamics (SGLD) method circumvents this problem in three ways: it generates proposed moves using only a subset of the data, it skips the Metropolis-Hastings a…
Motivated by their broad applications in reinforcement learning, we study the linear two-time-scale stochastic approximation, an iterative method using two different step sizes for finding the solutions of a system of two equations. Our main focus is to characterize the finite-time complexity of this method under time-…
New TD algorithms stabilize RL tasks by reformulating updates into fixed point equations.
This manuscript shows that AdaBoost and its immediate variants can produce approximate maximum margin classifiers simply by scaling step size choices with a fixed small constant. In this way, when the unscaled step size is an optimal choice, these results provide guarantees for Friedman's empirically successful "shrink…
Gradient descent with large steps leads to chaotic parameter space and unpredictable outcomes.
Proposes an exponentially increasing step-size for faster parameter estimation in statistical models.
Improved online prediction with guaranteed coverage.
This paper explores the problem of learning transforms for image compression via autoencoders. Usually, the rate-distortion performances of image compression are tuned by varying the quantization step size. In the case of autoen-coders, this in principle would require learning one transform per rate-distortion point at…
Deep unfolding is a promising deep-learning technique in which an iterative algorithm is unrolled to a deep network architecture with trainable parameters. In the case of gradient descent algorithms, as a result of the training process, one often observes the acceleration of the convergence speed with learned non-const…
A major challenge in current optimization research for deep learning is to automatically find optimal step sizes for each update step. The optimal step size is closely related to the shape of the loss in the update step direction. However, this shape has not yet been examined in detail. This work shows empirically that…
New SPS variant improves non-smooth optimization without small gradients.
Calibrated probabilistic solvers improve accuracy of ODE estimates.
Adaptive gradient methods converge faster with over-parameterization and line-search.
ATLAS adapts HMC step size and trajectory length for complex geometries.
New TD method stabilizes average-reward learning.
StochAstic Recursive grAdient algoritHm (SARAH), originally proposed for convex optimization and also proven to be effective for general nonconvex optimization, has received great attention due to its simple recursive framework for updating stochastic gradient estimates. The performance of SARAH significantly depends o…