A recent algorithmic family for distributed optimization, DIGing's, have been shown to have geometric convergence over time-varying undirected/directed graphs. Nevertheless, an identical step-size for all agents is needed. In this paper, we study the convergence rates of the Adapt-Then-Combine (ATC) variation of the DI…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “uncoordinated step-sizes”
A new decentralized optimization method with independent step-sizes and separated convergence rates.
problem Decentralized optimization with composite objective terms.
method Proximal-gradient algorithm with uncoordinated step-sizes and separated convergence rates.
result Linear convergence for special case without non-smooth terms under strong convexity.
New policy reduces spectrum access regret in uncoordinated systems.
problem Uncoordinated spectrum access with user-dependent rewards.
method Multi-user multi-armed bandit (MAB) model with user-specific rewards.
result Achieves regret for spectrum access.
Deep RL for uncoordinated cognitive radios finds near-optimal policies.
problem Resource allocation in uncoordinated cognitive radio networks.
method Distributed deep reinforcement learning algorithm.
result Algorithm converges to near-optimal policies in finite time.
New algorithms for uncoordinated spectrum access with multi-user multi-armed bandits.
problem Uncoordinated spectrum access with unknown number of users and channels.
method Developed algorithms for stochastic and adversarial settings, combining Exp3.P for dynamic scenarios.
result Sub-linear regret guarantees for both stochastic and adversarial cases, even when users outnumber channels.
Implicit Q-learning and SARSA adjust step-sizes automatically, improving stability and performance.
problem Numerical instability and slow progress in Q-learning and SARSA due to step-size calibration.
method Reformulate iterative updates as fixed-point equations, scaling step-sizes inversely with feature norms.
result Implicit methods maintain stability over broader step-size ranges and achieve comparable convergence rates.
TIDBD adapts TD step-sizes for better performance.
problem Finding optimal step-sizes for TD learning.
method Generalizes IDBD to TD learning, adapting step-sizes per feature.
result TIDBD outperforms other TD methods in various tasks.
The paper analyzes fixed step-size SA schemes on Riemannian manifolds.
problem Developing efficient algorithms for optimization on curved spaces.
method Fixed step-size stochastic approximation schemes in a Riemannian framework.
result The schemes converge to the solution as the step-size approaches zero.
The paper analyzes and validates two step size schedules for SGD: exponential and cosine, proving their adaptivity and performance.
problem The variability of SGD performance due to step size choice.
method Analysis and empirical evaluation of exponential and cosine step sizes.
result Exponential and cosine step sizes are adaptive to noise and achieve optimal performance without tuning hyperparameters.
New algorithm improves stability of optimization algorithms by adapting step-size.
problem Optimization algorithms' effectiveness is sensitive to step-size hyperparameters.
method Adapts NGN step-size method with momentum to enhance stability.
result Achieves convergence rate of O(1/√K) without restrictive assumptions.
Adaptive step sizes improve optimization for convex and nonconvex problems.
problem Optimizing functions that are not strongly convex.
method Bridge nonconvex and strongly convex problems via regularization, then apply Barzilai-Borwein step sizes with SARAH.
result Regularized SARAH methods achieve better complexity in nonconvex problems.
This paper optimizes step sizes for faster convergence in sparse coding.
problem Improving convergence rate of ISTA for sparse coding.
method Learning step sizes for ISTA using neural networks.
result A simple step size strategy can improve convergence rate of ISTA.
AutoStep MCMC adapts step size locally for better sampling efficiency.
problem Challenging step size selection for complex, multiscale targets.
method AutoStep MCMC uses a locally adaptive step size for involutive proposals.
result AutoStep MCMC is π-invariant, irreducible, and aperiodic.
The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the algorithm, where the importance of each step decreases with time. This article studies …
We analyze constant step-size and iterate averaging in linear stochastic approximation algorithms.
problem Policy evaluation in reinforcement learning using temporal difference algorithms.
method Constant step-size and Polyak-Ruppert averaging of iterates.
result MSE decays as O(1/t) for a range of constant step-sizes under certain conditions.
Adaptive step-size improves optimization in complex geometries.
problem Optimizing functions with non-Euclidean geometries.
method Adaptive step-size strategy for optimization algorithms.
result Guaranteed convergence for Adaptive Conditional Gradient Descent.
Negative step sizes improve second-order methods for neural networks.
problem Second-order methods discard negative curvature, limiting their effectiveness.
method Introduce negative step sizes in second-order methods combined with Wolfe line search.
result Negative step sizes lead to global convergence and improved performance.
Speed learning on the flymath.OC
The practical performance of online stochastic gradient descent algorithms is highly dependent on the chosen step size, which must be tediously hand-tuned in many applications. The same is true for more advanced variants of stochastic gradients, such as SAGA, SVRG, or AdaGrad. Here we propose to adapt the step size by …
New SVRG and SARAH schemes reduce tuning effort for variance reduction.
problem Optimal performance of SVRG and SARAH requires tuning of parameters.
method Introduces Barzilai-Borwein step sizes, averaging, and adaptive inner loop length.
result Improves SVRG, SARAH, and BB variants' convergence rates and performance.
New insights into SGD and SGD-M in high dimensions.
problem Understanding and comparing SGD and SGD-M in high-dimensional settings.
method Developed high-dimensional scaling limits for SGD-M and online SGD, examining their dynamics and performance.
result SGD-M amplifies high-dimensional effects, potentially degrading performance compared to online SGD.
Improved variational inequality algorithms using adaptive step sizes.
problem Solving monotone variational inequalities and convex-concave min-max problems efficiently.
method Adaptive step sizes that eliminate hyperparameters and global Lipschitz continuity requirements.
result Eliminated the need for the golden ratio in the algorithm and improved complexity bounds.
New step-size methods improve SHB convergence for stochastic optimization.
problem Tuning step-size and momentum parameters in SHB is challenging.
method Proposed MomSPS, MomDecSPS, and MomAdaSPS for SHB.
result Convergence guarantees for SHB to solution neighborhoods and exact minimizers.
Adaptive step-size method improves compressed SGD performance in machine learning.
problem Communication bottleneck in distributed and decentralized optimization.
method Developed an adaptive step-size method for compressed SGD.
result Order-optimal convergence rates for various objective functions.
Gradient descent can use larger step sizes to avoid strict saddle points.
problem Avoiding strict saddle points in non-convex optimization.
method Proving that gradient descent with step-size up to 2/L avoids strict saddle points with high probability.
result Gradient descent with step-size up to 2/L almost surely avoids strict saddle points.
One of the major issues in stochastic gradient descent (SGD) methods is how to choose an appropriate step size while running the algorithm. Since the traditional line search technique does not apply for stochastic optimization algorithms, the common practice in SGD is either to use a diminishing step size, or to tune a…
New adaptive step-size method for convex optimization without tuning.
problem Optimizing convex functions efficiently with stochastic gradients.
method Adapted Adaptive Gradient Descent Without Descent to stochastic setting.
result Stochastic gradient descent converges under various assumptions.
Survey shows firms still underutilize collaboration in procurement relationships.
problem Limited collaboration between purchasing firms and suppliers despite benefits.
method Survey of procurement professionals, structural equation modeling.
result Firms are not fully utilizing collaborative relationships.
Large SGD step sizes lead to sparse feature learning in neural networks.
problem Sparse feature learning in neural networks with large step sizes.
method Empirical observations and theoretical analysis of SGD dynamics.
result Large step sizes induce implicit regularization leading to sparse predictors.
Polyak step size GD reaches final radius of convergence after log iterations.
problem Statistical and computational complexities of Polyak step size GD.
method Generalized smoothness and Lojasiewicz conditions, stability of gradients.
result Polyak step size GD reaches final statistical radius of convergence after logarithmic number of iterations.
Develops a generalized version of Chung's Lemma for stochastic optimization methods.
problem Establishing asymptotic convergence rates for stochastic optimization methods under various step size rules.
method Generalized version of Chung's Lemma for a broader family of step size rules.
result Demonstrates tight non-asymptotic convergence rates for various stochastic methods.
WITCHcraft improves PGD attacks with random step size, enhancing efficiency.
problem Efficiently crafting adversarial attacks on neural networks.
method Variant of PGD using random step size.
result Superior performance to classical PGD without additional computational cost.
Convergence Analysis of a Momentum Algorithm with Adaptive Step Size for Non Convex Optimizationmath.OC
New convergence analysis for ADAM algorithm in non-convex optimization with adaptive step size.
problem Convergence issues in ADAM algorithm for non-convex optimization.
method Study of ADAM algorithm under bounded adaptive step size assumption, providing safe step sizes.
result Novel first order convergence rate result in deterministic and stochastic contexts.
Gradient descent step size impacts neural network training outcomes.
problem Understanding how step size affects neural network training outcomes.
method Analyzing gradient descent as a discrete-time dynamical system, studying Lyapunov stability.
result Step size determines the subset of local optima and the magnitude of oscillations.
Constant Step Size Least-Mean-Square: Bias-Variance Trade-offs and Optimal Sampling Distributionscs.LG
We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide an asymptotic expansion up to explicit exponentially decaying terms. Our analysis…
Proposes a new adaptive learning rate for SGD.
problem Finding an efficient learning rate for SGD.
method Stochastic Polyak step-size (SPS).
result SGD with SPS converges faster for over-parameterized models.
Study optimizes step size for Metropolis algorithm in non-identifiable cases.
problem Optimizing step size for Metropolis algorithm in non-identifiable models.
method Analytical derivation of average acceptance rate for non-identifiable cases.
result Developed optimization principle for step size based on average acceptance rate.
The paper adapts step sizes in TD learning to identify relevant features.
problem Identifying which features are relevant for temporal-difference learning.
method Adapting step sizes in stochastic gradient descent for feature relevance in TD learning.
result TD IDBD effectively distinguishes relevant features in gridworld and robotic tasks.
The paper interprets learned step sizes in deep-unfolded gradient descent.
problem Intuitive interpretation of learned non-constant step sizes in deep-unfolded gradient descent.
method Theoretical analysis and optimization of spectral radius.
result Chebyshev steps achieve the lower bound of convergence rate for first-order methods.
TIDBD adapts step sizes online for better robotic predictions.
problem Choosing appropriate learning parameters for online prediction-learning.
method Temporal-Difference Incremental Delta-Bar-Delta (TIDBD) for step-size adaptation.
result TIDBD performs comparably to classic TD learning and detects sensor failures.
New convergence results for NGVI with various step sizes and sample sizes.
problem Understanding convergence of stochastic NGVI for various schedules.
method Projected stochastic NGVI for exponential family variational distributions.
result Geometric convergence and $\mathcal{O}\left(\frac{1}{T^ρ}
ight)$ rates for different schedules.
New optimal step sizes and mini-batch sizes for SAGA.
problem Finding optimal step sizes and mini-batch sizes for SAGA.
method Provided closed-form expressions for expected smoothness constant and suggested new step sizes and mini-batch sizes.
result Total complexity of SAGA decreases linearly with mini-batch size up to an optimal value.
Learning the Step-size Policy for the Limited-Memory Broyden-Fletcher-Goldfarb-Shanno Algorithmcs.LG
Proposes a neural network for learning step-size policies for L-BFGS optimization.
problem Optimizing step sizes for L-BFGS in large-scale problems.
method Neural network architecture using local iterate information, trained via stochastic optimization.
result Outperforms existing step size selection methods in training classifiers.
Sparse Polyak improves high-dimensional statistical estimation.
problem High-dimensional statistical estimation problems with growing problem dimension.
method Sparse Polyak modifies Polyak's adaptive step size to estimate restricted Lipschitz smoothness.
result Sparse Polyak achieves optimal statistical precision with fewer iterations.
SGD converges almost surely in non-convex problems, avoiding saddle points and accelerating convergence.
problem Understanding convergence of SGD in non-convex optimization problems.
method Analysis of SGD trajectories, focusing on boundedness, convergence to strict saddle points, and rate of convergence.
result SGD converges almost surely to a minimizer in non-convex problems, avoiding strict saddle points.
Paper develops an online learning algorithm for functional data models.
problem Recovering slope functions or predictors in functional data models.
method Online regularized learning algorithm in reproducing kernel Hilbert spaces with polynomially decaying step-size.
result Established fast convergence rates for estimation error without capacity assumption.
Applying standard Markov chain Monte Carlo (MCMC) algorithms to large data sets is computationally infeasible. The recently proposed stochastic gradient Langevin dynamics (SGLD) method circumvents this problem in three ways: it generates proposed moves using only a subset of the data, it skips the Metropolis-Hastings a…
New SARAH variant MB-SARAH-RBB accelerates mini-batch optimization.
problem Improving the performance of SARAH in mini-batch settings.
method Introduced MB-SARAH-RBB, a variant of SARAH using RBB step size calculation.
result MB-SARAH-RBB converges linearly for strongly convex objectives and outperforms existing methods.
New TD algorithms stabilize RL tasks by reformulating updates into fixed point equations.
problem TD learning's sensitivity to step size specification.
method Implicit TD algorithms reformulate TD updates into fixed point equations.
result Implicit TD algorithms are more stable and less sensitive to step size.