Survey on strong convergence in random matrices and its applications.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Study on interest rate model with jumps, proving strong convergence in simulations.
FastAdaBelief improves convergence rate of AdaBelief by exploiting strong convexity.
This work proves a strong convergence result for a geometric EM scheme on Riemannian manifolds.
We study convergence properties of the full truncation Euler scheme for the Cox-Ingersoll-Ross process in the regime where the boundary point zero is inaccessible. Under some conditions on the model parameters (precisely, when the Feller ratio is greater than three), we establish the strong order 1/2 convergence in $L^…
We consider the approximation of stochastic differential equations (SDEs) with non-Lipschitz drift or diffusion coefficients. We present a modified explicit Euler-Maruyama discretisation scheme that allows us to prove strong convergence, with a rate. Under some regularity and integrability conditions, we obtain the opt…
Uniform counting formulas for orthogeodesics in Kleinian groups converge.
In this paper, we are interested in the strong convergence properties of the Ninomiya-Victoir scheme which is known to exhibit weak convergence with order 2. We prove strong convergence with order . This study is aimed at analysing the use of this scheme either at each level or only at the finest level of a multil…
New method uses momentum to converge in DC optimization with small batches.
Motivated by weak convergence results in the paper of Takahashi and Yoshida (2005), we show strong convergence for an accelerated Euler-Maruyama scheme applied to perturbed stochastic differential equations. The Milstein scheme with the same acceleration is also discussed as an extended result. The theoretical results …
Paper studies Kähler-Ricci flow convergence on Fano manifolds.
Many fractional processes can be represented as an integral over a family of Ornstein-Uhlenbeck processes. This representation naturally lends itself to numerical discretizations, which are shown in this paper to have strong convergence rates of arbitrarily high polynomial order. This explains the potential, but also s…
New method transforms complex stochastic equations into simpler ones for efficient simulation.
In this paper we generalize the framework of the feasible descent method (FDM) to a randomized (R-FDM) and a coordinate-wise random feasible descent method (RC-FDM) framework. We show that the famous SDCA algorithm for optimizing the SVM dual problem, or the stochastic coordinate descent method for the LASSO problem, f…
The multilevel Monte Carlo path simulation method introduced by Giles ({\it Operations Research}, 56(3):607-617, 2008) exploits strong convergence properties to improve the computational complexity by combining simulations with different levels of resolution. In this paper we analyse its efficiency when using the Milst…
Unified convergence analysis of alpha-SVRG under strong convexity.
Stochastic approximation (SA) is a classical approach for stochastic convex optimization. Previous studies have demonstrated that the convergence rate of SA can be improved by introducing either smoothness or strong convexity condition. In this paper, we make use of smoothness and strong convexity simultaneously to boo…
New insights show NAG and FISTA converge linearly without knowing strong convexity modulus.
Global convergence for robust regression problems via IRLS with enhancements.
Studied SGD convergence under weak conditions.
New algorithm solves saddle point problems in Banach spaces.
When approximating a space curve, it is natural to consider whether the knot type of the original curve is preserved in the approximant. This preservation is of strong contemporary interest in computer graphics and visualization. We establish a criterion to preserve knot type under approximation that relies upon pointw…
Study continuity of limit sets in symmetric spaces.
SVRG and its variants are among the state of art optimization algorithms for large scale machine learning problems. It is well known that SVRG converges linearly when the objective function is strongly convex. However this setup can be restrictive, and does not include several important formulations such as Lasso, grou…
Local Bayesian optimization shows strong performance and converges well, contrary to folklore.
Kernel method improves instrumental variable regression rates.
We are interested in strong approximations of one-dimensional SDEs which have non-Lipschitz coefficients and which take values in a domain. Under a set of general assumptions we derive an implicit scheme that preserves the domain of the SDEs and is strongly convergent with rate one. Moreover, we show that this general …
Stochastic gradient algorithms estimate the gradient based on only one or a few samples and enjoy low computational cost per iteration. They have been widely used in large-scale optimization problems. However, stochastic gradient algorithms are usually slow to converge and achieve sub-linear convergence rates, due to t…
In this paper we introduce a new multilevel Monte Carlo (MLMC) estimator for multi-dimensional SDEs driven by Brownian motions. Giles has previously shown that if we combine a numerical approximation with strong order of convergence with MLMC we can reduce the computational complexity to estimate expected value…
In this paper, we investigate the statistical convergence rate of a Bayesian low-rank tensor estimator. Our problem setting is the regression problem where a tensor structure underlying the data is estimated. This problem setting occurs in many practical applications, such as collaborative filtering, multi-task learnin…
Uniformly random permutations converge to regular representation on surface groups.
The paper estimates area and volume for spacetimes with integral mean curvature bounds.
New convergence rates for shuffling gradient methods without strong convexity.
We investigate compactness phenomena involving free boundary minimal hypersurfaces in Riemannian manifolds of dimension less than eight. We provide natural geometric conditions that ensure strong one-sheeted graphical subsequential convergence, discuss the limit behaviour when multi-sheeted convergence happens and deri…
Random surfaces have a strong spectral gap with polynomial rate.
We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the difference of convex (DC) programming, and enjoys both strong computational and statist…
Strong stability of ergodic iterations proven without ergodic driving sequence.
Study shows finite agent equilibrium converges to mean-field limit in asset pricing.
Paper shows how solutions to Allen-Cahn converge to multiphase mean curvature flow.
In 1963, Polyak proposed a simple condition that is sufficient to show a global linear convergence rate for gradient descent. This condition is a special case of the Łojasiewicz inequality proposed in the same year, and it does not require strong convexity (or even convexity). In this work, we show that this much-older…
Direct method finds Yang-Mills connections for SO(3) bundles.
Variational inference (VI) is a widely used framework in Bayesian estimation. For most of the non-Gaussian statistical models, it is infeasible to find an analytically tractable solution to estimate the posterior distributions of the parameters. Recently, an improved framework, namely the extended variational inference…
In this paper, we study the online learning algorithm without explicit regularization terms. This algorithm is essentially a stochastic gradient descent scheme in a reproducing kernel Hilbert space (RKHS). The polynomially decaying step size in each iteration can play a role of regularization to ensure the generalizati…
Yau's Affine Normal Descent optimizes smooth unconstrained problems with geometrically adapted directions.
Improved SGD methods converge faster for nonconvex optimization.
New varifold solutions for mean curvature flow converge and are unique.
RR algorithm improves convergence rate without strong convexity assumptions.
Although kernel methods are widely used in many learning problems, they have poor scalability to large datasets. To address this problem, sketching and stochastic gradient methods are the most commonly used techniques to derive efficient large-scale learning algorithms. In this study, we consider solving a binary class…