Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3773110146 · May 202619922001200920172026
48 results for decay constant

Riemannian stochastic gradient descent converges faster with increasing batch size.

problem Improving convergence rate of Riemannian stochastic gradient descent.
method Theoretical analysis and numerical investigation of increasing batch size effects.
result Riemannian stochastic gradient descent converges faster with increasing batch size.

Regularization in the optimization of deep neural networks is often critical to avoid undesirable over-fitting leading to better generalization of model. One of the most popular regularization algorithms is to impose L-2 penalty on the model parameters resulting in the decay of parameters, called weight-decay, and the …

2019-07-21abs ↗pdf ↗

Study on optimal ReLU networks with weight decay for interpolation.

problem Interpolating data with radially symmetric distributions using shallow ReLU networks.
method Weight decay regularization in infinite neuron, infinite data limit; analysis of growth rates.
result Existence and growth rates of unique radially symmetric minimizers with weight decay.

Last SGD iterate bounds for overparameterized linear regression.

problem Analyzing the last iterate risk bounds of SGD with decaying stepsize for overparameterized linear regression.
method Problem-dependent analysis of last iterate risk bounds of SGD with geometrically decaying stepsize.
result Proved nearly matching upper and lower bounds on the excess risk for last iterate SGD with geometrically decaying stepsize.

Step decay schedules improve convergence in non-convex optimization.

problem Improving convergence in non-convex optimization problems.
method Analyzing convergence rates of step decay schedules in non-convex, convex, and strongly convex problems.
result Step decay schedules achieve O(lnT/T)\mathcal{O}(\ln T/\sqrt{T}) convergence rates in various optimization scenarios.

This paper is motivated by the non-linear stability problem for the expanding region of Kerr de Sitter cosmologies in the context of Einstein's equations with positive cosmological constant. We show that under dynamically realistic assumptions the conformal Weyl curvature of the spacetime decays towards future null inf…

2016-10-13abs ↗pdf ↗

Paper develops an online learning algorithm for functional data models.

problem Recovering slope functions or predictors in functional data models.
method Online regularized learning algorithm in reproducing kernel Hilbert spaces with polynomially decaying step-size.
result Established fast convergence rates for estimation error without capacity assumption.

The study examines Kernel Ridge Regression error rates across noiseless and noisy conditions.

problem Characterizing Kernel Ridge Regression error rates in different noise levels.
method Unified analysis of Kernel Ridge Regression under various noise and regularization conditions.
result A crossover from noiseless to noisy error rates is observed as sample complexity increases.

The study examines averages of Laplacian determinants over large genus moduli spaces.

problem Analyzing averages of determinants of Laplacians over large genus moduli spaces.
method Examined the moduli space of hyperbolic surfaces with the Weil-Petersson metric, showing decay rates and approaching constants for specific functions.
result Found a universal constant E and decay rates for expected values of determinants over large genus moduli spaces.

New exponential decay estimate for Hermitian Yang-Mills metrics near branch points.

problem Understanding the behavior of Hermitian Yang-Mills metrics near branch points.
method Local radial solutions, global gluing construction, exponential estimate near branch points.
result Exponential decay estimate for local radial solutions near branch points.

Kernel Density Estimation is a very popular technique of approximating a density function from samples. The accuracy is generally well-understood and depends, roughly speaking, on the kernel decay and local smoothness of the true density. However concrete statements in the literature are often invoked in very specific …

2019-01-02abs ↗pdf ↗

We introduce a class of "weakly asymptotically hyperbolic" geometries whose sectional curvatures tend to 1-1 and are C0C^0, but are not necessarily C1C^1, conformally compact. We subsequently investigate the rate at which curvature invariants decay at infinity, identifying a conformally invariant tensor which serves a…

2015-06-10abs ↗pdf ↗

New theory sharpens Q-learning with LDTZ rate, proving it's best of both worlds.

problem Improving Q-learning's theoretical and practical performance.
method Developed a sharp non-asymptotic error bound and central limit theory for Q-learning with PD2Z-ν schedule.
result Q-learning with LDTZ schedule achieves rapid decay and asymptotic convergence guarantees.

Study of flows on circle bundles over translation surfaces, showing decay of correlations.

problem Ergodic properties of flows on circle bundles over translation surfaces.
method Generalizing Heisenberg nilflows to more general base surfaces, showing relatively mixing.
result Showed that such flows exhibit decay of correlations in the orthogonal complement of functions constant along fibers.

Growth of spinors in 4D and 3D generalized Seiberg-Witten equations.

problem Proving growth of spinors in GSW equations on R4\mathbb R^4 and R3\mathbb R^3.
method Unified framework of GSW equations, averaged L2L^2-norm, curvature decay assumption, Yang-Mills-Higgs energy.
result Growth of spinors in GSW equations on R4\mathbb R^4 and R3\mathbb R^3 faster than a power of the radius under suitable curvature decay.

WSqD extends learning rate schedules for large model training without fixed horizons.

problem Fixed learning rate schedules limit training horizon extension.
method WSqD replaces constant stable phase with a shifted inverse-square-root base, retaining linear cooldown.
result WSqD achieves minimax-optimal convergence rate and horizon-independence.

Future stability of FLRW solutions in expanding 3D space is shown for compact perturbations.

problem Future stability of expanding FLRW solutions with spatial topology R^3.
method Nonlinear stability analysis of spherically symmetric perturbations.
result Decay rates of energy momentum tensor components compared to Minkowski space.

WSD schedule improves model training efficiency by adapting learning rates dynamically.

problem Fixed compute budgets limit training efficiency of language models.
method Introduces a WSD schedule that uses a constant learning rate followed by a rapid decay phase.
result WSD schedule generates a non-traditional loss curve with stable and decay phases.

Paper extends foliation results in higher dimensions for Schwarzschild spaces.

problem Existence of foliations by constant harmonic mean curvature hypersurfaces in asymptotically Schwarzschild manifolds.
method Generalization to higher dimensions, proving existence under arbitrary dimensionality.
result Existence of foliations by constant harmonic mean curvature hypersurfaces in asymptotically Schwarzschild manifolds of arbitrary dimension.

CNN layers with large norms are still robust to adversarial attacks.

problem Understanding the relationship between layer norms and adversarial robustness in CNNs.
method Theoretical analysis of 1\ell_1 and \ell_\infty norms, norm decay method, adversarial training frameworks.
result Adversarially robust CNNs can have comparable or larger layer norms than non-adversarially robust ones.

Gradient descent outperforms ridge regression under certain covariance matrix decay conditions.

problem Comparing the performance of gradient descent and ridge regression in linear models.
method Investigated gradient descent and ridge regression for linear regression with random isotropic ground truth.
result Gradient descent outperforms ridge regression under specific covariance matrix decay conditions.

Study on U-statistics with heavy-tailed samples, providing tail bounds and LDP.

problem Deviation of U-statistics with heavy-tailed samples.
method Exponential tail bounds and Large Deviation Principle (LDP) for U-statistics.
result Obtained an exponential upper bound for U-statistics tail decay, showing two regions of decay.

We show that the only complete shrinking gradient Ricci solitons with vanishing Weyl tensor are quotients of the standard ones. This gives a new proof of the Hamilton-Ivey-Perel'man classification of 3-dimensional shrinking gradient solitons. We also prove a classification for expanding gradient Ricci solitons with con…

2007-12-08abs ↗pdf ↗

Generalizes Ricci flow starting from small curvature concentration with a Morrey-type condition.

problem Ricci flow starting from manifolds with unbounded curvature.
method Replaces bounded curvature with a Morrey-type condition on the gradient of the metric relative to a complete bounded curvature metric.
result Long-time existence of Ricci flow with curvature decay estimates and diffeomorphic manifold.

The paper connects neural collapse and low-rank bias in networks with L2 regularization.

problem Understanding the emergence of low-rank bias and neural collapse in L2-regularized networks.
method Unified theoretical framework linking TCV and rank of weight matrices, proving global optimality of DNC1, and establishing a benign landscape property.
result Zero TCV across intermediate layers minimizes representation cost under natural architectural constraints, and DNC1 is globally optimal.

New framework for Adam-type algorithms with constant β1, improving regret analysis.

problem Theoretical vs. practical use of Adam and variants with constant β1.
method Proposed a novel framework to derive optimal, data-dependent regret bounds with constant β1.
result Optimal, data-dependent regret bounds with constant β1 are achievable without further assumptions.

We show that for an nn dimensional complete non Ricci flat gradient steady Ricci soliton with potential function ff bounded above by a constant and curvature tensor RmRm satisfying limrrRm<15\overline{\lim}_{r\to \infty} r|Rm|<\frac{1}{5}, then RmCer|Rm|\leq Ce^{-r} for some constant C>0C>0, improving a result of [36]. For any f…

2019-08-27abs ↗pdf ↗

We consider solutions to the linear wave equation gφ=0\Box_gφ=0 on a non-extremal maximally extended Schwarzschild-de Sitter spacetime arising from arbitrary smooth initial data prescribed on an arbitrary Cauchy hypersurface. (In particular, no symmetry is assumed on initial data, and the support of the solutions may con…

2007-09-18abs ↗pdf ↗

SGD's performance improves with critical batch size, minimizing SFO complexity.

problem Optimizing SGD's performance with batch size and learning rate.
method Analysis of SGD using constant and decaying learning rates, focusing on batch size effects.
result SGD with critical batch size minimizes SFO complexity.

A 3D metric conformally related to Arnold cat fast dynamo metric: dsA2=eλzdp2+eλzdq2+dz2{ds_{A}}^{2}=e^{-λz}dp^{2}+e^{λz}dq^{2}+dz^{2} is shown to present a behaviour of non-dynamos where the magnetic field exponentially decay in time. The Riemann-Christoffel connection and Riemann curvature tensor for the Arnold and its conformal counter…

2007-03-14abs ↗pdf ↗

Let 0<m<(n-2)/n, n>2, α=(2β+ρ)/(1m)α=(2β+ρ)/(1-m) and β>mρ/(n2mn)β>mρ/(n-2-mn) for some constant ρ>0ρ>0. Suppose v is a radially symmetric symmetric solution of n1mΔvm+αv+βxv=0\frac{n-1}{m}Δv^m+αv+βx\cdot\nabla v=0, v>0, in RnR^n. When m=(n-2)/(n+2), the metric g=v4/(n+2)dx2g=v^{4/(n+2)}dx^2 corresponds to a locally conformally flat Yamabe shrinking gradient soli…

2012-11-14abs ↗pdf ↗

The study explores dilating set properties across Euclidean and hyperbolic geometries.

problem Distributional properties of dilating sets under projection.
method Covering maps and unit tangent bundles, focusing on manifolds of constant curvature.
result Established a precise asymptotic expansion for averages along expanding translates of homogeneous curves in hyperbolic surfaces.

We make some improvements to our previous results. First, we prove a version of our volume growth theorem which does not require any assumption on the first Betti number. Second, we show that our local regularity theorem only requires a lower volume growth assumption, not a full Sobolev constant bound. These results al…

2006-12-17abs ↗pdf ↗