Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

19385675 · May 202619922001200920172026
48 results for excess decay

Last SGD iterate bounds for overparameterized linear regression.

problem Analyzing the last iterate risk bounds of SGD with decaying stepsize for overparameterized linear regression.
method Problem-dependent analysis of last iterate risk bounds of SGD with geometrically decaying stepsize.
result Proved nearly matching upper and lower bounds on the excess risk for last iterate SGD with geometrically decaying stepsize.

The study examines Kernel Ridge Regression error rates across noiseless and noisy conditions.

problem Characterizing Kernel Ridge Regression error rates in different noise levels.
method Unified analysis of Kernel Ridge Regression under various noise and regularization conditions.
result A crossover from noiseless to noisy error rates is observed as sample complexity increases.

This paper concerns integral varifolds of arbitrary dimension in an open subset of Euclidean space with its first variation given by either a Radon measure or a function in some Lebesgue space. Pointwise decay results for the quadratic tilt-excess are established for those varifolds. The results are optimal in terms of…

2009-09-17abs ↗pdf ↗

Study on singularities in area-minimizing currents, proving unique tangent cones and rectifiability.

problem Understanding singularities in area-minimizing currents.
method Fine excess decay theorems and almost monotonicity of a frequency function.
result Unique tangent cones and countably (m2)(m-2)-rectifiable singular set.

Paper develops an online learning algorithm for functional data models.

problem Recovering slope functions or predictors in functional data models.
method Online regularized learning algorithm in reproducing kernel Hilbert spaces with polynomially decaying step-size.
result Established fast convergence rates for estimation error without capacity assumption.

We derive an upper bound on the local Rademacher complexity of p\ell_p-norm multiple kernel learning, which yields a tighter excess risk bound than global approaches. Previous local approaches aimed at analyzed the case p=1p=1 only while our analysis covers all cases 1p1\leq p\leq\infty, assuming the different feature …

2011-03-03abs ↗pdf ↗

New height estimate for area minimizing currents, leading to unique tangent cones and decay properties.

problem Analyzing singularities of area minimizing currents.
method Height estimate, decay estimates, techniques inspired by previous works.
result Locally area minimizing currents have a unique tangent cone at almost every point and decay rapidly to a unique tangent plane at branch points.

ASGD outperforms SGD in overparameterized linear regression, especially in subspaces of small eigenvalues.

problem Generalization of ASGD for overparameterized linear regression.
method Established instance-dependent excess risk bound for ASGD in each eigen-subspace of the data covariance matrix.
result ASGD outperforms SGD in subspaces of small eigenvalues, exhibiting faster decay of bias error.

The paper calculates how fast optimal investment strategies approach CRRA strategies in stochastic factor models.

problem Understanding convergence rates of optimal investment strategies in stochastic factor models.
method Analyzes optimal feedback functions in nonlinear and quadratic term structure models, considering decay of bond prices and power-like utility at high wealth levels.
result Convergence rates of optimal investment strategies to CRRA strategies are determined by bond price decay and power-like utility behavior.

Deep neural networks classify unbounded Gaussian mixture data without dimensionality issues.

problem Binary classification of unbounded Gaussian mixture data.
method Deep ReLU neural networks with non-asymptotic upper bounds and convergence rates.
result Deep ReLU networks can classify unbounded Gaussian mixture data without dimensionality constraints.

S2D selectively decays large singular values to improve quantization of neural activations.

problem Large activation outliers in transformer models cause accuracy drops during quantization.
method Selective Spectral Decay (S2DS^2D) that surgically regularizes only the largest singular values.
result Significantly reduces activation outliers and produces well-conditioned representations.

Defines MER for Bayesian learning, a gap between achievable and optimal performance.

problem Analyzing the best performance of Bayesian learning under generative models.
method Two methods for deriving upper bounds for MER: conditional mutual information and minimum estimation error.
result Quantifies the rate at which MER decays to zero with more data and relates it to model richness.

AI-driven investment strategies self-defeat at scale due to signal crowding and erosion.

problem Excess returns from AI-driven investment strategies diminish at scale due to signal crowding and erosion.
method Theoretical model and empirical validation using SEC Form 13F filings and hedge fund return dynamics.
result The alpha half-life of signals decreases significantly with AI adoption, leading to diminishing returns.

A class of heterogeneous agent models is investigated where investors switch trading position whenever their motivation to do so exceeds some critical threshold. These motivations can be psychological in nature or reflect behaviour suggested by the efficient market hypothesis (EMH). By introducing different propensitie…

2006-07-31abs ↗pdf ↗

Two models predict similar high-frequency price dynamics but differ in low-frequency impact strength.

problem Understanding the relationship between market prices and fundamental information.
method Comparing a microfounded linear model with a data-driven model at high and low frequencies.
result Both models predict similar high-frequency price dynamics but differ in low-frequency impact strength.

A new classifier uses Fermat distance for semi-supervised learning in high dimensions.

problem Semi-supervised classification with limited labeled data in high-dimensional settings.
method Proposes weighted k-NN and MDS classifiers using Fermat distance.
result The weighted k-NN classifier is minimax optimal and outperforms other methods.

Study examines robust regression in high dimensions with heavy-tailed data.

problem Analyzing robust regression in high-dimensional settings with heavy-tailed data.
method Sharp asymptotic characterisation of M-estimators and ridge regression in elliptical distributions.
result Ridge regression is optimal and universal for finite second moments but can decay faster without them.

Ridge regression performs optimally in noisy environments with heavy-tailed distributions.

problem Performance of ridge regression in noisy environments with heavy-tailed noise.
method Established excess risk bounds using integral operator framework and Fuk-Nagaev inequality.
result Ridge regression achieves optimal convergence rates under heavy-tailed noise, demonstrating robustness.

The paper proves unique blow-down for critical points of a Yang-Mills-Higgs functional.

problem Proving uniqueness of blow-down for critical points of a Yang-Mills-Higgs functional.
method Using an Allard-type improvement of flatness to establish co-dimension-two analogue of Savin's theorem.
result Entire critical points have unique blow-down, two-dimensional in ambient dimensions 2-4 or any dimension assuming local minimizer.

Paper analyzes SGD in kernel regression, showing it outperforms offline methods.

problem Performance of SGD in kernel regression compared to offline methods.
method Analyzes Stochastic Gradient Descent (SGD) in kernel regression under misspecified models.
result SGD achieves min-max optimal rates up to constants, avoiding saturation.

Study quantization effects on high-dimensional linear regression learning.

problem Understanding quantization's impact on learning high-dimensional linear regression models.
method Analyzes stochastic gradient descent for high-dimensional linear regression under various quantization targets.
result Establishes precise bounds on excess risk for different quantization schemes.

Investor-driven information diffusion affects excess comovement in China and the U.S. markets.

problem Investor-driven information diffusion and its impact on excess comovement.
method Cross-sectional analysis of 4,533 Chinese and 4,517 U.S. stocks from 2010 to 2022.
result Retail-driven information diffusion significantly drives excess comovement in China, while institution-driven diffusion is the primary driver in the U.S.

Mathematical study of excess growth rate connects info theory with finance.

problem Understanding the excess growth rate in portfolio theory.
method Axiomatic characterization theorems of excess growth rate in terms of relative entropy, Jensen's inequality gap, and logarithmic divergence.
result Established rich connections between information theory and finance.

New method improves convergence of SPP for convex optimization problems.

problem Stochastic optimization and robustness to SGD.
method Minibatch Stochastic Proximal Point (M-SPP) method with stability analysis.
result M-SPP achieves faster convergence rates under smoothness and quadratic growth conditions.

In statistical learning theory, convex surrogates of the 0-1 loss are highly preferred because of the computational and theoretical virtues that convexity brings in. This is of more importance if we consider smooth surrogates as witnessed by the fact that the smoothness is further beneficial both computationally- by at…

2014-02-07abs ↗pdf ↗

New tool detects 'fleeting modes' causing excess risk in financial markets.

problem Detecting portfolios with statistically significant excess risk in financial markets.
method Random Matrix Theory to identify 'fleeting modes' independent of underlying correlation structure.
result Fleeting modes exist in both futures and equity markets, and momentum is a source of excess risk.

The paper explores the information-theoretic nature of excess risk in machine learning.

problem Understanding the excess risk in machine learning models.
method Formulates the minimax excess risk as a zero-sum game and modifies it to allow swapping of the order of play.
result Proves that under certain conditions, the duality gap is zero, allowing for the application of Bayesian results to provide bounds on minimax excess risk.

Study excess capacity in neural networks using Rademacher complexity.

problem Understanding how much capacity deep networks have beyond what's needed for classification.
method Unified Rademacher complexity bounds for function composition and convolutional layers, considering Lipschitz constants and initialization norms.
result There is substantial excess capacity per task, and capacity can be kept similar across different tasks.

We find a deterministic equivalent for random feature regression's test error, independent of feature map dimension.

problem Understanding the generalization performance of random feature ridge regression.
method We derive a deterministic equivalent for the test error of RFRR under a concentration property, showing it can be approximated by a closed-form expression dependent on feature map eigenvalues.
result Our approximation guarantee is non-asymptotic, multiplicative, and independent of the feature map dimension, providing a tight result for the smallest number of features achieving optimal minimax error rate.

Study excess risk in statistical inference with transformations.

problem Excess risk in estimating random variables from feature vectors and transformations.
method Characterize lossless transformations, develop test statistics, and information-theoretic bounds.
result Strongly consistent partitioning test statistic for lossless transformations.