Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.8% · Oct 200319922001200920172026
48 results for under-regularization

This research improves binary classification by balancing overfitting and generalization with a novel Bayesian approach.

problem Improving binary classification models to avoid overfitting and generalize well.
method Introduces a PAC-Bayes type learning rule with a balancing parameter λ to balance training error and KL divergence to a prior.
result A choice of λ ensures uniformly vanishing excess loss, even in the agnostic case, by under-regularizing or over-regularizing appropriately.

Hopf's Umlaufsatz relates the total curvature of a closed immersed plane curve to its rotation number. While the curvature of a curve changes under local deformations, its integral over a closed curve is invariant under regular homotopies. A natural question is whether one can find some non-trivial densities on a curve…

2011-08-22abs ↗pdf ↗

Study reveals learning curves and benign overfitting in spectral algorithms for large dimensions.

problem Understanding learning curves and benign overfitting in spectral algorithms for large-dimensional data.
method Analysis of learning curves and benign overfitting in spectral algorithms for inner-product kernels on the sphere and general domains.
result Characterization of three distinct regimes: over-regularized, under-regularized, and interpolation regimes, revealing benign overfitting across both under-regularized and interpolation regimes.

The paper reveals three mechanisms for weak-to-strong generalization.

problem Understanding the mechanisms behind weak-to-strong generalization in imperfect labeling scenarios.
method Theoretical analysis of simple models including ridge regression and weighted ridge regression, and a nonlinear multi-index setting.
result A student model can compensate for a teacher's under-regularization and achieve lower test error.

The sparse representation classifier (SRC) is shown to work well for image recognition problems that satisfy a subspace assumption. In this paper we propose a new implementation of SRC via screening, establish its equivalence to the original SRC under regularity conditions, and prove its classification consistency for …

2019-06-04abs ↗pdf ↗

A bounded curvature path is a continuously differentiable piecewise C2C^2 path with a bounded absolute curvature that connects two points in the tangent bundle of a surface. In this work, we analyze the homotopy classes of bounded curvature paths for points in the tangent bundle of the Euclidean plane. We show the exis…

2014-03-19abs ↗pdf ↗

We consider properties of the total absolute geodesic curvature functional on circle immersions into a Riemann surface. In particular, we study its behavior under regular homotopies, its infima in regular homotopy classes, and the homotopy types of spaces of its local minima. We consider properties of the total curvatu…

2003-10-17abs ↗pdf ↗

We investigate manifolds obtained as a quotient of a doubly warped product. We show that they are always covered by the product of two suitable leaves. This allows us to prove, under regularity hypothesis, that these manifolds are a doubly warped product up to a zero measure subset formed by an union of leaves. We also…

2009-05-29abs ↗pdf ↗

Unified framework for shrinkage, thresholding, and regularization in normal mean estimation and linear regression.

problem Estimation of normal mean in multivariate settings with correlated observations.
method Approximate risk minimization over a functional class of shrinkage-thresholding rules.
result Unified estimator NOMAD for shrinkage, thresholding, and regularization.

Solvable structures, likewise solvable algebras of local symmetries, can be used to integrate scalar ODEs by quadratures. Solvable structures, however, are particularly suitable for the integration of ODEs with a lack of local symmetries. In fact, under regularity assumptions, any given ODE always admits solvable struc…

2008-07-21abs ↗pdf ↗

The paper bounds the complexity of GCNs using Rademacher complexity.

problem Understanding the sample complexity of GCNs.
method Derived tight upper and lower bounds of Rademacher complexity for GCN models.
result The derived bounds depend on the largest eigenvalue of the graph filter and the degree distribution.

New method uses fractional posteriors for semiparametric inference with improved uncertainty quantification.

problem Semiparametric inference with nonparametric priors and fractional posteriors.
method Established a general Bernstein--von Mises theorem for fractional posterior distributions, proposed shifted-and-rescaled credible sets.
result Fractional posterior credible sets provide reliable uncertainty quantification but have inflated size; shifted-and-rescaled set is an efficient confidence set.

Consider the standard symplectic $(\RR^{2n}, ω_0)$, a point $p\in\RR^{2n}$ and an immersed closed orientable hypersurface $Σ\subset\RR^{2n}\minus\{p\}$, all in general position. We study the following passage/tangency question: how many lines in $\RR^{2n}$ pass through pp and tangent to ΣΣ parallel to the 1-dimension…

2013-09-04abs ↗pdf ↗

Paper introduces a neural network for consistent estimation of optimal transport maps.

problem Statistically consistent estimation of optimal transport maps between probability distributions.
method Lipschitz-constrained GAN penalized by quadratic transportation cost.
result The generator converges uniformly to the optimal transport map as sample size increases.

The universal Liouville action equals the renormalized volume of a hyperbolic 3-manifold.

problem Understanding the geometric significance of the universal Liouville action.
method Analyzing the Weil-Petersson universal Teichmüller space and its relation to hyperbolic 3-manifolds.
result The gradient flow of the universal Liouville action converges to the origin, providing a bound on Weil-Petersson distance.

We analyze MDL for binary classification, quantifying overfitting and underfitting.

problem Understanding the trade-off between underfitting and overfitting in MDL for binary classification.
method Complete characterization of the regularization curve for MDL, extending previous work to all λλ.
result Precise quantitative description of the worst case limiting error as a function of λλ and noise level.

Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the perspective of random forests as an adaptive kernel method, we pair the forest kernel with a local li…

2018-07-30abs ↗pdf ↗

We study how the round-off (or discretization) error changes the statistical properties of a Gaussian long memory process. We show that the autocovariance and the spectral density of the discretized process are asymptotically rescaled by a factor smaller than one, and we compute exactly this scaling factor. Consequentl…

2011-07-22abs ↗pdf ↗

The celebrated Monte Carlo method estimates an expensive-to-compute quantity by random sampling. Bandit-based Monte Carlo optimization is a general technique for computing the minimum of many such expensive-to-compute quantities by adaptive random sampling. The technique converts an optimization problem into a statisti…

2018-05-21abs ↗pdf ↗

A nonparametric two-sample test using a parametric integral probability metric

problem Detecting distributional differences between two independent samples
method Propose a new two-sample test statistic based on a newly introduced integral probability metric (IPM)
result Establish theoretical guarantees for the associated two-sample testing procedure

The paper analyzes the sliding regret of stochastic bandit algorithms.

problem Measuring the one-shot behavior of no-regret algorithms in stochastic bandits.
method Introducing sliding regret to measure the worst pseudo-regret over a time-window.
result Randomized methods have optimal sliding regret, while index policies have the worst possible sliding regret.

HAMBO estimates policy performance by hallucinating worst-case trajectories, providing valid lower bounds.

problem Conservative off-policy evaluation of policies in real-world applications.
method HAMBO hallucinates worst-case trajectories based on learned model uncertainty.
result Valid lower bounds on policy performance, converging to true expected return under regular conditions.

Novel SVM approach for extreme quantile regression with heavy tailed inputs.

problem Learning from extreme values in quantile regression.
method Support Vector Machine framework for handling high-dimensional and nonlinear settings.
result Established finite-sample learning guarantees under mild regularity assumptions.

MOPI optimizes flexible set-valued mappings to achieve superior shape adaptivity in conformal prediction.

problem Challenges in achieving valid conditional coverage in conformal prediction.
method Minimax Optimization Predictive Inference (MOPI) framework that optimizes over a flexible class of set-valued mappings.
result MOPI achieves superior shape adaptivity and maintains a principled connection to mean squared coverage error.

SCOTCH learns system structure from irregular time series using neural SDEs.

problem Learning system structure from irregular time series data.
method SCOTCH uses neural stochastic differential equations (SDE) with variational inference.
result SCOTCH improves structure learning performance on synthetic and real-world datasets.

Study on learning strategies in matching markets with uncertain preferences.

problem Decision-making in scarcity of shared resources with unknown agent preferences.
method Representation of preferences in a reproducing kernel Hilbert space, learning algorithm for uncertainty.
result Optimal strategies derived to maximize agents' expected payoffs, with stability and fairness properties.

The paper develops a minimax optimal method for high-dimensional regression using auxiliary data.

problem High-dimensional additive regression with heavy-tailed errors and transfer learning.
method Smooth backfitting estimator with local linear smoothing, followed by a two-stage estimation method.
result The method achieves the minimax optimal rate under certain conditions.

Autonomous agents that must exhibit flexible and broad capabilities will need to be equipped with large repertoires of skills. Defining each skill with a manually-designed reward function limits this repertoire and imposes a manual engineering burden. Self-supervised agents that set their own goals can automate this pr…

2019-03-08abs ↗pdf ↗

We consider a problem of data integration. Consider determining which genes affect a disease. The genes, which we call predictor objects, can be measured in different experiments on the same individual. We address the question of finding which genes are predictors of disease by any of the experiments. Our formulation i…

2016-10-03abs ↗pdf ↗

In this paper, we study the problem of computing UU-statistics of degree 22, i.e., quantities that come in the form of averages over pairs of data points, in the local model of differential privacy (LDP). The class of UU-statistics covers many statistical estimates of interest, including Gini mean difference, Kendal…

2019-10-09abs ↗pdf ↗

Weight decay stabilizes training dynamics by slowing progressive sharpening.

problem Understanding how weight decay affects training stability in deep learning models.
method Analyzing weight decay effects at the Edge of Stability, developing a mathematical framework.
result Weight decay dampens oscillations and stabilizes sharpness in CNNs, causing a phase transition in MLPs.

Proposes a neural network method to combine nonprobability and probability survey samples.

problem Combining nonprobability and probability survey samples for accurate population mean estimation.
method Uses a deep neural network to estimate sampling scores from nonprobability samples and combines them with probability sample information.
result Proposed estimators improve robustness to parametric propensity-score misspecification, especially for nonlinear selection mechanisms.

WSFN overcomes saddle points for non-convex functionals in Wasserstein space.

problem Minimizing non-convex functionals over the Wasserstein space with saddle point avoidance.
method WSFN is a second-order method that preconditions the Wasserstein gradient to avoid saddle points.
result WSFN escapes saddle regions and reaches a global minimizer in polynomial time.