Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Feb 199419922001200920172026
48 results for aspect regularization

Unified definition of mass aspect function for weakly regular hyperbolic manifolds.

problem Ambiguity in mass definition for asymptotically hyperbolic manifolds.
method Introduced an ADM-style mass aspect function for broad asymptotics and low regularity.
result Unified mass aspect function exhibits favorable covariance properties.

New equivalences found between subsampling and ridge regularization methods.

problem Establishing precise structural and risk equivalences between subsampling and ridge regularization.
method Proved structural and risk equivalences between subsample ridge estimators and different ridge regularization levels and subsample aspect ratios.
result Optimally tuned ridge regression exhibits a monotonic prediction risk in the data aspect ratio.

The paper is mainly devoted to systematic developments and applications of geometric aspects of second-order variational analysis that are revolved around the concept of parabolic regularity of sets. This concept has been known in variational analysis for more than two decades while being largely underinvestigated. We …

2019-08-31abs ↗pdf ↗

Study optimal ridge regularization for out-of-distribution prediction.

problem Optimal ridge regularization for predicting out-of-distribution data.
method Established conditions for optimal regularization under covariate and regression shifts, proving monotonic risk in data aspect ratio.
result Negative regularization can be optimal under shifts, even with isotropic or underparameterized training features.

We study the order of tangency between two manifolds of same dimension and give that notion three quite different geometric interpretations. Related aspects of the order of tangency, e.g., regular separation exponents, are also discussed.

2018-03-20abs ↗pdf ↗

We study the existence and properties of metrics maximising the first Laplace eigenvalue among conformal metrics of unit volume on Riemannian surfaces. We describe a general approach to this problem and its higher eigenvalue versions via the direct method of calculus of variations. The principal results include the gen…

2011-03-12abs ↗pdf ↗

Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This paper presents generalizations of such estimation error analysis on all four aspe…

2015-05-09abs ↗pdf ↗

Batch Normalization (BN) improves both convergence and generalization in training neural networks. This work understands these phenomena theoretically. We analyze BN by using a basic block of neural networks, consisting of a kernel layer, a BN layer, and a nonlinear activation function. This basic network helps us unde…

2018-09-04abs ↗pdf ↗

We propose a geometric setup to study analytic aspects of a variant of the super symmetric two-dimensional nonlinear sigma model. This functional extends the functional of Dirac-harmonic maps by gravitino fields. The system of Euler--Lagrange equations of the two-dimensional nonlinear sigma model with gravitino is calc…

2016-10-07abs ↗pdf ↗

This report has several purposes. First, our report is written to investigate the reproducibility of the submitted paper On the regularization of Wasserstein GANs (2018). Second, among the experiments performed in the submitted paper, five aspects were emphasized and reproduced: learning speed, stability, robustness ag…

2017-12-16abs ↗pdf ↗

Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an alternative, similar data to the real-world examples can be produced artificially through …

2020-01-30abs ↗pdf ↗

Dropout introduces both explicit and implicit regularization effects.

problem Understanding the full impact of dropout regularization.
method Disentangled explicit and implicit regularization effects through experiments and analytic simplifications.
result Explicit and implicit regularization effects of dropout are distinct and can be characterized analytically.

KL regularization helps RL algorithms by implicitly averaging q-values.

problem Understanding why KL regularization improves RL performance.
method An approximate value iteration scheme, studying KL and entropy regularization.
result Strong performance bound combining linear horizon dependency and averaging effect of estimation errors.

This paper tackles the curse of dimensionality in semi-supervised learning using Laplacian regularization.

problem The curse of dimensionality in semi-supervised learning with Laplacian regularization.
method Statistical analysis and spectral filtering methods using kernel methods.
result The paper provides a method to overcome the curse of dimensionality in semi-supervised learning.

Paper shows regularization improves robustness in domain generalization.

problem Improving robustness in domain generalization.
method Derives novel theoretical analysis to control representation smoothness and proposes a regularization method.
result Regularization improves robustness in domain generalization.

The Seiberg-Witten equations that have recently found important applications for four-dimensional geometry are the Euler-Lagrange equations for a functional involving a connection AA on a line bundle LL and a section φφ of another bundle W+W^+ constructed from LL and a spinor bundle on a given four-dimensional Riem…

1995-04-28abs ↗pdf ↗

Study shows SGD's generalization is not explained by implicit bias.

problem Explaining the generalization ability of overparameterized learning algorithms.
method Revisited Stochastic Convex Optimization with SGD, demonstrating limitations of implicit bias.
result No distribution-independent or distribution-dependent implicit regularizer can explain SGD's generalization.

Unsupervised representation learning via generative modeling is a staple to many computer vision applications in the absence of labeled data. Variational Autoencoders (VAEs) are powerful generative models that learn representations useful for data generation. However, due to inherent challenges in the training objectiv…

2019-11-24abs ↗pdf ↗

Paper explores stability, regularization, and gradient flows for stochastic inverse problems.

problem Recovering random probability distributions from measurements.
method Direct inversion, variational formulation with regularization, and optimization via gradient flows.
result The choice of metric impacts stability and properties of the optimizer.

A generative model with a disentangled representation allows for independent control over different aspects of the output. Learning disentangled representations has been a recent topic of great interest, but it remains poorly understood. We show that even for GANs that do not possess disentangled representations, one c…

2018-12-04abs ↗pdf ↗

Evolutionary methods improve neural network loss functions, reducing overfitting.

problem Improving neural network performance and preventing overfitting.
method Evolutionary computation to optimize loss functions, balancing error pull and overfitting push.
result Evolved loss functions effectively reduce overfitting, leading to better performance and robustness.

Gradient descent dynamics in nonconvex models explained with universality.

problem Understanding long-time behavior of nonconvex gradient descent.
method Developed a state evolution system for tracking gradient descent iterates.
result Gradient descent iterates are approximately independent of data and strongly incoherent with feature vectors.

In this paper, we establish a framework for the analysis of linear parabolic equations on conical surfaces and use them to study the conical Ricci flow. In particular, we prove the long time existence of the conical Ricci flow for general cone angle and show that this solution has the optimal regularity, namely, the ti…

2016-05-28abs ↗pdf ↗

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function, which is specified based on prior domain-specific expertise to induce a desired st…

2017-01-05abs ↗pdf ↗

This paper tackles catastrophic forgetting in neural networks by providing a unified framework for regularization-based continual learning.

problem Catastrophic forgetting in neural networks trained sequentially on multiple tasks.
method Formulates regularization-based continual learning as a second-order Taylor approximation of the loss function, leading to a unified framework.
result Theoretical results indicate the importance of accurate approximation of the Hessian matrix for optimization and generalization.

Enhances deep kernel learning with stochastic latent variables for better model regularization.

problem Weak model regularization in deep kernel learning, especially on small datasets.
method Introduces DLVKL model with stochastic latent variables, NSDE for expressive posterior, and hybrid prior.
result DLVKL-NSDE outperforms existing deep GPs on large datasets.

A new method solves l1-regularized optimization problems efficiently and sparsely.

problem l1-regularized optimization problems in machine learning.
method Orthant Based Proximal Stochastic Gradient Method (OBProx-SG)
result Promotes sparsity of solutions substantially and converges to global optimal solutions.

Proposes a method for ranking items across multiple aspects based on user feedback.

problem No principled solution exists for generating multiple item rankings over different aspects.
method Developed a directional multi-aspect ranking criterion using probabilistic multivariate tensor factorization.
result Demonstrated effectiveness of the proposed method through comprehensive experiments on real datasets.

Estimates Gaussian location model with ridge regularization, comparing variational and spectral methods.

problem Estimating parameters in Gaussian location model with regularization.
method Ridge-regularized log-density-ratio estimation, variational and spectral approaches.
result Regularized variational estimator has lower risk with many observations, spectral estimator with fewer observations.

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and functional (smooth) aspects and may benefit from a regularization scheme that can captur…

2013-09-11abs ↗pdf ↗

Paper shows how to embed Möbius bands with many twists and small aspect ratios.

problem Finding the smallest aspect ratio for Möbius bands with many twists.
method Constructs a folded paper ribbon knot to bound the aspect ratio.
result Paper Möbius bands and annuli with any number of half-twists can be embedded with aspect ratio less than 8.