Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

128256384512 · Jun 202019922001200920172026
48 results for smoothing techniques

Paper improves neural network robustness certification with tighter radii estimates.

problem Certifying neural networks' robustness against adversarial attacks.
method Advanced algorithms for discrete and continuous domains, optimizing sample size, standard deviation, and temperature.
result Significant improvement in certified test-set accuracy with tighter certified radii bounds.

We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of \ell_\infty regression, we achieves an O(ε4/5)O(ε^{-4/5}) iteration complexity, breaking the O(ε1)O(ε^{-1}) barrier so far present for previous methods. We arrive at a similar rate fo…

2019-06-04abs ↗pdf ↗

Improved optimization technique reduces training complexity for non-convex problems.

problem Training non-convex optimization problems with exploding gradients.
method Employed variance reduction technique (SPIDER) with carefully designed learning rate.
result Improved stochastic gradient complexity to O(ε3)O(ε^{-3}) for εε-stationary solutions.

The paper proposes a decoupled approach to efficiently estimate CoVaR, a measure of systemic financial risk.

problem Estimating CoVaR, a measure of systemic financial risk, is challenging due to zero-probability events and portfolio repricing.
method The paper introduces a decoupled approach using smoothing techniques and a functional perspective to model CoVaR.
result The decoupled estimator achieves a rate of convergence of approximately OmP(Γ1/2)O_{ m P}(Γ^{-1/2}).

In this paper we introduce a technique, called rim surgery, which can change a smooth embedding of an orientable surface of positive genus and nonnegative self-intersection in a smooth 4-manifold while leaving the topological embedding unchanged.

1997-05-29abs ↗pdf ↗

Despite spectacular advances in defining invariants for simply connected smooth and symplectic 4-dimensional manifolds and the discovery of effective surgical techniques, we still have been unable to classify simply connected smooth manifolds up to diffeomorphism. In these notes, adapted from six lectures given at the …

2006-10-23abs ↗pdf ↗

These notes are adapted from two talks given at the 2004 Clay Institute Summer School on Floer homology, gauge theory, and low dimensional topology at the Alfred Renyi Institute. We will quickly review what we do and do not know about the existence and uniqueness of smooth and symplectic structures on closed, simply-co…

2005-02-08abs ↗pdf ↗

Self-distillation improves model performance by increasing teacher diversity and smoothing predictions.

problem Improving model generalization and performance through self-distillation.
method Interpreting self-distillation as MAP estimation and proposing instance-specific label smoothing.
result Self-distillation enhances model performance by increasing teacher diversity and smoothing predictions.

New technique reduces bias in CSO problems, improving sample complexity.

problem Reducing bias in conditional stochastic optimization problems.
method Introducing a stochastic extrapolation technique combined with variance reduction.
result Achieved significantly better sample complexity for nonconvex smooth objectives.

A new method boosts graph neural networks by preventing over-smoothing and over-squashing.

problem Graph Neural Networks struggle with long-range signals and over-smoothing/over-squashing.
method Proposes PowerEmbed, a layer-wise normalization technique inspired by spectral graph embedding.
result PowerEmbed prevents over-smoothing and avoids over-squashing, improving performance on heterophilous graphs.

Polarimetric Synthetic Aperture Radar (PolSAR) images are establishing as an important source of information in remote sensing applications. The most complete format this type of imaging produces consists of complex-valued Hermitian matrices in every image coordinate and, as such, their visualization is challenging. Th…

2012-07-03abs ↗pdf ↗

A new technique normalizes nodes within groups to improve GNN performance.

problem Over-smoothing in deeper GNNs reduces node distinguishability.
method Differentiable group normalization (DGN) to separate node distributions among groups.
result DGN makes GNN models more robust to over-smoothing and achieves better performance with deeper GNNs.

The paper develops techniques to study dynamical systems with Carnot metrics.

problem Understanding smooth dynamical systems in the presence of Carnot metrics.
method Employing techniques from Margulis-Mostow, Métivier, Mitchell, and Pansu on tangent cones, the paper establishes resonances between Lyapunov exponents.
result Local rigidity properties of higher hyperbolic rank metrics and uniform lattice actions on quaternionic and octonionic symmetric spaces.

This study improves scalability of randomized smoothing for certifying classifier robustness.

problem Certifying machine learning classifiers against adversarial attacks is challenging and scalable solutions are needed.
method The study reviews and explores randomized smoothing and its derivatives, focusing on scalability.
result The study provides theoretical guarantees and discusses scalability challenges of randomized smoothing.

Label smoothing improves model performance even with noisy labels.

problem Mitigating label noise in deep learning models.
method Examined label smoothing as a technique to cope with label noise and compared it to loss-correction methods.
result Label smoothing is competitive with loss-correction techniques under label noise and beneficial for distillation from noisy data.

A new method for efficient BNC parameter estimation outperforms HDP smoothing.

problem Efficiently estimating parameters for Bayesian network classifiers to match or exceed random forest performance.
method Uses log-linear regression to approximate hierarchical Dirichlet process (HDP) smoothing, making the approach simpler and faster.
result Our method outperforms HDP smoothing while being orders of magnitude faster and competitive with random forests.

Fusion of robustness and uncertainty techniques improves adversarial defense.

problem Adversarial attacks on deep neural networks.
method Integrating uncertainty quantification into randomized smoothing for robustness guarantees.
result Improved robustness guarantees for uncertainty aware classifiers.

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the 2\ell_2 norm. This "randomized smoothing" technique has been proposed recently in the literature, but existing guarantees are loose. We prove a tight robu…

2019-02-08abs ↗pdf ↗

We study the use of the multilevel Monte Carlo technique in the context of the calculation of Greeks. The pathwise sensitivity analysis differentiates the path evolution and reduces the payoff's smoothness. This leads to new challenges: the inapplicability of pathwise sensitivities to non-Lipschitz payoffs often makes …

2011-02-07abs ↗pdf ↗

We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our main analysis technique provides a fresh perspective on Nesterov's excessive gap te…

2014-06-20abs ↗pdf ↗

This survey article is about discrete constant mean curvature surfaces defined by an approach related to integrable systems techniques. We introduce the notion of discrete constant mean curvature surfaces by first introducing properties of smooth constant mean curvature surfaces. We describe the mathematical structure …

2010-10-11abs ↗pdf ↗

We apply a new numerical method, the singular Fourier-Padé (SFP) method invented by Driscoll and Fornberg (2001, 2011), to price European-type options in Lévy and affine processes. The motivation behind this application is to reduce the inefficiency of current Fourier techniques when they are used to approximate piecew…

2017-06-21abs ↗pdf ↗

This paper deals with certain results on the number of smooth structures on quaternionic projective spaces, obtained through the computation of inertia group and its analogues, which in turn are computed using techniques from stable homotopy theory. We show that the concordance inertia group is trivial in dimension 20,…

2017-08-22abs ↗pdf ↗

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic optimization procedures, both in expectation and with high probability, that have opti…

2011-03-22abs ↗pdf ↗