Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

214427641854 · Jun 202019922001200920172026
48 results for perturbation sets

The paper learns perturbation sets from data to improve robustness in machine learning.

problem Real-world perturbations are not well characterized in adversarial defenses.
method A conditional generator defines perturbation sets over latent space, with properties for quality measured.
result Learned perturbation sets generate diverse, meaningful perturbations and improve model robustness.

Study robust learning without knowing perturbation sets, using interactions with attackers.

problem Learning robust predictors against unknown adversarial perturbations.
method Examined different interaction models with adversarial attackers, derived bounds on sample complexity and interactions.
result Upper bounds on sample complexity and lower bounds on interactions in various models.

Advances FTPL results for bandit problems with unbounded perturbations.

problem Improving analytical foundations of FTPL in bandit problems.
method Revisiting classical FTRL-FTPL duality for unbounded perturbations.
result Establishes Best-of-Both-Worlds (BOBW) results for FTPL under a broad family of asymmetric unbounded perturbations.

Perturbs area-minimizing hypersurfaces to reduce singular set's dimension.

problem Reduces the dimension of the singular set of area-minimizing hypersurfaces.
method Perturbs a smooth hypersurface to minimize the Minkowski dimension of the singular set.
result The singular set of the perturbed minimizing current has Minkowski dimension less than n-9.

FTPL with Fréchet perturbation achieves near optimal regret bounds for m-set semi-bandit problems.

problem Optimizing regret bounds for m-set semi-bandit problems in adversarial and stochastic settings.
method Follow-the-Perturbed-Leader (FTPL) with Fréchet perturbation.
result Achieves near optimal regret bounds of O(nm(dlog(d)+m5/6))\mathcal{O}(\sqrt{nm}(\sqrt{d\log(d)}+m^{5/6})) in adversarial setting and logarithmic regret in stochastic setting.

The paper strengthens a theorem on crossings under linear perturbations with Hausdorff measure estimates.

problem Understanding multiple-point crossings under linear perturbations.
method Establishes a transversality theorem with Hausdorff measure estimates for exceptional parameter sets.
result Explicit upper bounds on the Hausdorff dimension of the exceptional set.

Improved online Lasso reduces regret in sparse linear contextual bandits.

problem Sparse linear contextual bandit problem with inefficient sampling.
method Perturbed adversary approach to alleviate sampling inefficiency.
result Online Lasso achieves O(kTlogd)\mathcal{O}(\sqrt{kT\log d}) regret bound.

Study adversarial perturbations in classification, analyzing learning and certification.

problem Formal study of classification under adversarial perturbations from both learner and third-party perspectives.
method PAC-type semi-supervised learning framework, black-box certification under limited query budget, adversary analysis.
result Existence of a polynomial query complexity adversary implies the existence of a sample efficient robust learner.

Study robust online learning with adversarial perturbations.

problem Learning robust classifiers in the presence of adversarial perturbations.
method Formulated as an online learning problem, considered both realizable and agnostic learnability, defined new dimension controlling mistake/regret bounds.
result Showed new dimension controls mistake/regret bounds, generalized to multiclass hypothesis classes.

PerturBench benchmarks ML models for cellular perturbation analysis.

problem Standardizing benchmarking in modeling single cell transcriptomic responses to perturbations.
method Modular platform, diverse datasets, metrics, extensive evaluation, rank metrics.
result Simpler models are competitive and scale well with larger datasets.

The paper examines how gradient descent stabilizes low-rank matrix factorization in noisy conditions.

problem Stability of low-rank implicit regularization in perturbed deep matrix factorization.
method Derives spectral conditions for gradient descent to exhibit a low-rank phase in noiseless settings and analyzes perturbed dynamics.
result Gradient descent converges to a low-rank solution under perturbation, with explicit dependence on perturbation size.

In a previous paper on coupled gravitational and electromagnetic perturbations of Reissner-Nordström spacetime in a polarized setting, we derived a system of wave equations for two independent quantities, one related to the Weyl curvature and one related to the Ricci curvature of the perturbed spacetime. We analyze her…

2018-04-16abs ↗pdf ↗

In this paper we study the property of phase retrievability by redundant sysems of vectors under perturbations of the frame set. Specifically we show that if a set $\fc$ of mm vectors in the complex Hilbert space of dimension n allows for vector reconstruction from magnitudes of its coefficients, then there is a pertu…

2013-08-25abs ↗pdf ↗

DEceit constructs effective universal pixel-restricted perturbations for deep image classifiers.

problem Creating effective universal pixel-restricted perturbations for deep neural networks.
method DEceit algorithm for black-box feedback, targeting 10% of pixels in images.
result Perturbing only 10% of pixels achieves high Fooling Rate and visual similarity.

New metrics produce discrete zero sets for nondegenerate harmonic forms.

problem Creating metrics to produce discrete zero sets for nondegenerate harmonic forms.
method Metric perturbation to produce new nondegenerate harmonic forms with discrete zero sets.
result Existence of metrics producing discrete zero sets for nondegenerate harmonic forms.

The paper smooths out equations on 4-manifolds to show smooth moduli spaces.

problem Understanding the structure of solutions to Vafa-Witten equations on 4-manifolds.
method Constructing perturbation terms to ensure transversality and showing moduli spaces are smooth.
result For generic perturbation, the general part of the moduli space is a smooth 0-dimensional manifold.

Study magnetic perturbations in Riemannian and Lorentzian Calderón problems.

problem Determining metrics from boundary measurements under magnetic perturbations.
method Runge approximation for Riemannian case, microlocal analysis for Lorentzian case.
result Metrics can be uniquely determined in both Riemannian and Lorentzian cases under specific perturbations.

Learnable token perturbations boost extrapolation in LLMs.

problem Limited flexibility of current discrete perturbations in large language models.
method Learnable continuous latent vector transformations in embedding space, unbiased estimating equations, stochastic gradient descent optimization.
result Significant gains in out-of-domain settings over state-of-the-art methods.

Deep neural networks (DNNs) have achieved superior performance in various prediction tasks, but can be very vulnerable to adversarial examples or perturbations. Therefore, it is crucial to measure the sensitivity of DNNs to various forms of perturbations in real applications. We introduce a novel perturbation manifold …

2019-01-22abs ↗pdf ↗

Classical matrix perturbation results, such as Weyl's theorem for eigenvalues and the Davis-Kahan theorem for eigenvectors, are general purpose. These classical bounds are tight in the worst case, but in many settings sub-optimal in the typical case. In this paper, we present perturbation bounds which consider the natu…

2017-06-20abs ↗pdf ↗

We introduce an efficient message passing scheme for solving Constraint Satisfaction Problems (CSPs), which uses stochastic perturbation of Belief Propagation (BP) and Survey Propagation (SP) messages to bypass decimation and directly produce a single satisfying assignment. Our first CSP solver, called Perturbed Blief …

2014-01-26abs ↗pdf ↗

SGD converges with perturbed forward-backward passes, explained by geometric amplification.

problem Analyzing convergence of SGD with perturbed forward-backward passes in composite optimization.
method Characterized propagation and amplification of perturbations, derived convergence guarantees for non-convex and PL objectives.
result Perturbations cascade through the computational graph, affecting convergence order under specific conditions.

New framework maximizes perturbed samples for inverse classification with budget constraints.

problem Maximizing perturbed samples for desired classification outcomes under budget constraints.
method Gradient methods, stochastic processes, Lagrangian relaxations, Gumbel trick.
result Stochastic process-based algorithms outperform in different budget settings.

We come up with infinite-dimensional prequantum line bundles and moment map interpretations of three different sets of equations - the generalised Monge-Amp`ere equation, the almost Hitchin system, and the Calabi-Yang-Mills equations. These are all perturbations of already existing equations. Our construction for the g…

2017-02-03abs ↗pdf ↗

LoRA fine-tuning explained with gradient dynamics for low-rank perturbations.

problem Understanding why gradient descent converges to useful low-rank perturbations in LoRA fine-tuning.
method Generalized student-teacher setting with i.i.d. samples and online gradient descent.
result Gradient descent converges to the teacher model in dkO(1)dk^{O(1)} iterations under certain conditions.

Study efficient learning of robust halfspaces with noise.

problem Learning robust halfspaces in the presence of adversarial perturbations and random label noise.
method Provides conditions for robust learnability and a simple algorithm for any ℓ_p perturbation.
result Simple computationally efficient algorithm for robust learning with random label noise.

We present CROSSGRAD, a method to use multi-domain training data to learn a classifier that generalizes to new domains. CROSSGRAD does not need an adaptation phase via labeled or unlabeled data, or domain features in the new domain. Most existing domain adaptation methods attempt to erase domain signals using technique…

2018-04-28abs ↗pdf ↗

Improved generalization with semantic perturbations using normalizing flows.

problem Overfitting in deep neural networks training.
method Use normalizing flows for generating semantically meaningful perturbations in latent space.
result Achieved 96.6% test accuracy on CIFAR-10 with ResNet-18, outperforming existing methods.

Introduces TPV to analyze model robustness without labels.

problem Analyzing post-training robustness of machine learning models.
method Parameter perturbations and test prediction variance (TPV) as a unifying framework.
result TPV connects various perturbations under a single lens, providing insights into model stability.

New framework for fair classification in adversarial settings with provable guarantees.

problem Fairness in classification with adversarial perturbations of protected attributes.
method Optimization framework for learning fair classifiers with provable guarantees.
result Near-tightness of accuracy and fairness guarantees for multiple protected attributes and various hypothesis classes.

The paper proves the existence and uniqueness of certain spacelike hypersurfaces with specific curvature and boundary conditions.

problem Existence and uniqueness of convex, entire, spacelike hypersurfaces with constant σkσ_k curvature.
method Investigation of hypersurfaces with prescribed set of lightlike directions and perturbation on the ideal boundary at infinity.
result Existence and uniqueness of complete entire spacelike constant σkσ_k curvature hypersurfaces with prescribed lightlike directions and perturbation.

This paper examines how graph topology affects adversarial attacks on vertex classification.

problem Adversarial attacks on vertex classification are vulnerable to graph topology changes.
method Examined two topological graph characteristics and their impact on adversary perturbation budgets.
result Training sets including high-degree vertices or those ensuring all unlabeled nodes have neighbors can significantly increase the adversary's perturbation budget.

Defenses against adversarial examples, such as adversarial training, are typically tailored to a single perturbation type (e.g., small \ell_\infty-noise). For other perturbations, these defenses offer no guarantees and, at times, even increase the model's vulnerability. Our aim is to understand the reasons underlying…

2019-04-30abs ↗pdf ↗