Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

88177265353 · Jun 202019922001200920172026
48 results for objective perturbation

New method stabilizes private LASSO for high-dimensional data with diverse covariate scales.

problem Privacy constraints and heterogeneity in covariate scales degrade LASSO stability and accuracy.
method Gram-based anisotropic objective perturbation to counteract covariate structure.
result Significantly improves convergence and statistical efficiency of private LASSO estimators.

Machine learning models have been shown vulnerable to adversarial attacks launched by adversarial examples which are carefully crafted by attacker to defeat classifiers. Deep learning models cannot escape the attack either. Most of adversarial attack methods are focused on success rate or perturbations size, while we a…

2018-12-01abs ↗pdf ↗

Node-perturbation learning is a type of statistical gradient descent algorithm that can be applied to problems where the objective function is not explicitly formulated, including reinforcement learning. It estimates the gradient of an objective function by using the change in the object function in response to the per…

2017-06-20abs ↗pdf ↗

Within the unmanageably large class of nonconvex optimization, we consider the rich subclass of nonsmooth problems that have composite objectives---this already includes the extensively studied convex, composite objective problems as a special case. For this subclass, we introduce a powerful, new framework that permits…

2011-09-01abs ↗pdf ↗

This paper analyzes privacy-preserving methods for sparse model optimization.

problem Privacy-preserving sparse model optimization with non-differentiable norms.
method Differential privacy techniques applied to Frank-Wolfe and objective perturbation algorithms.
result Excess risk bounds for Frank-Wolfe and objective perturbation algorithms are derived.

Generative models create indistinguishable adversarial objects for object detection.

problem Creating unrestricted adversarial examples for object detection.
method Search over latent space of GAN for adversarial objects.
result Generated adversarial objects are indistinguishable from non-adversarial objects and transferable.

We study the perturbations of two classes of static black ellipsoid solutions of four dimensional vacuum Einstein equations. Such solutions are described by generic off--diagonal metrics which are generated by anholonomic transforms of diagonal metrics. The analysis is performed in the approximation of small eccentrici…

2002-06-05abs ↗pdf ↗

Paper proposes EMO-based AE generation for black-box settings.

problem Designing robust adversarial examples for black-box models.
method Evolutionary Multi-objective Optimization (EMO) for generating various types of adversarial examples.
result EMO-based method generates AEs that are robust and applicable to high-resolution images.

Distributed descent-based methods are an essential toolset to solving optimization problems in multi-agent system scenarios. Here the agents seek to optimize a global objective function through mutual cooperation. Oftentimes, cooperation is achieved over a wireless communication network that is prone to delays and erro…

2019-03-17abs ↗pdf ↗

SGD converges with perturbed forward-backward passes, explained by geometric amplification.

problem Analyzing convergence of SGD with perturbed forward-backward passes in composite optimization.
method Characterized propagation and amplification of perturbations, derived convergence guarantees for non-convex and PL objectives.
result Perturbations cascade through the computational graph, affecting convergence order under specific conditions.

New optimization method improves generalization across various tasks.

problem Improving zeroth-order optimization for better generalization.
method Exponential tilting objective to connect zeroth-order optimization with sharpness-aware minimization.
result Achieves better generalization compared to vanilla zeroth-order baselines.

We explain how deformation theories of geometric objects such as complex structures, Poisson structures and holomorphic bundle structures lead to differential Gerstenhaber or Poisson algebras. We use homological perturbation theory to obtain AA_{\infty} algebra structures and some canonically defined deformations of s…

1999-06-14abs ↗pdf ↗

Sparse perturbations improve convergence in SZO methods for faster training.

problem Dependency of SZO methods on function dimensionality limits their convergence speed.
method Sparse perturbations reduce the effective dimensionality of the optimization problem.
result Sparse SZO optimization leads to faster convergence in training loss and test accuracy.

Introduces a new geometric framework for non-perturbative BV-theory.

problem Non-perturbative generalization of BV-theory in infinite-dimensional spaces.
method Derived differential geometry and homotopical algebraic geometry.
result Concrete model of derived smooth stacks for encoding non-perturbative BV-theory.

Proposes an efficient method for ordered counterfactual explanations.

problem Insufficient explanation of perturbation vectors for executing actions.
method Mixed-Integer Linear Optimization (MILP) approach for evaluating and extracting optimal pairs of actions and orders.
result Demonstrated effectiveness of the proposed method on real datasets.

Item recommendation is a personalized ranking task. To this end, many recommender systems optimize models with pairwise ranking objectives, such as the Bayesian Personalized Ranking (BPR). Using matrix Factorization (MF) --- the most widely used model in recommendation --- as a demonstration, we show that optimizing it…

2018-08-12abs ↗pdf ↗

AWP improves robustness by flattening weight loss landscape.

problem Improving robustness of deep neural networks against adversarial examples.
method Explicitly regularizes the flatness of weight loss landscape through adversarial weight perturbation.
result AWP forms a double-perturbation mechanism in adversarial training, leading to flatter weight loss landscape.

SIGNNAP learns stable and identifiable node representations in GNNs against graph perturbations.

problem Fragility of GNN models to graph perturbations leading to unreliable node representations.
method SIGNNAP proposes a novel model that learns stable and identifiable node representations in an unsupervised manner, formalizing stability and identifiability through a contrastive objective and preserving smoothness with existing GNN backbones.
result SIGNNAP demonstrates effectiveness in learning stable and identifiable node representations in GNNs against graph perturbations on six benchmarks.

We present CROSSGRAD, a method to use multi-domain training data to learn a classifier that generalizes to new domains. CROSSGRAD does not need an adaptation phase via labeled or unlabeled data, or domain features in the new domain. Most existing domain adaptation methods attempt to erase domain signals using technique…

2018-04-28abs ↗pdf ↗

The paper analyzes and proposes methods for privately sharing individual privacy losses using per-instance differential privacy.

problem The standard differential privacy framework provides a worst-case bound that may not accurately reflect individual privacy losses.
method The paper analyzes per-instance differential privacy and proposes methods to privately and accurately publish per-instance privacy losses.
result The methods privately and accurately publish per-instance differential privacy losses with minimal additional privacy cost.

We use closed geodesics to construct and compute Bott-type Morse homology groups for the energy functional on the loop space of flat nn-dimensional tori, n1n\ge 1, and Bott-type Floer cohomology groups for their cotangent bundles equipped with the natural symplectic structure. Both objects are isomorpic to the singula…

1996-12-16abs ↗pdf ↗

ALPS improves neural network robustness and generalization.

problem Challenges in designing effective regularization schemes for adversarial robustness.
method Adversarial Labelling of Perturbed Samples (ALPS) using synthetic samples and min-max formulation.
result ALPS achieves state-of-the-art regularization performance and adversarial robustness.

SRO optimizes decisions against worst-case sampler induced by generative models.

problem Operational uncertainty shifts from explicit probability law to sampler induced by learned generators.
method SRO optimizes decisions against the worst-case sampler induced by perturbing the learned generator.
result Empirical worst-case objective provides high-probability upper certificate for true population objective.

This work learns visual representations for deformable objects using contrastive estimation.

problem Challenges in learning plannable visual representations for deformable objects.
method Jointly optimizes visual representation and dynamics models using contrastive estimation.
result Substantial improvements in performance over standard model-based learning techniques.

Diffusion models optimize objectives similar to ELBO with Gaussian noise augmentation.

problem Optimizing diffusion models for high perceptual quality.
method Showed diffusion objectives are weighted ELBOs over noise levels, with Gaussian noise augmentation.
result Diffusion objectives equate to ELBO with Gaussian noise augmentation under monotonic weighting.

Hierarchical randomized smoothing improves model robustness for complex data.

problem Certifying robustness on complex data (e.g. images, graphs) is challenging.
method Add random noise to a randomly selected subset of entities in a hierarchical manner.
result Hierarchical randomized smoothing yields stronger robustness guarantees with high accuracy.

Our main objective is to demonstrate how homological perturbation theory (HPT) results over the last 40 years immediately or with little extra work give some of the Koszul duality results that have appeared in the last decade. Higher homotopies typically arise when a huge object, e. g. a chain complex defining various …

2004-01-14abs ↗pdf ↗

In this paper, we consider efficient differentially private empirical risk minimization from the viewpoint of optimization algorithms. For strongly convex and smooth objectives, we prove that gradient descent with output perturbation not only achieves nearly optimal utility, but also significantly improves the running …

2017-03-29abs ↗pdf ↗

We are focusing on bound constrained global optimization problems, whose objective functions are computationally expensive black-box functions and have multiple local minima. The recently popular Metric Stochastic Response Surface (MSRS) algorithm proposed by \cite{Regis2007SRBF} based on adaptive or sequential learnin…

2014-10-23abs ↗pdf ↗

Introduces TPV to analyze model robustness without labels.

problem Analyzing post-training robustness of machine learning models.
method Parameter perturbations and test prediction variance (TPV) as a unifying framework.
result TPV connects various perturbations under a single lens, providing insights into model stability.