Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4589134178 · Jun 202019922001200920172026
48 results for Non-Adversarial Mapping

SR-NAM maps low-res images to multiple high-res images realistically.

problem Mapping low-resolution images to multiple high-resolution images realistically.
method SR-NAM using Non-Adversarial Mapping (NAM) technique and a degradation model.
result Realistic degradation and down-sampling of high-resolution images.

Several methods were recently proposed for the task of translating images between domains without prior knowledge in the form of correspondences. The existing methods apply adversarial learning to ensure that the distribution of the mapped source domain is indistinguishable from the target domain, which suffers from kn…

2018-06-03abs ↗pdf ↗

New method simplifies and improves imitation learning without adversarial techniques.

problem Stable optimization and convergence issues in adversarial imitation learning methods.
method Proposes a non-adversarial framework for imitation learning, providing stronger convergence guarantees.
result Shows AIRL as a special case and derives new algorithms for offline imitation learning.

Develops a new non-adversarial framework for better generative models.

problem Inaccurate approximation of target distribution in latent space.
method Tessellated Wasserstein Auto-Encoders (TWAE) using centroidal Voronoi tessellation (CVT) to tessellate latent space.
result Significantly enhances generative performance in terms of FID compared to existing models.

Paper introduces non-adversarial training for Neural SDEs using signature kernel scores.

problem Stability and mode collapse issues in adversarial training of Neural SDEs.
method Uses signature kernel scores as objective function for non-adversarial training.
result Non-adversarial training leads to better performance and more stable models.

Generative adversarial networks (GANs) are designed with the help of min-max optimization problems that are solved with stochastic gradient-type algorithms which are known to be non-robust. In this work we revisit a non-adversarial method based on kernels which relies on a pure minimization problem and propose a simple…

2018-11-23abs ↗pdf ↗

We introduce a two-player contest for evaluating the safety and robustness of machine learning systems, with a large prize pool. Unlike most prior work in ML robustness, which studies norm-constrained adversaries, we shift our focus to unconstrained adversaries. Defenders submit machine learning models, and try to achi…

2018-09-22abs ↗pdf ↗

Learning to disentangle the hidden factors of variations within a set of observations is a key task for artificial intelligence. We present a unified formulation for class and content disentanglement and use it to illustrate the limitations of current methods. We therefore introduce LORD, a novel method based on Latent…

2019-06-27abs ↗pdf ↗

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these methods are not universal and can't defend unknown or non-adversarial evasion attacks.…

2019-09-12abs ↗pdf ↗

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are missing in current Neural ODE networks. In this paper, we propose a new continuous ne…

2019-06-05abs ↗pdf ↗

We study the problem of robust subspace recovery (RSR) in the presence of adversarial outliers. That is, we seek a subspace that contains a large portion of a dataset when some fraction of the data points are arbitrarily corrupted. We first examine a theoretical estimator that is intractable to calculate and use it to …

2019-04-05abs ↗pdf ↗

Recently, deep learning has been applied to many security-sensitive applications, such as facial authentication. The existence of adversarial examples hinders such applications. The state-of-the-art result on defense shows that adversarial training can be applied to train a robust model on MNIST against adversarial exa…

2018-05-13abs ↗pdf ↗

New method uses randomised signatures for generating financial time series data.

problem Generating synthetic financial time series data accurately.
method Introduced a Wasserstein-type distance based on discrete-time randomised signatures.
result Demonstrated universal approximation for randomised signatures on continuous functions.

To obtain uncertainty estimates with real-world Bayesian deep learning models, practical inference approximations are needed. Dropout variational inference (VI) for example has been used for machine vision and medical applications, but VI can severely underestimates model uncertainty. Alpha-divergences are alternative …

2017-03-08abs ↗pdf ↗

While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional statistical failures---operate as intended within the algorithmic framework. In r…

2019-08-23abs ↗pdf ↗

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent works have increased the robustness of DNNs by fitting networks using adversarially…

2018-11-19abs ↗pdf ↗

Deep neural networks (DNNs) are vulnerable to malicious inputs crafted by an adversary to produce erroneous outputs. Works on securing neural networks against adversarial examples achieve high empirical robustness on simple datasets such as MNIST. However, these techniques are inadequate when empirically tested on comp…

2018-02-02abs ↗pdf ↗

Tricks adversarial attacks to target specific classes, improving classifier accuracy.

problem Recent adversarial defense approaches have failed to protect classifiers from untargeted attacks.
method Target Training defense tricks untargeted attacks into targeted attacks on designated classes, then derives the real class.
result 86.2% accuracy for CW-L2 (confidence=0) in CIFAR10, outperforming unsecured classifiers.

Adversarially-trained models transfer better in limited data scenarios.

problem Improving transfer learning performance with limited data.
method Adversarially-train deep nets, freeze early layers, fine-tune last layers, observe shape vs texture bias.
result Adversarially-trained models transfer better than non-adversarially-trained models, especially with limited data.

The paper introduces boundary thickness as a measure for improving model robustness.

problem Improving the robustness of machine learning models to adversarial and non-adversarial corruptions.
method Introducing boundary thickness as a measure and showing how various procedures can increase it.
result Thicker decision boundaries lead to improved robustness against adversarial and out-of-distribution transforms.

Adversarial CBO optimizes under interventions by adversaries and non-stationarities.

problem Optimizing in the presence of adversaries and non-stationary factors.
method Formalizes CBO as ACBO, introduces CBO-MW algorithm combining online learning and causal modeling.
result First algorithm with bounded regret for ACBO, achieving superior performance in synthetic and real-world environments.

Generative models create indistinguishable adversarial objects for object detection.

problem Creating unrestricted adversarial examples for object detection.
method Search over latent space of GAN for adversarial objects.
result Generated adversarial objects are indistinguishable from non-adversarial objects and transferable.

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the verification of other properties of these systems. One important property, in pa…

2019-02-15abs ↗pdf ↗

CNN layers with large norms are still robust to adversarial attacks.

problem Understanding the relationship between layer norms and adversarial robustness in CNNs.
method Theoretical analysis of 1\ell_1 and \ell_\infty norms, norm decay method, adversarial training frameworks.
result Adversarially robust CNNs can have comparable or larger layer norms than non-adversarially robust ones.

In the last two years, more than 200 papers have been written on how machine learning (ML) systems can fail because of adversarial attacks on the algorithms and data; this number balloons if we were to incorporate papers covering non-adversarial failure modes. The spate of papers has made it difficult for ML practition…

2019-11-25abs ↗pdf ↗

A new model for sequential prediction handles adversarial examples by allowing abstention.

problem Sequential prediction algorithms fail with adversarial examples, leading to incorrect predictions.
method Proposes a new model that allows abstention from predictions on adversarial examples, scaling error with VC dimension.
result A learner's error scales with the VC dimension of the hypothesis class, matching the stochastic setting.

Paper develops robust neural network sensors for fuel injection quantities.

problem Adversarial noise increases error in standard neural network models for fuel injection measurements.
method Apply provable robust network learning and verification methods to fuel injection measurements.
result Provable robust model reduces mean relative error to 16.5% under sensor noise.

The paper analyzes how conformal prediction works with contaminated reference data.

problem The impact of contamination on the validity and power of conformal prediction methods.
method The paper analyzes the impact of contamination on the validity of conformal methods and proposes a data-cleaning framework to enhance power.
result The proposed data-cleaning framework can effectively enhance power while maintaining type-I error control.

New measure assesses deep neural networks' robustness to adversarial attacks.

problem Deep learning's fragility to adversarial attacks limits its adoption in mission-critical applications.
method Introduces residual error as a new performance measure for assessing adversarial robustness.
result Demonstrates effectiveness of residual error in assessing robustness of deep neural networks.

Study reveals adversarially robust domain adaptation is harder to generalize across domains.

problem Hardness of transferring adversarial robustness across different domains.
method Analysis of adversarial Rademacher complexity over symmetric difference hypothesis space.
result Adversarial Rademacher complexity is always greater than non-adversarial, indicating intrinsic hardness.

Paper proposes a GAN-based method for better next event prediction in business processes.

problem Insufficient training data and sub-optimal network configuration limit deep learning approaches to next event prediction.
method Adversarial training framework using Generative Adversarial Networks (GANs) for sequential temporal data.
result The proposed approach achieves at least as good accuracy as non-adversarial methods and outperforms them in accuracy and prediction earliness.

The paper learns perturbation sets from data to improve robustness in machine learning.

problem Real-world perturbations are not well characterized in adversarial defenses.
method A conditional generator defines perturbation sets over latent space, with properties for quality measured.
result Learned perturbation sets generate diverse, meaningful perturbations and improve model robustness.

Proof of Stake (PoS) is a burgeoning Sybil resistance mechanism that aims to have a digital asset ("token") serve as security collateral in crypto networks. However, PoS has so far eluded a comprehensive threat model that encompasses both Byzantine attacks from distributed systems and financial attacks that arise from …

2019-11-28abs ↗pdf ↗