Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

9.9%19.7%29.6%39.5% · May 201919922001200920172026
48 results for neural network vulnerability

Study on measuring vulnerability of neural network parameters via corruption.

problem Understanding the robustness and generalization of deep neural networks.
method Proposes an indicator to measure parameter robustness via parameter corruption and provides a gradient-based estimation.
result Demonstrates the effectiveness of the proposed indicator and training method in improving parameter robustness and accuracy.

This paper extensively evaluates the vulnerability of capsule networks to different adversarial attacks. Recent work suggests that these architectures are more robust towards adversarial attacks than other neural networks. However, our experiments show that capsule networks can be fooled as easily as convolutional neur…

2019-06-09abs ↗pdf ↗

Despite the remarkable performance of deep neural networks on various computer vision tasks, they are known to be susceptible to adversarial perturbations, which makes it challenging to deploy them in real-world safety-critical applications. In this paper, we conjecture that the leading cause of adversarial vulnerabili…

2019-08-12abs ↗pdf ↗

Study reveals how neural network smoothness affects their vulnerability to adversarial attacks.

problem Understanding adversarial vulnerability in deep learning networks.
method Analysis of manifold smoothness and generalization capability of deep neural networks trained with local errors.
result High generalization accuracy requires a fast power-law decay of eigen-spectrum of hidden representations.

Paper analyzes neural networks using active subspace for structural analysis and vulnerability, reducing model size and improving attacks.

problem Analyzing and reducing the complexity of neural networks.
method Active subspace method for measuring active neurons, network structure modification, and additive universal adversarial attack vector.
result ASNet achieves significant parameter and flops reduction, and improves universal adversarial attack performance.

Mathematical framework to understand neural network vulnerability.

problem Understanding and quantifying adversarial vulnerability in neural networks.
method Develops a geometric framework using Ricci curvature to measure decision boundaries and adversarial perturbations.
result Establishes a new theory linking adversarial attacks to Ricci curvature of decision boundaries.

NTK neural networks are robust to adversarial attacks in nonparametric regression.

problem Adversarial robustness of neural networks in nonparametric regression.
method Gradient flow with early stopping for NTK neural networks, proving robustness in Sobolev spaces.
result NTK neural networks achieve optimal adversarial robustness rates in Sobolev spaces.

Deep networks can overfit benignly but still be vulnerable to adversarial attacks.

problem Adversarial vulnerability of deep neural networks trained with benign overfitting.
method Investigated causes of adversarial vulnerability, identified label noise as a key factor, and explored the impact of training procedures and representation learning.
result Adversarial robustness requires more complex decision boundaries than simple ones, suggesting the need for better representation learning.

Graph neural network (GNN), as a powerful representation learning model on graph data, attracts much attention across various disciplines. However, recent studies show that GNN is vulnerable to adversarial attacks. How to make GNN more robust? What are the key vulnerabilities in GNN? How to address the vulnerabilities …

2019-05-09abs ↗pdf ↗

The paper proves neural networks are almost always surjective, impacting model safety.

problem Ensuring neural networks can generate any output, including harmful content.
method Analyzing fundamental neural architectures and generative models.
result Many neural architectures are almost always surjective, allowing for arbitrary outputs.

Graph neural networks are vulnerable to adversarial attacks by manipulating graph structure.

problem Vulnerability of Graph Neural Networks to adversarial attacks.
method Categorization and review of existing attacks and defenses.
result Developed a repository for empirical studies on graph adversarial attacks and defenses.

Two-layer networks trained on low-dimensional subspaces are vulnerable to adversarial examples.

problem Vulnerability of two-layer neural networks to adversarial examples on low-dimensional subspaces.
method Analysis of gradient behavior and effect of initialization scale and regularization.
result Decreasing initialization scale or adding L2 regularization can improve robustness to adversarial perturbations orthogonal to the data.

With rapid progress and significant successes in a wide spectrum of applications, deep learning is being applied in many safety-critical environments. However, deep neural networks have been recently found vulnerable to well-designed input samples, called adversarial examples. Adversarial examples are imperceptible to …

2017-12-19abs ↗pdf ↗

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary information or make the system more vulnerable. This work shows that such attri…

2017-11-06abs ↗pdf ↗

New normalization method makes neural networks more robust to adversarial attacks.

problem Adversarial vulnerability of BatchNorm in deep neural networks.
method Identified distribution shift caused by adversarial images, proposed RobustNorm to use inference-time statistics.
result RobustNorm makes models more robust to adversarial attacks without sacrificing BatchNorm benefits.

Despite their impressive performance, deep neural networks exhibit striking failures on out-of-distribution inputs. One core idea of adversarial example research is to reveal neural network errors under such distribution shifts. We decompose these errors into two complementary sources: sensitivity and invariance. We sh…

2018-11-01abs ↗pdf ↗

New method bounds membership inference attack success using mutual information.

problem Vulnerability of deep neural networks to membership inference attacks.
method Extended Fano's inequality to measure mutual information between inputs and activations.
result Empirical evaluation shows strong correlation between mutual information and model susceptibility.

Lower class selectivity makes networks more robust to natural perturbations but more vulnerable to adversarial attacks.

problem Understanding how class selectivity affects robustness to different types of perturbations in neural networks.
method Investigated the relationship between class selectivity and robustness to natural and adversarial perturbations in neural networks.
result Lower class selectivity increases robustness to natural perturbations but decreases robustness to adversarial attacks.

Bayesian Neural Networks are robust to gradient-based attacks in the large-data limit.

problem Vulnerability of deep learning models to adversarial attacks.
method Analysis of adversarial attacks in the large-data, overparametrized limit for Bayesian Neural Networks.
result BNN posteriors are robust to gradient-based adversarial attacks in the limit.

Deep neural networks (DNNs) have achieved superior performance in various prediction tasks, but can be very vulnerable to adversarial examples or perturbations. Therefore, it is crucial to measure the sensitivity of DNNs to various forms of perturbations in real applications. We introduce a novel perturbation manifold …

2019-01-22abs ↗pdf ↗

Deep-CAPTCHA cracks visual CAPTCHAs using deep learning.

problem Cracking visual CAPTCHAs to assess vulnerabilities.
method Developed a Convolutional Neural Network (Deep-CAPTCHA) to solve numerical and alphanumeric CAPTCHAs.
result Cracking accuracy of 98.94% and 98.31% for numerical and alphanumeric datasets respectively.

Backdoors can be implanted in neural models of source code, and we detect and remove them.

problem Vulnerability of neural models to backdoors in source code.
method Defined and implemented various backdoor classes, adapted robust statistics algorithms, and detected poisoned data through spectral signatures.
result Demonstrated the ease of injecting and removing backdoors in neural models of source code.

Class selectivity affects robustness to corruptions but not to adversarial attacks.

problem Understanding the relationship between class selectivity and robustness in neural networks.
method Investigated the impact of class selectivity on robustness to natural corruptions and adversarial attacks using Tiny ImageNetC and CIFAR10C datasets.
result Decreasing class selectivity increases robustness to both natural corruptions and adversarial attacks.

New method certifies joint adversarial robustness of model ensembles.

problem Ensuring robustness of model ensembles against adversarial attacks.
method Proposes a novel technique to certify joint robustness, building on prior work on single-model robustness certification.
result Demonstrates the effectiveness of certifying joint robustness of ensembles, improving understanding of ensemble defenses.

Thousands of security vulnerabilities are discovered in production software each year, either reported publicly to the Common Vulnerabilities and Exposures database or discovered internally in proprietary code. Vulnerabilities often manifest themselves in subtle ways that are not obvious to code reviewers or the develo…

2018-02-14abs ↗pdf ↗

New insights into adversarial vulnerability linked to manifold separability issues.

problem Adversarial vulnerability in machine learning models.
method Characterized data distribution as a low-dimensional manifold, focusing on on/off manifold directions and the impact of first-order vs. second-order optimization methods.
result First-order optimization methods lead to poor convergence in the off-manifold direction, causing adversarial vulnerability in inseparable datasets.

Deep learning takes advantage of large datasets and computationally efficient training algorithms to outperform other approaches at various machine learning tasks. However, imperfections in the training phase of deep neural networks make them vulnerable to adversarial samples: inputs crafted by adversaries with the int…

2015-11-24abs ↗pdf ↗

Machine learning classifiers are known to be vulnerable to inputs maliciously constructed by adversaries to force misclassification. Such adversarial examples have been extensively studied in the context of computer vision applications. In this work, we show adversarial attacks are also effective when targeting neural …

2017-02-08abs ↗pdf ↗

The paper introduces a method to make neural networks more robust to adversarial attacks.

problem Vulnerability of deep neural networks to small, adversarially designed perturbations.
method A bottom-up strategy using a nonlinear front end that polarizes and quantizes data.
result The approach can completely eliminate adversarial perturbations on MNIST and Fashion MNIST datasets.

Batch normalization (batch norm) is often used in an attempt to stabilize and accelerate training in deep neural networks. In many cases it indeed decreases the number of parameter updates required to achieve low training error. However, it also reduces robustness to small adversarial input perturbations and noise by d…

2019-05-06abs ↗pdf ↗

Federated learning can be vulnerable to adversarial attacks, which this work addresses.

problem Federated learning's adversarial vulnerability when deployed.
method Bias-Variance decomposition for federated learning, proposing Fed_BVA framework.
result Fed_BVA framework generates adversarial examples to improve robustness.

New mechanism protects neural network weights from privacy attacks during self-supervised learning.

problem Privacy risks during fine-tuning stage of self-supervised learning.
method Proposes a novel differential privacy mechanism using additive logistic noise.
result Reduces membership inference attack accuracy to 50% while maintaining below 5% performance loss.

Massif helps interpret adversarial attacks on deep learning models.

problem Vulnerability of deep learning models to adversarial attacks.
method Interactive tool for visualizing and interpreting neurons affected by adversarial attacks.
result Massif provides a high-level overview and detailed low-level analysis of adversarial effects.

Recently it's been shown that neural networks can use images of human faces to accurately predict Body Mass Index (BMI), a widely used health indicator. In this paper we demonstrate that a neural network performing BMI inference is indeed vulnerable to test-time adversarial attacks. This extends test-time adversarial a…

2019-05-16abs ↗pdf ↗

SmoothFool efficiently computes smooth adversarial perturbations for deep networks.

problem Vulnerability of deep neural networks to adversarial attacks with specific statistical properties.
method SmoothFool: a general and computationally efficient framework for computing smooth adversarial perturbations.
result Smoothness significantly enhances robustness against adversarial attacks and improves transferability.