Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3136279401,253 · Jun 202019922001200920172026
48 results for robust deep networks

Robust deep neural networks estimate multi-dimensional functional data robustly.

problem Estimating location function from multi-dimensional functional data robustly.
method Deep neural networks with ReLU activation, robust to outliers and model misspecification.
result Uniform convergence rates for robust deep neural network estimators.

New model improves neural network robustness against input manipulations.

problem Improving neural network robustness against input manipulations.
method Causal view and deep causal manipulation augmented model (deep CAMA) with data augmentation and test-time fine-tuning.
result Deep CAMA shows superior robustness against unseen manipulations compared to traditional models.

This paper investigates how network width and depth affect adversarially robust DNNs.

problem Understanding architectural configurations for adversarially robust DNNs.
method Comprehensive investigation on the impact of network width and depth on adversarial robustness.
result Optimal architectural configuration for adversarial robustness exists and can improve robustness.

Robust risk minimisation has several advantages: it has been studied with regards to improving the generalisation properties of models and robustness to adversarial perturbation. We bound the distributionally robust risk for a model class rich enough to include deep neural networks by a regularised empirical risk invol…

2018-09-04abs ↗pdf ↗

Paper assesses adversarial robustness of MCMC and BDK methods for deep Bayesian networks.

problem Assessing adversarial robustness of deep neural networks under MCMC and BDK approximations.
method Characterizes robustness of MCMC and BDK methods to FGSM and PGD attacks.
result Full MCMC-based inference shows excellent robustness, outperforming standard point estimation.

RobNets improve robustness of deep neural networks against adversarial attacks.

problem Vulnerability of deep neural networks to adversarial attacks.
method One-shot neural architecture search, finetuning sub-networks, and analyzing robustness indicators.
result RobNets achieve superior robustness performance across various datasets.

Enhances deep learning models to resist adversarial attacks.

problem Protecting deep learning models from adversarial examples.
method Combines two mechanisms: increased robustness at the cost of accuracy and improved accuracy without robustness guarantee.
result Combining mechanisms provides robustness against adversarial examples while maintaining accuracy.

DeepMPM uses MPM to make deep neural networks more robust against adversarial attacks.

problem Vulnerability of deep neural networks to adversarial attacks.
method Applying MPM to deep neural networks in an end-to-end fashion to minimize an upper bound of misclassification probabilities considering global class information.
result DeepMPM achieves comparable classification performance with CNN but is more robust against adversarial attacks.

New measure assesses deep neural networks' robustness to adversarial attacks.

problem Deep learning's fragility to adversarial attacks limits its adoption in mission-critical applications.
method Introduces residual error as a new performance measure for assessing adversarial robustness.
result Demonstrates effectiveness of residual error in assessing robustness of deep neural networks.

Random deep neural networks are robust to adversarial examples, scaling with input size and dimension.

problem Adversarial examples challenge the reliability of deep learning algorithms.
method Analysis of random deep neural networks with Gaussian process equivalence and experiments on MNIST and CIFAR10.
result The p\ell^p distance of adversarial examples scales as 1/dimesp1/\sqrt{d} imes \ell^p norm of the input.

Study evaluates adversarial training for deep learning IDSs against various attacks.

problem Evasion attacks against deep learning-based IDSs.
method Investigated adversarial training using min-max approach on CNN and RNN.
result Adversarial training improves robustness against five attack methods.

SOAR improves deep networks' robustness against adversarial examples.

problem Improving deep neural networks' robustness against adversarial examples.
method Formulated adversarial robustness problem under robust optimization framework, approximated loss function using second-order Taylor series expansion.
result SOAR significantly improves robustness of networks against adversarial perturbations.

New method speeds up training of deep networks robust to adversarial attacks.

problem Deep networks are sensitive to adversarial perturbations, compromising security and interpretability.
method Fast adversarial training using Euclidean norm approximation and distributed computing.
result Robust feature representations and reduced training time achieved.

Proposes model-based robust deep learning to handle natural variation in data.

problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.

SPLASH units improve deep neural network accuracy and adversarial robustness.

problem Improving deep neural network accuracy and adversarial robustness.
method SPLASH units are learnable activation functions with specific properties that enhance both accuracy and robustness.
result SPLASH units significantly increase adversarial robustness of deep neural networks.

Improves deep learning robustness by enforcing local and global compactness.

problem Deep neural networks' vulnerability to adversarial attacks.
method Proposes Adversary Divergence Reduction Network (ADRN) that enforces local/global compactness and clustering assumption.
result Augmenting adversarial training with ADRN components improves robustness.

This work improves deep reinforcement learning robustness to adversarial state uncertainty.

problem Robustness of deep reinforcement learning to adversarial state uncertainty.
method Certified adversarial robustness techniques are applied to deep reinforcement learning algorithms to compute guaranteed lower bounds on state-action values.
result The approach increases robustness to noise and adversaries in pedestrian collision avoidance and classic control tasks.

Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural networks generated using machine-learning. However, deep neural networks are opaque …

2017-09-08abs ↗pdf ↗

Paper explains why robust generalization is hard in deep learning models.

problem Difficulty in achieving robust generalization despite good training accuracy.
method Theoretical analysis of expressive power for deep neural networks.
result Expressive power of neural networks affects robust generalization.

Understanding deep neural networks is a major research objective with notable experimental and theoretical attention in recent years. The practical success of excessively large networks underscores the need for better theoretical analyses and justifications. In this paper we focus on layer-wise functional structure and…

2019-02-06abs ↗pdf ↗

Paper tackles noisy neural networks and proposes a method to enhance their robustness.

problem Noisy neural networks struggle with random continuous noise in weights.
method Knowledge distillation combined with noise injection during training.
result Models achieve up to twice greater noise tolerance.

New approach improves deep learning robustness in medical imaging.

problem Deep learning models are vulnerable to adversarial examples in medical imaging.
method Propose a min-max learning scheme to generate adversarial examples and filter them out.
result Proposed method significantly improves robustness of deep learning models in medical imaging.

Deep neural networks identify robust arbitrage strategies in financial markets.

problem Identifying profitable trading strategies under model ambiguity.
method Data-driven deep neural networks considering high-dimensional financial markets.
result Empirical investigations show profitable trading performances in various market conditions.

DRO-Augment framework enhances deep neural network robustness.

problem Robustness of deep neural networks against various perturbations and adversarial attacks.
method Integrates Wasserstein Distributionally Robust Optimization with data augmentation.
result Significantly improves robustness across various corruptions and adversarial attacks.

PaRoT simplifies robust training for deep neural networks.

problem Training deep neural networks to be robust to small input changes.
method Developed a practical framework on TensorFlow for robust training without code modifications.
result PaRoT's performance is comparable to existing methods and is easy to use on real-world models.

New algorithm improves deep learning models' robustness without sacrificing accuracy.

problem Low-rank methods compromise model robustness against adversarial perturbations.
method Robust low-rank training via approximate orthonormal constraints.
result Ensures well-conditioning and better adversarial robustness without sacrificing model accuracy.

New model improves deep learning robustness against adversarial attacks.

problem Improving adversarial robustness of deep learning models.
method Local competition principle, LWTA nonlinearities, Bayesian non-parametrics.
result The new model achieves high robustness to adversarial perturbations on MNIST and CIFAR10 datasets.

GrokAlign aligns Jacobians to accelerate grokking in deep networks.

problem Accelerating the training dynamics of deep networks to avoid delayed generalisation and robustness.
method Aligning the Jacobians of a deep network with the training data to ensure grokking under a low-rank assumption.
result GrokAlign regularizes Jacobians to induce grokking sooner than conventional methods.

This paper improves loss functions for deep learning with noisy labels.

problem Training deep neural networks with noisy labels.
method The paper introduces a normalization technique to make any loss function robust to noisy labels and proposes a framework called Active Passive Loss (APL) to combine robust loss functions.
result The proposed APL framework consistently outperforms state-of-the-art methods, especially under high noise rates.

HYDRA prunes robust neural networks to improve both benign and adversarial robustness.

problem Lack of robustness against adversarial attacks and large neural network size in deep learning.
method HYDRA integrates pruning techniques with adversarial training and verifiable robust training objectives.
result HYDRA achieves compressed networks with state-of-the-art benign and robust accuracy.

This paper improves causal inference using deep neural networks for low-dimensional covariates.

problem Improving causal inference with deep learning for high-dimensional covariates.
method Doubly robust off-policy learning with deep neural networks on low-dimensional manifolds.
result Nonasymptotic regret bounds for finite- and continuous-action scenarios, converging at a fast rate depending on intrinsic manifold dimension.

Deep neural networks have achieved impressive performance in many applications but their large number of parameters lead to significant computational and storage overheads. Several recent works attempt to mitigate these overheads by designing compact networks using pruning of connections. However, we observe that most …

2019-06-14abs ↗pdf ↗

Improved robustness for deep neural networks with tighter bounds and attacks.

problem Loose upper bounds and prohibitive computation in existing adversarial robustness methods.
method Primal approach with exact Lipschitz certificates for ReLU networks and modern architectures, and novel Wasserstein Distributional Attacks.
result Tighter upper bounds and greater flexibility in attack points compared to existing methods.

Spiking neural networks perform similarly to deep networks on occluded images.

problem Robust object recognition in partially occluded images.
method Developed a two-layer spiking neural network trained on natural scenes with a biologically plausible learning rule, compared to deep convolutional networks.
result Spiking neural networks achieve good accuracy and robustness on stepwise pixel erasement tasks.

Single neural networks can match deep ensembles' benefits without the complexity.

problem The effectiveness and necessity of deep ensembles in neural network models.
method Demonstrated limitations of ensemble diversity and OOD performance in deep ensembles compared to a single larger model.
result A single neural network can replicate deep ensembles' benefits in uncertainty quantification and robustness.

New deep learning model robust to adversarial attacks using stochastic LWTA units.

problem Adversarial robustness in deep learning networks.
method Introduces deep networks with stochastic LWTA activations, combining them with Bayesian non-parametric tools.
result Achieves high robustness to adversarial perturbations, outperforming state-of-the-art methods.