Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

1345 · Mar 202019922001200920172026
48 results for Non-Robustness

Batch normalization shifts models to rely more on non-robust features.

problem Understanding the impact of batch normalization on deep neural networks.
method Empirical analysis and a framework for disentangling robustness and usefulness.
result Batch normalization increases reliance on non-robust features, decreasing adversarial robustness.

Graph Random Neural Network improves semi-supervised learning on graphs.

problem Over-smoothing, non-robustness, and weak-generalization in GNNs with few labeled nodes.
method Random propagation strategy and consistency regularization.
result Significantly outperforms state-of-the-art GNN baselines on semi-supervised node classification.

Gradient descent biases neural networks to use an average of features, leading to non-robustness.

problem Non-robustness in neural networks due to feature averaging.
method Theoretical analysis and experiments on binary classification tasks.
result Gradient descent trains networks to rely on an average of features, making them vulnerable to adversarial attacks.

Defense against user shilling attacks in collaborative filtering using edge reweighting.

problem Vulnerability of collaborative filtering to profile injection attacks.
method Adversarial robustness based edge reweighting to attenuate non-robust edges.
result Effective defense against various types of attacks demonstrated through experiments.

Study uses RL to hedge financial derivatives, showing robust strategies outperform non-robust ones.

problem Risk mitigation and gain-seeking in hedging path-dependent financial derivatives.
method Robust risk-aware reinforcement learning (RL) with policy gradient approach.
result Robust hedging strategies outperform non-robust ones under varying data generating processes.

Bayesian investor learns unknown asset drift, trades mean-variance optimal portfolio, but policy is robust to observation model distortion.

problem Bayesian portfolio selection with observation model distortion
method Robust Bayesian portfolio selection
result Robust policy and its price are closed form, with price of robustness half the variance of the non-robust investor's loss.

Federated learning is the centralized training of statistical models from decentralized data on mobile devices while preserving the privacy of each device. We present a robust aggregation approach to make federated learning robust to settings when a fraction of the devices may be sending corrupted updates to the server…

2019-12-31abs ↗pdf ↗

New datasets reveal neural networks can rely on simple features, leading to poor generalization.

problem Neural networks' reliance on simple features can lead to poor generalization and robustness.
method Designing datasets with varying levels of simplicity and incorporating non-robustness.
result Neural networks can exclusively rely on the simplest feature, leading to poor performance on complex data.

Detects adversarial directions to make reinforcement learning policies more robust.

problem Adversarial attacks exploit non-robust directions in reinforcement learning policies, leading to instability.
method Local quadratic approximation of deep neural policy loss to identify non-robust directions.
result Provides a theoretical basis for distinguishing safe from adversarial observations.

Study analyzes and enhances robustness of neural networks for classification and regression.

problem Understanding and improving robustness of neural network predictions.
method Computes reachable sets of neural networks using over- and under-approximations.
result Approach outperforms adversarial attacks and state-of-the-art classifier verification methods.

New algorithm improves RL performance across different environments.

problem Improving reinforcement learning performance across various environments.
method Designing a fully model-free DRRL algorithm that learns from a single trajectory.
result Demonstrates superior robustness and sample efficiency compared to existing methods.

It has been shown that instead of learning actual object features, deep networks tend to exploit non-robust (spurious) discriminative features that are shared between training and test sets. Therefore, while they achieve state of the art performance on such test sets, they achieve poor generalization on out of distribu…

2019-10-01abs ↗pdf ↗

DVERGE diversifies adversarial vulnerabilities to enhance robust ensemble models.

problem Diverse adversarial vulnerabilities for robust ensemble models.
method Isolates and diversifies adversarial vulnerabilities through distillation and training.
result Achieves higher robustness against transfer attacks compared to previous methods.

DRO-REBEL improves LLM alignment by robustly updating models online.

problem Overfitting and drifting of LLMs during RLHF.
method DRO-REBEL uses type-pp Wasserstein, KL, and χ2χ^2 ambiguity sets for robust online updates.
result DRO-REBEL achieves faster convergence and better performance than prior methods.

The paper tackles robust classification trees for distribution shifts, improving accuracy in public health and social work.

problem Learning robust classification trees for high-stakes settings with distribution shifts.
method Mixed-integer robust optimization technology to reformulate as a two-stage linear robust optimization problem.
result Increase of up to 12.48% in worst-case accuracy and 4.85% in average-case accuracy.

This paper provides a non-robust interpretation of the distributionally robust optimization (DRO) problem by relating the distributional uncertainties to the chance probabilities. Our analysis allows a decision-maker to interpret the size of the ambiguity set, which is often lack of business meaning, through the chance…

2019-06-03abs ↗pdf ↗

Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. We demonstrate that adversarial examples can be directly attributed to the presence of non-robust features: features derived from patterns in the data distribution that ar…

2019-05-06abs ↗pdf ↗

Framework for robust control under model uncertainty, improving financial derivatives hedging.

problem Model uncertainty in financial derivatives hedging.
method Dynamic programming principle for solving one-step optimization problems.
result Robust hedging strategy outperforms model-based strategies during adverse scenarios.

Generative adversarial networks (GANs) are designed with the help of min-max optimization problems that are solved with stochastic gradient-type algorithms which are known to be non-robust. In this work we revisit a non-adversarial method based on kernels which relies on a pure minimization problem and propose a simple…

2018-11-23abs ↗pdf ↗

We continue the study of statistical/computational tradeoffs in learning robust classifiers, following the recent work of Bubeck, Lee, Price and Razenshteyn who showed examples of classification tasks where (a) an efficient robust classifier exists, in the small-perturbation regime; (b) a non-robust classifier can be l…

2019-02-04abs ↗pdf ↗

Variational inference is a powerful tool for approximate inference. However, it mainly focuses on the evidence lower bound as variational objective and the development of other measures for variational inference is a promising area of research. This paper proposes a robust modification of evidence and a lower bound for…

2016-11-28abs ↗pdf ↗

Despite the exploding interest in graph neural networks there has been little effort to verify and improve their robustness. This is even more alarming given recent findings showing that they are extremely vulnerable to adversarial attacks on both the graph structure and the node attributes. We propose the first method…

2019-10-31abs ↗pdf ↗

We solve robust optimization problems using Wasserstein balls and apply it to mean-CVaR optimization.

problem Distributionally robust optimization with Wasserstein ambiguity sets.
method Transformed robust optimization into non-robust with penalty term, selecting ambiguity set size.
result Impressive results in robust mean-CVaR optimization compared to other strategies.

Social Security and other public policies can be viewed as a series of cash in and outflows that depend on parameters such as the age distribution of the population and the retirement age. Given forecasts of these parameters, policies can be designed to be financially stable, i.e., to terminate with a zero balance. If …

2012-01-30abs ↗pdf ↗

Study examines noise sensitivity of DNNs for binary classification.

problem Understanding non-robustness of DNN classifiers under noise.
method Defined and extended noise sensitivity and stability concepts for Boolean functions, applied to DNN models.
result Sorted out the relation between definitions and properties of DNN architectures under noise.

New algorithm estimates eigenspace with faulty nodes, matching performance of existing methods.

problem Estimating eigenspace in distributed systems with node failures.
method Develops an eigenspace estimation algorithm for distributed environments with arbitrary node failures.
result Matches performance of existing non-robust estimator up to an additive error.

Recently, interpretable models called self-explaining models (SEMs) have been proposed with the goal of providing interpretability robustness. We evaluate the interpretability robustness of SEMs and show that explanations provided by SEMs as currently proposed are not robust to adversarial inputs. Specifically, we succ…

2019-05-27abs ↗pdf ↗

RATIO improves neural network robustness and explainability.

problem Neural networks' lack of robustness to adversarial changes and uncertainty on out-distribution samples.
method RATIO: Adversarial Training on In- and Out-distribution.
result RATIO leads to robust models with reliable confidence estimates on out-distribution samples.

Proposes a new VAE framework for anomaly detection in time series data.

problem Data scarcity leads to latent holes and discontinuous regions in latent space, causing non-robust reconstructions.
method Combines VAEs with self-supervised learning to address data scarcity and improve anomaly detection.
result Improves robustness of anomaly detection in time series data by addressing latent holes and discontinuities.

Two-layer networks trained on low-dimensional subspaces are vulnerable to adversarial examples.

problem Vulnerability of two-layer neural networks to adversarial examples on low-dimensional subspaces.
method Analysis of gradient behavior and effect of initialization scale and regularization.
result Decreasing initialization scale or adding L2 regularization can improve robustness to adversarial perturbations orthogonal to the data.

We study issues of robustness in the context of Quantitative Risk Management and Optimization. We develop a general methodology for determining whether a given risk measurement related optimization problem is robust, which we call "robustness against optimization". The new notion is studied for various classes of risk …

2018-09-25abs ↗pdf ↗

Study quantifies model risk in dynamic portfolio selection using KL divergence.

problem Model risk in financial portfolio selection under uncertainty.
method Defined model risk as KL divergence loss, solved nonlinear equations for optimal robust strategy.
result Optimal robust strategy can be obtained semi-analytically in worst case scenario.

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive action setting. In this paper, we propose robust methods for learning temporally …

2018-02-09abs ↗pdf ↗

Gradient flow in ReLU networks biases towards generalization but makes them vulnerable to adversarial attacks.

problem Generalization vs. Adversarial Robustness in ReLU Networks
method Analysis of gradient flow in two-layer ReLU networks with clustered data.
result Gradient flow biases towards generalization but also makes networks vulnerable to adversarial attacks.

Study shows semi-supervised learning can be more robust with fewer labeled examples.

problem Learning robust predictors in semi-supervised PAC model with minimal labeled data.
method Characterizes the minimal labeled and unlabeled data required for robust learning.
result Proves nearly matching upper and lower bounds on labeled sample complexity.

Deep RL policies share adversarial features across different MDPs.

problem Understanding decision boundaries and loss landscapes in neural policies.
method Investigating similarities in high sensitivity directions across MDPs using Arcade Learning Environment.
result High sensitivity directions for neural policies are correlated across MDPs, suggesting shared non-robust features.

Paper proposes an algorithm for robust estimation using Huber's criterion.

problem Non-convexity and non-robustness of joint maximum likelihood estimation.
method Block-wise minimization majorization framework with data-adaptive step sizes.
result Improved convergence and robustness in sparse learning.