Study shows computational hardness can improve adversarial robustness in learning.
problem Developing robust machine learning models against adversarial attacks.
method Investigate if computational limitations of attackers can enhance robustness.
result Demonstrated a learning task where computational robustness outperforms information-theoretic robustness.
New algorithms solve robust MDPs efficiently, significantly faster than existing methods.
problem Computing robust MDP solutions with uncertainty in transition probabilities is computationally expensive.
method Partial policy iteration and fast robust Bellman operator computation methods.
result The proposed methods are many orders of magnitude faster than state-of-the-art approaches.
We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of magnitude. We analyze the robustness property of DRL, showing that DRL not only…
RCaGP improves robustness and computational efficiency in Gaussian processes.
problem Outliers in large datasets corrupt standard Gaussian process models.
method Combines robustness and approximation-awareness in a principled framework.
result Ensures more conservative and reliable uncertainty estimates.
SNAP improves robust computation by emphasizing trustworthy items and downweighting outliers.
problem Improving robustness in computation, especially in high-dimensional settings.
method SNAP assigns weights based on mutual agreement, suppressing outlier contributions.
result SNAP ensures outliers contribute negligibly to computations, even in high-dimensional settings.
Efficiently computes robust option prices using multi-marginal martingale transport.
problem Computing robust option prices under martingale constraints.
method Extending state space, sequential martingale structure, entropic regularisation.
result Fast computation of optimal solutions for large problems.
CBC makes CNNs robust against adversarial attacks with minimal computational overhead.
problem Making CNNs robust against adversarial attacks without increasing computational complexity.
method CBC uses a stacked encoder-convolutional model where an auto-encoder encodes the input image, and the latent representation is used for classification.
result CBC is more robust to adversarial examples and has significantly lower computational complexity.
RieCUR improves Robust PCA by combining Riemannian optimization and CUR decompositions.
problem Robust Principal Component Analysis (PCA) to recover low-rank and sparse matrices from their sum.
method Riemannian CUR (RieCUR) algorithm that combines Riemannian optimization and robust CUR decompositions.
result RieCUR achieves state-of-the-art performance in Robust PCA with improved robustness to outliers and comparable computational complexity.
New insights into data augmentation for improving robustness in computer vision.
problem Challenges in achieving robustness to distributional shift in computer vision.
method Investigation of trade-offs between robustness to high and low frequency corruptions using Gaussian data augmentation and adversarial training.
result Improvements in robustness to high frequency corruptions come at the cost of reduced robustness to low frequency corruptions.
Proposes robust ABC method for outlier detection.
problem Outliers sensitivity in ABC methods.
method γ-divergence estimator with redescending property.
result Significantly higher robustness than existing methods.
This work improves scalability of Wasserstein distances in high dimensions.
problem Scalability issues in computing Wasserstein distances in high dimensions.
method Empirical convergence rates, robustness to data contamination, and computational methods.
result Established fast rates and robust estimation risks for sliced Wasserstein distances.
Paper tackles robust optimal transport with improved computational complexity and barycenter approximation.
problem Computing robust optimal transport and its barycenter efficiently.
method Sinkhorn-based algorithms for robust optimal transport and iterative Bregman projections for barycenter approximation.
result Improved computational complexity for robust optimal transport and barycenter approximation.
Study shows computational limits for robust classification tasks, leading to cryptographic implications.
problem Computational limitations in learning robust classifiers for classification tasks.
method Extending previous work on statistical/computational tradeoffs, using average-case hard functions and one-way functions.
result Computational hardness of learning robust classifiers even when efficient non-robust classifiers exist.
Deployment of deep neural networks (DNNs) in safety- or security-critical systems requires provable guarantees on their correct behaviour. A common requirement is robustness to adversarial perturbations in a neighbourhood around an input. In this paper we focus on the L0 norm and aim to compute, for a trained DNN an…
Paper connects GANs to robust estimation, leading to efficient computation of optimal estimators.
problem Statistical robust estimation under contaminated data models.
method Establishes connection between f-GANs and depth functions through f-Learning. result Appropriate discriminator network structures in GANs lead to optimal robust estimators.
Paper calculates robust FVA for OTC derivatives under distributional uncertainty.
problem Distributional uncertainty in over the counter derivatives valuation.
method Wasserstein distance as ambiguity measure, dual formulation of robust FVA optimization.
result Additional FVA charge due to distributional uncertainty measured under various configurations.
Efficiently solves large-scale robust portfolio optimization problems.
problem High computational demands in large-scale robust portfolio optimization.
method Extended supporting hyperplane approximation for distributionally robust portfolio problems.
result Significantly reduces computational time from several thousand seconds to just a few.
Computational limitations require more model parameters for robust learning.
problem Computational constraints affect the number of parameters needed for robust learning.
method Analyzes computational limitations and their impact on model size for robust learning.
result Computational bounded learners need significantly more parameters for robust learning.
Privacy improves robustness in statistical estimation.
problem Sparse mean estimation under privacy constraints.
method Sum-of-Squares method and exponential-time mechanisms.
result Private algorithms matching optimal tradeoffs are not known, but achieved via Sum-of-Squares.
Unsupervised learning techniques in computer vision often require learning latent representations, such as low-dimensional linear and non-linear subspaces. Noise and outliers in the data can frustrate these approaches by obscuring the latent spaces. Our main goal is deeper understanding and new development of robust ap…
The paper assesses text classification robustness through maximal safe radius computation.
problem Vulnerability of neural network models to small input modifications.
method Maximal safe radius computation, Monte Carlo Tree Search, syntactic filtering, linear bounding techniques.
result Approximation methods for computing upper and lower bounds of maximal safe radius.
Paper presents efficient computation of robust Wasserstein distance using Riemannian optimization.
problem Intractability of optimizing Projection Robust Wasserstein (PRW) distance due to non-convexity and non-smoothness.
method Riemannian optimization to efficiently compute PRW/Wasserstein Projection Pursuit (WPP) distance.
result The original formulation of PRW/WPP can be efficiently computed in practice, providing better behavior than its convex relaxation.
GeoCert finds robustness of neural networks by fitting a ball in polytopes.
problem Computing exact robustness of neural networks for all norms.
method GeoCert algorithm that finds the largest ball within a polytope.
result GeoCert efficiently computes robustness bounds for neural networks.
New method makes CNN interpretations robust to adversarial attacks.
problem Adversarial attacks on CNN interpretation maps.
method Renyi Differential Privacy (RDP) for robust interpretation.
result Certifiable top-k robustness and improved experimental robustness. The paper explores the difficulty of robust machine learning models.
problem Understanding the vulnerability of machine learning models to adversarial attacks.
method The study uses computational learning theory to analyze the feasibility of robust learning from both sample and computational complexity perspectives.
result No non-trivial concept class can be robustly learned in the distribution-free setting against a single-bit adversary, and the class of monotone conjunctions cannot be robustly learned under the uniform distribution against an adversary that can perturb ω(logn) bits. DETOX improves distributed training resilience with redundancy and robust aggregation.
problem Byzantine node failures in distributed training.
method Combines redundancy and robust aggregation methods.
result Substantial increase in robustness with nearly linear runtime.
Hybrid approach reduces computation time and decoding complexity.
problem Straggling servers in distributed computing.
method Coded partial gradient computation (CPGC) that balances gradient accuracy and completion time.
result Reduces both computation time and decoding complexity.
New method improves adversarial robustness of neural networks.
problem Vulnerability of neural networks to adversarial attacks.
method Integrates φ-divergence regularization into distributionally robust risk function.
result Achieves near-optimal sample complexity with efficient stochastic gradient methods.
Survey on efficient robust estimators for high-dimensional statistics.
problem Efficient robust mean estimation in high dimensions.
method Emerging algorithmic techniques in theoretical computer science.
result First efficient robust estimators for fundamental tasks.
Robust Kalman filtering method for outlier detection.
problem Outliers and misspecified measurement models in state-space models.
method Combines generalised Bayesian inference with Kalman filters for robustness and efficiency.
result Matches or outperforms other robust filtering methods at lower computational cost.
Study robust control for systems with continuous states using adversarial perturbations.
problem Fragile policies in Markov control models under internal or external perturbations.
method Distributionally robust stochastic control with adaptive adversarial perturbations.
result Optimal robust policies for continuous state systems with uniform learning guarantees.
Robust boosting improves regression accuracy in noisy data.
problem Handling outliers in non-parametric regression.
method Two-stage approach: robust residual scale minimization followed by bounded loss optimization.
result Robust boosting outperforms standard methods in outlier-prone data.
New algorithms optimize a soft-robust criterion in reinforcement learning, reducing conservatism.
problem Computing robust policies for high-stakes decisions with limited data.
method Soft-robust criterion using risk measures, two algorithms for optimization.
result Our algorithms produce less conservative solutions than existing methods.
Efficiently estimates sparse linear regression with heavy-tailed data and outliers.
problem Sparse estimation of linear regression coefficients with heavy-tailed covariates and noises, including outliers.
method Efficient computation of robust estimator with nearly optimal error bound.
result Nearly optimal error bound for robust sparse estimation.
Sparse DNNs improve adversarial robustness by reducing computation and memory usage.
problem Adversarial attacks on DNNs increase computation and memory requirements.
method Pruning dense DNNs to create sparse models, analyzing their robustness.
result Higher sparsity in nonlinear DNNs correlates with better adversarial robustness.
Proposes POPQORN to quantify robustness of RNNs, including LSTMs and GRUs.
problem Vulnerability to adversarial attacks in recurrent neural networks.
method Develops POPQORN, a general algorithm to quantify robustness of RNNs.
result Demonstrates effectiveness on different network architectures and shows insights from robustness quantification on individual steps.
New algorithms compute robustness bounds for multiclass classification models.
problem Computing robustness of deep learning models in multiclass classification.
method Optimal transport and linear programming/entropic regularization.
result Tractable algorithms for computing robustness bounds.
New framework for robust regularization under uncertain data distributions.
problem Addressing ill-posed inverse problems and statistical estimation under distributional uncertainty.
method Distributionally robust optimal regularization using convex duality.
result Identifies robust regularizers that remain effective under data distributional perturbations.
Paper improves neural network robustness analysis for safety-critical systems.
problem Uncertainty in neural network outputs for safety-critical systems.
method Unified propagation and partition approaches to provide tighter bounds.
result Proposed algorithms give tighter bounds than existing methods for the same computation time.
Study on learning halfspaces under adversarial perturbations, finding computational hardness.
problem Learning halfspaces in the presence of adversarial noise.
method Introduced an efficient learning algorithm and proved a nearly matching computational hardness result.
result The L∞ perturbations case is provably computationally harder than 2≤p<∞. Study robustness of polynomial neural networks using algebraic geometry.
problem Certify robustness radius of polynomial neural networks.
method Metric algebraic geometry, Euclidean distance degree, symbolic elimination, homotopy-continuation methods.
result Found decision boundaries with lower ED degree than generic cubic hypersurfaces.
Robust VB framework for large datasets with outliers.
problem Handling outliers and contamination in large datasets.
method Divide and conquer approach with geometric median aggregation.
result VM-Posterior distribution preserves contraction properties.
New probabilistic approach to neural network robustness.
problem Challenges in verifying neural network robustness.
method Probabilistic robustness approach, abstract interpretation, importance sampling.
result Practical algorithm for checking probabilistic robustness of neural networks.
In this paper we address the problem of performing statistical inference for large scale data sets i.e., Big Data. The volume and dimensionality of the data may be so high that it cannot be processed or stored in a single computing node. We propose a scalable, statistically robust and computationally efficient bootstra…
IRCUR accelerates RPCA by using CUR decomposition for efficient low rank estimation.
problem Dimension reduction in robust principal component analysis.
method IRCUR employs CUR decomposition to update the low rank component efficiently.
result IRCUR achieves significant computational efficiency compared to existing algorithms.
CNN layers with large norms are still robust to adversarial attacks.
problem Understanding the relationship between layer norms and adversarial robustness in CNNs.
method Theoretical analysis of ℓ1 and ℓ∞ norms, norm decay method, adversarial training frameworks. result Adversarially robust CNNs can have comparable or larger layer norms than non-adversarially robust ones.
New algorithms tackle robust RL with linear models, revealing unique challenges.
problem Distributionally robust offline RL with uncertainty in dynamics.
method Proposes minimax optimal and computationally efficient algorithms using novel function approximation mechanisms.
result Function approximation in robust offline RL is distinct and harder than in standard offline RL.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.