Proposes DRIG for robust predictions using noise interventions.
problem Developing robust prediction models against distribution shifts.
method Distributional Robustness via Invariant Gradients (DRIG) exploiting general noise interventions.
result DRIG yields robust predictions among a data-dependent class of distribution shifts.
A new framework for performative prediction robust to distributional misspecification.
problem Performative prediction models can be influenced by their own predictions, leading to suboptimal outcomes.
method Introduces distributionally robust performative prediction (DRPO) to approximate the true performative optimum (PO) robustly.
result DRPO provides provable guarantees as a robust approximation to the true PO when the nominal distribution map is misspecified.
This paper improves conformal prediction to be robust to perturbations.
problem Ensuring robustness of conformal prediction to natural and adversarial perturbations.
method Probabilistically robust conformal prediction (PRCP) and its adaptive version (aPRCP).
result aPRCP achieves better trade-offs between nominal performance and robustness.
The paper presents a method to make predictions robust to distributional shifts.
problem Making predictions robust to distributional shifts in machine learning.
method The method uses prediction sets and conformal inference to provide valid coverage under shifts.
result The method achieves nearly valid coverage in finite samples under exchangeable training data.
CTRF combines logged data and randomized experiments for robust prediction.
problem Robust prediction models to handle distributional shifts between training and testing data.
method CTRF uses existing training data and a small amount of randomized experiment data to train a robust model.
result CTRF produces robust predictions and outperforms baseline methods in the presence of feature shifts.
Connects robust optimization to conformal prediction for uncertainty sets.
problem Decision-making under uncertainty in sensitive data.
method Defines Mahalanobis distance as a conformity score and generates conformal uncertainty sets.
result Conformal uncertainty sets provide valid and conservative ellipsoidal regions.
It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to top-1 predictions. In many real-world applications, top-k predictions are more rel…
This research focuses on invariant probabilistic predictions, showing they are not robust under distribution shifts.
problem The challenge of creating robust probabilistic predictions that remain consistent under distribution shifts.
method A causality-inspired framework to investigate invariance and robustness of probabilistic predictions with respect to proper scoring rules.
result Arbitrary distribution shifts do not admit invariant and robust probabilistic predictions, unlike point predictions.
Study robustness of split conformal prediction in data contamination setting.
problem Robustness of split conformal prediction under data contamination.
method Analyze split conformal prediction's performance in a contaminated data setting and propose a new method.
result Demonstrated the impact of corrupted data on prediction intervals' coverage and efficiency.
New framework for robust uncertainty quantification in strategic settings.
problem Machine learning model predictions can be strategically altered by informed agents.
method Strategic Conformal Prediction framework
result Theoretical guarantees and experimental validation show remarkable effectiveness.
Modular pipeline improves stock portfolio prediction robustness under regime changes.
problem Overfitting in deep learning models for non-stationary datasets.
method Modular machine learning pipeline with GBDT models and online learning techniques.
result GBDT models with dropout show high performance, robustness, and generalisability.
RoCP-GNN improves GNNs' robustness in graph node classification.
problem Uncertainty in GNN predictions for graph data.
method Integrates conformal prediction into GNN training for robust prediction sets.
result GNN models with size loss improve performance in node classification.
Robust Bayes-Assisted Conformal Prediction improves prediction set sizes.
problem Misspecification of Bayesian working model and prior misalignment.
method RoBAS (Robust Bayes-Assisted Shrinkage) framework with two instantiations.
result Improves prediction set sizes in shifted settings.
Robust Bayes-Assisted Conformal Prediction improves prediction set sizes.
problem Misspecification of Bayesian working model and prior misalignment.
method RoBAS (Robust Bayes-Assisted Shrinkage) framework with two instantiations.
result Proposed scores adapt to prior quality, reducing interval widths in shifted settings.
Study robustness of split conformal prediction under adversarial attacks.
problem Ensuring distribution-free coverage guarantees in CP under adversarial conditions.
method Theoretical analysis and extensive experiments on split conformal prediction robustness.
result Prediction coverage varies with calibration-time attack strength, enabling control over coverage under adversarial tests.
This paper improves conformal prediction for robust interval estimation under distribution shifts.
problem Robustness of conformal prediction under distribution shifts.
method Modeling distribution shifts using Levy-Prokhorov (LP) ambiguity sets, which capture both local and global perturbations.
result Constructs robust conformal prediction intervals that remain valid under distribution shifts.
The study examines how model predictions hold up under model extensions.
problem Model predictions may not be robust under model extensions, limiting their applicability.
method The study uses causal ordering to assess robustness of qualitative model predictions and characterizes model extensions that preserve predictions.
result Conditions and techniques are provided to assess robustness of model predictions under model extensions.
Enhances deep learning models' robustness against adversarial attacks.
problem Lack of reliable uncertainty estimates and robust defenses for deep learning models.
method Integrates Conformal Prediction principles with adversarial training.
result Introduces OPSA-AT, a defense strategy that enhances robustness and reliability.
Synthesizes robust estimators for domain adaptation.
problem Improving prediction accuracy in target domain with limited data.
method Synthesizes a family of robust least squares estimators using convex optimization.
result Robust strategies can outperform non-robust interpolations.
Bayesian neural networks are vulnerable to adversarial attacks.
problem Adversarial robustness of Bayesian neural networks.
method Examination of adversarial robustness through three tasks: label prediction, adversarial example detection, and semantic shift detection.
result Bayesian neural networks are highly susceptible to adversarial attacks.
Single model predicts multiple subnetworks for robustness.
problem Efficiently ensemble neural networks for robustness and uncertainty.
method Multi-input multi-output (MIMO) configuration to train independent subnetworks.
result Significant improvement in negative log-likelihood, accuracy, and calibration error.
Neural networks classify OOD images by their nearest neighbor in training data.
problem Understanding out-of-distribution prediction behavior of neural networks.
method Nearest category generalization (NCG) measure to assess OOD prediction accuracy.
result Adversarially robust networks have higher NCG accuracy than natural training, indicating local regularization impacts decision regions.
Paper introduces novel model selection for CRO to balance robustness and decision risk.
problem Balancing robustness and decision risk in CRO.
method Conformalized Robust Optimization with Model Selection (CROMS) framework.
result Significant improvements in decision efficiency across various applications.
New robustness metric helps select reliable classifiers.
problem Evaluating reliability of classifier predictions.
method Proposed new robustness metric for any classifier and feature type.
result Demonstrated ability to distinguish reliable from unreliable predictions.
Enhances survival analysis predictions with a robust learning approach.
problem Improving robustness and accuracy in survival analysis predictions.
method Integrates Distributionally Robust Learning (DRL) into Cox regression using Wasserstein distance-based ambiguity set.
result Demonstrates superior performance in prediction accuracy and robustness compared to traditional methods.
DBU models struggle with robust uncertainty estimates under adversarial attacks.
problem Robustness of DBU models in adversarial settings.
method Investigated robustness of DBU models under adversarial attacks; proposed median smoothing approach.
result DBU models are not robust in indicating correctly and wrongly classified samples, detecting adversarial examples, and distinguishing ID and OOD data.
Study robustness of conformal prediction to label noise in regression and classification.
problem Robustness of conformal prediction to label noise in regression and classification.
method Characterized robustness of conformal prediction for both regression and classification problems, extending theory to control general loss functions.
result Conformal prediction and risk-controlling techniques can achieve conservative risk over clean ground truth labels with noisy labels.
New framework calibrates decision robustness using inverse conformal risk control.
problem Inadequate robustness levels in decision-making due to ad hoc choices.
method Constructs valid estimators to trace miscoverage-regret Pareto frontier.
result Provides distribution-free, finite-sample guarantees on robustness levels.
MC-CP combines adaptive MC dropout with conformal prediction for robust uncertainty quantification.
problem Deploying deep learning models in safety-critical applications requires reliable confidence estimates.
method MC-CP integrates adaptive Monte Carlo dropout with conformal prediction to improve model performance.
result MC-CP significantly outperforms state-of-the-art UQ methods in both classification and regression tasks.
A robust conformal method for set estimation using non-conformity scores.
problem Lack of robustness in standard conformal prediction methods for outliers or heavy tails.
method Robust conformal method based on non-conformity score defined as half-mass radius.
result Empirical conformal regions converge to robust population central set.
Fusion of robustness and uncertainty techniques improves adversarial defense.
problem Adversarial attacks on deep neural networks.
method Integrating uncertainty quantification into randomized smoothing for robustness guarantees.
result Improved robustness guarantees for uncertainty aware classifiers.
Bayes predictor remains robust to ignorable missingness shifts.
problem Challenges in prediction with missing covariates and shifts in missingness reasons.
method Bayesian approach and different prediction methods.
result Bayes predictor remains unchanged by ignorable shifts, but robust prediction requires disregarding missingness for non-ignorable shifts.
COLEP improves robustness of conformal prediction via probabilistic circuits.
problem Adversarial perturbations can undermine the coverage guarantees of conformal prediction.
method COLEP uses probabilistic circuits to learn and reason about different semantic concepts, providing certifiable coverage guarantees.
result COLEP achieves higher prediction coverage and accuracy than a single model, especially with non-trivial knowledge models.
Study highlights robustness issues in healthcare diagnostic models due to distribution shifts.
problem Robustness of diagnostic models in healthcare is compromised by distribution shifts.
method Theoretical analysis and simulation studies to understand and mitigate shortcuts learned by models.
result Ignoring covariates or using invariant learning approaches leads to non-robust predictors.
Enhanced route planning with probabilistic prediction and uncertainty sets.
problem Improving route planning reliability under uncertainty.
method CQR-GAE model integrating conformal prediction and uncertainty sets.
result Significantly outperforms baseline methods in real-world traffic scenarios.
Improves model calibration by addressing adversarially unrobust inputs.
problem Miscalibrated predictions and lack of adversarial robustness in neural networks.
method AR-AdaLS, an adaptive label smoothing method that considers adversarial robustness.
result AR-AdaLS improves model calibration, even under distributional shifts.
PRISM-FCP improves federated prediction robustness against Byzantine attacks.
problem Byzantine attacks in federated learning.
method Partial model sharing and distance-based maliciousness scores.
result Maintains nominal coverage guarantees under Byzantine attacks.
Novel causal effect estimators and distributionally robust prediction methods.
problem Estimating causal effects and distributional robustness in statistical models.
method Developed novel estimators and proposed a general framework for distributional robustness.
result Mean squared error improvements in causal effect estimation compared to existing methods.
Deep learning models predict stock prices with high accuracy.
problem Accurate prediction of future stock prices in an efficient market.
method Robust deep learning models using historical stock data.
result Models achieve high precision in predicting stock prices.
New method for robust prediction valid under non-exchangeable data.
problem Non-exchangeability in data violates robustness of common CP methods.
method Introduces efficient CP approach for general non-exchangeable data.
result Produces provably valid confidence sets for non-exchangeable data.
Study improves robust nonparametric regression in heavy-tailed noise.
problem Robust nonparametric regression with heavy-tailed noise and unbounded functions.
method Huber regression in reproducing kernel Hilbert spaces (RKHS), probabilistic effective hypothesis space, new comparison theorems.
result Explicit finite-sample error bounds and convergence rates for Huber regression in RKHS under heavy-tailed noise.
New robustness measure accounts for task-specific symmetries.
problem Traditional robustness measures fail for tasks with inherent symmetries.
method Sound notion of adversarial robustness for equivariant tasks, using randomized smoothing and graph edit distance certificates.
result Provable robustness can be achieved for various tasks with inherent symmetries.
New approach to meaningful and robust algorithmic recourse.
problem Ineffective and unmeaningful algorithmic recourse explanations.
method Meaningful Algorithmic Recourse (MAR) and Effective Algorithmic Recourse (EAR).
result Proposes new constraints for algorithmic recourse that improve both prediction and target.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.
FedGVI improves FL robustness to model misspecification.
problem Limited robustness in FL approaches to model misspecification.
method Probabilistic Federated Learning framework that generalizes previous methods.
result FedGVI provides robust and calibrated predictions under model misspecification.
GeFs use deep generative models to enhance prediction robustness and uncertainty.
problem Lack of principled methods to manipulate uncertainty in decision trees and random forests.
method Exploits Generative Forests (GeFs), a deep probabilistic model that extends Random Forests to represent full joint distributions.
result GeFs are uncertainty-aware classifiers capable of measuring robustness and detecting out-of-distribution samples.
Unified framework for robust linear predictions without distributional assumptions.
problem Robust linear predictions in the presence of outliers and model misspecification.
method Unified robust framework for linear prediction problems on Hilbert spaces, using Median of Means (MoM) approach.
result Achieves an error rate of \(O(\max\left\{|\mathcal{O}|^{1/2}n^{-1/2}, |\mathcal{I}|^{1/2}n^{-1}
ight\}+ε)\) for misspecification level \(ε\), matching best-known rates.
This work analyzes how frequency components affect CNN predictions and robustness.
problem Lack of frequency-based explanation for CNNs leading to vulnerabilities.
method Frequency component analysis and quantification of their contribution to CNN predictions.
result Adversarial attacks exploit high-frequency features, while robustness comes from low-frequency associations.