New approach models how explanations shift with distribution changes.
problem Model performance drops with changing input data distributions.
method Models explanation shifts and compares them to state-of-the-art techniques.
result Modeling explanation shifts better detects out-of-distribution behavior.
Unified framework certifies predictor performance under distribution shift.
problem Certifying predictor performance under distribution shift.
method Unified framework with explicit inequalities, sound verification, and identifiable structure.
result Explicit upper bound on excess risk under shift.
This research examines how model explanations change under distribution shifts in tabular data.
problem Detecting distribution shifts in tabular data affecting model performance and explanations.
method Investigates the relationship between model performance and explanation characteristics under distribution shifts.
result Explanation shifts are a better indicator for detecting predictive performance changes than traditional distribution shift techniques.
Paper tackles high-dimensional quantile regression with distribution shift using transfer learning.
problem Efficiency of knowledge transfer is severely impacted by distribution shift in high-dimensional regression.
method Proposes a novel transferable set and framework for three types of distribution shift: parameter, covariate, and residual.
result Establishes estimation error bounds and source detection consistency for the proposed method.
This work evaluates graph models' robustness to structural distributional shifts.
problem Evaluating graph models' robustness to structural distributional shifts.
method Proposes a general approach for inducing diverse distributional shifts based on graph structure.
result Simple models often outperform more sophisticated methods on structural distributional shifts.
A new policy for contextual bandits adapts to reward vector shifts.
problem Learning under reward vector shifts with ordered rewards.
method Adaptive-discretization and optimistic elimination policy.
result Established upper bounds on preference-based regret.
Paper proposes SJS model to estimate model performance under covariate and label shifts.
problem Estimating model performance when both covariates and labels shift.
method Sparse Joint Shift (SJS) model and SEES algorithm.
result SEES achieves significant shift estimation error improvements over existing approaches.
Paper proposes a framework to detect distribution shifts using embedding space geometry.
problem Detecting distribution shifts in candidate datasets to improve model generalizability.
method Non-parametric framework using embedding space geometry for two tests: robustness boundary and in-distribution/out-of-distribution classification.
result Both tests successfully detect distribution shifts in various scenarios for both synthetic and real-world datasets.
AdapTable adapts tabular models to shifts without source data, improving HELOC performance.
problem Distribution shifts in tabular data threaten model performance.
method Shift-aware uncertainty calibrator and label distribution handler.
result Up to 16% improvement on HELOC dataset.
New perspective on distribution shift helps make learning easier.
problem Learning with different training and target distributions.
method Formalizing and exploring Positive Distribution Shift (PDS).
result Distribution shift can be positive, making learning easier.
Study evaluates methods for improving model robustness to various real-world distribution shifts.
problem Improving model robustness to real-world distribution shifts like geographic changes.
method Introduced new datasets and evaluated existing methods on four types of shifts (style, blurriness, location, camera operation).
result Data augmentations and larger models can improve robustness on real-world distribution shifts, contrary to prior claims.
New CPS model tackles conditional probability shift in machine learning.
problem Discrepancy between source and target distributions in machine learning.
method Conditional Probability Shift Model (CPSM) using multinomial regression and EM algorithm.
result Superior balanced classification accuracy on target data compared to existing methods.
Study shows current image classification models lack robustness to real-world dataset shifts.
problem Robustness of current image classification models to natural distribution shifts in real datasets.
method Evaluation of 204 ImageNet models in 213 different test conditions.
result Little to no transfer of robustness from synthetic to natural distribution shifts.
Extends FJS analysis to general label spaces, including classification and regression.
problem Distribution shift in general label spaces, including covariate and label shifts.
method Proposes a framework for analyzing FJS in general label spaces and generalizes existing results.
result Generalizes FJS analysis to general label spaces, including classification and regression.
Graphs models are vulnerable to distribution shifts, which this work explains and mitigates.
problem Graph Neural Networks (GNNs) are susceptible to distribution shift, leading to performance degradation.
method Theoretical analysis quantifying conditional shift, proposing an approach to estimate and minimize it.
result The proposed approach demonstrates up to 10% absolute ROC AUC improvement under various distribution shifts.
Unsupervised learning representations generalize better than supervised learning under distribution shifts.
problem Robustness of unsupervised representations to distribution shift.
method Extensive evaluation on synthetic and realistic datasets, including controllable domain generalization datasets.
result Unsupervised representations learned from SSL and AE generalize better than supervised learning under various distribution shifts.
Develops estimators for near-optimal linear regression under distribution shift.
problem Linear regression under distribution shift with scarce target domain data.
method Minimax linear risk estimators covering various transfer learning settings.
result Achieves near-optimal risk for linear regression problems under distribution shift.
Unified learning bound for covariate and concept shifts.
problem Generalization under distribution shift in machine learning.
method Support-agnostic definitions of covariate and concept shifts using entropic optimal transport, leading to a unified error bound applicable to various loss functions and label spaces.
result Development of estimators for shifts with concentration guarantees and the DataShifts algorithm for quantifying and estimating the error bound.
Combines adversarial and interventional robustness for machine learning models.
problem Designing robust models for distribution shifts in machine learning.
method RISe formulation using distributionally robust optimization.
result Demonstrates efficacy of RISe approach with synthetic and real-world datasets.
STAD adapts models to evolving time-based data shifts.
problem Gradual distribution shifts over time challenge existing test-time adaptation methods.
method Bayesian filtering method that learns time-varying dynamics in hidden features.
result STAD excels in handling small batch sizes and label shift on real-world data.
Paper develops a new method to improve model calibration under distribution shifts.
problem Challenges in uncertainty quantification with different training and test distributions.
method Develops multi-domain temperature scaling to handle distribution shifts.
result Outperforms existing methods on in-distribution and out-of-distribution test sets.
New method learns distribution shifts caused by predictive models in social computing.
problem Learning distribution shifts due to predictive models in social computing.
method Reverse causal model with microfoundation for agents' actions.
result Effective in minimizing performative prediction risk.
This paper improves conformal prediction for robust interval estimation under distribution shifts.
problem Robustness of conformal prediction under distribution shifts.
method Modeling distribution shifts using Levy-Prokhorov (LP) ambiguity sets, which capture both local and global perturbations.
result Constructs robust conformal prediction intervals that remain valid under distribution shifts.
The study diagnoses fairness issues in healthcare models under distribution shifts.
problem Understanding and diagnosing fairness changes in machine learning models under distribution shifts in healthcare.
method Causal framing and conditional independence tests to characterize distribution shifts.
result Knowledge of distribution shifts helps diagnose fairness transfer failures, including complex cases.
Paper tackles online adaptation to changing label distributions.
problem Adapting machine learning models to changing label distributions in real-world settings.
method Leverages novel analysis to show estimation of expected test loss is possible without true labels. Proposes adaptation algorithms inspired by classical online learning techniques.
result Empirically verified that OGD is particularly effective and robust to various label shift scenarios.
Study addresses RTB model performance drops due to distribution shifts.
problem Distribution shifts between training and target environments in RTB markets.
method Applies Exponential Tilt Reweighting Alignment (ExTRA) algorithm to estimate and correct model weights.
result Demonstrates improved RTB model performance using ExTRA algorithm.
Proposes a new measure to evaluate stability of statistical parameters under distributional shifts.
problem Difficulty in transferring knowledge across data sets due to distributional changes.
method Introduces a measure of instability quantifying sensitivity of statistical parameters to Kullback-Leibler divergence and directional shifts.
result The proposed measure can elucidate the type of shifts a parameter is sensitive to and improve estimation accuracy under shifted distributions.
Proposes FSM-IRL to learn invariant network representations considering feature and structural shifts.
problem Spatial heterogeneity and temporal dynamics lead to OOD generalization issues in geographic networks.
method Introduces FSM-IRL model that accounts for feature and structural distribution shifts using causal attention and reweighting.
result Demonstrates strong learning capabilities on geographic and social network datasets in OOD scenarios.
Paper tackles robust federated learning for affine distribution shifts.
problem Statistical heterogeneity and distribution shifts degrade model performance in federated learning.
method Develops a robust federated learning algorithm (FLRA) for affine distribution shifts.
result FLRA achieves significant performance gains against affine distribution shifts.
Research tackles distribution shift issues in ML to improve AI reliability.
problem Distribution shift limits ML reliability and trustworthiness.
method Study three distribution shifts (perturbation, domain, modality) and investigate robustness, explainability, adaptability.
result Proposes effective solutions and fundamental insights for enhancing ML robustness, adaptability, and safety.
RIA method improves OoD generalization for covariate shift.
problem Improving out-of-distribution generalization under covariate shift.
method Adversarial label invariant graph data augmentations for OoD generalization.
result RIA method achieves high accuracy compared to OoD baselines.
Paper proposes a new regularization method to prevent model degradation under distribution shifts.
problem Model performance degrades under distribution shifts.
method Supervised contrastive learning with heterogeneous similarity.
result The proposed method outperforms existing regularization methods on benchmark datasets.
New insights into how high-dimensional models handle covariate shifts.
problem Covariate shift in high-dimensional random feature regression.
method Exact high-dimensional asymptotics of random feature regression under covariate shift.
result Overparameterized models exhibit enhanced robustness to covariate shift.
Proxy methods adapt to distribution shifts without explicitly modeling latent confounders.
problem Adapting to distribution shifts under latent variable confounding.
method Proximal causal learning, two-stage kernel estimation.
result Proxy methods outperform other methods in adapting to complex distribution shifts.
New framework identifies worst-case shifts for predictive resource allocation models.
problem Identifying harmful shifts in predictive models for resource allocation.
method Hierarchical model structure and submodular optimization for worst-case loss.
result Empirical evidence shows divergent worst-case shifts identified by different metrics.
EvoMSN tackles time series forecasting under distribution shifts by evolving multi-scale normalization.
problem Accurate long-term time series forecasting under complex distribution shifts.
method EvoMSN framework with multi-scale statistics prediction and adaptive ensembling for collaborative updating.
result Improves forecasting performance of five mainstream methods on benchmark datasets.
Paper shows fairness and domain adaptation can work together.
problem Algorithmic bias and distributional shifts in ML models.
method Leveraging fairness and distribution shifts, the paper shows how domain adaptation methods can mitigate bias.
result Enforcing individual fairness can improve out-of-distribution accuracy under covariate shift.
Method improves simulation accuracy by mitigating distribution shift in hybrid systems.
problem Mitigating distribution shift in machine-learning augmented hybrid simulation.
method Tangent-space regularized estimator to control distribution shift.
result Marked improvements in simulation accuracy, especially for systems with high distribution shift.
Corrects distribution shift in target shift scenarios using importance weighting.
problem Analyzes importance weighting for correcting distribution shift under target shift.
method Analyzed importance-weighted kernel ridge regression under target shift.
result Shows that importance weighting corrects the train-test mismatch without altering input-space complexity.
Detects which features have shifted in data distributions.
problem Identifying which specific features have caused a distribution shift.
method Formalizes the problem as multiple conditional distribution hypothesis tests, proposes non-parametric and parametric statistical tests, and uses a test statistic based on the density model score function.
result Demonstrates methods for identifying when and where a shift occurs in multivariate time-series data.
A new method detects distribution shifts faster than existing CTMs.
problem Detecting distribution shifts in data streams with contamination issues.
method Uses a fixed reference dataset to compare each new sample, avoiding contamination.
result Detects distribution shifts faster and more reliably than standard CTMs.
Analysis of ridge regression under concept shift reveals nontrivial effects on generalization performance.
problem Understanding and mitigating the impact of distribution shift in machine learning models.
method Derivation of exact prediction risk expression in the thermodynamic limit for ridge regression under concept shift.
result Reveals a phase transition and nonmonotonic data dependence of test performance under concept shift.
New method robust to random distributional shifts in prediction.
problem Random distributional shifts in real-world settings.
method Hybrid approach combining long-term and proxy outcomes.
result Hybrid approach yields lower mean-squared error than current methods.
This work introduces a method to attribute model performance drops to distribution shifts.
problem Attributing performance drops of machine learning models to distribution shifts.
method Formulated as a cooperative game, value of a set of distributions is defined as the change in model performance when only that set of distributions changes. Importance weighting method for computing the value of an arbitrary set of distributions is derived. Quantifying the contribution of each distribution as its Shapley value.
result Demonstrated the effectiveness of the method on various case studies.
Proposes MSS to identify causal structure from heterogeneous environments.
problem Distribution shifts between environments violate i.i.d. data assumption.
method Sparse mechanism shift hypothesis, score-based approach.
result Identifies entire causal structure with high probability.
Bayesian framework improves uncertainty estimates under covariate shifts.
problem Neural networks' unreliable uncertainty estimates under covariate shifts.
method Adaptive prior conditioned on training and new covariates, amortized variational inference.
result Significantly improved uncertainty estimates under distribution shifts.
New framework optimizes label shift adaptation using aligned distribution mixture.
problem Label shift where source and target label distributions differ.
method Aligned Distribution Mixture (ADM) framework, incorporating insights from generalization theory.
result The ADM framework improves four typical label shift methods and introduces a one-step approach.
This paper tackles distribution shift in model-based offline RL, proposing a shifts-aware reward method.
problem Distribution shift challenges model-based offline RL by distorting value estimation and policy optimization.
method The paper disentangles the problem into model bias and policy shift, proposing a shifts-aware reward through probabilistic inference.
result The proposed shifts-aware reward method effectively mitigates distribution shift and improves policy optimization.