Paper tackles efficient risk estimation under dataset shift conditions.
problem Limited data from target population; auxiliary data available.
method Semiparametric efficiency theory; efficient and multiply robust estimators.
result Developed estimators for various dataset shift conditions.
Graphs models are vulnerable to distribution shifts, which this work explains and mitigates.
problem Graph Neural Networks (GNNs) are susceptible to distribution shift, leading to performance degradation.
method Theoretical analysis quantifying conditional shift, proposing an approach to estimate and minimize it.
result The proposed approach demonstrates up to 10% absolute ROC AUC improvement under various distribution shifts.
New CPS model tackles conditional probability shift in machine learning.
problem Discrepancy between source and target distributions in machine learning.
method Conditional Probability Shift Model (CPSM) using multinomial regression and EM algorithm.
result Superior balanced classification accuracy on target data compared to existing methods.
The classical shift retrieval problem considers two signals in vector form that are related by a shift. The problem is of great importance in many applications and is typically solved by maximizing the cross-correlation between the two signals. Inspired by compressive sensing, in this paper, we seek to estimate the shi…
This paper rethinks confidence calibration under covariate shifts.
problem Calibration methods struggle with covariate shifts and unstable importance weighting.
method Derives Expectation consistency condition and proposes Expectation consistency loss (ECL).
result ECL loss is compatible with various types of calibration and has the same sample complexity as ECE.
Corrects distribution shift in target shift scenarios using importance weighting.
problem Analyzes importance weighting for correcting distribution shift under target shift.
method Analyzed importance-weighted kernel ridge regression under target shift.
result Shows that importance weighting corrects the train-test mismatch without altering input-space complexity.
ShapShift explains shifts in model predictions due to data distribution changes.
problem Prediction shifts caused by changes in input distribution.
method Subgroup Conditional Shapley Values applied to decision trees and ensembles.
result Simple, faithful, and near-complete explanations of prediction shifts across model classes.
New dataset for industrial machine malfunction detection with domain shifts.
problem Challenges in detecting anomalies due to domain shifts in industrial sounds.
method Created a dataset with domain shifts for five types of industrial machines.
result Significant performance differences between source and target domains.
The paper addresses the reliability of conformal prediction under covariate shift.
problem Ensuring reliable prediction sets under covariate shift.
method Derives upper bounds on training-conditional coverage.
result Offers PAC guarantees for conformal prediction methods.
Paper tackles backwards-compatible data adaptation for confounded covariate and label shifts.
problem Adapt covariates to predict labels confounded with covariate shifts.
method Proposes confounded shift framework based on minimizing divergence between source and target conditional distributions, conditioning on confounders.
result Demonstrates approach on synthetic and real datasets, achieving backwards-compatible data adaptation.
DeepCCG adapts classifiers to representation shifts in one step.
problem Adapting classifiers to shifts in continuous representation.
method Empirical Bayesian approach using class conditional Gaussian classifier and KL divergence for selection.
result DeepCCG reduces performance change due to representation shifts.
Detects which features have shifted in data distributions.
problem Identifying which specific features have caused a distribution shift.
method Formalizes the problem as multiple conditional distribution hypothesis tests, proposes non-parametric and parametric statistical tests, and uses a test statistic based on the density model score function.
result Demonstrates methods for identifying when and where a shift occurs in multivariate time-series data.
DCASE 2022 Task 2 tackles domain shifts in ASD for machine condition monitoring.
problem Domain shifts change acoustic characteristics, affecting ASD performance.
method Domain generalization techniques to detect anomalies across unknown domains.
result Two types of domain generalization techniques were identified and analyzed.
A new method detects distribution shifts faster than existing CTMs.
problem Detecting distribution shifts in data streams with contamination issues.
method Uses a fixed reference dataset to compare each new sample, avoiding contamination.
result Detects distribution shifts faster and more reliably than standard CTMs.
Method identifies shifts leading to large model performance differences.
problem Detecting shifts in distribution that affect model performance.
method Parametric changes in causal mechanisms define robustness sets; worst-case optimization problem approximated as non-convex quadratic.
result Second-order approximation of worst-case loss for small shifts, leading to efficient algorithms.
The paper explores rigidity of hypersurfaces with constant shifted curvature functions in hyperbolic space.
problem Rigidity of hypersurfaces with constant shifted curvature functions in hyperbolic space.
method Characterizations and rigidity investigations for hypersurfaces with constant weighted shifted mean curvatures or ratios.
result Rigidity results for hypersurfaces with constant linear combinations of weighted shifted mean curvatures and radially symmetric shifted mean curvatures.
The study diagnoses fairness issues in healthcare models under distribution shifts.
problem Understanding and diagnosing fairness changes in machine learning models under distribution shifts in healthcare.
method Causal framing and conditional independence tests to characterize distribution shifts.
result Knowledge of distribution shifts helps diagnose fairness transfer failures, including complex cases.
New insights into how high-dimensional models handle covariate shifts.
problem Covariate shift in high-dimensional random feature regression.
method Exact high-dimensional asymptotics of random feature regression under covariate shift.
result Overparameterized models exhibit enhanced robustness to covariate shift.
Audited Conformal Prediction improves conditional coverage in pretrained models under distribution shift.
problem Uncertainty quantification for pretrained models under unknown distribution shift
method Leverages a small labeled dataset to train an audit model for marginal coverage, integrates outputs into conformal prediction framework
result Significantly higher conditional coverage than existing approaches
SJS model predicts label shifts in multinomial datasets.
problem Predicting label shifts in multinomial datasets.
method Sparse joint shift model for dataset shift.
result Valid predictions and class prior probabilities estimates.
Defines strongest integrability condition for skew-symmetric endomorphisms.
problem Integrability conditions for skew-symmetric endomorphisms.
method Characterization of the shifted Courant-Nijenhuis torsion.
result Vanishing of the shifted Courant-Nijenhuis torsion as the strongest integrability condition.
Estimates calibration error under label shift without labels.
problem Ensuring model reliability in the face of dataset shift without access to labels.
method Importance re-weighting of the labeled source distribution to estimate calibration error under label shift.
result Effective and reliable CE estimation with respect to the shifted target distribution.
RLSbench benchmarks domain adaptation under label proportion shifts, revealing widespread failures and proposing a two-step meta-algorithm.
problem Domain adaptation under label proportion shifts is poorly understood and inconsistent across methods.
method RLSbench introduces a large-scale benchmark with 500 distribution shift pairs. It proposes a two-step meta-algorithm to improve domain adaptation methods under label proportion shifts.
result The two-step meta-algorithm improves domain adaptation methods by 2-10% accuracy points under large label proportion shifts.
The Grassmannian model represents harmonic maps from Riemann surfaces by families of shift-invariant subspaces of a Hilbert space. We impose a natural symmetry condition on the shift-invariant subspaces that corresponds to considering an important class of harmonic maps into symmetric and k-symmetric spaces. In parti…
Unified framework certifies predictor performance under distribution shift.
problem Certifying predictor performance under distribution shift.
method Unified framework with explicit inequalities, sound verification, and identifiable structure.
result Explicit upper bound on excess risk under shift.
OpFlow predicts robust OD flows by learning choice potentials conditioned on spatial exposures.
problem Deep models trained on raw counts are vulnerable to distribution shift.
method OpFlow learns row-centered choice potentials and reconstructs flows by combining them with a calibrated origin scale.
result OpFlow improves robustness under environment shifts, as shown by controlled synthetic shifts and a real-world experiment.
DRCD identifies causal direction between continuous and discrete variables using density ratio monotonicity.
problem Inferring causal direction between continuous and discrete variables from observational data.
method Density Ratio-based Causal Discovery (DRCD) method.
result DRCD identifies causal direction between continuous and discrete variables using density ratio monotonicity.
MIRRAMS framework tackles robust tabular learning under unseen missingness shifts.
problem Challenges in achieving robust predictive performance due to shifts in missingness distribution between training and test inputs.
method Introduces MI robustness conditions and MIRRAMS framework to enforce these conditions without specific missingness assumptions.
result Consistently outperforms existing state-of-the-art baselines and maintains stable performance under diverse missingness conditions.
Study reveals differences in label shift problem difficulty in supervised vs. unsupervised settings.
problem Label shift problem in non-parametric classification.
method Analysis of minimax rates in supervised and unsupervised settings, focusing on class conditional distributions estimation.
result A class proportion estimation approach is minimax rate-optimal in the unsupervised setting.
New methods boost first-order optimization with faster rates.
problem Designing efficient first-order methods for convex problems.
method Shifted objective function with interpolation condition.
result New schemes achieve faster convergence rates.
Unified view of label shift estimation methods.
problem Label distribution changes but class-conditional distributions remain the same.
method Unified view of two approaches: BBSE and MLLS.
result Unified framework and theoretical characterization of MLLS.
This paper explores conditions for neural networks to extrapolate to new domains.
problem Understanding when neural networks can extrapolate to unseen domains.
method Analyzes conditions for nonlinear models to extrapolate under specific distribution shifts.
result Neural networks of the form f(x)=∑fi(xi) can extrapolate if feature covariance is well-conditioned. Bayes predictor remains robust to ignorable missingness shifts.
problem Challenges in prediction with missing covariates and shifts in missingness reasons.
method Bayesian approach and different prediction methods.
result Bayes predictor remains unchanged by ignorable shifts, but robust prediction requires disregarding missingness for non-ignorable shifts.
Introduces derived Lie n-groupoids with shifted symplectic structures.
problem Defines structures for higher groupoids and their symplectic properties.
method Introduced derived Lie n-groupoids and their shifted symplectic structures, defining shifted lagrangian structures and proving composition well-defined.
result Shows that the framework includes various reduction procedures.
Optimal transport aligns source and target distributions for domain adaptation.
problem Unsupervised domain adaptation with joint class-conditional and label shifts.
method Minimizes importance weighted loss and Wasserstein distance for aligned marginals and class-conditional distributions.
result Our method outperforms competitors on various domain adaptation tasks.
We describe a pair of invariants for actions of finite groups on shifts of finite type, the left-reduced and right-reduced shifts. The left-reduced shift was first constructed by U. Fiebig, who showed that its zeta function is an invariant, and in fact equal to the zeta function of the quotient dynamical system. We als…
New algorithm mitigates misspecification amplification in regression models with covariate shift.
problem Distribution shift and model misspecification in regression models.
method Developed a new algorithm inspired by robust optimization to avoid misspecification amplification.
result No misspecification amplification while still achieving optimal statistical rates.
In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift adaptation. We prove that sparse filtering can perform adaptation only if the conditional…
Proposes SGShift to identify shifted features causing model performance degradation under concept shift.
problem Concept shift leading to miscalibration in ML models across domains.
method SGShift method for identifying sparse set of shifted features using feature selection and statistical tools.
result SGShift identifies shifted features more accurately than baseline methods, requires few samples in the shifted domain, and is robust to complex cases.
Paper proposes SJS model to estimate model performance under covariate and label shifts.
problem Estimating model performance when both covariates and labels shift.
method Sparse Joint Shift (SJS) model and SEES algorithm.
result SEES achieves significant shift estimation error improvements over existing approaches.
Study optimal ridge regularization for out-of-distribution prediction.
problem Optimal ridge regularization for predicting out-of-distribution data.
method Established conditions for optimal regularization under covariate and regression shifts, proving monotonic risk in data aspect ratio.
result Negative regularization can be optimal under shifts, even with isotropic or underparameterized training features.
The paper proves existence of horo-convex hypersurfaces in hyperbolic space with specific curvature conditions.
problem Existence of horo-convex hypersurfaces with prescribed shifted Gauss curvatures in hyperbolic space.
method Existence result obtained via standard degree theory based on a prior estimates for solutions to the prescribed shifted Gauss curvature equations.
result Existence of horo-convex hypersurfaces in hyperbolic space under certain conditions.
This paper introduces LR-FFS for robust feature screening in federated learning under label shift.
problem Label shift challenges in federated learning for high-dimensional classification.
method Unified feature screening framework, label-shift robust federated feature screening (LR-FFS), federated estimation procedure.
result LR-FFS outperforms existing methods in diverse client environments with varying class distributions, sample sizes, and missing data.
Newtonian dynamical systems which accept the normal shift on an arbitrary Riemannian manifold are considered. For them the determinating equations making the weak normality condition are derived. The expansion for the algebra of tensor fields is constructed.
New method disentangles latent subspaces under correlation shifts.
problem Correlations between factors of variation make disentanglement models less robust.
method Enforces independence between subspaces conditioned on available attributes using adversarial CMI minimization.
result Models are disentangled and robust under correlation shifts, including in weakly supervised settings.
Faced with distribution shift between training and test set, we wish to detect and quantify the shift, and to correct our classifiers without test set labels. Motivated by medical diagnosis, where diseases (targets) cause symptoms (observations), we focus on label shift, where the label marginal p(y) changes but the …
FLUXtrapolation benchmarks machine learning for extrapolating ecosystem fluxes under distribution shifts.
problem Machine learning challenges in extrapolating ecosystem fluxes under distribution shifts.
method Defined temporal, spatial, and temperature-based extrapolation scenarios; evaluated performance across domains, temporal aggregations, and tail errors.
result Baselines perform similarly under median hourly RMSE but differ under tail-focused and multi-scale evaluations.
Paper tackles CATE estimation with missing treatment info.
problem Challenges in estimating CATE with missing treatment information.
method Developed MTRNet, a novel CATE estimation algorithm using domain adaptation.
result Improves CATE estimation over state-of-the-art methods.