Selective pseudo-labeling improves unsupervised domain adaptation.
problem Classifying unlabeled target domain samples with labeled source domain samples.
method Structured prediction for selective pseudo-labeling.
result Selective pseudo-labeling outperforms state-of-the-art methods.
Improved segmentation model adaptation for new domains.
problem Reduced performance of pre-trained models on new domains.
method Calculated soft-label prototypes and predicted closest to class probabilities.
result Significant performance improvements on synthetic-to-real segmentation.
We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from pre-trained deep neural networks are transferable across related domains, domain adap…
TASFAR adapts regression models without labeled source data.
problem Lack of labeled source data for domain adaptation.
method Uses prediction confidence to estimate target label distribution and calibrate source model.
result Substantially reduces errors in various regression tasks.
Bayesian method matches uncertainty to adapt across domains.
problem Label distribution shift across domains degrades model performance.
method Bayesian neural network quantifies uncertainty; joint feature and label distribution matching.
result Improves model performance on domain adaptation tasks.
This work tackles robust multi-source domain adaptation under label shift.
problem Label shift and data contamination in multi-source domain adaptation.
method Domain-weighted empirical risk minimization framework with refinement procedure.
result The proposed method achieves superior performance in multi-category classification problems.
SFB uses stable features to adapt unstable ones for better performance.
problem Improving classifier performance on out-of-distribution data by leveraging stable features.
method SFB learns a predictor that separates stable and unstable features, then adapts unstable predictions using stable predictions.
result SFB can learn an asymptotically-optimal predictor without test-domain labels.
Domain knowledge helps detect adversarial examples in multi-label classification.
problem Detecting adversarial examples in multi-label classification.
method Convert domain knowledge into constraints and inject them into a semi-supervised learning problem.
result Domain-knowledge constraints help detect adversarial examples effectively.
Study shows cross-domain X-ray prediction performance discrepancies and label shifts.
problem Quantifying generalization limits across different X-ray datasets.
method Large-scale study on multiple X-ray datasets, focusing on performance and label shifts.
result Interesting discrepancies found between model performance and agreement, and concept similarity across tasks.
CAT improves domain adaptation for fault diagnosis by calibrating teacher network predictions.
problem Performance drops in deep learning models when applied to different data distributions.
method CAT uses post-hoc calibration techniques to calibrate predictions of the teacher network during self-training.
result CAT achieves state-of-the-art performance on most transfer tasks in domain-adaptive IFD.
Two approaches improve conformal Bayes for label shift, one post-hoc and one in-training.
problem Improving prediction sets for target domain under label shift.
method Two complementary approaches: post-hoc calibration and in-training adaptation.
result In-training adaptation achieves up to 43% width reduction at unchanged coverage.
Conformal Bayes under label shift: post-hoc calibration vs. in-training adaptation
problem Bayesian prediction sets under label shift
method Post-hoc calibration vs. In-training adaptation
result Both strategies achieve valid coverage equally in an unbiased training regime
Paper proposes a new method to aggregate multiple sources with different label distributions.
problem Aggregating from multiple target-shifted sources with different label distributions.
method Unified framework to select relevant sources for domain adaptation with limited label, unsupervised, and label partial unsupervised scenarios.
result Empirical results significantly outperform baselines.
Framework for domain adaptation using pseudo-labels from unlabeled data.
problem Improving prediction accuracy in target domain with covariate shift.
method Kernel GLMs with labeled and pseudo-labeled data, using imputation model for target data.
result Non-asymptotic excess-risk bounds for effective labeled sample size.
Proposes a regularization method for unsupervised domain adaptation that aligns predictions with target data's top singular vectors.
problem Domain adaptation challenges in high joint error scenarios.
method Regularizes classifier to align with unsupervised target data guided by label alignment property (LAP).
result The method improves performance in MNIST-USPS domain adaptation and cross-lingual sentiment analysis.
Paper tackles backwards-compatible data adaptation for confounded covariate and label shifts.
problem Adapt covariates to predict labels confounded with covariate shifts.
method Proposes confounded shift framework based on minimizing divergence between source and target conditional distributions, conditioning on confounders.
result Demonstrates approach on synthetic and real datasets, achieving backwards-compatible data adaptation.
Approach for biosensor condition detection using domain adaptation.
problem Limited clinical data for biosensor condition detection.
method Teacher-student adaptation of deep learning models.
result Significantly outperforms other methods on synthetic and real-world datasets.
ELSA efficiently adapts to label shift without post-prediction calibrations.
problem Domain adaptation with label shift across training and testing datasets.
method Moment-matching framework based on influence function geometry; solves linear systems for adaptation weights.
result ELSA estimator is n \sqrt{n} n -consistent and asymptotically normal, achieving state-of-the-art estimation performance. We study the task of unsupervised domain adaptation, where no labeled data from the target domain is provided during training time. To deal with the potential discrepancy between the source and target distributions, both in features and labels, we exploit a copula-based regression framework. The benefits of this approa…
Transformer models show robustness across domains with domain adversarial training.
problem Domain adaptation from multiple sources with no labeled data.
method Domain adversarial training and mixture of experts.
result Domain adversarial training improves representation but not performance.
Predicts student outcomes in real-time using domain adaptation.
problem Real-time student performance prediction in online courses.
method GritNet architecture with unsupervised domain adaptation.
result GritNet enhances real-time predictions, especially in early weeks.
Proposes a new approach for domain adaptation using latent representations.
problem Handling distribution shifts between source and target domains in high-dimensional data.
method Learn compact latent representations based on the label's Markov blanket, partitioning into parents, children, and spouses.
result General domain adaptation can be achieved by learning representations of the label's parents, children, and spouses.
Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited labeled data to improve the prediction performance. We propose a Bayesian transfer…
The paper proposes a method to adapt models from source to target domains by calibrating their predictive uncertainties.
problem Inferring class labels for unlabeled target domain given a related labeled source dataset.
method The approach involves calibrating predictive uncertainties quantified as Renyi entropy, using variational Bayes learning and sample variance regularization.
result The proposed method effectively adapts models across three domain-adaptation tasks.
Paper proposes zero-shot transfer learning for semantic parsing.
problem Applying neural networks to tasks with little data remains challenging.
method Introduces a new method for learning shared space between domains based on domain label prediction.
result Method outperforms state-of-the-art techniques in zero-shot experimental setting.
Causal inference is similar to prediction with treatment bias.
problem Generalizing from labeled to unlabeled data with treatment effects.
method Reframing causal inference as a prediction problem with explicit assumptions.
result Causal assumptions are not uniquely strong but more explicit.
Harmonization schemes limit accuracy due to domain information.
problem Harmonization schemes lead to inaccurate predictions due to domain information.
method Analysis of mutual information and real label value informativeness.
result Accuracy is limited by the domain with least information.
A new method improves label propagation for unsupervised domain adaptation.
problem Improving unsupervised domain adaptation through semi-supervised learning techniques.
method Label Propagation with Augmented Anchors (A 2 ^2 2 LP) for UDA. result A 2 ^2 2 LP improves over representative UDA methods and benchmarks. Proposes a new approach to MSDA by introducing latent covariate shift to handle varying label distributions.
problem Challenges of conventional MSDA approaches in real-world settings where label distributions vary across domains.
method Introduces latent covariate shift (LCS) and a causal generative model with latent noises, latent content variable, and latent style variable.
result Identifies latent content variable up to block identifiability, enabling more nuanced label distribution recovery.
LangDA improves domain adaptation for semantic segmentation by learning context-aware scene descriptions.
problem Improving domain adaptation for semantic segmentation with dense prediction tasks.
method LangDA learns contextual relationships between objects via VLM-generated scene descriptions and aligns image features with text representation.
result LangDA sets new state-of-the-art across three DASS benchmarks, outperforming existing methods.
Improves reliability of medical diagnosis uncertainty estimates.
problem Label uncertainty in medical diagnosis.
method Post-hoc a l p h a alpha a l p ha -calibration method for neural network classifiers. result Significantly enhances reliability of uncertainty estimates.
This paper tackles UDA by learning domain-invariant embeddings using distribution alignment and pseudo-labels.
problem Unsupervised domain adaptation between two visual domains.
method Shared deep encoder, Sliced-Wasserstein Distance, deep classifier, pseudo-labels for class alignment.
result Effective solution for training deep classification networks on source domain to generalize to target domain.
Improves unsupervised domain adaptation methods by aligning class conditional distributions.
problem Domain shift between source and target domains makes supervised learning models fail to generalize.
method Co-regularized domain alignment, creating multiple feature spaces and aligning them individually while encouraging agreement across class predictions.
result Significant performance improvements on domain adaptation benchmarks.
Algorithm constructs prediction sets with PAC guarantees in label shift settings.
problem Reliable uncertainty quantification in the face of distribution shift.
method Estimates predicted probabilities and confusion matrix, then propagates uncertainty through Gaussian elimination to compute confidence intervals and construct prediction sets.
result Satisfies PAC guarantees and produces smaller, more informative prediction sets.
We present CROSSGRAD, a method to use multi-domain training data to learn a classifier that generalizes to new domains. CROSSGRAD does not need an adaptation phase via labeled or unlabeled data, or domain features in the new domain. Most existing domain adaptation methods attempt to erase domain signals using technique…
Real-time student performance prediction without historical data.
problem Predict student performance in real-time with limited historical data.
method Domain adaptation framework using GritNet architecture with unsupervised transfer learning.
result GritNet generalizes well across different courses and enhances predictions in the early stages.
CPATTA uses conformal prediction for efficient test-time adaptation.
problem Low data selection efficiency in existing ATTA methods.
method Conformal Prediction, online weight-update algorithm, domain-shift detector, staged update scheme.
result CPATTA consistently outperforms state-of-the-art methods by 5% in accuracy.
Paper tackles stance detection across domains using adversarial domain adaptation.
problem Stance detection in different domains is costly and tedious.
method Adversarial domain adaptation for stance detection.
result Model effectively transfers knowledge for accurate stance detection across domains.
Paper improves bike-sharing demand prediction by adapting to changing patterns.
problem Improving bike-sharing demand prediction under temporal domain shifts.
method Gen-ROTDA, a robust optimal transport-guided residual domain adaptation framework.
result Gen-ROTDA achieves the lowest MAE and is the best OT-family method on average.
Anytime-valid confirmation of label-shift corrections
problem Small-batch scientific deployments with scarce labeled outcomes
method Conditional e-value and martingale-based rule
result Nonnegative martingale and anytime-valid confirmation rule
FinALBERT predicts stock prices using labelled Stocktwits data.
problem Efficient stock price prediction with limited labelled datasets.
method FinALBERT is an ALBERT-based model trained on labelled Stocktwits data for financial text classification.
result FinALBERT achieves optimal results in predicting stock price changes.
DAPDAG learns DAG structure to adapt predictions across domains.
problem Predicting in a new domain without labeled data.
method Auto-encoder with DAG reconstruction as auxiliary task.
result Reconstructing DAG benefits approximate inference and prediction.
Graph-based multi-label classifier extends CULP for multi-label data.
problem Solving multi-label classification problems.
method Extends CULP algorithm to handle multi-label data.
result Competitive results compared to cutting-edge multi-label classifiers.
AutoElicit uses LLMs to quickly create expert priors for predictive models.
problem Creating accurate priors for predictive models is time-consuming and costly.
method AutoElicit extracts knowledge from LLMs to construct priors for predictive models.
result AutoElicit yields priors that reduce error and save labelling effort.
AI agent predicts industry and product/service codes for companies.
problem Manual curation of company data is expensive and prone to errors.
method Hierarchical multi-class industry code classifier with multi-label product/service code classifier.
result High accuracy (92-96%) achieved with limited labeled data.
Constraint-based learning reduces the burden of collecting labels by having users specify general properties of structured outputs, such as constraints imposed by physical laws. We propose a novel framework for simultaneously learning these constraints and using them for supervision, bypassing the difficulty of using d…
Enhances adversarial robustness with unlabeled out-of-domain data.
problem Improving robustness of models against adversarial attacks.
method Leveraging unlabeled data from multiple domains to bridge the sample complexity gap in adversarial robustness.
result Better adversarial robustness achieved when unlabeled data comes from a shifted domain.
UTS improves DNN uncertainty calibration without labels, robust to domain shift.
problem Improving uncertainty calibration of DNNs under domain shift.
method UTS uses unlabeled test samples and a novel weighted NLL loss function.
result UTS outperforms other methods in domain shift scenarios.