DARL framework tackles partial domain adaptation by selecting source instances for positive transfer.
problem Tackles the challenge of selecting source instances for positive transfer in partial domain adaptation.
method Proposes a Domain Adversarial Reinforcement Learning (DARL) framework that uses deep Q-learning and domain adversarial learning to select source instances and learn domain-invariant features.
result Demonstrates superior performance over existing methods for partial domain adaptation on several benchmark datasets.
Paper proposes USSAR and TNNAR for efficient activity recognition.
problem Efficiently annotate target domains with few labels.
method USSAR selects best source domains; TNNAR transfers knowledge.
result USSAR and TNNAR improve activity recognition accuracy.
Method selects optimal source domain for better cross-domain sentiment classification.
problem Improving sentiment classification on unseen domains with limited labeled data.
method Predictive measure based on distance functions between source and target domains.
result Significant improvement in cross-domain classification error compared to random selection.
Paper proposes a new method to aggregate multiple sources with different label distributions.
problem Aggregating from multiple target-shifted sources with different label distributions.
method Unified framework to select relevant sources for domain adaptation with limited label, unsupervised, and label partial unsupervised scenarios.
result Empirical results significantly outperform baselines.
TopoGeoScore selects robust checkpoints using only source-domain representations.
problem Selecting robust checkpoints without target-domain labels or samples.
method Constructs class-conditional mutual k-nearest-neighbour graphs and extracts three interpretable signals.
result Source representations contain measurable global-local-topological evidence of robustness.
RTNet uses both deep and pixel-level features for partial domain adaptation.
problem Selecting relevant source samples for knowledge transfer in partial domain adaptation.
method Reinforced Transfer Network (RTNet) with a reinforced data selector (RDS) and domain adaptation model.
result RTNet achieves state-of-the-art performance on benchmark datasets.
Study shows algorithms benefit from limited target data with many source domains.
problem Adapting to new domains with scarce labeled target data.
method New family of model selection algorithms.
result Beneficial guarantees in scenarios with limited target data.
Paper proposes a method to predict disk failures using multi-layer domain adaptive learning.
problem Traditional machine learning models struggle to predict disk failures due to limited data.
method Multi-layer domain adaptive learning with source and target domains.
result The proposed method improves failure prediction accuracy on disk data with few failure samples.
This work evaluates PDA methods without target labels, revealing significant accuracy drops.
problem Evaluating PDA methods without target labels and inconsistent experimental settings.
method Realistic evaluation of 7 PDA methods with 7 model selection strategies on 2 datasets.
result Accuracy drops up to 30 percentage points without target labels, only one method performs well.
Autoencoder selects relevant source samples for self-taught learning.
problem Negative transfer from irrelevant source samples.
method Autoencoder with ℓ2,1-norm sparsity constraint for relevance metric. result Promising results in expanded training set for classifier training.
Collaborative filtering (CF) aims to predict users' ratings on items according to historical user-item preference data. In many real-world applications, preference data are usually sparse, which would make models overfit and fail to give accurate predictions. Recently, several research works show that by transferring k…
SETrLUSI combines diverse knowledge from multiple domains for faster convergence.
problem Handling diverse knowledge from multiple domains in transfer learning.
method Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI).
result SETrLUSI accelerates convergence and outperforms related methods.
A framework isolates and learns approximately shared features for better domain adaptation.
problem Reducing performance degradation in unseen domains using machine learning models.
method Statistical framework distinguishing feature utilities based on correlation variance across domains. Learning approximately shared features from source tasks and fine-tuning on target tasks.
result Improved population risk compared to previous results on both source and target tasks, resolving the paradox of feature selection.
Proposes MDDA for multi-source domain adaptation.
problem Performance decay in deep neural networks due to domain shift between labeled and unlabeled data.
method Multi-source distilling domain adaptation (MDDA) network considering multiple source distributions and target similarities.
result Significantly outperforms state-of-the-art approaches on public DA benchmarks.
Framework for domain adaptation using pseudo-labels from unlabeled data.
problem Improving prediction accuracy in target domain with covariate shift.
method Kernel GLMs with labeled and pseudo-labeled data, using imputation model for target data.
result Non-asymptotic excess-risk bounds for effective labeled sample size.
Transfer learning significantly accelerates the reinforcement learning process by exploiting relevant knowledge from previous experiences. The problem of optimally selecting source policies during the learning process is of great importance yet challenging. There has been little theoretical analysis of this problem. In…
Selective pseudo-labeling improves unsupervised domain adaptation.
problem Classifying unlabeled target domain samples with labeled source domain samples.
method Structured prediction for selective pseudo-labeling.
result Selective pseudo-labeling outperforms state-of-the-art methods.
SKADA-bench evaluates unsupervised DA methods across diverse modalities.
problem Evaluating unsupervised DA methods on diverse modalities with realistic validation.
method Nested cross-validation and unsupervised model selection scores.
result Highlights the importance of realistic validation and provides practical guidance.
In domain adaptation, classifiers with information from a source domain adapt to generalize to a target domain. However, an adaptive classifier can perform worse than a non-adaptive classifier due to invalid assumptions, increased sensitivity to estimation errors or model misspecification. Our goal is to develop a doma…
Proposes DT-LET for better transfer learning between domains with different resolutions.
problem Transfer learning between domains with different resolutions often fails due to mismatched hidden layers.
method Develops DT-LET model to find the best matching layers for transfer based on high-level feature correspondence.
result DT-LET achieves superior results in cross-domain recognition/classification tasks, validating the necessity of layer correspondence searching.
Adaptive transfer learning model for varying mechanisms across domains.
problem Improving inference in a target domain by leveraging related source domains with varying mechanisms.
method Semi-parametric domain-varying coefficient model (DVCM) for structured transfer learning.
result Minimax rate-optimal adaptive transfer learning estimator with provable negative transfer safeguards.
Proposes a transfer learning method for high-dimensional quantile regression.
problem Inadequate handling of heterogeneity and heavy tails in transfer learning.
method High-dimensional quantile regression framework with double transfer learning estimator.
result Established error bounds and valid confidence intervals for high-dimensional quantile regression coefficients.
The paper proposes a method to test features selected by SeqFS-DA with controlled FPR.
problem Ensuring reliability of feature selection after domain adaptation in high-dimensional regression.
method Proposes a novel method to test features selected by SeqFS-DA with controlled FPR.
result The proposed method controls FPR below a significance level α (e.g., 0.05) and enhances statistical power. Domain adaptation (DA) addresses the real-world image classification problem of discrepancy between training (source) and testing (target) data distributions. We propose an unsupervised DA method that considers the presence of only unlabelled data in the target domain. Our approach centers on finding matches between sa…
In this paper, we propose a new feature selection method for unsupervised domain adaptation based on the emerging optimal transportation theory. We build upon a recent theoretical analysis of optimal transport in domain adaptation and show that it can directly suggest a feature selection procedure leveraging the shift …
Method selects task-specific neurons for unsupervised transfer learning.
problem Challenges in fine-tuning large language models for specific tasks.
method Selects important neurons for a specific classification task and extends to multi-source transfer learning.
result Higher similarity between task-specific fingerprints leads to better transferability.
Improves text classification on new domains using distance-based measures and dynamic domain selection.
problem Improving text classification performance on new domains with limited labeled data.
method Develops DistanceNet and DistanceNet-Bandit models using distance measures to adapt to new domains.
result DistanceNet and DistanceNet-Bandit models outperform baseline methods in unsupervised domain adaptation.
A new method transfers parameters in ELM networks using projective model.
problem Parameter transfer in extreme learning machine networks.
method Projective model to bridge source and target model parameters, L2,1-norm penalty for joint feature selection and parameter transfer.
result Significantly outperforms non-transfer ELM networks and other methods.
Transfer learning framework for fragility modeling under domain shift and class imbalance
problem Data gaps in structural fragility modeling
method Transfer learning
result Improves failure detection and predictive stability in low-data regimes
Paper tackles cold-start domain adaptation with language descriptions.
problem Cold-start domain adaptation failure with scarce target data.
method Leverages textual descriptions to learn preferences from LLM, integrates into EM algorithm.
result Framework guides source selection for weak target signals, improves as data accumulates.
KD improves DNN performance on unseen data without hyperparameter tuning.
problem Overfitting in DNNs on unseen data.
method Knowledge distillation for semi-supervised domain adaptation.
result KD achieves significantly higher WMH dice scores than baseline and ADA.
A new method combines multiple bounds and betting strategies for selective prediction, improving risk coverage in data-scarce settings.
problem Selective prediction with risk control in data-scarce domains.
method Combines concentration inequalities, multiple-testing corrections, and betting-based confidence sequences.
result Transfer-Informed Betting achieves tighter bounds and better coverage in data-scarce settings.
XMixup improves transfer learning accuracy by 1.9% with less training time.
problem Efficiently transfer knowledge from large source datasets to target tasks with small samples.
method Cross-domain Mixup technique that selects auxiliary samples from source datasets and augments training samples via mixup strategy.
result Improves accuracy by 1.9% on average over six real-world transfer learning datasets.
Unified framework for distribution shift estimation, explanation, and improvement.
problem Estimating, explaining, and improving model performance on target domains with distribution shift.
method Entropic Projection Alignment (EPA) aligns source and target distributions by matching moments and minimizing KL divergence.
result EPA consistently outperforms state-of-the-art baselines while offering computational efficiency.
Deep neural networks require a large amount of labeled training data during supervised learning. However, collecting and labeling so much data might be infeasible in many cases. In this paper, we introduce a source-target selective joint fine-tuning scheme for improving the performance of deep learning tasks with insuf…
Boundary effects inflate variance in Gaussian processes, leading to acquisition bias.
problem Boundary-induced acquisition bias in Gaussian processes.
method Traced root cause to geometric mechanism of kernel truncation at domain boundaries.
result Boundary effects create distortion that worsens with dimensionality, affecting acquisition behavior.
New framework tackles multi-source domain adaptation with optimism and consistency.
problem Adjusting mixture distribution weights and ensuring low error on target domain.
method Mildly optimistic objective function and consistency regularization.
result Beats current state of the art in multi-source domain adaptation.
A primer on domain adaptation methods for handling distribution shifts.
problem Handling distribution shifts between source and target datasets in machine learning.
method Four special cases: prior shift, covariate shift, concept shift, and subspace mapping.
result A coherent presentation of four important domain adaptation methods.
The paper proposes using a discriminator for both domain adaptation and pseudo labeling confidence.
problem Improving generalization of classifiers trained on labeled source data to unlabeled target data.
method Multi-purposing the discriminator to learn domain-invariant feature representations and generate pseudo labels based on confidence.
result The approach enhances classifier performance by providing confidence measures for pseudo labels.
New study reveals surprising adaptive rates in model selection for transfer learning.
problem Model selection in transfer learning with varying transfer distances.
method Theoretical analysis focusing on classification.
result Adaptive rates can be arbitrarily slower than oracle rates.
The paper provides a risk bound for unsupervised cross-domain mapping algorithms.
problem Theoretical support for unsupervised cross-domain mapping algorithms is lacking.
method Adversarial training methods based on IPMs and a novel risk bound.
result A risk bound that upper bounds the risk between learned and target mappings.
PAS method improves UDA by progressively refining subspaces for reliable pseudo-labels.
problem Mitigating mode collapse in unsupervised domain adaptation.
method Progressive Adaptation of Subspaces (PAS) approach.
result PAS effectively mitigates mode collapse and improves performance in UDA and PDA.
UniFeat is an open-source Java tool for feature selection.
problem Efficient feature selection in various research areas.
method Provides a set of advanced feature selection methods.
result Facilitates rapid development of new feature selection algorithms.
This work tackles robust multi-source domain adaptation under label shift.
problem Label shift and data contamination in multi-source domain adaptation.
method Domain-weighted empirical risk minimization framework with refinement procedure.
result The proposed method achieves superior performance in multi-category classification problems.
TASFAR adapts regression models without labeled source data.
problem Lack of labeled source data for domain adaptation.
method Uses prediction confidence to estimate target label distribution and calibrate source model.
result Substantially reduces errors in various regression tasks.
A new discrepancy method improves efficiency and accuracy in unsupervised domain adaptation.
problem Measuring the difference between source and target domains without labeled target data.
method Source-guided discrepancy (S-disc) that uses source domain labels for efficient computation and tighter generalization bounds.
result S-disc provides a tighter generalization error bound than existing discrepancies.
CWAN tackles multi-source heterogeneous domain adaptation with conditional weighting.
problem Learning cross-domain samples from multiple heterogeneous domains.
method CWAN uses a feature transformer, label classifier, and domain discriminator to learn from multiple sources.
result CWAN outperforms state-of-the-art methods on four real-world datasets.
Training-free source selection for LLM families with shared vocabularies
problem Source selection for LLM families with shared vocabularies
method Fisher alignment at vocabulary scale
result Fisher alignment is a cosine between kernel mean embeddings in the joint activation-error space