Framework transfers knowledge across multiple target domains without shared categories.
problem Learning unlabeled target domains without shared categories.
method Model parameter adaptation (PA-1SmT) to transfer knowledge through a common model parameter dictionary.
result Framework demonstrates superiority on three domain adaptation benchmark datasets.
Paper develops upper-bounds for target general loss in multiple source DA and DG settings.
problem Complexity and trade-offs in multiple source domain adaptation and domain generalization.
method Defines two types of domain-invariant representations and studies their pros, cons, and trade-offs.
result Developed upper-bounds for target general loss offer insights into domain-invariant representations.
EnMDAP aligns conditional distributions for multi-source domain adaptation using pseudolabels.
problem Training a target model with no labeled data in the absence of target data labels.
method EnMDAP uses label-wise moment matching and ensemble learning with multiple feature extractors.
result EnMDAP achieves state-of-the-art performance in multi-source domain adaptation tasks.
Method generates intermediate domains to align source and target domains.
problem Challenges of domain adaptation with significant domain divergence.
method Progressive domain augmentation via domain interpolation and multiple subspace alignment.
result Achieves state-of-the-art performance on multiple domain adaptation tasks.
Paper proposes a new method to aggregate multiple sources with different label distributions.
problem Aggregating from multiple target-shifted sources with different label distributions.
method Unified framework to select relevant sources for domain adaptation with limited label, unsupervised, and label partial unsupervised scenarios.
result Empirical results significantly outperform baselines.
Study shows algorithms benefit from limited target data with many source domains.
problem Adapting to new domains with scarce labeled target data.
method New family of model selection algorithms.
result Beneficial guarantees in scenarios with limited target data.
New method uses limited labeled data and multiple starts to adapt models across domains.
problem Accurate predictions in target domain with few labeled data.
method Fine-tuning from multiple adaptive starts, extending UDA methods.
result Minimax-optimal target performance with limited labeled target data.
Improves domain adaptation by combining multiple source domains and target domain data.
problem Poor performance of empirical risk minimization in distributionally shifted target domains.
method Distributionally robust model optimizing adversarial reward based on explained variance across multiple source domains.
result The robust model is a weighted average of conditional outcome models from source domains.
AMEAN tackles BTDA by learning meta-sub-targets to bridge domain gaps and misalignments.
problem Blending-target Domain Adaptation (BTDA) with multiple sub-targets that are hard to distinguish.
method AMEAN uses two adversarial processes: first to align source and mixed target domains, second to learn meta-sub-targets.
result AMEAN significantly outperforms existing DA algorithms in BTDA scenarios.
Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as targets waiting to be solved. Most existing efforts tackle target domains separa…
Proposes MDDA for multi-source domain adaptation.
problem Performance decay in deep neural networks due to domain shift between labeled and unlabeled data.
method Multi-source distilling domain adaptation (MDDA) network considering multiple source distributions and target similarities.
result Significantly outperforms state-of-the-art approaches on public DA benchmarks.
A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the training data (source) and the test data (target) and several domain adaptation …
AlignFlow uses normalizing flows to model multiple domains efficiently.
problem Efficiently modeling data from multiple domains.
method Generative modeling framework using normalizing flows for flexibility and exact cycle consistency.
result AlignFlow guarantees exact cycle consistency and outperforms baselines.
LADDER improves DG by reweighting domain-specific classifiers.
problem Challenges of domain generalization when causal mechanisms vary across domains.
method LADDER learns causal and style representations, reweights classifiers at inference.
result LADDER achieves gains in accuracy on various DG tasks.
While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain adaptation problem may lead to suboptimal solutions. As a step toward bridging the gap…
New approach tackles open compound domain adaptation without clear domain labels.
problem Adapting models to new, mixed domains without domain labels.
method Curriculum domain adaptation strategy and memory module.
result Demonstrated effectiveness on various tasks.
In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task learning. We propose to adapt and reuse the mapped source task optimal-policy directly …
This work tackles robust multi-source domain adaptation under label shift.
problem Label shift and data contamination in multi-source domain adaptation.
method Domain-weighted empirical risk minimization framework with refinement procedure.
result The proposed method achieves superior performance in multi-category classification problems.
Stein discrepancy improves UDA performance in low-data scenarios.
problem Improving model performance on unlabeled target domains with limited data.
method Proposes a novel UDA framework using Stein discrepancy, an asymmetric measure that depends on the target distribution through its score function.
result Consistently outperforms prior UDA approaches under limited target data across multiple benchmarks.
We present a novel approach for supervised domain adaptation that is based upon the probabilistic framework of Gaussian processes (GPs). Specifically, we introduce domain-specific GPs as local experts for facial expression classification from face images. The adaptation of the classifier is facilitated in probabilistic…
Novel method adapts MRI brain images across multiple domains.
problem Generalization failure in medical image learning across different acquisition parameters.
method Consistency loss combined with adversarial learning.
result Significantly outperforms other domain adaptation methods in MRI lesion segmentation.
A decentralized approach for multi-source domain adaptation.
problem Transfer knowledge from multiple related domains to an unlabeled target domain.
method Federated Dataset Dictionary Learning (FedDaDiL) framework, eliminating central server, using Wasserstein barycenters.
result Our decentralized approach effectively adapts source domains to an unlabeled target domain.
MWGAN tackles multi-marginal matching problem with Wasserstein GAN.
problem Learning mappings to match a source domain to multiple target domains with cross-domain correlations.
method Develops a novel Multi-marginal Wasserstein GAN (MWGAN) with inner- and inter-domain constraints to minimize Wasserstein distance.
result Theoretical and empirical evaluations show MWGAN's effectiveness on balanced and imbalanced translation tasks.
A new method aligns source and target distributions by tuning their weights.
problem Domain adaptation on unlabeled target datasets using labeled source datasets.
method Weighted Joint Distribution Optimal Transport (WJDOT) method that finds alignment between source and target distributions and re-weighting of source distributions.
result Achieves state-of-the-art performance on simulated and real-life datasets.
CUDA CTDR tackles unsupervised domain adaptation without domain alignment.
problem Lack of direct methods for unlabeled target domain classification.
method Jointly learns CTDR on source and target distributions using contradistinguish loss and supervised loss.
result CUDA CTDR achieves state-of-the-art results on various domain adaptation datasets.
MDA learns domain-invariant features for better target domain classification.
problem Improving model performance on unseen target domains using multiple source domains.
method MDA learns a domain-invariant feature transformation with minimal divergence, maximal separability, and compactness.
result MDA achieves better generalization on unseen target domains compared to existing methods.
DARN uses multiple source datasets to adapt to a new target dataset.
problem Learning a model for a new, related dataset using multiple source datasets.
method DARN applies domain discrepancy minimization with a theoretical generalization bound to adjust source domain weights.
result DARN significantly outperforms state-of-the-art alternatives on real-world datasets.
Improves unsupervised domain adaptation methods by aligning class conditional distributions.
problem Domain shift between source and target domains makes supervised learning models fail to generalize.
method Co-regularized domain alignment, creating multiple feature spaces and aligning them individually while encouraging agreement across class predictions.
result Significant performance improvements on domain adaptation benchmarks.
Introduces Cauchy-Schwarz divergence for domain adaptation.
problem Evaluating discrepancy between source and target domains in unsupervised domain adaptation.
method Introduces Cauchy-Schwarz divergence as a measure for evaluating discrepancy between marginal and conditional distributions.
result CS divergence offers a tighter generalization error bound than Kullback-Leibler divergence.
Improved analysis of gradual domain adaptation with better generalization bounds.
problem Improving generalization in target domain through intermediate unlabeled domains.
method Analyzed gradual self-training under more general assumptions, proving a new generalization bound.
result Proved a significantly improved generalization bound of ε0 + O(TΔ + T/√n) + ˜O(1/√nT).
Method addresses label shift in adversarial domain adaptation.
problem Label shift in behavioral studies.
method DATS (Domain Adversarial nets for Target Shift) framework.
result DATS framework performs well under large label shift.
Contradistinguisher learns to distinguish target domain without aligning source and target domains.
problem Difficulty in aligning source and target domains for domain adaptation.
method Direct approach to unsupervised domain adaptation that learns contrastive features and improves classification performance.
result Achieves state-of-the-art performance on Office-31 and VisDA-2017 datasets.
Paper introduces Influence Function to assess OOD generalization stability.
problem Assessing OOD generalization accuracy when target domains are unknown.
method Introduced Influence Function from robust statistics to monitor model stability.
result Accuracy on test domains and Influence Function variance can distinguish OOD algorithms and generalization quality.
Survey explores methods to adapt deep learning models across multiple labeled domains.
problem Difficulty in obtaining labeled data for deep learning models.
method Multi-source domain adaptation (MDA) to transfer knowledge from labeled to unlabeled or sparsely labeled target domains.
result MDA methods improve performance by minimizing domain shift.
Proposes a novel framework for unsupervised domain adaptation using specialized batch normalization.
problem Improves unsupervised domain adaptation in deep neural networks.
method Integrates domain-specific batch normalization layers in convolutional neural networks, estimating pseudo-labels for target domain examples and learning final models with multi-task classification loss.
result Achieves state-of-the-art accuracy in standard and multi-source domain adaptation scenarios.
Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of …
Paper tackles adapting multiple domains to a target domain using distillation and dictionary learning.
problem Adapting multiple heterogeneous labeled source domains to an unlabeled target domain.
method Combines Multi-Source Domain Adaptation and Dataset Distillation with Dataset Dictionary Learning.
result Achieves state-of-the-art adaptation performance even with minimal labeled data.
Deep networks have been successfully applied to learn transferable features for adapting models from a source domain to a different target domain. In this paper, we present joint adaptation networks (JAN), which learn a transfer network by aligning the joint distributions of multiple domain-specific layers across domai…
SETrLUSI combines diverse knowledge from multiple domains for faster convergence.
problem Handling diverse knowledge from multiple domains in transfer learning.
method Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI).
result SETrLUSI accelerates convergence and outperforms related methods.
Paper proposes a method to learn linear regression models using multiple pre-trained models.
problem Learning a linear regression model with limited target data.
method Representation transfer learning method using multiple pre-trained models.
result The method achieves better sample complexity compared to baseline methods.
SIG model identifies invariant variables for MSDA with fewer domain constraints.
problem Challenges in enforcing minimal changes across domains for MSDA.
method Subspace identification theory and variational inference.
result SIG model outperforms existing techniques on various benchmark datasets.
In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a classification problem with the same output classes, but with labels' proportions differing…
COLUMBUS discovers new features to improve domain generalization.
problem Improving machine learning models' ability to generalize to unseen domains.
method COLUMBUS uses targeted corruption of input and multi-level representations to discover new features.
result COLUMBUS achieves state-of-the-art performance on DG benchmarks.
Paper tackles domain adaptation in object detection, improving accuracy.
problem Real-world object detection faces domain shift issues.
method Formulates domain adaptation as noisy label training; uses noisy bounding boxes from source domain.
result Significantly improves object detection accuracy on various domain adaptation scenarios.
Generative model predicts multiple brain graphs from one, preserving topology.
problem Predicting multiple brain graphs from a single one, preserving topology.
method MultiGraphGAN architecture, graph adversarial auto-encoder, cluster-specific decoders, topological loss.
result Significantly outperformed variants in multi-view brain graph generation.
Paper tackles online multi-source domain adaptation using Gaussian mixtures and dictionary learning.
problem Adapting multiple, heterogeneous source domains to a target domain in a streaming fashion.
method Introduces a novel approach for online fitting of Gaussian Mixture Models based on Wasserstein geometry, combined with dataset dictionary learning.
result Demonstrates ability to adapt 'on the fly' to target domain data streams.
Self-training avoids spurious features in domain adaptation.
problem Domain shift with large differences between source and target domains.
method Entropy minimization on unlabeled target data, initialized with a source classifier.
result Entropy minimization avoids using spurious features in large domain shifts.
The paper tackles MSDA by learning dictionary atoms in Wasserstein space.
problem Mitigating data distribution shifts across multiple source domains to target domain.
method Dictionary learning and optimal transport in Wasserstein space; DaDiL algorithm for learning.
result Improved classification performance by 3.15%, 2.29%, and 7.71% in benchmarks.