DARL framework tackles partial domain adaptation by selecting source instances for positive transfer.
problem Tackles the challenge of selecting source instances for positive transfer in partial domain adaptation.
method Proposes a Domain Adversarial Reinforcement Learning (DARL) framework that uses deep Q-learning and domain adversarial learning to select source instances and learn domain-invariant features.
result Demonstrates superior performance over existing methods for partial domain adaptation on several benchmark datasets.
Transformer models show robustness across domains with domain adversarial training.
problem Domain adaptation from multiple sources with no labeled data.
method Domain adversarial training and mixture of experts.
result Domain adversarial training improves representation but not performance.
This work increases shape bias in CNNs trained on ImageNet, improving robustness without accuracy gain.
problem Shape bias in CNNs trained on ImageNet.
method Uses domain-adversarial training to remove texture clues and increase shape bias.
result The method increases robustness of CNNs without improving accuracy.
Fisher loss improves deep domain adaptation by learning discriminative within-class compact and between-class separable representations.
problem Improving deep domain adaptation performance by learning discriminative representations.
method Proposes a Fisher loss to learn discriminative representations that are within-class compact and between-class separable.
result Noticeable improvements in deep domain adaptation performance, e.g., 6.67% absolute improvement in mean accuracy on the Office-Home dataset.
Choosing optimal (or at least better) policies is an important problem in domains from medicine to education to finance and many others. One approach to this problem is through controlled experiments/trials - but controlled experiments are expensive. Hence it is important to choose the best policies on the basis of obs…
Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g. covariate or label shift, enable principled algorithms. Recently-proposed domain-adversa…
Paper proposes MDAT to stabilize domain alignment in label-scarce settings.
problem Stable and comprehensive domain alignment in label-scarce settings.
method Max-margin Domain-Adversarial Training (MDAT) with Adversarial Reconstruction Network (ARN).
result MDAT stabilizes gradient reversing and achieves strong robustness to hyper-parameters.
Domain adaptation refers to the problem of leveraging labeled data in a source domain to learn an accurate model in a target domain where labels are scarce or unavailable. A recent approach for finding a common representation of the two domains is via domain adversarial training (Ganin & Lempitsky, 2015), which attempt…
MuLANN tackles multi-domain learning with adversarial approach.
problem Automated microscopy data with domain bias.
method Semi-supervised multi-domain learning with MuLANN.
result Improves state of the art on image benchmarks and bioimage dataset.
New framework using Jensen-Shannon divergence improves domain adaptation theory.
problem Incoherence between empirical domain adversarial training and theoretical H-divergence. method Established new theoretical framework based on Jensen-Shannon divergence, derived bi-directional upper bounds.
result Framework exhibits flexibilities for various transfer learning problems.
Unified deep architecture for domain-invariant network alignment.
problem Eliminate domain representation bias in network alignment.
method DANA (Domain Adversarial Network Alignment) using graph convolutional networks and semi-supervised learning.
result Achieves state-of-the-art alignment results on real-world social networks.
AFTER technique improves NLP models by preventing overfitting to task-specific domains.
problem Standard fine-tuning degrades pretraining domain representations.
method Complements task-specific loss with adversarial objective.
result AFTER leads to improved performance on various NLP tasks.
We present CROSSGRAD, a method to use multi-domain training data to learn a classifier that generalizes to new domains. CROSSGRAD does not need an adaptation phase via labeled or unlabeled data, or domain features in the new domain. Most existing domain adaptation methods attempt to erase domain signals using technique…
Paper proposes a method to refine embeddings efficiently.
problem Efficiently refining embeddings after their creation.
method Uses a Domain Adversarial Network (DAN) with constraints.
result Significantly outperforms state-of-the-art unsupervised algorithms.
Through deep learning and computer vision techniques, driving manoeuvres can be predicted accurately a few seconds in advance. Even though adapting a learned model to new drivers and different vehicles is key for robust driver-assistance systems, this problem has received little attention so far. This work proposes to …
Domain-Adversarial Neural Networks improve fault diagnosis models across different machines.
problem Improving fault diagnosis models on new machines with limited labeled data.
method Domain-Adversarial Neural Networks (DANN) and other methods for domain adaptation.
result Unified experimental protocol for fair comparison of domain adaptation methods.
MetFA aligns source and target domains for cross-device image classification.
problem Learning discriminative class boundaries across different domains.
method Distance metric guided feature alignment (MetFA) for domain-invariant and discriminative feature extraction.
result MetFA outperforms state-of-the-art methods in cross-device image classification.
New risk decompositions clarify domain adaptation issues.
problem Domain adaptation challenges with different training and test distributions.
method Representation Bayesian Risk Decompositions, hybrid argument.
result Clarifies factors (2) and (3) as reasons for generalization failure.
With the rapid development of high-throughput technologies, parallel acquisition of large-scale drug-informatics data provides huge opportunities to improve pharmaceutical research and development. One significant application is the purpose prediction of small molecule compounds, aiming to specify therapeutic propertie…
DAC-SSM learns domain-agnostic states for better imitation learning.
problem Domain shifts hinder imitation learning in partially observable tasks.
method DAC-SSM uses adversarial training to remove domain-dependent information from states.
result DAC-SSM achieves comparable performance to experts in sparse reward tasks.
Proposes novel losses for fine-grained categorical domain adaptation.
problem Fine-grained alignment of categories across domains in unsupervised domain adaptation.
method Joint category-domain classifier with adversarial training losses for both domain and category levels, and vicinal domain adaptation.
result Achieves state-of-the-art performance on benchmark datasets.
Statistical learning on biological data can be challenging due to confounding variables in sample collection and processing. Confounders can cause models to generalize poorly and result in inaccurate prediction performance metrics if models are not validated thoroughly. In this paper, we propose methods to control for …
We propose a framework that learns a representation transferable across different domains and tasks in a label efficient manner. Our approach battles domain shift with a domain adversarial loss, and generalizes the embedding to novel task using a metric learning-based approach. Our model is simultaneously optimized on …
Unsupervised learning filters tweets for emergency services during crises.
problem Challenges in filtering relevant information from social web data during disasters.
method Multi-task domain adversarial attention network for unsupervised domain adaptation.
result The multi-task model outperforms single task models in filtering relevant tweets.
AVDA transfers knowledge from source to target domains using embeddings.
problem Transferring knowledge from a source domain to a target domain with limited labeled data.
method Adversarial Variational Domain Adaptation (AVDA) with deep embeddings and Gaussian Mixture Model.
result AVDA outperforms previous methods in semi-supervised few-shot domain adaptation.
Generating logical form equivalents of human language is a fresh way to employ neural architectures where long short-term memory effectively captures dependencies in both encoder and decoder units. The logical form of the sequence usually preserves information from the natural language side in the form of similar token…
Paper tackles sim-to-real domain adaptation in HEP.
problem Discrepancy between simulations and real data affects ML algorithms performance.
method Domain Adversarial Neural Network trained on HEP data.
result Ensures consistent ML algorithm performance on simulated and real HEP datasets.
We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain adaptation suggesting that, for effective domain transfer to be achieved, predict…
Improves unsupervised domain adaptation by mixing source and target domains.
problem Improves unsupervised domain adaptation by mixing source and target domains.
method Enforces training constraints across domains using mixup formulation and feature-level consistency regularizer.
result Significantly improves state-of-the-art performance on image classification and human activity recognition tasks.
Method addresses label shift in adversarial domain adaptation.
problem Label shift in behavioral studies.
method DATS (Domain Adversarial nets for Target Shift) framework.
result DATS framework performs well under large label shift.
This paper creates imperceptible, effective audio adversarial examples for speech recognition.
problem Current adversarial examples in speech recognition are easily detectable and ineffective in real-world settings.
method Developed imperceptible audio adversarial examples using psychoacoustic masking and simulated environmental distortions.
result Successfully created imperceptible, targeted adversarial examples for speech recognition that are effective in real-world settings.
While neural networks have shown impressive performance on large datasets, applying these models to tasks where little data is available remains a challenging problem. In this paper we propose to use feature transfer in a zero-shot experimental setting on the task of semantic parsing. We first introduce a new method fo…
Active learning improves inspection systems by using weakly labeled data.
problem Rapidly updating machine vision inspection systems in evolving manufacturing processes.
method Developed a methodology for active learning from weakly labeled data, addressing covariate shift with domain-adversarial training.
result Demonstrated that active learning can accelerate the annotation process and reduce false positives.
Many people are suffering from voice disorders, which can adversely affect the quality of their lives. In response, some researchers have proposed algorithms for automatic assessment of these disorders, based on voice signals. However, these signals can be sensitive to the recording devices. Indeed, the channel effect …
CRN model estimates treatment effects over time using adversarial balancing.
problem Estimating treatment effects over time in medical settings.
method Adversarial domain balancing to remove time-varying confounders.
result CRN achieves lower error in estimating counterfactuals and treatment timing.
New method removes pseudo-label bias for unsupervised domain adaptation.
problem Class imbalance and distribution shift between domains.
method Implicit class-conditioned domain alignment without explicit pseudo-label optimization.
result Effective in handling within-domain class imbalance and between-domain class distribution shift.
The paper improves model robustness by regularizing posterior differences.
problem Improving model robustness in noisy input scenarios.
method Posterior differential regularization with f-divergence. result Regularizing with f-divergence improves model robustness. New algorithm guarantees domain generalization with few environments.
problem Performing well on unseen environments with limited training data.
method Iterative feature matching algorithm with theoretical guarantees.
result Guaranteed domain generalization with logarithmic environments.
We consider the problem of a neural network being requested to classify images (or other inputs) without making implicit use of a "protected concept", that is a concept that should not play any role in the decision of the network. Typically these concepts include information such as gender or race, or other contextual …
A new method makes adversarial domain adaptation aware of class relationships.
problem Ignoring inter-class semantic relationships in domain adaptation.
method RADA algorithm that aligns inter-class dependencies learned from domain discriminator with those from label predictor.
result Improves performance on benchmark datasets by incorporating class relationships.
Proposes a method to predict RUL with domain adaptation for PHM.
problem Domain shift reduces predictive model performance in PHM.
method Long Short-Term Neural Networks (LSTM) for domain adaptation.
result Proposed method provides more reliable RUL predictions under different conditions.
While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain adaptation problem may lead to suboptimal solutions. As a step toward bridging the gap…
We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation suggesting that, for effective domain transfer to be achieved, predictions must be made b…
Incremental domain adaptation improves neural network performance.
problem Improper domain adaptation leads to unpredictable model behavior.
method Iterative unsupervised domain adaptation using neural network confidence.
result Clear improvement in performance across multiple datasets.
KD improves DNN performance on unseen data without hyperparameter tuning.
problem Overfitting in DNNs on unseen data.
method Knowledge distillation for semi-supervised domain adaptation.
result KD achieves significantly higher WMH dice scores than baseline and ADA.
The learning of domain-invariant representations in the context of domain adaptation with neural networks is considered. We propose a new regularization method that minimizes the discrepancy between domain-specific latent feature representations directly in the hidden activation space. Although some standard distributi…
Paper develops new algorithms for unsupervised multi-class domain adaptation.
problem Improving performance of machine learning models across different domains without labeled data.
method Introduces MCSD divergence and a new domain adaptation bound, develops adversarial learning objectives, and proposes new algorithms like McDalNets and SymmNets.
result New algorithms improve performance across different domain adaptation settings.
Typically a classifier trained on a given dataset (source domain) does not performs well if it is tested on data acquired in a different setting (target domain). This is the problem that domain adaptation (DA) tries to overcome and, while it is a well explored topic in computer vision, it is largely ignored in robotic …