A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
New technique for multiple-source adaptation without density estimation.
Study shows algorithms benefit from limited target data with many source domains.
This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new guarantees that hold in the case where the conditional probabilities for the sour…
Paper develops upper-bounds for target general loss in multiple source DA and DG settings.
While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain adaptation problem may lead to suboptimal solutions. As a step toward bridging the gap…
Paper proposes a new method to aggregate multiple sources with different label distributions.
This paper presents a novel theoretical study of the general problem of multiple source adaptation using the notion of Renyi divergence. Our results build on our previous work [12], but significantly broaden the scope of that work in several directions. We extend previous multiple source loss guarantees based on distri…
EnMDAP aligns conditional distributions for multi-source domain adaptation using pseudolabels.
This work tackles robust multi-source domain adaptation under label shift.
CoDATS improves DA on time series data with weak supervision.
Improves domain adaptation by combining multiple source domains and target domain data.
Deep neural networks suffer from performance decay when there is domain shift between the labeled source domain and unlabeled target domain, which motivates the research on domain adaptation (DA). Conventional DA methods usually assume that the labeled data is sampled from a single source distribution. However, in prac…
Face verification remains a challenging problem in very complex conditions with large variations such as pose, illumination, expression, and occlusions. This problem is exacerbated when we rely unrealistically on a single training data source, which is often insufficient to cover the intrinsically complex face variatio…
PyKale bridges interdisciplinary ML with Python, enabling accurate predictions.
Introduces Cauchy-Schwarz divergence for domain adaptation.
Proxy methods adapt to distribution shifts without explicitly modeling latent confounders.
We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks while allowing them to share all other model parameters, which is realized by a tw…
We present a novel approach for supervised domain adaptation that is based upon the probabilistic framework of Gaussian processes (GPs). Specifically, we introduce domain-specific GPs as local experts for facial expression classification from face images. The adaptation of the classifier is facilitated in probabilistic…
In many real-world applications, we want to exploit multiple source datasets of similar tasks to learn a model for a different but related target dataset -- e.g., recognizing characters of a new font using a set of different fonts. While most recent research has considered ad-hoc combination rules to address this probl…
In this paper, we propose a novel framework to analyze the theoretical properties of the learning process for a representative type of domain adaptation, which combines data from multiple sources and one target (or briefly called representative domain adaptation). In particular, we use the integral probability metric t…
Model learns from multiple data sources for D2T and T2D tasks.
This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change across domains. To develop an automated way of domain adaptation with multiple sour…
Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of …
Survey explores methods to adapt deep learning models across multiple labeled domains.
Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain (1S1T), and just a few works concern the scenario of multiple source domains and…
Domain adaptation performance of a learning algorithm on a target domain is a function of its source domain error and a divergence measure between the data distribution of these two domains. We present a study of various distance-based measures in the context of NLP tasks, that characterize the dissimilarity between do…
Integrates multiple datasets to solve open set crowdsourcing problems.
Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper, we study transfer learning in the context of nonparametric classification based …
Flexible multi-task learning framework using summary statistics.
Data integration methods that analyze multiple sources of data simultaneously can often provide more holistic insights than can separate inquiries of each data source. Motivated by the advantages of data integration in the era of "big data", we investigate feature selection for high-dimensional multi-view data with mix…
An algorithm learns from multiple models to match an oracle's risk.
The paper proposes a method to integrate prior information into penalized regression.
A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the training data (source) and the test data (target) and several domain adaptation …
The paper develops methods to identify stable associations across multiple studies.
Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discriminative across diverse domains that differ in terms of language, spontaneity of speech, recording condi…
Transfer knowledge from multiple sources to improve matrix completion.
This paper synthesizes and analyzes some important current and recent contributions to the theory of the firm under uncertainty. In so doing, it examines the production and hedging decisions of the competitive firm under a single source and multiple sources of uncertainty.
Transformer models show robustness across domains with domain adversarial training.
This work improves transferability by considering conditional distributions in feature representations.
KG-WDRO optimizes transfer learning with external knowledge.
Paper tackles linear models with missing values, achieving minimax optimal results.
Proposes a new approach to MSDA by introducing latent covariate shift to handle varying label distributions.
This work sets theoretical limits on meta-learning performance.
Paper uses deep learning to make predictions transparently.
The paper quantizes concatenated noisy vectors to a common cluster center, improving performance over naive methods.
Flexible framework for CMTF with ADMM for various constraints and couplings.
A new framework optimizes model transfer across domains with labeled data.
Imaging genetic research has essentially focused on discovering unique and co-association effects, but typically ignoring to identify outliers or atypical objects in genetic as well as non-genetics variables. Identifying significant outliers is an essential and challenging issue for imaging genetics and multiple source…