arXiv research

Paper proposes MMI-ALI for scalable joint distribution matching across multiple domains.

We investigate the non-identifiability issues associated with bidirectional adversarial training for joint distribution matching. Within a framework of conditional entropy, we propose both adversarial and non-adversarial approaches to learn desirable matched joint distributions for unsupervised and supervised tasks. We…

LSDM uses unpaired data to match latent space distributions for generative modeling.

AR-CSM models use derivatives of univariate log-conditionals to estimate joint distributions efficiently.

L2M learns to match distributions for domain adaptation without relying on hand-crafted priors.

A new generative adversarial network is developed for joint distribution matching. Distinct from most existing approaches, that only learn conditional distributions, the proposed model aims to learn a joint distribution of multiple random variables (domains). This is achieved by learning to sample from conditional dist…

Paper proposes a new generative model for discrete distributions using flows on submanifolds.

Paper studies matching of samples from two distributions with a Gibbs probability weight.

Matching datasets of multiple modalities has become an important task in data analysis. Existing methods often rely on the embedding and transformation of each single modality without utilizing any correspondence information, which often results in sub-optimal matching performance. In this paper, we propose a nonlinear…

New method extracts joint and individual signals from multi-view data.

Posterior Matching enables VAEs to model arbitrary conditional densities.

Generative model for joint discrete distributions using randomized assignment flows.

We present a novel approximate graph matching algorithm that incorporates seeded data into the graph matching paradigm. Our Joint Optimization of Fidelity and Commensurability (JOFC) algorithm embeds two graphs into a common Euclidean space where the matching inference task can be performed. Through real and simulated …

Efficiently combines autoregressive and set-based models for joint distributions.

Generative models learn distributions, new method finds inputs matching desired conditional distributions.

Bayesian method matches uncertainty to adapt across domains.

In this work, we formulate the fixed-length distribution matching as a Bayesian inference problem. Our proposed solution is inspired from the compressed sensing paradigm and the sparse superposition (SS) codes. First, we introduce sparsity in the binary source via position modulation (PM). We then present a simple and …

Improves EM algorithm for better local optima in mixture models.

MIRA scores assess conditional distribution accuracy using joint samples.

A new method for conditional sampling using paired Wasserstein Autoencoders.

Generative models often fail to preserve joint structure despite matching marginals.

We present KERMIT, a simple insertion-based approach to generative modeling for sequences and sequence pairs. KERMIT models the joint distribution and its decompositions (i.e., marginals and conditionals) using a single neural network and, unlike much prior work, does not rely on a prespecified factorization of the dat…

Novel upper bound for unsupervised domain adaptation considers joint error.

We consider moment matching techniques for estimation in Latent Dirichlet Allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component analysis (ICA), we first derive a new set of cumulant-based tensors, with an improved sample complexity. Moreover, we reuse standard ICA techni…

An essential problem in domain adaptation is to understand and make use of distribution changes across domains. For this purpose, we first propose a flexible Generative Domain Adaptation Network (G-DAN) with specific latent variables to capture changes in the generating process of features across domains. By explicitly…

A Triangle Generative Adversarial Network ($Δ$-GAN) is developed for semi-supervised cross-domain joint distribution matching, where the training data consists of samples from each domain, and supervision of domain correspondence is provided by only a few paired samples. $Δ$-GAN consists of four neural networks, two ge…

Unified framework for simulation-based inference learns a single model for multiple tasks.

A new method for aligning datasets without known correspondences.

In systems biomedicine, an experimenter encounters different potential sources of variation in data such as individual samples, multiple experimental conditions, and multi-variable network-level responses. In multiparametric cytometry, which is often used for analyzing patient samples, such issues are critical. While c…

A new bimodal generative model is proposed for generating conditional and joint samples, accompanied with a training method with learning a succinct bottleneck representation. The proposed model, dubbed as the variational Wyner model, is designed based on two classical problems in network information theory -- distribu…

We introduce the Neural Conditioner (NC), a self-supervised machine able to learn about all the conditional distributions of a random vector $X$. The NC is a function $NC(x \cdot a, a, r)$ that leverages adversarial training to match each conditional distribution $P(X_r|X_a=x_a)$. After training, the NC generalizes to …

Directed latent variable models that formulate the joint distribution as $p(x,z) = p(z) p(x \mid z)$ have the advantage of fast and exact sampling. However, these models have the weakness of needing to specify $p(z)$, often with a simple fixed prior that limits the expressiveness of the model. Undirected latent variabl…

A new variational inference method using Gaussian score matching.

Extends geostatistical simulation method to handle multiple variables and large grids.

We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by drawing explicit links between the new models and a discrete version of independent component analysis …

Framework solves physics-constrained inverse problems with limited data.

Generalizes adversarial learning for better latent variable inference in GANs.

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which implies that the joint distribution given the ODE's and GP kernels is also Gaussian di…

We consider the use of the Joint Clustering and Matching (JCM) procedure for the supervised classification of a flow cytometric sample with respect to a number of predefined classes of such samples. The JCM procedure has been proposed as a method for the unsupervised classification of cells within a sample into a numbe…

A new imputation method estimates missing values by matching observed marginals from masked data.

CW-Gen models improve probabilistic time series forecasting by incorporating prior information.

A scalable algorithm for sampling and fine-tuning models using Tilt Matching.

Optimal transport aligns source and target distributions for domain adaptation.

In recent years, an increasing popularity of deep learning model for intelligent condition monitoring and diagnosis as well as prognostics used for mechanical systems and structures has been observed. In the previous studies, however, a major assumption accepted by default, is that the training and testing data are tak…

This paper speeds up inference in large hierarchical models.

Novel proof shows continuity of optimal transport feasible set mapping.

EventFlow forecasts event sequences without autoregression, improving accuracy.

Domain adaptation aims to assist the modeling tasks of the target domain with knowledge of the source domain. The two domains often lie in different feature spaces due to diverse data collection methods, which leads to the more challenging task of heterogeneous domain adaptation (HDA). A core issue of HDA is how to pre…