arXiv research

HCL learns shared and modality-specific latent representations for multimodal data.

New critics improve VAEs by preventing latent collapse.

A new framework converts EEG signals between subjects and tasks.

Develops a method to identify causal effects in linear models with latent variables.

New method AnInfoNCE uncovers latent factors in contrastive learning with practical variability.

CIR method preserves relation for case-control studies.

Framework explains how dual deep networks learn features from unlabeled data.

Bayesian network models with latent variables are widely used in statistics and machine learning. In this paper we provide a complete algebraic characterization of Bayesian network models with latent variables when the observed variables are discrete and no assumption is made about the state-space of the latent variabl…

We study the problem of learning latent variables in Gaussian graphical models. Existing methods for this problem assume that the precision matrix of the observed variables is the superposition of a sparse and a low-rank component. In this paper, we focus on the estimation of the low-rank component, which encodes the e…

New model uncovers non-Euclidean neural representations.

cMCA uses contrastive learning to identify latent subgroups in political party data.

New model learns multimodal data better than DAGs.

Study nonparametric factor analysis with arbitrary noise.

SSL framework identifies non-linear systems without labeled data.

Unnormalised latent variable models are a broad and flexible class of statistical models. However, learning their parameters from data is intractable, and few estimation techniques are currently available for such models. To increase the number of techniques in our arsenal, we propose variational noise-contrastive esti…

We investigate probabilistic graphical models that allow for both cycles and latent variables. For this we introduce directed graphs with hyperedges (HEDGes), generalizing and combining both marginalized directed acyclic graphs (mDAGs) that can model latent (dependent) variables, and directed mixed graphs (DMGs) that c…

With the introduction of the variational autoencoder (VAE), probabilistic latent variable models have received renewed attention as powerful generative models. However, their performance in terms of test likelihood and quality of generated samples has been surpassed by autoregressive models without stochastic units. Fu…

Modeling hidden neurons in SNNs using mesoscopic approximations.

We propose a nonparametric procedure to achieve fast inference in generative graphical models when the number of latent states is very large. The approach is based on iterative latent variable preselection, where we alternate between learning a 'selection function' to reveal the relevant latent variables, and use this …

Reparameterization of variational auto-encoders with continuous random variables is an effective method for reducing the variance of their gradient estimates. In the discrete case, one can perform reparametrization using the Gumbel-Max trick, but the resulting objective relies on an $\arg \max$ operation and is non-dif…

New results show contrastive learning can recover shared factors in multimodal data.

Causal Component Analysis aims to recover latent variables with causal relationships.

New method uses cycle consistency to enforce invariance in latent space.

Contrastive learning adapts to data intrinsic dimensions, learning low-dimensional representations.

One of the most surprising and exciting discoveries in supervised learning was the benefit of overparameterization (i.e. training a very large model) to improving the optimization landscape of a problem, with minimal effect on statistical performance (i.e. generalization). In contrast, unsupervised settings have been u…

Proposes flexible auto-encoders for varying data dimensions.

We present a representation learning framework for financial time series forecasting. One challenge of using deep learning models for finance forecasting is the shortage of available training data when using small datasets. Direct trend classification using deep neural networks trained on small datasets is susceptible …

New framework identifies causal models with arbitrary interventions, improving realism.

In this paper we present a fully Bayesian latent variable model which exploits conditional nonlinear(in)-dependence structures to learn an efficient latent representation. The latent space is factorized to represent shared and private information from multiple views of the data. In contrast to previous approaches, we i…

We study a formalization of the grammar induction problem that models sentences as being generated by a compound probabilistic context-free grammar. In contrast to traditional formulations which learn a single stochastic grammar, our grammar's rule probabilities are modulated by a per-sentence continuous latent variabl…

Develops fully Bayesian LVGP for better uncertainty quantification.

With latent variables, stochastic recurrent models have achieved state-of-the-art performance in modeling sound-wave sequence. However, opposite results are also observed in other domains, where standard recurrent networks often outperform stochastic models. To better understand this discrepancy, we re-examine the role…

VJE learns latent representations without contrastive learning, providing probabilistic semantics.

New method identifies causal relationships from interventions in complex systems.

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which implies that the joint distribution given the ODE's and GP kernels is also Gaussian di…

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning interpretable latent representations for undirected graphs. We demonstrate this model us…

Improved VAEs by training a contrastive prior to match posterior.

New method estimates model parameters from incomplete data.

We introduce the Mutual Information Machine (MIM), a probabilistic auto-encoder for learning joint distributions over observations and latent variables. MIM reflects three design principles: 1) low divergence, to encourage the encoder and decoder to learn consistent factorizations of the same underlying distribution; 2…

Paper compares two methods for inferring network structures in presence of latent confounders.

CDVAE estimates treatment effects over time by accounting for unobserved variables.

Testing whether a probability distribution is compatible with a given Bayesian network is a fundamental task in the field of causal inference, where Bayesian networks model causal relations. Here we consider the class of causal structures where all correlations between observed quantities are solely due to the influenc…

Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target dataset compared to some background---e.g. enriched in patients compared to the genera…

cvHM framework speeds up GP inference for neural spike train analysis.

Researchers identify latent variables and causal structures from nonlinear hierarchical models.

DO-EM framework for quantum models improves generative tasks.

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating signals, each layer in our framework is trained to directly solve the task, but acq…

Double InfoGAN improves CA by generating clearer, more accurate images.