DGA and DVGA learn disentangled graph representations to improve graph analysis.
problem Holistic graph auto-encoders fail to capture latent factors effectively.
method Design disentangled graph convolutional network and component-wise flow, impose independence constraints.
result Improved disentangled graph representations enhance graph analysis tasks.
Improved reconstruction performance in disentanglement challenge.
problem Learning disentangled representations from real-world data.
method Adopted FactorVAE and improved reconstruction performance.
result Achieved 1st place in the disentanglement challenge.
After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an interpretable and factorized representation of latent variable by modifying their objec…
A new method for disentangled latent spaces in VAEs that can manipulate attributes.
problem Disentangled representation of attributes in latent spaces of VAEs.
method Attribute-based regularization loss to enforce monotonic relationships between attributes and latent codes.
result Manipulation of attributes in latent spaces post-training.
MACRo-mIcro VAE learns disentangled user behavior representations.
problem Complex user behavior data in recommender systems are entangled; disentangling them enhances robustness and interpretability.
method MACRo-mIcro Disentangled Variational Auto-Encoder (MacridVAE) infers high-level user intentions and micro-disentangles preferences.
result Our approach achieves substantial improvement over state-of-the-art baselines and demonstrates interpretable and controllable learned representations.
Improved model-based RL for 2-agent tasks reduces error accumulation.
problem Accumulating errors in model-based reinforcement learning for multi-agent systems.
method Disentangled variational auto-encoder for latent variable models of multi-step trajectory segments.
result Our approach achieves better sample efficiency and learns both cooperative and adversarial behavior.
A new VAE model learns disentangled latent factors without supervision.
problem Learning disentangled latent representations in unsupervised settings.
method Relevance-Factor-VAE model using total correlation and relevance indicators.
result Demonstrates superior disentanglement performance across multiple datasets.
This paper improves disentanglement in VAEs by progressively learning hierarchical representations.
problem Compromised disentanglement in VAEs due to high-level abstraction extraction.
method Progressive learning of independent hierarchical representations from high to low levels.
result Improved disentanglement demonstrated on two benchmark datasets using new metrics.
Bayes-Factor-VAE models improve disentanglement of latent factors in data.
problem Disentangling latent factors in data using standard Gaussian priors is suboptimal.
method Introduced hierarchical Bayesian deep auto-encoder models with hyper-priors on latent variances.
result Bayes-Factor-VAEs outperform existing methods in latent disentanglement.
Model learns from multiple data sources for D2T and T2D tasks.
problem Limited performance due to single-source corpora.
method Variational auto-encoder with disentangled style and content variables.
result Model outperforms single-source counterpart on multiple datasets.
CompVAE handles multi-ensemble data with compositional generative model.
problem Handling multi-ensemble data with control and generative models.
method Derived from Bayesian variational principles, CompVAE learns a latent representation leveraging observational and symbolic information.
result Supports compositional generative model enabling multi-ensemble operations.
We study the role of latent space dimensionality in Wasserstein auto-encoders (WAEs). Through experimentation on synthetic and real datasets, we argue that random encoders should be preferred over deterministic encoders. We highlight the potential of WAEs for representation learning with promising results on a benchmar…
This paper characterizes VAE training pathologies and their effects on tasks.
problem Characterizing VAE training pathologies and their impact on downstream tasks.
method Concretely characterizing conditions for VAE training pathologies and their connection to specific downstream tasks.
result Connects VAE training pathologies to specific downstream tasks like learning compressed and disentangled representations, adversarial robustness, and semi-supervised learning.
Improved sample complexity for Gaussian process approximations.
problem Efficiently approximating Gaussian processes with sparse spectrum.
method Improved sample complexity analysis and auto-encoding algorithm.
result Gaussian process predictions and model evidence can be well-approximated with low sample complexity.
This paper takes a step towards temporal reasoning in a dynamically changing video, not in the pixel space that constitutes its frames, but in a latent space that describes the non-linear dynamics of the objects in its world. We introduce the Kalman variational auto-encoder, a framework for unsupervised learning of seq…
This research improves dynamical systems understanding by identifying latent states and their nonlinear transitions.
problem Previous work on dynamical systems could not identify nonlinear transition dynamics, leading to unreliable predictions.
method Proposes a state-space modeling framework using variational auto-encoders to identify latent states and their nonlinear transition functions.
result Demonstrates high accuracy in recovering latent state dynamics and future prediction accuracy.
SepVAE separates patient-specific patterns from healthy ones using contrastive VAE.
problem Separating patient-specific patterns from healthy ones in medical datasets.
method SepVAE uses a contrastive VAE with disentangling and classification losses to differentiate between common and salient features.
result SepVAE outperforms previous methods in three medical applications and a CelebA dataset.
A new method decouples GANs for better latent space inference.
problem Inability of GANs to encode real-world samples.
method Latently Invertible Autoencoder (LIA) framework.
result LIA enables disentangled inference in GANs.
Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are dynamically controlled by learning disentangled latent representations with designated…
Advances in unsupervised learning enable reconstruction and generation of samples from complex distributions, but this success is marred by the inscrutability of the representations learned. We propose an information-theoretic approach to characterizing disentanglement and dependence in representation learning using mu…
A novel cross-modal auto-encoder associates different data types efficiently.
problem Cross-modal data association in heterogeneous datasets.
method Bayesian inference framework with variational auto-encoders and associators.
result Successfully associates visual and auditory data with minimal paired data.
CVAEs improve VAEs by accounting for correlations in latent representations.
problem VAEs fail to account for correlations between data points, limiting their effectiveness.
method CVAEs incorporate correlation structure into VAEs using a prior and tractable approximations.
result CVAEs outperform baseline algorithms in matching and link prediction tasks.
New definition of disentanglement for non-independent factors of variation.
problem Current disentanglement definitions assume independent factors of variation, limiting their applicability.
method Definition based on information theory, related to Information Bottleneck Method, proposed measurement method.
result Proposed method correctly measures disentanglement with non-independent factors of variation.
SIG-VAE enhances VGAE for graph data modeling.
problem Limited flexibility in VGAE for graph data.
method Hierarchical variational framework with Bernoulli-Poisson link decoder.
result SIG-VAE outperforms state-of-the-art methods on graph tasks.
New method learns disentangled discrete representations using categorical variational autoencoders.
problem Learning disentangled representations from discrete latent spaces.
method Replaced standard Gaussian VAE with a categorical VAE to mitigate rotational invariance.
result Categorical distributions improve learning of disentangled representations.
Disentanglement-PyTorch library facilitates disentangled representation learning.
problem Unsupervised learning of disentangled representations.
method Modular library for variational algorithms, decoupling architectures, latent space, and training algorithms.
result Achieved 3rd rank in NeurIPS 2019 Disentanglement Challenge.
Improved training for VQ-VAE models with robust codebook learning.
problem Challenges in training discrete latent variable models, especially VQ-VAEs.
method Increased learning rate and periodic re-initialization of codebook for robust training.
result More robust training and increased usage of latent codewords, even for large codebooks.
There are many forms of feature information present in video data. Principle among them are object identity information which is largely static across multiple video frames, and object pose and style information which continuously transforms from frame to frame. Most existing models confound these two types of represen…
LANCA uses ANM to learn latent causal factors without supervision.
problem Learning latent causal factors without supervision.
method LANCA employs a deterministic Wasserstein Auto-Encoder coupled with a differentiable ANM Layer.
result LANCA outperforms baselines on physics and photorealistic environments.
CasVAE outperforms supervised methods for star-galaxy classification.
problem Challenges in machine learning for astronomy data.
method Cascade Variational Auto-Encoder (CasVAE) for unsupervised star-galaxy classification.
result CasVAE outperforms baseline models in accuracy and stability.
Gaussian process variational autoencoders improve disentanglement in time series data.
problem Learning disentangled representations from multivariate time series data.
method Model each latent channel with a Gaussian process prior and a structured variational distribution to capture temporal dependencies.
result Competitive performance on benchmark and real-world medical time series data.
Our goal is to predict future video frames given a sequence of input frames. Despite large amounts of video data, this remains a challenging task because of the high-dimensionality of video frames. We address this challenge by proposing the Decompositional Disentangled Predictive Auto-Encoder (DDPAE), a framework that …
Paper proposes a new method for learning deep generative models using annealed importance sampling.
problem Learning deep generative models efficiently and accurately.
method Proposes annealed importance sampling as a bridge between variational inference and Markov chain Monte Carlo.
result Demonstrates improved density models and better trade-off between computation and model accuracy.
Improved reliability of machine learning predictions using variational auto-encoders.
problem Individual unreliability of machine learning models.
method Modified variational auto-encoders to identify a low-dimensional space for reliable classification.
result Improved reliability of predictions and robust identification of adversarial samples.
ACVAEs improve on CVAEs by learning more flexible latent correlations.
problem Learning latent representations with correlated structure.
method Adaptive prior distribution and belief propagation.
result ACVAEs outperform CVAEs in link prediction and hierarchical clustering.
Paper introduces Wasserstein total correlation for disentangled representation learning.
problem Learning disentangled representations from data.
method Adversarial training of a critic to estimate Wasserstein total correlation in variational and Wasserstein autoencoders.
result Proposed method achieves comparable disentanglement performance with less reconstruction loss.
Self-supervised VAEs improve data compression and generation.
problem Efficient data compression and generation.
method Introducing self-supervised Variational Auto-Encoders with deterministic and discrete variational posteriors.
result Self-supervised VAEs simplify the objective function and improve data reconstruction.
UDR selects disentangled models without labels.
problem Unsupervised disentangled model selection.
method UDR leverages variational autoencoder disentanglement theory to rank models.
result UDR performs comparably to supervised methods and correlates with task performance.
Paper proposes a new model for speech synthesis with better interpretability.
problem Improving interpretability in speech synthesis models.
method Hierarchical, fine-grained latent variable model with conditional variational auto-encoder (VAE).
result The new model allows better interpretability without degrading performance.
Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks, interpretability, etc. We consider the problem of unsupervised learning of disentangled rep…
GCVAE improves disentanglement in VAEs while balancing reconstruction error.
problem Improving disentanglement in VAEs while maintaining low reconstruction error.
method Introduces three controllable Lagrangian hyperparameters to optimize reconstruction and KL divergence loss.
result GCVAE outperforms state-of-the-art models in disentanglement while balancing reconstruction.
We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning interpretable latent representations for undirected graphs. We demonstrate this model us…
DISCoVeR learns disentangled representations by separating shared and condition-specific factors.
problem Learning disentangled representations for multi-condition data.
method Dual-latent architecture, parallel reconstructions, max-min objective.
result DISCoVeR achieves improved disentanglement on various datasets.
New technique learns causally disentangled representations for better generation.
problem Learning disentangled representations for accurate generation.
method Causally Disentangled Generation (CDG) approach with supervised regularization.
result CDG is necessary and sufficient for accurate disentangled generation.
Unified method for disentangling classes and content improves AI representation learning.
problem Current methods struggle with disentangling class and content variations.
method LORD: Latent Optimization for Representation Disentanglement with asymmetric noise regularization.
result LORD achieves superior disentanglement performance compared to existing methods.
Improved disentanglement through learned feature aggregation.
problem Disentangling latent factors in images.
method Variational autoencoder trained on regionally aggregated feature maps from ImageNet.
result 2nd place in NeurIPS 2019 disentanglement challenge.
A new approach to disentangled representations using structured latent priors.
problem Learning disentangled representations in unsupervised learning.
method Proposed a structured latent prior to encourage disentanglement and mitigate trade-offs.
result The structured latent prior significantly mitigates the trade-off between reconstruction loss and disentanglement.
Here we propose a novel model family with the objective of learning to disentangle the factors of variation in data. Our approach is based on the spike-and-slab restricted Boltzmann machine which we generalize to include higher-order interactions among multiple latent variables. Seen from a generative perspective, the …