FAVAE learns disentangled representations from sequential data.
problem Learning disentangled and interpretable representations from sequential data.
method FAVAE uses the information bottleneck principle without supervision.
result FAVAE can disentangle multiple dynamic factors.
New method disentangles correlated factors without independence assumption.
problem Learning disentangled representations from correlated data.
method Hausdorff Factorized Support (HFS) criterion for disentanglement.
result HFS consistently improves disentanglement and recovery across various correlation settings.
New definition of disentanglement for non-independent factors of variation.
problem Current disentanglement definitions assume independent factors of variation, limiting their applicability.
method Definition based on information theory, related to Information Bottleneck Method, proposed measurement method.
result Proposed method correctly measures disentanglement with non-independent factors of variation.
A method for disentangling discrete and continuous factors of data without using a discriminator network.
problem Unsupervised disentanglement of discrete and continuous factors of data.
method A procedure that minimizes total correlation of continuous latent variables and a separate discrete inference procedure.
result The method significantly outperforms current disentanglement methods based on disentanglement score and inference network classification score.
Bayes-Factor-VAE models improve disentanglement of latent factors in data.
problem Disentangling latent factors in data using standard Gaussian priors is suboptimal.
method Introduced hierarchical Bayesian deep auto-encoder models with hyper-priors on latent variances.
result Bayes-Factor-VAEs outperform existing methods in latent disentanglement.
Model predicts video factors independently without cross-factor interference.
problem Predicting video factors without cross-factor interference.
method Unsupervised variational model for disentangling video into independent factors.
result Often learns interpretable factors like objects in a scene.
New approach to disentangled representations using mutual information.
problem Disentangled representations lack sufficient inductive biases.
method Formulate disentanglement through mutual information and conditional independence.
result Violation of mutual information assumption leads to loss of disentanglement.
A new VAE model learns disentangled latent factors without supervision.
problem Learning disentangled latent representations in unsupervised settings.
method Relevance-Factor-VAE model using total correlation and relevance indicators.
result Demonstrates superior disentanglement performance across multiple datasets.
Paper proposes MIM-DRCFR to learn disentangled factors for better treatment effect estimation.
problem Learning disentangled factors precisely for individual-level treatment effect estimation.
method Multi-task learning framework with MI minimization criteria.
result MIM-DRCFR outperforms state-of-the-art methods in treatment effect estimation.
Here we propose a novel model family with the objective of learning to disentangle the factors of variation in data. Our approach is based on the spike-and-slab restricted Boltzmann machine which we generalize to include higher-order interactions among multiple latent variables. Seen from a generative perspective, the …
Improved disentanglement of data factors using recursive training.
problem Current unsupervised disentanglement methods are inconsistent and fail to achieve levels of disentanglement seen in supervised approaches.
method Introduced PBT for VAEs, used UDR for heuristic scoring, and developed recursive rPU-VAE approach.
result Recursive training leads to robust disentanglement of data factors across multiple datasets.
A new method for unsupervised disentanglement using axis-aligned cliffs.
problem Unsupervised disentanglement of latent factors under nonlinear maps.
method Encouraging axis-aligned discontinuities (cliffs) in the estimated density of factors.
result Cliff method outperforms baselines on disentanglement benchmarks.
DGA and DVGA learn disentangled graph representations to improve graph analysis.
problem Holistic graph auto-encoders fail to capture latent factors effectively.
method Design disentangled graph convolutional network and component-wise flow, impose independence constraints.
result Improved disentangled graph representations enhance graph analysis tasks.
Method ranks generative models without needing latent factor supervision.
problem Challenges in selecting generative models for qualities like disentanglement.
method Ranking generative models based on training dynamics, without requiring labels for latent factors.
result Method correlates with supervised disentanglement metrics and can predict downstream performance.
New principle for disentangling latent factors using sparse regularization.
problem Disentangling latent factors from complex data.
method Sparse regularization of latent mechanisms to induce disentanglement.
result Recovery of latent variables up to permutation under certain conditions.
We define disentanglement in generative models and prove it's related to identifiable factors.
problem Understanding disentanglement in generative models like VAEs and GANs.
method Characterized disentanglement in smooth generative pushforward models using the SVD of the Jacobian.
result Disentanglement is identifiable under certain conditions on the generator, promoting separable factors.
New framework learns disentangled causal representations from observed labels.
problem Learning meaningful disentangled causal representations from observed data.
method ICM-VAE framework using flow-based diffeomorphic functions and causal disentanglement prior.
result Induces highly disentangled causal factors and improves robustness.
New method disentangles latent factors for better treatment effect estimation.
problem Estimating treatment effects from observational data when confounders are not the only variables.
method Variational inference to disentangle latent factors into instrumental, confounding, and risk factors.
result The method improves treatment effect estimation accuracy on various datasets.
We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed discrete distribution and controlling the amount of information encoded in each latent…
C2VAE learns disentangled and coupled representations without prior knowledge.
problem Learning disentangled and coupled representations in latent space.
method Introduces C2VAE, a self-supervised VAE that factorizes posterior and uses Gaussian copula for dependencies. result Demonstrates strong effect in enhancing disentangled representation learning.
Discond-VAE separates continuous and discrete factors in data.
problem Separating shared and class-specific variations in real-world data.
method Introduces private and public latent variables to represent continuous and discrete factors, respectively.
result Discond-VAE successfully disentangles class-dependent continuous factors from discrete factors.
Boxhead dataset tests autoencoder disentanglement in hierarchical data.
problem Evaluate disentanglement in hierarchical data.
method Introduced Boxhead dataset with hierarchically structured factors, evaluated autoencoder models.
result Hierarchical models outperform single-layer VAEs in disentangling factors.
Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks, interpretability, etc. We consider the problem of unsupervised learning of disentangled rep…
New method for disentangling latent factors with sparse dependencies.
problem Disentangling latent factors from observed variables and past factors.
method Mechanism sparsity regularization and sparse causal graphical model.
result Identifiability of latent factors up to a sparse causal graph.
New framework for disentangling graph node and edge features.
problem Learning disentangled representations for attributed graphs with node and edge features.
method Proposes a novel variational objective and architecture for node and edge deconvolutions to disentangle latent factors.
result Demonstrates effectiveness of the proposed model and its extensions on synthetic and real-world datasets.
New metric for disentangling multivariate representations, accounting for more complex entanglements.
problem Current disentanglement metrics fail to detect entanglements involving more than two variables.
method Partial Information Decomposition framework to analyze information sharing and propose a new disentanglement metric.
result The proposed metric correctly identifies entanglements in high-dimensional spaces.
New method learns useful disentangled representations from weakly labeled data.
problem Learning useful representations from weakly labeled data.
method Model pairs of non-i.i.d. images, learn disentangled representations without requiring annotation.
result Learn disentangled representations reliably from pairs of images without requiring group, individual factor, or number of changed factors annotation.
A framework for disentangling class-related and class-independent factors in data.
problem Learning disentangled representations in variational autoencoders.
method Attention mechanism in latent space, mixture models, Bhattacharyya coefficient, semi-supervised training.
result Disentangles class-related and class-independent factors of variation.
Unified framework for disentangled representations using mechanistic independence.
problem Identifiability of disentangled latent factors under statistical dependencies.
method Introduces mechanistic independence to characterize latent factors by their actions on observed variables, proposing various independence criteria.
result Establishes conditions for identifiability of latent subspaces without statistical assumptions.
Proposes a new method for disentangling data representations using topological analysis.
problem Learning disentangled representations for better model explainability and robustness.
method Integrates a multi-scale topological loss term into the training of deep learning models.
result Improves disentanglement scores compared to state-of-the-art methods.
Study improves interpretability in generative models by disentangling latent variables in scientific datasets.
problem Extracting generative factors from complex, high-dimensional datasets in unsupervised or semi-supervised settings.
method Introducing Aux-VAE, a novel architecture within the VAE framework, which disentangles latent variables by guiding them with auxiliary variables.
result Aux-VAE achieves disentanglement with minimal modifications to the standard VAE loss function, validated on multiple datasets.
Model learns disentangled representations from natural videos.
problem Disentangling factors of variation in natural data.
method Sparse prior on temporally adjacent observations.
result Model reliably learns disentangled representations on natural data.
Paper addresses the disparity between sampled and mean representations in disentangled learning.
problem Disparity between sampled and mean representations in disentangled learning.
method Proposes a method to eliminate the disparity by proving and utilizing the relationship between total correlation of sampled and mean representations for multivariate normal distributions.
result Demonstrates that a factorized mean representation can have lower total correlation than the sampled representation.
Improved disentangled representation learning using a non-parametric latent density model.
problem Limited disentanglement in VAE due to constraints on latent density independence and complexity.
method Utilized the Indian Buffet Process (IBP) as a non-parametric latent density model to allow richer modeling capacity.
result IBP-VAE outperformed state-of-the-art VAEs in disentangling latent factors across various datasets.
DISCoVeR learns disentangled representations by separating shared and condition-specific factors.
problem Learning disentangled representations for multi-condition data.
method Dual-latent architecture, parallel reconstructions, max-min objective.
result DISCoVeR achieves improved disentanglement on various datasets.
ROVAE uses noisy pairwise comparisons to disentangle factors in VAEs.
problem Disentangling factors in VAEs requires an inductive bias.
method Robust Ordinal VAE (ROVAE) incorporates noisy pairwise ordinal comparisons to disentangle factors.
result ROVAE outperforms existing methods and is more robust to noisy comparisons.
MACRo-mIcro VAE learns disentangled user behavior representations.
problem Complex user behavior data in recommender systems are entangled; disentangling them enhances robustness and interpretability.
method MACRo-mIcro Disentangled Variational Auto-Encoder (MacridVAE) infers high-level user intentions and micro-disentangles preferences.
result Our approach achieves substantial improvement over state-of-the-art baselines and demonstrates interpretable and controllable learned representations.
IPGDN learns disentangled node representations in graphs.
problem Learning disentangled node representations in graph convolutional networks (GCNs).
method IPGDN uses neighborhood routing mechanism and HSIC to enforce independence among latent representations.
result IPGDN outperforms state-of-the-arts in graph classification, clustering, and visualization.
A method for disentangling latent variables using weak supervision based on pairwise similarities.
problem Disentangling latent variables without strong supervision.
method Weak supervision through binary or real-valued similarities, applied within a Variational Autoencoder framework.
result Utilizing weak supervision improves disentanglement performance substantially.
We analyze disentangled representations under a causal generative process, proposing new metrics and datasets.
problem Addressing fairness and interpretability through disentangled representations with a causal perspective.
method Work under a causal generative process, proposing new metrics and datasets to study disentanglement.
result Proposed metrics capture the desiderata of disentangled causal process.
This work proposes a model to disentangle image factors effectively and control their manipulation.
problem Controlling disentanglement during image editing while preserving object identity.
method Encoder-decoder architecture with decorrelation regularization and soft target representations.
result The model successfully disentangles image factors and manipulates them effectively.
New findings show disentangled latent representations are not enough for robust compositional generalization.
problem Deep learning models struggle with compositional generalization, especially in out-of-distribution samples.
method Investigated a 2D Gaussian generation task with fully disentangled inputs, then forced disentangled latent representations into full-dimensional output space.
result Forcing disentangled latent representations into full-dimensional output space enables robust compositional generalization.
New method disentangles shared and private latent factors in multimodal data.
problem Challenges in disentangling shared and private latent factors in multimodal data.
method Proposes a modification to existing multimodal Variational Autoencoders (MMVAE) to better handle modality-specific variation.
result Demonstrates improved robustness of modified MMVAE to modality-specific variation.
CausalVAE learns causal relationships in VAE models for better data disentanglement.
problem Learning disentanglement of independent factors from observational data.
method CausalVAE framework with a Causal Layer to transform exogenous factors into causal endogenous ones.
result CausalVAE learns semantically interpretable causal representations and accurately identifies their DAG structure.
A new method uses hyperspherical latent spaces to disentangle data with periodic structures.
problem Disentangling data with periodic or cyclic underlying factors in Euclidean space.
method Diffusion Variational Autoencoder with a modified Evidence Lower Bound.
result The method can recover periodic true factors effectively.
Method evaluates disentanglement in DLVMs, including those not aligned with latent axes.
problem Evaluate disentanglement in DLVMs, especially those not aligned with latent axes.
method Proposes a statistical method to discover generative factors of a dataset.
result Empirically demonstrates the advantage of the method on two datasets.
Learning the disentangled representation of interpretable generative factors of data is one of the foundations to allow artificial intelligence to think like people. In this paper, we propose the analogical training strategy for the unsupervised disentangled representation learning in generative models. The analogy is …
A new VAE model improves disentanglement with identifiable latent factors.
problem Learning disentangled representations without inductive biases.
method A novel VAE with a conditional prior over latent variables.
result Superior performance in disentanglement metrics.