Paper presents a reparameterized DP-DLGMM for clustering.
problem Non-parametric DP priors in DLGMM are hard to couple with variational inference.
method Closed-form updates for DP-DLGMM's variational posterior.
result Model generates realistic samples and performs competitively in semi-supervised settings.
This paper studies clustering and embedding in high-dimensional Gaussian mixture block models.
problem Clustering and embedding in high-dimensional Gaussian mixture block models.
method Spectral clustering and embedding algorithms for graphs sampled from Gaussian mixture block models.
result Performance analysis of spectral clustering and embedding algorithms for 2-component spherical Gaussian mixtures.
New method clusters longitudinal data with many time points.
problem Clustering longitudinal data with many time points.
method Extension of the mixture of common factor analyzers model with expectation-maximization algorithm for parameter estimation and Bayesian information criterion for model selection.
result The approach effectively clusters longitudinal data with many time points.
GPMM recovers latent signals from noisy mixtures using Bayesian inference.
problem Recovering latent signals from noisy mixed measurements.
method Gaussian process mixture of measurements (GPMM) with Bayesian inference.
result GPMM outperforms standard GP in signal recovery.
Proposes a new prior for deep generative models to capture latent properties.
problem Complex non-linear relationships between data and latent properties.
method Factorial mixture prior with Gaussian mixture models for quantization.
result Empirically evaluated method for learning discrete properties in unsupervised or semi-supervised settings.
The paper optimizes hyperplanes for binary classification in high-dimensional data with latent Gaussian mixtures.
problem Binary classification in high-dimensional data with latent Gaussian mixtures.
method Generalized least squares estimator for estimating the direction of the optimal separating hyperplane. Simple correction for intercept estimation.
result The procedure is minimax optimal in many scenarios and can retain the interpolation property.
Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced with squashed Gaussian distributions. This allows documents to be associated with e…
A mixture of Gaussians fit to a single curved or heavy-tailed cluster will report that the data contains many clusters. To produce more appropriate clusterings, we introduce a model which warps a latent mixture of Gaussians to produce nonparametric cluster shapes. The possibly low-dimensional latent mixture model allow…
A mixture of Gaussians fit to a single curved or heavy-tailed cluster will report that the data contains many clusters. To produce more appropriate clusterings, we introduce a model which warps a latent mixture of Gaussians to produce nonparametric cluster shapes. The possibly low-dimensional latent mixture model allow…
Method identifies latent variables from high-dimensional data with piecewise affine mixing.
problem Identifying latent variables from high-dimensional observations with dependencies and piecewise affine transformations.
method Proposes a two-stage method with sparsity and Gaussianity regularization.
result Effectively recovers ground-truth latent variables from synthetic and image data.
Model disentangles timbre and pitch for musical instruments.
problem Learning disentangled representations of musical instrument sounds.
method Gaussian mixture variational autoencoders with two separate encoders for timbre and pitch.
result Model successfully disentangles timbre and pitch, enabling controllable synthesis and transfer.
DGMM uses deep layers of Gaussian mixtures for flexible data modeling.
problem Efficiently modeling complex data relationships.
method Deep Gaussian Mixture Models (DGMM) with nested mixtures of linear models and factor models.
result DGMM provides a flexible nonlinear model for data description.
GMVAE improves open-set classification by clustering latent representations.
problem Improving open-set classification accuracy and robustness.
method Cooperative learning of reconstruction and clustering in the latent space of a GMVAE.
result Achieved an average F1 improvement of 29.5% in open-set classification.
Unified framework for clustering with auxiliary data.
problem Clustering with datasets reflecting similar but different latent structures.
method Adaptive Transfer Clustering (ATC) algorithm that optimizes bias-variance decomposition.
result ATC proves optimal under Gaussian mixture model and shows transfer benefits.
Proposes tGM-VAE for clustering and outlier detection in rs-fMRI.
problem Clustering major functional connectivity patterns in rs-fMRI data is hindered by noise and minor clusters.
method Uses a truncated Gaussian-mixture model within a Variational AutoEncoder framework.
result Demonstrates improved clustering and outlier detection in MNIST and rs-fMRI datasets.
Proposes a VAE with Student-t mixture model for authorship attribution.
problem Traditional authorship attribution in closed-set scenarios.
method Extends variational autoencoder with embedded Student-t mixture model. result Superior performance over existing methods on Amazon review dataset.
A scalable Gaussian process model using a mixture-of-experts approach.
problem Training Gaussian process models is computationally expensive and not scalable.
method A mixture-of-experts model with low-dimensional matrix inversions and importance sampling.
result The model offers comparable performance to Gaussian process regression at a lower computational cost.
PDGMM-VAE uses adaptive priors for better ICA recovery.
problem Nonlinear ICA recovery of latent source signals.
method Adaptive per-dimension Gaussian mixture model priors in a variational autoencoder.
result PDGMM-VAE effectively recovers source-specific non-Gaussian marginals.
This paper presents a new model called infinite mixtures of multivariate Gaussian processes, which can be used to learn vector-valued functions and applied to multitask learning. As an extension of the single multivariate Gaussian process, the mixture model has the advantages of modeling multimodal data and alleviating…
VLAC clusters data hierarchically, outperforming GMM.
problem Clustering with multiple attributes or hierarchies.
method Disentangled latent representations for hierarchical clustering.
result VLAC outperforms Gaussian Mixture Models in clustering accuracy.
UT module refines VAE latent space, improving disentanglement and interpretability.
problem Irregular latent distributions cause posterior collapse and misalignment in VAEs.
method UT module uses G-KDE clustering, GM modeling, and PIT to transform latent space into uniform distribution.
result UT module enhances disentanglement and interpretability of latent representations.
Modeling the Drosophila connectome using semiparametric spectral methods.
problem Understanding the structure and function of the Drosophila mushroom body network.
method Semiparametric spectral modeling, latent structure model (LSM), Gaussian mixture modeling (GMM), adjacency spectral embedding (ASE).
result Captures latent connectome structure and elucidates neuronal properties.
Study learns Gaussian mixtures from censored data.
problem Learning Gaussian mixtures with incomplete data.
method Proposes an algorithm to estimate weights and means with minimal samples.
result Achieves accurate estimation with very few samples.
The paper explores methods for inference in multiplicative latent force models.
problem Inference in hybrid models combining mechanistic and flexible components.
method Two methods of approximate inference: gradient matching and mixtures of local approximations.
result Comparison of methods on simulated and motion capture data.
Corrected whitening restores orthogonality in high-dimensional spherical Gaussian mixtures.
problem In high-dimensional data, standard whitening fails to preserve orthogonality of mixture means.
method Derived exact limits for whitened means dot products using random matrix theory, constructed a corrected whitening matrix.
result Corrected whitening allows for improved estimation of spherical Gaussian mixtures in the large-dimensional regime.
Develops a new unsupervised clustering method using Variational Information Bottleneck and Gaussian Mixture Model.
problem Unsupervised clustering of unlabeled data.
method Combines Variational Information Bottleneck and Gaussian Mixture Model in a deep neural network framework.
result Derives a new bound on the cost function and provides an algorithm for efficient computation.
Efficient algorithms for sparse parameter recovery in mixture models.
problem Support recovery of high-dimensional sparse latent vectors in mixture models.
method Efficient algorithms with logarithmic sample complexity dependence on dimensionality.
result First guarantees on support recovery for various mixture models.
The paper proves variational Bayes methods are statistically optimal under certain conditions.
problem Justification of variational Bayes methods for parameter estimation.
method General conditions for optimal risk bounds in mean-field variational Bayesian inference.
result Optimal risk bounds for variational Bayes estimates are achievable under specific conditions.
The paper stabilizes invertible neural networks by using Gaussian mixture models.
problem Invertible neural networks can have exploding Lipschitz constants, leading to numerical errors.
method The authors use Gaussian mixture models to stabilize the latent distribution of invertible neural networks.
result Numerical simulations confirm that this modification improves sampling quality in multimodal applications.
A model for time-sequence analysis infers latent functions automatically.
problem Understanding the structure of multiple time-sequences.
method Bayesian nonparametric Poisson process allocation (BaNPPA) with Gaussian process latent functions.
result The model infers the number of latent functions automatically and is computationally efficient.
Proposes a new model for mixed membership in Gaussian mixture.
problem Limited to single component membership in Gaussian mixture models.
method Mixed membership sub-Gaussian model, spectral algorithm.
result Estimation error can be made arbitrarily small with high probability.
Generative networks improve by embedding data into a metric space.
problem Mode collapse in GANs.
method Metric embedding of data into l2 space, using Gaussian mixture model.
result GANs generate samples spanning most modes without mode collapse.
The paper tackles model collapse in GPLVMs by improving kernel flexibility and projection variance.
problem Model collapse in GPLVMs leading to vague latent representations.
method Theoretical analysis of projection variance, integration of SM and RFF kernels, and variational inference.
result The advisedRFLVM outperforms competing models in informative latent representations and missing data imputation.
Improved vector quantization using Gaussian mixtures for better codebook utilization.
problem Training instability and information loss in discrete vector quantization.
method Generalized vector quantization with Gaussian mixture model and aggregated categorical posterior evidence lower bound.
result GM-VQ improves codebook utilization and reduces information loss without heuristics.
Improves VAEs for generating data from mixed distributions.
problem Inability of VAEs to generate from individual data modalities.
method Conditional Prior VAE (CP-VAE) with two-level generative process.
result Generations from individual mixture components of multimodal data.
VampPrior Mixture Model improves clustering in DLVMs.
problem Simplicity of standard priors in DLVMs leads to poor clustering performance.
method Leverages VampPrior concepts to fit a Bayesian GMM prior in a VAE.
result VMM achieves highly competitive clustering performance on benchmark datasets.
GGMPs improve non-Gaussian conditional density estimation.
problem Multimodality, heteroscedasticity, and strong non-Gaussianity in conditional density estimation.
method GGMP combines local Gaussian mixture fitting, cross-input component alignment, and per-component heteroscedastic GP training.
result GGMPs improve distributional approximation on synthetic and real-world datasets.
A new clustering model for mixed datasets combines continuous and non-continuous data.
problem Challenges in clustering mixed data due to heterogeneous variables.
method Mixed Deep Gaussian Mixture Model (MDGMM) with multilayer architecture.
result Automatic selection of model specifications and optimal number of clusters.
VBphenoR uses variational Bayes for EHR-based patient phenotyping.
problem Phenotyping patients from EHR data for targeted treatments.
method Variational Bayes Gaussian Mixture Model (GMM) and logistic regression.
result Closed-form inference for efficient patient phenotype determination.
X-VAE uses data-adaptive Gaussian priors to improve latent space modeling.
problem Limitations of standard Gaussian priors in complex datasets.
method Data-adaptive Gaussian prior derived from pretrained autoencoder latent codes.
result Improved latent space modeling and generation quality.
Enhances text generation interpretability with a mixture of exponential family distributions.
problem Limited interpretability in text generation models.
method Introduced Dispersed Exponential Family Mixture VAEs (DEM-VAE) with a mixture of exponential family distributions and an extra dispersion term to train the model.
result Demonstrated improved interpretability and generation quality compared to strong baselines.
MMGAN stabilizes GANs for multi-modal data clustering.
problem Stability and data distribution loss in GANs for multi-modal data.
method Model latent space as Gaussian mixture model, clusters data manifolds, and trains with clustering network.
result MMGAN outperforms state-of-the-art models in clustering multi-modal data.
Model detects epileptic seizures in EEG with high sensitivity.
problem Detecting epileptic seizures in EEG signals.
method Time-series scale mixture model with hidden Markov structure.
result Model outperformed baselines in seizure detection.
GMVAEs cluster and generate game levels without labels.
problem Manual exploration of latent space for VAE-generated game levels.
method Apply Gaussian Mixture VAEs (GMVAEs) to learn latent clusters and generate levels.
result GMVAEs can cluster and generate game levels without requiring labels.
Unified model for reducing dimensions and clustering high-dimensional data.
problem High-dimensional data clustering and dimensionality reduction.
method Hierarchical mixtures of Gaussians (HMoGs) with closed-form likelihood and inference.
result Efficiently models hundreds of latent dimensions, improving clustering performance.
Mixture of multi-task GPs for clustering and prediction of functional data.
problem Handling multi-task learning, clustering, and prediction for functional data.
method A mixture of multi-task Gaussian processes with a variational EM algorithm for hyper-parameter optimization.
result Enhanced predictive performance for group-structured data.
DGPs learn from multiple tasks using shared and private latent processes.
problem Improving learning performance and information transfer between tasks.
method Non-linear mixtures of latent processes with shared and task-specific components, using hard or soft sharing.
result DGPs outperform other multi-task learning models across various settings.
Improved clustering and anomaly detection using latent space conditioning.
problem Anomaly detection on unlabeled data.
method Conditional latent space variational autoencoder (cLSVAE) that separates latent space by conditioning on data labels.
result The method outperforms typical variational autoencoders in clustering and anomaly detection.