LSI enables joint learning of latent variables and generative models.
problem Joint optimization of latent variables and generative models.
method Developed a principled ELBO objective in continuous time for joint learning.
result LSI learns effective latent representations and generative transformations.
Investigates latent variable models for useful generative concept representations.
problem Creating latent representations that support various concepts and attributes.
method Latent variable modeling, including latent variable models, latent representations, and latent spaces.
result Hierarchical latent representations and latent space vectors and geometry are effective for generative concept representations.
Enhances interpolation paths in latent space using particle filters.
problem Generating meaningful interpolations between data points in latent space.
method Introduces a discriminator network to guide particle filter sampling of interpolation paths.
result Improved variability and stronger drift towards high data density areas.
LVM-GP solves PDEs with uncertainty using latent variables and Gaussian processes.
problem Uncertainty quantification in PDE solutions with noisy data.
method Combines latent variable model and Gaussian process for uncertainty-aware prediction.
result Efficiently captures functional dependencies and robust uncertainty quantification.
EXoN creates an explainable latent space for semi-supervised learning.
problem Creating an explainable latent space for semi-supervised learning.
method EXoN combines VAE with SCI (Soft-label Consistency Interpolation) to create an explainable latent space.
result EXoN reduces the cost of investigating representation patterns on the latent space.
LOL method simplifies forming linear combinations of latent variables.
problem Lack of general-purpose methods for manipulating latent variables.
method Latent Optimal Linear combinations (LOL) method.
result LOL simplifies creation of expressive low-dimensional representations.
Deep learning system generates new Chinese fonts via style variables.
problem Efficiently design new Chinese fonts.
method End-to-end deep learning system generating new style fonts via interpolation of latent style-related embedding variables.
result Smooth transition between different font styles achieved.
Generative Adversarial networks (GANs) have obtained remarkable success in many unsupervised learning tasks and unarguably, clustering is an important unsupervised learning problem. While one can potentially exploit the latent-space back-projection in GANs to cluster, we demonstrate that the cluster structure is not re…
SentenceMIM learns rich latent representations for variable-length language data.
problem Challenges in learning VAEs for variable-length language data, especially posterior collapse.
method Probabilistic auto-encoder trained with Mutual Information Machine (MIM) learning.
result SentenceMIM learns informative latent representations with high mutual information.
Proposes a geometry-aware VAE for better latent space modeling.
problem Lack of meaningful latent space structure in VAEs for small datasets.
method Introduces a Riemannian Hamiltonian VAE with a learned metric.
result Improves latent space structure leading to better interpolations and data generation.
We improve autoencoder image interpolation by shaping latent space.
problem Incongruities in autoencoder interpolation leading to artifacts or unrealistic results.
method Propose a regularization technique to shape latent space to follow a smooth, locally convex manifold consistent with training images.
result Faithful interpolation between data points achieved.
This work predicts and interpolates long-range videos using unsupervised landmarks.
problem Predicting and interpolating long-range video data with occlusions and appearance changes.
method Unsupervised latent structure inference followed by temporal prediction in a latent space.
result High-quality long-range video interpolation and extrapolation achieved through landmark representation.
Paper presents a unified approach to interpolation and geodesics in latent spaces of generative models.
problem Finding geodesics and interpolating in latent spaces of non-Gaussian densities.
method General approach to interpolation and geodesics in latent space for arbitrary density.
result Maximizing quality measure of an interpolating curve is equivalent to finding geodesic.
We present a neural network architecture based upon the Autoencoder (AE) and Generative Adversarial Network (GAN) that promotes a convex latent distribution by training adversarially on latent space interpolations. By using an AE as both the generator and discriminator of a GAN, we pass a pixel-wise error function acro…
This paper improves probabilistic latent models on hyperbolic spaces.
problem Uncertainty in predictions due to geodesics crossing low-data regions.
method Augmenting hyperbolic manifold with a pullback metric for probabilistic pullback metrics.
result Geodesics on pullback metric respect both geometry and data distribution, reducing uncertainty.
Autoencoders provide a powerful framework for learning compressed representations by encoding all of the information needed to reconstruct a data point in a latent code. In some cases, autoencoders can "interpolate": By decoding the convex combination of the latent codes for two datapoints, the autoencoder can produce …
Generative model learns shape drift for quantifying domain uncertainty in hemodynamics.
problem Quantifying domain uncertainty in medical image segmentation for biomarker estimation.
method Conditional stochastic interpolant framework based on LDDMM registration.
result Generative model can create random perturbations of shapes for biomarker estimation.
Generative models learn manifold structure; new approach uses atlas and geodesic interpolation.
problem Challenges in representing manifolds with topology different from Euclidean space.
method Atlas Generative Models (AGMs) with hybrid latent spaces and geodesic interpolation.
result Geodesic interpolation can be extended to AGMs, improving manifold representation.
Deep generative models provide a systematic way to learn nonlinear data distributions, through a set of latent variables and a nonlinear "generator" function that maps latent points into the input space. The nonlinearity of the generator imply that the latent space gives a distorted view of the input space. Under mild …
New model generates realistic single-cell gene expression data.
problem Generating realistic single-cell gene expression profiles is challenging.
method scLDM, a latent diffusion model using Diffusion Transformers and linear interpolants.
result Superior performance in generating realistic single-cell gene expression data.
We investigate the properties of multidimensional probability distributions in the context of latent space prior distributions of implicit generative models. Our work revolves around the phenomena arising while decoding linear interpolations between two random latent vectors -- regions of latent space in close proximit…
We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the necessary algorithms to compute expected metric tensors where the distribution over…
The paper optimizes hyperplanes for binary classification in high-dimensional data with latent Gaussian mixtures.
problem Binary classification in high-dimensional data with latent Gaussian mixtures.
method Generalized least squares estimator for estimating the direction of the optimal separating hyperplane. Simple correction for intercept estimation.
result The procedure is minimax optimal in many scenarios and can retain the interpolation property.
Improves latent space structure for better data representation.
problem Limited ability of conventional priors to encode data manifold structure.
method Introduces an Encoded Prior Sliced Wasserstein AutoEncoder with iterative training and geodesic interpolation.
result Learned manifold encoding preserves topological and geometric properties of data.
Generative models synthesize microstructures respecting physical invariances.
problem Synthesizing microstructures given limited images and physical constraints.
method Three generative models: WGAN, physics-informed GAN, and hybrid model.
result Synthesized microstructures respect physical invariances and latent variable constraints.
In implicit models, one often interpolates between sampled points in latent space. As we show in this paper, care needs to be taken to match-up the distributional assumptions on code vectors with the geometry of the interpolating paths. Otherwise, typical assumptions about the quality and semantics of in-between points…
Improves clustering performance by mixing latent representations.
problem Finding well-defined clusters in data representations.
method Mixing Consistent Deep Clustering method that encourages realistic interpolations and semantic consistency.
result Improved clustering performance across various models and datasets.
MTDS improves sequence generation adaptability via latent code control.
problem Lack of adaptability in sequence generation models like RNNs.
method Hierarchical multi-task dynamical systems (MTDS) with latent code control.
result MTDS enables style transfer, interpolation, and morphing in generated sequences.
This study proposes a method to generate biosignals with controlled characteristics using GANs and latent variable analysis.
problem Unclear relationship between input and generated data from GANs, inability to control generated data characteristics.
method Recurrent GANs with latent variable analysis using CCA to control generated biosignals.
result Effective control of biosignal characteristics using proposed GAN method and latent variable analysis.
A semi-supervised framework using stochastic interpolation and latent representations.
problem Challenges in conditional generative modeling with scarce labeled data.
method Combines conditional stochastic interpolation with low-dimensional latent representations.
result Significantly improves sample complexity and achieves faster convergence rate.
New approach uses interpolation models and error bounds for verifiable scientific machine learning.
problem Challenges in verifying and validating modern scientific machine learning workflows.
method Combines multiple standard interpolation techniques with error bounds for efficient computation and comparative performance analysis.
result Error bounds for interpolation techniques can be computed or estimated efficiently, aiding in validation goals.
FFRK automatically extracts features for spatial interpolation without external variables.
problem Spatial interpolation challenges, especially nonstationarity and lack of explanatory variables.
method Feature-Free Regression Kriging (FFRK) method that extracts geospatial features.
result FFRK outperforms classical methods in predicting heavy metal concentrations.
Proposes a new method for feature selection using Bayesian ID with intervention.
problem Feature selection in data with varying importance.
method Probabilistic model for interpolative decomposition with Bayesian inference and Gibbs sampling.
result The proposed Bayesian ID algorithm with intervention selects features with higher priority and comparable reconstructive errors.
New method certifies generative models' robustness.
problem Certifying generative models' robustness is challenging due to non-convex sets.
method ApproxLine, a scalable certification method capturing infinite sets or distributions over them.
result ApproxLine provides sound deterministic and probabilistic guarantees.
Paper analyzes latent space geometry in generative models using Fisher information.
problem Understanding the structure of latent spaces in generative models.
method Reconstructs Fisher information metric from generated samples and posterior distribution.
result Reveals fractal structure and abrupt changes in Fisher metric at phase boundaries.
Proposes a model to handle mobile health data with irregular measurements.
problem Handling heterogeneous, multi-resolution data in mobile health.
method Individualized dynamic latent factor model for irregular multi-resolution time series data.
result Superior performance compared to existing methods in simulation and smartwatch data applications.
Proposes CLSM for better subsequence generation in music sequences.
problem Editing subsequences in music sequences without losing context.
method Context-informed prior and decoder for generative model, context position-informed encoder for inference.
result Contextual latent space is smoother in interpolation and generates higher quality samples.
A new method for generating realistic and creative 3D shapes from point clouds.
problem Generating realistic and creative 3D shapes from point clouds.
method Learning to interpolate point clouds by encoding prior knowledge about real-world objects.
result Generated 3D shapes are both realistic and creative, unlike any existing forms.
LOCA learns standardized data coordinates from measurements.
problem Learning invariant data coordinates from non-linearly deformed manifolds.
method LOCA, a LOcal Conformal Autoencoder, learns an isometric embedding.
result LOCA preserves geometric information while learning invariant coordinates.
Proposes learning a hierarchical prior in VAEs to avoid over-regularization.
problem Over-regularization in VAEs with standard normal priors.
method Formulates as a constrained optimisation problem, introduces graph-based interpolation.
result Learned latent representation reflects data manifold topology and properties.
Adversarial autoencoder improves music latent space learning.
problem Learning effective latent spaces for symbolic music data.
method Adversarial regularization with Gaussian mixtures.
result MusAE outperforms standard VAEs in reconstruction and interpolation.
A new model for point processes without intensity function trade-offs.
problem Inefficiency and trade-offs in existing point process models.
method Point Set Diffusion, a diffusion-based latent variable model.
result Achieves state-of-the-art performance in point process generation.
The paper proposes a method for generating uniform interpolations on data manifolds.
problem Generating high-quality interpolations between data samples on complex manifolds.
method Autoencoder network with interpolation network, regularized by a Riemannian metric.
result The method generates interpolations that remain within the manifold's distribution.
We introduce several techniques for sampling and visualizing the latent spaces of generative models. Replacing linear interpolation with spherical linear interpolation prevents diverging from a model's prior distribution and produces sharper samples. J-Diagrams and MINE grids are introduced as visualizations of manifol…
New method learns under latent group sparsity using network dynamics.
problem Sparse learning under latent group structure without prior group information.
method Heat-flow-based local network dynamics incorporating Laplacian geometry.
result Automatic interpolation between lasso and group lasso penalties.
PFM generates novel samples on data manifolds using pullback geometry.
problem Generating novel samples on complex data manifolds.
method Pullback Flow Matching framework leveraging pullback geometry and isometric learning.
result PFM achieves improved manifold learning and generative performance.
A new method generates meta-tasks using generative models for unsupervised learning.
problem Creating synthetic meta-tasks for unsupervised learning.
method Generative models with latent space interpolation for sampling.
result The method outperforms or is competitive with baselines on few-shot classification tasks.
Generative Latent Implicit Conditional Optimization (GLICO) learns from small samples.
problem Learning from small labeled datasets.
method Generative Latent Implicit Conditional Optimization (GLICO) learns a latent space and generator from small labeled data.
result GLICO synthesizes new samples for every class using as few as 10 examples per class.