arXiv research

HiLLoC compresses large images losslessly using VAEs.

VAEs analyzed using harmonic analysis, showing how variance controls frequency content and robustness.

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the latter, however, and failure to do so leads to a frequent failure mode called posteri…

We present a simple neural rendering architecture that helps variational autoencoders (VAEs) learn disentangled representations. Instead of the deconvolutional network typically used in the decoder of VAEs, we tile (broadcast) the latent vector across space, concatenate fixed X- and Y-"coordinate" channels, and apply a…

SHVC improves image compression with fewer parameters.

Variational autoencoders (VAEs) defined over SMILES string and graph-based representations of molecules promise to improve the optimization of molecular properties, thereby revolutionizing the pharmaceuticals and materials industries. However, these VAEs are hindered by the non-unique nature of SMILES strings and the c…

NeRF-VAE generates 3D scenes with geometric structure from few images.

Unsupervised mesh disentanglement separates identity and pose.

A hybrid Convolutional VAE predicts crypto volatility surfaces, outperforming single-symbol approaches.

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their extensions rely on graph convolutional networks (GCN) to learn vector space repres…

Convolutional networks outperform fully-connected ones in certain tasks.

ES-VAE models skeletal pose trajectories by removing nuisance factors.

Predicting smartphone users location with WiFi fingerprints has been a popular research topic recently. In this work, we propose two novel deep learning-based models, the convolutional mixture density recurrent neural network and the VAE-based semi-supervised learning model. The convolutional mixture density recurrent …

Unsupervised learning of disentangled representations is an open problem in machine learning. The Disentanglement-PyTorch library is developed to facilitate research, implementation, and testing of new variational algorithms. In this modular library, neural architectures, dimensionality of the latent space, and the tra…

Improved disentanglement in VAEs using aggregated feature maps.

Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory recurrent neural network (LSTM RNN) sub-modules for time series classification. Our …

A framework connects VAEs to GLMs for better model initialization and performance.

Improved VAE estimation from incomplete data using variational mixtures.

Variational Autoencoders (VAEs) are powerful in data representation inference, but it cannot learn relations between features with its vanilla form and common variations. The ability to capture relations within data can provide the much needed inductive bias necessary for building more robust Machine Learning algorithm…

Generative Adversarial Networks (GANs) are a powerful class of generative models. Despite their successes, the most appropriate choice of a GAN network architecture is still not well understood. GAN models for image synthesis have adopted a deep convolutional network architecture, which eliminates or minimizes the use …

Convolutional nets require fewer samples than fully-connected nets for image classification.

NVAE improves VAE performance on large image datasets.

DAEs can generate images without additional loss terms, inheriting VAE properties.

GD-VAEs learn dynamics from observations using geometric and topological information.

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data for the current one is available. We address this problem of continual learning …

Paper presents efficient algorithms for convolutional neural networks using Winograd minimal filtering.

The study shows removing fully connected output layers improves efficiency without sacrificing performance.

This paper proposes a non-parallel many-to-many voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE (ACVAE). The proposed method has three key features. First, it adopts fully convolutional architectures to construct the encoder and decoder ne…

Direct optimization of binary latent VAEs achieves competitive results without sampling.

A new VAE model improves disentanglement with identifiable latent factors.

This article demonstrates that convolutional operation can be converted to matrix multiplication, which has the same calculation way with fully connected layer. The article is helpful for the beginners of the neural network to understand how fully connected layer and the convolutional layer work in the backend. To be c…

We introduce a deep learning method to simulate the motion of particles trapped in a chaotic recirculating flame. The Lagrangian trajectories of particles, captured using a high-speed camera and subsequently reconstructed in 3-dimensional space, were used to train a variational autoencoder (VAE) which comprises multipl…

Simpler linear models outperform complex GCN encoders for graph tasks.

We propose a novel VAE-based deep auto-encoder model that can learn disentangled latent representations in a fully unsupervised manner, endowed with the ability to identify all meaningful sources of variation and their cardinality. Our model, dubbed Relevance-Factor-VAE, leverages the total correlation (TC) in the late…

Proves DCNNs with expansive convolution are strongly universally consistent.

A graph VAE framework optimizes neural architectures in a continuous space.

Variational autoencoders (VAE) have quickly become a central tool in machine learning, applicable to a broad range of data types and latent variable models. By far the most common first step, taken by seminal papers and by core software libraries alike, is to model MNIST data using a deep network parameterizing a Berno…

Geometric interpretation improves VAE performance and robustness.

New method learns convolution-like structures from scratch.

Paper uses CNNs for eye tracking data segmentation, generation, and reconstruction.

Develops a method for lossless compression using latent variable models.

Paper presents a semi-supervised grasp detection method using VQ-VAE.

An ability to model a generative process and learn a latent representation for speech in an unsupervised fashion will be crucial to process vast quantities of unlabelled speech data. Recently, deep probabilistic generative models such as Variational Autoencoders (VAEs) have achieved tremendous success in modeling natur…

Personalization of cardiac models involves the optimization of organ tissue properties that vary spatially over the non-Euclidean geometry model of the heart. To represent the high-dimensional (HD) unknown of tissue properties, most existing works rely on a low-dimensional (LD) partitioning of the geometrical model. Wh…

Generative Adversarial Nets (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but the underlying mathematics are not well understood. We compute deep convolutional network generators by inverting a fixed embedding operator. Therefore, they do not require to be o…

Improved disentanglement of data factors using recursive training.

A new text representation model combines CNN and VAE for better semantic extraction.

A new Multi-Stream VAE separates multiple sources in images and audio.