A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Paper proposes a new method to handle missing data in medical records using sequential variational autoencoders.
A semi-recurrent hybrid VAE-GAN model for generating sequential data is introduced. In order to consider the spatial correlation of the data in each frame of the generated sequence, CNNs are utilized in the encoder, generator, and discriminator. The subsequent frames are sampled from the latent distributions obtained b…
VQ-DRAW compresses images and generates realistic samples.
Paper improves VAEs using Monte Carlo methods.
This paper reviews and benchmarks DVAEs for sequential data.
This paper improves level generation using VAEs for coherent, logically following segments.
A new method for effective VAE training using calibrated decoders.
DD-VAE uses deterministic decoding for better latent code utilization in discrete data.
Temporal VAE improves VaR estimation for financial portfolios.
The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a distribution. Here, we propose an extension of the VAE framework that incorporates a classi…
Status prediction and anomaly detection are two fundamental tasks in automatic IT systems monitoring. In this paper, a joint model Predictor & Anomaly Detector (PAD) is proposed to address these two issues under one framework. In our design, the variational auto-encoder (VAE) and long short-term memory (LSTM) are joine…
We improve a graph generation model to accurately recover Barabási-Albert graph parameters.
This work addresses identifiability in sequential data with switching dynamics, introducing a new estimator.
The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling approach to compress temporal sequences with a focus on video. Our approach builds upon…
Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data for the current one is available. We address this problem of continual learning …
Proposes a VAE with a discrete bottleneck for better text generation.
We present Ordinary Differential Equation Variational Auto-Encoder (ODEVAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in deep generative models, ODEVAE can simultaneously learn the embedding of high dimensional trajectories and infer arbitrarily complex conti…
Algorithm optimizes measurement sequence to minimize data acquisition.
The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we demonstrate, existing recurrent VAE models have difficulty modeling sequences with long-te…
Sequential data often originates from diverse domains across which statistical regularities and domain specifics exist. To specifically learn cross-domain sequence representations, we introduce disentangled state space models (DSSM) -- a class of SSM in which domain-invariant state dynamics is explicitly disentangled f…
VAEM extends VAEs to handle mixed-type data heterogeneity.
Recent neural text-to-speech (TTS) models with fine-grained latent features enable precise control of the prosody of synthesized speech. Such models typically incorporate a fine-grained variational autoencoder (VAE) structure, extracting latent features at each input token (e.g., phonemes). However, generating samples …
Model change points in time-series data with neural SDEs and variational autoencoders.
Self-reflective VAE improves inference and generative modeling without complex components.
Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the likelihood of the data. In this paper, we propose an alternative that utilizes t…
Proposes a method to improve SLMC for multimodal distributions.
CTGAN synthesizes population data for travel behavior simulation.
SYNC learns time-aware causal representations to improve model generalization in evolving domains.
Generative models of graph structure have applications in biology and social sciences. The state of the art is GraphRNN, which decomposes the graph generation process into a series of sequential steps. While effective for modest sizes, it loses its permutation invariance for larger graphs. Instead, we present a permuta…
Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical data imputation methods in this domain. However, naive applications of deep learn…
In this paper, we integrate VAEs and flow-based generative models successfully and get f-VAEs. Compared with VAEs, f-VAEs generate more vivid images, solved the blurred-image problem of VAEs. Compared with flow-based models such as Glow, f-VAE is more lightweight and converges faster, achieving the same performance und…
We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and formally show that common issues such as blurry samples and uninformative latent feat…
Variational autoencoders were proven successful in domains such as computer vision and speech processing. Their adoption for modeling user preferences is still unexplored, although recently it is starting to gain attention in the current literature. In this work, we propose a model which extends variational autoencoder…
This work tackles posterior collapse in conditional and hierarchical VAEs.
A new method scales Gaussian process variational autoencoders to handle high-dimensional time series.
BS-VAE separates decoder variance and beta to improve VAE performance.
A tutorial on VAEs explaining its derivation and applications.
This paper introduces Associative Compression Networks (ACNs), a new framework for variational autoencoding with neural networks. The system differs from existing variational autoencoders (VAEs) in that the prior distribution used to model each code is conditioned on a similar code from the dataset. In compression term…
New system for i-vector speaker recognition based on variational autoencoder (VAE) is investigated. VAE is a promising approach for developing accurate deep nonlinear generative models of complex data. Experiments show that VAE provides speaker embedding and can be effectively trained in an unsupervised manner. LLR est…
The paper provides convergence guarantees for VAEs using SGD and Adam.
VAEs help in learning latent variables for cryo-EM applications.
PRI-VAE learns disentangled representations by optimizing principle-of-relevant-information.
CVAE learns disentangled and coupled representations without prior knowledge.
Variational autoencoders (VAEs) have ushered in a new era of unsupervised learning methods for complex distributions. Although these techniques are elegant in their approach, they are typically not useful for representation learning. In this work, we propose a simple yet powerful class of VAEs that simultaneously resul…
NE-VAE prevents posterior collapse in VAEs by embedding neighbors in latent space.
The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the generator. In our work modeling US postal addresses, we show that our discrete VAE wit…
q-VAE extracts disentangled latent spaces for robot control and dynamic systems.
Single training run learns optimal VAE parameters for various β values.