Improved VAE estimation from incomplete data using variational mixtures.
problem Estimating VAEs from incomplete data increases posterior complexity.
method Introducing variational mixtures based on finite and imputation distributions.
result Variational mixtures improve VAE estimation accuracy from incomplete data.
New method clusters matrix-variate data with outliers.
problem Clustering matrix-variate data with outliers.
method Iterative approach using subset log-likelihoods.
result Extends OCLUST algorithm to matrix-variate normal data.
New method disentangles shared and private latent factors in multimodal data.
problem Challenges in disentangling shared and private latent factors in multimodal data.
method Proposes a modification to existing multimodal Variational Autoencoders (MMVAE) to better handle modality-specific variation.
result Demonstrates improved robustness of modified MMVAE to modality-specific variation.
New method reduces inference variance for faster optimization.
problem High variance in black-box variational inference.
method Joint control variate addressing both data subsampling and Monte Carlo noise.
result Significantly reduced gradient variance, leading to faster optimization.
Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear whether the fixed point identified by the variational inference algorithm is a local…
New formulas for coassociative submanifolds' volume variation.
problem Understanding volume changes in coassociative submanifolds.
method Proved new variation formulae using G2 data. result Highlight the role of ambient torsion and Ricci curvature in volume changes.
A practical guide to Variational Bayes methods.
problem Bayesian inference for data analysis practitioners.
method Explains and demonstrates commonly used Variational Bayes methods.
result Quick derivation and implementation of VB algorithms.
New method models longitudinal data using variational inference and normalizing flows.
problem Handling high-dimensional longitudinal data with time dependency.
method Variational inference with normalizing flows for latent variables.
result The method achieves better likelihood estimates and more reliable missing data imputation.
Over the years data has become increasingly higher dimensional, which has prompted an increased need for dimension reduction techniques. This is perhaps especially true for clustering (unsupervised classification) as well as semi-supervised and supervised classification. Although dimension reduction in the area of clus…
Research in several fields now requires the analysis of data sets in which multiple high-dimensional types of data are available for a common set of objects. In particular, The Cancer Genome Atlas (TCGA) includes data from several diverse genomic technologies on the same cancerous tumor samples. In this paper we introd…
This paper presents a multi-dimensional computational method to predict the spatial variation data inside and across multiple dies of a wafer. This technique is based on tensor computation. A tensor is a high-dimensional generalization of a matrix or a vector. By exploiting the hidden low-rank property of a high-dimens…
Variational inference is an umbrella term for algorithms which cast Bayesian inference as optimization. Classically, variational inference uses the Kullback-Leibler divergence to define the optimization. Though this divergence has been widely used, the resultant posterior approximation can suffer from undesirable stati…
In recent years, data have become increasingly higher dimensional and, therefore, an increased need has arisen for dimension reduction techniques for clustering. Although such techniques are firmly established in the literature for multivariate data, there is a relative paucity in the area of matrix variate, or three-w…
tvGP-VAE models tensor-valued latent variables with Gaussian processes for better data structure representation.
problem Agnostic latent variables in VAEs ignore data structure correlations.
method Proposes tensor-variate Gaussian process prior for variational autoencoder.
result Explicitly modeling correlation structures improves model performance in reconstruction.
New method calibrates predictions in chaotic systems using variational inference.
problem Uncertainty in data assimilation for chaotic systems.
method Variational inference applied to multivariate Gaussian distribution.
result Nearly perfectly calibrated predictions in chaotic Lorenz-96 dynamics.
Variational inference (VI) combined with data subsampling enables approximate posterior inference over large data sets, but suffers from poor local optima. We first formulate a deterministic annealing approach for the generic class of conditionally conjugate exponential family models. This approach uses a decreasing te…
A new meta-learning method using shared variational inference.
problem Meta-learning with uncertainty over model parameters.
method Shared amortized variational inference network for conditional prior and posterior.
result Prevents collapse of conditional prior to Dirac delta function.
Integrative analysis of disparate data blocks measured on a common set of experimental subjects is a major challenge in modern data analysis. This data structure naturally motivates the simultaneous exploration of the joint and individual variation within each data block resulting in new insights. For instance, there i…
Optimal pre-processing reduces disparate impact by minimizing total variation distance.
problem Achieving fairness in data outputs based on protected attributes.
method Using pre-processing to enforce fairness, minimizing total variation distance between pre-processed and original data distributions.
result The problem of fairness can be formulated as a linear program, efficiently solvable.
Bayesian neural networks ignore data in infinite units limit.
problem Pathological behavior of posterior in over-parameterized networks.
method Mean-field variational inference in infinite hidden units limit.
result Posterior mean converges to zero, ignoring data.
Improved multimodal variational models capture more complex joint distributions.
problem Limited expressiveness of multimodal variational models.
method Used normalizing flows to approximate and transform a simple parametric joint posterior into a more complex one.
result The model improves on state-of-the-art multimodal variational methods on various tasks.
Self-supervised VAEs improve data compression and generation.
problem Efficient data compression and generation.
method Introducing self-supervised Variational Auto-Encoders with deterministic and discrete variational posteriors.
result Self-supervised VAEs simplify the objective function and improve data reconstruction.
New clustering algorithm for time series data using RNN and variational Bayes.
problem Lack of generative model-based clustering methods for time series data.
method Recurrent Neural Network (RNN) with variational Bayes method.
result Robustness against phase shift, amplitude, and signal length variations.
Optimizes variational autoencoder for detecting missing data in Mars rover transmissions.
problem Detecting missing data in Mars rover transmissions to prevent volume loss and corruption.
method Applies derivative-free optimization to tune variational autoencoder.
result Improves variational autoencoder's ability to detect missing data, aiding GDSA team.
This paper learns variational models and solvers for inverse problems from incomplete data.
problem Solving inverse problems with partially observed data.
method Joint learning of variational cost and gradient-based solver as neural networks.
result Joint learning leads to improved reconstruction performance.
RTVAE uses β-divergence to detect anomalies in tabular data robustly.
problem Outliers in tabular data affect VAE training and anomaly detection.
method Robust VAE with β-divergence for mixed categorical and continuous features.
result Demonstrates effectiveness on network traffic anomaly detection.
This paper models time-series data with a mixture of Markov chains, automatically determining the number of components.
problem Tackles the inability of common Markov state modeling frameworks to discern heterogeneities in complex data.
method Uses a mixture of Markov chains and variational expectation-maximization algorithm for automatic component selection.
result Achieves performance consistent with theoretically optimal error scaling, identifying meaningful heterogeneities in various data sets.
Enhances graph modeling with hyperbolic geometry and variational inference.
problem Challenges in modeling relational data with complex dependencies.
method Semi-implicit hierarchical variational Bayes with Poincaré embedding and mutual information regularization.
result Improves graph representation quality and flexibility in edge prediction and node classification.
Improves NF for complex data distributions with multiple modes.
problem Difficulty in handling data distributions with multiple isolated modes.
method Proposes a new framework using variational latent representation to improve NF.
result Significantly more powerful for generating data distributions with multiple modes.
Gaussian process variational autoencoders improve disentanglement in time series data.
problem Learning disentangled representations from multivariate time series data.
method Model each latent channel with a Gaussian process prior and a structured variational distribution to capture temporal dependencies.
result Competitive performance on benchmark and real-world medical time series data.
VIR model improves regression accuracy and uncertainty estimation for imbalanced data.
problem Imbalanced regression datasets lead to poor model accuracy and uncertainty estimation.
method VIR model uses probabilistic smoothing and reweighting to estimate latent representations and uncertainty.
result VIR model outperforms state-of-the-art models in accuracy and uncertainty estimation.
Bayes-CATSI uses variational Bayesian deep learning for medical time series data imputation.
problem Missing values in medical time series data.
method Bayes-CATSI integrates variational inference for uncertainty quantification and context-aware imputation.
result Bayes-CATSI outperforms CATSI by 9.57% in imputation performance.
Tutorial on using neural networks for single cell data analysis.
problem Handling large sequencing datasets efficiently.
method Single cell variational inference using variational auto-encoder.
result Model learns data distribution for insights.
Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequential data setting. Our algorithm is applicable to both finite hidden Markov models and hierarchical D…
Fast variational Bayes methods improve geospatial data analysis speed and accuracy.
problem Inaccurate and slow variational Bayes methods for large geospatial data.
method Combination of calculus of variations, closed-form gradient updates, and linear response corrections.
result Comparable accuracy to spNNGP with reduced computational costs and faster speed.
A new method combines Laplace and Variational Bayes for scalable inference.
problem Complex models and large datasets make exact inference infeasible.
method Low-Rank Variational Bayes Correction (VBC) using Laplace method and Variational Bayes correction in a lower dimension.
result The method ensures scalability in both model complexity and data size.
The paper analyzes variational autoencoders for state space models with risk bounds.
problem Analyzing the risk associated with variational autoencoders for state space models.
method Backward factorization of variational distributions to analyze excess risk, providing oracle inequalities and upper bounds.
result Explicit upper bounds on variational estimation error for state space models under strong mixing assumptions.
We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models, latent Dirichlet allocation and the hierarchical Dirichlet process topic model. Usin…
We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle …
Unified approach for predicting missing segments in partially observed functions.
problem Predicting missing segments in partially observed functions with complex dependence and irregular noise.
method Unified registration and prediction approach under the conformal prediction framework, integrating amplitude and phase components.
result Effective prediction bands with finite-sample marginal coverage guarantees under weak assumptions.
Improved image learning using elliptically contoured tensor-variate distributions.
problem Inadequate statistical analysis for tensor-valued data, especially with heavier or lighter tails.
method Developed a family of elliptically contoured tensor-variate distributions and derived their properties and procedures for estimation.
result Tensor-variate classification rules and tensor-on-tensor regression better predict and characterize data than TVN-based methods.
VANO uses neural operators for unsupervised learning of functional data.
problem Learning operators between infinite dimensional spaces for functional data.
method Variational Autoencoding Neural Operators (VANO) approach.
result VANO can learn and reconstruct functional data without supervision.
Improved Bayesian inference via variational approximations of generalized rho-posteriors.
problem Robust Bayesian inference under model misspecification and data contamination.
method Introducing a modified ρ-posterior and using PAC-Bayesian analysis with variational approximations. result Theoretical guarantees for tractable inference with competitive robustness and computational efficiency.
We investigate the problem of learning representations that are invariant to certain nuisance or sensitive factors of variation in the data while retaining as much of the remaining information as possible. Our model is based on a variational autoencoding architecture with priors that encourage independence between sens…
p3VAE combines physics and machine learning for robust data representations.
problem Improving machine learning models' robustness to environmental factors of variation.
method Physics-informed variational autoencoder integrating physical knowledge with neural networks.
result p3VAE outperforms competing models in extrapolation and interpretability. A scalable method for estimating spatial data using VREML.
problem Costly computation of REML for large, sparse precision matrices in spatial data.
method Proposes VREML framework approximating marginal likelihood with Gaussian variational distribution and deriving a coordinate-ascent algorithm.
result Empirically shows VREML outperforms MLE and INLA.
New method estimates model parameters from incomplete data.
problem Estimating model parameters from incomplete data.
method Variational Gibbs Inference (VGI)
result Competitive or better performance compared to existing methods.
A new variational inference method speeds up AMMI model estimation.
problem High-dimensional GxE interaction data in plant breeding.
method Variational inference for AMMI model.
result The new method is 2x faster with similar predictive performance.