Proposes a method to learn conditional VAEs from datasets with missing covariates.
problem Learning conditional VAEs from datasets with missing covariates.
method Augments conditional VAEs with a prior distribution for missing covariates and estimates their posterior using amortised variational inference.
result The proposed method outperforms previous methods in learning conditional VAEs from non-temporal, temporal, and longitudinal datasets.
A new meta-learning method using shared variational inference.
problem Meta-learning with uncertainty over model parameters.
method Shared amortized variational inference network for conditional prior and posterior.
result Prevents collapse of conditional prior to Dirac delta function.
Method for conditional sampling with pre-trained normalizing flows.
problem Conditional sampling for incomplete observations.
method Variational Schur conditional sampling with normalizing flows.
result Successfully applied to invertible residual networks for inference and classification.
Derives optimal control conditions using calculus of variations.
problem Optimizing Markov control in stochastic control problems.
method Calculus of variations approach to derive necessary conditions.
result Solves the Merton portfolio optimization problem.
The paper develops a new approach to conditional risk measures using modular convex analysis.
problem Developing a new method for conditional risk measures.
method Random modular approach to conditional certainty equivalents and niveloids in the conditional L∞-space. result Retrieves a conditional variational formula for optimized certainty equivalents and applies it to the conditional entropic risk measure.
Study high-dimensional Bayesian linear regression using variational inference.
problem High-dimensional Bayesian linear regression with product priors.
method Non-linear large deviations theory and variational inference.
result Unique optimizer in variational problem governs posterior distribution under separation condition.
We study convergence rates of variational posterior distributions for nonparametric and high-dimensional inference. We formulate general conditions on prior, likelihood, and variational class that characterize the convergence rates. Under similar "prior mass and testing" conditions considered in the literature, the rat…
The paper simplifies conditions for optimal paths on manifolds avoiding obstacles.
problem Finding optimal paths on manifolds avoiding obstacles.
method Study of sufficient conditions for optimality on Riemannian manifolds and Lie groups.
result New conditions for optimality are provided in terms of matrix invertibility.
Systems of ordinary differential equations (or dynamical forms in Lagrangian mechanics), induced by embeddings of smooth fibered manifolds over one-dimensional basis, are considered in the class of variational equations. For a given non-variational system, conditions assuring variationality (the Helmholtz conditions) o…
DISCoVeR learns disentangled representations by separating shared and condition-specific factors.
problem Learning disentangled representations for multi-condition data.
method Dual-latent architecture, parallel reconstructions, max-min objective.
result DISCoVeR achieves improved disentanglement on various datasets.
New model reconstructs flow from sparse data with uncertainty quantification.
problem Reconstructing nonlinear flow from limited observations.
method Semi-Conditional Variational Autoencoder (SCVAE) for probabilistic flow reconstruction.
result SCVAE improves reconstruction accuracy compared to Gappy Proper Orthogonal Decomposition (GPOD).
A new method for estimating causal parameters from observables reduces the need for finite moment conditions.
problem Estimating causal parameters from observational data with unknown or infinite moment conditions.
method Variational Method of Moments (VMM) for a general class of estimators, including kernel and neural net-based methods.
result VMM estimators are consistent, asymptotically normal, and semiparametrically efficient.
New model improves multimodal autoencoders by learning joint and conditional distributions.
problem Limitations in recent multimodal autoencoders restrict their quality on complex datasets.
method Proposes a multistage training process with variational inference and Normalizing Flows, leveraging shared modality information.
result Achieves state-of-the-art results on benchmark datasets.
This work tackles posterior collapse in conditional and hierarchical VAEs.
problem Posterior collapse in VAEs leads to poor latent variable representations.
method Theoretical analysis of linear conditional and hierarchical VAEs, empirical validation.
result Theoretical and empirical evidence of posterior collapse causes in conditional and hierarchical VAEs.
Study variations of metrics on Riemannian submersions to preserve fiber geometry.
problem Preserving specific geometries of fibers under metric variations on Riemannian submersions.
method Formulated conditions for preserving fiber geometry (totally geodesic, umbilical, minimal) and examined variations of sectional curvatures.
result Conditions for metric to be a critical point of integrated squared norms of fiber curvatures, with non-negative second variation.
The article addresses a long-standing open problem on the justification of using variational Bayes methods for parameter estimation. We provide general conditions for obtaining optimal risk bounds for point estimates acquired from mean-field variational Bayesian inference. The conditions pertain to the existence of cer…
Study on slow convergence in geometric variational problems.
problem Slow convergence of solutions in geometric variational problems.
method Identifying necessary conditions for slowly converging solutions and characterizing their convergence rate and direction.
result Characterization of the rate and direction of convergence for slowly converging solutions.
Paper tightens variational GP approximations for large datasets.
problem Scaling Gaussian processes to large datasets.
method Relaxing the standard assumption about inducing points' posterior matching the prior, leading to a tighter variational approximation.
result The proposed approximation consistently matches or outperforms standard sparse variational GPs while maintaining computational cost.
We propose a single neural probabilistic model based on variational autoencoder that can be conditioned on an arbitrary subset of observed features and then sample the remaining features in "one shot". The features may be both real-valued and categorical. Training of the model is performed by stochastic variational Bay…
A scalable online method for Gaussian processes that improves decision-making in various applications.
problem Scalability issues with Gaussian processes for online decision-making.
method Online variational conditioning (OVC) for SVGPs.
result OVC enables efficient online learning and decision-making with SVGPs.
Current variational inference methods for hierarchical Bayesian nonparametric models can neither characterize the correlation structure among latent variables due to the mean-field setting, nor infer the true posterior dimension because of the universal truncation. To overcome these limitations, we propose the conditio…
Study the stability of membranes using Helfrich energy and second variation formula.
problem Stability of membranes under various conditions.
method Developed and applied a second variation formula for the Helfrich energy for a class of surfaces.
result Studied the second variation of the area functional for a specific example.
Reduces necessary conditions for collision avoidance on curved spaces.
problem Finding non-intersecting trajectories for multiple agents on curved spaces.
method Reduction by Lie group symmetries of variational collision avoidance problems.
result Derives necessary conditions for reduced extremals.
Recent advances in neural variational inference have spawned a renaissance in deep latent variable models. In this paper we introduce a generic variational inference framework for generative and conditional models of text. While traditional variational methods derive an analytic approximation for the intractable distri…
New method improves generative model performance by fully conditioning variational posteriors.
problem Inaccurate inference due to partial conditioning of variational posteriors in sequential LVMs.
method Introduces fully-conditioned approximate posteriors to improve generative model performance.
result Improves generative modelling and multi-step prediction performance.
Paper models spatio-temporal extremes using conditional variational autoencoders.
problem Modeling co-occurrence of extreme weather events under changing climate conditions.
method Conditional Variational Autoencoder (cXVAE) with CNN integration.
result Accurately emulates spatial fields and recovers extremal dependence with low computational cost.
Variational Autoencoders (VAEs) are a popular generative model, but one in which conditional inference can be challenging. If the decomposition into query and evidence variables is fixed, conditional VAEs provide an attractive solution. To support arbitrary queries, one is generally reduced to Markov Chain Monte Carlo …
Greg McShane introduced a remarkable identity for lengths of simple closed geodesics on the once punctured torus with a complete, finite volume hyperbolic structure. Bowditch later generalized this and gave sufficient conditions for the identity to hold for general type-preserving representations of a free group on two…
Defines a filtration on variational bicomplex for concise functional form conditions.
problem Expressing functional form vanishing conditions concisely.
method Introduces a filtration on the variational bicomplex and studies its properties.
result Graded components of the filtration inherit module structures, simplifying functional form conditions.
Eight different refinements of trapped surfaces are proposed, of three basic types, each intended as potential stability conditions. Minimal trapped surfaces are strictly minimal with respect to the dual expansion vector. Outer trapped surfaces have positivity of a certain curvature, related to surface gravity. Increas…
VFMs use noise adapters to conditionally generate images in one step.
problem Conditional image generation with iterative models is slow and requires explicit sampling paths.
method Developed a variational flow map framework that learns noise distributions for conditional sampling.
result VFMs achieve well-calibrated conditional samples in a single forward pass.
Variational inference (VI) is a widely used framework in Bayesian estimation. For most of the non-Gaussian statistical models, it is infeasible to find an analytically tractable solution to estimate the posterior distributions of the parameters. Recently, an improved framework, namely the extended variational inference…
NeVI-Cut uses neural networks to efficiently propagate uncertainty without feedback.
problem Efficiently propagating uncertainty in downstream Bayesian analysis without feedback.
method NeVI-Cut combines neural networks and normalizing flows for variational inference.
result NeVI-Cut achieves significant computational gains and higher accuracy than traditional methods.
Gradient-free method improves predictive accuracy for probabilistic models.
problem Balancing computational efficiency and robust predictive performance in deep learning.
method CAVI-CMN, a gradient-free variational method for conditional mixture networks.
result CAVI-CMN achieves competitive and often superior predictive accuracy compared to MLE with backpropagation.
FlowVAT improves variational inference for multi-modal distributions.
problem Mode-seeking behavior and collapse in variational inference for complex posteriors.
method Conditional tempering approach for normalizing flow variational inference.
result FlowVAT outperforms traditional and adaptive annealing methods in multi-modal distributions, finding more modes and achieving better ELBO values.
We study the variational problem for N-parallel curves on a Finslerian surface by means of Exterior Differential Systems using Griffiths' method. We obtain the conditions when these curves are extremals of a length functional and write the explicit form of Euler-Lagrange equations for this type of variational problem…
New bounds show BBVI's gradient variance matches SGD conditions, improving parameterization efficiency.
problem Understanding and improving the convergence of black-box variational inference (BBVI).
method Showed BBVI satisfies matching gradient variance bounds corresponding to the ABC condition for smooth and quadratically-growing log-likelihoods.
result Proven BBVI's gradient variance matches SGD conditions, with superior dimensional dependence for mean-field parameterization.
VSD efficiently learns conditional distributions for combinatorial designs.
problem Learning conditional distributions for rare combinatorial designs.
method Variational Search Distributions (VSD) using variational inference.
result VSD outperforms existing methods on real sequence-design problems.
Novel boundary conditions for Ricci flow to deform compact manifolds.
problem Deforming compact Riemannian manifolds with boundary using Ricci flow.
method Proposed boundary conditions that make first variations of functionals (Einstein-Hilbert action, lambda-functional) without boundary terms.
result Proof of short-term existence of solutions under proposed conditions.
New method reduces variance in Bayesian inverse problems.
problem High variance in Monte Carlo estimates for inverse problems.
method Conditional neural control variates based on Stein's identity.
result Substantial variance reduction across different inverse problems.
In this note we continue the analysis of metric measure space with variable ricci curvature bounds. First, we study (κ,N)-convex functions on metric spaces where κ is a lower semi-continuous function, and gradient flow curves in the sense of a new evolution variational inequality that captures the information that …
Derives energy-momentum tensor from Standard Model, examines energy conditions.
problem Validating energy conditions in the context of the Standard Model.
method Geometric variational problem on globally hyperbolic manifold, deriving energy-momentum tensor.
result Validates various energy conditions in general relativity.
Recent advances in Neural Variational Inference allowed for a renaissance in latent variable models in a variety of domains involving high-dimensional data. While traditional variational methods derive an analytical approximation for the intractable distribution over the latent variables, here we construct an inference…
We use Frölicher-Nijenhuis theory to obtain global Helmholtz conditions, expressed in terms of a semi-basic 1-form, that characterize when a semispray is locally Lagrangian. We also discuss the relation between these Helmholtz conditions and their classic formulation written using a multiplier matrix. When the semi-bas…
The paper improves guarantees for VI in symmetric cases.
problem Approximating intractable densities via VI with misspecified families.
method Extends previous robust VI results to wider divergences and non-log-concave targets.
result Guarantees for exact recovery of target mean and correlation matrix under various conditions.
We consider in this paper an area functional defined on submanifolds of fixed degree immersed into a graded manifold equipped with a Riemannian metric. Since the expression of this area depends on the degree, not all variations are admissible. It turns out that the associated variational vector fields must satisfy a sy…
Bayesian method improves SOM training for dynamic data.
problem Training Self Organizing Maps (SOM) for non-stationary data.
method Variational Bayesian approach with adaptive neighborhood radius.
result Method outperforms other adaptive methods in high dimensions.
A-VI can approximate F-VI under certain conditions, improving inference in some models.
problem Approximate Bayesian inference using factorized distributions.
method Amortized variational inference (A-VI) learns a common inference function for latent variables.
result A-VI can close the amortization gap in simple hierarchical models.