Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

147293440586 · Jun 202019922001200920172026
48 results for variational structure

Develops methods for structured variational inference with star-structured models.

problem Inference in models with interdependent variables.
method Star-structured variational inference, existence, uniqueness, self-consistency proofs, approximation error bounds, gradient-based algorithm.
result First results for existence, uniqueness, and self-consistency of variational approximations in star-structured models.

The paper introduces structured variational families to improve scalability in black-box variational inference.

problem Scalability issues in black-box variational inference, especially for large datasets and hierarchical models.
method Developed structured variational families that achieve better iteration complexity of O(N) compared to full-rank families.
result Structured variational families can achieve better scaling with respect to dataset size N, improving iteration complexity from O(N^2) to O(N).

The paper calculates variations of Einstein-Hilbert action on CR manifolds.

problem Variation of the Einstein-Hilbert action in pseudohermitian geometry.
method Computed first and second variations on CR manifolds, characterized critical points as pseudo-Einstein structures, and analyzed second variation on standard spheres.
result In three dimensions, the second variation of the Einstein-Hilbert action on CR structures differs from the Riemannian case due to embeddability.

Recent efforts on combining deep models with probabilistic graphical models are promising in providing flexible models that are also easy to interpret. We propose a variational message-passing algorithm for variational inference in such models. We make three contributions. First, we propose structured inference network…

2018-03-15abs ↗pdf ↗

A new EVI framework improves ParVI methods by maintaining variational structure and reducing KL-divergence.

problem Improving variational inference methods for better approximation of target distributions.
method EVI framework that minimizes the VI objective function based on an energy-dissipation law, including a new 'Approximation-then-Variation' scheme.
result The new scheme significantly decreases KL-divergence and outperforms existing ParVI methods in fidelity.

Improved Bayesian uncertainty quantification using variational bagging.

problem Inefficient and underestimating uncertainty in mean-field variational Bayes.
method Integrates bagging with variational Bayes for improved inference.
result Bagged variational posterior provides proper uncertainty quantification.

tvGP-VAE models tensor-valued latent variables with Gaussian processes for better data structure representation.

problem Agnostic latent variables in VAEs ignore data structure correlations.
method Proposes tensor-variate Gaussian process prior for variational autoencoder.
result Explicitly modeling correlation structures improves model performance in reconstruction.

Bounding geodesic length variation for surface projective structures.

problem Understanding how geodesic lengths change under projective structure variations.
method Bounding the derivative of complex length in terms of the Schwarzian norm.
result Application to cone-manifold deformations of hyperbolic 3-manifolds.

Cascading flows improve variational inference in structured programs.

problem Challenges in variational inference for complex probabilistic programs.
method Integrates normalizing flows and ASVI to create cascading flows, which embed the forward-pass of probabilistic programs.
result Cascading flows outperform normalizing flows and ASVI in structured inference problems.

We show a very simple and general total second variation formula for Perelman's W\mathcal{W}-functional at arbitrary points in the space of Riemannian metrics. Moreover we perform a study of the properties of the variations of Kähler structures. We deduce a quite simple and general total second variation formula for P…

2012-01-04abs ↗pdf ↗

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed Correlated Variational Auto-Encoders (CVAEs), which employ a structured mixture model as …

2019-06-14abs ↗pdf ↗

Study variational properties of cone structures with infinitesimal symmetry.

problem Variational properties of cone structures with infinitesimal symmetry.
method Establishing a correspondence between cone structures and geometric structures via symmetry reduction and quasi-contactification.
result Invariant conditions for specific properties of cone structures.

A 'Liouville structure' is a structure isomorphic to a cotangent vector fibration. A Liouville structure is an essential ingredient of every variational formulation of a physical theory. For reasons of interpretation the Liouville structure can not be replaced by the corresponding cotangent fibration. We give a precise…

2008-06-08abs ↗pdf ↗

We develop a framework for incorporating structured graphical models in the \emph{encoders} of variational autoencoders (VAEs) that allows us to induce interpretable representations through approximate variational inference. This allows us to both perform reasoning (e.g. classification) under the structural constraints…

2016-11-22abs ↗pdf ↗

Structured Nonparametric Variational Inference for Dependent Latent Modeling

problem Approximating posterior distributions with complex dependencies among latent variables
method Structured Nonparametric Variational Inference (SN-VI)
result Flexible and accurate posterior approximation with arbitrary shapes

Paper proposes Walsh-Hadamard Variational Inference for efficient approximate inference in large models.

problem Over-regularization in variational inference for large models.
method Walsh-Hadamard factorization strategies to reduce parameterization, accelerate computations, and increase posterior expressiveness.
result Efficient approximate inference achieved in over-parameterized models.

The study of higher tangential structures, arising from higher connected covers of Lie groups (String, Fivebrane, Ninebrane structures), require considerable machinery for a full description, especially for connections to geometry and applications. With utility in mind, in this paper we study these structures at the ra…

2016-12-21abs ↗pdf ↗

Variational Causal Networks approximate Bayesian inference over causal structures.

problem Quantifying uncertainty in causal structure inference from finite data.
method Parametric variational family over DAGs, using Evidence Lower Bound (ELBO) for tractable learning.
result Approximation of the true posterior over DAGs is demonstrated to be good.

VFG model embeds flow-based models with hierarchical structures using variational inference.

problem Flow-based models struggle with high-dimensional latent spaces and lack of tractable inference for graphical structures.
method Integrates flow-based functions through variational inference with aggregation nodes for hierarchical information integration.
result VFG models achieve improved ELBO and likelihood values on multiple datasets.

Generating graph structures is a challenging problem due to the diverse representations and complex dependencies among nodes. In this paper, we introduce Graph Variational Recurrent Neural Network (GraphVRNN), a probabilistic autoregressive model for graph generation. Through modeling the latent variables of graph data…

2019-10-02abs ↗pdf ↗

Learning in the latent variable model is challenging in the presence of the complex data structure or the intractable latent variable. Previous variational autoencoders can be low effective due to the straightforward encoder-decoder structure. In this paper, we propose a variational composite autoencoder to sidestep th…

2018-04-12abs ↗pdf ↗

Construct quaternionic-Kähler metrics from special Kähler manifolds with specific BPS structure variations.

problem Construct quaternionic-Kähler metrics from special Kähler manifolds with mutually local variations of BPS structures.
method Construct quaternionic-Kähler metrics from a conical special Kähler manifold with a certain type of mutually-local variation of BPS structures. Provide global and local explicit formulas for the quaternionic-Kähler metric.
result Construct quaternionic-Kähler metrics that are positive-definite and deform the 1-loop corrected Ferrara-Sabharval metric.

There are a number of examples of variations of Hodge structure of maximum dimension. However, to our knowledge, those that are global on the level of the period domain are totally geodesic subspaces that arise from an orbit of a subgroup of the group of the period domain. That is, they are defined by Lie theory rather…

2017-03-02abs ↗pdf ↗

We study underlying geometric structures for integral variational functionals, depending on submanifolds of a given manifold. Applications include (first order) variational functionals of Finsler and areal geometries with integrand the Hilbert 1-form, and admit immediate extensions to higher-order functionals.

2013-07-03abs ↗pdf ↗

The study finds variations in ownership structure and efficiency across sectors in Malaysia.

problem Investigate variations in ownership structure and firm efficiency across sectors in Malaysia.
method Frequency distributions of ownership structure, DEA under CRS and VRS, stratified random sampling.
result There are variations in firm ownership structure and efficiency across sectors in Malaysia.