Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

61123184245 · Jun 202019922001200920172026
48 results for mixed variation

Develops a new method for learning discrete distributions without embedding them in a continuous space.

problem Challenges in learning discrete distributions using current methodologies.
method Introduces a MAD invertible map and a mixed variational flow (MAD Mix) for discrete distributions.
result MAD Mix produces more reliable approximations than continuous-embedding flows.

PVI improves SIVI by directly optimizing ELBO without parametric assumptions.

problem Intractable variational densities in SIVI methods.
method Particle Variational Inference (PVI) using empirical measures to approximate optimal mixing distributions.
result PVI directly optimizes the ELBO and performs favorably compared to other SIVI methods.

The paper explores formulas and applications for mixed scalar curvature in multi-product manifolds.

problem Integral and variation formulas for mixed scalar curvature in multi-product manifolds.
method Generalizes results from pseudo-Riemannian almost product manifolds to multi-product structures.
result Generalizes formulas for mixed scalar curvature in multi-product manifolds.

The paper proposes an efficient method to scale Bayesian inference for mixed multinomial logit models to very large datasets.

problem Efficiency in Bayesian inference for mixed multinomial logit models on large datasets.
method Amortized Variational Inference with stochastic backpropagation, automatic differentiation, and GPU acceleration.
result The proposed method achieves significant computational speedups over traditional methods for large datasets.

The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (top-down) is jointly learned by stochastic gradient variational Bayes. We first elaborate Gaussian VAE, approximating the local covariance matrix of the decoder as an o…

2016-04-18abs ↗pdf ↗

Semi-implicit variational inference (SIVI) is introduced to expand the commonly used analytic variational distribution family, by mixing the variational parameter with a flexible distribution. This mixing distribution can assume any density function, explicit or not, as long as independent random samples can be generat…

2018-05-28abs ↗pdf ↗

New method improves uncertainty estimation in complex statistical models.

problem Challenges in estimating high-dimensional mixed models due to computational complexity.
method Partially factorized variational inference to relax mean-field assumption.
result Relaxed variational inference provides accurate uncertainty quantification without high computational cost.

Many real-valued stochastic time-series are locally linear (Gassian), but globally non-linear. For example, the trajectory of a human hand gesture can be viewed as a linear dynamic system driven by a nonlinear dynamic system that represents muscle actions. We present a mixed-state dynamic graphical model in which a hid…

2013-01-23abs ↗pdf ↗

MMM model clusters mixed-type longitudinal data efficiently.

problem Challenges in clustering multivariate longitudinal mixed-type data.
method MMM model reorganizes data into a three-way structure, using a mixture of matrix-variate normal distributions.
result MMM model handles various data types (continuous, ordinal, binary, nominal, count) and temporal dependence.

We examine the total mixed scalar curvature of a fixed distribution as a functional of a pseudo-Riemannian metric. We develop variational formulas for quantities of extrinsic geometry of the distribution to find the critical points of this action. Together with the arbitrary variations of the metric, we consider also v…

2016-09-29abs ↗pdf ↗

Improved state estimation in nonlinear models using amortized backward variational inference.

problem State estimation in general state-space models.
method Amortized backward variational inference with neural network parameters.
result Linear growth of variational approximation error in number of observations.

New method combines domain changes and sparse mixing for better latent variable learning.

problem Challenges in identifying latent variables due to insufficient domain changes and violated sparsity constraints.
method Combines sufficient changes and sparse mixing constraints, using domain encoding networks and variational autoencoders.
result Identifiability of latent variables achieved with less restrictive constraints.

Study of Einstein-Hilbert action on metric-affine spaces with connections.

problem Formulating and solving variational problems for mixed Einstein-Hilbert action.
method Developed variational formulas for extrinsic geometry, derived Euler-Lagrange equations, and characterized critical points.
result Derived new equations analogous to Einstein and Cartan equations, with a new Ricci type tensor.

This work analyzes Gibbs samplers for Bayesian hierarchical models without dimensionality constraints.

problem Analyzing convergence properties of Gibbs samplers for Bayesian hierarchical models.
method Using Bayesian asymptotics and total variation mixing times, the study provides dimension-free convergence results.
result Dimension-free convergence results for Gibbs samplers targeting hierarchical models under random data-generating assumptions.

A new method for efficient inference in sequential latent-variable models.

problem Computational challenges in integrating subject-specific random effects.
method Anchored variational inference framework to approximate posterior distributions.
result The method achieves accurate estimation with significant computational gains.

MixFlows uses a mixture of flows for efficient variational inference.

problem Efficient and reliable variational inference for complex models.
method A new variational family of mixed flows with efficient algorithms and convergence guarantees.
result MixFlows provides more reliable posterior approximations and comparable sample quality to MCMC methods.

This note is concerned with an accurate and computationally efficient variational bayesian treatment of mixed-effects modelling. We focus on group studies, i.e. empirical studies that report multiple measurements acquired in multiple subjects. When approached from a bayesian perspective, such mixed-effects models typic…

2019-03-21abs ↗pdf ↗

Paper uses VAEAC to estimate Shapley values for complex models with mixed features.

problem Estimating Shapley values for models with dependent mixed features.
method Uses variational autoencoder with arbitrary conditioning (VAEAC) to model feature dependencies.
result VAEAC approach outperforms state-of-the-art methods for various settings.

MALA mixes efficiently under smoothness and isoperimetry assumptions.

problem Sampling from target densities efficiently.
method Metropolis-Adjusted Langevin algorithm (MALA) with smoothness and isoperimetry assumptions.
result MALA mixes in $O\left(\frac{(LΥ)^{\frac12}}{ψ_μ^2} \log\left(\frac{1}ε ight) ight)$ iterations.

Paper improves variational inference for complex models.

problem Improving statistical accuracy of variational inference in high-dimensional models.
method Developed a general framework for MFVI and proposed a partially grouped VI algorithm.
result Proposed algorithm works and outperforms vanilla MFVI in mixed membership stochastic blockmodel.

MMbeddings reduces categorical embeddings by treating them as latent effects, significantly decreasing parameters and mitigating overfitting.

problem Large cardinalities in categorical embeddings lead to high parameter counts and overfitting.
method MMbeddings treats embeddings as latent random effects in a variational autoencoder framework, reducing parameter count and mitigating overfitting.
result MMbeddings consistently outperforms traditional embeddings across various tasks, demonstrating its potential in machine learning applications.

Sharp inequality between TV and Hellinger distances for Gaussian mixtures.

problem Understanding the relationship between total variation and Hellinger distances for Gaussian mixtures.
method Established a general upper bound on Hellinger distance in terms of TV distance raised to a power, demonstrating sharpness with specific examples.
result The Hellinger distance between two Gaussian mixtures is bounded by the TV distance raised to a power 1o(1)1-o(1), where o(1)o(1) is of order 1/loglog(1/TV)1/\log\log(1/\mathrm{TV}).

Euclidean geometry has historically been the typical "workhorse" for machine learning applications due to its power and simplicity. However, it has recently been shown that geometric spaces with constant non-zero curvature improve representations and performance on a variety of data types and downstream tasks. Conseque…

2019-11-19abs ↗pdf ↗

We link disjoint longitudinal data for rare disease patients using latent representations and mixed-effects regression.

problem Analyzing treatment switches in rare diseases with limited data and changing measurement instruments.
method We embed item values into a shared latent space using variational autoencoders and apply mixed-effects regression to quantify treatment effects.
result Our approach allows for statistical inference and quantifies the impact of treatment switches in spinal muscular atrophy.

Observations consisting of measurements on relationships for pairs of objects arise in many settings, such as protein interaction and gene regulatory networks, collections of author-recipient email, and social networks. Analyzing such data with probabilisic models can be delicate because the simple exchangeability assu…

2007-05-30abs ↗pdf ↗

Injective flows for star-like manifolds improve variational inference efficiency.

problem Efficiently modeling densities on star-like manifolds with exact Jacobian computation.
method Proposed injective flows for star-like manifolds with exact Jacobian computation.
result Exact Jacobian computation for star-like manifolds reduces computational cost to NFs.

Characterizes continuity of monotone functionals in mixed topology.

problem Continuity of monotone functionals in mixed topology.
method Characterization through lower semicontinuity and dual representations.
result Continuity in mixed topology is equivalent to dual representation in terms of countably additive measures.