Improved VAE model enhances image accuracy and robustness.
problem Enhancing accuracy and robustness of VAE models.
method Coupled VAE method with generalized entropy function.
result Improved accuracy and robustness of output images.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,932 papers · 148 categories
Trend · papers per month
48 results for “coupled variational”
Study on kinetic Langevin diffusions and their couplings, showing subtle TV bounds and new non-Markovian couplings.
problem Understanding and quantifying the TV distance between solutions of kinetic Langevin diffusions with different initial values.
method Established new non-Markovian couplings for kinetic Langevin diffusions, derived from optimal coalescence trajectories, and analyzed their TV bounds.
result No Markovian coupling can capture the asymptotic decay rate of the TV distance between solutions of kinetic Langevin diffusions with different initial values.
Sparse variational approximations allow for principled and scalable inference in Gaussian Process (GP) models. In settings where several GPs are part of the generative model, theses GPs are a posteriori coupled. For many applications such as regression where predictive accuracy is the quantity of interest, this couplin…
A new model integrates LSTM and copulas for high-dimensional financial data.
problem Modeling high-dimensional dependencies across financial markets.
method Variational LSTM with regular vine copulas.
result Outperforms benchmarks in cross-market portfolio forecasting.
Variational Pseudolikelihood for Regularized Ising Inferencecond-mat.stat-mech
I propose a variational approach to maximum pseudolikelihood inference of the Ising model. The variational algorithm is more computationally efficient, and does a better job predicting out-of-sample correlations than regularized maximum pseudolikelihood inference as well as mean field and isolated spin pair appro…
C-VAE improves VAE by resolving prior issues and generating better samples.
problem Low-quality samples from VAE due to prior issues.
method Formulates VAE as OT, allows flexible priors, and uses OT formulations.
result C-VAE generates higher quality samples and latent representations.
VIND reduces gradient variance for non-Gaussian approximations.
problem Improving Variational Inference for non-Gaussian distributions.
method Extends reparameterization trick to exponential families using numerical derivatives and tight coupling.
result Reduces gradient variance, leading to better posterior approximations.
Massless scalar and vector fields are coupled to Lyra geometry by means of Duffin-Kemmer-Petiau (DKP) theory. Using Schwinger Variational Principle, equations of motion, conservation laws and gauge symmetry are implemented. We find that the scalar field couples to the anholonomic part of the torsion tensor, and the gau…
Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising modelcond-mat.dis-nn
We describe and analyze some novel approaches for studying the dynamics of Ising spin glass models. We first briefly consider the variational approach based on minimizing the Kullback-Leibler divergence between independent trajectories and the real ones and note that this approach only coincides with the mean field equ…
This study compares direct and indirect methods for estimating own funds in life insurance, finding indirect methods more effective under realistic asset-liability coupling.
problem Computing own funds for life insurers using direct and indirect methods in a risk-neutral pricing framework.
method Introduced a novel family of mixed estimators including both direct and indirect methods, integrated into a control variate framework for variance reduction.
result The indirect method is more effective under realistic asset-liability coupling, but neither method is universally superior.
Proposes CVRCF for streaming recommender systems combining deep learning and probabilistic models.
problem Streaming recommendation problem with dynamic data and complexity.
method Coupled Variational Recurrent Collaborative Filtering (CVRCF) framework integrating stochastic processes and deep factorization models.
result Favorable performance in temporal dependency modeling and predictive accuracy compared to state-of-the-art methods.
Improved VAE models avoid posterior collapse in text modeling.
problem Posterior collapse in VAEs leads to poor data manifold parameterization.
method Coupled-VAE couples a VAE with a deterministic autoencoder to improve encoder and decoder parameterizations.
result Coupled-VAE consistently improves results in probability estimation and latent space richness.
Motivated by the sigma model limit of multicomponent Ginzburg-Landau theory, a version of the Faddeev-Skyrme model is considered in which the scalar field is coupled dynamically to a one-form field called the supercurrent. This coupled model is investigated in the general setting where physical space is an oriented Rie…
Based on a study of the coupling by reflection of diffusion processes, a new monotonicity in time of a time-dependent transportation cost between heat distribution is shown under Bakry-Emery's curvature-dimension condition on a Riemannian manifold. The cost function comes from the total variation between heat distribut…
A method to approximate posterior distributions using Monte Carlo and variational inference.
problem Lack of systematic understanding of how optimizing different objectives relates to approximating the posterior distribution.
method Divide and couple procedure to identify augmented proposal and target distributions.
result Maximizing the VI objective leads to an augmented variational distribution that approximates the posterior distribution.
First-order methods play a central role in large-scale machine learning. Even though many variations exist, each suited to a particular problem, almost all such methods fundamentally rely on two types of algorithmic steps: gradient descent, which yields primal progress, and mirror descent, which yields dual progress. W…
Study optimal partitions on spheres using fractional Q-curvature and variational methods.
problem Optimal partition problem on the sphere with fractional Q-curvature.
method Variational approach, symmetry analysis, Hölder regularity results.
result Existence of a symmetric minimal partition.
Neural Spline Flowsstat.ML
Neural spline flows enhance flow models with rational-quadratic splines.
problem Improving flexibility and density estimation in flow models.
method Proposes a new differentiable module based on monotonic rational-quadratic splines.
result Demonstrates improved performance in density estimation, variational inference, and generative modeling of images.
DiffObs predicts global precipitation with realistic wave modes and low frequency variations.
problem Predicting global precipitation evolution using satellite observations.
method Autoregressive generative diffusion model trained on satellite data.
result Model generates realistic wave modes and low frequency variations, validating its potential for climate prediction.
Unbiased gradient estimation improves VAE performance.
problem Training VAEs via maximum likelihood is difficult due to intractable integrals.
method Introduced unbiased estimators of the log-likelihood gradient using coupled Markov chains.
result Unbiased estimators lead to better predictive performance in VAEs.
Newton's method solves variational problems on manifolds.
problem Solving variational equations on manifolds.
method Newton's method with affine covariant damping strategy.
result Numerical results for variational problems demonstrated.
Variations of the sub-Riemannian distance on Sasakian manifolds with applications to couplingmath.DG
Maps on Sasakian manifolds limit to sub-Riemannian distance bounds.
problem Understanding sub-Riemannian distances on Sasakian manifolds.
method Parallel and mirror maps along geodesics of a taming Riemannian metric.
result Limits of transport maps outside sub-Riemannian cut-locus provide bounds on sub-Riemannian distance.
In this paper we prove the existence of coupled Kähler-Einstein metrics on complex manifolds whose canonical bundle is ample. These metrics were introduced and their existence in the said case was proven by Hultgren and Nyström using calculus of variations. We prove the result using the method of continuity. In the pro…
The variational calculus for the Faddeev-Hopf model on a general Riemannian domain, with general Kaehler target space, is studied in the strong coupling limit. In this limit, the model has key similarities with pure Yang-Mills theory, namely conformal invariance in dimension 4 and an infinite dimensional symmetry group…
New normalizing flows in hyperbolic space improve posterior modeling for hierarchical data.
problem Limited flexibility of existing normalizing flows in Euclidean space for hierarchical data.
method Elevated normalizing flows to hyperbolic spaces using coupling transforms and Wrapped Hyperboloid Coupling.
result Improved performance on density estimation and hierarchical graph data.
The paper prices a new life insurance policy for couples, considering various contingent benefits.
problem Valuation of life insurance policies for dependent coupled lives.
method Employed the -rule combining real-world and risk-neutral measures for pricing.
result Explicit pricing expressions for the new insurance policy were derived and analyzed.
Coupled entropy corrects flaws in Tsallis entropy for complex systems.
problem Misinterpretation of generalized temperature and entropy.
method Derived from generalized Pareto and Student's t distributions.
result Provides balanced measure of uncertainty for complex systems.
We introduce a novel kernel that models input-dependent couplings across multiple latent processes. The pairwise joint kernel measures covariance along inputs and across different latent signals in a mutually-dependent fashion. A latent correlation Gaussian process (LCGP) model combines these non-stationary latent comp…
Elvet solves differential equations and variational problems with neural networks.
problem Solving complex differential and variational equations with arbitrary conditions.
method Machine learning, specifically neural networks, to represent and solve equations.
result Elvet can solve a wide range of differential and variational problems.
Method for initializing Gaussian mixtures for variational inference with multi-modal distributions.
problem Challenges in variational inference with Gaussian mixtures due to multimodality and nonconvex loss functions.
method Optimization to find local maxima, local Gaussian approximations, and constrained least squares regression.
result Robust initialization improves variational inference performance and scalability.
uHMC achieves fast mixing in high dimensions with gradient evaluations.
problem Quantifying mixing time of uHMC in high dimensions.
method Construction of successful couplings for uHMC.
result uHMC mixes in total variation with logarithmic dependence on dimension.
We present a general framework, the coupled compound Poisson factorization (CCPF), to capture the missing-data mechanism in extremely sparse data sets by coupling a hierarchical Poisson factorization with an arbitrary data-generating model. We derive a stochastic variational inference algorithm for the resulting model …
vOED-NFs uses normalizing flows to improve Bayesian OED without likelihood evaluations.
problem Optimizing experiments to maximize information gain in model parameters.
method vOED-NFs combines variational approximations with normalizing flows for efficient EIG estimation.
result vOED-NFs achieves lower EIG estimation bias compared to previous methods.
This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the sum of local convex functions. A distributed online primal-dual dynamic mirror des…
Hierarchical pretraining with slow-fast ODEs
problem Causal self-attention vs. slow-fast ODEs
method Instantiating fast-slow ODE formalism as a concrete neural network
result Equilibrium manifold is exactly the master-equation (ME) stationary distribution
Develop a framework for barycentric projections of optimal transport plans on Riemannian manifolds.
problem Optimal transport couplings are probabilistic objects, while many learning pipelines require deterministic maps.
method Develop a framework for barycentric projections of transport couplings on Riemannian manifolds.
result The intrinsic projection maps each source point to the conditional Fréchet mean of its destination law and is shown to be the best deterministic representative under squared geodesic loss.
We discuss the coupling of the electromagnetic field with a curved and torsioned Lyra manifold using the Duffin-Kemmer-Petiau theory. We will show how to obtain the equations of motion and energy-momentum and spin density tensors by means of the Schwinger Variational Principle.
Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and well-calibrated Bayesian treatment of GAMs using Gaussian processes (GPs) and leveraging recent adv…
CVAE learns disentangled and coupled representations without prior knowledge.
problem Learning disentangled and coupled representations in latent space.
method Introduces CVAE, a self-supervised VAE that factorizes posterior and uses Gaussian copula for dependencies.
result Demonstrates strong effect in enhancing disentangled representation learning.
Paper proves existence of solutions for a specific system.
problem Existence of solutions for a conformal Dirac-Einstein system.
method Perturbation methods to prove existence of solutions.
result Existence of solutions for the conformal Dirac-Einstein system.
Gaussian processes (GPs) provide a powerful non-parametric framework for reasoning over functions. Despite appealing theory, its superlinear computational and memory complexities have presented a long-standing challenge. State-of-the-art sparse variational inference methods trade modeling accuracy against complexity. H…
We investigate how simultaneously recorded long-range power-law correlated multi-variate signals cross-correlate. To this end we introduce a two-component ARFIMA stochastic process and a two-component FIARCH process to generate coupled fractal signals with long-range power-law correlations which are at the same time lo…
Poisson variational autoencoders introduce a metabolic cost term that penalizes high baseline activity.
problem Energy constraints in computation.
method Poisson variational autoencoders with a Kullback-Leibler divergence term proportional to firing rates.
result Poisson variational autoencoders introduce a metabolic cost term that penalizes high baseline activity.
Extending work of Caffarelli-Yang and Tarantello, we present a variational existence proof for two-vortex solutions of the periodic Chern-Simons Higgs model and analyze the asymptotic behavior of these solutions as the parameter coupling the gauge field with the scalar field tends to 0.
The paper proposes methods to estimate MCMC quality with couplings, bounding Wasserstein distance.
problem Improving MCMC efficiency without sacrificing asymptotic consistency.
method Estimators based on couplings of Markov chains to assess quality of asymptotically biased sampling methods.
result Empirical upper bounds of Wasserstein distance for assessing MCMC quality.
Improved HGF networks avoid negative precision errors in volatility updates.
problem Negative posterior precision errors in volatility-coupled nodes of HGF networks.
method Introduced a modified quadratic approximation to variational energy.
result Robust update equations across parameter space that track posterior faithfully.
Probabilistic approaches for tensor factorization aim to extract meaningful structure from incomplete data by postulating low rank constraints. Recently, variational Bayesian (VB) inference techniques have successfully been applied to large scale models. This paper presents full Bayesian inference via VB on both single…
The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to earlier published flows, scales well to high-dimensional latent spaces. The proposed f…