A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
New method accelerates energetic variational inference using particle dynamics.
A new EVI framework improves ParVI methods by maintaining variational structure and reducing KL-divergence.
Model predicts stable molecules with AI and physics constraints.
Reduced order modeling of energetic materials using physics-aware neural networks.
In this paper we present an econophysic model for the description of shares transactions in a capital market. For introducing the fundamentals of this model we used an analogy between the electrical field produced by a system of charges and the overall of economic and financial information of the shares transactions fr…
We study a class of nonlocal, energy-driven dynamical models that govern the motion of closed, embedded curves from both an energetic and dynamical perspective. Our energetic results provide a variety of ways to understand physically motivated energetic models in terms of more classical, combinatorial measures of compl…
Low-rank training improves neural network training on edge devices with non-volatile memory.
The paper studies harmonic maps to the circle with complex singular sets.
New method steers protein design towards desired properties.
EVI-MMD approximates target distributions via MMD minimization with adaptive kernel.
Study on thermodynamic costs of simple linear regression.
Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.
Large twist-angle grain boundaries in layered structures are often described by Scherk's first surface whereas small twist-angle grain boundaries are usually described in terms of an array of screw dislocations. We show that there is no essential distinction between these two descriptions and that, in particular, their…
Variational inference is a scalable technique for approximate Bayesian inference. Deriving variational inference algorithms requires tedious model-specific calculations; this makes it difficult to automate. We propose an automatic variational inference algorithm, automatic differentiation variational inference (ADVI). …
Variational Inference shows promise for Bayesian GARCH model estimation.
A tutorial on variational inference for high-dimensional models.
Variational inference is an umbrella term for algorithms which cast Bayesian inference as optimization. Classically, variational inference uses the Kullback-Leibler divergence to define the optimization. Though this divergence has been widely used, the resultant posterior approximation can suffer from undesirable stati…
The article explores Helfrich flow with spontaneous curvature, finding singularities and convergence behaviors.
Semi-Implicit Variational Inference (SIVI) is improved with SIVI-SM using score matching.
A new particle algorithm improves mean-field variational inference.
We introduce incremental variational inference and apply it to latent Dirichlet allocation (LDA). Incremental variational inference is inspired by incremental EM and provides an alternative to stochastic variational inference. Incremental LDA can process massive document collections, does not require to set a learning …
DDVI uses diffusion models for variational inference, improving latent variable model performance.
Boosting Variational Inference improves posterior approximations with adaptive step-sizes.
Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI) technique is an instance of augmented variational inference, thus identifying th…
Recent efforts on combining deep models with probabilistic graphical models are promising in providing flexible models that are also easy to interpret. We propose a variational message-passing algorithm for variational inference in such models. We make three contributions. First, we propose structured inference network…
This paper introduces Wasserstein variational inference, a new form of approximate Bayesian inference based on optimal transport theory. Wasserstein variational inference uses a new family of divergences that includes both f-divergences and the Wasserstein distance as special cases. The gradients of the Wasserstein var…
Variational inference offers scalable and flexible tools to tackle intractable Bayesian inference of modern statistical models like Bayesian neural networks and Gaussian processes. For largely over-parameterized models, however, the over-regularization property of the variational objective makes the application of vari…
Amortized variational inference (AVI) replaces instance-specific local inference with a global inference network. While AVI has enabled efficient training of deep generative models such as variational autoencoders (VAE), recent empirical work suggests that inference networks can produce suboptimal variational parameter…
NVGD uses neural networks to infer distributions without kernel choices.
This work improves variational inference by reducing gradient variance.
SoftCVI uses contrastive estimation to infer complex posteriors.
New method reduces inference variance for faster optimization.
We review three algorithms for Latent Dirichlet Allocation (LDA). Two of them are variational inference algorithms: Variational Bayesian inference and Online Variational Bayesian inference and one is Markov Chain Monte Carlo (MCMC) algorithm -- Collapsed Gibbs sampling. We compare their time complexity and performance.…
Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear whether the fixed point identified by the variational inference algorithm is a local…
VISA improves inference efficiency for complex models.
Variational inference provides a powerful tool for approximate probabilistic in- ference on complex, structured models. Typical variational inference methods, however, require to use inference networks with computationally tractable proba- bility density functions. This largely limits the design and implementation of v…
BayesPy is an open-source Python software package for performing variational Bayesian inference. It is based on the variational message passing framework and supports conjugate exponential family models. By removing the tedious task of implementing the variational Bayesian update equations, the user can construct model…
Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of variational inference and Monte Carlo methods where we incorporate one or more s…
The recognition network in deep latent variable models such as variational autoencoders (VAEs) relies on amortized inference for efficient posterior approximation that can scale up to large datasets. However, this technique has also been demonstrated to select suboptimal variational parameters, often resulting in consi…
We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models, latent Dirichlet allocation and the hierarchical Dirichlet process topic model. Usin…
SNVI combines likelihood estimation with variational inference for efficient Bayesian inference.
A new variational method speeds up Bayesian phylogenetic inference.
New framework for variational coresets simplifies Bayesian inference for complex models.
Improved state estimation in nonlinear models using amortized backward variational inference.
Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational posterior. However, existing methods on implicit posteriors still face challenges of…
Hybrid continuous-discrete models naturally represent many real-world applications in robotics, finance, and environmental engineering. Inference with large-scale models is challenging because relational structures deteriorate rapidly during inference with observations. The main contribution of this paper is an efficie…
Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequential data setting. Our algorithm is applicable to both finite hidden Markov models and hierarchical D…
Study trade-offs between statistical and computational efficiency in variational inference.