A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Souriau studies Gibbs states for symplectic manifolds with group actions.
Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale to large graphical models by reducing its computational cost. In this paper, we p…
A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most accurate approaches and provides unbiased samples from the posterior but it has hi…
Meta-learning algorithms prepare quantum Gibbs states efficiently for NISQ devices.
Study measures rigidity for random walks and flows via generalized u-Gibbs states.
DiGS improves sampling from multi-modal distributions.
Bayesian inference in state-space models is challenging due to high-dimensional state trajectories. A viable approach is particle Markov chain Monte Carlo, combining MCMC and sequential Monte Carlo to form "exact approximations" to otherwise intractable MCMC methods. The performance of the approximation is limited to t…
With their origin in thermodynamics and symbolic dynamics, Gibbs measures are crucial tools to study the ergodic theory of the geodesic flow on negatively curved manifolds. We develop a framework (through Patterson-Sullivan densities) allowing us to get rid of compactness assumptions on the manifold, and prove many exi…
We analyze the complexity of Gibbs samplers for inference in crossed random effect models used in modern analysis of variance. We demonstrate that for certain designs the plain vanilla Gibbs sampler is not scalable, in the sense that its complexity is worse than proportional to the number of parameters and data. We thu…
Study the Hessian geometry of an ideal gas in a centrifuge.
New method transfers instances between domains using Gibbs Sampling and RBM.
Gibbs pruning optimizes neural networks by combining physics and regularization.
Bayesian model learns multiscale interactions in complex systems.
The paper proposes a Gibbs sampler for neural network posterior sampling.
Infinite Hidden Markov Models (iHMM's) are an attractive, nonparametric generalization of the classical Hidden Markov Model which can automatically infer the number of hidden states in the system. However, due to the infinite-dimensional nature of transition dynamics performing inference in the iHMM is difficult. In th…
New method reduces Gibbs partition function estimation complexity.
Improved Gibbs sampler speeds up Bayesian exponential smoothing model.
New PG samplers improve inference in coupled state-space models.
Proposes a link between randomness and compression in deep learning.
The latent Dirichlet allocation (LDA) model is a widely-used latent variable model in machine learning for text analysis. Inference for this model typically involves a single-site collapsed Gibbs sampling step for latent variables associated with observations. The efficiency of the sampling is critical to the success o…
Markov jump processes and continuous time Bayesian networks are important classes of continuous time dynamical systems. In this paper, we tackle the problem of inferring unobserved paths in these models by introducing a fast auxiliary variable Gibbs sampler. Our approach is based on the idea of uniformization, and sets…
Bayesian inference for biochemical reaction networks using jump-diffusion approximations.
Bayesian graphical models have been shown to be a powerful tool for discovering uncertainty and causal structure from real-world data in many application fields. Current inference methods primarily follow different kinds of trade-offs between computational complexity and predictive accuracy. At one end of the spectrum,…
Robust state-space radio interferometric imaging using Stochastic Approximation Expectation Maximization
Study birth-death dynamics for sampling Gibbs measures with nonconvex potentials.
The Gibbs sampler is one of the most popular algorithms for inference in statistical models. In this paper, we introduce a herding variant of this algorithm, called herded Gibbs, that is entirely deterministic. We prove that herded Gibbs has an convergence rate for models with independent variables and for ful…
A fast Gibbs sampler for Bayesian HMMs with missing data.
In this work, we propose a model for estimating volatility from financial time series, extending the non-Gaussian family of space-state models with exact marginal likelihood proposed by Gamerman, Santos and Franco (2013). On the literature there are models focused on estimating financial assets risk, however, most of t…
PPL improves on Takacs-Fiksel estimation for Gibbs models.
We prove a large deviation principle for a sequence of point processes defined by Gibbs probability measures on a Polish space. This is obtained as a consequence of a more general Laplace principle for the non-normalized Gibbs measures. We consider three main applications: Conditional Gibbs measures on compact spaces, …
We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for many complex models, integrating out these variables is either analytically or co…
The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently improve the quality of a discrete Gibbs sampler. Our Dobrushin-optimized Gibbs samp…
We consider the ideal-gas models of trading markets, where each agent is identified with a gas molecule and each trading as an elastic or money-conserving (two-body) collision. Unlike in the ideal gas, we introduce saving propensity of agents, such that each agent saves a fraction of its money and trades with t…
We review a simple model of closed economy, where the economic agents make money transactions and a saving criterion is present. We observe the Gibbs distribution for zero saving propensity, and non-Gibbs distributions otherwise. While the exact solution in the case of zero saving propensity is already known to be give…
Bayesian mixture models are widely applied for unsupervised learning and exploratory data analysis. Markov chain Monte Carlo based on Gibbs sampling and split-merge moves are widely used for inference in these models. However, both methods are restricted to limited types of transitions and suffer from torpid mixing and…
For large scale on-line inference problems the update strategy is critical for performance. We derive an adaptive scan Gibbs sampler that optimizes the update frequency by selecting an optimum mini-batch size. We demonstrate performance of our adaptive batch-size Gibbs sampler by comparing it against the collapsed Gibb…
A new algorithm reduces bias in estimating model parameters.
Quantum algorithm speeds up Gibbs partition function estimation.
D-Wave quantum annealing fails to improve sampling quality from RBMs compared to Gibbs sampling.
Paper introduces a new sampling method for Bayesian inference.
New Gibbs sampling method improves MCMC efficiency.
We describe an adaptation of the simulated annealing algorithm to nonparametric clustering and related probabilistic models. This new algorithm learns nonparametric latent structure over a growing and constantly churning subsample of training data, where the portion of data subsampled can be interpreted as the inverse …
We prove a generalization of the fundamental inequality of Guivarc'h relating entropy, drift and critical exponent to Gibbs measures on geometrically finite quotients of CAT(-1) metric spaces. For random walks with finite superexponential moment, we show that the equality is achieved if and only if the Gibbs density is…
Gibbs sampler contracts entropy under strong log-concavity, improving mixing time.
The notion of Berman-Gibbs stability was originally introduced by Robert Berman for -Fano varieties . We show that the pair is K-stable (resp. K-semistable) provided that is Berman-Gibbs stable (resp. semistable).
New model estimates Gibbs free energies using machine learning and isobaric-isothermal flows.
Modified Gibbs-Helmholtz equation geometric models for thermodynamics.
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.