New method reduces Gibbs partition function estimation complexity.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A new method avoids partition function computation for Gibbs density estimation.
Quantum algorithm speeds up Gibbs partition function estimation.
New bound on partition function proves Kähler-Einstein stability.
The Gibbs sampler is a particularly popular Markov chain used for learning and inference problems in Graphical Models (GMs). These tasks are computationally intractable in general, and the Gibbs sampler often suffers from slow mixing. In this paper, we study the Swendsen-Wang dynamics which is a more sophisticated Mark…
We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet process, corresponding to the Dirichlet process, and the stable (or three-param…
New method uses quantum annealing and VAN for better statistical mechanics calculations.
New algorithms improve convergence rates for non-log-concave sampling and log-partition estimation.
The beta-negative binomial process (BNBP), an integer-valued stochastic process, is employed to partition a count vector into a latent random count matrix. As the marginal probability distribution of the BNBP that governs the exchangeable random partitions of grouped data has not yet been developed, current inference f…
The paper clarifies thermodynamics on non-compact symmetric spaces using Kähler geometry.
The Gumbel trick is a method to sample from a discrete probability distribution, or to estimate its normalizing partition function. The method relies on repeatedly applying a random perturbation to the distribution in a particular way, each time solving for the most likely configuration. We derive an entire family of r…
Improved sampling for Bayesian neural networks reduces vanishing acceptance rates and increases predictive accuracy.
We develop the distance dependent Chinese restaurant process (CRP), a flexible class of distributions over partitions that allows for non-exchangeability. This class can be used to model many kinds of dependencies between data in infinite clustering models, including dependencies across time or space. We examine the pr…
New model detects hidden group structures in criminal networks.
A hierarchical gamma process infinite edge partition model is proposed to factorize the binary adjacency matrix of an unweighted undirected relational network under a Bernoulli-Poisson link. The model describes both homophily and stochastic equivalence, and is scalable to big sparse networks by focusing its computation…
Modified Gibbs-Helmholtz equation geometric models for thermodynamics.
Bayesian mixture models are widely applied for unsupervised learning and exploratory data analysis. Markov chain Monte Carlo based on Gibbs sampling and split-merge moves are widely used for inference in these models. However, both methods are restricted to limited types of transitions and suffer from torpid mixing and…
Souriau studies Gibbs states for symplectic manifolds with group actions.
This work analyzes Gibbs samplers for Bayesian hierarchical models without dimensionality constraints.
The edge partition model (EPM) is a fundamental Bayesian nonparametric model for extracting an overlapping structure from binary matrix. The EPM adopts a gamma process (P) prior to automatically shrink the number of active atoms. However, we empirically found that the model shrinkage of the EPM does not typically wo…
Enhances robustness in experimental design through Generalised Bayesian inference.
Bayesian inference for Levy density with Gibbs posterior in discrete sampling.
New Gibbs sampling method improves MCMC efficiency.
In the popular approach of "Bayesian variable selection" (BVS), one uses prior and posterior distributions to select a subset of candidate variables to enter the model. A completely new direction will be considered here to study BVS with a Gibbs posterior originating in statistical mechanics. The Gibbs posterior is con…
Bayesian inference for biochemical reaction networks using jump-diffusion approximations.
A new method improves uncertainty quantification in Bayesian inference.
To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stacked gamma distributions, whose scales depend on the covariates. Generalizing logistic regression that…
The Gibbs sampler is one of the most popular algorithms for inference in statistical models. In this paper, we introduce a herding variant of this algorithm, called herded Gibbs, that is entirely deterministic. We prove that herded Gibbs has an convergence rate for models with independent variables and for ful…
Topological recursion recovers a specific partition function for colored knots.
Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from complicated high-dimensional posterior distributions. The key point for the suc…
Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale to large graphical models by reducing its computational cost. In this paper, we p…
Entity resolution (ER; also known as record linkage or de-duplication) is the process of merging noisy databases, often in the absence of unique identifiers. A major advancement in ER methodology has been the application of Bayesian generative models, which provide a natural framework for inferring latent entities with…
Proposes SPFB method for optimizing partition functions in stochastic learning.
PPL improves on Takacs-Fiksel estimation for Gibbs models.
Given discrete time observations over a fixed time interval, we study a nonparametric Bayesian approach to estimation of the volatility coefficient of a stochastic differential equation. We postulate a histogram-type prior on the volatility with piecewise constant realisations on bins forming a partition of the time in…
In this paper we relate the partition function to the max-statistics of random variables. In particular, we provide a novel framework for approximating and bounding the partition function using MAP inference on randomly perturbed models. As a result, we can use efficient MAP solvers such as graph-cuts to evaluate the c…
We study 4-dimensional higher-derivative conformal higher spin (CHS) fields generalising Weyl graviton and conformal gravitino. They appear, in particular, as "induced" theories in the AdS/CFT context. We consider their partition function on curved Einstein-space backgrounds like (A)dS or sphere and Ricci-flat spaces. …
New algorithm trains deep neural networks without global optimization.
We perform a resurgence analysis of the Chern-Simons partition function on a Brieksorn homology sphere . Starting from an exact Chern-Simons partition function, we study the Borel resummation of its perturbative expansion.
Paper adapts Bayesian Hui-Walter method for unlabeled data.
Paper studies matching of samples from two distributions with a Gibbs probability weight.
The abstract conjectures a link between knot homologies and quiver partition functions.
We prove a large deviation principle for a sequence of point processes defined by Gibbs probability measures on a Polish space. This is obtained as a consequence of a more general Laplace principle for the non-normalized Gibbs measures. We consider three main applications: Conditional Gibbs measures on compact spaces, …
We study approximations of the partition function of dense graphical models. Partition functions of graphical models play a fundamental role is statistical physics, in statistics and in machine learning. Two of the main methods for approximating the partition function are Markov Chain Monte Carlo and Variational Method…
We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for many complex models, integrating out these variables is either analytically or co…
The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently improve the quality of a discrete Gibbs sampler. Our Dobrushin-optimized Gibbs samp…
Definition of the partition function of U(1) gauge theory is extended to a class of four-manifolds containing all compact spaces and certain asymptotically locally flat (ALF) ones including the multi-Taub--NUT spaces. The partition function is calculated via zeta-function regularization with special attention to its mo…
Let where is a self-adjoint Laplace type operator acting on sections of a vector bundle over a compact Riemannian manifold and is a symmetric endomorphism field. We derive an asymptotic expansion for the heat kernel of as . As a consequence we get an asymptotic expansion for the …