A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
We extend the Fourier cosine method to discrete probability distributions, achieving faster convergence rates.
We apply a new numerical method, the singular Fourier-Padé (SFP) method invented by Driscoll and Fornberg (2001, 2011), to price European-type options in Lévy and affine processes. The motivation behind this application is to reduce the inefficiency of current Fourier techniques when they are used to approximate piecew…
Efficiently scales continuous kernels with sparse Fourier domain learning.
The Gibbs sampler is one of the most popular algorithms for inference in statistical models. In this paper, we introduce a herding variant of this algorithm, called herded Gibbs, that is entirely deterministic. We prove that herded Gibbs has an convergence rate for models with independent variables and for ful…
Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale to large graphical models by reducing its computational cost. In this paper, we p…
We prove a large deviation principle for a sequence of point processes defined by Gibbs probability measures on a Polish space. This is obtained as a consequence of a more general Laplace principle for the non-normalized Gibbs measures. We consider three main applications: Conditional Gibbs measures on compact spaces, …
We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for many complex models, integrating out these variables is either analytically or co…
The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently improve the quality of a discrete Gibbs sampler. Our Dobrushin-optimized Gibbs samp…
We review a simple model of closed economy, where the economic agents make money transactions and a saving criterion is present. We observe the Gibbs distribution for zero saving propensity, and non-Gibbs distributions otherwise. While the exact solution in the case of zero saving propensity is already known to be give…
For large scale on-line inference problems the update strategy is critical for performance. We derive an adaptive scan Gibbs sampler that optimizes the update frequency by selecting an optimum mini-batch size. We demonstrate performance of our adaptive batch-size Gibbs sampler by comparing it against the collapsed Gibb…
New Gibbs sampling method improves MCMC efficiency.
We prove a generalization of the fundamental inequality of Guivarc'h relating entropy, drift and critical exponent to Gibbs measures on geometrically finite quotients of CAT(-1) metric spaces. For random walks with finite superexponential moment, we show that the equality is achieved if and only if the Gibbs density is…
Gibbs sampler contracts entropy under strong log-concavity, improving mixing time.
The notion of Berman-Gibbs stability was originally introduced by Robert Berman for -Fano varieties . We show that the pair is K-stable (resp. K-semistable) provided that is Berman-Gibbs stable (resp. semistable).
Souriau studies Gibbs states for symplectic manifolds with group actions.
New model estimates Gibbs free energies using machine learning and isobaric-isothermal flows.
Modified Gibbs-Helmholtz equation geometric models for thermodynamics.
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.
Introduces HMC method for sampling Gibbs densities.
New method improves uncertainty quantification in latent variable models.
DiGS improves sampling from multi-modal distributions.
The Gibbs sampler is a particularly popular Markov chain used for learning and inference problems in Graphical Models (GMs). These tasks are computationally intractable in general, and the Gibbs sampler often suffers from slow mixing. In this paper, we study the Swendsen-Wang dynamics which is a more sophisticated Mark…
Improved MALA method for neural networks uncertainty quantification.
This work analyzes Gibbs samplers for Bayesian hierarchical models without dimensionality constraints.
Bayesian inference for Levy density with Gibbs posterior in discrete sampling.
Gibbs sampling is the de facto Markov chain Monte Carlo method used for inference and learning on large scale graphical models. For complicated factor graphs with lots of factors, the performance of Gibbs sampling can be limited by the computational cost of executing a single update step of the Markov chain. This cost …
A new algorithm for sampling from complex distributions.
Gibbs sampler mixes quickly for certain smooth distributions.
Study non-asymptotic Langevin Monte Carlo for Gibbs distributions.
The Gibbs algorithm's generalization error is bounded, improving with prior volume in low temperatures.
We show how spectral filters can improve the convergence of numerical schemes which use discrete Hilbert transforms based on a sinc function expansion, and thus ultimately on the fast Fourier transform. This is relevant, for example, for the computation of fluctuation identities, which give the distribution of the maxi…
We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet process, corresponding to the Dirichlet process, and the stable (or three-param…
Gibbs sampling, as a model learning method, is known to produce the most accurate results available in a variety of domains, and is a de facto standard in these domains. Yet, it is also well known that Gibbs random walks usually have bottlenecks, sometimes termed "local maxima", and thus samplers often return suboptima…
New bounds tighten the generalization error of Gibbs algorithm.
New Gibbs sampling reduces GLMB filtering complexity to linear time.
New diagnostic tool for assessing approximate Bayesian inference.
A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most accurate approaches and provides unbiased samples from the posterior but it has hi…
New method transfers instances between domains using Gibbs Sampling and RBM.
A result about projections of Gibbs measures from a particular class arising in economic modeling is proved.
Bayesian feature allocation models are a popular tool for modelling data with a combinatorial latent structure. Exact inference in these models is generally intractable and so practitioners typically apply Markov Chain Monte Carlo (MCMC) methods for posterior inference. The most widely used MCMC strategies rely on an e…
The paper tackles sampling from Gibbs measures with constrained support, providing a sampling guarantee.
We analyze Gibbs-based transfer learning algorithms using information theory.
Gibbs pruning optimizes neural networks by combining physics and regularization.
The paper proposes a Gibbs sampler for neural network posterior sampling.
GDiff tackles blind denoising with Gibbs sampling and Monte Carlo inference.
We analyze the complexity of Gibbs samplers for inference in crossed random effect models used in modern analysis of variance. We demonstrate that for certain designs the plain vanilla Gibbs sampler is not scalable, in the sense that its complexity is worse than proportional to the number of parameters and data. We thu…
A new method improves uncertainty quantification in Bayesian inference.
Hyper-parameters play a major role in the learning and inference process of latent Dirichlet allocation (LDA). In order to begin the LDA latent variables learning process, these hyper-parameters values need to be pre-determined. We propose an extension for LDA that we call 'Latent Dirichlet allocation Gibbs Newton' (LD…