Holomorphic vector fields and anti-canonical divisors on complex manifolds are studied.
problem Existence of non-trivial holomorphic vector fields on compact complex manifolds.
method Vanishing result for measure preserving holomorphic vector fields, Gibbs stability, and log terminal singularities.
result No non-trivial holomorphic vector fields on compact complex manifolds with big anti-canonical line bundle.
Souriau studies Gibbs states for symplectic manifolds with group actions.
problem Understanding Gibbs states for symplectic manifolds with symmetries.
method Adaptation of cross product for pseudo-Euclidean spaces, detailed proofs, examples of Gibbs states.
result Presentation of Gibbs states and associated thermodynamic functions for various symplectic manifolds.
Proposes a link between randomness and compression in deep learning.
problem Improving efficiency in deep learning training.
method Introduces a novel tomographic compression framework called Dual Tomographic Compression (DTC).
result Demonstrates high correlation between learning performance and Gibbs entropy over compression ratios.
Paper derives formulas for higher-order curvature derivatives of framed space curves.
problem Deriving exact formulas for higher-order derivatives of curvature of framed space curves.
method Parametrizing rotation tensor using Gibbs vector, deriving closed-form formulas for derivatives, and formulating a linearized updating algorithm.
result Closed-form formulas and a linearized updating algorithm for curvature and its derivatives of framed space curves.
Adaptive sampling for multimodal distributions converges faster than classical methods.
problem Sampling from multimodal distributions efficiently.
method Adaptive linear dynamics with adaptive diffusion coefficients and vector fields, interpreted as weighted Wasserstein gradient flows.
result Derivative-free dynamics can achieve significantly faster convergence for nonconvex potentials.
The study examines mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression.
problem Investigating convergence properties of data-augmentation samplers for Bayesian probit regression.
method Using recent results on Gibbs samplers for log-concave targets, the study provides non-asymptotic bounds on mixing times.
result Explicit non-asymptotic bounds on mixing times depend on design matrix and prior precision, holding uniformly over responses.
Extends DAMs to Gaussian distributions for efficient pattern storage and retrieval.
problem Limited storage capacity and retrieval methods for non-vector pattern representations.
method Introduces a log-sum-exp energy function over Gaussian distributions, using optimal transport maps for retrieval dynamics.
result Proves exponential storage capacity and provides quantitative retrieval guarantees.
The Gibbs sampler is one of the most popular algorithms for inference in statistical models. In this paper, we introduce a herding variant of this algorithm, called herded Gibbs, that is entirely deterministic. We prove that herded Gibbs has an O(1/T) convergence rate for models with independent variables and for ful…
New method speeds up Gibbs sampling for large graphs.
problem Efficiently sampling from large graphical models.
method Poisson-minibatching Gibbs sampling.
result Theoretical convergence rate guarantees for Poisson-minibatching Gibbs.
Proposes a new SPVM model for RVM with more flexible priors.
problem Improper priors on multiple penalty parameters in RVM lead to improper posteriors.
method Introduces a single penalty approach (SPRVM) and a semi-Bayesian fitting method.
result SPRVM allows for more flexible priors and has proven conditions for posterior propriety.
We prove a large deviation principle for a sequence of point processes defined by Gibbs probability measures on a Polish space. This is obtained as a consequence of a more general Laplace principle for the non-normalized Gibbs measures. We consider three main applications: Conditional Gibbs measures on compact spaces, …
We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for many complex models, integrating out these variables is either analytically or co…
The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently improve the quality of a discrete Gibbs sampler. Our Dobrushin-optimized Gibbs samp…
Generalizes entropy-drift inequality for specific geometric spaces.
problem Entropy, drift, and critical exponent in Gibbs measures on geometrically finite manifolds.
method Generalization of Guivarc'h's inequality for CAT(-1) spaces, analysis of random walks.
result Equality in entropy-drift inequality achieved if and only if Gibbs density is equivalent to hitting measure.
We review a simple model of closed economy, where the economic agents make money transactions and a saving criterion is present. We observe the Gibbs distribution for zero saving propensity, and non-Gibbs distributions otherwise. While the exact solution in the case of zero saving propensity is already known to be give…
For large scale on-line inference problems the update strategy is critical for performance. We derive an adaptive scan Gibbs sampler that optimizes the update frequency by selecting an optimum mini-batch size. We demonstrate performance of our adaptive batch-size Gibbs sampler by comparing it against the collapsed Gibb…
New Gibbs sampling method improves MCMC efficiency.
problem Improving efficiency of Gibbs sampling.
method Non-uniform random scan with selection probability optimization.
result Non-uniform scan improves mixing time of Markov chain.
MLDL preserves manifold geometry in vector transformations.
problem Geometric deterioration in neural network transformations.
method Locally isometric smoothness (LIS) and Markov random field (MRF) encoding.
result Enhanced vector transformations into well-behaved metric homeomorphisms.
Gibbs sampler contracts entropy under strong log-concavity, improving mixing time.
problem Improving the mixing time of Gibbs sampler under strong log-concavity.
method Analyzing Gibbs sampler contraction under strong log-concavity, providing sharp contraction rate.
result Gibbs sampler contracts entropy linearly with condition number and independent of dimension under strong log-concavity.
Developed a Particle-Gibbs sampler for Bayesian feature allocation models.
problem Intractable exact inference in Bayesian feature allocation models.
method Particle-Gibbs sampler for feature allocation matrix updates.
result PG sampler improves performance of feature allocation models.
The notion of Berman-Gibbs stability was originally introduced by Robert Berman for Q-Fano varieties X. We show that the pair (X,−KX) is K-stable (resp. K-semistable) provided that X is Berman-Gibbs stable (resp. semistable).
New model estimates Gibbs free energies using machine learning and isobaric-isothermal flows.
problem Estimating Gibbs free energies for complex systems.
method Normalizing flows trained to sample isobaric-isothermal ensemble.
result Excellent agreement with established baselines for water phases.
Modified Gibbs-Helmholtz equation geometric models for thermodynamics.
problem Geometric interpretation of Gibbs-Helmholtz equation in thermodynamics.
method Developed new holonomic and non-holonomic geometric models associated to Gibbs-Helmholtz equation.
result Characterized equivalence between Gibbs-Helmholtz entropy and other entropies.
New approach for adaptive conformal inference using Blackwell's theory.
problem Non-exchangeable environments in sequential conformal inference.
method Reinterpretation of ACI as a game, construction of coverage and efficiency objectives, approachability strategy.
result Algorithm achieves strong theoretical guarantees and practical insights.
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.
problem Improving the scalability of MCMC methods for complex Bayesian models.
method Relating convergence properties to conditional conductance for non-conjugate hierarchical models.
result Established dimension-free convergence results for Metropolis-within-Gibbs schemes.
New algorithm speeds up SVAR inference for large datasets.
problem Inference in sign-identified SVARs for big data.
method Elliptical slice within Gibbs sampler for computational efficiency.
result Algorithm delivers posterior distribution and is well-defined.
Introduces HMC method for sampling Gibbs densities.
problem Sampling from Gibbs densities efficiently.
method Hamiltonian Monte Carlo (HMC) method based on Hamiltonian dynamics.
result Idealized HMC preserves the target distribution and converges under certain conditions.
New method improves uncertainty quantification in latent variable models.
problem Uncertainty quantification in latent variable models with SGLD-Gibbs.
method Statistical scaling limit theory for SGLD-Gibbs, proposing hyperparameter tuning.
result Explicit guidance on hyperparameter tuning for SGLD-Gibbs ensures meaningful uncertainty quantification.
DiGS improves sampling from multi-modal distributions.
problem Inadequate mixing in MCMC methods for multi-modal distributions.
method Integrates diffusion models and Gibbs sampling to create an auxiliary noisy distribution.
result DiGS exhibits better mixing for multi-modal distributions than state-of-the-art methods.
The Gibbs sampler is a particularly popular Markov chain used for learning and inference problems in Graphical Models (GMs). These tasks are computationally intractable in general, and the Gibbs sampler often suffers from slow mixing. In this paper, we study the Swendsen-Wang dynamics which is a more sophisticated Mark…
Improved MALA method for neural networks uncertainty quantification.
problem Uncertainty quantification in Bayesian neural networks.
method Corrected Stochastic MALA (csMALA) with a simplified correction term.
result Improved surrogate posterior for quantifying uncertainties in neural networks.
This work analyzes Gibbs samplers for Bayesian hierarchical models without dimensionality constraints.
problem Analyzing convergence properties of Gibbs samplers for Bayesian hierarchical models.
method Using Bayesian asymptotics and total variation mixing times, the study provides dimension-free convergence results.
result Dimension-free convergence results for Gibbs samplers targeting hierarchical models under random data-generating assumptions.
Bayesian inference for Levy density with Gibbs posterior in discrete sampling.
problem Inference on Levy density for financial models with jumps.
method Gibbs posterior framework using a loss function for intractable likelihood.
result Gibbs posterior achieves nearly optimal rate of convergence under certain conditions.
Gibbs sampling is the de facto Markov chain Monte Carlo method used for inference and learning on large scale graphical models. For complicated factor graphs with lots of factors, the performance of Gibbs sampling can be limited by the computational cost of executing a single update step of the Markov chain. This cost …
Gibbs sampler mixes quickly for certain smooth distributions.
problem Drawing samples from log-smooth log-concave distributions.
method Analyzes Gibbs sampler on log-smooth and strongly log-concave distributions.
result Gibbs sampler mixes in O⋆(κ2n7.5) steps. A new algorithm for sampling from complex distributions.
problem Sampling from high-dimensional multivariate probability densities.
method Combines kernel herding and Gibbs sampling for deterministic sampling.
result Significantly lower computation time compared to kernel herding.
Study non-asymptotic Langevin Monte Carlo for Gibbs distributions.
problem Sampling from Gibbs distributions with dissipative potentials.
method Langevin-type algorithms based on Liptser--Shiryaev theory and Poincaré inequalities.
result Upper bound on 2-Wasserstein distance for accurate approximation.
The Gibbs algorithm's generalization error is bounded, improving with prior volume in low temperatures.
problem Bounding the generalization error of the Gibbs algorithm in low temperature regimes.
method Analyzes the Gibbs algorithm's performance, extending known high-temperature bounds to low-temperature scenarios.
result With high probability, the generalization error decreases with the total prior volume of similar hypotheses.
We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet process, corresponding to the Dirichlet process, and the stable (or three-param…
Improved particle Gibbs sampling by marginalizing parameters.
problem Bayesian inference in high-dimensional state-space models is challenging.
method Marginalized particle Gibbs sampling, combining MCMC and sequential Monte Carlo.
result Marginalization improves performance beyond the Gibbs sampler, scaling linearly.
Gibbs sampling, as a model learning method, is known to produce the most accurate results available in a variety of domains, and is a de facto standard in these domains. Yet, it is also well known that Gibbs random walks usually have bottlenecks, sometimes termed "local maxima", and thus samplers often return suboptima…
New bounds tighten the generalization error of Gibbs algorithm.
problem Bounding the generalization error of Gibbs algorithm.
method Characterization of generalization error in terms of symmetrized KL information.
result Exact characterization of Gibbs algorithm's expected generalization error.
This work develops machine learning for micromagnetic energy minimization.
problem Minimizing Gibbs free energy in full 3D micromagnetic simulations.
method Advanced machine learning techniques, including Physics-Informed Neural Networks (PINNs) and Extreme Learning Machines (ELMs), with reformulated bounds and optimization schemes.
result Competitive performance of machine learning methods compared to traditional numerical approaches.
New Gibbs sampling reduces GLMB filtering complexity to linear time.
problem NP-hard GLMB density computation in multi-object systems.
method Tempered Gibbs sampler exploiting GLMB structure.
result Linear complexity O(T(P+M)) for GLMB filtering. New diagnostic tool for assessing approximate Bayesian inference.
problem Assessing the trustworthiness of approximate Bayesian inference.
method Reframe the problem in terms of incompatible conditional distributions and use Gibbs priors.
result The diagnostic tool can discover the inductive bias in various Bayesian models and approximations.
A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most accurate approaches and provides unbiased samples from the posterior but it has hi…
New method transfers instances between domains using Gibbs Sampling and RBM.
problem Transfer Learning between domains with limited target data.
method Gibbs Sampling and RBM for instance transition.
result Significant improvement in target classification.
A result about projections of Gibbs measures from a particular class arising in economic modeling is proved.