A new decentralized Bayesian learning method using Metropolis-adjusted Hamiltonian Monte Carlo.
problem Decentralized Bayesian learning with uncertainty quantification.
method Metropolis-adjusted Hamiltonian Monte Carlo in a decentralized federated learning setting.
result Theoretical guarantees and numerical effectiveness of the method on non-convex problems.
A new Metropolis-Hastings algorithm uses Gaussian Processes to speed up sampling from complex models.
problem Sampling from computationally expensive probabilistic models.
method Two-stage Metropolis-Hastings algorithm with a Gaussian Process surrogate model.
result The approach learns the target distribution while sampling, eliminating the need for pre-training.
Modified Metropolis algorithm ensures convergence for multivariate binary distributions with fixed-order updates.
problem Infeasibility of standard Metropolis algorithm for multivariate binary distributions with fixed-order updates.
method Proposed a modified Metropolis transition operator ensuring irreducibility and convergence.
result Ensures convergence to the limiting distribution in multivariate binary case with fixed-order updates.
Generates samples from a target distribution using a discriminator.
problem Sampling from complex target distributions.
method Implicit Metropolis-Hastings algorithm using GAN discriminator.
result Discriminator loss bounds the distance to target distribution.
New MCMC method corrects bias without extra cost.
problem Correcting bias in MCMC algorithms without additional computational cost.
method Generalized Markov Chain Importance Sampling methods.
result Proposed methods are more efficient than Metropolis-Hastings versions.
We introduce an adaptive output-sensitive Metropolis-Hastings algorithm for probabilistic models expressed as programs, Adaptive Lightweight Metropolis-Hastings (AdLMH). The algorithm extends Lightweight Metropolis-Hastings (LMH) by adjusting the probabilities of proposing random variables for modification to improve c…
SMTM improves MCMC sampling in high dimensions with multiple proposals and stereographic integration.
problem Improving MCMC performance in high-dimensional sampling.
method Integrating multiple-try Metropolis with stereographic MCMC framework.
result SMTM outperforms classical MTM and other methods in high-dimensional sampling.
Gradient learning optimises MCMC proposal distributions.
problem Intractable targets in MCMC sampling.
method Gradient-based optimisation of proposal distributions using a maximum entropy regularised objective function.
result Our method can outperform traditional MCMC algorithms, including Hamiltonian Monte Carlo.
Combines MALA and Adam for efficient uncertainty quantification in deep learning.
problem Uncertainty estimation in deep neural networks.
method Integrates Metropolis Adjusted Langevin Algorithm (MALA) with momentum-based optimization (Adam) for efficient sampling from posterior distributions.
result The algorithm approximates the Gibbs posterior in total variation distance and efficiently quantifies epistemic uncertainty.
Develops algorithm to differentiate Metropolis-Hastings for optimization.
problem Optimizing intractable densities with discrete components.
method Fuses stochastic automatic differentiation with Markov chain coupling schemes.
result Unbiased and low-variance gradient estimator for intractable densities.
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.
problem Improving the scalability of MCMC methods for complex Bayesian models.
method Relating convergence properties to conditional conductance for non-conjugate hierarchical models.
result Established dimension-free convergence results for Metropolis-within-Gibbs schemes.
cKAM improves adaptive sampling by incorporating a cyclical stepsize scheme.
problem Adaptive Metropolis algorithms can get stuck in local modes.
method cKAM uses a cyclical stepsize scheme to encourage exploration and escape from local modes.
result cKAM successfully escapes local modes and converges to the true posterior distribution.
This paper reviews multiple try MCMC methods for signal processing.
problem Estimating parameters in signal processing using Bayesian inference.
method Review of MCMC methods with multiple candidates.
result Comparison and analysis of different MCMC techniques.
MAFLA improves sampling from heavy-tailed distributions using MH-inspired corrections.
problem Sampling from heavy-tailed and multimodal distributions when neither target nor proposal densities can be evaluated.
method Metropolis-Adjusted Fractional Langevin Algorithm (MAFLA) with Score Balance Matching.
result MAFLA significantly improves finite-time sampling accuracy over unadjusted fractional Langevin dynamics.
Improved spectral gap for MwG with adaptive RWM proposals.
problem Improving mixing efficiency of MwG for log-concave distributions.
method Using adaptive RWM proposals tuned to match conditional variances of log-concave target distributions.
result Established a spectral gap lower bound of order O(1/κd) for MwG. Relational learning can be used to augment one data source with other correlated sources of information, to improve predictive accuracy. We frame a large class of relational learning problems as matrix factorization problems, and propose a hierarchical Bayesian model. Training our Bayesian model using random-walk Metro…
New method improves blockchain analysis by handling temporal changes and scalability.
problem Limited focus on evolving nature and scalability of blockchain transaction networks.
method Incremental approach with Metropolis-Hastings random walks.
result Comparable performance in node classification tasks with reduced computational overhead.
We present a novel Metropolis-Hastings method for large datasets that uses small expected-size minibatches of data. Previous work on reducing the cost of Metropolis-Hastings tests yield variable data consumed per sample, with only constant factor reductions versus using the full dataset for each sample. Here we present…
Monte Carlo (MC) sampling methods are widely applied in Bayesian inference, system simulation and optimization problems. The Markov Chain Monte Carlo (MCMC) algorithms are a well-known class of MC methods which generate a Markov chain with the desired invariant distribution. In this document, we focus on the Metropolis…
RLMH improves adaptive MCMC by optimizing contrastive divergence reward.
problem Tuning MCMC samplers is challenging and time-consuming.
method Formulated Metropolis-Hastings as a Markov decision process and used RL to adaptively tune it.
result A novel reward function based on contrastive divergence outperforms existing ones.
Study optimizes step size for Metropolis algorithm in non-identifiable cases.
problem Optimizing step size for Metropolis algorithm in non-identifiable models.
method Analytical derivation of average acceptance rate for non-identifiable cases.
result Developed optimization principle for step size based on average acceptance rate.
AMAGOLD improves stochastic gradient MCMC by infrequent Metropolis-Hastings corrections.
problem Bias in stochastic gradient Hamiltonian Monte Carlo (SGHMC).
method AMAGOLD infrequently uses Metropolis-Hastings corrections to remove bias, with a fixed step size schedule.
result AMAGOLD converges to the target distribution with a fixed, rather than a diminishing, step size, and at most a constant factor slower convergence rate.
Paper presents a fast, private MH algorithm for large-scale Bayesian inference.
problem Privacy-preserving Bayesian inference for large-scale data.
method Developed a novel DP-MH algorithm using minibatches.
result First exact and fast DP MH algorithm with privacy, scalability, and efficiency trade-offs.
UniNet efficiently learns network representations from large graphs.
problem Efficiently learning network representations from large graphs.
method Metropolis-Hastings sampling for efficient edge sampling and random walk model abstraction.
result UniNet outperforms existing NRL models on billion-edge networks.
A new two-step MH method for Bayesian EL computation.
problem Complex likelihood support in Bayesian EL.
method Hierarchical Metropolis Hastings with reversible jump MCMC.
result Improved sampling from BayesEL posteriors.
SMH kernel speeds up Bayesian inference for large datasets.
problem Inefficient MCMC methods for large datasets.
method Combines factorized acceptance probabilities, fast simulation, and control variates.
result Achieves geometric ergodicity and exact posterior sampling.
CGMH uses Metropolis-Hastings sampling to generate sentences with complex constraints.
problem Generating sentences with specific constraints while maintaining fluency and naturalness.
method CGMH employs Metropolis-Hastings sampling for constrained sentence generation.
result CGMH outperforms previous methods in various constrained sentence generation tasks.
New tuning rules for Metropolis algorithms derived from Bayesian large-sample asymptotics.
problem Optimal scaling in random-walk Metropolis algorithms under realistic assumptions.
method Large-sample asymptotics to derive weak convergence results and tuning guidelines.
result Tuning guidelines consistent with previous ones when target density is product form, accounting for correlation structure.
This paper uses MH algorithm to improve variational inference and GANs.
problem Improving sampling efficiency in Bayesian inference and GANs.
method Proposes learning an independent sampler to maximize MH acceptance rate, related to variational inference. Deduces GANs from MH perspective.
result Improves variational inference and GANs performance on real-world datasets.
New algorithm improves sampling from constrained spaces.
problem Sampling from constrained spaces efficiently.
method Metropolis-adjusted Mirror Langevin algorithm.
result Unbiased sampling with improved mixing time.
A new MH-MCMC method using mini-batches and stochastic gradient for scalable inference.
problem Computational inefficiency of traditional MCMC algorithms for large datasets.
method Mini-batch MH-MCMC with reversible stochastic gradient proposal.
result The method provides approximate tempered stationary distribution and reasonable acceptance probabilities.
Optimizes Metropolis-Hastings algorithms for efficient sampling in high dimensions.
problem Efficiently sampling from complex target distributions in high-dimensional spaces.
method Analyzes and optimizes the Barker proposal and other locally-balanced algorithms.
result Derives optimal noise distribution and balancing function for the Barker proposal.
A new algorithm improves sampling for graph learning models.
problem Euclidean proposals struggle near the boundary of PSD matrices.
method ConeMALA, a geometry-aware Langevin algorithm.
result ConeMALA achieves higher ESS/sec and stable diagnostics.
Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques have become very popular in signal processing over the last years. Importance Sampling (IS) is a well-known Monte Carlo technique that approximates integrals involving a posterior distribution by means of weighted samples. In th…
MH-GAN uses a discriminator to improve sampling from a GAN's distribution.
problem Improving sampling from a GAN's implicitly defined distribution.
method Combines Markov chain Monte Carlo and GANs, using a discriminator to wrap the generator.
result MH-GAN samples from the true distribution even when the generator is imperfect.
This paper proposes a new method to improve the MH algorithm for Bayesian estimation.
problem Difficulty in tuning the proposal distribution for efficient convergence in MH algorithms.
method Uses damped BFGS updates to incorporate gradient and curvature information from numerical optimization.
result Empirically demonstrates improved mixing and convergence of MH algorithm realisations.
Bayesian method learns causal orderings from heterogeneous data.
problem Learning causal structure from heterogeneous data.
method Order-based Bayesian framework for Gaussian DAG models.
result Causal ordering is identifiable up to two permutations.
New sampling method improves accuracy for constrained spaces.
problem Sampling from constrained convex subsets of R^d.
method Metropolis-adjusted Preconditioned Langevin Algorithm.
result High-accuracy sampling with polylogarithmic error dependence.
PL-MCMC samples from normalizing flows' conditional distributions.
problem Sampling from complex conditional distributions learned by normalizing flows.
method Metropolis-Hastings implementation of PL-MCMC.
result PL-MCMC asymptotically samples from exact conditional distributions.
A DP method selects best sparse models in high dimensions efficiently.
problem Model selection in high-dimensional sparse linear regression under privacy constraints.
method Differential privacy (DP) with exponential mechanism and Metropolis-Hastings algorithm.
result The method identifies active features quickly under privacy constraints.
The study examines convergence of stochastic processes on large graphs and adjacency matrices.
problem Analyzing convergence of stochastic processes on large graphs and adjacency matrices.
method Introduced new metrics on the space of measure-valued graphons and used them to show convergence of random trajectories to deterministic curves.
result The Metropolis chain converges to a deterministic gradient flow curve on the space of graphons under certain conditions.
Optimal preconditioning improves Langevin sampling efficiency.
problem Improving sampling efficiency in high-dimensional target distributions.
method Optimal preconditioning using Fisher information, applied to MALA.
result Adaptive MCMC scheme significantly outperforms other methods.
New method samples Jeffreys prior for objective Bayesian inference.
problem Sampling from Jeffreys prior is challenging.
method Metropolis-Adjusted Langevin Algorithm
result Samples can be directly used in Bayesian methods.
This paper improves conditional sampling for VAEs by overcoming structural issues.
problem Computational intractability of conditional sampling in VAEs.
method Proposes two methods to address pitfalls in Metropolis-within-Gibbs (MWG) for VAEs.
result Improved performance on sampling tasks.
Unbiased smoothing method improves accuracy in noisy measurements.
problem Approximating latent Markov process expectations with noisy measurements.
method Coupling Particle Independent Metropolis-Hastings (PIMH) chains.
result Unbiased smoothing estimators for parallel computing and confidence intervals.
MALA improves sampling from log-concave densities with faster mixing times.
problem Sampling from strongly log-concave densities efficiently.
method Discretization of Langevin diffusion with accept-reject step.
result MALA requires O(κdlog(1/δ)) steps for TV error δ. Enhanced MH algorithm reduces expensive function evaluations and improves sampling efficiency.
problem Computational expense of evaluating target distributions or likelihood functions, especially with big data.
method Accelerated MH algorithm using Bayesian optimization and Gaussian processes.
result Significant improvement in sampling efficiency and reduced function evaluations.
Improved sampling for complex distributions using quasi-Newton proposals.
problem Sampling from complex, high-dimensional target distributions efficiently.
method Extended pseudo-marginal Metropolis-Hastings with quasi-Newton proposals.
result Quasi-Newton proposals outperform standard random-walk and Hessian-based proposals.