A new method combines classification with population Monte Carlo for efficient ABC.
problem Inefficient particle proposals and subjectivity in ABC methods.
method Classification-PMC, blending adaptive proposals and classification.
result Classification-PMC outperforms state-of-the-art ABC methods in simulations.
Estimates for neural network risk nearly match Monte Carlo error rates.
problem Understanding the performance of two-layer neural networks.
method Established a priori estimates for the population risk of two-layer neural networks.
result The new estimates are nearly optimal and depend only on function norms, not model parameters.
AFT combines AIS, SMC, and NFs for better Monte Carlo estimates.
problem Estimating normalizing constants of complex probability distributions.
method Annealed Flow Transport (AFT) integrates AIS, SMC, and normalizing flows.
result AFT improves Monte Carlo estimates of normalizing constants and expectations.
We propose a new algorithm to do posterior sampling of Kingman's coalescent, based upon the Particle Markov Chain Monte Carlo methodology. Specifically, the algorithm is an instantiation of the Particle Gibbs Sampling method, which alternately samples coalescent times conditioned on coalescent tree structures, and tree…
This paper reviews various sampling methods from statistics and machine learning.
problem Addressing sampling methods in statistics and machine learning.
method Explains and reviews simple random sampling, bootstrapping, stratified sampling, cluster sampling, multistage sampling, network sampling, snowball sampling, and sampling from cumulative distribution function.
result Summarizes characteristics, pros, and cons of different sampling methods.
Adaptive Monte Carlo schemes developed over the last years usually seek to ensure ergodicity of the sampling process in line with MCMC tradition. This poses constraints on what is possible in terms of adaptation. In the general case ergodicity can only be guaranteed if adaptation is diminished at a certain rate. Import…
TP-AIS improves sampling efficiency over existing methods.
problem Efficient sampling from complex probability distributions.
method Iterative sampling using a tree pyramid structure.
result TP-AIS outperforms DM-PMC, M-PMC, and LAIS.
Rodent hippocampal population codes represent important spatial information about the environment during navigation. Several computational methods have been developed to uncover the neural representation of spatial topology embedded in rodent hippocampal ensemble spike activity. Here we extend our previous work and pro…
This work learns models for population dynamics using variational methods and higher-order quadrature.
problem Modeling population dynamics of physical systems with stochastic and mean-field effects.
method Variational problem to infer gradient fields, combining Monte Carlo sampling with higher-order quadrature rules.
result Accurate prediction of population dynamics over a wide range of parameters.
Mesoscopic model infers neural population dynamics from spike trains.
problem Challenges in fitting mechanistic spiking networks to empirical population data.
method Fit mesoscopic model to aggregate population activity, using likelihood of single-neuron and connectivity parameters.
result Extracts posterior correlations between model parameters and defines subsets of parameters able to reproduce data.
Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use simpler proposal probability densities to draw candidate samples. The performan…
FBMS R package simplifies Bayesian model selection and averaging.
problem Complex regression settings with multi-modal posterior landscapes.
method Efficient MJMCMC and GMJMCMC algorithms for Bayesian model exploration.
result FBMS effectively handles Bayesian generalized linear and nonlinear models.
Estimating the log-likelihood gradient with respect to the parameters of a Restricted Boltzmann Machine (RBM) typically requires sampling using Markov Chain Monte Carlo (MCMC) techniques. To save computation time, the Markov chains are only run for a small number of steps, which leads to a biased estimate. This bias ca…
New wavelet frames constructed from reproducing kernels for continuous and discrete domains.
problem Generating wavelet frames on non-Euclidean structures.
method Spectral filtering of integral operators associated with reproducing kernels.
result Discrete frames as Monte Carlo estimates of continuous frames, with finite-sample rates derived.
Paper proposes an ensemble-based AIS for multimodal sampling.
problem Sampling from multimodal distributions is challenging.
method Combines AIS with population-based Monte Carlo methods.
result Improves efficiency through ensemble interaction.
This study improves audit sampling by using sequential procedures with statistical guarantees.
problem Improving audit efficiency and reliability with statistical methods.
method Formulated as a sequential testing problem, defining null and alternative hypotheses, stopping and decision rules, and exact boundary conditions.
result Exact design yields ex ante control of decision error probabilities, and simulation-based implementation approximates this design.
The paper optimizes private data sharing by selecting statistics and using MCMC for Bayesian inference.
problem Optimizing private data sharing by selecting statistics and performing Bayesian inference.
method Promotes Fisher information for statistic selection and proposes MCMC algorithms for inference.
result The Fisher information of the privatized statistic predicts the relative performance of the statistic in Bayesian estimation.
vOED-NFs uses normalizing flows to improve Bayesian OED without likelihood evaluations.
problem Optimizing experiments to maximize information gain in model parameters.
method vOED-NFs combines variational approximations with normalizing flows for efficient EIG estimation.
result vOED-NFs achieves lower EIG estimation bias compared to previous methods.
HAIS improves importance sampling in high dimensions using HMC.
problem Improving importance sampling in high-dimensional problems.
method Two-step adaptive process with parallel HMC chains.
result Significant performance improvement in high-dimensional problems.
CRISP predicts individual-level COVID-19 risk based on contact data.
problem Estimating individual-level infection risk during the pandemic.
method Probabilistic graphical model using SEIR framework with contact data.
result Model accurately predicts infection spread and recovery times.
New algorithms improve MCMC efficiency for complex distributions.
problem High variance and low effective sample size in MCMC samplers.
method Antithetic Riemannian Manifold and Quantum-Inspired Hamiltonian Monte Carlo.
result Improved effective sample size and variance reduction.
Combines normalizing flows and quasi-Monte Carlo for improved numerical integration.
problem Improving the efficiency of numerical integration methods.
method Uses normalizing flows to approximate distributions and quasi-Monte Carlo for sampling.
result Demonstrates an estimator with significantly lower variance.
Speeds up complex portfolio exposure calculations.
problem Calculating exposure of portfolios with exotic derivatives.
method Least Squares Monte Carlo (LSMC) technique.
result Significantly reduces computation time for nested Monte Carlo.
GPU computing has become popular in computational finance and many financial institutions are moving their CPU based applications to the GPU platform. Since most Monte Carlo algorithms are embarrassingly parallel, they benefit greatly from parallel implementations, and consequently Monte Carlo has become a focal point …
We formalize AURC and develop estimators for SC systems.
problem Evaluation of SC systems' performance.
method Formal statistical formulation, Monte Carlo methods, plug-in estimators.
result Plug-in estimators are consistent, with low bias and bounded MSE.
Bayesian inference for biochemical reaction networks using jump-diffusion approximations.
problem Estimating hidden quantities in poorly characterized biochemical processes.
method Developed a Bayesian inference algorithm based on Markov chain Monte Carlo and sequential Monte Carlo methods.
result Numerical evaluation of the algorithm for a partially observed multi-scale birth-death process.
Estimates log marginal likelihood using multilevel Monte Carlo.
problem Estimating log marginal likelihood accurately.
method Unbiased multilevel Monte Carlo estimator.
result Validates application in variational Bayes.
Proposes FedPop for personalised federated learning with uncertainty quantification.
problem Uncertainty quantification and client drift in personalised federated learning.
method FedPop recasts FL into population modeling with Markov chain Monte Carlo methods.
result Non-asymptotic convergence guarantees for uncertainty quantification.
Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques have become very popular in signal processing over the last years. Importance Sampling (IS) is a well-known Monte Carlo technique that approximates integrals involving a posterior distribution by means of weighted samples. In th…
SLMC improves sampling efficiency for high-dimensional distributions.
problem Sampling from high-dimensional distributions is computationally challenging.
method SLMC projects Langevin updates onto subsampled eigenblocks of a time-varying preconditioner.
result SLMC offers superior adaptability and computational efficiency compared to traditional methods.
This study compares MC and QMC methods for derivative pricing, showing QMC's superior convergence rates.
problem Improving derivative pricing accuracy and efficiency in high-dimensional settings.
method Compared Monte Carlo and quasi-Monte Carlo techniques, focusing on convergence rates and low-discrepancy sequences.
result Quasi-Monte Carlo methods achieve superior convergence rates and reduce root mean square error in derivative pricing.
A new eigenvalue-based method speeds up Monte Carlo simulations.
problem Reducing the number of paths needed for accurate Monte Carlo simulations.
method Eigenvalue-based approximation of Markov Chain Monte Carlo.
result Significant variance reduction and comparable results to traditional Monte Carlo.
New methods improve efficiency of sampling algorithms for complex systems.
problem Efficiently sampling from complex, high-dimensional probability distributions.
method Randomized Runge-Kutta-Nyström methods tailored for Hamiltonian flows.
result Quantitative 5/2-order L2-accuracy in approximating Hamiltonian flows. Bayesian method improves estimation of unseen species.
problem Estimating unseen species in biological and physical sciences.
method Bayesian nonparametric approach with Pitman-Yor prior and Gaussian credible intervals.
result Improves asymptotic credible intervals for unseen species estimation.
Stacked Monte Carlo improves option pricing efficiency.
problem Evaluating option prices in various models.
method A stacking technique that approximates Monte Carlo draws using a specified function.
result Shows efficiency in European and Asian Call options in both constant and stochastic volatility models.
We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured decomposition of the model of interest, turning the overall inferential task into a coll…
New method reduces Monte Carlo error in option pricing and Greeks estimation.
problem Reducing Monte Carlo error in option pricing and Greeks estimation.
method Denoised Monte Carlo technique for LSV models.
result Reduces Monte Carlo error by an order of magnitude.
ParaMonte::Python streamlines Bayesian data analysis with fast Monte Carlo and MCMC routines.
problem Efficiently sampling posterior distributions in Bayesian modeling and data science.
method Serial and MPI-parallelized Markov Chain Monte Carlo (MCMC) routines.
result Automated model calibration and uncertainty quantification in Bayesian analysis.
In this paper, we discuss the application of quasi-Monte Carlo methods to the Heston model. We base our algorithms on the Broadie-Kaya algorithm, an exact simulation scheme for the Heston model. As the joint transition densities are not available in closed-form, the Linear Transformation method due to Imai and Tan, a p…
We consider the problem of simulating loss probabilities and conditional excesses for linear asset portfolios under the t-copula model. Although in the literature on market risk management there are papers proposing efficient variance reduction methods for Monte Carlo simulation of portfolio market risk, there is no pa…
Deep learning enhances Hamiltonian Monte Carlo for sampling gauge field configurations.
problem Sampling from complex gauge field topologies efficiently.
method Stacked neural networks to generalize Hamiltonian Monte Carlo.
result Significantly reduces computational cost for generating gauge field configurations.
New algorithms improve sampling from complex distributions.
problem Sampling from complex probability distributions efficiently.
method Regime-switching Langevin dynamics and Monte Carlo algorithms.
result Convergence guarantees and iteration complexities provided.
Improves Monte-Carlo simulations for consistent mean and variance.
problem Artificial randomness in running mean calculations.
method Combining running mean and variance with accurate summing.
result Increased accuracy and robustness of Monte-Carlo estimates.
This thesis tackles non-convex Bayesian learning via scalable dynamic importance sampling algorithms.
problem Non-convex Bayesian learning problem in deep neural networks.
method Replica exchange Langevin Monte Carlo, control variates method, population-chain replica exchange, scalable dynamic importance sampling.
result Control variates method reduces variance and accelerates convergence in non-convex Bayesian learning.
This paper extends AD techniques to Monte Carlo processes for efficient derivative calculation.
problem Obtaining derivatives of expectation values in Monte Carlo processes.
method Two approaches: reweighting and Hamiltonian extension of HMC.
result Hamiltonian approach as a change of variables simplifies variance reduction.
Hamiltonian Monte Carlo converges to target distributions under mild conditions.
problem Establishing convergence of Hamiltonian Monte Carlo algorithms.
method Analyzing Lq convergence for Hamiltonian Monte Carlo under mild conditions. result Outputs converge to target distributions under specified conditions.
New method combines Monte Carlo and tensor networks for solving complex equations.
problem Solving high-dimensional partial differential equations efficiently.
method Uses Monte Carlo simulations and tensor train sketching for updates and re-estimations.
result Demonstrates versatility and efficacy in solving specific equations.
Simulation-based inference speeds up gravitational wave data analysis.
problem High-dimensional parameter spaces and complex noise in gravitational wave data.
method Simulation-based inference methods using machine learning techniques.
result Simulation-based inference methods improve speed over traditional methods.