Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

3537061,0581,411 · Jun 202019922001200920182026
48 results for intractable models

A new method improves inference for complex Bayesian models.

problem Bayesian inference for doubly intractable distributions is computationally challenging.
method Monte Carlo Stein variational gradient descent (MC-SVGD) approach.
result The method achieves substantial computational gains over existing algorithms.

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte Carlo techniques (Møller et al., 2006; Murray et al., 2006) for tackling this pr…

2017-10-12abs ↗pdf ↗

Researchers develop a method for statistical inference in models with intractable likelihoods.

problem Statistical inference for models with intractable likelihoods.
method Minimum distance estimators using maximum mean discrepancy (MMD) in reproducing kernel Hilbert space.
result The estimators are consistent, asymptotically normal, and robust to model misspecification.

Develops a new Bayesian inference method for discrete data.

problem Computational challenges in discrete state spaces, especially intractable likelihoods.
method Uses a discrete Fisher divergence to update beliefs about model parameters, circumventing the intractable normalising constant.
result Establishes statistical properties of the generalised posterior and proposes a calibration approach.

Generative Bayesian Filtering improves inference in complex models without explicit density evaluations.

problem Performing posterior inference in complex nonlinear and non-Gaussian state-space models.
method Generative Bayesian Filtering (GBF) extends GBC to dynamic settings using deep neural networks for recursive posterior inference. Generative-Gibbs sampler bypasses density evaluations for parameter learning.
result GBF significantly outperforms likelihood-free approaches in accuracy and robustness for intractable state-space models.

A new MCMC method for GPs tackles computational burden and intractable likelihoods.

problem High computational burden and intractable likelihoods in Gaussian process models.
method Combines variationally sparse Gaussian processes with pseudo-marginal MCMC.
result Asymptotically exact inference with computational gains for large datasets.

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational inference and learning algorithm that scales to large datasets and, under some mild dif…

2013-12-20abs ↗pdf ↗

A new method for sampling from posterior distributions in Bayesian inverse problems.

problem Sampling from posterior distributions in Bayesian inverse problems is challenging due to intractable terms.
method Proposes a novel approach that decomposes the transitions, allowing a trade-off between complexity of guidance term and prior transitions.
result Validated through experiments on various inverse problems, including challenging cases with latent diffusion models as priors.

NPE improves scalability and efficiency for ERGMs.

problem Scalability and efficiency issues in Bayesian ERGM estimation.
method Neural posterior estimation (NPE) for ERGMs using neural network density estimation.
result NPE provides more efficient and scalable inference for ERGMs.

Top-performing machine learning systems, such as deep neural networks, large ensembles and complex probabilistic graphical models, can be expensive to store, slow to evaluate and hard to integrate into larger systems. Ideally, we would like to replace such cumbersome models with simpler models that perform equally well…

2015-10-08abs ↗pdf ↗

Optimizes experimental designs for intractable models using mutual information bounds.

problem Finding optimal experimental designs for models with intractable data-generating distributions.
method Maximizes mutual information lower bounds parametrized by neural networks, updating network parameters and designs simultaneously.
result Framework enables experimental design for various tasks including parameter estimation and model discrimination.

Paper proposes nested MLMC for SNPE with intractable likelihoods.

problem Estimating posterior distributions from intractable likelihoods.
method Nested MLMC for loss function and gradients, with convergence results.
result Effective methods for approximating complex multimodal posteriors.

A new sampler tackles high-dimensional models with intractable likelihoods.

problem Statistical inference for models with computationally intractable likelihoods and high-dimensional parameters.
method Likelihood-free approximate Gibbs sampler focusing on lower-dimensional conditional distributions estimated by flexible regression models.
result The sampler enables fitting models with 13,140 parameters that are otherwise impossible with standard ABC techniques.

This paper shows how to perform likelihood inference for complex graphical models efficiently.

problem Intractable normalizing constants in fully and partially observed exponential family graphical models.
method Using a technique from Geyer (1991), the paper estimates the normalizing constant and its gradient.
result Full likelihood-based analysis is feasible and computationally efficient for these models.

New method uses approximate KLD for intractable likelihood models.

problem Designing experiments for models with intractable likelihoods.
method Derive a lower bound of KLD utility, express it in terms of entropies, and evaluate efficiently.
result Demonstrated the performance of the proposed method through numerical examples.

wBSL uses whitening transformations to speed up BSL for intractable likelihood models.

problem Computational demands of Bayesian synthetic likelihood with growing summary statistics.
method Whitening transformations to decorrelate summary statistics.
result Significant reduction in model simulations required for accurate inference.

A new method improves Bayesian inference for multimodal posteriors.

problem Insensitivity to well-separated modes in multimodal posteriors.
method Weighted Kernel Stein Discrepancy method.
result Significantly improved mode sensitivity compared to standard KSD-Bayes.

We propose a novel approach to parameter estimation for simulator-based statistical models with intractable likelihood. Our proposed method involves recursive application of kernel ABC and kernel herding to the same observed data. We provide a theoretical explanation regarding why the approach works, showing (for the p…

2018-02-23abs ↗pdf ↗

New method uses neural exponential families for likelihood-free inference.

problem Bayesian Likelihood-Free Inference with intractable likelihood.
method Score Matching neural conditional exponential families for approximate likelihood.
result State-of-the-art performance in posterior sampling for intractable likelihood models.

BSL package simplifies Bayesian synthetic likelihood for complex models.

problem Estimating posterior distributions for models with intractable likelihoods.
method Approximates likelihood via model simulation and density estimation, using penalized covariance and semi-parametric approaches.
result Reduces the need for model simulations and improves efficiency compared to ABC.

ConDiSim uses diffusion models to approximate complex system posteriors efficiently.

problem Simulation-based inference of systems with intractable likelihoods.
method Conditional diffusion model with forward and reverse processes.
result Effective posterior approximation across various benchmark and real-world problems.

The paper introduces a method for fitting complex models using simulation and optimization.

problem Fitting models with intractable likelihood or moments.
method Sequential sampling and local smoothing, combining global and local search phases.
result The proposed method outperforms alternative approaches in fitting complex models.

Undirected graphical models are applied in genomics, protein structure prediction, and neuroscience to identify sparse interactions that underlie discrete data. Although Bayesian methods for inference would be favorable in these contexts, they are rarely used because they require doubly intractable Monte Carlo sampling…

2016-02-11abs ↗pdf ↗

New MCMC methods use auxiliary variables to sample from intractable distributions.

problem Sampling from distributions with unknown normalizing constants.
method Unified Markov chain Monte Carlo framework with auxiliary variables.
result New algorithms outperform existing methods on synthetic and real datasets.

Develops an efficient approximation for collapsed Gibbs sampling in complex models.

problem Intractability of integrating out variables in collapsed Gibbs sampling for complex models.
method Uses expectation propagation to approximate collapsed Gibbs integrals.
result Approximate sampler enables a runtime-accuracy tradeoff in sampling complex models.

Non-convex optimization problems often arise from probabilistic modeling, such as estimation of posterior distributions. Non-convexity makes the problems intractable, and poses various obstacles for us to design efficient algorithms. In this work, we attack non-convexity by first introducing the concept of \emph{probab…

2013-12-16abs ↗pdf ↗