Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

66131197262 · Jun 202019922001200920172026
48 results for posterior inclusion probabilities

Bayesian neural networks are compressed using feature and weight pruning based on posterior inclusion probabilities.

problem Efficiently compressing Bayesian neural networks to reduce computation cost and improve generalizability.
method Bayesian model selection principles are applied to obtain posterior inclusion probabilities for pruning and feature selection.
result Pruned models show better generalizability on simulated and real-world data.

New method improves variational inference for better posterior approximation.

problem Challenges in minimizing inclusive KL divergence for amortized variational inference.
method Likelihood-tempered sequential Monte Carlo samplers to estimate inclusive KL gradient.
result SMC-Wake method fits variational distributions more accurately than existing methods.

Proposes a method to learn sparse deep neural networks with theoretical guarantees.

problem Over-parameterized deep neural networks cause training, prediction, and interpretation difficulties.
method Frequentist-like method for sparse DNNs under Bayesian framework.
result Consistent sparse DNNs with at most O(n/log(n))O(n/\log(n)) connections.

Implied posterior probability of a given model (say, Support Vector Machines (SVM)) at a point x\bf{x} is an estimate of the class posterior probability pertaining to the class of functions of the model applied to a given dataset. It can be regarded as a score (or estimate) for the true posterior probability, which ca…

2019-09-30abs ↗pdf ↗

One of the central themes in the classification task is the estimation of class posterior probability at a new point x\bf{x}. The vast majority of classifiers output a score for x\bf{x}, which is monotonically related to the posterior probability via an unknown relationship. There are many attempts in the literature …

2019-09-12abs ↗pdf ↗

SVB method provides scalable Bayesian proportional hazards model for high-dimensional gene expression data.

problem Bayesian methods for high-dimensional sparse survival data often sacrifice uncertainty quantification or computational scalability.
method Mean-field variational approximation for scalable Bayesian proportional hazards model.
result SVB method offers posterior distribution for parameters and variable selection via posterior inclusion probabilities.

Focal loss improves classification but not class-posterior probability estimation.

problem Improving class-posterior probability estimation from focal loss.
method Proved classification-calibration and derived a transformation to recover true class-posterior probabilities.
result A transformation of the confidence score from focal loss minimization allows recovery of true class-posterior probabilities.

A fast and scalable method for variable selection in high-dimensional Gaussian processes.

problem Inefficient variable selection in high-dimensional Gaussian processes.
method Developed a fast and scalable variational inference algorithm for spike and slab Gaussian processes.
result Consistently outperforms vanilla and sparse variational GPs while retaining similar runtimes.

Efficiently identifies important variables in binary outcomes using variational Bayes.

problem Bayesian variable selection for binary outcomes with computational challenges.
method Mean-field variational Bayes approximation with closed-form updates and efficient inference algorithm.
result Successfully identifies important variables and is orders of magnitude faster than MCMC.

PosCal training improves classification models by calibrating posterior probabilities.

problem Poorly calibrated posterior probabilities in classification models.
method End-to-end training procedure that directly optimizes the objective while minimizing the difference between predicted and empirical posterior probabilities.
result PosCal training achieves about 2.5% task performance gain and 16.1% calibration error reduction.

The semantic map calibrates uncertainty from language model probabilities.

problem Uncertainty in language model probabilities for professional decisions.
method Prespecified semantic map linking probabilities of verbal responses to probabilities of declared states.
result Language-derived probabilities outperform printed numerical probabilities and recover valid uncertainty coverage.

Develops variational inference for Neyman-Scott processes for faster sampling.

problem Slow mixing time in MCMC for posterior sampling in Neyman-Scott processes.
method Variational inference algorithm for Neyman-Scott processes, minimizing KL divergence.
result Achieves better prediction performance than MCMC with limited computational time.

Algorithm identifies correct hypothesis from alternatives in bandit problems.

problem Efficiently identifying the correct hypothesis from a finite set of alternatives in structured stochastic multi-armed bandits.
method Frank-Wolfe Self-Play (FWSP) reformulates the game as a saddle-point problem, using a differential-inclusion argument to prove convergence.
result Convergence of the game value for best-arm identification in linear bandits, with uniform global convergence to the optimal value.

Proposes a Bayesian approach for automatic node selection in sparse neural networks.

problem Reduces structural complexity and computational speedup in large-scale predictive models.
method Uses spike-and-slab Gaussian priors and variational Bayes approach for node selection.
result Establishes variational posterior consistency and optimal contraction rates for sparse networks.

This paper argues against using calibration metrics for assessing posterior probabilities and proposes expected proper scoring rules instead.

problem The assessment of posterior probabilities generated by machine learning classifiers using calibration metrics is flawed and should be replaced with expected proper scoring rules.
method The paper reviews proper scoring rules from a practical perspective, explains why expected PSRs are a principled measure of posterior quality, and introduces a new calibration metric called calibration loss.
result Calibration loss is superior to expected calibration error and expected score divergence calibration metrics for assessing posterior probabilities.

The paper reinterprets Bayesian priors and posteriors using Riemannian manifolds.

problem The dependence of maximum a posteriori estimates on parametrization.
method Assuming a Riemannian manifold with Fisher metric, the paper reinterprets priors and posteriors as distributions over probability distributions, making estimates independent of parametrization.
result A maximum a posteriori estimate independent of parametrization is defined.

New method for PU learning with instance-dependent propensity scores.

problem Learning from positive and unlabeled data with instance-dependent labeling.
method Empirical risk minimization of joint risk function, alternating optimization of posterior probability and propensity score.
result The method achieves comparable or better performance than state-of-the-art methods.

We develop a Bayesian "sum-of-trees" model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm that generates samples from a posterior. Effectively, BART is a nonparametric Bayesian regression appr…

2008-06-19abs ↗pdf ↗

Paper examines stability of Bayesian posterior measures using integral probability metrics.

problem Stability of Bayesian inference in large-scale inverse problems.
method New families of integral probability metrics for likelihood and prior perturbations.
result Constructs new stability results for Bayesian posterior measures.

Loss assigns examples to classes and superclasses in hierarchical data.

problem Learning from hierarchical classification problems with known class hierarchy.
method Introduces a loss function that considers the hierarchy of classes, aiming for consistent classification across different granularities.
result Improves accuracy and reduces coarse errors in classification compared to cross-entropy loss.

We study the task of retrieving relevant experiments given a query experiment. By experiment, we mean a collection of measurements from a set of `covariates' and the associated `outcomes'. While similar experiments can be retrieved by comparing available `annotations', this approach ignores the valuable information ava…

2014-02-19abs ↗pdf ↗

We develop amortized population Gibbs (APG) samplers, a class of scalable methods that frames structured variational inference as adaptive importance sampling. APG samplers construct high-dimensional proposals by iterating over updates to lower-dimensional blocks of variables. We train each conditional proposal by mini…

2019-11-04abs ↗pdf ↗

This document is an invited chapter covering the specificities of ABC model choice, intended for the incoming Handbook of ABC by Sisson, Fan, and Beaumont (2017). Beyond exposing the potential pitfalls of ABC based posterior probabilities, the review emphasizes mostly the solution proposed by Pudlo et al. (2016) on the…

2015-03-26abs ↗pdf ↗

Brain uses synaptic failure to sample from posterior distributions.

problem Bayesian inference in the brain's probabilistic computations.
method Adapting synaptic failure to sample posterior predictive distributions.
result Synaptic failure enables sampling of complete posterior predictive distributions.

We present a new Markov chain Monte Carlo method for estimating posterior probabilities of structural features in Bayesian networks. The method draws samples from the posterior distribution of partial orders on the nodes; for each sampled partial order, the conditional probabilities of interest are computed exactly. We…

2012-02-14abs ↗pdf ↗

BayesBag improves reproducibility of Bayesian inference under model misspecification.

problem Bayesian posteriors can be unreliable and inconsistent under model misspecification.
method Apply bagging to the Bayesian posterior to improve reproducibility.
result Bagged posteriors typically satisfy reproducibility criteria under misspecification.

We extend Bayes' theorem for upper probabilities considering likelihood uncertainty.

problem Addressing uncertainty in likelihood for upper probability bounds.
method Generalization of Wasserman and Kadane's result, considering both prior and likelihood uncertainty.
result A sufficient condition for the upper bound to become an equality.

New method calibrates neural SBI to avoid overconfident posteriors.

problem Overconfident posteriors in SBI due to inaccurate uncertainty quantification.
method Introduces a calibration term into neural model training objective, enabling end-to-end backpropagation.
result Achieves competitive or better coverage and posterior density than existing methods.

This work explores how overparametrization and priors affect Bayesian neural network posteriors.

problem Symmetries, non-identifiabilities, and weight-space priors fragment and inflate BNN posteriors.
method We study the interplay between overparametrization and priors in BNN posteriors, deriving key phenomena and validating through experiments.
result Overparametrization induces structured, prior-aligned weight posterior distributions.

A nonparametric kernel-based method for realizing Bayes' rule is proposed, based on representations of probabilities in reproducing kernel Hilbert spaces. Probabilities are uniquely characterized by the mean of the canonical map to the RKHS. The prior and conditional probabilities are expressed in terms of RKHS functio…

2010-09-29abs ↗pdf ↗

We propose a predictive neural network architecture that can be utilized to update reference velocity models as inputs to the full waveform inversion. Deep learning models are explored to augment velocity model building workflows during processing the 3D seismic volume in salt-prone environments. Specifically, a neural…

2019-08-11abs ↗pdf ↗

Proposes robust ITRs integrating multiple datasets to handle posterior shift.

problem Posterior shift in conditional outcome distributions between source and target populations.
method Distributionally robust approach with closed-form solution and adaptive uncertainty tuning.
result Achieves superior performance compared to existing methods in simulations and real-data applications.

A new probability distribution on full rooted trees helps in model selection.

problem Model selection for full rooted trees is problematic due to their hierarchical structure.
method Assume a prior distribution on full rooted trees, using Bayes decision theory.
result The proposed distribution enables optimal model selection and prevents overfitting.

New sampler reduces MCMC complexity for Bayesian variable selection.

problem High-dimensional Bayesian variable selection with high computation complexity.
method Variable-complexity subset weighted-Tempered Gibbs Sampler (wTGS) with Rao-Blackwellized estimator.
result Variances of Rao-Blackwellized estimator are smaller than those of subset wTGS.

PPI uses predictions and weighting to infer from partially labeled data.

problem Valid inference with partially labeled data.
method Combines model-based predictions with bias correction from labeled data, using Horvitz-Thompson and Hájek corrections.
result IPW-adjusted PPI with estimated propensities performs similarly to known-probability case.