BRPC online Bayesian calibration handles gradual and abrupt system changes.
problem Aligning model outputs with field observations in evolving systems.
method Bayesian Recursive Projected Calibration (BRPC) for streaming data under simulator mismatch and nonstationarity.
result Improves calibration accuracy under gradual changes and robustness under abrupt regime shifts.
Unified Bayesian-AI framework improves epidemiological risk prediction and uncertainty quantification.
problem Lack of calibrated uncertainty in machine learning models for epidemiology.
method Combines Bayesian prediction with Bayesian hyperparameter optimization using logistic regression and Gaussian-process Bayesian optimization.
result Unified Bayesian-AI framework provides reliable coverage and improved calibration, enhancing epidemiological decision making.
The paper presents methods to improve uncertainty calibration in Bayesian Neural Networks.
problem Uncalibrated Bayesian Neural Networks often lead to overconfidence.
method The paper uses alpha-divergences from Information Geometry for calibration.
result Calibration using alpha-divergences provides better uncertainty estimates and is more efficient.
The paper improves Bayesian optimization by calibrating uncertainty estimates.
problem Improper uncertainty estimates in Bayesian optimization when data is non-stationary.
method Proposes online learning algorithms to maintain calibration on non-i.i.d. data and integrates them into Bayesian optimization.
result Calibrated Bayesian optimization converges to better optima in fewer steps.
Bayesian neural networks outperform calibrated neural networks for tabular data.
problem Uncertainty in neural network predictions for tabular data.
method Bayesian neural networks vs. post-hoc calibration methods.
result Bayesian neural networks yield competitive performance compared to calibrated neural networks.
Efficiently calibrates epidemiological models using Bayesian optimization.
problem Calibration of complex epidemiological models is computationally expensive and challenging.
method Graybox Bayesian optimization scheme leveraging Gaussian processes and functional structure of compartmental models.
result Proposed methods achieve efficient calibration and improved performance compared to existing schemes.
BayCANN uses ANN to speed up Bayesian calibration in health sciences.
problem Bayesian calibration's practical and computational burdens in health decision sciences.
method BayCANN trains an ANN metamodel to calibrate parameters probabilistically, comparing accuracy and speed to direct Bayesian calibration.
result BayCANN is more accurate and faster than direct Bayesian calibration methods.
Schervish (1985b) showed that every forecasting system is noncalibrated for uncountably many data sequences that it might see. This result is strengthened here: from a topological point of view, failure of calibration is typical and calibration rare. Meanwhile, Bayesian forecasters are certain that they are calibrated-…
Loss-calibrated EP improves Bayesian decision-making by focusing on utility-sensitive posterior approximations.
problem Bayesian decision-making under asymmetric utility functions.
method Loss-calibrated expectation propagation (Loss-EP) that tilts the posterior towards higher utility decisions.
result Loss-EP can capture useful information for decision-making under asymmetric penalties.
Improved Bayesian FL method calibrates predictions for federated learning.
problem Overconfident predictions in Bayesian FL methods for federated learning.
method β-Predictive Bayes algorithm interpolates between mixture and product of local predictive posteriors, tuning parameter β for better calibration.
result Demonstrated superior calibration compared to other baselines, even with increased data heterogeneity.
This paper calibrates Gaussian process predictive distributions for Bayesian optimization to improve sampling decisions.
problem Lower-tail miscalibration in GP predictive distributions affects BO sampling decisions.
method Introduces goal-oriented calibration for GP predictive distributions below a threshold t. result Post-hoc method tcGP improves lower-tail calibration and BO performance.
Leaky ReLU activations improve the calibration of Bayesian neural networks.
problem Bayesian neural networks struggle with mean-field variational inference for ReLU activations.
method Investigated the effect of activation functions on the calibration of Bayesian neural networks.
result Leaky ReLU activations lead to more Gaussian-like weight posteriors and lower expected calibration error.
Study improves neural network calibration for drug discovery.
problem Improper calibration of neural network predictions in drug discovery.
method Compared different metrics for model hyperparameter tuning and proposed Bayesian Linear Probing (BLP) method.
result Bayesian Linear Probing (BLP) improves model calibration and accuracy.
Bayesian neural networks improve uncertainty calibration with DAP priors.
problem Improving predictive uncertainty in deep learning models outside training data.
method Distance-Aware Prior (DAP) calibration method to correct overconfidence.
result Demonstrated effectiveness in various classification and regression tasks.
Bayesian calibration speeds up ABM for pandemic modeling.
problem Calibrating stochastic ABMs for accurate pandemic predictions is computationally intensive.
method Random forest surrogate modeling for accelerated ABM evaluation.
result Improved predictive performance with random forest calibration compared to previous methods.
Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in critical decision scenarios. In this work, we propose to use a decoupled Bayesian stage…
NeuralSurv models survival analysis with Bayesian uncertainty.
problem Capturing time-varying risk relationships in survival analysis.
method Two-stage data-augmentation scheme, mean-field variational algorithm, coordinate-ascent updates, locally linearized Bayesian neural network.
result Delivers superior calibration compared to state-of-the-art models.
Bayesian calibration improves ABMs for predicting travel patterns.
problem Calibrating ABMs for accurate travel pattern predictions.
method Gaussian Process emulator with deep learning dimensionality reduction for high-dimensional, non-stationary data.
result Improved accuracy in predicting travel patterns using traffic flow data.
New method calibrates neural network uncertainty for medical images.
problem Uncalibrated probabilistic outputs from deep neural networks in medical diagnosis.
method Functional space variational inference for Bayesian neural networks.
result Better calibrated uncertainty estimates at lower computational cost.
Bayesian deep learning improves accuracy and calibration without sacrificing scalability.
problem Bayesian inference's potential for deep neural networks.
method Marginalization over optimization, using neural networks' inherent structure and inductive biases.
result Improvements in accuracy and calibration compared to standard training methods.
We introduce a Bayesian solution for the problem in forensic speaker recognition, where there may be very little background material for estimating score calibration parameters. We work within the Bayesian paradigm of evidence reporting and develop a principled probabilistic treatment of the problem, which results in a…
Bayesian method calibrates local volatility with Gaussian processes.
problem Calibrating local volatility models is challenging.
method Bayesian inference with Gaussian process priors.
result Rich probabilistic model of local volatility with uncertainty.
Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use of approximate inference, Bayesian uncertainty estimates are often inaccurate -…
Bayesian framework predicts aerodynamic uncertainty from sparse measurements.
problem Calibrating aerodynamic models with sparse and uncertain measurements.
method Bayesian latent Gaussian process for surrogate model calibration.
result Calibrated surrogate model accurately predicts aerodynamic uncertainty.
New method improves calibration of BayesCG for better uncertainty quantification.
problem Bayesian conjugate gradient method's poor calibration limits its utility.
method Randomized postiteration strategy to enhance posterior calibration.
result The method improves the distribution of posterior errors and enhances uncertainty quantification.
Proposes FIPO-BC for efficient online calibration of complex models.
problem Efficiently calibrating computationally expensive models with large datasets.
method Fixed inducing points online Bayesian calibration (FIPO-BC) algorithm.
result FIPO-BC is at least ten times faster than standard methods and enables online updates.
Bayesian neural SDEs calibrate financial models robustly.
problem Calibrating financial models using neural SDEs for robustness.
method Bayesian framework with prior and likelihood, global approximation theorem, Langevin algorithm.
result Robust bounds on implied volatility surface learned from historical and option data.
Bayesian calibration for BCP self-assembly models using image data and measure transport.
problem Calibrating models of BCP self-assembly from image data with aleatory uncertainty.
method Likelihood-free inference via measure transport and summary statistics.
result Expected information gains can be computed efficiently for model calibration.
Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model discrepancy term using Gaussian processes; inference is then carried out using M…
The paper corrects Bayesian neural network approximations to improve decision quality.
problem Inaccurate posterior approximations in Bayesian neural networks lead to suboptimal decisions.
method Develops methods to calibrate approximate posterior predictive distributions for better decision making.
result Empirically produces higher quality decisions compared to previous methods.
Bayesian GBMs improve predictive uncertainty calibration for tabular data.
problem Lack of well-calibrated predictive uncertainties in gradient boosting machines.
method Variational inference with soft decision trees.
result Variational soft GBMs provide useful uncertainty estimates and maintain good predictive performance.
Two methods improve Gaussian process predictive distributions' calibration.
problem Improving the reliability of Gaussian process predictive intervals.
method Introduces two methods: cps-gp and bcr-gp, both adapting conformal predictive systems to GP interpolation.
result Both methods provide finite-sample marginal calibration and smooth predictive distributions.
Adaptive calibration improves model accuracy with fewer simulations.
problem Inefficient calibration of complex models using fixed designs.
method Bayesian adaptive experimental design to optimize simulation runs.
result The method achieves better parameter estimation with fewer simulations.
Researchers develop methods to calibrate ABMs using Bayesian techniques.
problem Challenges in calibrating ABMs due to likelihood intractability and non-differentiability.
method Generalised variational inference for differentiable ABMs.
result Accurate Bayesian parameter inferences for differentiable ABMs demonstrated.
Bayesian approach fixes overconfidence in ReLU networks, even slightly.
problem Overconfidence in ReLU networks far from training data.
method Theoretical analysis of approximate Gaussian distributions on ReLU weights, and empirical validation.
result Even a simplistic Bayesian approximation fixes overconfidence issues.
This paper examines how to calibrate ensemble members for better prediction accuracy.
problem Improper calibration of deep neural networks leads to unreliable probability estimates.
method Theoretical analysis and empirical evaluation on CIFAR-100 dataset.
result Well-calibrated ensemble members do not guarantee a well-calibrated ensemble prediction, but a well-calibrated ensemble prediction cannot exceed the average performance of its members.
This paper establishes the asymptotic consistency of the {\it loss-calibrated variational Bayes} (LCVB) method. LCVB was proposed in~\cite{LaSiGh2011} as a method for approximately computing Bayesian posteriors in a `loss aware' manner. This methodology is also highly relevant in general data-driven decision-making con…
CCI combines Bayesian and gradient boosting to create fair, reliable credit risk scores.
problem Tackles high-stakes lending decisions with changing data distributions and fairness constraints.
method Combines Bayesian neural risk scorer and fairness-constrained gradient boosting with shift-aware fusion.
result CCI achieves best trade-off between discrimination, calibration, stability, and fairness.
Study shows uncertainty calibration improves BO performance, but not as much as model type.
problem Effect of model uncertainties on Bayesian optimization performance.
method Extensive study comparing different surrogate models and their uncertainty calibration.
result Gaussian Processes outperform other models in BO, and uncertainty calibration does not significantly improve regret.
CP4SBI improves the calibration of credible sets in SBI models.
problem Inaccurate credible sets in SBI models lead to underestimation of true parameters.
method Develops a local conformal calibration framework for SBI models.
result Improves the quality of uncertainty quantification for neural posterior estimators.
Score calibration enables automatic speaker recognizers to make cost-effective accept / reject decisions. Traditional calibration requires supervised data, which is an expensive resource. We propose a 2-component GMM for unsupervised calibration and demonstrate good performance relative to a supervised baseline on NIST…
Bayesian models for networks are often misspecified, leading to overconfident inference.
problem Real-world networks violate assumptions of geometry and link function in latent space models.
method Proposes a generalized posterior framework for random geometric graphs, using Link-Sequential R-SafeBayes to adaptively tune posterior regularization.
result Improved calibration and better link prediction performance demonstrated on synthetic and real-world networks.
Bayesian approach improves car-following model calibration and validation with limited data.
problem Difficulties in calibrating car-following models using limited data for work zones.
method Bayesian programming for data analysis and parameter estimation.
result Bayesian methods enhance model calibration and validation accuracy.
Bayesian deep learning improves neural network accuracy and generalization.
problem Improving accuracy and calibration of deep neural networks.
method Bayesian marginalization and deep ensembles to approximate marginalization, and tempering for calibrating predictive distributions.
result Bayesian approaches improve deep neural networks' accuracy and generalization.
SGPA calibrates transformer uncertainty for safety-critical tasks.
problem Uncertainty estimation in transformer models for safety-critical domains.
method Bayesian inference in transformer's output space using sparse Gaussian processes.
result SGPA-based Transformers improve in-distribution calibration and out-of-distribution robustness.
We study statistical calibration, i.e., adjusting features of a computational model that are not observable or controllable in its associated physical system. We focus on functional calibration, which arises in many manufacturing processes where the unobservable features, called calibration variables, are a function of…
The study uses statistical methods to analyze nuclear mass models.
problem Understanding the information content of nuclear masses from models.
method Bayesian calibration, Bayesian model averaging, chi-square correlation analysis, principal component analysis.
result A dramatic parameter reduction can be achieved in both 4-parameter and 14-parameter models.
The paper proposes a framework to calibrate multi-agent simulation models from output series using Bayesian optimization.
problem Calibrating multi-agent simulation models from observable output series.
method Novel eligibility set concept, two-sample Kolmogorov-Smirnov test with Bonferroni correction, Bayesian optimization (BO), and trust-region BO (TuRBO).
result Demonstrated the efficiency of the proposed framework using numerical experiments.