DRO-NPE improves neural posterior estimation by reducing overconfidence and overfitting.
problem Overconfident and unreliable posteriors in simulation-based inference with limited simulation budgets.
method Distributionally robust approach using Wasserstein ambiguity set and KL-based metrics.
result Consistently improves coverage and calibration across benchmark tasks.
New method improves variational inference for dynamical systems without extra computational cost.
problem Inexact variational inference leading to overconfident posterior and overestimation of process noise.
method Proposes a non-factorised posterior distribution for Gaussian process transition functions.
result Improves accuracy of posterior over transition function and process noise estimation.
New method calibrates neural SBI to avoid overconfident posteriors.
problem Overconfident posteriors in SBI due to inaccurate uncertainty quantification.
method Introduces a calibration term into neural model training objective, enabling end-to-end backpropagation.
result Achieves competitive or better coverage and posterior density than existing methods.
Bayesian ReLU nets fix asymptotic overconfidence with infinite features.
problem Bayesian ReLU nets can be asymptotically overconfident far from training data.
method Extend finite ReLU BNNs with infinite ReLU features via a Gaussian process.
result The resulting model is asymptotically maximally uncertain far from the data.
Bayesian models for networks are often misspecified, leading to overconfident inference.
problem Real-world networks violate assumptions of geometry and link function in latent space models.
method Proposes a generalized posterior framework for random geometric graphs, using Link-Sequential R-SafeBayes to adaptively tune posterior regularization.
result Improved calibration and better link prediction performance demonstrated on synthetic and real-world networks.
A technique called 'prior laundering' uses legacy reconstructions to create uncertainty in Bayesian inverse problems.
problem Uncertainty in Bayesian inverse problems when data is uninformative.
method Using an archive of legacy reconstructions to create uncertainty in the posterior distribution, averaging the legacy posterior over measurements.
result The uncertainty reported in the posterior is inherited from the legacy reconstructions, not from the data itself.
QLA improves Bayesian uncertainty estimation for DNNs without increasing computational cost.
problem Overconfident out-of-distribution predictions from DNNs.
method Proposes Quadratic Laplace Approximation (QLA) to improve Bayesian uncertainty quantification.
result QLA yields modest yet consistent uncertainty estimation improvements over Linearized Laplace Approximation (LLA) on five regression datasets.
Improved Bayesian FL method calibrates predictions for federated learning.
problem Overconfident predictions in Bayesian FL methods for federated learning.
method β-Predictive Bayes algorithm interpolates between mixture and product of local predictive posteriors, tuning parameter β for better calibration.
result Demonstrated superior calibration compared to other baselines, even with increased data heterogeneity.
This work extends balancing to various simulation-based inference algorithms for more conservative posterior approximations.
problem Overconfident posterior approximations in simulation-based inference.
method Introduces a balanced version of neural posterior estimation and contrastive neural ratio estimation.
result Balanced versions tend to produce conservative posterior approximations on various benchmarks.
Simulation-based inference methods can produce unreliable posterior approximations.
problem Reliability of simulation-based inference methods for scientific use cases.
method Benchmarked algorithms including Neural Posterior Estimation, Neural Ratio Estimation, Sequential Neural Likelihood, and Approximate Bayesian Computation.
result Ensembling posterior surrogates provides more reliable approximations.
The paper proposes a method to estimate predictive uncertainty in neural networks using gradient uncertainty.
problem Overconfidence in neural network predictions, especially in safety-critical applications.
method Incorporates gradient uncertainty into posterior sampling for efficient predictive uncertainty estimation.
result The proposed method effectively estimates predictive uncertainty on MNIST and notMNIST datasets.
Combines Laplace approximations of deep networks for better uncertainty quantification.
problem Overconfident predictions on outliers in deep learning models.
method Gaussian mixture model posterior using weighted sum of Laplace approximations of pre-trained deep networks.
result Mitigates overconfidence 'far away' from training data.
New BNN method reduces training time and model size.
problem Overconfident predictions in deep learning models.
method Designing STF-BNN for efficient scaling of BNNs.
result Significantly reduces training time and model size compared to vanilla BNNs.
BNRE improves simulation-based inference by producing more conservative posteriors.
problem Overconfident posteriors from current simulation-based inference algorithms risk false inferences.
method Balanced Neural Ratio Estimation (BNRE) that produces more conservative posterior approximations.
result BNRE produces more conservative posterior surrogates on all tested benchmarks and simulation budgets.
New method uses neural networks to efficiently approximate Bayesian inference for complex models.
problem Efficiently approximating Bayesian inference for complex models with varying temperatures.
method Fully amortized neural posterior estimator trained on a single forward pass.
result Achieves competitive posterior approximations across various temperatures and benchmarks.
FMCPE improves SBI accuracy by correcting posterior estimators with flow matching.
problem Model misspecification in SBI leads to biased or overconfident posteriors.
method Flow Matching Corrected Posterior Estimation (FMCPE) trains a posterior approximator and corrects it using calibration samples.
result FMCPE consistently mitigates misspecification effects, improving inference accuracy and uncertainty quantification.
In this article, we analyze the application of options contract in special commodity supply chain such as fresh agricultural products. This problem is discussed in the point of the retailer. When spot market and future market are both available, we discuss how the retailer chooses the optimal production. Furthermore, o…
Method estimates noise transition matrix from noisy labels without relying on unreliable class-posterior estimation.
problem Estimating noise transition matrix from noisy data.
method Total variation regularization to encourage distinguishable predicted probabilities.
result Consistent estimator of the noise transition matrix under mild assumptions.
The thesis tackles overconfident approximations in simulation-based inference.
problem Overconfident conclusions from machine learning approximations in statistical analyses.
method Introduces balancing and Bayesian neural networks to reduce overconfidence.
result Balancing and Bayesian neural networks lead to less overconfident approximations.
FreB protocol uses AI to infer hidden parameters with valid confidence regions.
problem Generating biased or overconfident conclusions from AI-generated posterior distributions.
method Frequentist-Bayes (FreB) protocol reshapes AI-generated posterior distributions into valid confidence regions.
result FreB provides valid confidence regions that consistently include true parameters with expected probability.
Proposes a new method to find overconfident predictions in classifiers.
problem Challenges in assessing classifier accuracy without labeled test data.
method Facility locations utility model and greedy query algorithm.
result Greedy query algorithm finds overconfident unknown unknowns more effectively.
UA-SABI uses surrogates to speed up Bayesian inference for expensive models.
problem Inference for computationally expensive models is slow and uncertain.
method Combines surrogate modeling with Amortized Bayesian Inference (ABI) to propagate uncertainties.
result Reliable, fast, and repeated Bayesian inference for expensive models is achieved.
CBGP boosts GP covariance to model spatiotemporal irregularities.
problem Overfitting and overconfident uncertainty in nonstationary GP models.
method Boosting covariance priors, partially-whitened observations, gradient descent-like procedure.
result Accurate and reliable SBAS ionospheric corrections in challenging space weather.
Regularized mixtures improve inflation and interest rate forecasts, especially correcting overconfidence.
problem Improving density forecasts of Eurozone inflation and real interest rates.
method Construct regularized mixtures of density forecasts with various objectives and penalties.
result Regularized mixtures outperform individual forecasters, especially correcting overconfidence.
Improves Bayesian inference for deep models to better approximate posterior distributions.
problem Bayesian deep learning struggles with intractable posterior distributions, leading to overconfident predictions.
method Uses variational inference to approximate posterior distributions, proposing a unified view and improving inference for deep Gaussian processes.
result Variational inference can provide a lower bound for marginal likelihood, facilitating model selection and optimization.
Bayesian approach fixes overconfidence in ReLU networks, even slightly.
problem Overconfidence in ReLU networks far from training data.
method Theoretical analysis of approximate Gaussian distributions on ReLU weights, and empirical validation.
result Even a simplistic Bayesian approximation fixes overconfidence issues.
Bayesian Pseudo Label Selection reduces overfitting in semi-supervised learning.
problem Overfitting in pseudo-label selection for semi-supervised learning.
method BPLS, a Bayesian framework that approximates the posterior predictive of pseudo-samples.
result BPLS outperforms traditional PLS methods, especially in high-dimensional data.
Bayesian meta-reinforcement learning improves over point estimates with Laplace approximation.
problem Improving meta-reinforcement learning by providing full posterior distributions.
method Augmenting point estimates with Laplace approximation for full posterior distributions.
result Our method performs similarly to variational baselines with fewer parameters.
New CNN approach reduces overconfidence in object classification predictions.
problem Overconfident predictions from deep models, especially SoftMax layer.
method Introduces CNN probabilistic approach using Logit layer for Bayesian inference.
result Proposed approach shows promising performance compared to SoftMax.
New method improves deep learning models' uncertainty estimates.
problem Overconfidence in deep learning predictions.
method Develops a novel training algorithm using conformal inference.
result Produces more reliable uncertainty estimates without sacrificing accuracy.
Bayesian neural networks improve uncertainty calibration with DAP priors.
problem Improving predictive uncertainty in deep learning models outside training data.
method Distance-Aware Prior (DAP) calibration method to correct overconfidence.
result Demonstrated effectiveness in various classification and regression tasks.
Bayesian deep learning uses function-space priors to improve model uncertainty and robustness.
problem Bayesian deep learning struggles with model-specific weight-space priors that are hard to interpret and specify.
method Apply a Dirichlet prior in predictive space and perform approximate function-space variational inference.
result The approach improves uncertainty quantification, scalability, and adversarial robustness in large-scale image classification.
ABC improves uncertainty quantification in LLMs for clinical diagnostics.
problem Overconfident and poorly calibrated estimates of LLMs in clinical domains.
method Approximate Bayesian Computation (ABC) for likelihood-free inference.
result Improves accuracy by up to 46.9%, reduces Brier scores by 74.4%, and enhances calibration.
A new method for self-attention models that improves uncertainty estimation.
problem Overconfident predictions and lack of calibrated uncertainty in Transformers.
method Kernel-Eigen Pair Sparse Variational Gaussian Processes (KEP-SVGP) with Kernel SVD (KSVD) to handle asymmetry of attention kernels.
result Reduction in time complexity and improved performance on various benchmarks.
Bayesian neural networks struggle with uncertainty estimates between regions.
problem Limited expressiveness of predictive uncertainty estimates in between regions.
method Compared mean-field variational inference (MFVI) with linearised Laplace approximation.
result Linearised Laplace approximation handles 'in-between' uncertainty better.
Meta-learning model predicts intervention effects from uncertain causal graphs.
problem Estimating intervention effects when causal structures are uncertain.
method Model-Averaged Causal Estimation Transformer Neural Process (MACE-TNP) using meta-learning.
result MACE-TNP outperforms Bayesian baselines in predicting intervention distributions.
A new algorithm PBNN improves scalability of Bayesian Neural Networks.
problem Scalability issues in Neural Network posterior sampling with large datasets.
method Penalty Bayesian Neural Networks (PBNN) using subsampled batch data.
result PBNN achieves good predictive performance with small mini-batch sizes.
New method improves simulation-based inference by avoiding model misspecification.
problem Inefficient parameter estimation for models with intractable likelihoods.
method Proposes a robust SNL method with additional adjustment parameters.
result Demonstrates more accurate point estimates and uncertainty quantification.
This work improves neural network trustworthiness through uncertainty estimation.
problem Overconfident neural networks lead to poor performance under distribution shifts.
method Develops a general uncertainty framework for neural networks, including classification with rejection.
result Improves model trustworthiness and robustness in decision-making tasks.
CREDO combines credal and conformal methods to create interpretable prediction intervals.
problem Overconfident prediction intervals in regions of model extrapolation.
method CREDO uses a credal envelope to widen intervals in weak evidence regions and then applies conformal calibration.
result CREDO prediction intervals are interpretable and maintain target coverage.
The paper addresses poor calibration in fine-tuned LLMs after preference alignment.
problem Poor calibration in fine-tuned Large Language Models (LLMs) after preference alignment.
method Proposes a calibration-aware fine-tuning approach to restore calibration without compromising model performance.
result Demonstrates the effectiveness of the proposed methods through extensive experiments.
New method improves OOD detection by integrating diffusion models into discriminator models.
problem Overconfidence in discriminator models leads to poor OOD detection.
method Integrates diffusion models into discriminator and generation models to mitigate overconfidence.
result Demonstrates significant improvement in AUROC scores for challenging datasets.
New metrics CWSA and CWSA+ improve model evaluation under confidence thresholds.
problem Lack of metrics capturing model reliability under confidence thresholds.
method Introducing CWSA and CWSA+ metrics that reward confident accuracy and penalize overconfident mistakes.
result CWSA and CWSA+ outperform classical metrics in trust-sensitive tests.
Pseudo-label selection affects semi-supervised learning performance.
problem Selection of pseudo-labeled data impacts semi-supervised learning's generalization performance.
method Embedding pseudo-label selection into decision theory, deriving a novel selection criterion based on posterior predictive.
result BPLS (Bayesian pseudo-label selection) outperforms traditional methods in overfitting-prone data.
BLoB fine-tunes LLMs with Bayesian methods to improve uncertainty estimation.
problem Overconfidence in LLMs during inference for domain-specific tasks.
method Continuous Bayesian low-rank adaptation during fine-tuning.
result BLoB improves generalization and uncertainty estimation in LLMs.
Inflationary flows use DBMs for accurate Bayesian inference.
problem Calibrated uncertainty quantification in Bayesian inference.
method Inflationary flows leverage DBMs to map data to a Gaussian latent space.
result Inflationary flows produce accurate, identifiable posterior distributions.
New algorithm selects multiple kernels for better GP regression predictions.
problem Improving Gaussian process regression accuracy with multiple kernels.
method Variational Bayesian kernel selection (VBKS) for sparse Gaussian process regression (SGPR).
result VBKS learns uncertainty in kernel selection for better predictions.
Time series foundation models are well-calibrated, improving over baseline models.
problem Calibration of time series foundation models for practical applications.
method Systematic evaluations of five time series foundation models and two baselines, assessing calibration, prediction heads, and long-term forecasting.
result Time series foundation models are consistently better calibrated than baseline models and do not show over- or under-confidence.