Review of uncertainty representation methods in risk management.
problem Inadequate consideration of uncertainty in risk management.
method Systematic literature review of 370 publications.
result Probabilistic methods are predominant, but fuzzy and evidence-based approaches are also useful.
A method for profiling systematic uncertainties in SBI using Factorizable Normalizing Flows.
problem Computational cost and limited applicability of current SBI methods for realistic analyses.
method Simulation-Based Inference with Factorizable Normalizing Flows to model systematic variations.
result Efficient profiling of nuisance parameters and multivariate DoI in complex analyses.
It is a well known fact that recovery rates tend to go down when the number of defaults goes up in economic downturns. We demonstrate how the loss given default model with the default and recovery dependent via the latent systematic risk factor can be estimated using Bayesian inference methodology and Markov chain Mont…
Unified neural network model for astro-particle physics predictions with coverage, systematics, and goodness-of-fit.
problem Lack of statistical uncertainties, coverage, systematic uncertainties, and goodness-of-fit in neural network predictions.
method KL-divergence objective for joint distribution of data and labels, conditional normalizing flows, amortized with neural networks.
result Unified supervised learning and VAEs under stochastic variational inference for event property predictions.
Systematic review of conformal inference for treatment effect estimation.
problem Uncertainty quantification in treatment effect estimation.
method Conformal prediction methods for treatment effect estimation.
result Current state-of-the-art conformal prediction methods identified and described.
The paper proposes a new risk model for foundation models in finance.
problem Understanding how foundation models affect trading strategies' risk and return.
method An extension of the CAPM, separating systematic and idiosyncratic risks.
result Monte Carlo dropout measures the epistemic risk of foundation models.
Enhances uncertainty modeling in random PDEs using PINNs and generative models.
problem Uncertainty in complex systems modeled by random PDEs.
method Combines Physics-Informed Neural Networks (PINNs) with generative modeling techniques.
result Systematic control of uncertainty with maintained predictive accuracy.
HI-SIGMA improves sensitivity in high-dimensional statistical inference with data-driven background models.
problem Performing high-dimensional statistical inference with complex backgrounds in high-energy physics.
method HI-SIGMA uses generative ML models to learn signal and background distributions, incorporating systematic uncertainties.
result HI-SIGMA provides improved sensitivity compared to classifier-based methods.
This work optimizes statistical inference with neural networks for high-energy physics data.
problem Optimal dimensionality reduction with minimal loss of information in the presence of systematic uncertainties.
method Neural network optimization based on binned Poisson likelihoods with nuisance parameters.
result Estimates of parameters of interest close to optimal.
Paper quantifies uncertainty in probabilistic models using Gaussian Processes.
problem Assessing reliability of probabilistic machine learning predictions.
method Systematic framework for estimating epistemic and aleatoric uncertainty, using Gaussian Processes and Monte Carlo sampling.
result Effective approach for quantifying prediction confidence in probabilistic models.
There is empirical evidence that recovery rates tend to go down just when the number of defaults goes up in economic downturns. This has to be taken into account in estimation of the capital against credit risk required by Basel II to cover losses during the adverse economic downturns; the so-called "downturn LGD" requ…
New method assesses prediction intervals across different operating points.
problem Difficulty in comparing prediction intervals across studies.
method Operating characteristics curves and gain over a simple reference.
result A novel operating point agnostic assessment methodology for prediction intervals.
New method explains predictive uncertainty by focusing on second-order effects.
problem Explaining predictive uncertainty in machine learning models.
method CovLRP, CovGI, etc., based on second-order effects.
result Predictive uncertainty is dominated by second-order effects.
Unified framework for causal inference with reliable uncertainty quantification.
problem Causal inference under unobserved confounding with unreliable uncertainty quantification.
method Deconditional Gaussian Process (DGP) framework for uncertainty-aware causal learning.
result Strong predictive performance and informative uncertainty quantification.
Review of integrating Bayesian methods with neural network-based MPC.
problem Lack of standardized benchmarks and reliable analyses in Bayesian MPC.
method Systematic analysis of Bayesian methods in neural-network-based MPC.
result Need for standardized benchmarks, ablation studies, and transparent reporting.
Proposes integrating global and local entropy for more reliable LLMs.
problem Uncertainty in large language models (LLMs) leads to unreliable predictions.
method Measures global uncertainty from hidden-state matrices and local uncertainty from tokens, combining them via a multiplicative gate.
result Global-Local Uncertainty (GLU) outperforms unsupervised baselines across multiple models and benchmarks.
In healthcare applications, predictive uncertainty has been used to assess predictive accuracy. In this paper, we demonstrate that predictive uncertainty estimated by the current methods does not highly correlate with prediction error by decomposing the latter into random and systematic errors, and showing that the for…
PAGER detects failures in deep regression models using a new framework.
problem Detecting failures in deep regression models.
method PAGER uses a combination of epistemic uncertainty and manifold non-conformity scores.
result PAGER accurately characterizes and detects failures in deep regressors.
UAG defends GNNs against adversarial attacks by quantifying and explaining uncertainties.
problem Lack of uncertainty quantification in GNNs makes them vulnerable to adversarial attacks.
method UAG uses Bayesian Uncertainty Technique (BUT) and Uncertainty-aware Attention Technique (UAT).
result UAG outperforms state-of-the-art solutions in defending adversarial attacks on GNNs.
Survey and framework for consistent uncertainty quantification in deep learning.
problem Partial uncertainty coverage and inconsistencies in deep learning uncertainty quantification.
method Bayes' theorem and conditional probability densities applied to all major sources of uncertainty.
result Improved robustness and reliability of neural network predictions in real-world scenarios.
This work examines uncertainty sampling in binary classification using equivalent loss.
problem Lack of consensus on proper uncertainty definition and theoretical guarantees for active learning.
method Systematically examines uncertainty sampling via equivalent loss, proving its optimality.
result Established that uncertainty sampling optimizes against equivalent loss, providing theoretical guarantees.
Study finds uncertainty estimators weakly correlate with LLM hallucinations.
problem Characterizing the relationship between uncertainty estimators and LLM hallucinations.
method Systematic empirical study of diverse uncertainty estimators across hallucination types and benchmarks.
result Uncertainty estimators weakly correlate with LLM hallucinations, depending on hallucination type and LLM.
Study uses TV news to measure climate risks affecting clean energy firms.
problem Understanding how climate risks impact clean energy firms' financial stability.
method Developed climate risk measures from TV news coverage and analyzed their effects on clean energy firms' risks.
result Increased TV news coverage of climate risks correlates with higher systematic risk and lower idiosyncratic risk for clean energy firms.
This paper introduces a new framework for quantifying predictive uncertainty for both data and models that relies on projecting the data into a Gaussian reproducing kernel Hilbert space (RKHS) and transforming the data probability density function (PDF) in a way that quantifies the flow of its gradient as a topological…
New method improves uncertainty calibration in deep learning.
problem Systematic overconfidence in EDL on out-of-distribution inputs.
method Density-Informed Pseudo-count EDL (DIP-EDL) separates class prediction from uncertainty.
result DIP-EDL achieves asymptotic concentration and enhances robustness and uncertainty calibration.
We describe a strategy for constructing a neural network jet substructure tagger which powerfully discriminates boosted decay signals while remaining largely uncorrelated with the jet mass. This reduces the impact of systematic uncertainties in background modeling while enhancing signal purity, resulting in improved di…
New method attributes feature uncertainty in ML models using cooperative game theory.
problem Lack of feature-level uncertainty attribution in explainable AI.
method Proposes a novel, model-agnostic uncertainty attribution method using cooperative game theory and conformal prediction.
result Demonstrates improved runtime efficiency and practical utility in real-world applications.
Evaluation of Bayesian deep learning (BDL) methods is challenging. We often seek to evaluate the methods' robustness and scalability, assessing whether new tools give `better' uncertainty estimates than old ones. These evaluations are paramount for practitioners when choosing BDL tools on-top of which they build their …
Paper develops a new method to improve model calibration under distribution shifts.
problem Challenges in uncertainty quantification with different training and test distributions.
method Develops multi-domain temperature scaling to handle distribution shifts.
result Outperforms existing methods on in-distribution and out-of-distribution test sets.
The paper develops methods to assess and correct model uncertainties in graphical models.
problem Model uncertainty in probabilistic graphical models.
method Information-theoretic and non-parametric stress tests.
result Ranking and correcting impactful sources of uncertainty in graphical models.
This paper surveys UQ methods for deep learning.
problem Overconfident predictions in deep learning models.
method Categorizes UQ methods by uncertainty sources.
result Identifies strengths and limitations of each category.
New framework identifies and reduces errors in machine learning under distribution shift.
problem Errors in machine learning models when distributions change.
method Developed a principled framework to characterize and eliminate epistemic errors in imperfect multitask learning.
result Provided a decompositional epistemic error bound for general settings of distribution shift.
TFB simplifies Bayesian LLM uncertainty estimation without extra training.
problem Estimating uncertainty in LLM responses remains challenging.
method Training-Free Bayesianization (TFB) that transforms low-rank adapters into Bayesian ones without additional training.
result TFB achieves superior uncertainty estimation and generalization compared to existing methods.
Paper introduces conformal prediction for reliable uncertainty quantification in landmark localization.
problem Systematic underestimation of total predictive uncertainty in landmark localization.
method Conformal prediction framework for multi-output regression, generating flexible prediction regions.
result Methods outperform existing approaches in validity and efficiency across 2D and 3D datasets.
Single-cell gene expression data provide invaluable resources for systematic characterization of cellular hierarchy in multi-cellular organisms. However, cell lineage reconstruction is still often associated with significant uncertainty due to technological constraints. Such uncertainties have not been taken into accou…
When simulating a complex stochastic system, the behavior of output response depends on input parameters estimated from finite real-world data, and the finiteness of data brings input uncertainty into the system. The quantification of the impact of input uncertainty on output response has been extensively studied. Most…
New framework models graph signals as distribution-valued signals in Wasserstein space.
problem Limitations of classical vector-based GSP, including synchronous observations and uncertainty.
method Introduces graph distribution-valued signals (GDSs) in the Wasserstein space.
result GDSs naturally encode uncertainty and stochasticity, generalizing traditional graph signals.
Response calibration is the process of inferring how much the measured data depend on the signal one is interested in. It is essential for any quantitative signal estimation on the basis of the data. Here, we investigate self-calibration methods for linear signal measurements and linear dependence of the response on th…
We here present a model of the dynamics of extremism based on opinion dynamics in order to understand the circumstances which favour its emergence and development in large fractions of the general public. Our model is based on the bounded confidence hypothesis and on the evolution of initially anti-conformist agents to…
Paper studies portfolio investment under volatility uncertainty and short-sale constraints, improving risk-adjusted returns.
problem Investment portfolio optimization under volatility uncertainty and short-sale constraints.
method Sublinear expectation model to handle volatility uncertainty, constructing SLE-MUV model.
result Pareto frontier of SLE-MUV model is a continuous convex curve with polynomial analytical expression.
Fusion of robustness and uncertainty techniques improves adversarial defense.
problem Adversarial attacks on deep neural networks.
method Integrating uncertainty quantification into randomized smoothing for robustness guarantees.
result Improved robustness guarantees for uncertainty aware classifiers.
Bayesian hybrid models fuse physics-based insights with machine learning constructs to correct for systematic bias. In this paper, we compare Bayesian hybrid models against physics-based glass-box and Gaussian process black-box surrogate models. We consider ballistic firing as an illustrative case study for a Bayesian …
DSVNP uses global and local latent variables for improved neural process predictions.
problem Limited expressiveness of vanilla neural processes in capturing target-specific local variation.
method Introduces DSVNP combining global and local latent variables for prediction.
result Competitive prediction performance in multi-output regression and uncertainty estimation.
Study on estimating conditional risk in machine learning.
problem Estimating expected loss of prediction models given input features.
method Analyzed in classification and regression settings, showing equivalence to standard regression. Developed theoretical insights and empirical validation.
result Conditional risk calibration is distinct from existing uncertainty quantification problems.
The paper debiases mini-batch approximations in deep learning for more accurate optimization and uncertainty quantification.
problem Bias in mini-batch approximations distorts the shape of quadratic approximations used in deep learning.
method Developed and evaluated debiasing strategies for mini-batch approximations.
result Debiasing strategies improve the accuracy of second-order optimization and uncertainty quantification in deep learning.
Study quantifies distribution shifts and uncertainties to improve machine learning model robustness.
problem Distribution shifts between training and test datasets impact model generalization and robustness.
method Synthetic data generation and quantitative measures (KL divergence, JS distance, Mahalanobis distance) to assess data similarity and model uncertainty.
result Utilizing statistical measures like Mahalanobis distance helps assess distribution shift and model uncertainty.
Comparison of UQ methods in deep learning for a simple physical system.
problem Uncertainty quantification in deep learning for physical systems.
method Bayesian Neural Networks (BNN), Concrete Dropout (CD), Deep Ensembles (DE), and Analytic Error Propagation.
result Pitfalls in using UQ methods, especially Bayesian Neural Networks and Concrete Dropout.
SBMC method improves uncertainty estimation in deep learning models.
problem Improving uncertainty quantification in deep learning models.
method A scalable Bayesian Monte Carlo method using a model and parallel SMC/MCMC algorithm.
result SBMC achieves comparable or better accuracy and improved uncertainty quantification compared to state-of-the-art methods.