Dual representations for robust risk measures and uncertainty sets.
problem Characterizing continuity of robust risk measures and their uncertainty sets.
method Develop dual representations for robust risk measures and uncertainty sets based on distinct geometric assumptions.
result Two dual frameworks for consolidated uncertainty sets are complementary, not interchangeable.
The paper proposes a framework for information-theoretic predictive uncertainty measures.
problem The need for reliable estimation of predictive uncertainty in machine learning.
method Revisiting core concepts, categorizing predictive uncertainty measures based on model and approximation of true distribution.
result Identification of conditions under which certain predictive uncertainty measures excel.
Framework for quantifying uncertainty in dynamic processes.
problem Quantifying uncertainty in dynamic stochastic processes.
method Define dynamic uncertainty sets and dynamic robust risk measures.
result Dynamic robust risk measures are time-consistent under specific uncertainty sets.
New fairness measures account for prediction uncertainties to detect bias.
problem Fairness of ML models is not well-defined and measures are limited.
method Introduce new fairness measures based on aleatoric and epistemic uncertainties.
result Uncertainty-based measures reveal bias not captured by existing measures.
This study introduces axioms to assess regression uncertainty measures.
problem Limited formal justification and evaluations of uncertainty measures in regression settings.
method Introduces axioms and analyzes entropy- and variance-based measures in a predictive exponential family context.
result Provides a principled foundation for reliable uncertainty assessment in regression.
Paper decomposes risk into aleatoric and epistemic uncertainties and generates predictive uncertainty measures.
problem Unclear relationships between various predictive uncertainty measures in literature.
method Bayesian estimation to decompose risk into aleatoric and epistemic uncertainties, generating different predictive uncertainty measures.
result Experimental validation confirms usefulness of derived predictive uncertainty measures for detecting out-of-distribution and misclassified instances.
The paper argues that uncertainty quantification in ML is application-specific and proposes a flexible family of measures.
problem The need for proper uncertainty quantification in machine learning for safety-critical applications.
method A flexible family of uncertainty measures tailored to specific applications, using proper scoring rules to control characteristics.
result Different uncertainty measures are more suitable for different tasks (e.g., selective prediction, out-of-distribution detection, active learning).
New method quantifies uncertainty at class level for better decision-making.
problem Improving cost-sensitive decision-making in classification tasks.
method Label-wise decomposition of uncertainty measures based on non-categorical metrics.
result Proposed measures adhere to desirable properties and improve uncertainty quantification.
Paper introduces a new uncertainty measure for misclassification detection.
problem Effective detection of unreliable model predictions in machine learning.
method Data-driven measure of uncertainty relative to an observer based on soft-predictions.
result Demonstrates improved misclassification detection over state-of-the-art methods.
The volume of a credal set correlates with epistemic uncertainty in binary classification but not in multi-class.
problem Representing and quantifying epistemic uncertainty in machine learning.
method Examined the geometric representation of credal sets as d-dimensional polytopes and their volume as a measure of uncertainty. result The volume of a credal set is a meaningful measure of epistemic uncertainty in binary classification but not in multi-class.
Improved measure of predictive uncertainty for machine learning models.
problem Current measure of predictive uncertainty assumes BMA predictive distribution is equivalent to true model's distribution.
method Introduced a new measure based on information theory to correct the assumption.
result Our measure behaves more reasonably in synthetic tasks and is advantageous in real-world applications.
Proposes measures for uncertainty quantification using proper scoring rules.
problem Uncertainty quantification for prediction tasks.
method Decomposes proper scoring rules into divergence and entropy components, tailoring uncertainty quantification to specific tasks.
result Flexibility in uncertainty quantification improves performance in selective prediction and active learning.
Paper introduces variance-based measures for second-order uncertainty quantification in classification problems.
problem Uncertainty in machine learning predictions and decision-making.
method Second-order uncertainty quantification using variance-based measures.
result Variance-based measures effectively quantify uncertainty on a class-based level and are competitive with entropy-based measures.
Measuring uncertainty is a promising technique for detecting adversarial examples, crafted inputs on which the model predicts an incorrect class with high confidence. But many measures of uncertainty exist, including predictive en- tropy and mutual information, each capturing different types of uncertainty. We study th…
The standard taxonomy of predictive uncertainty is inconsistent with standard measures.
problem Uncertainty taxonomy and measure inconsistency
method Proof of inconsistency
result Uncertainty is not reducible to data collection
A new framework for measuring uncertainty in machine learning models.
problem Uncertainty measures for second-order distributions in machine learning models have theoretical flaws.
method Formal criteria and a general framework based on the Wasserstein distance.
result The Wasserstein distance-based measure satisfies all proposed criteria for meaningful uncertainty measures.
A new method ranks uncertainty vectors from multiple measures for robust prediction.
problem Single scalar measures of model reliability are insufficient for comprehensive uncertainty quantification.
method Optimal transport ranks vectors of uncertainty measures, supporting flexible fusion of aleatoric and epistemic uncertainties.
result The method provides a robust ranking of uncertainty that supports various downstream tasks.
Study optimizes natural resource harvesting under model uncertainty using risk measures.
problem Optimal harvesting policy selection for natural resources under model uncertainty.
method Investigated using neoclassical growth model dynamics and convex risk measures, specifically Fréchet risk measures.
result Robust harvesting strategies quantifying operational and marginal risk under model uncertainty.
For many applications it is critical to know the uncertainty of a neural network's predictions. While a variety of neural network parameter estimation methods have been proposed for uncertainty estimation, they have not been rigorously compared across uncertainty measures. We assess four of these parameter estimation m…
Bayesian framework predicts aerodynamic uncertainty from sparse measurements.
problem Calibrating aerodynamic models with sparse and uncertain measurements.
method Bayesian latent Gaussian process for surrogate model calibration.
result Calibrated surrogate model accurately predicts aerodynamic uncertainty.
The paper studies robust risk measures with linear penalties under uncertain distributions.
problem Risk measurement under distributional uncertainty.
method Robust distortion risk measures with linear penalty function under distributional constraints.
result Explicit characterization of optimal quantile distribution and value function.
DEUP directly predicts epistemic uncertainty, improving model optimization and exploration.
problem Existing measures of epistemic uncertainty do not account for model misspecification.
method Proposes a framework to estimate excess risk as a measure of epistemic uncertainty, using a secondary predictor for generalization error.
result DEUP improves sequential model optimization and exploration in interactive learning environments.
Statistical uncertainty of different filtration techniques for market network analysis is studied. Two measures of statistical uncertainty are discussed. One is based on conditional risk for multiple decision statistical procedures and another one is based on average fraction of errors. It is shown that for some import…
The paper introduces new measures for quantifying uncertainty in machine learning.
problem Uncertainty representation and quantification in machine learning.
method Proper scoring rules for aleatoric and epistemic uncertainty quantification.
result Established a natural bridge between credal set and second-order distribution representations of uncertainty.
The paper proves uncertainty principles on Finsler measure spaces.
problem Uncertainty principles on Finsler measure spaces.
method Analyzes Lp-uncertainty principles on Finsler measure spaces with bounded curvatures. result Sharp Lp-uncertainty principles are proven and characterized. Paper proposes a new method to quantify uncertainty in machine learning models.
problem Quantifying uncertainty in multiclass classification models.
method Distance-based approach using Integral Probability Metrics (IPMs).
result Effective uncertainty measures for multiclass classification.
The investor is interested in the expected return and he is also concerned about the risk and the uncertainty assumed by the investment. One of the most popular concepts used to measure the risk and the uncertainty is the variance and/or the standard-deviation. In this paper we explore the following issues: Is the stan…
A new method to break down insurance costs into risk and uncertainty.
problem Understanding and quantifying insurance costs in uncertain environments.
method An axiomatic approach to decompose premium principles into risk and deviation measures.
result Maximal risk and minimal deviation measures can be uniquely identified in decompositions.
New framework assesses LM uncertainty without thresholding.
problem Uncertainty quantification for LMs, especially comparing different measures.
method Rank-Calibration framework to assess uncertainty and confidence measures.
result Higher uncertainty correlates with lower generation quality.
Surveying risk measures for handling uncertainty in various fields.
problem Handling uncertainty in engineering and data-driven problems.
method Review of risk measures and their applications.
result Rapid development and widespread use of risk measures.
Unified control theory and machine learning for safety in uncertain systems.
problem Safety guarantees for systems with measurement model uncertainty.
method Measurement-Robust Control Barrier Functions (MR-CBFs) for control synthesis.
result MR-CBFs ensure safety in perception systems with measurement model uncertainty.
Paper revisits Black-Scholes model, proving solution existence and measuring market uncertainty.
problem Proving existence of solution in inverse Black-Scholes model.
method Rigorous proof and empirical study using finite element method.
result New measure of market uncertainty developed.
Paper quantifies distortion risk measures' robustness to distributional uncertainty.
problem Quantifying risk measures' robustness to distributional uncertainty.
method Employing isotonic projections, the paper derives bounds on distortion risk measures' values.
result Sharp bounds on distortion risk measures' values are provided, especially for Value-at-Risk and Range-Value-at-Risk.
Investigates the effects of nondominated sets of probability measures in robust models of finance.
problem Uncertainty in financial models due to multiple possible probability measures.
method Analyzes various results from mathematical finance literature under the assumption of nondominated sets of probability measures.
result Many classical results in robust models do not hold when the set of measures is nondominated.
Enhances financial optimization under model uncertainty using subsampling.
problem Model uncertainty in financial decision-making from limited data.
method Superimposes uncertainty measure on model space, uses subsampling for model distribution approximation, adapts SGD for efficiency.
result Uncertainty measures outperform traditional methods and achieve comparable performance to Bayesian methods.
The paper proposes a new framework for accurate uncertainty representation and propagation.
problem Inaccurate representation and propagation of uncertainty in measurement systems.
method The paper introduces a comprehensive framework using Gaussian Mixture Models (GMMs) for representing and propagating quantitative attributes in measurement systems.
result GMMs offer improved accuracy in representing and propagating measurement uncertainty compared to traditional Gaussian methods, while maintaining computational tractability.
A new method for measuring prediction uncertainty in classifiers.
problem Measuring uncertainty of predictions from machine learning methods.
method Density Based Calibration (DBCal) technique.
result Expected calibration error of less than 0.2% on binary classifiers and less than 3% on semantic segmentation networks.
As relational datasets modeled as graphs keep increasing in size and their data-acquisition is permeated by uncertainty, graph-based analysis techniques can become computationally and conceptually challenging. In particular, node centrality measures rely on the assumption that the graph is perfectly known -- a premise …
A new method decomposes subjective risk into epistemic and aleatoric uncertainties.
problem Uncertainty quantification in modeling decisions.
method Subjective risk decomposition using strictly proper loss.
result Recovery of classic uncertainty measures and new learning-theoretic connections.
Bayesian approach to robust risk measures under model uncertainty.
problem Representing robust risk measures as a single probability measure.
method Introducing two types of risk measures and analyzing their relation to robust risk measures.
result Robust risk measures can be represented by a mixture probability measure, a Bayesian approach.
Unified framework for robust risk measures beyond convexity.
problem Developing risk measures for uncertainty beyond classical convexity.
method Constructing robust quasi-convex measures through uncertainty sets.
result Unified framework for robust quasi-convex risk measures.
Proposes a new method for uncertainty estimation in neural networks.
problem Uncertainty quantification in neural networks for high-risk applications.
method Intuitive framework based on signal-to-noise ratio and variance-gated measure.
result Demonstrates a collapse in diversity of committee machines.
Risk assessment under different possible scenarios is a source of uncertainty that may lead to concerning financial losses. We address this issue, first, by adapting a robust framework to the class of spectral risk measures. Second, we propose a Deviation-based approach to quantify uncertainty. Furthermore, the theory …
Paper proposes a new method to evaluate joint risk under uncertainty.
problem Evaluating joint risk of multiple insurance risks under dependence uncertainty.
method Axiomatic approach to scalar and vector-valued distortion joint risk measures.
result Established a new scalar distortion joint risk measure with positive homogeneity.
Worst-Case Sensitivity measures model sensitivity to uncertainty set size.
problem Model sensitivity to uncertainty set size in Distributionally Robust Optimization.
method Introducing Worst-Case Sensitivity as a measure of model sensitivity, and deriving closed-form expressions for various uncertainty sets.
result DRO solutions can be sensitive to the family and size of the uncertainty set, and worst-case sensitivity reflects these properties.
Bayesian framework improves ML classification models' uncertainty estimates.
problem Ensuring trustworthy AI predictions with explicit uncertainty quantification.
method Proposes a Bayesian framework for generative ML classification models that accounts for input measurement uncertainty.
result The BQDA model outperforms other models in terms of interpretability, explicit uncertainty modeling, and computational efficiency.
Detects out-of-distribution sentences in Neural Machine Translation.
problem Identifying sentences from a different language than the training data.
method Developed a new uncertainty measure for long sequences of words in Transformers.
result Shows ability to identify Dutch sentences as German input.
Introduces hierarchical uncertainty using U-sequences.
problem Tackles Ellsberg's paradox in multi-layer uncertainty.
method Uses category theory to construct U-sequences and endofunctors.
result Constructs a universal uncertainty space for multi-layer uncertainty.