Develops a risk-sensitive reinforcement learning framework for uncertain environments.
problem Learning in uncertain environments with varying risk preferences.
method Integrates utility functions and risk measures into reinforcement learning, tuning risk preference with parameter β.
result Risk-averse, risk-neutral, and risk-taking behaviors can be achieved and compared.
This paper introduces modal epistemic tools for risk management.
problem Identifying and certifying risk claims when institutions lack the necessary epistemic stance.
method Develops crisp and fuzzy modal semantics for assurance and working commitment, distinguishing between object-level risk claims and meta-level epistemic diagnostics.
result Risk governance should model evidential incompleteness and failures of escalation, not just hazards and losses.
DEUP directly predicts epistemic uncertainty, improving model optimization and exploration.
problem Existing measures of epistemic uncertainty do not account for model misspecification.
method Proposes a framework to estimate excess risk as a measure of epistemic uncertainty, using a secondary predictor for generalization error.
result DEUP improves sequential model optimization and exploration in interactive learning environments.
A new method decomposes subjective risk into epistemic and aleatoric uncertainties.
problem Uncertainty quantification in modeling decisions.
method Subjective risk decomposition using strictly proper loss.
result Recovery of classic uncertainty measures and new learning-theoretic connections.
A framework for estimating both epistemic and aleatoric uncertainties in reinforcement learning.
problem Estimating risk and uncertainty in deep reinforcement learning.
method Proposed a framework for disentangling and estimating epistemic and aleatoric uncertainties on learned Q-values, derived unbiased estimators, and introduced an uncertainty-aware DQN algorithm.
result The uncertainty-aware DQN algorithm exhibits safe learning behavior and outperforms other DQN variants on the MinAtar testbed.
The paper assesses fairness in risk score models, focusing on epistemic value.
problem Fairness of risk score models in communicating uncertainty.
method Identified key fairness desiderata, developed metrics for quantitative assessment, and applied methodology in two case studies.
result Introduced a novel calibration error metric for meaningful comparisons between groups of different sizes.
CLEAR calibrates both aleatoric and epistemic uncertainties for better predictive intervals.
problem Balanced uncertainty quantification for reliable predictive modeling.
method CLEAR uses two parameters, γ1 and γ2, to combine aleatoric and epistemic uncertainties.
result Clear achieves significant improvements in interval width and coverage.
New framework improves model reliability under distribution shifts.
problem Lack of formal guarantees connecting shift magnitude to prediction reliability in TTA methods.
method Develops a PAC-Bayesian framework interpreting MMD-balls as credal sets.
result Establishes generalization bounds and provides epistemic uncertainty quantification.
Risk Advisor predicts and mitigates ML deployment failures.
problem Predicting and mitigating test-time failure risks of ML systems.
method Post-hoc meta-learner for estimating failure risks and uncertainties.
result Reliably predicts deployment-time failure risks across various ML models.
Paper decomposes risk into aleatoric and epistemic uncertainties and generates predictive uncertainty measures.
problem Unclear relationships between various predictive uncertainty measures in literature.
method Bayesian estimation to decompose risk into aleatoric and epistemic uncertainties, generating different predictive uncertainty measures.
result Experimental validation confirms usefulness of derived predictive uncertainty measures for detecting out-of-distribution and misclassified instances.
A new method predicts stock ranking uncertainty to improve trading performance during regime shifts.
problem Ranking models fail during regime shifts, leading to suboptimal performance.
method Adapting DEUP to rankers, predicting rank displacement and uncertainty, and proposing a two-level deployment policy.
result The two-level deployment policy improves risk-adjusted performance and indicates DEUP adds value mainly as a tail-risk guard.
The study quantifies and compares aleatoric and epistemic discrimination in ML models.
problem Sources of discrimination in ML models and their impact on performance.
method Quantifying aleatoric and epistemic discrimination using statistical experiments and model accuracy.
result State-of-the-art fairness interventions are effective at removing epistemic discrimination but not aleatoric discrimination in datasets with missing values.
New findings show second-order scoring rules can't accurately represent epistemic uncertainty.
problem Lack of epistemic uncertainty representation in second-order learners.
method Generalised second-order scoring rules introduced to prove theoretical limitations.
result No loss function incentivizes second-order learners to accurately represent epistemic uncertainty.
Study analyzes EU in variational inference for Bayesian deep learning.
problem Analyzing epistemic uncertainty in variational inference for Bayesian deep learning.
method Theoretical analysis and derivation of relations between generalization error and EU measurements. Proposing a new objective function for VI.
result Proposed new objective function significantly improves EU evaluation over existing VI methods.
Paper discusses optimal CP for second-order predictions.
problem How to incorporate second-order predictions into conformal prediction.
method Introduces Bernoulli prediction sets (BPS) for second-order predictions and applies conformal risk control for compromised validity.
result BPS provides the smallest prediction sets with conditional coverage.
The paper proposes a new risk model for foundation models in finance.
problem Understanding how foundation models affect trading strategies' risk and return.
method An extension of the CAPM, separating systematic and idiosyncratic risks.
result Monte Carlo dropout measures the epistemic risk of foundation models.
This work tackles uncertainty quantification in language models, proposing a principled approach.
problem Challenges in identifying task-specific uncertainties in large language models.
method Bayesian decision theory, focusing on a similarity measure between generated and hypothetical true responses.
result Derives a measure for epistemic uncertainty based on a missing data perspective.
Second-order methods fail to fully quantify epistemic uncertainty, leading to biased predictions.
problem Incomplete quantification of epistemic uncertainty in machine learning models.
method Analysis of existing second-order uncertainty estimation methods.
result Current methods overestimate aleatoric uncertainty and underestimate epistemic uncertainty, leading to biased predictions.
PAGER detects failures in deep regression models using a new framework.
problem Detecting failures in deep regression models.
method PAGER uses a combination of epistemic uncertainty and manifold non-conformity scores.
result PAGER accurately characterizes and detects failures in deep regressors.
Bayesian Neural Networks show unexpected collapse of epistemic uncertainty with large models and little data.
problem Unexpected collapse of epistemic uncertainty in Bayesian Neural Networks.
method Experiments with varying model size and training data size.
result Epistemic uncertainty collapses in the presence of large models and sometimes little data.
Proposes a new principle for active learning based on epistemic uncertainty.
problem Active learning and uncertainty quantification in machine learning.
method Distinction between epistemic and aleatoric uncertainty; proposes epistemic uncertainty sampling.
result Epistemic uncertainty sampling shows promising performance in experimental studies.
Overparametrized neural networks retain significant epistemic uncertainty even with sufficient data.
problem Epistemic uncertainty in overparametrized neural networks persists despite model identifiability.
method Analysis of non-identifiability and characterization of residual uncertainty in one-hidden-layer ReLU networks.
result Substantial parameter uncertainty remains even when the underlying function is fully identified.
The standard taxonomy of predictive uncertainty is inconsistent with standard measures.
problem Uncertainty taxonomy and measure inconsistency
method Proof of inconsistency
result Uncertainty is not reducible to data collection
Proposes EVE for efficient exploration in reinforcement learning.
problem Efficient exploration in reinforcement learning.
method EVE: a recipe for posterior over parameters, facilitating efficient exploration.
result Competitive performance on benchmarks, efficient exploration confirmed.
New method estimates model uncertainty in regression.
problem Challenges in distinguishing aleatoric and epistemic uncertainty.
method Conditional predictions with model's initial output.
result Rigorous frequentist approach to epistemic uncertainty.
New method isolates epistemic uncertainty in diffusion models, improving plausibility scores.
problem Uncertainty quantification in diffusion models, especially epistemic uncertainty.
method Fisher information based approach using FLARE (Fisher-Laplace Randomized Estimator).
result FLARE improves uncertainty estimation in synthetic time-series generation tasks.
Introduces epistemic deep learning for better uncertainty estimation in neural networks.
problem Uncertainty quantification in deep neural networks.
method Random-set convolutional neural networks with belief function-based loss functions.
result Epistemic approach produces better performance in uncertainty estimation.
Deep ensembles effectively capture epistemic uncertainty through training stochasticity, providing a frequentist perspective.
problem Understanding and quantifying epistemic uncertainty in machine learning models.
method Bootstrap-based estimator and decomposition of deep ensembles into data variability and training stochasticity.
result Deep ensembles primarily capture training stochasticity, explaining their effectiveness in quantifying epistemic uncertainty.
New framework identifies and reduces errors in machine learning under distribution shift.
problem Errors in machine learning models when distributions change.
method Developed a principled framework to characterize and eliminate epistemic errors in imperfect multitask learning.
result Provided a decompositional epistemic error bound for general settings of distribution shift.
Large models collapse epistemic uncertainty, challenging traditional wisdom.
problem Epistemic uncertainty collapse in large models.
method Implicit ensembling and decomposition techniques.
result Larger models can collapse epistemic uncertainty, contrary to expectations.
Bayesian neural networks with latent variables are scalable and flexible probabilistic models: They account for uncertainty in the estimation of the network weights and, by making use of latent variables, can capture complex noise patterns in the data. We show how to extract and decompose uncertainty into epistemic and…
Decomposes epistemic uncertainty into per-class contributions for safer classification.
problem Asymmetric costs in safety-critical classification.
method Decomposes mutual information into per-class vector Ck using second-order Taylor expansion. result Decomposition improves selective risk by 34.7% and 56.2% over existing metrics.
New framework compares credal sets for hypothesis testing with epistemic uncertainty.
problem Comparing distributions with partial ignorance and epistemic uncertainty.
method Credal two-sample testing framework for convex sets of probability measures.
result Direct integration of epistemic uncertainty in hypothesis testing.
The paper introduces new measures for quantifying uncertainty in machine learning.
problem Uncertainty representation and quantification in machine learning.
method Proper scoring rules for aleatoric and epistemic uncertainty quantification.
result Established a natural bridge between credal set and second-order distribution representations of uncertainty.
CLAPS improves conformal regression by adaptively scaling interval widths based on last-layer Laplace uncertainty.
problem Lack of adaptive interval width scaling in conformal regression for heterogeneous inputs.
method CLAPS uses heteroscedastic last-layer Laplace uncertainty to adaptively scale interval widths, combining aleatoric and epistemic uncertainties.
result CLAPS provides competitive interval efficiency with nominal-level coverage, reducing to aleatoric scaling as epistemic uncertainty decreases.
QUAM improves uncertainty quantification in deep learning models.
problem Estimating epistemic uncertainty in deep learning models.
method QUAM identifies regions with high divergence between predictions and a reference model.
result QUAM has lower approximation error of epistemic uncertainty compared to previous methods.
New findings show AI models can't be validated in complex social systems.
problem AI models in complex social systems can't be validated due to data collection practices.
method Formal impossibility results using the MovieLens benchmark.
result AI models in complex social systems are invalid under current data collection practices.
EPICSCORE improves conformal scores by explicitly accounting for epistemic uncertainty.
problem Overconfident predictions in data-sparse regions due to lack of epistemic uncertainty.
method Model-agnostic approach using Bayesian techniques like Gaussian Processes, Dropout, and Regression Trees.
result Enhanced predictive intervals that adaptively expand in sparse data regions and maintain compact intervals in abundant data.
In reinforcement learning the Q-values summarize the expected future rewards that the agent will attain. However, they cannot capture the epistemic uncertainty about those rewards. In this work we derive a new Bellman operator with associated fixed point we call the `knowledge values'. These K-values compress both the …
Loss minimisation fails to capture epistemic uncertainty in second-order predictors.
problem Capturing epistemic uncertainty in machine learning models.
method Analysis of a second-order learner approach using loss minimisation.
result Loss minimisation does not faithfully represent epistemic uncertainty in second-order predictors.
The volume of a credal set correlates with epistemic uncertainty in binary classification but not in multi-class.
problem Representing and quantifying epistemic uncertainty in machine learning.
method Examined the geometric representation of credal sets as d-dimensional polytopes and their volume as a measure of uncertainty. result The volume of a credal set is a meaningful measure of epistemic uncertainty in binary classification but not in multi-class.
GPNs use unlabeled data to estimate uncertainty in Bayesian problems.
problem Limited training data in high-dimensional problems.
method Generative Posterior Networks (GPNs) that approximate the posterior distribution using unlabeled data.
result GPNs improve epistemic uncertainty estimation and scalability.
The paper quantifies aleatoric and epistemic uncertainties with random forests.
problem Addressing uncertainty in machine learning predictions.
method Using decision trees and random forests to measure aleatoric and epistemic uncertainties.
result Random forests effectively quantify uncertainties compared to deep neural networks.
Unified framework for hierarchical image classification with epistemic uncertainty.
problem Overconfident predictions and lack of logical consistency in deep learning models.
method Neurosymbolic approach with epistemic deep learning, using focal set reasoning and differentiable fuzzy logic.
result Maintains accuracy on par with transformer baselines while providing more calibrated and interpretable predictions.
New method estimates uncertainty without sampling for neural networks.
problem Estimating epistemic uncertainty in neural networks for safety-critical applications.
method Approximated Variance Propagation without sampling.
result Significantly reduces computational overhead compared to sampling-based methods.
Cooperative model disentangles data uncertainties.
problem Disentangling aleatoric and epistemic uncertainties in real-world data.
method Cooperatively trains a variance estimation network with a Bayesian neural network.
result Improves mean estimation and disentangles uncertainties.
Bayesian inference improves neural network predictions by separating aleatoric and epistemic uncertainties.
problem Improving prediction accuracy of neural networks by quantifying and separating uncertainties.
method Approximated posterior distributions using deep ensembles for various neural network architectures.
result Prediction accuracy depends on both aleatoric and epistemic uncertainties, not just marginalized uncertainty.
Proposes a new method to measure epistemic uncertainty in Bayesian neural networks.
problem Measuring epistemic uncertainty in Bayesian neural networks for out-of-distribution detection.
method Proposes measuring disagreement between logits and their pre-softmax counterparts as an epistemic uncertainty measure.
result Proposed epistemic uncertainty scores outperform mutual information and equal predictive entropy performance.