Study improves AI's handling of uncertainty.
problem Uncertainty in AI models, especially with limited data.
method Integrates theories, latest developments, and practical applications.
result Novel definition of total uncertainty in AI.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “AI uncertainty”
AI helps HEP measure uncertainties, but needs better interpretation.
problem Uncertainty interpretation in AI for HEP measurements.
method Discussing existing AI methods for inference, simulation, and control/decision-making.
result Need for trustworthy AI UQ methods for widespread usage.
This work advances collaborative decision making by combining human and AI strengths in uncertainty quantification.
problem Current AI lacks robust decision-making capabilities under uncertainty, especially in high-stakes contexts.
method Introduces Human AI Collaborative Uncertainty Quantification (HACUQ) framework, formalizing AI-human collaboration and developing calibration algorithms.
result Optimal collaborative prediction sets follow a two-threshold structure, and online adaptation algorithms can adapt to evolving human behavior.
Adaptive AI delegation framework for dynamic decision authority allocation.
problem Dynamic allocation of decision authority to AI-generated recommendations under evolving evidence quality and uncertainty.
method Formulated as a Governance-Aware POMDP, using Bayesian inference for informational state estimation and sequential optimization for authority allocation.
result Sequential Bayesian governance provides the strongest general-purpose policy across AI-quality regimes, adapting to evolving evidence.
Develops methods for AI self-assessment to improve trustworthiness.
problem Uncertainty in AI predictions and lack of trust in AI systems.
method Uncertainty estimation techniques considering practical impacts and costs.
result Guidelines for selecting and designing effective AI self-assessment methods.
Unified Uncertainty Calibration improves AI predictions by combining different types of uncertainty.
problem AI classifiers struggle with uncertainty, leading to miscalibrated predictions and poor performance.
method Unified Uncertainty Calibration (U2C) combines aleatoric and epistemic uncertainties to improve prediction quality.
result U2C outperforms traditional reject-or-classify methods across various ImageNet benchmarks.
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal predictionphysics.ao-ph
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction
problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics
AI can learn true probabilities if data and assumptions align.
problem Understanding when AI models can accurately represent true objective probabilities.
method Proved conditions under which AI can learn true probabilities.
result Conditions for learning true probabilities are identified.
New method accounts for uncertainty in medical AI evaluations.
problem Uncertainty in ground truth affects AI model performance estimates.
method Statistical aggregation approach to infer probabilities of medical conditions.
result Performance estimates are significantly lower when uncertainty is accounted for.
Quantifying and managing uncertainties that occur when data-driven models such as those provided by AI and machine learning methods are applied is crucial. This whitepaper provides a brief motivation and first overview of the state of the art in identifying and quantifying sources of uncertainty for data-driven compone…
Unified Bayesian-AI framework improves epidemiological risk prediction and uncertainty quantification.
problem Lack of calibrated uncertainty in machine learning models for epidemiology.
method Combines Bayesian prediction with Bayesian hyperparameter optimization using logistic regression and Gaussian-process Bayesian optimization.
result Unified Bayesian-AI framework provides reliable coverage and improved calibration, enhancing epidemiological decision making.
Deep learning complements OR/MS for decision-making under uncertainty.
problem Sequential decision-making in uncertain environments.
method Integration of deep learning and OR/MS frameworks.
result Deep learning enhances adaptability and scalability in decision systems.
AI-driven Bayesian inference improves decision-making uncertainty.
problem Lack of certainty in AI predictions.
method Non-parametric Bayesian framework with Dirichlet process prior and AI-driven baseline.
result AI predictions can be integrated into Bayesian analysis for predictive inference and uncertainty quantification.
Paper analyzes uncertainty metrics in ensemble learning for healthcare AI.
problem Selecting appropriate uncertainty metrics for ensemble learners in healthcare AI.
method Rigorous analysis of two uncertainty metrics: ensemble mean and variance.
result Ensemble mean is preferable to ensemble variance for decision making in healthcare AI.
Teaches uncertainty in ML through practical examples.
problem Lack of uncertainty teaching in ML curricula.
method Developed a curriculum and use cases.
result Motivates adoption of uncertainty concepts in AI courses.
Hybrid AI and rule-based framework de-identifies medical imaging data.
problem De-identifying medical imaging data to protect PHI and PII.
method Combines rule-based and AI techniques with uncertainty quantification.
result Robust performance across benchmark datasets and regulatory standards.
Conf-Gen applies uncertainty quantification to generative models.
problem Uncertainty quantification for unsupervised generative models.
method Adapts CRC to generative tasks, relaxing theoretical assumptions.
result Demonstrates flexibility and correctness of AI agent outputs.
The paper integrates AI and expert knowledge to optimize radiotherapy decisions.
problem Optimizing radiation dose planning considering patient-specific information.
method Integrating Gaussian process models with deep neural networks to quantify uncertainty.
result Improves AI model performance and guides clinical decision making.
Bayesian principles improve agentic AI decision-making.
problem Decision-making under uncertainty in agentic AI systems.
method Bayesian decision theory applied to the orchestration layer of agentic AI.
result Bayesian principles enhance agentic AI's ability to make decisions under uncertainty.
Uncertainty in AI-driven Monte Carlo simulationscond-mat.dis-nn
New method reduces uncertainty in AI-driven Monte Carlo simulations.
problem Epistemic uncertainty in AI surrogate models affects Monte Carlo sampling outcomes.
method Penalty Ensemble Method (PEM) modifies Metropolis acceptance rule to increase rejection probability in uncertain regions.
result PEM enhances reliability of Monte Carlo simulations by reducing uncertainty propagation.
Develops a framework for quantifying agentic AI model risk using LLM-inferred Bayesian state filters.
problem Quantifying the risk of agentic AI systems due to uncertain beliefs and actions.
method Representing the system as a partially observed Markov decision process with latent states, Bayesian belief updates, control-dependent losses, and tail-risk functionals.
result Develops a rigorous framework for separating uncertainty quantification from risk measurement.
Paper tackles AI risks by customizing metrics and models.
problem AI risks are multidimensional and immaturely managed.
method Decomposes AI risks into data protection, fairness, etc., and develops metrics and models.
result Customized metrics and models reduce AI risk uncertainty.
Study benchmarks uncertainty quantification in chest X-ray classification.
problem Reliable uncertainty quantification for medical AI models.
method Evaluation of 13 uncertainty quantification methods on MIMIC-CXR-JPG dataset.
result Insights into effectiveness and disentanglement of epistemic and aleatoric uncertainties.
Improved AI lung ultrasound segmentation using expert confidence values.
problem Label uncertainty in lung ultrasound due to subjective interpretation by radiologists.
method Designing a data annotation protocol capturing expert confidence, training AI on binarized labels with confidence thresholds.
result Improved AI segmentation and better clinical outcomes (e.g., S/F oxygenation ratio estimation, patient readmission prediction).
MissBGM uses AI and Bayesian modeling for better missing data imputation.
problem Missing data imputation in data science, especially with uncertainty quantification.
method AI-powered Bayesian generative modeling with explicit modeling of missingness mechanisms.
result MissBGM provides principled posterior uncertainty over imputations and superior performance.
Adaptive uncertainty quantification improves black-box model predictions in generative AI.
problem Improving uncertainty quantification for black-box models in generative AI.
method Adaptive partitioning and local calibration of conformity scores.
result Local tightening of uncertainty sets with adaptive bands.
New method explains predictive uncertainty by focusing on second-order effects.
problem Explaining predictive uncertainty in machine learning models.
method CovLRP, CovGI, etc., based on second-order effects.
result Predictive uncertainty is dominated by second-order effects.
New method improves active statistical inference by reducing noise.
problem Inaccurate uncertainty estimates in active sampling lead to noisy results.
method Robust sampling strategies that interpolate between uniform and active sampling based on uncertainty scores.
result The robust sampling ensures that the estimator is never worse than uniform sampling and usually outperforms active inference.
New methods quantify uncertainties in AI weather forecasts.
problem Uncertainty in AI weather predictions.
method Comparing ensemble and post-hoc uncertainty quantification methods.
result Probabilistic forecasts improve over ensemble physics-based models.
The paper shows how uncertainty quantification improves counterfactual explainability in AI.
problem Lack of foundational concepts in transparency research.
method Integrates uncertainty quantification into counterfactual explainability.
result Demonstrates competitive performance of an uncertainty-based explainer.
New method attributes feature uncertainty in ML models using cooperative game theory.
problem Lack of feature-level uncertainty attribution in explainable AI.
method Proposes a novel, model-agnostic uncertainty attribution method using cooperative game theory and conformal prediction.
result Demonstrates improved runtime efficiency and practical utility in real-world applications.
New framework quantifies uncertainties in neural network explanations.
problem Lack of methods to quantify uncertainties in neural network explanations.
method Converts any explanation method into a Bayesian neural network method, modeling uncertainties.
result Allows quantification of explanation uncertainties and appropriate confidence levels.
Unified taxonomy for ML uncertainty in physics, validated.
problem Uncertainty quantification in machine learning for physics.
method Unified taxonomy, principled validation tools.
result Illustrated validation tools with examples.
FST.ai 2.0 improves Taekwondo decision-making with AI, reducing review time and increasing trust.
problem Fair, transparent, and explainable decision-making in Taekwondo.
method Pose-based action recognition, epistemic uncertainty modeling, interactive dashboards.
result 85% reduction in decision review time, 93% referee trust in AI-assisted decisions.
Polynomial chaos surrogates quantify epistemic uncertainty in AI-driven scientific models.
problem Uncertainty in reward estimates hinders interpretability in sequential generative models.
method Fit polynomial chaos expansions to trained models to propagate epistemic uncertainty and quantify sensitivity.
result Interpretable decomposition of reward components driving generative decisions.
Paper tackles selective regression using uncertainty estimation.
problem Selective regression for machine learning models to avoid predictions when uncertain.
method Model-agnostic non-parametric uncertainty estimation.
result Superior performance compared to state-of-the-art selective regressors.
Fortuna simplifies uncertainty quantification in deep learning.
problem Improving uncertainty estimates in deep learning models.
method Supports various calibration techniques including conformal prediction and scalable Bayesian inference.
result Simplifies benchmarking and builds robust AI systems.
New method provides calibrated feature importance explanations for regression models.
problem Lack of uncertainty quantification in existing local explanation methods.
method Extension of Calibrated Explanations method to support regression and probabilistic regression.
result Calibrated Explanations for regression provides quantified uncertainty and robust explanations.
Paper reviews synthetic data from AI models for statistical inference.
problem When can synthetic data be used reliably in statistical inference?
method Survey of generative models, statistical analysis of pitfalls.
result Principled use of synthetic data requires careful model specification.
Novel approach uses ENN for UQ in gust predictions, reducing RMSE and improving confidence.
problem Reducing bias and uncertainty in wind gust predictions.
method Evidential Neural Network (ENN) with Explainable AI.
result 47% reduction in RMSE, 95% coverage of observed gusts at 179 out of 266 stations.
Loss estimator improves model calibration and generalization.
problem Ensuring models generalize to unseen data.
method Train a loss estimator alongside the model using contrastive training.
result Improves model generalization and calibration.
This paper tackles AI model governance challenges in financial services.
problem Challenges in current AI model governance practices in financial services.
method Proposes a system-level framework for increased self-regulation.
result Enhanced model governance and risk management capabilities.
Monitoring Model Deterioration with Explainable Uncertainty Estimation via Non-parametric Bootstrapcs.LG
The paper monitors model deterioration using uncertainty estimation.
problem Challenges in monitoring deployed machine learning models.
method Non-parametric bootstrapped uncertainty estimates and SHAP values.
result The approach detects model deterioration and uncertainty effectively.
Rubin LSST DESC uses AI/ML for dark energy research.
problem Challenges in uncertainty quantification and model robustness for AI/ML in DESC.
method Bayesian inference, physics-informed methods, validation frameworks, active learning.
result AI/ML methods are essential but require rigorous evaluation and governance.
(Early) AI Compute Asset Pricingq-fin.PR
The paper analyzes the pricing of a new compute futures asset.
problem Uncertainty in AI adoption and pricing of compute capital.
method An asset-pricing framework for compute futures, including synthetic futures pricing.
result Preliminary evidence suggests a positive compute risk premium.
Uncertainty estimation in deep neural networks is essential for designing reliable and robust AI systems. Applications such as video surveillance for identifying suspicious activities are designed with deep neural networks (DNNs), but DNNs do not provide uncertainty estimates. Capturing reliable uncertainty estimates i…
Paper introduces a hybrid GPR model for more interpretable RUL prediction in aeroengine.
problem Challenges in interpreting and modeling uncertainty in RUL prediction models.
method Modified Gaussian Process Regression (GPR) with temporal feature extraction.
result Effective prediction of RUL intervals with transparent feature significance.
Unified framework for arbitrary conditional inference using AI and Bayesian methods.
problem Limited flexibility in existing conditional inference methods.
method Bayesian generative modeling with stochastic iterative algorithm.
result Single learned model for universal conditional prediction with uncertainty quantification.