New methods for better uncertainty prediction in ML.
problem Insufficient calibration in machine learning regression.
method Conditional calibration with respect to input features (adaptivity).
result Consistency and adaptivity are complementary, and good consistency does not guarantee good adaptivity.
CUQ-GNN adapts uncertainty quantification for graph data, improving on GPN.
problem Defining meaningful uncertainty on graph data with domain-specific characteristics.
method Combines Graph Neural Networks with Posterior Networks using Normalizing Flows.
result CUQ-GNN produces more flexible and effective uncertainty estimates.
ABNN converts pre-trained DNNs into BNNs for reliable uncertainty quantification.
problem Uncertainty quantification in deep neural networks (DNNs) is challenging and critical for real-world applications.
method Adaptable Bayesian Neural Network (ABNN) that transforms pre-trained DNNs into BNNs with minimal overhead.
result ABNN achieves state-of-the-art performance in image classification and semantic segmentation tasks.
New method quantifies uncertainty in fine-tuned LLMs using LoRA ensembles.
problem Uncertainty in fine-tuned LLMs and how to trust their predictions.
method Posterior approximations using low-rank adaptation ensembles.
result Unexpected retention of acquired knowledge during fine-tuning in overfitting regime.
Survey on uncertainty in ML and DL, covering sources, quantification, and decision-making.
problem Understanding and quantifying uncertainty in ML and DL for risk-sensitive applications.
method Structured review of literature, categorizing uncertainty, assessing uncertainty quantification techniques.
result Broadened scope of uncertainty discussion and updated DL uncertainty quantification methods.
Adaptive uncertainty quantification improves black-box model predictions in generative AI.
problem Improving uncertainty quantification for black-box models in generative AI.
method Adaptive partitioning and local calibration of conformity scores.
result Local tightening of uncertainty sets with adaptive bands.
MC-CP combines adaptive MC dropout with conformal prediction for robust uncertainty quantification.
problem Deploying deep learning models in safety-critical applications requires reliable confidence estimates.
method MC-CP integrates adaptive Monte Carlo dropout with conformal prediction to improve model performance.
result MC-CP significantly outperforms state-of-the-art UQ methods in both classification and regression tasks.
This study revisits UQ validation methods based on consistency and adaptivity concepts.
problem Lack of comprehensive validation methods for UQ metrics across input feature ranges.
method Revisit and extend common validation methods for UQ metrics based on consistency and adaptivity concepts.
result Improved understanding and capabilities of UQ metrics validation methods.
JANET improves time series prediction with adaptive uncertainty regions.
problem Time series data's lack of exchangeability and multi-step prediction challenges.
method Proposes JANET, a framework for joint adaptive prediction regions with controlled error rates.
result Demonstrates superior performance in multi-step prediction tasks across diverse datasets.
Efficiently constructs prediction bands with minimal assumptions.
problem Uncertainty quantification for nonparametric, heteroscedastic data.
method Semi-definite programming for data-adaptive prediction bands.
result Strong non-asymptotic coverage properties with minimal distributional assumptions.
This work advances collaborative decision making by combining human and AI strengths in uncertainty quantification.
problem Current AI lacks robust decision-making capabilities under uncertainty, especially in high-stakes contexts.
method Introduces Human AI Collaborative Uncertainty Quantification (HACUQ) framework, formalizing AI-human collaboration and developing calibration algorithms.
result Optimal collaborative prediction sets follow a two-threshold structure, and online adaptation algorithms can adapt to evolving human behavior.
CP-ROC bands improve graph classification accuracy and uncertainty quantification.
problem Uncertainty quantification and robustness to distributional shifts in graph classification.
method Conditional Prediction ROC (CP-ROC) bands for graph classification, developed for TGNNs and adaptable to GNNs.
result Statistically guaranteed coverage for CP-ROC under local exchangeability condition, improving prediction reliability.
CRC method provides tighter uncertainty intervals for CT images.
problem Expressing uncertainty in CT images in clinically meaningful terms.
method Semantically adaptive CRC procedure leveraging length minimization.
result Valid coverage of ground-truth images with tighter uncertainty intervals.
Study improves LLMs for PPI analysis by addressing uncertainty.
problem Uncertainty in LLM predictions for PPIs.
method Fine-tuned LLaMA-3 and BioMedGPT models, LoRA ensembles, Bayesian LoRA for UQ.
result Competitive PPI identification performance across diverse disease contexts.
Paper introduces efficient uncertainty estimation in LLMs without multiple forward passes.
problem Accurate uncertainty quantification in LLMs remains challenging.
method Evidential Knowledge Distillation to create compact student models.
result Efficient uncertainty estimation achieved with single forward pass.
Enhances ocean floor mapping with adaptive uncertainty estimates.
problem Inaccurate bathymetric data for precise ocean modeling.
method Block-based conformal prediction with VQ-VAE architecture.
result Significant improvements in reconstruction quality and uncertainty estimation reliability.
Hybrid Bayesian-conformal framework improves uncertainty quantification in healthcare predictions.
problem Jointly satisfying distribution-free coverage guarantees and risk-adaptive precision in clinical decision-making.
method Integrates Bayesian hierarchical random forests with group-aware conformal calibration, using posterior uncertainties to weight conformity scores.
result Achieves target coverage (94.3% vs 95% target) with adaptive precision, 21% narrower intervals for low-uncertainty cases.
NCP improves deep classifier uncertainty quantification efficiency.
problem Uncertainty quantification for deep classifiers in high-stake applications.
method Neighborhood Conformal Prediction (NCP) algorithm.
result NCP produces smaller prediction sets than traditional CP methods.
Improved Bayesian uncertainty quantification using variational bagging.
problem Inefficient and underestimating uncertainty in mean-field variational Bayes.
method Integrates bagging with variational Bayes for improved inference.
result Bagged variational posterior provides proper uncertainty quantification.
AdaPTS adapts univariate FMs for multivariate time series forecasting.
problem Challenges in managing feature dependencies and uncertainty quantification in multivariate time series forecasting.
method Adapters that transform multivariate inputs into a latent space and apply univariate FMs independently to each dimension.
result AdaPTS enhances forecasting accuracy and uncertainty quantification compared to baseline methods.
CAOS aggregates multiple one-shot predictors for efficient uncertainty quantification.
problem Lack of principled uncertainty quantification in one-shot prediction.
method CAOS, a conformal framework that aggregates multiple one-shot predictors and uses a leave-one-out calibration scheme.
result CAOS produces smaller prediction sets with reliable coverage compared to split conformal baselines.
Enhances activity recognition in wearable computing with context awareness and uncertainty quantification.
problem Context-dependent activity recognition and unknown contexts in wearable computing.
method Developed the α-{eta} network coupled with uncertainty quantification (UQ) based on maximum entropy.
result Improved accuracy and F-score by 10% through high-level context identification.
Develops a neural surrogate for proton dose calculation using Monte Carlo dropout uncertainty.
problem Computational demand in proton therapy workflows requiring repeated evaluations.
method Integrates Monte Carlo dropout into a neural network surrogate for fast, differentiable dose predictions and uncertainty quantification.
result Shows significant speedups over MC while retaining uncertainty information.
Adaptive Conformal Inference improves time series forecasting uncertainty.
problem Uncertainty quantification in time series models with dependency.
method AgACI, an adaptive method based on online expert aggregation.
result AgACI provides efficient prediction intervals for day-ahead electricity price forecasting.
A novel capsule network model improves surrogate modeling and uncertainty quantification from sparse data.
problem Surrogate modeling and uncertainty quantification of systems from sparse data.
method Adapted Capsule Network (CapsNet) architecture into image-to-image regression encoder-decoder network.
result The proposed approach accurately, efficiently, and robustly predicts responses for arbitrary diffusion fields.
Bayesian adaptive PCE method improves surrogate modeling and sensitivity analysis.
problem Lack of fully Bayesian PCE methods in statistics.
method Developed a novel fully Bayesian adaptive PCE method with R implementation.
result Bayesian adaptive PCE provides competitive performance for various UQ tasks.
Bayesian parametric matrix models provide uncertainty quantification for spectral learning.
problem Uncertainty quantification in spectral learning for safety-critical applications.
method Bayesian parametric matrix models (B-PMMs) that extend PMMs to provide uncertainty estimates.
result B-PMMs achieve exceptional uncertainty calibration (ECE < 0.05) while maintaining favorable scaling.
CASCADE improves uncertainty communication in Parkinson's disease medication management.
problem Uncertainty in clinical decision-making for Parkinson's disease patients.
method CASCADE uses a novel conformal prediction framework to adaptively scale prediction intervals based on classification uncertainty.
result CASCADE produces more efficient and robust prediction intervals for Parkinson's disease patients.
A scalable GP model for online uncertainty quantification over graphs.
problem Scalable uncertainty quantification over graphs with dynamic data.
method Graph-aware parametric Gaussian process model using random features and online conformal prediction.
result Improved coverage and efficient prediction sets over existing methods.
GP model calibration improves optimization algorithm performance.
problem GP model uncertainty calibration issues degrade optimization performance.
method Kernel validation procedure to calibrate GP predictions.
result Proper calibration enhances optimization algorithm convergence.
Proposes a simple method to explain aleatoric uncertainty in neural networks.
problem Lack of transparent explanations for uncertainty estimates in AI models.
method Adapting a neural network with Gaussian output to estimate predictive variance and applying explainers to the variance output.
result The proposed method explains uncertainty more reliably than complex approaches and outperforms them in most settings.
DS-CP improves reliability of uncertainty quantification for large language models under domain shift.
problem Overconfident and factually incorrect outputs (hallucinations) from large language models.
method Adapts conformal prediction to large language models under domain shift by reweighting calibration samples.
result DS-CP delivers more reliable coverage than standard conformal prediction, especially under substantial distribution shifts.
Bayesian framework quantifies uncertainty in portfolio temperature alignment.
problem Uncertainty in portfolio temperature alignment models.
method X-Degree Compatibility (XDC) approach with FaIR climate model, adaptive MCMC, deep learning emulator.
result Robust parametric uncertainty quantification for FaIR model.
ECI improves time series prediction uncertainty quantification by smoothing miscoverage error.
problem Challenges in uncertainty quantification for time series prediction due to temporal dependence and distribution shift.
method Error-quantified Conformal Inference (ECI) by smoothing quantile loss function and introducing adaptive feedback scale.
result ECI achieves valid miscoverage control and tighter prediction sets than existing methods.
New method reduces uncertainty in high-dimensional circuits by automatically determining tensor rank and adaptive sampling.
problem Uncertainty quantification in high-dimensional circuits due to fabrication process variations.
method Tensor regression with ℓq/ℓ2 group-sparsity regularization for rank determination and adaptive sampling. result Captures uncertainty with only 100-600 simulation samples for 19-100 random variables.
A method predicts posterior PCs for faster uncertainty quantification in imaging.
problem Uncertainty visualization in image restoration models is limited by per-pixel variances.
method Neural Posterior Principal Components (NPPC) method for predicting PCs in a single forward pass.
result Orders of magnitude faster uncertainty quantification compared to posterior samplers.
Flexible evidential deep learning improves uncertainty quantification in machine learning.
problem Overconfident predictions in machine learning models can lead to serious consequences.
method Proposes flexible evidential deep learning (F-EDL) to model uncertainty over class probabilities using a flexible Dirichlet distribution.
result Empirically demonstrates state-of-the-art uncertainty quantification performance across diverse scenarios.
Conf-Gen applies uncertainty quantification to generative models.
problem Uncertainty quantification for unsupervised generative models.
method Adapts CRC to generative tasks, relaxing theoretical assumptions.
result Demonstrates flexibility and correctness of AI agent outputs.
Sparse Gaussian process quantile regression tackles computational challenges in Bayesian quantile regression.
problem Nonconjugacy and computational cost in Gaussian process quantile regression.
method Sparse Gaussian process framework with Laplace approximation, adaptive inducing-input placement, and sequential data acquisition.
result Accuracy of Laplace approximation and effectiveness of adaptive mechanisms in reducing predictive uncertainty.
New method improves reliability of depth estimation models.
problem Uncertainty quantification in large-scale vision models.
method Parameter-efficient Bayesian neural networks with PEFT methods.
result Combining PEFT methods with Bayesian inference enhances predictive performance.
DANCE improves prediction set efficiency for deep learning models.
problem Inefficient, overly conservative prediction sets for pre-trained models.
method DANCE combines adaptive kernel regression and nearest-neighbor approach.
result DANCE produces more efficient and robust prediction sets.
New method calibrates models under covariate shifts.
problem Calibration of models can be lost under covariate shifts.
method Importance sampling based approach.
result Efficacy demonstrated on real-world and synthetic datasets.
Fortuna simplifies uncertainty quantification in deep learning.
problem Improving uncertainty estimates in deep learning models.
method Supports various calibration techniques including conformal prediction and scalable Bayesian inference.
result Simplifies benchmarking and builds robust AI systems.
This paper examines the convergence of adaptive sampling methods for Bayesian neural networks.
problem Uncertainty quantification in deep neural networks, especially for medical applications.
method Locally adaptive and scalable diffusion-based sampling methods.
result These methods can have a substantial bias in the distribution they sample, even in the limit of vanishing step sizes.
The paper introduces algorithms for uncertainty quantification in metric spaces.
problem Uncertainty quantification in regression models defined on metric spaces.
method Proposes conformal and kNN prediction algorithms for metric spaces.
result Both algorithms provide finite-sample guarantees and improve local coverage calibration.
The paper quantifies uncertainty in aggregated machine learning metrics.
problem Uncertainty in summarizing model performance across multiple tasks.
method Statistical methodologies including bootstrapping and Bayesian modeling.
result Insights into model performance dominance for specific tasks.
Gradient Boosted Mixed Models estimate mean and variance components for clustered data.
problem Limited flexibility in linear mixed models for complex settings.
method Gradient Boosting extended to mixed models with likelihood-based gradients and flexible base learners.
result Accurate recovery of variance components and improved predictive accuracy.
Bayesian meta learning improves uncertainty quantification in regression.
problem Trusting uncertainty quantification in Bayesian regression.
method Trust-Bayes framework for Bayesian meta learning, optimizing for trustworthy uncertainty quantification.
result Lower bounds and sample complexity for trustworthy uncertainty quantification are characterized.