SCS identifies a range of plausible equally weighted portfolios, quantifying selection uncertainty.
problem Uncertainty in selecting the best equally weighted portfolio subset.
method Introduces Selection Confidence Set (SCS) for EWPs, covering plausible portfolios with high probability.
result SCS quantifies selection uncertainty and covers the unknown optimal selection with high probability.
New method selects equivariant models using uncertainty metrics.
problem Selecting equivariant models among pretrained ones with varying symmetry biases.
method Uncertainty-aware model selection using frequentist, Bayesian, and calibration-based measures.
result Bayesian model evidence often misaligns with predictive performance.
Selective planning with imperfect models reduces harmful effects of model inadequacy.
problem Harmful effects of using an imperfect model in reinforcement learning.
method Selective planning with heteroscedastic regression to estimate predictive uncertainty from model inadequacy.
result Effective selective planning requires considering both parameter uncertainty and model inadequacy.
Proposes a new batch selection method for multi-label classification.
problem Improving the accuracy of deep neural networks in multi-label classification tasks.
method Adapts uncertainty measures to multi-label data, considering label correlations and dynamic uncertainty.
result Improves performance and accelerates convergence of multi-label deep learning models.
Study time-inconsistent control problems with model uncertainty, solving portfolio selection.
problem Time-inconsistent Markovian control problems under model uncertainty.
method Combining sub-game perfect strategies with adaptive robust stochastic methods.
result Solved numerically the mean-variance portfolio selection problem.
Paper tackles selective regression using uncertainty estimation.
problem Selective regression for machine learning models to avoid predictions when uncertain.
method Model-agnostic non-parametric uncertainty estimation.
result Superior performance compared to state-of-the-art selective regressors.
Unified framework for selecting variables with uncertainty quantification.
problem Uncertainty in nonlinear variable selection for various models.
method Develops a unified framework using integrated partial derivatives for quantifying variable importance and uncertainty.
result The approach provides a principled method for quantifying variable selection uncertainty and is generalizable to non-differentiable models.
Proposes a new selective regression method using conformal prediction.
problem The need for models to abstain from predictions in cases of uncertainty.
method Leverages conformal prediction to provide grounded confidence measures for individual predictions based on model-specific biases.
result Demonstrates an advantage over state-of-the-art baselines in selective regression.
This thesis enhances ML reliability by selectively abstaining from predictions when uncertain.
problem Improving reliability in machine learning systems, especially in high-stakes domains.
method Exploiting uncertainty signals from training trajectories to develop lightweight, post-hoc abstention methods compatible with differential privacy.
result A robust trajectory-based approach to selective prediction that maintains high accuracy under privacy noise.
A method to select important experts for Gaussian processes to balance computational efficiency and uncertainty quantification.
problem Balancing computational efficiency and uncertainty quantification in Gaussian processes for big data.
method Using graphical models to select important experts and aggregate their predictions while ensuring uncertainty quantification.
result Substantially reduces computational cost of aggregating dependent experts while ensuring calibrated uncertainty quantification.
SVB method provides scalable Bayesian proportional hazards model for high-dimensional gene expression data.
problem Bayesian methods for high-dimensional sparse survival data often sacrifice uncertainty quantification or computational scalability.
method Mean-field variational approximation for scalable Bayesian proportional hazards model.
result SVB method offers posterior distribution for parameters and variable selection via posterior inclusion probabilities.
COPS optimizes deep learning by selecting informative samples with uncertainty estimation.
problem Mitigating high costs in labeling and computational resources for deep learning.
method COPS (unCertainty based OPtimal Sub-sampling) selects data with input and output uncertainty for linear softmax regression.
result COPS outperforms baseline methods in deep learning tasks, minimizing expected loss.
The paper explores MMPR to select diverse models for scientific insight.
problem Model selection often fails to bring multiple underlying patterns to light.
method Multi-model penalized regression (MMPR) to acknowledge model uncertainty.
result Different penalty settings can promote either shrinkage or sparsity of coefficients in separate models.
Comprehensive review of robust portfolio selection models.
problem Addressing uncertainty in financial portfolio optimization.
method Classification and analysis of various models and approaches.
result Identification of open research questions.
A framework for uncertainty-aware multimodal learning using conformal Shapley intervals.
problem Uncertainty and modality level importance in multimodal learning.
method Introduces conformal Shapley intervals to quantify modality level importance and uncertainty.
result Demonstrates meaningful uncertainty quantification and strong predictive performance.
Study optimizes natural resource harvesting under model uncertainty using risk measures.
problem Optimal harvesting policy selection for natural resources under model uncertainty.
method Investigated using neoclassical growth model dynamics and convex risk measures, specifically Fréchet risk measures.
result Robust harvesting strategies quantifying operational and marginal risk under model uncertainty.
Selective prediction framework reduces errors in molecular structure identification from MS/MS.
problem High-stakes applications require reliable molecular structure identification from MS/MS data.
method Selective prediction framework using risk-coverage tradeoff and uncertainty quantification.
result First-order confidence measures and retrieval-level aleatoric uncertainty achieve strong risk-coverage tradeoffs.
A new method ranks uncertainty vectors from multiple measures for robust prediction.
problem Single scalar measures of model reliability are insufficient for comprehensive uncertainty quantification.
method Optimal transport ranks vectors of uncertainty measures, supporting flexible fusion of aleatoric and epistemic uncertainties.
result The method provides a robust ranking of uncertainty that supports various downstream tasks.
A scalable framework selects top factors from CAE latent factors for better portfolio optimization.
problem Limited latent factor dimension in CAE models degrades performance.
method Couple high-dimensional CAE with uncertainty-aware factor selection.
result Pruning strategy delivers substantial gains in risk-adjusted performance.
Framework disentangles deep feature uncertainty for efficient inference.
problem Inference-time uncertainty estimation for reliable decision-making.
method Uncertainty-Guided Inference-Time Selection framework.
result Significantly tighter prediction intervals and 60% compute reduction.
Proposes measures for uncertainty quantification using proper scoring rules.
problem Uncertainty quantification for prediction tasks.
method Decomposes proper scoring rules into divergence and entropy components, tailoring uncertainty quantification to specific tasks.
result Flexibility in uncertainty quantification improves performance in selective prediction and active learning.
Bayesian principles improve neural additive models for better feature selection and uncertainty.
problem Lack of calibrated uncertainties and feature selection in neural additive models.
method Augmenting NAMs with Bayesian principles to provide credible intervals, feature selection, and interaction ranking.
result Improved performance on tabular datasets and real-world medical tasks.
Study optimal portfolio selection with Recovery Average Value at Risk, showing better control over liabilities.
problem Optimizing portfolios with a new risk measure under known or uncertain distributions.
method Existence results for mean-risk optimal portfolios under different distributional assumptions.
result Portfolio selection under Recovery Average Value at Risk provides better control over liabilities.
VMoER improves uncertainty quantification in MoE layers for scalable foundation models.
problem Uncertainty quantification in large-scale models like MoE layers.
method Structured Bayesian approach with amortized variational inference over routing logits and temperature parameter inference.
result Improves routing stability, reduces calibration error, and increases AUROC by 12%.
Missing data are a concern in many real world data sets and imputation methods are often needed to estimate the values of missing data, but data sets with excessive missingness and high dimensionality challenge most approaches to imputation. Here we show that appropriate feature selection can be an effective preprocess…
Bayesian method identifies dynamical models with uncertainty quantification.
problem Uncertainty in selecting governing equations for dynamical systems.
method Bayesian sparse identification with model averaging.
result Accurately recovers sparse interaction structures with uncertainty quantification.
This work develops rigorous theoretical basis for the fact that deep Bayesian neural network (BNN) is an effective tool for high-dimensional variable selection with rigorous uncertainty quantification. We develop new Bayesian non-parametric theorems to show that a properly configured deep BNN (1) learns the variable im…
Select-DC reduces GFLOPS for uncertainty estimation in neural networks.
problem Computational inefficiency in estimating model uncertainty for low-latency applications.
method Select-DC uses a subset of layers to model epistemic uncertainty with MCDC, reducing GFLOPS.
result Significant reduction in GFLOPS required for uncertainty estimation with marginal performance loss.
Framework for imputing time series data with uncertainty measures.
problem Handling missing values in time series data, especially in healthcare.
method Uncertainty-aware multivariate time series imputation framework.
result Selective imputation of less uncertain values improves downstream tasks.
The paper argues that uncertainty quantification in ML is application-specific and proposes a flexible family of measures.
problem The need for proper uncertainty quantification in machine learning for safety-critical applications.
method A flexible family of uncertainty measures tailored to specific applications, using proper scoring rules to control characteristics.
result Different uncertainty measures are more suitable for different tasks (e.g., selective prediction, out-of-distribution detection, active learning).
Novel methods for splitting Gaussian mixtures improve uncertainty propagation in nonlinear systems.
problem Improving accuracy and efficiency in nonlinear uncertainty propagation.
method Preserving mean and covariance, novel heuristics for selecting splitting direction informed by initial uncertainty and nonlinear function properties.
result Improved accuracy and efficiency in uncertainty propagation compared to existing techniques.
Machine learning selects the best prediction rules from noisy data.
problem Selection under uncertainty in machine learning.
method Statistical tools and inequalities to control noise in empirical estimates.
result Theoretical guarantees on selection outcomes under uncertainty.
Robust optimization improves portfolio selection by accounting for deep uncertainties.
problem Managing deep uncertainties in future asset returns for successful portfolio selection.
method Robust optimization (RO) models incorporating general assumptions on uncertain risk parameters.
result RO models outperform traditional models in comprehensive empirical assessments.
Enhances clinical trial predictions by quantifying uncertainty.
problem Uncertainty in medical diagnosis and drug discovery predictions.
method Selective classification integrated with Hierarchical Interaction Network (HINT).
result Significant improvement in PR-AUC, F1, ROC-AUC, and overall accuracy.
Method evaluates classification uncertainty with adaptively chosen features.
problem Finding a balance between model efficiency and fairness.
method Adaptively selects features for equalized coverage in classification.
result Valid and effective method demonstrated on simulated and real data.
This research improves neural network uncertainty estimates and reliability.
problem Lack of inherent uncertainty estimates and variability in softmax scores.
method Ensemble-based Dirichlet modeling with method of moments estimator.
result Improved stability and predictive uncertainty estimates.
BayesBoost combines boosting and Bayesian methods for linear mixed models, improving uncertainty estimation and variable selection.
problem Lack of straightforward uncertainty estimation for parameters in high-dimensional linear mixed models.
method BayesBoost: Combines boosting and Bayesian inference for linear mixed models.
result Improves uncertainty estimation and variable selection in linear mixed models.
This paper proposes a method to select project schedules with the lowest risk.
problem Selecting schedules that meet project deadlines while minimizing risk.
method Integrating aleatory uncertainty into project scheduling to quantify and compare risks.
result Proposes a method to select schedules with the lowest risk.
SConU improves uncertainty prediction for large models by testing for outliers and reducing miscoverage.
problem Real-world deployment of large language models requires reliable guarantees of task-specific metrics.
method SConU implements significance tests to identify and exclude outliers that violate exchangeability assumptions.
result SConU reduces miscoverage rates and enhances prediction efficiency in high-stakes tasks.
New method improves Bayesian model selection for neural dynamics.
problem Bayesian methods struggle with large datasets and computational constraints.
method Computation-Aware State-Space Model (CASSM) with model selection.
result CASSM yields competitive performance and improved uncertainty calibration.
In markets for online advertising, some advertisers pay only when users respond to ads. So publishers estimate ad response rates and multiply by advertiser bids to estimate expected revenue for showing ads. Since these estimates may be inaccurate, the publisher risks not selecting the ad for each ad call that would max…
Active learning selects optimal measurement times for inferring continuous paths from sparse data.
problem Inferring continuous probability paths from sparse snapshots in high-fidelity domains like single-cell biology.
method Extends active experimentation to the space of measures using Linearized Optimal Transport (LOT) for probabilistic surrogate modeling.
result Empirical results show that the proposed strategy outperforms uncertainty-agnostic baselines.
Review of uncertainty representation methods in risk management.
problem Inadequate consideration of uncertainty in risk management.
method Systematic literature review of 370 publications.
result Probabilistic methods are predominant, but fuzzy and evidence-based approaches are also useful.
BO algorithms improve binary and preferential optimization by distinguishing between types of uncertainty.
problem Optimizing expensive functions with binary or pairwise comparisons.
method Proposed new acquisition functions distinguishing between epistemic and aleatoric uncertainty.
result New acquisition functions outperform state-of-the-art heuristics in binary and preferential BO.
In many real-world scenarios where data is high dimensional, test time acquisition of features is a non-trivial task due to costs associated with feature acquisition and evaluating feature value. The need for highly confident models with an extremely frugal acquisition of features can be addressed by allowing a feature…
Cross-validation is one of the most popular model selection methods in statistics and machine learning. Despite its wide applicability, traditional cross validation methods tend to select overfitting models, due to the ignorance of the uncertainty in the testing sample. We develop a new, statistically principled infere…
PROWL uses robust reward estimates to improve ITR selection.
problem Reward uncertainty in ITR estimation leads to inflated performance.
method PAC-Bayesian framework with reward uncertainty certificates.
result PROWL achieves better robust treatment regime estimation.
Teaches uncertainty in ML through practical examples.
problem Lack of uncertainty teaching in ML curricula.
method Developed a curriculum and use cases.
result Motivates adoption of uncertainty concepts in AI courses.