Unified method for input, data, and model uncertainty in neural networks.
problem Uncertainty in neural network inputs and outputs.
method Propagating uncertainty through inputs using a unified formulation.
result More stable decision boundaries with input noise, and propagation of input uncertainty to model outputs.
Proposes training neural networks to predict uncertainty for out-of-distribution inputs.
problem Poor uncertainty predictions for out-of-distribution inputs limit model robustness.
method Generates pseudo-inputs in low-density regions and trains a Bayesian framework.
result Yields robust and interpretable uncertainty predictions.
A new method quantifies input model uncertainty in streaming data.
problem Quantifying input model uncertainty in streaming data.
method Two-layer importance sampling framework for online uncertainty quantification.
result Consistency and asymptotic convergence rate of the proposed algorithms.
When simulating a complex stochastic system, the behavior of output response depends on input parameters estimated from finite real-world data, and the finiteness of data brings input uncertainty into the system. The quantification of the impact of input uncertainty on output response has been extensively studied. Most…
Testing under what conditions the product satisfies the desired properties is a fundamental problem in manufacturing industry. If the condition and the property are respectively regarded as the input and the output of a black-box function, this task can be interpreted as the problem called Level Set Estimation (LSE) --…
Framework optimizes multiple objectives considering input uncertainty.
problem Efficiently optimizing multiple objectives with input uncertainty.
method Robust Gaussian Process model and two-stage Bayesian optimization process.
result Found a robust Pareto frontier considering input uncertainty.
CLUE method interprets uncertainty from BNNs by showing how inputs change to increase confidence.
problem Lack of work on interpreting uncertainty estimates from probabilistic models.
method CLUE method uses counterfactual explanations to interpret uncertainty from BNNs.
result CLUE outperforms baselines and helps practitioners understand predictive uncertainty.
Survey and framework for consistent uncertainty quantification in deep learning.
problem Partial uncertainty coverage and inconsistencies in deep learning uncertainty quantification.
method Bayes' theorem and conditional probability densities applied to all major sources of uncertainty.
result Improved robustness and reliability of neural network predictions in real-world scenarios.
Contrastive learning recovers latent distributions for ambiguous inputs, including aleatoric uncertainty.
problem Real-world observations often have inherent ambiguities, making the true posterior probabilistic with heteroscedastic uncertainty.
method Extended InfoNCE objective and encoders to predict latent distributions, proving they recover the correct posteriors, including aleatoric uncertainty.
result Contrastive learning encoders can recover the correct posteriors of data-generating processes, including aleatoric uncertainty, up to a rotation of the latent space.
δ-CLUE generates diverse explanations for model uncertainty.
problem Lack of constraints in generating explanations for uncertainty estimates.
method Augmenting CLUE approach to provide a set of plausible explanations.
result Returns a set of diverse inputs that yield confident predictions.
Obtaining reliable uncertainty estimates of neural network predictions is a long standing challenge. Bayesian neural networks have been proposed as a solution, but it remains open how to specify their prior. In particular, the common practice of an independent normal prior in weight space imposes relatively weak constr…
Proposes a new criterion for reliable uncertainty estimation in deep neural networks.
problem Inability of existing approaches to provide reliable uncertainty estimates for deep neural networks.
method Develops a density uncertainty layer architecture that satisfies the proposed criterion.
result Density uncertainty layers provide more reliable uncertainty estimates and robust out-of-distribution detection.
Bayesian framework improves ML classification models' uncertainty estimates.
problem Ensuring trustworthy AI predictions with explicit uncertainty quantification.
method Proposes a Bayesian framework for generative ML classification models that accounts for input measurement uncertainty.
result The BQDA model outperforms other models in terms of interpretability, explicit uncertainty modeling, and computational efficiency.
CNNs learn about input data uncertainties, improving classification performance.
problem Errors in measurements are often neglected in ML, affecting classification performance.
method Constructed a model with known noise levels and used CNNs to learn about uncertainties.
result CNNs can incorporate information about input data uncertainties, improving classification performance.
A new method quantifies uncertainty in brain injury simulations.
problem High computational cost and high-dimensional inputs/outputs limit traditional UQ methods for biofidelic head models.
method Two-stage, data-driven manifold learning framework using Gaussian kernel-density estimation, diffusion maps, and Grassmannian diffusion maps.
result Surrogate models reduce computational cost while providing highly accurate approximations of the computational model.
The inputs of deep neural network (DNN) from real-world data usually come with uncertainties. Yet, it is challenging to propagate the uncertainty in the input features to the DNN predictions at a low computational cost. This work employs a gradient-based subspace method and response surface technique to accelerate the …
Improved VAE model enhances uncertainty estimation for out-of-distribution samples.
problem VAEs assign higher likelihood to out-of-distribution inputs.
method INCPVAE integrates noise contrastive prior into VAEs for reliable uncertainty estimation.
result INCPVAE outperforms standard VAEs in uncertainty estimation for OOD inputs.
Unified method for balancing simulation and data collection.
problem Finding optimal solutions with uncertain inputs.
method Bayesian Information Collection and Optimisation (BICO) procedure.
result Algorithm automatically determines optimal balance between optimisation and data collection.
New methods improve uncertainty explanations for models.
problem Improving interpretation of uncertainty estimates from probabilistic models.
method Developed new methods to generate diverse and global explanations for uncertain model predictions.
result Generated diverse and global explanations for uncertain model predictions, addressing previous limitations.
Safety evaluation of self-driving technologies has been extensively studied. One recent approach uses Monte Carlo based evaluation to estimate the occurrence probabilities of safety-critical events as safety measures. These Monte Carlo samples are generated from stochastic input models constructed based on real-world d…
Δ-UQ uses anchoring to estimate uncertainty in models.
problem Estimating uncertainty in predictive models.
method Anchoring input into a tuple for uncertainty estimation.
result Δ-UQ outperforms baselines in various use-cases.
PCENet reduces uncertainty in high-dimensional data efficiently.
problem Uncertainty quantification in high-dimensional data is computationally expensive.
method Two-stage learning process: variational autoencoder for low-dimensional representation, polynomial chaos expansion for mapping.
result Model captures system dynamics, learns under uncertainty, estimates high-dimensional data uncertainty, matches output distribution moments.
Bayesian Gaussian process models handle uncertain data locations in PDE approximations.
problem Handling uncertainties in data locations for PDE approximations.
method Bayesian inference of uncertain inputs integrated into Gaussian process predictions.
result Substantial reduction in predictive uncertainties achieved through Bayesian inference.
Bayesian framework predicts aerodynamic uncertainty from sparse measurements.
problem Calibrating aerodynamic models with sparse and uncertain measurements.
method Bayesian latent Gaussian process for surrogate model calibration.
result Calibrated surrogate model accurately predicts aerodynamic uncertainty.
New framework calibrates computer models using deep learning and quantile regression.
problem Uncertainty in computer model input parameters due to high-dimensional time series data.
method Deep neural network with long-short term memory layers for inverse modeling, quantile regression for interval predictions.
result Accurate point and interval estimates for input parameters in WRF-hydro model.
Paper introduces uncertainty injection for deep learning robust optimization.
problem Uncertainty in input data affects deep learning model performance in optimization problems.
method Uncertainty injection scheme for training deep learning models to produce robust solutions.
result Proposed scheme improves robustness of solutions in wireless communications applications.
Develops a framework to quantify uncertainties in multiple ML models.
problem Uncertainty in ML model predictions and model inputs.
method Develops a theoretical framework to decouple and transform uncertainties.
result Generates joint distribution of ML predictions considering uncertainties.
The ACCRU framework improves probabilistic forecasts by capturing input-dependent uncertainty.
problem Uncertainty in deterministic predictions, especially for skewed and non-Gaussian errors.
method Neural network trained with a loss function balancing accuracy and reliability to learn input-dependent, non-Gaussian uncertainty distributions.
result Improves probabilistic forecasts relative to existing methods, capturing skewed and non-Gaussian errors.
Work proposes a new framework to improve uncertainty estimation in deep Bayesian models.
problem Traditional training procedures underestimate uncertainty in NLMs, leading to unreliable predictions.
method Introduces a novel training framework that captures useful predictive uncertainties for out-of-distribution inputs.
result Demonstrates that traditional methods for NLMs significantly underestimate uncertainty and propose a new framework to address this issue.
We present a learning theory for the training of a linear system operator having an input compositional variable and propose a Bayesian inversion method for inferring the unknown variable from an output of a noisy linear system. We assume that we have partial or even no knowledge of the operator but have training data …
The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often based on the variation in predictions produced by a diverse ensemble of models …
Proposes a new deep learning model for uncertainty quantification and propagation.
problem High-dimensional uncertainty quantification and propagation problems.
method Integrates U-net with Gaussian Gated Linear Network (GGLN) to create GLU-net.
result Less complex architecture with 44% fewer parameters than existing models.
Paper uses PCE to quantify ML model and input uncertainties.
problem Accurately quantify and propagate combined uncertainties in ML predictions.
method Polynomial Chaos Expansion (PCE) for joint input and model uncertainty.
result Efficient and accurate calculation of output variability and sensitivity.
Proposes a method to identify critical regions in neural networks using adversarial attacks.
problem Capturing uncertainty in neural networks near decision boundaries.
method Adversarial attack method to derive uncertainty from input perturbations.
result The proposed method outperforms other uncertainty methods in capturing model uncertainty.
Bayesian neural networks simplified with input augmentation.
problem Uncertainty in deep learning models.
method Layer-wise input augmentation to induce uncertainty distributions.
result State-of-the-art performance in uncertainty representation.
Detects unusual inputs to neural networks to prevent flawed predictions.
problem Erratic predictions from neural networks on unexpected inputs.
method Evaluates input unusualness by comparing its content to learned parameters.
result Simple, effective method for comparing input metrics across different scales.
Model predicts composite structures assembly quality with input uncertainty.
problem Accurate prediction of dimensional deviations and residual stress in composite structures assembly.
method Neural Network Gaussian Process considering input uncertainty.
result NNGPIU model outperforms other methods for nonsmooth, nonlinear responses.
Rate-In dynamically adjusts dropout rates during inference to improve uncertainty estimation in neural networks.
problem Static dropout rates lead to suboptimal uncertainty estimates in neural networks.
method Rate-In dynamically adjusts dropout rates using information-theoretic principles.
result Rate-In improves calibration and sharpens uncertainty estimates compared to fixed or heuristic dropout rates.
Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This requires a system to reason about its own uncertainty given unfamiliar, out-of-distrib…
Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though a large class of such tools currently exists, most assume that predictions are p…
The paper quantifies and attributes uncertainty in complex system simulations.
problem Uncertainty in complex system simulations due to unknown or approximated subprocesses.
method Developed a framework for quantifying and attributing submodel uncertainty using bootstrapping, Bayesian model averaging, and tree-based methods.
result Individual submodels contribute to overall uncertainty, and their importance can be quantified.
OMADA improves uncertainty calibration for deep networks.
problem Challenges in reliably quantifying uncertainty for modern deep networks.
method On-Manifold Adversarial Data Augmentation (OMADA) using latent space adversarial attacks.
result OMADA consistently yields more accurate and better calibrated classifiers than baseline models.
Tree-based ensemble methods, as Random Forests and Gradient Boosted Trees, have been successfully used for regression in many applications and research studies. Furthermore, these methods have been extended in order to deal with uncertainty in the output variable, using for example a quantile loss in Random Forests (Me…
Study finds uncertainty estimators weakly correlate with LLM hallucinations.
problem Characterizing the relationship between uncertainty estimators and LLM hallucinations.
method Systematic empirical study of diverse uncertainty estimators across hallucination types and benchmarks.
result Uncertainty estimators weakly correlate with LLM hallucinations, depending on hallucination type and LLM.
A method constructs a stochastic surrogate from dimensionality reduction results for high-dimensional uncertainty quantification.
problem High-dimensional uncertainty quantification with physics-based models.
method Constructs a stochastic surrogate model from dimensionality reduction results.
result Preserves convenience of sequential dimensionality reduction and Gaussian process regression while overcoming limitations.
Proposes a method to quantify and explain deep learning model uncertainties.
problem Deep learning model predictions are sensitive to perturbations and adversarial attacks.
method Gradient-based uncertainty attribution method to identify problematic regions and propose mitigation strategies.
result Proposed UA-Backprop method achieves competitive accuracy and efficiency compared to existing methods.
New method certifies neural network robustness to random input noise.
problem Certifying neural networks' robustness to random input noise.
method Chance-constrained optimization problem reformulated using input-output samples.
result Certifies a uniform infinity-norm uncertainty region with a radius 50 times larger.
AIRBO optimizes robustly under uncertain inputs.
problem Challenges in Bayesian Optimization due to input uncertainty.
method AIRBO models arbitrary input uncertainty with MMD and accelerates posterior inference.
result AIRBO achieves state-of-the-art performance under various input uncertainties.