Bayesian neural network models improve uncertainty quantification in multivariate regression.
problem Uncertainty quantification in multivariate regression models with heteroscedastic noise.
method Proposes Bayesian Last Layer neural network models and EM algorithms for parameter learning.
result Capable of disentangling aleatoric and epistemic uncertainty.
New BNN architectures reduce computational cost for uncertainty quantification.
problem High computational cost in Bayesian neural networks.
method Partial trace-class Bayesian neural networks (PaTraC BNNs).
result Comparable uncertainty quantification with fewer parameters.
Develops a framework for inferring causal relationships in networked data with uncertainty quantification.
problem Extracting reliable inference from complex Hawkes network data with uncertainty.
method Statistical inference framework based on maximum likelihood estimation and concentration inequalities of continuous-time martingales.
result Provides a non-asymptotic confidence set for uncertainty quantification.
Fortuna simplifies uncertainty quantification in deep learning.
problem Improving uncertainty estimates in deep learning models.
method Supports various calibration techniques including conformal prediction and scalable Bayesian inference.
result Simplifies benchmarking and builds robust AI systems.
Quantification is a supervised learning task that consists in predicting, given a set of classes C and a set D of unlabelled items, the prevalence (or relative frequency) p(c|D) of each class c in C. Quantification can in principle be solved by classifying all the unlabelled items and counting how many of them have bee…
HistNetQ improves quantification tasks by optimizing loss functions and eliminating label requirements.
problem Quantification of class prevalence in bags of examples.
method Permutation-invariant Histograms and deep neural networks.
result HistNetQ outperforms other quantification methods and optimizes custom loss functions.
SVGP KAN integrates uncertainty quantification into Kolmogorov-Arnold networks.
problem Uncertainty quantification in scientific machine learning models.
method Sparse variational Gaussian process inference with Kolmogorov-Arnold topology.
result Demonstrated ability to distinguish aleatoric and epistemic uncertainty in various scientific applications.
Efficiently quantifies uncertainty in subsurface flow using neural networks guided by theory.
problem Uncertainty in dynamic subsurface flow predictions.
method Theory-guided Neural Network (TgNN) for efficient uncertainty quantification.
result TgNN surrogate improves efficiency of uncertainty quantification compared to MC method.
NCP improves deep classifier uncertainty quantification efficiency.
problem Uncertainty quantification for deep classifiers in high-stake applications.
method Neighborhood Conformal Prediction (NCP) algorithm.
result NCP produces smaller prediction sets than traditional CP methods.
Paper improves uncertainty quantification in PINNs using error bounds and solution bundles.
problem Uncertainty quantification in PINNs for differential equation systems.
method Two-step procedure with Bayesian Neural Networks and heteroscedastic variance.
result Improved uncertainty estimation over PINNs solutions in differential equation systems.
A new method reduces complexity and uncertainty in neural networks.
problem Uncertainty quantification in complex neural networks.
method Condensed Stein Variational Gradient Descent (cSVGD) method.
result Condensed SVGD provides uncertainty quantification on parameters.
A novel capsule network model improves surrogate modeling and uncertainty quantification from sparse data.
problem Surrogate modeling and uncertainty quantification of systems from sparse data.
method Adapted Capsule Network (CapsNet) architecture into image-to-image regression encoder-decoder network.
result The proposed approach accurately, efficiently, and robustly predicts responses for arbitrary diffusion fields.
Post-hoc uncertainty quantification improves on pre-trained neural networks without underfitting.
problem Uncertainty quantification in neural networks is underfitting or computationally demanding.
method Gaussian Process Activation function (GAPA) for neuron-level uncertainty, with two methods: GAPA-Free and GAPA-Variational.
result GAPA-Variational outperforms Laplace approximation on most datasets in uncertainty quantification metrics.
TOQ-Nets learn to recognize complex temporal events with varying objects and sequences.
problem Recognizing complex relational-temporal events with varying numbers of objects and sequence lengths.
method Neuro-symbolic networks with reasoning layers for finite-domain quantification over objects and time.
result TOQ-Nets can generalize to scenarios with more objects than training data and temporal warpings.
PE-GQNN improves spatial data prediction and uncertainty quantification.
problem Poor calibration of predictive distributions in spatial data models.
method Combines PE-GNNs with Quantile Neural Networks and recalibration techniques.
result PE-GQNN outperforms existing methods in predictive accuracy and uncertainty quantification.
This paper connects noise injection to Bayesian inference for neural networks, improving model uncertainty.
problem Improving the reliability and confidence of neural network predictions through uncertainty quantification.
method Introducing noise into neural network parameters during training and inference to estimate prediction uncertainty.
result The MCNI method outperforms baseline models in regression and classification tasks.
CUQ-GNN adapts uncertainty quantification for graph data, improving on GPN.
problem Defining meaningful uncertainty on graph data with domain-specific characteristics.
method Combines Graph Neural Networks with Posterior Networks using Normalizing Flows.
result CUQ-GNN produces more flexible and effective uncertainty estimates.
Combines neural networks with variational inference for better uncertainty quantification.
problem Overconfident predictions from traditional neural networks and time-consuming Bayesian optimization.
method VIFO (Variational Inference on the Final-Layer Output) using neural networks to learn mean and variance.
result VIFO provides a good tradeoff in run time and uncertainty quantification, especially for out of distribution data.
Morse neural networks improve uncertainty quantification and detection.
problem Uncertainty quantification and out-of-distribution detection.
method Generalizes unnormalized Gaussian densities to high-dimensional submanifolds using KL-divergence loss.
result Unified approach for OOD detection, anomaly detection, and continuous learning.
New method for PINNs uncertainty quantification without prior distribution.
problem Lack of reliable uncertainty quantification for PINNs.
method Extended fiducial inference with narrow-neck hyper-network.
result Construction of honest confidence sets based on observed data.
This work investigates training infinite mixtures with maximum likelihood for improved uncertainty quantification.
problem Improving uncertainty quantification in neural networks.
method Investigates training infinite mixtures with maximum likelihood instead of variational inference.
result The proposed method leads to stochastic networks with increased predictive variance, improved robustness, and higher entropy on out-of-distribution data.
Bayesian neural networks struggle with accuracy and uncertainty quantification in complex models.
problem Challenges in achieving high predictive performance and reliable uncertainty estimates in Bayesian neural networks.
method Investigates computational costs, accuracy, and uncertainty quantification in Bayesian neural networks with different inference techniques.
result Variational inference provides better uncertainty quantification than Markov chain Monte Carlo, and stacking/ensembling variational approximations can achieve similar accuracy at reduced cost.
The paper improves uncertainty quantification for node classification using distance-based regularization.
problem Uncertainty in deep learning models, especially for node classification tasks.
method Graph posterior networks (GPNs) with UCE loss function, followed by a distance-based regularization.
result The proposed distance-based regularization outperforms state-of-the-art methods in OOD detection and misclassification detection.
Bayesian deep learning tackles uncertainty in high-dimensional systems.
problem Uncertainty quantification in high-dimensional stochastic partial differential equations.
method Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC) for efficient sampling of posterior distributions.
result The method efficiently handles high-dimensional problems with almost independent computational cost.
New method for neural network uncertainty quantification using empirical Neural Tangent Kernel.
problem Accurately quantify uncertainty in neural network predictions.
method Post-hoc, sampling-based approach using gradient-descent on linearized networks.
result Method effectively approximates Gaussian process posterior and outperforms existing methods in efficiency and accuracy.
SON learns SPDE solutions and uncertainty from noisy data.
problem Uncertainty quantification in SPDEs with unknown model uncertainties.
method Combining DeepONet and SNNs, SON models stochasticity and predicts uncertainty.
result SON accurately captures solution structure and quantifies predictive uncertainty.
Neural networks simplify uncertainty quantification of locally nonlinear systems.
problem Estimating statistics of responses in large-scale locally nonlinear dynamical systems.
method Decomposes response into nominal linear system and a neural network-estimated pseudoforce.
result Neural networks can efficiently estimate pseudoforce containing nonlinear and uncertain information.
Proposes a method to quantify uncertainty in PFNs.
problem Lack of uncertainty quantification in PFNs.
method Martingale posteriors for efficient, tuning-free sampling.
result Proves convergence of proposed sampling procedure.
RegVar quantifies uncertainty in deep learning networks by measuring sensitivity to regularization.
problem Uncertainty quantification in deep learning networks, especially for large networks.
method RegVar method based on variation due to regularization, implemented during fine-tuning phase.
result RegVar provides rigorous uncertainty estimates that recover Bayesian deep learning approximations.
BSG learns dynamic network spillovers and uncertainty quantification.
problem Identifying indirect spillovers and systemic risk in dynamic networks.
method Bayesian Spillover Graphs using FEVD and Bayesian time series models.
result Significant performance gains over baselines in identifying source and sink nodes.
We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since normal neural netwo…
Improved neural network ensembles using Stein Variational Newton updates.
problem Lack of efficient second-order information in current ensemble methods.
method Proposes a novel approximate Bayesian inference method integrating Stein Variational Newton updates with scalable Hessian approximations.
result Significantly faster convergence and more accurate posterior distribution approximations.
Survey and framework for consistent uncertainty quantification in deep learning.
problem Partial uncertainty coverage and inconsistencies in deep learning uncertainty quantification.
method Bayes' theorem and conditional probability densities applied to all major sources of uncertainty.
result Improved robustness and reliability of neural network predictions in real-world scenarios.
ABNN converts pre-trained DNNs into BNNs for reliable uncertainty quantification.
problem Uncertainty quantification in deep neural networks (DNNs) is challenging and critical for real-world applications.
method Adaptable Bayesian Neural Network (ABNN) that transforms pre-trained DNNs into BNNs with minimal overhead.
result ABNN achieves state-of-the-art performance in image classification and semantic segmentation tasks.
The paper introduces a method to quantify uncertainty in neural networks without parametric assumptions.
problem Uncertainty quantification for neural network predictions.
method Nonparametric estimation of conditional label distribution using Nadaraya-Watson kernel.
result The method effectively disentangles aleatoric and epistemic uncertainties.
CP-ROC bands improve graph classification accuracy and uncertainty quantification.
problem Uncertainty quantification and robustness to distributional shifts in graph classification.
method Conditional Prediction ROC (CP-ROC) bands for graph classification, developed for TGNNs and adaptable to GNNs.
result Statistically guaranteed coverage for CP-ROC under local exchangeability condition, improving prediction reliability.
USNRT uses tree-structured learning to improve uncertainty quantification of variance networks.
problem Improving uncertainty quantification of variance networks.
method Tree-structured local neural network model that partitions feature space into regions for training region-specific neural networks to predict mean and variance.
result USNRT shows superior performance in estimating uncertainty with variances on UCI datasets compared to recent methods.
The vulnerability to adversarial attacks has been a critical issue for deep neural networks. Addressing this issue requires a reliable way to evaluate the robustness of a network. Recently, several methods have been developed to compute robustness quantification for neural networks, namely, certified lower b…
FNNs can be made more interpretable with statistical methods.
problem FNNs lack interpretability and are often used as black-box models.
method Supplement FNNs with statistical inference and covariate-effect visualizations.
result FNNs can be made more like traditional statistical models.
A new method reduces Volterra kernel complexity and uncertainty quantification.
problem Challenges in modeling nonlinear systems with Volterra series due to high model order.
method Bayesian Tensor Network Volterra kernel machines (BTN-V) using canonical polyadic decomposition.
result Competitive accuracy, enhanced uncertainty quantification, and reduced computational cost.
Wasserstein Dropout improves uncertainty estimation in neural networks.
problem Estimating neural uncertainties for safe machine learning.
method A purely non-parametric approach using dropout-based sub-network distributions and Wasserstein distance.
result Wasserstein Dropout outperforms state-of-the-art methods in uncertainty estimation.
RAFs Ensemble improves neural network uncertainty quantification.
problem Inaccurate predictions in out-of-distribution data.
method Proposes RAFs Ensemble, using random activation functions in neural networks.
result RAFs Ensemble outperforms state-of-the-art methods in uncertainty quantification.
New method uses backward SDEs for deep learning uncertainty.
problem Uncertainty quantification in deep learning models.
method Probabilistic machine learning with stochastic neural networks and stochastic optimal control.
result Effectiveness validated through numerical experiments.
RP-WNO extends WNO with uncertainty quantification, useful for scientists and engineers.
problem Uncertainty in predictions of deep learning models.
method Randomized Prior Wavelet Neural Operator (RP-WNO) with uncertainty quantification module.
result RP-WNO effectively estimates uncertainty in predictions.
Single neural networks can match deep ensembles' benefits without the complexity.
problem The effectiveness and necessity of deep ensembles in neural network models.
method Demonstrated limitations of ensemble diversity and OOD performance in deep ensembles compared to a single larger model.
result A single neural network can replicate deep ensembles' benefits in uncertainty quantification and robustness.
DeepONets combine neural networks with physics constraints for PDEs and parameter estimation.
problem Estimating parameters in PDEs with uncertainty quantification.
method Physics-informed neural networks (PINNs) integrated with Deep Operator Networks (DeepONets) for Bayesian inference.
result Robust and accurate solutions with comprehensive uncertainty quantification.
Paper defines and quantifies safety risks in deep neural networks.
problem Safety concerns in deep neural networks applied to critical sectors.
method Defines safety property, computes maximum safe radius, identifies new risk class, develops algorithm.
result Method achieves competitive performance in safety quantification.
MixupMP improves uncertainty quantification in neural networks using data augmentation.
problem Uncertainty quantification in deep learning models.
method MixupMP constructs a more realistic predictive distribution using data augmentation techniques.
result MixupMP achieves superior predictive performance and uncertainty quantification on various image classification datasets.