This paper connects noise injection to Bayesian inference for neural networks, improving model uncertainty.
problem Improving the reliability and confidence of neural network predictions through uncertainty quantification.
method Introducing noise into neural network parameters during training and inference to estimate prediction uncertainty.
result The MCNI method outperforms baseline models in regression and classification tasks.
Paper introduces uncertainty injection for deep learning robust optimization.
problem Uncertainty in input data affects deep learning model performance in optimization problems.
method Uncertainty injection scheme for training deep learning models to produce robust solutions.
result Proposed scheme improves robustness of solutions in wireless communications applications.
The paper optimizes insurer's decisions on dividends, reinsurance, and capital injection under model uncertainty.
problem Maximizing insurer's expected discounted dividends while managing model uncertainty and risk.
method Modeling reserve levels as diffusion processes, solving for optimal strategies in closed form.
result Optimal strategies include barrier dividend and capital injection policies.
We propose a feed-forward inference method applicable to belief and neural networks. In a belief network, the method estimates an approximate factorized posterior of all hidden units given the input. In neural networks the method propagates uncertainty of the input through all the layers. In neural networks with inject…
No-regret optimization for time-varying functions using uncertainty injection.
problem Optimizing time-varying functions with no-regret in bandit feedback.
method W-SparQ-GP-UCB, incorporating uncertainty injection and additional queries.
result Achieves no-regret with a vanishing number of additional queries per iteration.
We present a sampling-free approach for computing the epistemic uncertainty of a neural network. Epistemic uncertainty is an important quantity for the deployment of deep neural networks in safety-critical applications, since it represents how much one can trust predictions on new data. Recently promising works were pr…
Flexible VAEs using FIFs improve model likelihood on image datasets.
problem Limitations of diagonal Gaussian posteriors in VAEs.
method Regularized Free-form Injective Flow (FIF) for flexible posterior.
result Full covariance VAEs outperform diagonal Gaussian posteriors.
FA-LD algorithm improves uncertainty quantification and mean predictions in federated learning.
problem Uncertainty quantification and mean predictions in federated learning with distributed clients.
method FA-LD algorithm for strongly log-concave distributions with non-i.i.d data, considering general models.
result The FA-LD algorithm provides theoretical guarantees for convergence and optimal noise injection.
New method reduces uncertainty in deep neural networks with minimal computation.
problem Uncertainty in over-parameterized neural networks hinders reliability and statistical guarantees.
method Procedural-noise-correcting (PNC) predictor and resampling methods.
result Asymptotically exact-coverage confidence intervals constructed with minimal computation.
VGE provides a practical approach to uncertainty estimation in ensemble models.
problem Uncertainty estimation in ensemble models using additive decomposition breaks down.
method Variance-Gated Ensembles (VGE) introduces a differentiable framework with a signal-to-noise gate.
result VGE provides a Variance-Gated Margin Uncertainty (VGMU) score and Variance-Gated Normalization (VGN) layer.
UBMF tackles fault diagnosis in imbalanced industrial data with enhanced accuracy and adaptability.
problem Fault diagnosis challenges in imbalanced industrial data.
method Integrates four key modules: data perturbation, cross-task feature extraction, uncertainty-based filtering, and Bayesian meta-knowledge integration.
result Achieves an average improvement of 42.22% across ten diagnostic tasks.
Spatial processes with nonstationary and anisotropic covariance structure are often used when modelling, analysing and predicting complex environmental phenomena. Such processes may often be expressed as ones that have stationary and isotropic covariance structure on a warped spatial domain. However, the warping functi…
Cross-regularization adapts model complexity during training.
problem Manual tuning of model complexity for overfitting prevention.
method Directly adapts regularization parameters through validation gradients during training.
result Organic emergence of architecture-specific regularization during training.
Neural Bootstrapper reduces bootstrapping cost for deep neural networks.
problem Computational burden in bootstrapping deep neural networks.
method Neural Bootstrapper learns to generate bootstrapped neural networks through single model training.
result Neural Bootstrapper outperforms bagging methods with lower computational cost.
Researchers use GANs to infer physics-based inverse problems, quantifying uncertainty and promoting generalizability.
problem Quantifying uncertainty in physics-based inverse problems.
method Trained conditional Wasserstein GANs with U-Net architecture and conditional instance normalization.
result The approach effectively samples from the posterior and promotes generalizability with out-of-distribution samples.
This paper proposes a deep neural network approach for predicting multiphase flow in heterogeneous domains with high computational efficiency. The deep neural network model is able to handle permeability heterogeneity in high dimensional systems, and can learn the interplay of viscous, gravity, and capillary forces fro…
DIN framework directly models hydraulic conductivity and uncertainty.
problem Modeling hydraulic conductivity and uncertainty in groundwater flow.
method DIN utilizes DDPM as a prior learner, incorporating observational data through conditional injection mechanisms.
result DIN generates multiple constraint-satisfying realizations and accurate uncertainty quantification.
Rate-In dynamically adjusts dropout rates during inference to improve uncertainty estimation in neural networks.
problem Static dropout rates lead to suboptimal uncertainty estimates in neural networks.
method Rate-In dynamically adjusts dropout rates using information-theoretic principles.
result Rate-In improves calibration and sharpens uncertainty estimates compared to fixed or heuristic dropout rates.
VCoTTA uses variational Bayesian methods to adapt models under continuous domain shifts.
problem Error accumulation in continual test-time adaptation.
method VCoTTA employs variational Bayesian techniques to update a Bayesian Neural Network (BNN) during testing, combining priors from source and teacher models.
result VCoTTA effectively mitigates error accumulation in CTTA, as shown by experimental results on three datasets.
Injectivity of ReLU networks is characterized for generative models and inverse problems.
problem Injectivity in ReLU networks for generative models and inverse problems.
method Layerwise analysis, worst-case Lipschitz constants, differential topology, random projections.
result Global injectivity of ReLU networks requires expansivity between 3.4 and 10.5 for Gaussian matrices.
FCNv2 robustness tested under noise and random initial conditions.
problem Assessing AI weather forecasting model robustness to input noise.
method Two experiments with varying noise levels and random initial conditions.
result FCNv2 preserves hurricane features under low to moderate noise, but underestimates intensity and persistence.
Classifies π1-injective maps between non-compact surfaces.
problem Characterizing maps with injective fundamental groups.
method Proper homotopy classification of maps.
result All π1-injective proper maps are classified. Positive injectivity radius for manifolds with Lie structure at infinity.
problem Injectivity radius positivity for manifolds with specific boundary conditions.
method Lie groupoids to prove injectivity radius positivity.
result Injectivity radius is positive for manifolds with Lie structure at infinity.
Geometric analysis improves noise injection in GANs.
problem Unclear mechanism of noise injection in GANs.
method Geometric framework based on Riemannian geometry.
result A new strategy for noise injection is devised.
Optimal design portfolios improve energy efficiency and reduce risk in uncertain reservoirs.
problem Uncertain reservoir conditions lead to unstable gas recovery and low resource efficiency.
method Developed optimal portfolios of well designs based on reservoir conditions and probabilities.
result Remarkable reduction in variation and substantial increase in energy efficiency achieved.
The paper analyzes optimal dividend and capital injection strategies under time-inconsistent preferences.
problem Optimal dividend and capital injection strategies under time-inconsistent preferences.
method Diffusion risk model with general discount functions, weak equilibrium definition, HJB equation system.
result Explicit solutions and threshold types of optimal strategies derived under different discount functions.
A quasi-geodesic is Morse if and only if it is strongly contracting in injective spaces.
problem Characterizing Morse quasi-geodesics in injective spaces.
method Proving equivalence between Morse and strongly contracting quasi-geodesics.
result Injective metric spaces have the Morse local-to-global property and acylindrically hyperbolic groups with Morse elements.
Compact theorem for minimal surfaces with lower injectivity radius.
problem Proving compactness of minimal surfaces with lower injectivity radius.
method Variant of Choi--Schoen compactness theorem, focusing on injectivity radius.
result Proved compactness theorem for minimal surfaces.
Lecture notes on group actions on injective spaces and Helly graphs.
problem Understanding group actions on specific metric spaces.
method Review of injective metric spaces and Helly graphs, elementary properties, constructions, and exercises.
result Presentation of various constructions of injective metric spaces and Helly graphs with interesting group actions.
Proves polynomial injectivity of Fubini-Study map for ample line bundles.
problem Injectivity of Fubini-Study map for ample line bundles.
method Polynomial injectivity proof with polynomial dependence on ample line bundle exponent.
result Quantitative version of injectivity proved, polynomial in ample line bundle exponent.
Lower bound on boundary injectivity radius for specific tubes.
problem Estimating the boundary injectivity radius of Margulis tubes.
method Using curvature bounds to derive a lower bound.
result A lower bound on the boundary injectivity radius is provided.
Reservoir subspace injection improves online ICA by preserving injected features.
problem Discarding injected features in top-n whitening can degrade performance. method Formalized reservoir subspace injection (RSI) and developed diagnostics (IER, SSO, ρ_x) to identify and mitigate the failure mode.
result RSI controller preserves passthrough retention, improving performance by up to 2.2 dB.
Injective and surjective neural operators for function spaces.
problem Tackles injective and surjective neural operators in function spaces.
method Combines prior work in ReLU and operator learning, uses Fredholm theory and Leray-Schauder degree theory.
result Injective and surjective neural operators are universal approximators and maintain their properties in finite-rank implementations.
Proposes a method to enhance graph models by injecting unseen connections.
problem Enhancing graph models to utilize unseen connections.
method Parametric link injection layer to find and inject weak connections.
result Improves performance on node classification and link prediction tasks.
The paper proves that certain spaces are injective and Helly graphs.
problem Understanding the structure of certain geometric and algebraic spaces.
method Building Helly graphs and injective metric spaces from lattices.
result The natural piecewise ℓ∞ metric on Euclidean buildings and Deligne complexes is injective. Smooths metrics on manifolds with curvature bounds and injectivity radius constraints.
problem Smooth metrics on manifolds with curvature and injectivity constraints.
method Bi-Lipschitz smoothing with controlled smoothing and volume lower bounds.
result Proves existence of smooth metrics with curvature bounds and injectivity radius constraints.
Nonuniform tubular neighborhoods of curves in Euclidean n-space are studied by using weighted distance functions and generalizing the normal exponential map. Different notions of injectivity radii are introduced to investigate singular but injective exponential maps. A generalization of the thickness formula is obtaine…
Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals while still allowing modelers to draw insights from data by estimating regressio…
In this paper, we obtain two-sided bounds for the volumes of the Aloff-Wallach spaces W(p,q), compute maximal and minimal sectional curvature for the spaces W(n,n+1), and use this information to estimate the injectivity radii: We derive an upper bound for the injectivity radii of W(p,q) and a lower bound for the …
Injectivity of geodesic ray transform on specific Finsler manifolds proven.
problem Injectivity of geodesic ray transform on spherically symmetric reversible Finsler manifolds.
method Reduction to invertibility of generalized Abel transforms using angular Fourier series and Taylor expansions of geodesics.
result Injectivity of geodesic ray transform proven on specified Finsler manifolds.
Noise Injection probes deep learning dynamics during training phases.
problem Understanding the learning mechanism of deep neural networks.
method Noise Injection Nodes (NINs) are used to perturb DNN architectures without altering the optimization algorithm.
result Distinct training phases are observed based on the scale of injected noise.
Enformer and GEnformer use Transformers with stochastic learning to forecast multivariate and spatiotemporal data with uncertainty.
problem Uncertainty quantification in multivariate time series and spatiotemporal forecasting.
method Synthesizing Transformer's expressive power with stochastic learning to model conditional distributions directly.
result Enformer and GEnformer yield calibrated probabilistic forecasts and outperform state-of-the-art baselines.
A new method decomposes Bayesian uncertainty into per-class contributions for safer classification.
problem Bayesian uncertainty metrics fail to distinguish between safe and critical classes in safety-critical classification tasks.
method Decomposes mutual information into per-class contributions using a second-order Taylor expansion and a weighting correction.
result The per-class uncertainty vector Ck reduces selective risk and improves out-of-distribution detection compared to traditional metrics. Decomposes epistemic uncertainty into per-class contributions for safer classification.
problem Asymmetric costs in safety-critical classification.
method Decomposes mutual information into per-class vector Ck using second-order Taylor expansion. result Decomposition improves selective risk by 34.7% and 56.2% over existing metrics.
Generalizes a soul-bound for noncompact Alexandrov spaces.
problem Finding a lower bound for injectivity radius in Alexandrov spaces.
method Introduces the soul of Alexandrov spaces and applies a generalized bound.
result Injectivity radius is at least πK⁻¹/² if not equal to the soul's.
A labeled oriented tree is called injective if each generator occurs at most once as an edge label. We show that injective labeled oriented trees are aspherical. The proof relies on a new relative asphericity test based on a lemma of Stallings.
Optimal control problem for firm cash flow with dividend and capital injection strategies.
problem Maximizing dividends while managing capital injections in a firm's cash flow.
method Proved two optimal strategies: mean-reverting dividends with capital injections or no injections until ruin.
result Optimal strategies are dichotomous: either mean-reverting dividends with injections or no injections.
The exponential map fails to be injective near critical points in sub-Riemannian geometry.
problem Injectivity failure of the exponential map at critical points in sub-Riemannian geometry.
method Analysis of the Hilbert invariant integral of the variational problem associated with the sub-Riemannian structure.
result Characterization of conjugate points in terms of metric structure.