Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4999148197 · May 202619922001200920172026
48 results for Intrinsic Uncertainty

Polynomial chaos surrogates handle intrinsic noise in stochastic models.

problem Handling intrinsic noise in stochastic models with parametric uncertainty.
method Developed a PCE surrogate on a joint space of intrinsic and parametric uncertainty using Rosenblatt transformations and Karhunen-Loeve expansion.
result Quantified intrinsic noise contribution to model output variance using PCE Sobol indices.

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration from the intrinsic motivation literature, we use density models to measure uncert…

2016-06-06abs ↗pdf ↗

Study finds multifractal cross-correlations between agricultural markets and external uncertainties.

problem Investigating relationships between agricultural spot markets and external uncertainties.
method Multifractal detrending moving-average cross-correlation analysis (MF-X-DMA).
result Maize exhibits intrinsic joint multifractality with all uncertainty proxies.

When the cost of misclassifying a sample is high, it is useful to have an accurate estimate of uncertainty in the prediction for that sample. There are also multiple types of uncertainty which are best estimated in different ways, for example, uncertainty that is intrinsic to the training set may be well-handled by a B…

2018-10-29abs ↗pdf ↗

Novel framework improves GNN uncertainty estimates under distribution shifts.

problem Improving reliability of GNN uncertainty estimates under distribution shifts.
method Adapting stochastic data centering to graph data through novel graph anchoring strategies.
result G-ΔΔUQ leads to better calibrated GNNs for node and graph classification.

A new multi-objective RL framework improves intrinsic exploration performance.

problem Sub-optimal exploration performance due to ad-hoc handling of intrinsic exploration.
method A multi-objective RL framework where both exploration and exploitation are optimized as separate objectives.
result EMU-Q method outperforms classic and other intrinsic RL methods on benchmarks.

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic" reward. In this work, we focus on model uncertainty estimation as an intrinsic r…

2019-11-19abs ↗pdf ↗

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The first is a decaying schedule to suppress the intrinsic uncertainty. The second …

2019-05-13abs ↗pdf ↗

Study designs steering rewards for MFGs with unknown dynamics and model uncertainty.

problem Designing incentives for large populations of agents in MFGs with uncertain model details.
method Developed optimistic exploration algorithms for agents with no-adaptive regret behaviors.
result Sub-linear regret guarantees for cumulative gaps between agent behaviors and desired outcomes.

A new probabilistic approach improves deep metric learning by considering image uncertainties and class-specific variances.

problem Proxy-based deep metric learning struggles with image uncertainties and class-specific structures.
method Introduces non-isotropic probabilistic proxy-based deep metric learning using directional von Mises-Fisher distributions.
result Improves generalization performance and competitive on standard benchmarks.

Normalizing flows improve ptychography reconstruction quality and uncertainty quantification.

problem Challenges in ptychography due to large-scale nonlinear and non-convex inverse problems and photon statistics.
method Use of normalizing flows to model the posterior distribution and quantify reconstruction uncertainty.
result Normalizing flows enable better characterization and uncertainty quantification in ptychography reconstructions.

Model predicts composite structures assembly quality with input uncertainty.

problem Accurate prediction of dimensional deviations and residual stress in composite structures assembly.
method Neural Network Gaussian Process considering input uncertainty.
result NNGPIU model outperforms other methods for nonsmooth, nonlinear responses.

Study finds uncertainty estimators weakly correlate with LLM hallucinations.

problem Characterizing the relationship between uncertainty estimators and LLM hallucinations.
method Systematic empirical study of diverse uncertainty estimators across hallucination types and benchmarks.
result Uncertainty estimators weakly correlate with LLM hallucinations, depending on hallucination type and LLM.

Characterizes uncertainty in high-dimensional linear classification models.

problem Assessing uncertainty in high-dimensional linear classification models.
method Approximate message passing algorithm for posterior marginals, closed-form formula for joint statistics.
result Closed-form formula for joint statistics between logistic classifier, Bayesian uncertainty, and ground-truth probit uncertainty.

New framework quantifies uncertainties in neural network explanations.

problem Lack of methods to quantify uncertainties in neural network explanations.
method Converts any explanation method into a Bayesian neural network method, modeling uncertainties.
result Allows quantification of explanation uncertainties and appropriate confidence levels.

DEUP directly predicts epistemic uncertainty, improving model optimization and exploration.

problem Existing measures of epistemic uncertainty do not account for model misspecification.
method Proposes a framework to estimate excess risk as a measure of epistemic uncertainty, using a secondary predictor for generalization error.
result DEUP improves sequential model optimization and exploration in interactive learning environments.

Proposes a method to enhance exploration in RL using temporal difference uncertainties.

problem Challenges in estimating uncertainty in non-tabular reinforcement learning settings.
method Estimates uncertainty over value function using temporal difference errors and incorporates it as an intrinsic reward.
result Demonstrates improved exploration in various tasks, including Deep Sea and Atari 2600 environments.

Paper develops a new RL method for MDPs with uncertainty, achieving better regret bounds.

problem Online reinforcement learning in environments with both endogenous and exogenous uncertainty.
method Developed a VB-UCRL algorithm that restarts based on variation schedules.
result Established a regret bound of saving at most S\sqrt{S} or S16T112S^{\frac{1}{6}}T^{\frac{1}{12}}.

New active learning methods for Gaussian process improve predictive modeling of composite fuselage.

problem Improving predictive modeling of composite fuselage with limited training samples and uncertainties.
method Proposed two new active learning algorithms for Gaussian process considering uncertainties.
result The proposed approach realizes better prediction performance for automatic shape control of composite fuselage.

This paper analyzes uncertainty in DFN simulations using sensitivity analysis.

problem Uncertainty in estimating QoI due to epistemic and aleatoric uncertainties in DFN simulations.
method Sensitivity analysis to attribute uncertainty to input parameters and aleatoric uncertainty.
result Characterizes uncertainty in DFN flow simulations with heteroskedastic aleatoric uncertainty.

Proposes a framework to quantify uncertainty in multi-step decision-making by LLMs.

problem Uncertainty quantification in multi-step decision-making scenarios of LLMs.
method A principled, information-theoretic framework decomposing uncertainty into internal and extrinsic components, and proposing UProp for efficient extrinsic uncertainty estimation.
result UProp significantly outperforms existing single-turn UQ baselines in multi-step decision-making benchmarks.

This study examines Gaussian processes on Riemannian manifolds and proves contraction rates.

problem Comparing intrinsic vs. extrinsic Gaussian processes on Riemannian manifolds.
method Proves optimal contraction rates for intrinsic Matérn Gaussian processes on compact Riemannian manifolds.
result Intrinsic Gaussian processes on Riemannian manifolds achieve better performance than extrinsic ones.

TOFU-POV tackles partially observed linear bandits, achieving sublinear regret with low-dimensional action vectors.

problem Stochastic linear bandits with partially observed actions in settings like recommendation and healthcare.
method TOFU-POV estimates latent action subspace, imputes missing actions, and runs OFUL in low-dimensional coordinates.
result TOFU-POV achieves T\sqrt{T} regret scaling with intrinsic subspace dimension, improving upon natural baselines.

The paper introduces isotropy as a regularizer to enhance portfolio stability.

problem Model uncertainty and estimation errors in diversification strategies.
method Integrates isotropy as a geometric regularizer into mean-variance optimization.
result Isotropy constraint systematically induces negative average-signal exposure, providing a robust crash hedge.

We develop methods to efficiently approximate data in metric spaces without additional assumptions.

problem Efficiently approximating data in metric spaces without imposing structural assumptions.
method Identify discrete modulus of continuity, investigate consistency, propose algorithm, and develop approximation theory.
result Consistent approximation of data in metric spaces without structural assumptions.

Variational Bayesian neural nets combine the flexibility of deep learning with Bayesian uncertainty estimation. Unfortunately, there is a tradeoff between cheap but simple variational families (e.g.~fully factorized) or expensive and complicated inference procedures. We show that natural gradient ascent with adaptive w…

2017-12-06abs ↗pdf ↗

Optimal transport improves multivariate prediction uncertainty quantification.

problem Uncertainty quantification in multivariate learning tasks, especially in regression and classification.
method Introducing a novel Conformal Prediction procedure using optimal transport to handle multivariate score functions and construct flexible prediction regions.
result Ensures finite-sample, distribution-free coverage guarantees for multivariate prediction sets.

Bayesian neural networks improve uncertainty calibration without sacrificing accuracy.

problem Bayesian neural networks struggle with uncertainty calibration and high-dimensional geometry.
method Model uncertainty only in weight directions using a von Mises-Fisher posterior on the unit sphere, deriving a compact KL term.
result A lightweight, dimension-aware variational unit improves calibration without sacrificing accuracy.

Bayesian method improves predictions in overparameterized nonlinear regression.

problem Understanding overparameterization in nonlinear regression models.
method Bayesian framework with adaptive prior considering data spectral structure.
result Posterior contraction established for generalized linear and single-neuron models, demonstrating prediction consistency.

Universal AI seeks high-optionality states through empowerment and curiosity.

problem Understanding and optimizing AI behavior in uncertain environments.
method Unified framework combining AIXI and variational empowerment, showing how universal AI agents balance goal-directed behavior with uncertainty reduction curiosity.
result Self-AIXI asymptotically converges to AIXI performance and exhibits power-seeking behavior due to intrinsic motivations.

Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may offer good predictive performances but do not intrinsically provide uncertainty estimates. In contras…

2018-10-24abs ↗pdf ↗

In information theory, Fisher information and Shannon information (entropy) are respectively used to quantify the uncertainty associated with the distribution modeling and the uncertainty in specifying the outcome of given variables. These two quantities are complementary and are jointly applied to information behavior…

2018-07-10abs ↗pdf ↗

Unified Bayesian framework for LTV system identification using neural networks and Gaussian Processes.

problem Identifying Linear Time-Varying systems from input-output data.
method Bayesian modeling of impulse response as a stochastic process, using neural networks and Gaussian Processes for inference.
result Framework can infer LTI system properties from a single noisy input-output pair, achieving lower error than classical methods.