DEUP directly predicts epistemic uncertainty, improving model optimization and exploration.
problem Existing measures of epistemic uncertainty do not account for model misspecification.
method Proposes a framework to estimate excess risk as a measure of epistemic uncertainty, using a secondary predictor for generalization error.
result DEUP improves sequential model optimization and exploration in interactive learning environments.
Defines MER for Bayesian learning, a gap between achievable and optimal performance.
problem Analyzing the best performance of Bayesian learning under generative models.
method Two methods for deriving upper bounds for MER: conditional mutual information and minimum estimation error.
result Quantifies the rate at which MER decays to zero with more data and relates it to model richness.
A new formula reveals symmetries between mean excess and ES functions.
problem Optimizing risk measures in financial models.
method Established a reverse ES optimization formula.
result Reveals elegant symmetries and relationships between mean excess and ES functions.
Study designs steering rewards for MFGs with unknown dynamics and model uncertainty.
problem Designing incentives for large populations of agents in MFGs with uncertain model details.
method Developed optimistic exploration algorithms for agents with no-adaptive regret behaviors.
result Sub-linear regret guarantees for cumulative gaps between agent behaviors and desired outcomes.
Study shows houses appreciated more during pandemic due to speculation, not just price uncertainty.
problem Impact of COVID-19 on house prices and speculation.
method Quasi-experimental design, unit-level matching, multivariate difference-in-difference regression.
result Properties listed for sale appreciated an additional 1% per month after pandemic onset, with an excess annual growth of 12.7 percentage points.
This paper investigates WDRO for nonparametric regression, achieving robustness against distributional uncertainty.
problem Addressing model misspecification in nonparametric regression under distributional uncertainty.
method Wasserstein distributionally robust optimization (WDRO) with structural distinction based on Wasserstein distance order.
result Achieves a convergence rate of n−2β/(d+2β) up to logarithmic factors, showing minimax optimality. The study examines robust decision-making in volatile financial markets, finding action robustness is more impactful than uncertainty tolerance.
problem Sequential decision making in high-frequency markets under evolving uncertainty.
method Analyzes two dimensions of robustness: uncertainty tolerance and action robustness, using simulations and empirical evidence.
result Action robustness has a larger impact on profitability than uncertainty tolerance, and excessive robustness can reduce profitability in illiquid markets.
Linear regression is a classic method of data analysis. In recent years, sketching -- a method of dimension reduction using random sampling, random projections, or both -- has gained popularity as an effective computational approximation when the number of observations greatly exceeds the number of variables. In this p…
Cryptocurrency markets show higher spreads during extreme fear and greed phases.
problem Understanding and predicting liquidity withdrawal in cryptocurrency markets.
method Analysis of Crypto Fear & Greed Index and Bitcoin daily data.
result Extreme fear and greed regimes exhibit significantly higher spreads than neutral periods.
Study analyzes EU in variational inference for Bayesian deep learning.
problem Analyzing epistemic uncertainty in variational inference for Bayesian deep learning.
method Theoretical analysis and derivation of relations between generalization error and EU measurements. Proposing a new objective function for VI.
result Proposed new objective function significantly improves EU evaluation over existing VI methods.
A new method decomposes subjective risk into epistemic and aleatoric uncertainties.
problem Uncertainty quantification in modeling decisions.
method Subjective risk decomposition using strictly proper loss.
result Recovery of classic uncertainty measures and new learning-theoretic connections.
This work tackles uncertainty quantification in language models, proposing a principled approach.
problem Challenges in identifying task-specific uncertainties in large language models.
method Bayesian decision theory, focusing on a similarity measure between generated and hypothetical true responses.
result Derives a measure for epistemic uncertainty based on a missing data perspective.
We develop a model for contagion in reinsurance networks by which primary insurers' losses are spread through the network. Our model handles general reinsurance contracts, such as typical excess of loss contracts. We show that simpler models existing in the literature--namely proportional reinsurance--greatly underesti…
The main objective is to present a some variant of the Black - Litterman model. We consider the canonical case when priori return is determined by means such excess return from the CAPM market portfolio which is derived using reverse optimization method. Then the a priori return is at risk quantified uncertainty. On th…
Classical mean-variance portfolio theory tells us how to construct a portfolio of assets which has the greatest expected return for a given level of return volatility. Utility theory then allows an investor to choose the point along this efficient frontier which optimally balances her desire for excess expected return …
Study optimal reinsurance pricing under model uncertainty for multiple insurers.
problem Optimal reinsurance pricing in the presence of multiple sources of model uncertainty.
method Solves a continuous-time Stackelberg game for general reinsurance contracts, considering entropy penalties and ambiguity in insurers' models.
result Reinsurer prices under a distortion of the barycentre of insurers' models, maximizing expected wealth with an entropy penalty.
fSGLD optimizes deep learning by favoring flat regions in the loss landscape.
problem Understanding and improving the behavior and generalization of deep learning algorithms.
method Flatness-Aware Stochastic Gradient Langevin Dynamics (fSGLD) that biases learning towards flat basins.
result fSGLD targets a flatness-biased Gibbs distribution with explicit excess risk guarantees.
Missing data are a concern in many real world data sets and imputation methods are often needed to estimate the values of missing data, but data sets with excessive missingness and high dimensionality challenge most approaches to imputation. Here we show that appropriate feature selection can be an effective preprocess…
The study quantifies decision-making risks from suboptimal classifiers and proposes methods to reduce these risks.
problem Excess risk in decision-making from suboptimal probabilistic classifiers.
method Analytical expressions and upper/lower bounds for excess risk, calibration curve estimation, grouping loss estimator.
result Identifies regimes where recalibration alone or post-training is more effective.
A new method optimizes robustness measures under input uncertainty using randomized Gaussian process upper confidence bound.
problem Optimizing robustness measures under input uncertainty.
method Randomized robustness measure GP-UCB (RRGP-UCB) that samples β from a chi-squared-based distribution.
result RRGP-UCB provides tight bounds on expected regret.
Study validates ML-UQ calibration statistics using simulated reference values.
problem Validation of ML-UQ calibration statistics is lacking due to lack of predefined reference values.
method Proposed validation workflow using simulated reference values derived from synthetic datasets.
result Some statistics, like CC and ENCE, are overly sensitive to generative distribution choice.
A flexible machine learning model infers the morphology of the Galactic Center Excess.
problem Inferring the unknown morphology of the Galactic Center Excess using Fermi gamma-ray data.
method Used a Gaussian process (GP) to model the Galactic Center Excess (GCE) as a flexible, non-parametric machine learning model.
result The best-fit GP contains morphological features not typically associated with traditional GCE studies, such as a localized bright source and a diagonal arm.
We investigate the impact of Knightian uncertainty on the optimal timing policy of an ambiguity averse decision maker in the case where the underlying factor dynamics follow a multidimensional Brownian motion and the exercise payoff depends on either a linear combination of the factors or the radial part of the driving…
Since exchange economy considerably varies in the market assets, asset prices have become an attractive research area for investigating and modeling ambiguous and uncertain information in today markets. This paper proposes a new generative uncertainty mechanism based on the Bayesian Inference and Correntropy (BIC) tech…
A new method improves policy evaluation in RL by tracking value uncertainties.
problem Limitations in existing policy evaluation methods for deep RL tasks.
method KOVA (Kalman Optimization for Value Approximation) based on extended Kalman filter.
result KOVA minimizes a regularized objective function that considers parameter and noisy return uncertainties.
Optimal insurance contracts are designed to screen risk preferences and risk types under asymmetric information.
problem Designing optimal insurance contracts under asymmetric information and risk types.
method Constructing a menu of contracts that maximizes mean-variance utilities, subject to truth-telling constraints.
result Equilibrium contracts exhibit nonlinear pricing with decreasing risk loadings, inducing self-selection.
This paper presents a novel analysis of two feed-in tariffs (FIT) under market and regulatory uncertainty, namely a sliding premium with cap and floor and a minimum price guarantee. Regulatory uncertainty is modeled with a Poisson process, whereby a jump event may reduce the tariff before the signature of the contract.…
Investor-driven information diffusion affects excess comovement in China and the U.S. markets.
problem Investor-driven information diffusion and its impact on excess comovement.
method Cross-sectional analysis of 4,533 Chinese and 4,517 U.S. stocks from 2010 to 2022.
result Retail-driven information diffusion significantly drives excess comovement in China, while institution-driven diffusion is the primary driver in the U.S.
We examine random variables in the power law/regularly varying class with stochastic tail exponent, the exponent α having its own distribution. We show the effect of stochasticity of α on the expectation and higher moments of the random variable. For instance, the moments of a right-tailed or right-asymmetric varia…
Mathematical study of excess growth rate connects info theory with finance.
problem Understanding the excess growth rate in portfolio theory.
method Axiomatic characterization theorems of excess growth rate in terms of relative entropy, Jensen's inequality gap, and logarithmic divergence.
result Established rich connections between information theory and finance.
Market inefficiencies arise from density-dependent returns in a noisy environment.
problem Market inefficiencies and excess volatility.
method Developed a market model using ecological concepts.
result Market dynamics are density-dependent, leading to inefficiencies.
In statistical learning theory, convex surrogates of the 0-1 loss are highly preferred because of the computational and theoretical virtues that convexity brings in. This is of more importance if we consider smooth surrogates as witnessed by the fact that the smoothness is further beneficial both computationally- by at…
Developing a climate-aware pricing framework for XL reinsurance and CAT bonds under non-stationary catastrophe risk.
problem Pricing excess-of-loss (XL) reinsurance and catastrophe (CAT) bonds under climate uncertainty.
method Modeling catastrophe arrivals as a Cox process with a temperature-dependent stochastic intensity and aggregate losses following a compound Cox structure.
result Climate dependence materially changes the loss-generation mechanism and affects the valuation of catastrophe-linked contracts.
New tool detects 'fleeting modes' causing excess risk in financial markets.
problem Detecting portfolios with statistically significant excess risk in financial markets.
method Random Matrix Theory to identify 'fleeting modes' independent of underlying correlation structure.
result Fleeting modes exist in both futures and equity markets, and momentum is a source of excess risk.
The paper explores the information-theoretic nature of excess risk in machine learning.
problem Understanding the excess risk in machine learning models.
method Formulates the minimax excess risk as a zero-sum game and modifies it to allow swapping of the order of play.
result Proves that under certain conditions, the duality gap is zero, allowing for the application of Bayesian results to provide bounds on minimax excess risk.
Study excess capacity in neural networks using Rademacher complexity.
problem Understanding how much capacity deep networks have beyond what's needed for classification.
method Unified Rademacher complexity bounds for function composition and convolutional layers, considering Lipschitz constants and initialization norms.
result There is substantial excess capacity per task, and capacity can be kept similar across different tasks.
The paper analyzes the excess risk of PCA and provides a precise characterization.
problem Understanding the excess risk of principal component analysis (PCA).
method Established a central limit theorem for PCA error and derived the excess risk distribution.
result Obtained a non-asymptotic upper bound on the excess risk of PCA.
Improved self-supervised learning using credal sets.
problem Lack of precise knowledge in pseudo-labels.
method Using credal sets (sets of probability distributions) for labeling unlabeled data.
result Competitive to superior performance in low-label scenarios.
Study excess risk in statistical inference with transformations.
problem Excess risk in estimating random variables from feature vectors and transformations.
method Characterize lossless transformations, develop test statistics, and information-theoretic bounds.
result Strongly consistent partitioning test statistic for lossless transformations.
Develops a robust learning method for unknown context distributions.
problem Learning from data in different, unknown contexts.
method Focuses on excess risks, constructs distribution sets with statistical coverage.
result Shows robustness in worst-case scenarios without sacrificing nominal performance.
This work improves adaptive conformal prediction using self-supervised learning.
problem Improving the adaptability of conformal prediction intervals.
method Train an auxiliary model with a self-supervised pretext task on top of an existing predictive model and use the self-supervised error as an additional feature to estimate nonconformity scores.
result Empirically demonstrates the benefit of additional information in improving the efficiency (width), deficit, and excess of conformal prediction intervals.
We use a continuous-time random walk (CTRW) to model market fluctuation data from times when traders experience excessive losses or excessive profits. We analytically derive "superstatistics" that accurately model empirical market activity data (supplied by Bogachev, Ludescher, Tsallis, and Bunde)that exhibit transitio…
Paper improves neural network robustness analysis for safety-critical systems.
problem Uncertainty in neural network outputs for safety-critical systems.
method Unified propagation and partition approaches to provide tighter bounds.
result Proposed algorithms give tighter bounds than existing methods for the same computation time.
New framework robustly handles outliers in Wasserstein DRO for better decision-making.
problem Non-geometric perturbations like adversarial outliers distort Wasserstein distance.
method Proposes an outlier-robust WDRO framework using a robust Wasserstein ball.
result Derives minimax optimal excess risk bounds for robust WDRO.
Proponents of behavioral finance have identified several "puzzles" in the market that are inconsistent with rational finance theory. One such puzzle is the "excess volatility puzzle". Changes in equity prices are too large given changes in the fundamentals that are expected to change equity prices. In this paper, we of…
CARDS improves decoding efficiency and alignment quality for LLMs.
problem Efficiency bottlenecks in decoding-time alignment for LLMs.
method Cascade Reward Sampling (CARDS) with segment-level rejection sampling and uncertainty-based segmentation.
result Significant improvement in decoding efficiency and alignment quality.
The paper analyzes competition among fund managers using excess logarithmic returns and constructs games to find optimal allocations.
problem Optimal allocation strategies among fund managers considering excess logarithmic returns.
method Constructs both n-player and mean field games to address the competition problem. result The MFE of the MFG represents the limit of n-player game's equilibrium as n approaches infinity. Currency volatility shocks predict lower excess returns, and buying weak transmitters outperforms selling strong ones.
problem Predicting currency returns using volatility shocks.
method Constructed a dynamic, directed network of volatility connections using option-implied volatilities.
result Currencies that transmit more volatility shocks earn lower excess returns.