Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

5.7%11.4%17.1%22.7% · Feb 202619922001200920172026
48 results for upper tail statistics

Study on U-statistics with heavy-tailed samples, providing tail bounds and LDP.

problem Deviation of U-statistics with heavy-tailed samples.
method Exponential tail bounds and Large Deviation Principle (LDP) for U-statistics.
result Obtained an exponential upper bound for U-statistics tail decay, showing two regions of decay.

New method optimizes language model performance for test-time strategies.

problem Mismatch between training objectives and test-time deployment of large language models.
method Tail-Extrapolated estimators to approximate best-of-N performance from limited training rollouts.
result Improved performance of best-of-N deployment across various models and datasets.

Proposes QGC to distinguish between lower and upper tail connectivity in financial networks.

problem Identifying systemically important firms using financial data.
method Quantile Granger Causality (QGC) using Lasso penalized quantile regressions.
result QGC networks detect systemic risk more accurately than mean-based networks.

New bounds on continuous random variables' right-tail probabilities.

problem Finding precise upper and lower limits for right-tail probabilities of continuous random variables.
method Developed new bounds based on PDF, first derivative, and two parameters.
result The new bounds are tight for various continuous random variables.

The paper analyzes the reward improvement of aligned policies in large language models.

problem Optimizing policies in large language models while staying close to a reference policy.
method Information-theoretic analysis and reduction to exponential order statistics.
result Information-theoretic upper bounds on reward improvement are derived.

This study examines biases in flow matching samplers using finite-sample estimation.

problem Biases in flow matching samplers when using finite-sample surrogates.
method Finite-sample plug-in estimation and hierarchy of empirical FM models.
result Exact empirical minimizer and smoothed plug-in regime identified for affine conditional flows.

Privacy affects how much data is needed for CVaR optimization.

problem Privacy constraints impact the effective sample size for CVaR optimization.
method Analyzes the privacy-relevant sample size and decomposes CVaR excess risk.
result The effective private tail sample size is εnτ, affecting CVaR learning rates.

ACP-UCB1 ranks arms based on upper-tail performance, improving stochastic bandit algorithms.

problem Stochastic bandit algorithms often favor arms with strong upper-tail performance, which is not well-addressed by classical mean-reward criteria.
method ACP-UCB1 combines an adaptive conformal estimate of the upper endpoint with a UCB-type optimism bonus.
result ACP-UCB1 achieves logarithmic upper-quantile regret with per-arm contribution \(O( icefrac{\log n}{Δ_j^{\mathrm{ACP}}})\).

The paper evaluates and improves uncertainty estimates in neural networks for safety-critical applications.

problem Quantifying uncertainty in neural networks for safety-critical systems.
method Proposes a statistical test for evaluating uncertainty realism in neural networks and transfers a classification architecture to image-to-image tasks.
result The variational U-Net architecture significantly improves uncertainty realism in image-to-image tasks compared to a plain model.

The paper proposes a new method to measure risk with fine-grained tail sensitivity.

problem Risk measures that do not account for tail sensitivity are insufficient for machine learning systems.
method The approach involves specifying a reference distribution with desired tail behavior and constructing risk measures compatible with this upper probability.
result Risk measures with fine-grained tail sensitivity can replace the expectation operator in machine learning systems.

Method bounds tail probabilities of continuous RVs.

problem Bounding tail probabilities of continuous random variables.
method Setting continuous, positive, and strictly decreasing/increasing functions to derive upper and lower bounds.
result Provides tighter bounds than existing methods, including a novel asymptotic capacity bound for AWGN channel.

For a risk vector VV, whose components are shared among agents by some random mechanism, we obtain asymptotic lower and upper bounds for the individual agents' exposure risk and the aggregated risk in the market. Risk is measured by Value-at-Risk or Conditional Tail Expectation. We assume Pareto tails for the componen…

2015-03-12abs ↗pdf ↗

Interpolating models can have heavy-tailed risk, leading to rare but severe errors.

problem Interpolating models' tail risk is poorly understood, affecting rare but impactful errors.
method Large-deviation methods to study the fragility of high-dimensional linear interpolators.
result Ridgeless regression exhibits heavy-tailed risk, while ridge-regularized estimators have better tail behavior.

The paper examines how small positive dependence can lead to correlated tail risks.

problem Understanding the impact of dependence uncertainty on tail risk measures.
method Introducing a regular dependence measure and analyzing the aggregation of risks.
result Small positive dependence can result in perfectly correlated tail risks.

Proposes a copula-based filter for diabetes risk prediction.

problem Feature selection for robust and interpretable predictive modeling in medicine, especially for extreme patient strata.
method Copula-based supervised filter using Gumbel-copula implied upper-tail concordance score (lambda U).
result The proposed filter outperforms standard filters and provides clinically coherent predictors.

The book chapter discusses tail risk analysis for financial data using extreme value statistics.

problem Serial dependence in financial time series complicates tail risk assessment.
method The approach involves unconditional and conditional quantile forecasting.
result Serial dependence impacts multivariate tail dependence.

Novel Orlicz regrets consistently bound environmental variable statistics.

problem Consistent evaluation of stochastic environmental variables like water quality indices.
method Proposed novel Orlicz regrets for upper and lower bounds.
result Explicit linkage between Orlicz regrets and divergence risk measures.

The paper explores how benign overfitting occurs in heavy-tailed input distributions.

problem Understanding overfitting in heavy-tailed input distributions.
method Analysis of maximum margin classifiers on unregularized logistic loss with gradient descent.
result Linear classifiers trained under certain conditions can asymptotically achieve the noise level as misclassification error.

Study growth patterns in random networks using i.i.d. perturbations.

problem Understanding the growth of affine regions in random piecewise-linear networks.
method Analyzes a random compositional model with i.i.d. perturbations of the tent map, proving submultiplicative pressure and using finite-state defect process for upper-tail lower bounds.
result Proves the existence of a submultiplicative pressure for \(N_n\) and gives exponential upper bounds for \(n^{-1}\log N_n\).

The paper studies quantile contributions and their relationship with order statistics in heavy-tailed distributions.

problem Challenges of classical statistical models in heavy-tailed distributions.
method Theoretical study of quantile contribution statistic and its relationship with order statistics. Derivation of closed-form expression for joint CDF of order statistics and quantile contributions.
result Established asymptotic normality of quantile contributions and characterized their limiting distribution.

HTFM improves mode coverage and tail-statistic recovery for heavy-tailed data.

problem Tackles heavy-tailed data in various domains with rare events.
method Proposes a framework using clock-conditioned Gaussian sources and truncated logsignature features.
result Improves mode coverage, sample quality, and tail-statistic recovery over Gaussian flow matching and baselines.

New algorithm improves heavy-tailed statistical estimation in streaming data.

problem Heavy-tailed statistical estimation in streaming data.
method Clipped stochastic gradient descent algorithm with improved analysis.
result Guarantees exponential concentration with O(1)O(1) batch size for mean estimation and linear regression.

Study differentially private linear regression with heavy-tailed data.

problem Differentially private 1\ell_1-norm linear regression with heavy-tailed data.
method Exponential mechanism for 2\ell_2-norm bounded second moment; relaxation to 2\ell_2-norm bounded θθ-th moment; coordinate-wise bounded moments.
result Achieved upper bounds for privacy-preserving linear regression under various moment conditions.

A new UCB algorithm for heavy-tailed bandits with near-optimal regret.

problem Sequential decision making in uncertain environments with heavy-tailed rewards.
method Data-driven, distribution-free UCB algorithm combining resampled median-of-means and UCB.
result Near-optimal regret bound for heavy-tailed distributions.

A common challenge in nonparametric inference is its high computational complexity when data volume is large. In this paper, we develop computationally efficient nonparametric testing by employing a random projection strategy. In the specific kernel ridge regression setup, a simple distance-based test statistic is prop…

2018-02-17abs ↗pdf ↗

Heavy-tailed outliers are more resilient to robust estimation than adversarial ones.

problem Developing robust estimators for data with outliers.
method Analyzing the relationship between adversarial and heavy-tailed outlier models.
result Optimal estimators for heavy-tailed outliers are also optimal for adversarial settings, but not vice versa.

The book examines statistical issues with fat-tailed distributions and proposes remedies.

problem Misapplication of conventional statistical techniques to fat-tailed distributions.
method Investigates the limitations of traditional asymptotics and proposes remedies.
result Traditional statistical techniques often fail when applied to fat-tailed distributions.

Basel II and Solvency 2 both use the Value-at-Risk (VaR) as the risk measure to compute the Capital Requirements. In practice, to calibrate the VaR, a normal approximation is often chosen for the unknown distribution of the yearly log returns of financial assets. This is usually justified by the use of the Central Limi…

2013-11-01abs ↗pdf ↗

Study shows heavy-tailed distributions affect reliability of machine learning calibration statistics.

problem Reliability of calibration statistics for machine learning regression tasks is affected by heavy-tailed uncertainty and error distributions.
method Examined two calibration error estimation methods (CE and ZMS) and found ZMS to be less sensitive to heavy-tailed distributions.
result Heavy-tailed distributions make MSE and MV unreliable, but ZMS remains a reliable approach.

A new algebra for probabilistic programming improves tail behavior accuracy.

problem Inaccurate tail behavior in probabilistic models based on neural networks.
method Developed a three-parameter tail asymptotics algebra based on the generalized Gamma distribution.
result Inference algorithms using the heavy-tailed algebra achieve superior performance.

Modified lognormal distribution with flexible tails for skewed data.

problem Skewed and fat-tailed data in natural and engineering datasets.
method Developed a family of three-parameter non-Gaussian probability density functions based on generalized kappa-exponential and kappa-logarithm functions.
result Closed-form analytic expressions for statistical functions and maximum-likelihood estimation.

Study learns linear system dynamics from noisy bilinear data.

problem Learning linear dynamics from bilinear observations with process and measurement noise.
method Regression with Kronecker product design, data-dependent and independent error bounds.
result Upper bounds on statistical error rates and sample complexity for learning dynamics matrices.

This work extends diffusion models to handle heavy-tailed targets, improving score estimation and sampling guarantees.

problem Score estimation and sampling guarantees for heavy-tailed targets in diffusion models.
method Kernel density estimation and minimax rates analysis for score estimation and sampling guarantees.
result Sharp minimax rates for score estimation and sampling guarantees for heavy-tailed targets, revealing qualitative differences between exponential and polynomial tails.

Paper presents a dynamic tail risk protection strategy using ML and econometrics.

problem Tail risk protection in finance with solid mathematical and statistical tools.
method Dynamic tail risk protection strategy using weak classifiers (parametric and non-parametric) to estimate exceedance probability and derive trading signals.
result Ensemble classifier improves generalization and trading performance.

Improved Clipped-SGD achieves near-optimal heavy-tailed statistical estimation in streaming settings.

problem High-dimensional heavy-tailed statistical estimation in streaming with memory constraints.
method Stochastic convex optimization with Clipped-SGD, proving near-optimal sub-Gaussian statistical rates.
result Clipped-SGD achieves an error of Tr(Σ)+Tr(Σ)Σ2log(log(T)δ)T\sqrt{\frac{\mathsf{Tr}(Σ)+\sqrt{\mathsf{Tr}(Σ)\|Σ\|_2}\log(\frac{\log(T)}δ)}{T}} with probability 1δ1-δ.

Paper develops robust estimators and strategies for stochastic MABs with heavy-tailed rewards.

problem Stochastic multi-armed bandits with heavy-tailed rewards.
method Proposes a novel robust estimator and perturbation-based exploration strategy.
result Develops upper and lower regret bounds for various perturbations.

A new tail-shape index based on Value at Risk and Expected Shortfall.

problem Measuring and comparing tail behavior of loss distributions.
method Introducing a new θθ-index based on equal level relationships between Value at Risk and Expected Shortfall.
result The θθ-index provides a level-dependent, scale-free measure of upper tail behavior.

The paper explores tail diversification in financial markets using entropy and mutual information.

problem Tail diversification in financial time series.
method Statistical independence through differential entropy and mutual information, using moments as contrast functions.
result Tail covariance matrix is a key driver of tail diversification.