We investigate the ability of popular flow based methods to capture tail-properties of a target density by studying the increasing triangular maps used in these flow methods acting on a tractable source density. We show that the density quantile functions of the source and target density provide a precise characterizat…
Study on hidden units in finite Bayesian neural networks and their tail properties.
problem Understanding the behavior of hidden units in finite Bayesian neural networks.
method Introduced a generalized Weibull-tail property to describe hidden units tails.
result Unit priors become heavier-tailed going deeper, providing insights into finite Bayesian neural networks.
Study tail behavior of sum of heavy-tailed risks with copulas.
problem Analyzing the tail behavior of sums of heavy-tailed risks with dependence modeled by copulas.
method Modeling dependence with copulas and analyzing tail asymptotics of sums of heavy-tailed risks.
result Obtained asymptotic expansions for Value-at-Risk of aggregate risk.
Proposes a tail-adaptive shrinkage method for robust sparse estimation.
problem Robust Bayesian methods for high-dimensional regression under diverse sparse regimes.
method Global-local-tail (GLT) Gaussian mixture distribution with tail-adaptive shrinkage.
result GLT posterior contracts at minimax optimal rate for sparse normal mean models.
Econometric framework integrates heavy-tailed distributions with behavioral probability weighting for better asset pricing.
problem Underestimation of Value-at-Risk by traditional models in asset pricing.
method Developed an econometric framework combining heavy-tailed Student's t distributions with behavioral probability weighting. result Student's t specifications outperform Gaussian models in 88.4% of cases, reducing underestimation of Value-at-Risk by 16.5 percentage points. Paper develops heavy-tailed embeddings for better text classification and augmentation.
problem Improving text classification, especially for extreme values.
method Develops heavy-tailed embeddings using multivariate extreme value theory and introduces a scale-invariant classifier.
result The classifier outperforms baselines and generates meaningful augmented text.
Algorithm distinguishes light-tailed from non-light-tailed distributions.
problem Characterize the tail of a distribution using hazard rate.
method Careful bucketing scheme based on hazard rate.
result Polynomial number of samples required for success.
Work on SGDm under heavy-tailed noise, revealing its generalization properties.
problem Understanding generalization of SGDm under heavy-tailed noise.
method Analysis of continuous-time limit (SDE) and discrete-time SGDm, establishing generalization bounds.
result SGDm can have worse generalization in the presence of heavy-tailed noise for quadratic loss functions.
The paper examines how heavy-tailed risks behave under Gaussian copula models.
problem Understanding tail risk probabilities with heavy-tailed marginal risks and Gaussian dependence.
method Modeling heavy-tailed risks using regular variation and analyzing tail probabilities under Gaussian copula.
result The rate of decay of tail set probabilities varies with the type of tail sets and Gaussian correlation matrix.
Researchers study heavy-tail properties of SGD using stochastic recurrence equations.
problem Analyzing heavy-tail properties of Stochastic Gradient Descent (SGD).
method Modeling SGD iterations as multivariate affine stochastic recursions and applying the theory of irreducible-proximal (i-p) matrices.
result Extended results of Gürbüzbalaban et al. (2020) by using the theory of i-p matrices.
Reply to Tetlock et al. on tail risk and probability gap.
problem Expert judgment fails to account for tail risk.
method Comparison of forecasting tournaments and extreme value theory.
result Greater gap between tail expectation and probability properties.
This study uses local Gaussian correlation to analyze stock return tails, revealing more sensitive network properties.
problem Misleading results from Pearson correlation in financial networks.
method Local Gaussian correlation coefficient for capturing nonlinear dependence and heavy-tailed distributions.
result Local Gaussian correlation network among negative tails is more sensitive to stock market risks.
We study tilting subweibull distributions and their tail behavior.
problem Understanding tail behavior of subweibull distributions.
method Alternative characterizations and conditions for tail behavior preservation.
result Conditions for tail behavior preservation after exponential tilting.
Proposes a method to model financial returns with extreme shocks using flexible tail transformations.
problem Capturing extreme shocks in financial return data.
method Introduces a transformation layer in normalizing flows to model heavy-tailed distributions.
result Trained models can generate synthetic sets of extreme returns.
This paper reformulates systemic risk measures and finds new properties and estimators.
problem Understanding and measuring systemic risk in financial networks.
method Representation of systemic risk measures in terms of univariate risk measures and quantiles determined by copulas. Empirical properties and estimators derived.
result MES is not suitable for measuring extreme risks. ES-based measures are more sensitive to power-law tails and large losses.
Extended univariate Range Value-at-Risk to multivariate settings.
problem Inability of traditional risk measures for heavy-tail distributions and infinite tail expectations.
method Multivariate definitions of robust truncated tail expectations, robustness and properties derived, closed-form expressions and special cases discussed.
result Empirical estimators accuracy examined through numerical and graphical examples.
The hidden tail of empirical distributions is analyzed using extreme value theory.
problem Understanding the bias between in-sample mean and true statistical mean for large n. method Extreme value theory applied to empirical distributions and their moments.
result The hidden moment of order 0 for power law distributions follows an exponential distribution with expectation 1/n. Financial time series have been investigated to follow fat-tailed distributions. Further, an empirical probability distribution sometimes shows cut-off shapes on its tails. To describe this stylized fact, we incorporate the cut-off effect in superstatistics. Then we confirm that the presented stochastic model is capabl…
We exhibit an infinite family of knots with the property that the first coefficient of the n-colored Jones polynomial grows linearly with n. This shows that the concept of stability and tail seen in the colored Jones polynomials of alternating knots does not generalize naively.
Paper introduces MTCM to measure multivariate tail dependence.
problem Classical TDC fails to capture non-exchangeable features of multivariate tail dependence.
method Extends bivariate tail copula measure to multivariate case.
result MTCM reveals off-diagonal stress directions and differences in extremal dependence.
Variational inference with α-divergences has been widely used in modern probabilistic machine learning. Compared to Kullback-Leibler (KL) divergence, a major advantage of using α-divergences (with positive α values) is their mass-covering property. However, estimating and optimizing α-divergences require to use importa…
It is known that the colored Jones polynomial of a +-adequate link has a well-defined tail consisting of stable coefficients, and that the coefficients of the tail carry geometric and topological information on the +-adequate link complement. We show that a power series similar to the tail of the colored Jones poly…
Bitcoin returns exhibit a distinct inverse cubic law scaling behavior.
problem Investigating the scaling properties of Bitcoin price returns.
method Analysis of recent Bitcoin data to determine tail index and autocorrelation of absolute returns.
result The tail index of Bitcoin returns changes to approximately 3, consistent with the inverse cubic law.
We consider strictly stationary heavy tailed time series whose finite-dimensional exponent measures are concentrated on axes, and hence their extremal properties cannot be tackled using classical multivariate regular variation that is suitable for time series with extremal dependence. We recover relevant information ab…
A new tail-shape index based on Value at Risk and Expected Shortfall.
problem Measuring and comparing tail behavior of loss distributions.
method Introducing a new θ-index based on equal level relationships between Value at Risk and Expected Shortfall. result The θ-index provides a level-dependent, scale-free measure of upper tail behavior. New bounds for SGD generalize without mutual information terms.
problem Generalizing SGD's learning dynamics for heavy-tailed distributions.
method Introducing a geometric decoupling term and bounding it computably.
result Proved generalization bounds without mutual information terms.
Dynamic portfolio strategy using generative model with attention mechanism.
problem Dynamic modeling of multivariate stock returns with tail-side properties.
method Dynamic generative factor model using Attention-GRU network for dynamic learning and forecasting.
result The proposed model leads to wiser investments with higher reward-risk ratios and lower tail risks.
Investigates spectral properties of neural networks, showing invariance under certain conditions.
problem Understanding the spectral evolution and invariance in linear-width neural networks.
method Empirical and theoretical analysis of spectra of weight matrices in high-dimensional settings.
result Spectra of weight matrices are invariant under certain training conditions, with implications for feature learning.
Tail-GNNs improve protein function prediction using relational reinforcement.
problem Predicting hierarchical protein functions from sequence data.
method Combining Tail-GNNs with dilated convolutional networks for multi-task learning.
result Significant improvement in F_1 score for protein function prediction.
New bounds for heavy-tailed SDEs without info-theory terms.
problem Understanding generalization of heavy-tailed stochastic optimization.
method Fractional Fokker-Planck equation to estimate entropy flows.
result High-probability bounds with better dimension dependence.
We generalize Quasi-Linear Means by restricting to the tail of the risk distribution and show that this can be a useful quantity in risk management since it comprises in its general form the Value at Risk, the Tail Value at Risk and the Entropic Risk Measure in a unified way. We then investigate the fundamental propert…
Proves generalization bounds for SGD using Feller processes and Hausdorff dimension.
problem Characterizing generalization properties of SGD in deep learning.
method Proves generalization bounds for SGD under Feller process approximation, linking generalization error to the Hausdorff dimension of trajectories.
result Generalization error controlled by the Hausdorff dimension of trajectories, which is linked to the tail behavior of the driving process.
We introduce a family of copulas which are locally piecewise uniform in the interior of the unit cube of any given dimension. Within that family, the simultaneous control of tail dependencies of all projections to faces of the cube is possible and we give an efficient sampling algorithm. The combination of these two pr…
Generative Adversarial Network (GAN) simulates realistic multi-asset scenarios for tail risk.
problem Simulating realistic joint dynamics of multi-asset portfolios for tail risk estimation.
method Designing a GAN that preserves Value-at-Risk (VaR) and Expected Shortfall (ES) tail risk features.
result Correctly captures tail risk for a broad class of trading strategies and demonstrates strong generalization.
We propose a new heavy-tailed distribution --- Gaussian-Chain (GC) distribution, which is inspirited by the hierarchical structures prevailing in social organizations. We determine the mean, variance and kurtosis of the Gaussian-Chain distribution to show its heavy-tailed property, and compute the tail distribution tab…
New method approximates CVaR with less data for heavy-tailed risks.
problem Lack of data for accurate CVaR approximation in heavy-tailed distributions.
method Importance sampling based extrapolation for heavy-tailed distributions.
result Statistically consistent approximations with reduced data requirements.
Distortion risk measures are extensively used in finance and insurance applications because of their appealing properties. We present three methods to construct new class of distortion functions and measures. The approach involves the composting methods, the mixing methods and the approach that based on the theory of c…
DE-SGD shows heavy-tailed behavior in decentralized settings.
problem Heavy-tailed behavior in decentralized SGD.
method Analyzes the emergence of heavy-tails in DE-SGD, considering both quadratic and twice continuously differentiable strongly convex loss functions.
result DE-SGD exhibits heavier tails than centralized SGD, and tail behavior depends on network parameters.
We examine the performance of six estimators of the power-law cross-correlations -- the detrended cross-correlation analysis, the detrending moving-average cross-correlation analysis, the height cross-correlation analysis, the averaged periodogram estimator, the cross-periodogram estimator and the local cross-Whittle e…
Deep generative networks such as GANs and normalizing flows flourish in the context of high-dimensional tasks such as image generation. However, so far exact modeling or extrapolation of distributional properties such as the tail asymptotics generated by a generative network is not available. In this paper, we address …
While stochastic gradient descent (SGD) is one of the major workhorses in machine learning, the learning properties of many practically used variants are poorly understood. In this paper, we consider least squares learning in a nonparametric setting and contribute to filling this gap by focusing on the effect and inter…
Conditions for geometric ergodicity of multivariate autoregressive conditional heteroskedasticity (ARCH) processes, with the so-called BEKK (Baba, Engle, Kraft, and Kroner) parametrization, are considered. We show for a class of BEKK-ARCH processes that the invariant distribution is regularly varying. In order to accou…
New framework for calculating multivariate risk measures using Wishart process.
problem Quantifying multivariate risk measures in financial markets.
method Introducing a new analytical framework based on the Wishart process.
result Explicit computation of conditional tail risk measures up to two dimensions.
Study tail risk in high-frequency finance using L1-regularized regression.
problem Measuring tail risk dynamics in high-frequency financial markets.
method Dynamic extreme value regression model with L1-regularized maximum likelihood estimator. result Severity of extreme losses well predicted by low price impact in high volatility periods.
Studied how heavy-tailed behavior affects SGD's generalization in quadratic optimization.
problem Link between heavy-tailed behavior and generalization in SGD.
method Used heavy-tailed stochastic differential equation and proved stability bounds.
result Stability of SGD depends on the loss function's tail behavior.
Efficiently estimates sparse mean from heavy-tailed data.
problem Robustly estimating sparse mean from heavy-tailed distributions.
method Stability-based approach adapted for heavy-tailed data.
result Optimal sample complexity with logarithmic dependence on dimension.
A new model captures financial asset returns' tail behaviors and outperforms GARCH family.
problem Capturing the dynamic tail behaviors of financial asset returns.
method Combines LSTM with a novel parametric quantile function.
result Out-of-sample forecasts of conditional quantiles or VaR outperform GARCH family.
The SV-GARCH-EVT model improves risk assessment in financial markets.
problem Inaccurate risk assessment in financial markets due to fat-tailed and leverage effects.
method Enhanced SV model with EVT for tail distribution, MCMC for parameter estimation.
result SV-EVT models outperform other models in backtesting and out-of-sample analysis.