New method corrects bias in datasets using cumulative distribution functions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
ECOD detects outliers without parameters, fast and simple.
Study quantifies how LLMs capture higher-order statistical structure using cumulant expansion.
The paper studies empirical processes from nearest neighbors in regression.
Nonparametric neural-network estimation of current-status data
Paper speeds up Gaussian process inference using Matérn kernels.
The paper proposes a new method to evaluate LLM agent responses using ECDF clustering.
The paper introduces a spline-based method for calibrating neural networks.
AI learns to classify and represent univariate distributions in a 2D latent space.
The paper calculates bounds for risk metrics and entropies under partial information constraints.
The attack intensity of distributed denial of service (DDoS) attacks is increasing every year. Botnets based on internet of things (IOT) devices are now being used to conduct DDoS attacks. The estimation of direct and indirect economic damages caused by these attacks is a complex problem. One of the indirect damage of …
Develops uniform convergence guarantees for a broad class of risk functionals in supervised learning.
We introduce a new set of consistent measures of risks, in terms of the semi-invariants of pdf's, such that the centered moments and the cumulants of the portfolio distribution of returns that put more emphasis on the tail the distributions. We derive generalized efficient frontiers, based on these novel measures of ri…
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
We show power-scaling behaviors for fluctuations in share volume, which no other studies have so far done. After analyzing a database of the daily transactions for all securities listed on the Tokyo Stock Exchange, we selected 1050 large companies that each had an unbroken series of daily trading activity from January …
SafeML monitors ML systems for safety and security risks.
Paper converts quantiles to cumulative distribution functions to simplify risk measures.
We introduce a new type of graphical model called a "cumulative distribution network" (CDN), which expresses a joint cumulative distribution as a product of local functions. Each local function can be viewed as providing evidence about possible orderings, or rankings, of variables. Interestingly, we find that the condi…
Based on a faithful representation of the heavy tail multivariate distribution of asset returns introduced previously (Sornette et al., 1998, 1999) that we extend to the case of asymmetric return distributions, we generalize the return-risk efficient frontier concept to incorporate the dimensions of large risks embedde…
We propose a novel algebraic framework for treating probability distributions represented by their cumulants such as the mean and covariance matrix. As an example, we consider the unsupervised learning problem of finding the subspace on which several probability distributions agree. Instead of minimizing an objective f…
EDRBO optimizes Bayesian optimization with continuous contexts using ensemble models and robust methods.
Kernelized cumulants improve statistical analysis in high-dimensional spaces.
We leverage neural networks as universal approximators of monotonic functions to build a parameterization of conditional cumulative distribution functions (CDFs). By the application of automatic differentiation with respect to response variables and then to parameters of this CDF representation, we are able to build bl…
Paper proposes a framework for reliable off-policy evaluation in reinforcement learning.
We provide evidence that cumulative distributions of absolute normalized returns for the American companies with the highest market capitalization, uncover a critical behavior for different time scales . Such cumulative distributions, in accordance with a variety of complex --and financial-- systems, can be m…
The paper studies quantile contributions and their relationship with order statistics in heavy-tailed distributions.
Optimizes portfolios using CPT utility via convex optimization.
A new model for stock price fluctuations is proposed, based upon an analogy with the motion of tracers in Gaussian random fields, as used in turbulent dispersion models and in studies of transport in dynamically disordered media. Analytical and numerical results for this model in a special limiting case of a single-sca…
Using a family of modified Weibull distributions, encompassing both sub-exponentials and super-exponentials, to parameterize the marginal distributions of asset returns and their natural multivariate generalizations, we give exact formulas for the tails and for the moments and cumulants of the distribution of returns o…
Estimates MLP expected output without sampling, using fewer FLOPs.
The problem of an arbitrary truncated Levy flight description using the method of cumulant approach has been solved. The set of cumulants of the truncated Levy distribution given the assumption of arbitrary truncation has been found. The influence of truncation shape on the truncated Levy flight properties in the Gauss…
Unified probabilistic gradient boosting for entire conditional distribution modeling.
Neural networks can learn from higher-order cumulants efficiently, requiring quadratic samples.
We extend and test empirically the multifractal model of asset returns based on a multiplicative cascade of volatilities from large to small time scales. The multifractal description of asset fluctuations is generalized into a multivariate framework to account simultaneously for correlations across times scales and bet…
In this paper we study the volatility and its probability distribution function for the cumulative production based on the experience curve hypothesis. This work presents a generalization of the study of volatility in [1], which addressed the effects of normally distributed noise in the production process. Due to its w…
Are large scale research programs that include many projects more productive than smaller ones with fewer projects? This problem of economy of scale is particularly relevant for understanding recent mergers in particular in the pharmaceutical industry. We present a quantitative theory based on the characterization of d…
Paper improves Thompson Sampling for linear contextual bandits.
New method identifies causal structure in count data using cumulants and path analysis.
Exponential dispersion model is a useful framework in machine learning and statistics. Primarily, thanks to the additive structure of the model, it can be achieved without difficulty to estimate parameters including mean. However, tight conditions on cumulant function, such as analyticity, strict convexity, and steepne…
Directed acyclic graphs (DAGs) are a popular framework to express multivariate probability distributions. Acyclic directed mixed graphs (ADMGs) are generalizations of DAGs that can succinctly capture much richer sets of conditional independencies, and are especially useful in modeling the effects of latent variables im…
We study the rank distribution, the cumulative probability, and the probability density of returns of stock prices of listed firms traded in four stock markets. We find that the rank distribution and the cumulative probability of stock prices traded in are consistent approximately with the Zipf's law or a power law. It…
Introduces CuFun model for more accurate TPPs using CDF.
The paper analyzes worst-case distortion risk metrics and weighted entropy under partial information.
In this paper we derive the exact solution of the multi-period portfolio choice problem for an exponential utility function under return predictability. It is assumed that the asset returns depend on predictable variables and that the joint random process of the asset returns and the predictable variables follow a vect…
A new GAN loss function based on cumulant generating functions improves stability and robustness.
This work presents an empirical study of the evolution of the personal income distribution in Brazil. Yearly samples available from 1978 to 2005 were studied and evidence was found that the complementary cumulative distribution of personal income for 99% of the economically less favorable population is well represented…
Bayesian methods improve inference for cumulative probit models on large datasets.
A new UU-test decides unimodality of datasets.