We study 'meta-dependence' in conditional independence tests across different empirical distributions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The best-known and most commonly used distribution-property estimation technique uses a plug-in estimator, with empirical frequency replacing the underlying distribution. We present novel linear-time-computable estimators that significantly "amplify" the effective amount of data available. For a large variety of distri…
Study spectral properties of graph Laplacian for manifold data.
Study of common financial data patterns across stocks.
We consider different levels of complexity which are observed in the empirical investigation of financial time series. We discuss recent empirical and theoretical work showing that statistical properties of financial time series are rather complex under several ways. Specifically, they are complex with respect to their…
Estimating properties of discrete distributions is a fundamental problem in statistical learning. We design the first unified, linear-time, competitive, property estimator that for a wide class of properties and for all underlying distributions uses just samples to achieve the performance attained by the empirical…
This paper reformulates systemic risk measures and finds new properties and estimators.
The ROC curve is widely used to assess the quality of prediction/classification/ranking algorithms, and its properties have been extensively studied. The precision-recall (PR) curve has become the de facto replacement for the ROC curve in the presence of imbalance, namely where one class is far more likely than the oth…
New method improves estimation of complex models from conditional moment restrictions.
We propose a group model for correlations in stock markets. In the group model the markets are composed of several groups, within which the stock price fluctuations are correlated. The spectral properties of empirical correlation matrices reported in [Phys. Rev. Lett. {\bf 83}, 1467 (1999); Phys. Rev. Lett. {\bf 83}, 1…
Most high-dimensional estimation and prediction methods propose to minimize a cost function (empirical risk) that is written as a sum of losses associated to each data point. In this paper we focus on the case of non-convex losses, which is practically important but still poorly understood. Classical empirical process …
This paper studies the landscape of empirical risk of deep neural networks by theoretically analyzing its convergence behavior to the population risk as well as its stationary points and properties. For an -layer linear neural network, we prove its empirical risk uniformly converges to its population risk at the rat…
We study some properties of eigenvalue spectra of financial correlation matrices. In particular, we investigate the nature of the large eigenvalue bulks which are observed empirically, and which have often been regarded as a consequence of the supposedly large amount of noise contained in financial data. We challenge t…
Study examines dependence properties of Bayesian neural network units in finite-width networks.
Study finds short-term instability in financial ARCH models.
The work "Loss Landscape Sightseeing with Multi-Point Optimization" (Skorokhodov and Burtsev, 2019) demonstrated that one can empirically find arbitrary 2D binary patterns inside loss surfaces of popular neural networks. In this paper we prove that: (i) this is a general property of deep universal approximators; and (i…
Persistent homology enhances graph classification by capturing long-range graph properties.
Empirical study compares finite- and infinite-width BNNs, revealing performance differences under model mismatch.
We report evidence of a deep interplay between cross-correlations hierarchical properties and multifractality of New York Stock Exchange daily stock returns. The degree of multifractality displayed by different stocks is found to be positively correlated to their depth in the hierarchy of cross-correlations. We propose…
We perform an extensive empirical analysis of scaling properties of equity returns, suggesting that financial data show time varying multifractal properties. This is obtained by comparing empirical observations of the weighted generalised Hurst exponent (wGHE) with time series simulated via Multifractal Random Walk (MR…
Study examines auditing fairness in evolving models, identifying strategic updates that preserve audit properties.
Financial time series exhibit a number of interesting properties that are difficult to explain with simple models. These properties include fat-tails in the distribution of price fluctuations (or returns) that are slowly removed at longer timescales, strong autocorrelations in absolute returns but zero autocorrelation …
Efficiently selects important variables in high-dimensional logistic regression.
Law derived for neural networks with sparse connections.
Paper shows robust estimators converge to true risk minimizers at optimal rates.
Machine learning systems increasingly depend on pipelines of multiple algorithms to provide high quality and well structured predictions. This paper argues interaction effects between clustering and prediction (e.g. classification, regression) algorithms can cause subtle adverse behaviors during cross-validation that m…
Framework for assessing fairness across similar predictive models.
Meta-learning symbolic default hyperparameters from dataset properties.
Recent works investigated the generalization properties in deep neural networks (DNNs) by studying the Information Bottleneck in DNNs. However, the mea- surement of the mutual information (MI) is often inaccurate due to the density estimation. To address this issue, we propose to measure the dependency instead of MI be…
Parameters defined via General Estimating Equations (GEE) can be estimated by maximizing the Empirical Likelihood (EL). Newey and Smith (2004) have recently shown that this EL estimator exhibits desirable higher-order asymptotic properties, namely, that its O(n^-1) bias is small and that bias-corrected EL is higher-ord…
New algorithm reduces sample complexity for Top Two method.
Parameters defined via general estimating equations (GEE) can be estimated by maximizing the empirical likelihood (EL). Newey and Smith [Econometrica 72 (2004) 219--255] have recently shown that this EL estimator exhibits desirable higher-order asymptotic properties, namely, that its bias is small and that …
Paper offers a framework for estimating symmetric properties efficiently.
Study evaluates and compares traditional and causal machine learning methods for estimating direct price effects of environmental amenities.
We develop a scale-invariant truncated Lévy (STL) process to describe physical systems characterized by correlated stochastic variables. The STL process exhibits Lévy stability for the probability density, and hence shows scaling properties (as observed in empirical data); it has the advantage that all moments are fini…
Paper presents ERM with -divergence regularization and its properties.
Robustness of deep learning models is a property that has recently gained increasing attention. We explore a notion of robustness for generative adversarial models that is pertinent to their internal interactive structure, and show that, perhaps surprisingly, the GAN in its original form is not robust. Our notion of ro…
In this work, we propose an order book model with herd behavior. The proposed model is built upon two distinct approaches: a recent empirical study of the detailed order book records by Kanazawa et al. [Phys. Rev. Lett. 120, 138301] and financial herd behavior model. Combining these approaches allows us to propose a mo…
We assume that a high-dimensional datum, like an image, is a compositional expression of a set of properties, with a complicated non-linear relationship between the datum and its properties. This paper proposes a factorial mixture prior for capturing latent properties, thereby adding structured compositionality to deep…
New empirical PAC-Bayes bound for Markov chains with finite state space.
The hidden tail of empirical distributions is analyzed using extreme value theory.
The salient properties of large empirical covariance and correlation matrices are studied for three datasets of size 54, 55 and 330. The covariance is defined as a simple cross product of the returns, with weights that decay logarithmically slowly. The key general properties of the covariance matrices are the following…
New method for efficient inference in large datasets.
Signature kernel handles sequential data with theoretical and practical advantages.
The paper explores theoretical insights into WGANs for better understanding and stability.
Empirical study shows consistent meta-RL algorithms adapt to OOD tasks.
In financial markets, not only prices and returns can be considered as random variables, but also the waiting time between two transactions varies randomly. In the following, we analyse the statistical properties of General Electric stock prices, traded at NYSE, in October 1999. These properties are critically revised …
In this study, we have investigated empirically the effects of market properties on the degree of diversification of investment weights among stocks in a portfolio. The weights of stocks within a portfolio were determined on the basis of Markowitz's portfolio theory. We identified that there was a negative relationship…