Proposes integrating random effects into deep neural networks for better predictive performance.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
LMMVAE improves VAE for correlated data by separating latent variables into fixed and random parts.
Random forest performance depends on SNR and covariate characteristics.
We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC) (correlations among observations for each individual over time), {\em cluster correlation…
We confirm universal behaviors such as eigenvalue distribution and spacings predicted by Random Matrix Theory (RMT) for the cross correlation matrix of the daily stock prices of Tokyo Stock Exchange from 1993 to 2001, which have been reported for New York Stock Exchange in previous studies. It is shown that the random …
We estimate generic statistical properties of a structural credit risk model by considering an ensemble of correlation matrices. This ensemble is set up by Random Matrix Theory. We demonstrate analytically that the presence of correlations severely limits the effect of diversification in a credit portfolio if the corre…
The paper finds a surprising positive correlation between upstreamness and downstreamness in global value chains.
We review recent advances on the record statistics of strongly correlated time series, whose entries denote the positions of a random walk or a Lévy flight on a line. After a brief survey of the theory of records for independent and identically distributed random variables, we focus on random walks. During the last few…
Study analyzes factors affecting capital adequacy in Bangladesh's banks.
FREEtree improves tree-based methods for correlated longitudinal data.
A new method estimates conditional canonical correlations using random forests.
A detailed analysis of correlation between stock returns at high frequency is compared with simple models of random walks. We focus in particular on the dependence of correlations on time scales - the so-called Epps effect. This provides a characterization of stochastic models of stock price returns which is appropriat…
Unified analytic account of correlation emergence and Epps effect in coupled limit order books
We revisit the index leverage effect, that can be decomposed into a volatility effect and a correlation effect. We investigate the latter using a matrix regression analysis, that we call `Principal Regression Analysis' (PRA) and for which we provide some analytical (using Random Matrix Theory) and numerical benchmarks.…
We review recent progress in modeling credit risk for correlated assets. We start from the Merton model which default events and losses are derived from the asset values at maturity. To estimate the time development of the asset values, the stock prices are used whose correlations have a strong impact on the loss distr…
RFMs transition from linear to nonlinear under specific input-label correlation.
This paper compares imputation and direct parameter estimation methods for missing data in correlation matrix visualization.
This study analyzes the correlation structure of global agricultural futures markets using RMT.
Spectral denoising recovers meaningful network structure from noisy financial correlations.
We find a novel correlation structure in the residual noise of stock market returns that is remarkably linked to the composition and stability of the top few significant factors driving the returns, and moreover indicates that the noise band is composed of multiple subbands that do not fully mix. Our findings allow us …
We propose improved methods to identify stock groups using the correlation matrix of stock price changes. By filtering out the marketwide effect and the random noise, we construct the correlation matrix of stock groups in which nontrivial high correlations between stocks are found. Using the filtered correlation matrix…
The cross-correlation matrix of daily returns of stock market indices in a diverse set of 37 countries worldwide was analyzed. Comparison of the spectrum of this matrix with predictions of random matrix theory provides an empirical evidence of strong interactions between individual economies, as manifested by three lar…
First passage models, where corporate assets undergo correlated random walks and a company defaults if its assets fall below a threshold provide an attractive framework for modeling the default process. Typical one year default correlations are small, i.e., of order a few percent, but nonetheless including correlations…
We review the decomposition method of stock return cross-correlations, presented previously for studying the dependence of the correlation coefficient on the resolution of data (Epps effect). Through a toy model of random walk/Brownian motion and memoryless renewal process (i.e. Poisson point process) of observation ti…
Existing guarantees in terms of rigorous upper bounds on the generalization error for the original random forest algorithm, one of the most frequently used machine learning methods, are unsatisfying. We discuss and evaluate various PAC-Bayesian approaches to derive such bounds. The bounds do not require additional hold…
Repelling random walks improve graph-based sampling efficiency.
CopulaGNN integrates graph representational and correlational roles for better node-level predictions.
We consider the problem of how to assign treatment in a randomized experiment, in which the correlation among the outcomes is informed by a network available pre-intervention. Working within the potential outcome causal framework, we develop a class of models that posit such a correlation structure among the outcomes. …
Proposes rounding method for precise treatment effect estimation under budget constraints.
Estimates Hurst exponent of log-volatility using KS statistic, addressing serial correlation in financial data.
Financial empirical correlation matrices of all the companies which both, the Deutsche Aktienindex (DAX) and the Dow Jones comprised during the time period 1990-1999 are studied using a time window of a limited, either 30 or 60, number of trading days. This allows a clear identification of the resulting correlations. O…
Random forest hyperparameters affect variable selection in omics studies.
Model simulates correlation emergence in two coupled limit order books.
The cross-correlations between the exchange rate fluctuations of 74 currencies over the period 1995-2012 are analyzed in this paper. The eigenvalue distribution of the cross-correlation matrix exhibits a bulk which approximately matches the bounds predicted from random matrices constructed using mutually uncorrelated t…
We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based c…
Estimates vaccine effectiveness and immune correlates in TND studies with missing data.
OmniMatch algorithm perfectly matches graphs without edge correlation.
We analyse the dependence of stock return cross-correlations on the sampling frequency of the data known as the Epps effect: For high resolution data the cross-correlations are significantly smaller than their asymptotic value as observed on daily data. The former description implies that changing trading frequency sho…
Polynomial-time algorithm matches correlated random graphs with non-vanishing correlation.
Proposes a new method to estimate variable importance in black box models, mitigating correlation effects.
Gaussian copulas are widely used in the industry to correlate two random variables when there is no prior knowledge about the co-dependence between them. The perturbed Gaussian copula approach allows introducing the skew information of both random variables into the co-dependence structure. The analytical expression of…
MOMENT selects and estimates mixed-effects models using moment identities.
New method speeds up solving orthogonality constrained problems.
We analyze ridge interpolators in correlated factor regression models using RDT.
Simplifies large action space bandits by selecting representative actions.
Counterfactual reasoning is an important paradigm applicable in many fields, such as healthcare, economics, and education. In this work, we propose a novel method to address the issue of \textit{selection bias}. We learn two groups of latent random variables, where one group corresponds to variables that only cause sel…
In this paper, we deal with the problem of inferring causal directions when the data is on discrete domain. By considering the distribution of the cause and the conditional distribution mapping cause to effect as independent random variables, we propose to infer the causal direction via comparing the di…
Multivariate probability density functions of returns are constructed in order to model the empirical behavior of returns in a financial time series. They describe the well-established deviations from the Gaussian random walk, such as an approximate scaling and heavy tails of the return distributions, long-ranged volat…