Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

193385578770 · Jun 202019922001200920172026
48 results for Correlated Random Effects

Proposes integrating random effects into deep neural networks for better predictive performance.

problem Correlated data in real-life applications are not handled well by traditional deep neural networks.
method Uses mixed models with random effects to handle correlations in deep neural networks, minimizing Gaussian negative log-likelihood with SGD.
result Improves predictive performance over natural competitors in various correlation scenarios.

LMMVAE improves VAE for correlated data by separating latent variables into fixed and random parts.

problem Correlated data in tabular and image datasets.
method Integrates random effects into VAE architecture, separating latent variables into fixed and random parts.
result Significant improvement in reconstruction error and likelihood loss on unseen data.

We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC) (correlations among observations for each individual over time), {\em cluster correlation…

2019-11-11abs ↗pdf ↗

We confirm universal behaviors such as eigenvalue distribution and spacings predicted by Random Matrix Theory (RMT) for the cross correlation matrix of the daily stock prices of Tokyo Stock Exchange from 1993 to 2001, which have been reported for New York Stock Exchange in previous studies. It is shown that the random …

2003-12-25abs ↗pdf ↗

We estimate generic statistical properties of a structural credit risk model by considering an ensemble of correlation matrices. This ensemble is set up by Random Matrix Theory. We demonstrate analytically that the presence of correlations severely limits the effect of diversification in a credit portfolio if the corre…

2011-02-18abs ↗pdf ↗

The paper finds a surprising positive correlation between upstreamness and downstreamness in global value chains.

problem The puzzling positive correlation between upstreamness and downstreamness in industries and countries.
method Analysis of a simple model of random Input/Output tables and experiments on empirical data.
result Upstreamness and downstreamness of the same industrial sector/country are positively correlated with a slope close to +1.

Study analyzes factors affecting capital adequacy in Bangladesh's banks.

problem Factors influencing capital adequacy in commercial banks in Bangladesh.
method Fixed Effect, Random Effect, and Pooled Ordinary Least Square (POLS) methods.
result Several independent variables significantly affect capital adequacy, with specific relationships between leverage, liquidity risk, and other factors.

FREEtree improves tree-based methods for correlated longitudinal data.

problem Poor performance of Random Forests in high dimensional longitudinal data with correlated features.
method FREEtree uses a piecewise random effects model and clustering with WGCNA to select features and maintain interpretability.
result FREEtree outperforms other tree-based methods in prediction and feature selection accuracy.

A new method estimates conditional canonical correlations using random forests.

problem Estimating relationships between two sets of variables given covariates.
method Random Forest with Canonical Correlation Analysis (RFCCA)
result RFCCA provides accurate canonical correlation estimations and well-controlled Type-1 error.

Unified analytic account of correlation emergence and Epps effect in coupled limit order books

problem Correlation emergence and Epps effect in coupled limit order books
method Discrete random-walk description of order flow with creation, cancellation, and diffusion, coupled reaction-diffusion equations with moving reaction boundary
result Realized correlations as a function of aggregation time

We revisit the index leverage effect, that can be decomposed into a volatility effect and a correlation effect. We investigate the latter using a matrix regression analysis, that we call `Principal Regression Analysis' (PRA) and for which we provide some analytical (using Random Matrix Theory) and numerical benchmarks.…

2010-11-26abs ↗pdf ↗

RFMs transition from linear to nonlinear under specific input-label correlation.

problem Understanding the transition from linear to nonlinear behavior in RFMs.
method Analyzing RFMs under spiked covariance designs, characterizing the interaction between anisotropy and input-label correlation.
result The RFM generalization error is governed by the strength of input-label correlation, leading to a clear nonlinear advantage above a specific boundary.

This paper compares imputation and direct parameter estimation methods for missing data in correlation matrix visualization.

problem Missing data challenges in estimating correlation coefficients for accurate visualization.
method Comparison of imputation and direct parameter estimation methods for handling missing data.
result Direct parameter estimation (DPER) outperforms imputation for accurate correlation matrix visualization.

This study analyzes the correlation structure of global agricultural futures markets using RMT.

problem Understanding the complex correlation structure of global agricultural futures markets.
method Random Matrix Theory (RMT) applied to analyze correlation coefficients and eigenvalues.
result The correlation structure is asymmetric and right skewed, with significant eigenvalues indicating market effects and commodity groups.

Spectral denoising recovers meaningful network structure from noisy financial correlations.

problem Noise in empirical correlation matrices from financial returns obscures genuine interactions.
method Spectral decomposition to separate structured and random components.
result Structured networks derived from 10-16 eigenmodes exhibit stronger core-periphery organization and scale-free degree distributions.

We find a novel correlation structure in the residual noise of stock market returns that is remarkably linked to the composition and stability of the top few significant factors driving the returns, and moreover indicates that the noise band is composed of multiple subbands that do not fully mix. Our findings allow us …

2009-09-08abs ↗pdf ↗

We propose improved methods to identify stock groups using the correlation matrix of stock price changes. By filtering out the marketwide effect and the random noise, we construct the correlation matrix of stock groups in which nontrivial high correlations between stocks are found. Using the filtered correlation matrix…

2005-03-09abs ↗pdf ↗

First passage models, where corporate assets undergo correlated random walks and a company defaults if its assets fall below a threshold provide an attractive framework for modeling the default process. Typical one year default correlations are small, i.e., of order a few percent, but nonetheless including correlations…

2008-12-10abs ↗pdf ↗

We review the decomposition method of stock return cross-correlations, presented previously for studying the dependence of the correlation coefficient on the resolution of data (Epps effect). Through a toy model of random walk/Brownian motion and memoryless renewal process (i.e. Poisson point process) of observation ti…

2007-04-28abs ↗pdf ↗

Existing guarantees in terms of rigorous upper bounds on the generalization error for the original random forest algorithm, one of the most frequently used machine learning methods, are unsatisfying. We discuss and evaluate various PAC-Bayesian approaches to derive such bounds. The bounds do not require additional hold…

2018-10-23abs ↗pdf ↗

CopulaGNN integrates graph representational and correlational roles for better node-level predictions.

problem Graphs encode diverse roles in node-level prediction tasks, but GNNs struggle with correlational information.
method Copula theory to describe multivariate dependence, integrating representational and correlational graph information.
result CopulaGNN improves GNN performance on regression tasks by leveraging both types of graph information.

Proposes rounding method for precise treatment effect estimation under budget constraints.

problem Resource-constrained experimental design for precise treatment effect estimation.
method Dependent randomized rounding procedure to convert assignment probabilities into binary treatment decisions.
result Improved estimator precision through variance reduction and efficient inference.

Estimates Hurst exponent of log-volatility using KS statistic, addressing serial correlation in financial data.

problem Estimating Hurst exponent of log-volatility in financial time series with serial correlation.
method Proposes a random permutation procedure to remove serial correlation, using the Kolmogorov-Smirnov statistic for distribution-based estimation.
result Establishes the asymptotic variance of the estimator and reveals statistically significant hierarchy of roughness in volatility measures.

Financial empirical correlation matrices of all the companies which both, the Deutsche Aktienindex (DAX) and the Dow Jones comprised during the time period 1990-1999 are studied using a time window of a limited, either 30 or 60, number of trading days. This allows a clear identification of the resulting correlations. O…

2001-03-29abs ↗pdf ↗

Model simulates correlation emergence in two coupled limit order books.

problem Modeling correlation emergence in coupled limit order books.
method Simulated two coupled diffusive limit order books using random walks in the fluid limit, with trader interactions.
result Demonstrated the recovery of an Epps effect from the model.

We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based c…

2015-07-02abs ↗pdf ↗

Estimates vaccine effectiveness and immune correlates in TND studies with missing data.

problem Confounding and missing data in TND studies of vaccine effectiveness and immune correlates.
method Targeted maximum likelihood estimation using a semiparametric logistic regression model.
result Valid causal inference of vaccine effectiveness and immune correlates in TND studies with missing exposure data.

OmniMatch algorithm perfectly matches graphs without edge correlation.

problem Graph matching in the absence of edge correlation.
method OmniMatch algorithm for seeded multiple graph matching.
result OmniMatch aligns O(sα)O(s^α) unseeded vertices across multiple networks efficiently and perfectly.

We analyse the dependence of stock return cross-correlations on the sampling frequency of the data known as the Epps effect: For high resolution data the cross-correlations are significantly smaller than their asymptotic value as observed on daily data. The former description implies that changing trading frequency sho…

2007-04-09abs ↗pdf ↗

Polynomial-time algorithm matches correlated random graphs with non-vanishing correlation.

problem Matching correlated random graphs with non-vanishing edge correlation.
method Iterative algorithm for polynomial-time recovery of latent matching.
result Algorithm succeeds in recovering latent matching as long as edge correlation is non-vanishing.

Proposes a new method to estimate variable importance in black box models, mitigating correlation effects.

problem Correlation between covariates affects the interpretation of variable importance parameters.
method Develops a modified LOCO (Leave Out COvariates) method and uses semiparametric models for estimation.
result Shows how to estimate a modified LOCO method that mitigates correlation effects.

Gaussian copulas are widely used in the industry to correlate two random variables when there is no prior knowledge about the co-dependence between them. The perturbed Gaussian copula approach allows introducing the skew information of both random variables into the co-dependence structure. The analytical expression of…

2010-02-27abs ↗pdf ↗

MOMENT selects and estimates mixed-effects models using moment identities.

problem Selecting and estimating random-effects covariance matrix and fixed-effects coefficients in multiresponse linear mixed-effects models.
method MOMENT is a stage-wise moment-based framework that reduces the random-effects selection problem to a smooth constrained convex optimization problem.
result MOMENT performs competitively and can outperform separate univariate analyses for correlated responses.

We analyze ridge interpolators in correlated factor regression models using RDT.

problem Performance analysis of ridge interpolators in correlated factor regression models.
method Utilizing Random Duality Theory (RDT), we obtain precise closed form characterizations of optimization problems.
result Ridge interpolators can smooth out the excess prediction risk and exhibit double-descent behavior.

Simplifies large action space bandits by selecting representative actions.

problem Efficiently managing large action spaces with correlated outcomes.
method Random sampling and solving of bandit instances to identify representative actions.
result The algorithm selects a smaller set of representative actions that perform nearly as well as the full action space.

In this paper, we deal with the problem of inferring causal directions when the data is on discrete domain. By considering the distribution of the cause P(X)P(X) and the conditional distribution mapping cause to effect P(YX)P(Y|X) as independent random variables, we propose to infer the causal direction via comparing the di…

2018-03-21abs ↗pdf ↗

Multivariate probability density functions of returns are constructed in order to model the empirical behavior of returns in a financial time series. They describe the well-established deviations from the Gaussian random walk, such as an approximate scaling and heavy tails of the return distributions, long-ranged volat…

2004-01-02abs ↗pdf ↗