arXiv research

Weak correlations explain linear dynamics in deep learning models.

RFMs transition from linear to nonlinear under specific input-label correlation.

The paper proposes new cross-correlators using Price's Theorem and piecewise-linear decomposition.

Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from the model prior to statistical inference, can be used to overcome this challenge. Prior works on co…

Previous studies indicate that nonlinear properties of Gaussian time series with long-range correlations, $u_i$, can be detected and quantified by studying the correlations in the magnitude series $|u_i|$, i.e., the ``volatility''. However, the origin for this empirical observation still remains unclear, and the exact …

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order corr…

Canonical correlation analysis was proposed by Hotelling [6] and it measures linear relationship between two multidimensional variables. In high dimensional setting, the classical canonical correlation analysis breaks down. We propose a sparse canonical correlation analysis by adding l1 constraints on the canonical vec…

Study shows how correlations between neural activity affect classification capacity.

The article generalizes Pearson correlation to Riemannian manifolds.

Proposes $\ell_0$-CCA for sparse CCA with improved representation learning.

This study examines how sequential correlations affect in-context learning in sequence models.

Financial time series exhibit two different type of non linear correlations: (i) volatility autocorrelations that have a very long range memory, on the order of years, and (ii) asymmetric return-volatility (or `leverage') correlations that are much shorter ranged. Different stochastic volatility models have been propos…

The diagonal effect of orders is well documented in different markets, which states that orders are more likely to be followed by orders of the same aggressiveness and implies the presence of short-term correlations in order flows. Based on the order flow data of 43 Chinese stocks, we investigate if there are long-rang…

In this paper we briefly review the recently inrtroduced Multifractal Random Walk (MRW) that is able to reproduce most of recent empirical findings concerning financial time-series : no correlation between price variations, long-range volatility correlations and multifractal statistics. We then focus on its extension t…

The paper examines how NFT valuations correlate with market data and social trends.

Most data is multi-dimensional. Discovering whether any subset of dimensions, or subspaces, of such data is significantly correlated is a core task in data mining. To do so, we require a measure that quantifies how correlated a subspace is. For practical use, such a measure should be universal in the sense that it capt…

A fast method estimates correlations in hybrid systems using observable market data.

Canonical Correlation Analysis (CCA) is a linear representation learning method that seeks maximally correlated variables in multi-view data. Non-linear CCA extends this notion to a broader family of transformations, which are more powerful in many real-world applications. Given the joint probability, the Alternating C…

Proposes a method to calibrate data for more accurate linear correlation testing.

This paper offers a new algebraic perspective of GCCA using subspace intersection.

Model predicts epileptic seizures with high accuracy using EEG signals.

In many domains, there is significant interest in capturing novel relationships between time series that represent activities recorded at different nodes of a highly complex system. In this paper, we introduce multipoles, a novel class of linear relationships between more than two time series. A multipole is a set of t…

The study uses DCC for financial market analysis, revealing hidden correlations.

We introduce the Randomized Dependence Coefficient (RDC), a measure of non-linear dependence between random variables of arbitrary dimension based on the Hirschfeld-Gebelein-Rényi Maximum Correlation Coefficient. RDC is defined in terms of correlation of random non-linear copula projections; it is invariant with respec…

ARC algorithm optimizes dynamic pricing with correlated observations.

New methods test correlation between network structure and node features.

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

We study historical correlations and lead-lag relationships between individual stock risk (volatility of daily stock returns) and market risk (volatility of daily returns of a market-representative portfolio) in the US stock market. We consider the cross-correlation functions averaged over all stocks, using 71 stock pr…

Predicting the price correlation of two assets for future time periods is important in portfolio optimization. We apply LSTM recurrent neural networks (RNN) in predicting the stock price correlation coefficient of two individual stocks. RNNs are competent in understanding temporal dependencies. The use of LSTM cells fu…

We study the dynamics of the linear and non-linear serial dependencies in financial time series in a rolling window framework. In particular, we focus on the detection of episodes of statistically significant two- and three-point correlations in the returns of several leading currency exchange rates that could offer so…

We present an extension of sparse Canonical Correlation Analysis (CCA) designed for finding multiple-to-multiple linear correlations within a single set of variables. Unlike CCA, which finds correlations between two sets of data where the rows are matched exactly but the columns represent separate sets of variables, th…

Exact simulation of correlated binary outcomes using PMF constraints and linear programming.

Enhances sensitivity analysis for correlated inputs.

A new screening method for high-dimensional data reduces computational cost.

CDSSL improves representation quality by integrating linear and nonlinear dependencies.

In a very high-dimensional vector space, two randomly-chosen vectors are almost orthogonal with high probability. Starting from this observation, we develop a statistical factor model, the random factor model, in which factors are chosen at random based on the random projection method. Randomness of factors has the con…

In this article we analyse linear correlation and non-linear dependence of traded volume, $v$, of the 30 constituents of Dow Jones Industrial Average at different value scales. Specifically, we have raised $v$ to some real value $α$ or $β$, which introduces a bias for small ($α, β<0$) or large ($α, β>1$) values. Our r…

Research examines correlations of complex logarithms of lattice points, showing level repulsion and Poissonian behavior.

Spatially relaxed inference tackles high-dimensional linear models with correlated covariates.

The study examines correlations of logarithms of integers at different scalings.

The paper introduces a framework to assess nonlinear causality in financial markets.

Paper proposes PSIPS for identifying Pareto set with correlated objectives.

We perform a systematic investigation on the components of the empirical multifractality of financial returns using the daily data of Dow Jones Industrial Average from 26 May 1896 to 27 April 2007 as an example. The temporal structure and fat-tailed distribution of the returns are considered as possible influence facto…

We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms $x_i$ and up to $p^2$ quadratic terms $x_i x_j$. Quadratic terms enable prediction/modeling of higher-order effects between features and the target, but when incorporated naively may involve solvi…

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of interest, such as covariance, dynamical structure, correlation between data sets, inp…

In the last years efforts in econophysics have been shifted to study how network theory can facilitate understanding of complex financial markets. Main part of these efforts is the study of correlation-based hierarchical networks. This is somewhat surprising as the underlying assumptions of research looking at financia…

Lasso performs poorly with correlated covariates, but a rescaled approach fixes this.

Method estimates sparse inverse covariance and partial correlation matrices efficiently.