arXiv research

New metrics defined for full-rank correlation matrices, ensuring unique operations.

Researchers develop geodesics for a new metric on correlation matrices.

New bound for neural networks with full-rank weights, independent of network width.

Develops log-Euclidean Lie groups for SPD and correlation matrices.

This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model for estimating the spatial covariance matrices (SCMs) and power spectral densities…

Geodesics found in deep linear networks.

This paper solves quadratic systems with sparse or generative priors.

In this paper, we present some theoretical work to explain why simple gradient descent methods are so successful in solving non-convex optimization problems in learning large-scale neural networks (NN). After introducing a mathematical tool called canonical space, we have proved that the objective functions in learning…

New metrics improve landing algorithms for orthogonality constraints.

Matrix factorization is a well-studied task in machine learning for compactly representing large, noisy data. In our approach, instead of using the traditional concept of matrix rank, we define a new notion of link-rank based on a non-linear link function used within factorization. In particular, by applying the round …

Financial markets analyzed by reducing correlation matrix complexity.

In this paper, we develop a relative error bound for nuclear norm regularized matrix completion, with the focus on the completion of full-rank matrices. Under the assumption that the top eigenspaces of the target matrix are incoherent, we derive a relative upper bound for recovering the best low-rank approximation of t…

Polynomial time algorithm matches correlated Gaussian matrices without vanishing correlation.

We simplify matrix computations for block matrices, especially useful for covariance and correlation matrices.

A necessary condition for a connection in a vector bundle to be locally metric is for its curvature matrix, which consists of $2$ forms, to be skew symmetric with respect to some local frame. In this paper we give a simple algorithm that can be used to decide when a matrix of $2$ forms is equivalent to a skew symmetric…

Magnetoencephalography and electroencephalography (M/EEG) can reveal neuronal dynamics non-invasively in real-time and are therefore appreciated methods in medicine and neuroscience. Recent advances in modeling brain-behavior relationships have highlighted the effectiveness of Riemannian geometry for summarizing the sp…

Mirror descent algorithm recovers low-rank matrices in matrix sensing.

Financial correlation matrices measure the unsystematic correlations between stocks. Such information is important for risk management. The correlation matrices are known to be ``noise dressed''. We develop a new and alternative method to estimate this noise. To this end, we simulate certain time series and random matr…

There has been an increasing interest in testing the equality of large Pearson's correlation matrices. However, in many applications it is more important to test the equality of large rank-based correlation matrices since they are more robust to outliers and nonlinearity. Unlike the Pearson's case, testing the equality…

Paper tackles fairness in CCA by minimizing correlation disparity error.

Bootstrapping regularizes singular correlation matrices, reducing the need for complex regularization.

A new way to describe correlation matrices makes modeling easier.

We analyze the spectral properties of correlation matrices between distinct statistical systems. Such matrices are intrinsically non symmetric, and lend themselves to extend the spectral analyses usually performed on standard Pearson correlation matrices to the realm of complex eigenvalues. We employ some recent random…

In this paper, we introduce a new geometric description of the manifolds of matrices of fixed rank. The starting point is a geometric description of the Grassmann manifold $\mathbb{G}_r(\mathbb{R}^k)$ of linear subspaces of dimension $r<k$ in $\mathbb{R}^k$ which avoids the use of equivalence classes. The set $\mathbb{…

Unified framework for Riemannian deep learning across manifold-valued representations.

Unified framework for Riemannian deep learning across manifold-valued representations.

Estimates covariance matrices with correlations between samples.

Matrices of (approximate) low rank are pervasive in data science, appearing in recommender systems, movie preferences, topic models, medical records, and genomics. While there is a vast literature on how to exploit low rank structure in these datasets, there is less attention on explaining why the low rank structure ap…

cCorrGAN approximates conditional correlation matrices using GANs.

New insights into attention mechanisms reveal dramatic trade-offs between rank and heads.

New method uses VAEs to generate financial correlation matrices for credit portfolio VaR analysis.

New model for high rank matrix completion with online and batch methods.

Complex systems are typically represented by large ensembles of observations. Correlation matrices provide an efficient formal framework to extract information from such multivariate ensembles and identify in a quantifiable way patterns of activity that are reproducible with statistically significant frequency compared…

New method for initializing low-rank neural networks improves performance.

We show that for any positive integer $n$, the maps $x \in \mathbb{C}^n \mapsto \{\left|\langle x, z_i \rangle \right|^2\}_{i=1}^{4n} \in \mathbb{R}^{4n}$, where $z_i$ are the columns of four $n\times n$ unitary matrices, are generically injective modulo multiplication by a global phase factor, yielding a family of emb…

We study a new ensemble of random correlation matrices related to multivariate Student (or more generally elliptic) random variables. We establish the exact density of states of empirical correlation matrices that generalizes the Marcenko-Pastur result. The comparison between the theoretical density of states in the St…

Article presents QR and LQ decomposition algorithms for various matrix sizes and ranks.

Theoretical analysis of the error landscape of deep neural networks has garnered significant interest in recent years. In this work, we theoretically study the importance of noise in the trajectories of gradient descent towards optimal solutions in multi-layer neural networks. We show that adding noise (in different wa…

Improved eigenvalue distribution method for financial data.

A method to complete incomplete correlation matrices using maximum entropy.

We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend …

Paper defines conditions for feasible correlation matrices from factor structures.

Financial markets are highly correlated systems that reveal both the inter-market dependencies and the correlations among their different components. Standard analyzing techniques include correlation coefficients for pairs of signals and correlation matrices for rich multivariate data. In the latter case one constructs…

Graph alignment problem solved with convex relaxations for correlated matrices.

We construct and analyze symmetrized delay correlation matrices for empirical data sets for atmopheric and financial data to derive information about correlation between different entities of the time series over time. The information about correlations is obtained by comparing the results for the eigenvalue distributi…

Method estimates sparse inverse covariance and partial correlation matrices efficiently.

Robust principal component analysis (RPCA) can recover low-rank matrices when they are corrupted by sparse noises. In practice, many matrices are, however, of high-rank and hence cannot be recovered by RPCA. We propose a novel method called robust kernel principal component analysis (RKPCA) to decompose a partially cor…

A new geometric framework embeds correlation matrices into Euclidean space for scalable brain network analysis.