arXiv research

Paper addresses eigenvector perturbation in small eigen-gap scenarios.

The original contributions of this paper are twofold: a new understanding of the influence of noise on the eigenvectors of the graph Laplacian of a set of image patches, and an algorithm to estimate a denoised set of patches from a noisy image. The algorithm relies on the following two observations: (1) the low-index e…

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly perturbed version $\mathbf{M}$ is observed. The noise matrix $\mathbf{M}-\mathbf{M}^{\s…

The paper explores how kernel eigenalignments affect generalization in KRR.

The pentagram map's limit point is related to infinitesimal perturbations of polygons.

We study the problem asking if one can embed manifolds into finite dimensional Euclidean spaces by taking finite number of eigenvector fields of the connection Laplacian. This problem is essential for the dimension reduction problem in massive data analysis. Singer-Wu proposed the vector diffusion map which embeds mani…

ELD compares graphs by their embedded Laplacian eigenvectors, resolving ambiguities.

New formulas for flag manifolds simplify eigenvector perturbation.

New algorithm updates eigenvectors of evolving graphs efficiently.

Proposes a new algorithm to estimate invariant subspaces across multilayer networks.

We propose a general framework to study the stability of the subspace spanned by $P$ consecutive eigenvectors of a generic symmetric matrix ${\bf H}_0$, when a small perturbation is added. This problem is relevant in various contexts, including quantum dissipation (${\bf H}_0$ is then the Hamiltonian) and risk control …

A method to explain disease transformation using biomarker covariance matrices.

This paper aims to address two fundamental challenges arising in eigenvector estimation and inference for a low-rank matrix from noisy observations: (1) how to estimate an unknown eigenvector when the eigen-gap (i.e. the spacing between the associated eigenvalue and the rest of the spectrum) is particularly small; (2) …

New bounds for private matrix approximation using Gaussian noise and Dyson Brownian Motion.

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or Krylov methods. While there is classical and comprehensive analysis for subspace c…

Spectral methods are popular in detecting global structures in the given data that can be represented as a matrix. However when the data matrix is sparse or noisy, classic spectral methods usually fail to work, due to localization of eigenvectors (or singular vectors) induced by the sparsity or noise. In this work, we …

Classical matrix perturbation results, such as Weyl's theorem for eigenvalues and the Davis-Kahan theorem for eigenvectors, are general purpose. These classical bounds are tight in the worst case, but in many settings sub-optimal in the typical case. In this paper, we present perturbation bounds which consider the natu…

Many deep learning models are vulnerable to the adversarial attack, i.e., imperceptible but intentionally-designed perturbations to the input can cause incorrect output of the networks. In this paper, using information geometry, we provide a reasonable explanation for the vulnerability of deep learning models. By consi…

We propose a general framework to study the stability of the subspace spanned by $P$ consecutive eigenvectors of a generic symmetric matrix ${\bf H}_0$, when a small perturbation is added. This problem is relevant in various contexts, including quantum dissipation (${\bf H}_0$ is then the Hamiltonian) and financial ris…

We analyzed cross-correlations between price fluctuations of global financial indices (20 daily stock indices over the world) and local indices (daily indices of 200 companies in the Korean stock market) by using random matrix theory (RMT). We compared eigenvalues and components of the largest and the second largest ei…

Laplacian Eigenvectors of the graph constructed from a data set are used in many spectral manifold learning algorithms such as diffusion maps and spectral clustering. Given a graph constructed from a random sample of a $d$-dimensional compact submanifold $M$ in $\mathbb{R}^D$, we establish the spectral convergence rate…

Improved rank aggregation via spectral method reduces sample complexity.

We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes either from an arbitrary additive or multiplicative rotational invariant perturbati…

Spectral clustering is one of the most widely used techniques for extracting the underlying global structure of a data set. Compressed sensing and matrix completion have emerged as prevailing methods for efficiently recovering sparse and partially observed signals respectively. We combine the distance preserving measur…

Study on signed graphs with random signs, focusing on community detection.

Study eigenvector overlaps in large Gaussian matrices, simplifying for GOE.

The paper explores how polynomial roots and operator eigenvalues change with parameters.

Machine learning models perform better with location coordinates alone, not Moran Eigenvectors.

We calculate eigenvector overlaps between intersecting time periods of covariance matrices.

In many applications, one has side information, e.g., labels that are provided in a semi-supervised manner, about a specific target region of a large data set, and one wants to perform machine learning and data analysis tasks "nearby" that prespecified target region. For example, one might be interested in the clusteri…

In spectral clustering, one defines a similarity matrix for a collection of data points, transforms the matrix to get the Laplacian matrix, finds the eigenvectors of the Laplacian matrix, and obtains a partition of the data using the leading eigenvectors. The last step is sometimes referred to as rounding, where one ne…

Spectral clustering for geometric graphs achieves strong consistency in community recovery.

New metric tensor field on symmetric matrices simplifies eigenvector computation.

Spectral clustering performance depends on eigenvector fluctuations, shown to be Gaussian.

New neural architectures invariant to sign flips and basis symmetries for graph representation learning.

How many samples are sufficient to guarantee that the eigenvectors and eigenvalues of the sample covariance matrix are close to those of the actual covariance matrix? For a wide family of distributions, including distributions with finite second moment and distributions supported in a centered Euclidean ball, we prove …

A new method for distributed PCA using matrix β-mean.

The paper provides entrywise bounds for Sparse PCA, improving upon previous results.

New theory for eigenvectors of generalized Laplacian matrices, addressing dependency issues.

Fast algorithm recovers principal eigenvector from noisy matrices.

This paper develops the exact linear relationship between the leading eigenvector of the unnormalized modularity matrix and the eigenvectors of the adjacency matrix. We propose a method for approximating the leading eigenvector of the modularity matrix, and we derive the error of the approximation. There is also a comp…

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a maximization problem, existing approaches formulate this problem by adding a penalty te…

Improved spectral clustering with fewer eigenvectors performs better.

New insights into spectral clustering reveal strong connections within eigenvectors.

We characterize the contractions that are similar to the backward shift in the Hardy space $H^2$. This characterization is given in terms of the geometry of the eigenvector bundles of the operators.

Graph convolutional networks fail to use eigenvectors beyond the first, unlike spectral embedding.

We provide new examples of diffusion operators in dimension 2 and 3 which have orthogonal polynomials as eigenvectors. Their construction rely on the finite subgroups of O(3) and their invariant polynomials.

Study eigenvalues and eigenvectors in neural networks, focusing on signal propagation.