arXiv research

The paper examines how gradient descent stabilizes low-rank matrix factorization in noisy conditions.

Improved perturbation reduces matrix condition number to O(n) with minimal storage.

Paper shows robustness of gradient descent in matrix sensing despite perturbations.

Paper bounds subspace estimator error from noisy projections.

Beyond existing multi-view clustering, this paper studies a more realistic clustering scenario, referred to as incomplete multi-view clustering, where a number of data instances are missing in certain views. To tackle this problem, we explore spectral perturbation theory. In this work, we show a strong link between per…

New technique stabilizes singular values in concatenated matrices.

Study analyzes perturbations in singular subspaces under random noise.

The universal perturbative invariants of rational homology spheres can be extracted from the Chern-Simons partition function by combining perturbative and nonperturbative results. We spell out the general procedure to compute these invariants, and we work out in detail the case of Seifert spaces. By extending some prev…

The Davis-Kahan-Wedin $\sin Θ$ theorem describes how the singular subspaces of a matrix change when subjected to a small perturbation. This classic result is sharp in the worst case scenario. In this paper, we prove a stochastic version of the Davis-Kahan-Wedin $\sin Θ$ theorem when the perturbation is a Gaussian rando…

Paper proposes a method to generate adversarial perturbations for black-box attacks without accessing inner states.

We propose a new input perturbation mechanism for publishing a covariance matrix to achieve $(ε,0)$-differential privacy. Our mechanism uses a Wishart distribution to generate matrix noise. In particular, We apply this mechanism to principal component analysis. Our mechanism is able to keep the positive semi-definitene…

New bounds for private matrix approximation using Gaussian noise and Dyson Brownian Motion.

New framework for higher-order singular-value derivatives of rectangular matrices.

Spectral clustering is one of the most widely used techniques for extracting the underlying global structure of a data set. Compressed sensing and matrix completion have emerged as prevailing methods for efficiently recovering sparse and partially observed signals respectively. We combine the distance preserving measur…

Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient ascent (a variant of the tensor power method), and hard thresholding of the resid…

Study linear perturbations of Spin(7) metrics, finding only rank one nilpotent matrices.

Short proof shows how ridge regression works with random data.

The paper analyzes how quantization affects the Fisher Information Matrix's dominant eigenvalue.

The higher order singular value decomposition (HOSVD) of tensors is a generalization of matrix SVD. The perturbation analysis of HOSVD under random noise is more delicate than its matrix counterpart. Recently, polynomial time algorithms have been proposed where statistically optimal estimates of the singular subspaces …

New knot invariants derived using quantum cluster algebras.

Adding node feature kernels improves GCN robustness to graph perturbations.

In this paper, we discuss the sensitivity of quantum PageRank. By using the finite dimensional perturbation theory, we estimate the change of the quantum PageRank under a small analytical perturbation on the Google matrix. In addition, we will show the way to estimate the lower bound of the convergence radius as well a…

This paper solves the convergence problem for estimating MGGD parameters with a convex formulation.

New method improves matrix completion accuracy, especially in noisy data.

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly perturbed version $\mathbf{M}$ is observed. The noise matrix $\mathbf{M}-\mathbf{M}^{\s…

Most of machine learning deals with vector parameters. Ideally we would like to take higher order information into account and make use of matrix or even tensor parameters. However the resulting algorithms are usually inefficient. Here we address on-line learning with matrix parameters. It is often easy to obtain onlin…

The paper analyzes how random perturbations affect RSVD and its applications.

New method estimates heterogeneous treatment effects with improved guarantees.

A problem of paramount importance in both pure (Restricted Invertibility problem) and applied mathematics (Feature extraction) is the one of selecting a submatrix of a given matrix, such that this submatrix has its smallest singular value above a specified level. Such problems can be addressed using perturbation analys…

Paper addresses eigenvector perturbation in small eigen-gap scenarios.

This letter proposes a low-computational Bayesian algorithm for noisy sparse recovery in the context of one bit compressed sensing with sensing matrix perturbation. The proposed algorithm which is called BHT-MLE comprises a sparse support detector and an amplitude estimator. The support detector utilizes Bayesian hypot…

This work improves robustness guarantees for neural networks using low rank representations.

Complex Chern-Simons theory reveals peacock patterns in perturbative series.

In this paper, we study the problem of precision matrix estimation when the dataset contains sensitive information. In the differential privacy framework, we develop a differentially private ridge estimator by perturbing the sample covariance matrix. Then we develop a differentially private graphical lasso estimator by…

Study robust estimation of principal components under adversarial perturbations.

Spectral methods simplify data analysis, improving accuracy and stability.

We quantify the sensitivity of the Eisenberg-Noe clearing vector to estimation errors in the bilateral liabilities of a financial system in a stylized setting. The interbank liabilities matrix is a crucial input to the computation of the clearing vector. However, in practice central bankers and regulators must often es…

Classical matrix perturbation results, such as Weyl's theorem for eigenvalues and the Davis-Kahan theorem for eigenvectors, are general purpose. These classical bounds are tight in the worst case, but in many settings sub-optimal in the typical case. In this paper, we present perturbation bounds which consider the natu…

The study examines collective behavior in banking sectors across mature and emerging markets.

A new method for feature selection robust to noise and design variability.

Paper analyzes singular subspace estimation in noisy matrix models.

Gradient descent solves asymmetric low-rank matrix factorization efficiently.

In this paper, we study the nonnegative matrix factorization problem under the separability assumption (that is, there exists a cone spanned by a small subset of the columns of the input nonnegative data matrix containing all columns), which is equivalent to the hyperspectral unmixing problem under the linear mixing mo…

Within the unmanageably large class of nonconvex optimization, we consider the rich subclass of nonsmooth problems that have composite objectives---this already includes the extensively studied convex, composite objective problems as a special case. For this subclass, we introduce a powerful, new framework that permits…

LoRA fine-tuning explained with gradient dynamics for low-rank perturbations.

We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes either from an arbitrary additive or multiplicative rotational invariant perturbati…

New method stabilizes private LASSO for high-dimensional data with diverse covariate scales.

We introduce negative binomial matrix factorization (NBMF), a matrix factorization technique specially designed for analyzing over-dispersed count data. It can be viewed as an extension of Poisson matrix factorization (PF) perturbed by a multiplicative term which models exposure. This term brings a degree of freedom fo…