New method reduces computational cost for nonnegative low rank matrix approximation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Nonnegative low-rank matrix recovery can have spurious local minima.
The exact nonnegative matrix factorization (exact NMF) problem is the following: given an -by- nonnegative matrix and a factorization rank , find, if possible, an -by- nonnegative matrix and an -by- nonnegative matrix such that . In this paper, we propose two heuristics for exac…
SON-NMF estimates nonnegative rank on-the-fly for NMF.
Paper develops a method to approximate Markov chains with fewer states.
In this note we show that every (real or complex) vector bundle over a compact rank one symmetric space carries, after taking the Whitney sum with a trivial bundle of sufficiently large rank, a metric with nonnegative sectional curvature. We also examine the case of complex vector bundles over other manifolds, and give…
In this letter, we propose a new identification criterion that guarantees the recovery of the low-rank latent factors in the nonnegative matrix factorization (NMF) model, under mild conditions. Specifically, using the proposed criterion, it suffices to identify the latent factors if the rows of one factor are \emph{suf…
A new ranking model uses nonnegative matrix factorization for tennis players.
Due to the iterative nature of most nonnegative matrix factorization (\textsc{NMF}) algorithms, initialization is a key aspect as it significantly influences both the convergence and the final solution obtained. Many initialization schemes have been proposed for NMF, among which one of the most popular class of methods…
Given a matrix (not necessarily nonnegative) and a factorization rank , semi-nonnegative matrix factorization (semi-NMF) looks for a matrix with columns and a nonnegative matrix with rows such that is the best possible approximation of according to some metric. In this paper, we study th…
We prove that the Euler characteristic of an even-dimensional compact manifold with positive (nonnegative) sectional curvature is positive (nonnegative) provided that the manifold admits an isometric action of a compact Lie group with principal isotropy group and cohomogeneity such that $k - (\rank G - \ran…
New NMF algorithm uses Toeplitz matrix for facial recognition.
The paper studies SDP feasibility and sos ranks for specific polynomials.
New NMF method tackles nonnegative data with separability relaxed.
Nonnegative Matrix Factorization (NMF) was first introduced as a low-rank matrix approximation technique, and has enjoyed a wide area of applications. Although NMF does not seem related to the clustering problem at first, it was shown that they are closely linked. In this report, we provide a gentle introduction to clu…
Nonnegative matrix factorization (NMF), a dimensionality reduction and factor analysis method, is a special case in which factor matrices have low-rank nonnegative constraints. Considering the stochastic learning in NMF, we specifically address the multiplicative update (MU) rule, which is the most popular, but which h…
We study the problem of nonnegative rank-one approximation of a nonnegative tensor, and show that the globally optimal solution that minimizes the generalized Kullback-Leibler divergence can be efficiently obtained, i.e., it is not NP-hard. This result works for arbitrary nonnegative tensors with an arbitrary number of…
New algorithm improves clustering accuracy without sacrificing scalability.
The paper improves density estimation in high dimensions using tensor decompositions.
In this paper, we introduce and provide a short overview of nonnegative matrix factorization (NMF). Several aspects of NMF are discussed, namely, the application in hyperspectral imaging, geometry and uniqueness of NMF solutions, complexity, algorithms, and its link with extended formulations of polyhedra. In order to …
For certain manifolds, nonnegative Ricci curvature limits dimension and forces almost abelian fundamental group.
NMF and PCC linked, improving data denoising and feature stability.
Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this property of NMF on three applications, in image processing, text mining and hyperspe…
Graph neural networks speed up nonnegative matrix factorization.
Paper studies nonnegative Tucker decomposition identifiability with sparsity conditions.
Efficient NTF algorithm for large sparse tensors.
Nonnegative matrix factorization (NMF) has been shown recently to be tractable under the separability assumption, under which all the columns of the input data matrix belong to the convex cone generated by only a few of these columns. Bittorf, Recht, Ré and Tropp (`Factoring nonnegative matrices with linear programs', …
Proposes CC-NMDF for analyzing manifold-valued data.
MaxVol NMF maximizes the volume of in NMF for better sparse and interpretable solutions.
We consider invariant Riemannian metrics on compact homogeneous spaces G/H where an intermediate subgroup K between G and H exists, so that the homogeneous space G/H is the total space of a Riemannian submersion. We study the question as to whether enlarging the fibers of the submersion by a constant scaling factor ret…
The paper proves properties of fundamental groups of 4-manifolds with nonnegative Ricci curvature and Euclidean volume growth.
Compact rank one symmetric spaces are rigid under certain curvature conditions.
We consider cohomogeneity one homogeneous disk bundles and adress the question when these admit a nonnegatively curved invariant metric with normal collar, i.e., such that near the boundary the metric is the product of an interval and a normal homogeneous space. If such a bundle is not (the quotient of) a trivial bundl…
Nonnegative matrix factorization (NMF) has become a very popular technique in machine learning because it automatically extracts meaningful features through a sparse and part-based representation. However, NMF has the drawback of being highly ill-posed, that is, there typically exist many different but equivalent facto…
Paper develops compact formulations for optimization problems with rank-one convex functions and indicator variables.
We propose a geometric assumption on nonnegative data matrices such that under this assumption, we are able to provide upper bounds (both deterministic and probabilistic) on the relative error of nonnegative matrix factorization (NMF). The algorithm we propose first uses the geometric assumption to obtain an exact clus…
Nonnegative Tucker decomposition (NTD) is a powerful tool for the extraction of nonnegative parts-based and physically meaningful latent components from high-dimensional tensor data while preserving the natural multilinear structure of data. However, as the data tensor often has multiple modes and is large-scale, exist…
New PSDMF algorithms derived from PR and ARM methods.
The paper develops new algorithms for KL-divergence NMF, proving convergence and performance.
We propose a new method to estimate Wasserstein distances and optimal transport plans between two probability distributions from samples in high dimension. Unlike plug-in rules that simply replace the true distributions by their empirical counterparts, our method promotes couplings with low transport rank, a new struct…
Method improves clarity in forecasting spatio-temporal data.
Introduces nondecreasing rank for matrices and tensors, developing methods and applications.
We characterize complete nonnegatively curved steady gradient soliton with curvature in L^1. We show that there are isometric to a product (R^2,g_{cigar}) times(R^{n-2}, eucl))/Gamma where Gamma is a Bieberbach group of rank n-2. We prove also a similar local splitting result under weaker curvature assumptions.
The paper explores partial identifiability in nonnegative matrix factorization under specific conditions.
Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal, and other data types. This framework encompasses many well known techniques in da…
A new NMF model for co-clustering and data approximation.
Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the symmetric nonnegative matrix factorization problem under a simplicial constraint, whic…
Nonnegative Matrix Factorization (NMF) has been continuously evolving in several areas like pattern recognition and information retrieval methods. It factorizes a matrix into a product of 2 low-rank non-negative matrices that will define parts-based, and linear representation of nonnegative data. Recently, Graph regula…