A hierarchical Gaussian prior model improves low-rank matrix completion.
problem Low-rank matrix completion with improved structure exploitation.
method Hierarchical Gaussian prior model with GAMP embedded variational Bayesian inference.
result The proposed method outperforms state-of-the-art matrix completion methods.
Matrix completion is a problem that arises in many data-analysis settings where the input consists of a partially-observed matrix (e.g., recommender systems, traffic matrix analysis etc.). Classical approaches to matrix completion assume that the input partially-observed matrix is low rank. The success of these methods…
New method improves robust low-rank matrix completion for computer vision.
problem Robust low-rank matrix completion for partially observed data.
method Formulated as a nonsmooth Riemannian optimization problem over Grassmann manifold, solved with an alternating manifold proximal gradient continuation method.
result Demonstrated advantages over existing approaches in background extraction from surveillance videos.
New method for matrix completion under complex missing data patterns.
problem Matrix completion with complex missing data patterns.
method Estimate the probability matrix of observation via low-rank matrix estimation and use inverse probabilities weighting to complete the target matrix.
result Optimal asymptotic convergence rates for observation probabilities and target matrix estimation.
New nonconvex regularizer speeds up low-rank matrix completion.
problem Low-rank matrix completion with good theoretical and empirical performance.
method Proposes a new nonconvex regularizer with adaptive shrinkage, scalable, and fast optimization.
result Proposed method achieves state-of-the-art recovery performance and is the fastest.
The paper tackles matrix estimation from noisy data, focusing on low-rank matrices.
problem Estimating a low-rank matrix from noisy observations.
method The paper analyzes several estimators, including constrained nuclear-norm minimization, nuclear-norm regularized least squares, and a nonconvex constrained low-rank optimization problem.
result The estimators provide upper error bounds that depend on matrix rank, observed fraction, and matrix sums, and are minimax optimal.
Unified approach for robust low rank matrix estimation with adversaries.
problem Robust low rank matrix estimation in the presence of adversaries.
method Unified approach combining Huber loss and nuclear norm penalization.
result Sharp estimation error bounds for matrix compressed sensing and completion.
New method solves matrix completion problems to certifiable optimality.
problem Certifying optimality in low-rank matrix completion.
method Disjunctive branch-and-bound scheme for convex relaxation.
result Decreases optimality gap by two orders of magnitude.
Most recent results in matrix completion assume that the matrix under consideration is low-rank or that the columns are in a union of low-rank subspaces. In real-world settings, however, the linear structure underlying these models is distorted by a (typically unknown) nonlinear transformation. This paper addresses the…
Proposes a new model for image restoration combining deep learning and total variation.
problem Restoring images from limited data with low-rank constraints insufficient.
method Regularized Deep Matrix Factorized (RDMF) model using deep neural network's low-rank bias and total variation.
result Outperforms state-of-the-art models in image restoration from few observations.
Paper develops new patterns for unique matrix completions.
problem Developing unique completions for non-random matrix patterns.
method Formulated low-rank matrix completion using Plucker coordinates.
result Provides two families of patterns for any rank.
A new method for 1-bit matrix completion that is faster and more accurate.
problem Estimating a low-rank matrix from binary observations.
method Majorization-Minimization Gauss-Newton (MMGN) method.
result MMGN outperforms existing methods in accuracy and speed.
Paper tackles missing value imputation in time series forecasting.
problem Missing value imputation in time series analysis.
method Low-rank matrix completion with Hankel matrices and nuclear norm relaxation.
result Proper weighting scheme is crucial for known observations.
We present a novel algebraic combinatorial view on low-rank matrix completion based on studying relations between a few entries with tools from algebraic geometry and matroid theory. The intrinsic locality of the approach allows for the treatment of single entries in a closed theoretical and practical framework. More s…
Paper proposes a method to recover rankings from limited comparisons using low-rank matrix completion.
problem Rank aggregation from pairwise comparisons with limited and noisy data.
method Low-rank matrix completion, alternating minimization algorithm, maximum likelihood estimation.
result Improved algorithm performance over state-of-the-art methods.
New method for robust matrix completion with mixed data types.
problem Recovering a structured low rank matrix with mixed data types.
method Proposes a computationally feasible statistical approach with strong recovery guarantees for mixed data types.
result Strong recovery guarantees for low rank matrix completion with mixed data types.
Paper tackles matrix completion with a mixture of low-rank matrices.
problem Matrix completion with a mixture of low-rank matrices.
method Generalized matrix completion model (MMC) with theoretical and practical contributions.
result MMC provides a more accurate model for recommender systems and clustering.
Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict inductively on new users/movies. In this paper, we study the problem of inductive matr…
New method predicts binary matrix entries using empirical Bayes and low-rank structure.
problem Predicting unobserved entries in binary matrices.
method Empirical Bayes method motivated by Efron--Morris estimator, exploiting low-rank structure.
result Superior performance in predictive accuracy, calibration, and efficiency compared to existing methods.
New nonconvex regularizers improve low-rank matrix recovery efficiency and accuracy.
problem Efficiently recover low-rank matrices from incomplete data.
method Factor group-sparse regularization, related to Schatten-p norms.
result Improved generalization error bounds for Schatten-p norms as p decreases.
Characterizes uncertainty in low-rank matrix completion with noisy data.
problem Uncertainty quantification in low-rank matrix completion with heterogeneous sub-exponential noise.
method Characterizes the distribution of estimated matrix entries under low-rank estimators with heterogeneous sub-exponential noise.
result Explicit formulas for the distribution of estimated matrix entries under Poisson and Binary noise.
Estimates low-rank distributional matrices from incomplete samples.
problem Matrix completion for distributional entries with limited observed data.
method Kernel mean embeddings, Tucker rank, functional unfolding operators.
result Effective estimator for distributional matrix completion established.
Paper determines rank of unknown low-rank data.
problem Determining the rank of unknown low-rank data.
method Analyzes various data models and provides upper bounds on rank based on sampled entries.
result Upper bounds on rank are equal to the true rank in many cases.
Selective sampling improves matrix completion with known structure.
problem Reconstructing a low-rank matrix with incomplete data.
method Designing observation sets based on matrix structure and selective sampling.
result Improved reconstruction accuracy with selective sampling.
This paper addresses the problem of low-rank distance matrix completion. This problem amounts to recover the missing entries of a distance matrix when the dimension of the data embedding space is possibly unknown but small compared to the number of considered data points. The focus is on high-dimensional problems. We r…
Paper analyzes robust matrix completion with efficient nonconvex method and leave-one-out analysis.
problem Robust matrix completion with sparse noise.
method Alternates between projected gradient step for low-rank and thresholding step for sparse noise.
result Achieves linear convergence for general thresholding functions.
Study compares LRMC algorithms under dependent sampling in various applications.
problem Recovering missing entries in partially observed low-rank matrices with dependent sampling.
method Various LRMC algorithms tested under dependent sampling in different contexts.
result Performance differences among LRMC algorithms under dependent sampling.
Study nonconvex matrix completion for low-rank approximation without rank assumptions.
problem Low-rank approximation of positive semidefinite matrices from partial entries.
method Nonconvex optimization, local-minimum analysis, no spurious local minima.
result Improved sampling rate for nonconvex matrix completion with no spurious local minima.
Gradient descent achieves exact linear convergence rate for symmetric matrix completion.
problem Low-rank symmetric matrix completion using gradient descent.
method Local analysis of gradient descent for symmetric matrices without additional assumptions.
result Closed-form expression of exact linear convergence rate matches practice.
We address the collective matrix completion problem of jointly recovering a collection of matrices with shared structure from partial (and potentially noisy) observations. To ensure well--posedness of the problem, we impose a joint low rank structure, wherein each component matrix is low rank and the latent space of th…
New method solves robust matrix completion using nonlinear equations.
problem Recover low rank and sparse matrices from incomplete observations.
method Transforms problem into solving a system of nonlinear equations, then uses the alternative direction method.
result Algorithm converges linearly to the true solution under proper assumptions.
We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general case with noisy observations, we show that our algorithm is guaranteed to linearl…
The paper completes matrices from non-uniformly sampled entries, especially when columns are randomly selected and fully observed.
problem Matrix completion from non-uniformly sampled entries, including fully and partially observed columns.
method First, recover the column space from fully observed columns. Then, for each partially observed column, find a vector in the recovered column space with the observed entries. For low-rank matrices, recover them from Ω(rnlnn) entries. result The algorithm can exactly recover a low-rank matrix from merely Ω(rnlnn) entries. Paper develops a new weighted low-rank matrix approximation technique.
problem Matrix completion with missing data.
method Element-wise weighted generalization of low-rank matrix approximation.
result Proposes an algorithm and acceleration techniques for solving the weighted problem.
Improved matrix completion for non-uniformly sampled data.
problem Estimating unobserved entries in a matrix with varying sampling probabilities.
method Developed entry-specific bounds for low-rank matrix completion under structured non-uniform sampling.
result Error bounds for each entry match minimax lower bounds under certain conditions.
Proposes a new tensor grid method for image completion.
problem Image completion from missing data.
method Low-rank tensor grid with two-stage density matrix renormalization group initialization and alternating least squares factorization.
result The proposed tensor grid method outperforms existing methods in image recovery accuracy.
SGD with mini-batches can solve convex low-rank matrix problems efficiently.
problem Solving large-scale convex low-rank matrix problems efficiently.
method Stochastic Gradient Descent with mini-batches and low-rank projections.
result SGD with mini-batches produces low-rank iterates with high probability.
Paper extends matrix completion to nonlinear algebraic varieties.
problem Matrix completion for nonlinear algebraic varieties.
method Tensorization and Kronecker product approach.
result New method outperforms existing state-of-the-art methods.
Unified framework for nonconvex matrix completion with linearly parameterized factors.
problem Matrix completion with improved accuracy using linearly parameterized factors.
method Unified nonconvex optimization framework with Correlated Parametric Factorization condition.
result Uniform upper bounds for low-rank estimation at any local minimum.
Paper tackles clipped matrix recovery from scientific areas with theoretical and practical methods.
problem Recovering low-rank matrices from clipped observations in scientific areas.
method Trace-norm minimization algorithm and squared hinge loss with a novel regularization term.
result Theoretical guarantee and practical algorithms for exact recovery of clipped matrix completion.
Matrix completion works well for smooth non-linear structures, even without low-rank assumptions.
problem Matrix completion for smooth non-linear structures.
method Nuclear-norm penalization for matrices lying in a low-dimensional non-linear manifold.
result Nuclear-norm penalization is minimax rate optimal for recovering smooth non-linear matrices with missing data.
In this paper, we develop a relative error bound for nuclear norm regularized matrix completion, with the focus on the completion of full-rank matrices. Under the assumption that the top eigenspaces of the target matrix are incoherent, we derive a relative upper bound for recovering the best low-rank approximation of t…
New method for online low-rank matrix completion with improved regret.
problem Designing an efficient algorithm for online recommendation systems with low regret.
method Explore-then-commit (ETC) approach and iterative user clustering (OCTAL) for rank-1 setting.
result Nearly optimal regret bounds for online low-rank matrix completion.
New guarantees for matrix completion from any deterministic sampling patterns.
problem Proving guarantees for low-rank matrix completion from non-random sampling schemes.
method Introduced a graph with observed entries as edges to analyze the performance of constrained nuclear norm minimization algorithm.
result The algorithm can successfully complete the matrix if the observation graph is well-connected and has similar node degrees.
For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation matrix completion in various fields such as the financial market and the low-ra…
Review of robust PCA and matrix completion methods.
problem Robust Principal Component Analysis and matrix completion with outliers.
method Various provably correct, fast, and practical solutions to RPCA and matrix completion.
result Exhaustive review of recent literature on RPCA and dynamic RPCA.
ScaledGD improves gradient descent for ill-conditioned low-rank matrix estimation.
problem Efficiently solving ill-conditioned low-rank matrix estimation problems.
method Scaled Gradient Descent (ScaledGD) with adaptive pre-conditioners.
result Linear convergence rate independent of condition number, low per-iteration cost.
Survey of structured low-rank algorithms for MR signal recovery.
problem Recovering multidimensional signals from few non-uniform measurements.
method Structured low-rank matrix completion formulation.
result Performance guarantees and fast algorithms for large-scale MR problems.