A new method for matrix completion identifies low-rank submatrices.
problem Matrix completion for non-low-rank matrices.
method Targeted framework: extract low-rank submatrices, complete separately.
result Significantly smaller reconstruction errors than classical methods.
A hierarchical Gaussian prior model improves low-rank matrix completion.
problem Low-rank matrix completion with improved structure exploitation.
method Hierarchical Gaussian prior model with GAMP embedded variational Bayesian inference.
result The proposed method outperforms state-of-the-art matrix completion methods.
Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the partially observed matrix is of low-rank. We propose a new matrix approximation model w…
New algorithms recover low-rank matrices from few noisy projections.
problem Estimating low-rank matrices from rank-one projections with noise.
method Two fast, non-convex algorithms for matrix recovery.
result Proposed algorithms achieve linear convergence and independent sample complexity of condition number.
New method improves robust low-rank matrix completion for computer vision.
problem Robust low-rank matrix completion for partially observed data.
method Formulated as a nonsmooth Riemannian optimization problem over Grassmann manifold, solved with an alternating manifold proximal gradient continuation method.
result Demonstrated advantages over existing approaches in background extraction from surveillance videos.
Unified framework for nonconvex low-rank matrix estimation using gradient descent.
problem Estimating low-rank matrices in noisy and noiseless settings.
method Gradient descent algorithm applied to nonconvex optimization.
result Unified framework guarantees linear convergence to the unknown low-rank matrix with optimal statistical error.
The paper tackles matrix estimation from noisy data, focusing on low-rank matrices.
problem Estimating a low-rank matrix from noisy observations.
method The paper analyzes several estimators, including constrained nuclear-norm minimization, nuclear-norm regularized least squares, and a nonconvex constrained low-rank optimization problem.
result The estimators provide upper error bounds that depend on matrix rank, observed fraction, and matrix sums, and are minimax optimal.
New spectral methods improve matrix estimation in RL with low-rank structure.
problem Estimating matrices with low-rank structure in reinforcement learning.
method Spectral-based matrix estimation approaches.
result Spectral methods efficiently recover singular subspaces and minimize entry-wise error.
New approach to convex hulls for low-rank problems.
problem Characterizing convex hulls for low-rank sets.
method Matrix perspective function and orthogonal projection matrices.
result Strong relaxations for various low-rank problems.
Paper proposes a method to recover rankings from limited comparisons using low-rank matrix completion.
problem Rank aggregation from pairwise comparisons with limited and noisy data.
method Low-rank matrix completion, alternating minimization algorithm, maximum likelihood estimation.
result Improved algorithm performance over state-of-the-art methods.
Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict inductively on new users/movies. In this paper, we study the problem of inductive matr…
Most recent results in matrix completion assume that the matrix under consideration is low-rank or that the columns are in a union of low-rank subspaces. In real-world settings, however, the linear structure underlying these models is distorted by a (typically unknown) nonlinear transformation. This paper addresses the…
New nonconvex regularizers improve low-rank matrix recovery efficiency and accuracy.
problem Efficiently recover low-rank matrices from incomplete data.
method Factor group-sparse regularization, related to Schatten-p norms.
result Improved generalization error bounds for Schatten-p norms as p decreases.
New model improves matrix completion under noisy conditions.
problem Noisy matrix completion with structured matrices.
method Introduces permutation-rank model, analyzes SVD algorithm.
result Minimax rates equivalent to low-rank model, consistent estimator.
New method solves matrix completion problems to certifiable optimality.
problem Certifying optimality in low-rank matrix completion.
method Disjunctive branch-and-bound scheme for convex relaxation.
result Decreases optimality gap by two orders of magnitude.
New nonconvex regularizer speeds up low-rank matrix completion.
problem Low-rank matrix completion with good theoretical and empirical performance.
method Proposes a new nonconvex regularizer with adaptive shrinkage, scalable, and fast optimization.
result Proposed method achieves state-of-the-art recovery performance and is the fastest.
Novel method for efficient low-rank matrix estimation and bandit algorithms.
problem Low-rank matrix estimation and bandit problems.
method LowPopArt method for low-rank matrix estimation and novel experimental design criterion.
result Improved recovery guarantees and regret bounds for low-rank bandit algorithms.
Four conditions ensure low-rank projection costs using random matrix tricks.
problem Preserving projection costs in low-rank approximations.
method Four structural conditions using randomized matrix techniques.
result Conditions guarantee cost preservation in rank-k projections. Low-rank matrices explain data science patterns.
problem Why do data matrices often have low rank?
method A generative model with latent variables and piecewise functions.
result Approximating large matrices with low rank is feasible.
Paper develops a new weighted low-rank matrix approximation technique.
problem Matrix completion with missing data.
method Element-wise weighted generalization of low-rank matrix approximation.
result Proposes an algorithm and acceleration techniques for solving the weighted problem.
We present a unified framework for low-rank matrix estimation with nonconvex penalties. We first prove that the proposed estimator attains a faster statistical rate than the traditional low-rank matrix estimator with nuclear norm penalty. Moreover, we rigorously show that under a certain condition on the magnitude of t…
SGD with mini-batches can solve convex low-rank matrix problems efficiently.
problem Solving large-scale convex low-rank matrix problems efficiently.
method Stochastic Gradient Descent with mini-batches and low-rank projections.
result SGD with mini-batches produces low-rank iterates with high probability.
Paper refines null space conditions for nuclear norm minimization in low-rank matrix recovery.
problem Establishing conditions for successful nuclear norm minimization recovery of low-rank matrices.
method Developed new null space conditions for nuclear norm minimization, proving their necessity and sufficiency.
result Weak null space condition is sufficient but not necessary for nuclear norm minimization recovery, providing a new necessary and sufficient condition.
New method solves nonsmooth low-rank matrix optimization problems efficiently.
problem Nonsmooth and low-rank matrix optimization problems in statistics and machine learning.
method Low-rank Extragradient Method with warm-start initialization.
result The extragradient method converges to an optimal solution with rate O(1/t) and requires only two low-rank SVDs per iteration. Improved stability for matrix recovery from rank-one measurements.
problem Phase retrieval problem of recovering rank-one positive semidefinite matrices.
method Developed a smoothing Newton method based on Bures-Wasserstein gradient descent.
result Superlinear convergence with rigorous guarantees and stable implementation.
New method for matrix completion using algebraic varieties.
problem Matrix completion with high-rank data.
method Algebraic variety mapping and kernel trick.
result Algorithm recovers data up to sampling complexity bounds.
Unified approach for robust low rank matrix estimation with adversaries.
problem Robust low rank matrix estimation in the presence of adversaries.
method Unified approach combining Huber loss and nuclear norm penalization.
result Sharp estimation error bounds for matrix compressed sensing and completion.
This paper tackles fitting multilevel low rank matrices by addressing three problems.
problem Fitting a given matrix by an MLR matrix in the Frobenius norm.
method Factor fitting, rank allocation, and hierarchical partitioning.
result The proposed methods can fit a given matrix by an MLR matrix in the Frobenius norm.
ScaledGD improves gradient descent for ill-conditioned low-rank matrix estimation.
problem Efficiently solving ill-conditioned low-rank matrix estimation problems.
method Scaled Gradient Descent (ScaledGD) with adaptive pre-conditioners.
result Linear convergence rate independent of condition number, low per-iteration cost.
New algorithm approximates large psd matrices from sketches.
problem Large-scale positive-semidefinite matrices from streaming data.
method Combines Nystrom approximation with rank truncation.
result Achieves prescribed relative error in Schatten 1-norm.
A1GM method improves efficiency in reconstructing missing data using KL divergence.
problem Efficiently reconstructing missing data in matrices.
method Fast non-gradient-based rank-1 NMF using KL divergence.
result A1GM outperforms gradient methods in efficiency with competitive reconstruction errors.
New method for matrix completion under complex missing data patterns.
problem Matrix completion with complex missing data patterns.
method Estimate the probability matrix of observation via low-rank matrix estimation and use inverse probabilities weighting to complete the target matrix.
result Optimal asymptotic convergence rates for observation probabilities and target matrix estimation.
Study nonconvex matrix completion for low-rank approximation without rank assumptions.
problem Low-rank approximation of positive semidefinite matrices from partial entries.
method Nonconvex optimization, local-minimum analysis, no spurious local minima.
result Improved sampling rate for nonconvex matrix completion with no spurious local minima.
Paper proposes a method for estimating complex low-rank matrices from phase-only measurements.
problem Estimating complex low-rank matrices from magnitude-only measurements.
method A hierarchical prior model with a Gaussian-Wishart distribution is used to promote low-rankness. A variational EM algorithm is developed to solve the problem.
result The proposed method is less sensitive to initialization and performs well with random initialization.
Develops methods to construct confidence regions for singular subspaces in low-rank matrix regression.
problem Recovering the singular subspace of a low-rank matrix from noisy measurements.
method Two-step procedure involving de-biasing and empirical singular vector calculation.
result Asymptotically normal joint projection distance for confidence regions of the true singular subspace.
Algorithm learns a better sketch matrix for low-rank approximations.
problem Efficiently compute low-rank approximations of large matrices.
method Uses a learned sketch matrix instead of random matrix for optimization.
result Learned sketch matrix reduces approximation loss significantly compared to random matrix.
Study shows generative priors improve rank-one matrix recovery with optimal sample complexity.
problem Recovering a rank-one signal matrix from noisy data with additional prior information.
method Analysis of a nonlinear least squares objective with a favorable global optimization landscape.
result Established optimal sample complexity for generative priors in rank-one matrix recovery.
Estimates low-rank distributional matrices from incomplete samples.
problem Matrix completion for distributional entries with limited observed data.
method Kernel mean embeddings, Tucker rank, functional unfolding operators.
result Effective estimator for distributional matrix completion established.
This paper sets fundamental limits for rank-one matrix estimation with varying noise levels.
problem Estimating a rank-one matrix from Gaussian observations with different noise levels across blocks.
method Novel reduction from heterogeneous noise to homogeneous noise, proving asymptotic error bounds.
result Asymptotically exact formulas for minimum mean-squared error in estimating rank-one matrix and factors.
New method reduces computational cost for nonnegative low rank matrix approximation.
problem Efficiently compute nonnegative low rank matrix approximation for nonnegative matrices.
method Alternating projections onto tangent spaces of fixed rank matrices manifold and nonnegative matrix manifold.
result Sequence converges linearly to optimal solutions, showing better performance in terms of computational time and accuracy.
New methods recover best rank-r approximations from few entries.
problem Recovering best rank-r approximations from limited data entries.
method Two agnostic approaches: spectral truncation and projected gradient descent.
result Projected gradient descent yields superior performance.
Rank-one measurements limit feasible sets for low-rank PSD matrices.
problem Feasibility of PSD matrices under rank-one measurements.
method Characterization of feasible sets for PSD matrices given rank-one projections.
result Radius of feasible sets determines singleton solution sets for low-rank matrices.
New algorithms improve RPCA for large matrices with upper rank bounds.
problem Efficiently decompose large matrices into low-rank and sparse parts.
method Combine regularization and matrix multiplication approaches with upper rank bounds.
result Proposed algorithms are faster and more robust than existing methods.
Paper determines rank of unknown low-rank data.
problem Determining the rank of unknown low-rank data.
method Analyzes various data models and provides upper bounds on rank based on sampled entries.
result Upper bounds on rank are equal to the true rank in many cases.
The paper examines how gradient descent stabilizes low-rank matrix factorization in noisy conditions.
problem Stability of low-rank implicit regularization in perturbed deep matrix factorization.
method Derives spectral conditions for gradient descent to exhibit a low-rank phase in noiseless settings and analyzes perturbed dynamics.
result Gradient descent converges to a low-rank solution under perturbation, with explicit dependence on perturbation size.
UA-LQE improves value function learning by selectively erasing uncertain entries in Q-matrix.
problem Improving value function learning in complex reinforcement learning tasks.
method Uncertainty-aware low-rank Q-matrix estimation (UA-LQE) algorithm.
result UA-LQE selectively erases uncertain entries in Q-matrix to improve value function approximation.
New algorithms improve transduction accuracy with low-rank data matrices.
problem Improving transduction accuracy with low-rank data matrices.
method Proposes two new algorithms using Smoothed Rank Function for transduction with Matrix Completion.
result Proposed methods outperform state-of-the-art methods in accuracy, especially in low observation rates.
Study robust recovery of low-rank matrices from corrupted measurements without rank prior.
problem Robust recovery of low-rank matrices from corrupted Gaussian measurements with unknown rank.
method Subgradient method with diminishing stepsizes for nonconvex nonsmooth problem.
result Subgradient method converges to exact low-rank solution at sublinear rate under RDPP condition.