arXiv research

Paper finds a lower bound for estimating low-rank matrices in logistic regression.

Solves weakly supervised regression using low-rank approximations and manifold regularization.

Novel method for efficient low-rank matrix estimation and bandit algorithms.

Low-rank matrix regression refers to the instances of recovering a low-rank matrix based on specially designed measurements and the corresponding noisy outcomes. In the last decade, numerous statistical methodologies have been developed for efficiently recovering the unknown low-rank matrices. However, in some applicat…

We solve robust regression and matrix completion problems with sparse and low-rank models.

Introduces a new model for mapping matrices to matrices, subsuming linear regression.

Paper studies quantized LRMR with random dithering for correlated tasks.

Proposes a new method for multivariate functional regression.

New approach to convex hulls for low-rank problems.

Unified approach for robust low rank matrix estimation with adversaries.

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general case with noisy observations, we show that our algorithm is guaranteed to linearl…

In this paper, we solve a semi-supervised regression problem. Due to the lack of knowledge about the data structure and the presence of random noise, the considered data model is uncertain. We propose a method which combines graph Laplacian regularization and cluster ensemble methodologies. The co-association matrix of…

Spectral algorithm reduces samples needed for multitask regression.

Paper develops DP methods for low-rank matrix estimation with near-optimal performance.

This paper studies how to sketch element-wise functions of low-rank matrices. Formally, given low-rank matrix A = [Aij] and scalar non-linear function f, we aim for finding an approximated low-rank representation of the (possibly high-rank) matrix [f(Aij)]. To this end, we propose an efficient sketching-based algorithm…

The paper examines how kernel approximations affect Gaussian process regression in large data applications.

Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict inductively on new users/movies. In this paper, we study the problem of inductive matr…

New model reduces matrix factorization bias, yielding truly low-rank solutions.

The effectiveness of supervised learning techniques has made them ubiquitous in research and practice. In high-dimensional settings, supervised learning commonly relies on dimensionality reduction to improve performance and identify the most important factors in predicting outcomes. However, the economic importance of …

Novel Fréchet regression method handles errors-in-variables with low-rank covariates.

CUR matrix decomposition is a randomized algorithm that can efficiently compute the low rank approximation for a given rectangle matrix. One limitation with the existing CUR algorithms is that they require an access to the full matrix A for computing U. In this work, we aim to alleviate this limitation. In particular, …

This work establishes always-valid risk bounds for online matrix completion.

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the low-rank matrix, and to run projected gradient descent on the nonconvex factoriz…

Improved kernel ridge regression using conjugate gradients.

New algorithms solve dense linear systems with low-rank structure efficiently.

This paper proposes robust matrix variate regression models with rank constraints and vector regularization.

Weight Decay induces low-rank weight matrices in neural networks, improving generalization.

New method uses nuclear and ℓ1 penalties for matrix regression, improving brain disorder detection.

Low-rank approximations of data matrices are an important dimensionality reduction tool in machine learning and regression analysis. We consider the case of categorical variables, where it can be formulated as the problem of finding low-rank approximations to Boolean matrices. In this paper we give what is to the best …

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size. This paper presents two parallel GP regression methods that exploit low-rank co…

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size. This paper presents two parallel GP regression methods that exploit low-rank co…

GL-LowPopArt improves minimax-optimal estimation for trace regression.

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low rank matrix $Θ^\star$ with a second matrix $Γ^\star$ endowed with a complementary …

Algorithm recovers multiple low-rank matrices from unlabeled data.

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample means given the observations. However, in many real applications with skewed and…

The paper improves matrix completion with auxiliary covariates using LS estimation.

Paper tackles matrix estimation under arbitrary noise, achieving minimax optimality.

Total least squares regression sped up with input sparsity time.

Exploiting low-rank structure of the user-item rating matrix has been the crux of many recommendation engines. However, existing recommendation engines force raters with heterogeneous behavior profiles to map their intrinsic rating scales to a common rating scale (e.g. 1-5). This non-linear transformation of the rating…

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the partially observed matrix is of low-rank. We propose a new matrix approximation model w…

New method improves robust low-rank matrix completion for computer vision.

New spectral methods improve matrix estimation in RL with low-rank structure.

SpINNEr uses matrix regression to analyze brain connectivity, improving accuracy over other methods.

We study the residual bootstrap (RB) method in the context of high-dimensional linear regression. Specifically, we analyze the distributional approximation of linear contrasts $c^{\top} (\hatβ_ρ-β)$, where $\hatβ_ρ$ is a ridge-regression estimator. When regression coefficients are estimated via least squares, classical…

New framework improves efficiency in low-rank matrix bandit problems.

New nonconvex regularizer speeds up low-rank matrix completion.

Efficient and accurate low-rank approximations of multiple data sources are essential in the era of big data. The scaling of kernel-based learning algorithms to large datasets is limited by the O(n^2) computation and storage complexity of the full kernel matrix, which is required by most of the recent kernel learning a…

The problem of low rank matrix completion is considered in this paper. To exploit the underlying low-rank structure of the data matrix, we propose a hierarchical Gaussian prior model, where columns of the low-rank matrix are assumed to follow a Gaussian distribution with zero mean and a common precision matrix, and a W…