arXiv research

Paper improves efficiency in matrix computations for Gaussian processes.

Accelerated RPCholesky speeds up kernel matrix approximations.

We provide a proof of backpropagation algorithm in matrix notation.

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix multiplication, that are robust to stragglers (i.e., machines that may perform slower …

Paper proposes diagnostics for error and variance estimation in randomized matrix computations.

We simplify matrix computations for block matrices, especially useful for covariance and correlation matrices.

Improved statistical computation through efficient matrix sampling.

A new algorithm speeds up matrix operations in Neural Networks.

In this paper, we propose an online algorithm to compute matrix factorizations. Proposed algorithm updates the dictionary matrix and associated coefficients using a single observation at each time. The algorithm performs low-rank updates to dictionary matrix. We derive the algorithm by defining a simple objective funct…

Efficiently computes matrix square roots and their inverses for large matrices.

We study the problem of computing the matrix exponential of a block triangular matrix in a peculiar way: Block column by block column, from left to right. The need for such an evaluation scheme arises naturally in the context of option pricing in polynomial diffusion models. In this setting a discretization process pro…

A new method computes link invariants from diagrams.

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian processes framework, the computational bottlenecks are the inversion of the (regulariz…

In this paper, we consider the streaming memory-limited matrix completion problem when the observed entries are noisy versions of a small random fraction of the original entries. We are interested in scenarios where the matrix size is very large so the matrix is very hard to store and manipulate. Here, columns of the o…

A distributed framework for reducing high-dimensional matrix-variate time series data.

Matrix profile has been recently proposed as a promising technique to the problem of all-pairs-similarity search on time series. Efficient algorithms have been proposed for computing it, e.g., STAMP, STOMP and SCRIMP++. All these algorithms use the z-normalized Euclidean distance to measure the distance between subsequ…

New method reduces computational cost for nonnegative low rank matrix approximation.

We consider the problem of finding anomalies in high-dimensional data using popular PCA based anomaly scores. The naive algorithms for computing these scores explicitly compute the PCA of the covariance matrix which uses space quadratic in the dimensionality of the data. We give the first streaming algorithms that use …

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$ operations. When $n,p$ are large, this computation may be prohibitively slow. Moreover, …

Localized sketching improves matrix multiplication and ridge regression complexity.

Matrix completion aims to predict missing elements in a partially observed data matrix which in typical applications, such as collaborative filtering, is large and extremely sparsely observed. A standard solution is matrix factorization, which predicts unobserved entries as linear combinations of latent variables. We g…

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms. This paper presents a randomized hierarchical alternating least squares (HALS) algorithm to comput…

Article presents QR and LQ decomposition algorithms for various matrix sizes and ranks.

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem ${\mathcal{NP}}$-hard. In this work, we prove that, if the matrix is positive semidefinite and its …

We develop matrix models for Grassmann, flag, and Stiefel manifolds.

Efficient approximations reduce computation of matrix-based Renyi's entropy.

Two algorithms estimate Wasserstein distance matrices from few entries for manifold learning.

New method tackles high-dimensional SBL without covariance matrices.

New method tackles over-parameterized matrix sensing with FGD, improving statistical and computational complexity.

New method improves robust low-rank matrix completion for computer vision.

Paper proposes a novel method to improve matrix completion with median loss for large datasets.

We introduce a "learning-based" algorithm for the low-rank decomposition problem: given an $n \times d$ matrix $A$, and a parameter $k$, compute a rank-$k$ matrix $A'$ that minimizes the approximation loss $\|A-A'\|_F$. The algorithm uses a training set of input matrices in order to optimize its performance. Specifical…

Linear regression models depend directly on the design matrix and its properties. Techniques that efficiently estimate model coefficients by partitioning rows of the design matrix are increasingly popular for large-scale problems because they fit well with modern parallel computing architectures. We propose a simple me…

Reservoir computing's success depends on mapping different input time series to separable states.

HyperINF improves influence function estimation for large models with better accuracy and efficiency.

Improved matrix approximation using randomized algorithms.

Develops a fast algorithm for fitting multilevel factor models.

Predicting unobserved entries of a partially observed matrix has found wide applicability in several areas, such as recommender systems, computational biology, and computer vision. Many scalable methods with rigorous theoretical guarantees have been developed for algorithms where the matrix is factored into low-rank co…

The smallest eigenvalues and the associated eigenvectors (i.e., eigenpairs) of a graph Laplacian matrix have been widely used in spectral clustering and community detection. However, in real-life applications the number of clusters or communities (say, $K$) is generally unknown a-priori. Consequently, the majority of t…

We simplify debiasing of LASSO estimates for practical computation.

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the partially observed matrix is of low-rank. We propose a new matrix approximation model w…

This project compares MCMC and VI for Bayesian PMF on MovieLens.

New algorithm for efficient prediction intervals in neural networks.

Paper explores statistical and computational limits of estimating low-rank Gaussian mixtures.

BiQGEMM efficiently multiplies quantized DNN weights using lookup tables.

Study on Gaussian ensemble of matrix products with mixed moments computed.

NGRC shows numerical instabilities with short lags and high-degree polynomials.

Advanced optimization algorithms such as Newton method and AdaGrad benefit from second order derivative or second order statistics to achieve better descent directions and faster convergence rates. At their heart, such algorithms need to compute the inverse or inverse square root of a matrix whose size is quadratic of …