arXiv research

Unified analysis of matching pursuit and coordinate descent methods.

This paper closes the gap on matching pursuit's convergence rate.

New algorithm combines gradient and coordinate descent steps for faster convergence.

A new algorithm improves SSC clustering accuracy with low complexity.

Orthogonal Matching Pursuit (OMP) has long been considered a powerful heuristic for attacking compressive sensing problems; however, its theoretical development is, unfortunately, somewhat lacking. This paper presents an improved Restricted Isometry Property (RIP) based performance guarantee for T-sparse signal reconst…

Two of the most fundamental prototypes of greedy optimization are the matching pursuit and Frank-Wolfe algorithms. In this paper, we take a unified view on both classes of methods, leading to the first explicit convergence rates of matching pursuit methods in an optimization sense, for general sets of atoms. We derive …

Improved SSC clustering with reduced computation time and accuracy.

OOMP selects features online for sparse linear regression.

Paper proposes an accelerated algorithm for sparse subspace clustering.

New technique RRT improves OMP performance without knowing sparsity or noise.

Paper proves noise-tolerant SSC using greedy methods under coherence conditions.

Matching Pursuit LASSIn Part I \cite{TanPMLPart1}, a Matching Pursuit LASSO ({MPL}) algorithm has been presented for solving large-scale sparse recovery (SR) problems. In this paper, we present a subspace search to further improve the performance of MPL, and then continue to address another major challenge of SR -- bat…

DeepMP improves non-negative sparse recovery performance.

We propose a novel application of the Simultaneous Orthogonal Matching Pursuit (S-OMP) procedure for sparsistant variable selection in ultra-high dimensional multi-task regression problems. Screening of variables, as introduced in \cite{fan08sis}, is an efficient and highly scalable way to remove many irrelevant variab…

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex or a nonconvex cost function, which is a generalization of the matching pursuit…

This work defines observation-specific explanations for black-box models.

Proposes a new algorithm for Sparse Bayesian Learning connected to Stepwise Regression.

Distributed-OMP recovers sparse vectors with low communication costs.

The performance of Orthogonal Matching Pursuit (OMP) for variable selection is analyzed for random designs. When contrasted with the deterministic case, since the performance is here measured after averaging over the distribution of the design matrix, one can have far less stringent sparsity constraints on the coeffici…

OMP improves text classification accuracy with sparse models.

In this paper, we present new results on using orthogonal matching pursuit (OMP), to solve the sparse approximation problem over redundant dictionaries for complex cases (i.e., complex measurement vector, complex dictionary and complex additive white Gaussian noise (CAWGN)). A sufficient condition that OMP can recover …

In this paper, we consider the problem of compressed sensing where the goal is to recover almost all the sparse vectors using a small number of fixed linear measurements. For this problem, we propose a novel partial hard-thresholding operator that leads to a general family of iterative algorithms. While one extreme of …

GRRT recovers sparse signals without prior sparsity or noise variance knowledge.

Efficiently decomposes tensors with Boolean factors using BMP.

This paper studies the effect of discretizing the parametrization of a dictionary used for Matching Pursuit decompositions of signals. Our approach relies on viewing the continuously parametrized dictionary as an embedded manifold in the signal space on which the tools of differential (Riemannian) geometry can be appli…

We propose a novel sparse preference learning/ranking algorithm. Our algorithm approximates the true utility function by a weighted sum of basis functions using the squared loss on pairs of data points, and is a generalization of the kernel matching pursuit method. It can operate both in a supervised and a semi-supervi…

A new greedy method tackles $\ell_{0,\infty}$ sparse coding for better image processing.

Chebyshev Greedy Algorithm is a generalization of the well known Orthogonal Matching Pursuit defined in a Hilbert space to the case of Banach spaces. We apply this algorithm for constructing sparse approximate solutions (with respect to a given dictionary) to convex optimization problems. Rate of convergence results in…

Paper proposes online learning for MIMO channel estimation using neural networks.

Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and classification. It is well-known that solving for the sparse coefficient vector to ma…

Sparsity-based subspace clustering algorithms have attracted significant attention thanks to their excellent performance in practical applications. A prominent example is the sparse subspace clustering (SSC) algorithm by Elhamifar and Vidal, which performs spectral clustering based on an adjacency matrix obtained by sp…

Paper improves compressed sensing with prior probability information.

Subspace clustering methods based on $\ell_1$, $\ell_2$ or nuclear norm regularization have become very popular due to their simplicity, theoretical guarantees and empirical success. However, the choice of the regularizer can greatly impact both theory and practice. For instance, $\ell_1$ regularization is guaranteed t…

Sparsity-constrained optimization is an important and challenging problem that has wide applicability in data mining, machine learning, and statistics. In this paper, we focus on sparsity-constrained optimization in cases where the cost function is a general nonlinear function and, in particular, the sparsity constrain…

The study analyzes group testing algorithms for identifying defective items with high confidence.

In this paper, we propose an efficient and scalable low rank matrix completion algorithm. The key idea is to extend orthogonal matching pursuit method from the vector case to the matrix case. We further propose an economic version of our algorithm by introducing a novel weight updating rule to reduce the time and stora…

This paper considers a recently emerged hyperspectral unmixing formulation based on sparse regression of a self-dictionary multiple measurement vector (SD-MMV) model, wherein the measured hyperspectral pixels are used as the dictionary. Operating under the pure pixel assumption, this SD-MMV formalism is special in that…

Max-plus algebra approximates MDP value iteration for reduced state space.

New algorithm targets nonsmooth constraints for robust data interpolation and denoising.

Modern statistical applications involving large data sets have focused attention on statistical methodologies which are both efficient computationally and able to deal with the screening of large numbers of different candidate models. Here we consider computationally efficient variational Bayes approaches to inference …

Efficiently poisons offline RLHF models by flipping preference labels.

Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.

Orthogonal matching pursuit (OMP) is a widely used compressive sensing (CS) algorithm for recovering sparse signals in noisy linear regression models. The performance of OMP depends on its stopping criteria (SC). SC for OMP discussed in literature typically assumes knowledge of either the sparsity of the signal to be e…

Thompson Sampling improves pursuit-evasion coordination.

Isometry pursuit identifies orthonormal submatrices from wide matrices.

Proposes a novel neural architecture for sparse coding using learned greedy pursuit.

Robust STAP with coprime arrays reduces clutter using sparse modeling.

We study a form of cyclic pursuit on Riemannian manifolds with positive injectivity radius. We conjecture that on a compact manifold, the piecewise geodesic loop formed by connecting consecutive pursuit agents either collapses in finite time or converges to a closed geodesic. The main result is that this conjecture is …