arXiv research

Framework learns continuous dynamics from sparse trajectories.

Paper solves k-sparse parity problem with sign SGD, matching SQ lower bound.

OOMP selects features online for sparse linear regression.

We study sparse group Lasso for high-dimensional double sparse linear regression, where the parameter of interest is simultaneously element-wise and group-wise sparse. This problem is an important instance of the simultaneously structured model -- an actively studied topic in statistics and machine learning. In the noi…

Matching Pursuit LASSIn Part I \cite{TanPMLPart1}, a Matching Pursuit LASSO ({MPL}) algorithm has been presented for solving large-scale sparse recovery (SR) problems. In this paper, we present a subspace search to further improve the performance of MPL, and then continue to address another major challenge of SR -- bat…

Expands sparse disparity cues from LiDAR to improve stereo matching performance.

FM4PDE learns PDE solutions from sparse data.

DeepMP improves non-negative sparse recovery performance.

Sparse text alignments learned via optimal transport improve model explainability.

Sparse coding has been popularly used as an effective data representation method in various applications, such as computer vision, medical imaging and bioinformatics, etc. However, the conventional sparse coding algorithms and its manifold regularized variants (graph sparse coding and Laplacian sparse coding), learn th…

Transforming sparse outcomes into dense process rewards for efficient reinforcement learning.

GRRT recovers sparse signals without prior sparsity or noise variance knowledge.

Bayesian method improves dictionary learning for complex problems.

Sparse Subspace Clustering (SSC) is one of the most popular methods for clustering data points into their underlying subspaces. However, SSC may suffer from heavy computational burden. Orthogonal Matching Pursuit applied on SSC accelerates the computation but the trade-off is the loss of clustering accuracy. In this pa…

Proposes a new algorithm for Sparse Bayesian Learning connected to Stepwise Regression.

New algorithm finds sparse matrices on Stiefel manifold for optimisation.

Orthogonal Matching Pursuit (OMP) has long been considered a powerful heuristic for attacking compressive sensing problems; however, its theoretical development is, unfortunately, somewhat lacking. This paper presents an improved Restricted Isometry Property (RIP) based performance guarantee for T-sparse signal reconst…

Distributed-OMP recovers sparse vectors with low communication costs.

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the modified ADMM method has an optimal convergence rate of $\mathcal{O}(s\log d/T)$, w…

Sparse Vision MoE matches dense networks in image recognition while using less compute.

Algorithm matches vertices of correlated Erdős-Rényi graphs efficiently.

In this paper, we study the information-theoretic limits of community detection in the symmetric two-community stochastic block model, with intra-community and inter-community edge probabilities $\frac{a}{n}$ and $\frac{b}{n}$ respectively. We consider the sparse setting, in which $a$ and $b$ do not scale with $n$, and…

New approach to sparse optimal transport for matching tokens with experts.

Sparse neural networks can match dense models on Lipschitz functions.

Paper proves noise-tolerant SSC using greedy methods under coherence conditions.

In this paper, we present new results on using orthogonal matching pursuit (OMP), to solve the sparse approximation problem over redundant dictionaries for complex cases (i.e., complex measurement vector, complex dictionary and complex additive white Gaussian noise (CAWGN)). A sufficient condition that OMP can recover …

We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time increments and arbitrary sparseness, which is in contrast with gradient matching that…

Paper tightens variational GP approximations for large datasets.

IDS improves sparse linear bandits by balancing information and regret.

New method smooths optimization for sparse regularization.

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can be computed one by one, repeatedly solving the single-component problem and def…

Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.

New method improves matrix completion accuracy, especially in noisy data.

Graph matching with feature vectors is solved using a two-layer graph neural network.

New algorithm improves PPS for multi-object matching.

Demixing problems in many areas such as hyperspectral imaging and differential optical absorption spectroscopy (DOAS) often require finding sparse nonnegative linear combinations of dictionary elements that match observed data. We show how aspects of these problems, such as misalignment of DOAS references and uncertain…

3BASiL-TM decomposes LLMs into sparse and low-rank matrices for efficient compression.

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse PCA. We give the first practically viable robust estimators for these problems.…

We study sparse approximation by greedy algorithms. We prove the Lebesgue-type inequalities for the Weak Chebyshev Greedy Algorithm (WCGA), a generalization of the Weak Orthogonal Matching Pursuit to the case of a Banach space. The main novelty of these results is a Banach space setting instead of a Hilbert space setti…

We consider the high-dimensional sparse linear regression problem of accurately estimating a sparse vector using a small number of linear measurements that are contaminated by noise. It is well known that the standard cadre of computationally tractable sparse regression algorithms---such as the Lasso, Orthogonal Matchi…

Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and classification. It is well-known that solving for the sparse coefficient vector to ma…

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learning is limited to sparse coding where extracting representations for new data can be computationally intensive. Here, we begin by demonstrat…

PopArt efficiently solves sparse linear bandits with tighter recovery guarantees.

Paper tackles graph matching with partially correct seeds, improving performance guarantees.

Greedy algorithm performs well in online matching despite non-i.i.d. connections.

Orthogonal matching pursuit (OMP) is a widely used compressive sensing (CS) algorithm for recovering sparse signals in noisy linear regression models. The performance of OMP depends on its stopping criteria (SC). SC for OMP discussed in literature typically assumes knowledge of either the sparsity of the signal to be e…

HARFE approximates sparse additive functions using random features and ridge regression.

New guarantees for Group LASSO in sparse convex optimization.