This paper considers the recovery of a low-rank matrix from an observed version that simultaneously contains both (a) erasures: most entries are not observed, and (b) errors: values at a constant fraction of (unknown) locations are arbitrarily corrupted. We provide a new unified performance guarantee on when the natura…
HSNLD solves robust Hankel recovery efficiently and robustly.
problem Robust Hankel recovery of sparse outliers and missing entries.
method Hankel Structured Newton-Like Descent (HSNLD) algorithm.
result HSNLD achieves linear convergence independent of the condition number.
New method improves traffic data recovery for streaming data.
problem Improve data quality in traffic data for ITS.
method Online robust tensor recovery algorithm leveraging spatio-temporal correlations and local consistency.
result Significantly improved computational efficiency and high recovery accuracy.
We show that stochastic recovery always leads to counter-intuitive behaviors in the risk measures of a CDO tranche - namely, continuity on default and positive credit spread risk cannot be ensured simultaneously. We then propose a simple recovery variance regularization method to control the magnitude of negative credi…
New algorithm recovers matrices that are both low rank and sparse in rows and columns.
problem Recovering matrices that are simultaneously low rank and row/column sparse.
method Gradient Descent with hard Thresholding (GDT) algorithm to minimize a bi-convex function over a nonconvex set of constraints.
result GDT achieves linear convergence to near optimal solutions with statistical error.
New algorithm recovers model coefficients and supports from noisy data.
problem Simultaneous estimation and support recovery in linear models with Gaussian noise.
method Projection-based algorithm for STG regularized minimization problem, proving convergence and support recovery guarantees.
result New algorithm outperforms existing methods in support recovery for various data setups.
New method guarantees simultaneous decomposition of tensor components.
problem Existing methods fail to recover all tensor components simultaneously.
method S-ASI method using slicing initialization and subspace iterations.
result Guaranteed recovery of top r components simultaneously for symmetric tensors.
Matching Pursuit LASSIn Part I \cite{TanPMLPart1}, a Matching Pursuit LASSO ({MPL}) algorithm has been presented for solving large-scale sparse recovery (SR) problems. In this paper, we present a subspace search to further improve the performance of MPL, and then continue to address another major challenge of SR -- bat…
This paper improves credit risk analysis by incorporating state-dependent recovery rates into a factor model.
problem Accurate default forecasting in credit risk analysis.
method Extends a one-factor Gaussian copula model to include state-dependent recovery rates and a common factor.
result The proposed model outperforms other models in default prediction, especially during hectic periods.
This work provides a guaranteed tensor recovery method by combining low-rankness and smoothness priors.
problem Guaranteed tensor recovery with theoretical guarantees for low-rank and smoothness priors.
method Developed a new regularization term that combines low-rankness and smoothness priors, proving exact recovery guarantees.
result Rigorously proved exact recovery guarantees for tensor completion and tensor robust principal component analysis.
Paper proposes a multi-task model for CECT macromolecule classification, segmentation, and recovery.
problem Challenges in recognizing and recovering macromolecular structures due to structural diversity and imaging limitations.
method A novel multi-task 3D CNN model that shares learned features across tasks.
result Multi-task model outperforms single-task methods and discovers novel structures.
In this paper, we generalize Huber's criterion to multichannel sparse recovery problem of complex-valued measurements where the objective is to find good recovery of jointly sparse unknown signal vectors from the given multiple measurement vectors which are different linear combinations of the same known elementary vec…
GRRT recovers sparse signals without prior sparsity or noise variance knowledge.
problem Recovering sparse signals without prior sparsity or noise variance knowledge.
method Generalized residual ratio thresholding (GRRT) for SOMP and BOMP.
result Finite sample and finite SNR guarantees for exact support recovery.
New method recovers block-sparse signals with common sparsity patterns.
problem Recovering block-sparse signals with common sparsity patterns in MMV.
method Pattern-coupled hierarchical Gaussian prior model with EM framework.
result Proposed method automatically captures block sparse structure.
Refines pDCA_e for DC function minimization, with applications to sparse recovery and outlier detection.
problem Minimizing DC functions with specific properties.
method Refined convergence analysis of pDCA_e algorithm.
result The pDCA_e algorithm converges for level-bounded DC functions without differentiability assumptions.
RTC-GTNLN model recovers traffic data from missing values and noise.
problem Simultaneous missing data and noise in traffic data.
method Gradient tensor nuclear L1-L2 norm for robust tensor completion.
result RTC-GTNLN model outperforms existing methods in complex recovery scenarios.
Jointly learns feature and sample relevancies for robust sparse recovery.
problem Sparse recovery sensitivity to data contaminants like outliers or misspecified noise.
method Jointly learns feature and sample relevancies via marginal likelihood optimization.
result Consistent sparse and robust prediction models across diverse tasks.
Solves complex clustering and rotation synchronization problem.
problem Challenges in classifying and synchronizing rotated objects into multiple categories.
method Semidefinite programming relaxations to solve the joint problem of community detection and synchronization.
result Exact recovery of community detection and synchronization when extending stochastic block model.
In this paper we formulate a corporate bond (CB) pricing model for deriving the term structure of default probabilities (TSDP) and the recovery rate (RR) for each pair of industry factor and credit rating grade, and these derived TSDP and RR are regarded as what investors imply in forming CB prices in the market at eac…
We assume i.i.d. data sampled from a mixture distribution with K components along fixed d-dimensional linear subspaces and an additional outlier component. For p>0, we study the simultaneous recovery of the K fixed subspaces by minimizing the l_p-averaged distances of the sampled data points from any K subspaces. Under…
Paper proposes LC-Checkpoint for efficient deep learning model checkpoints.
problem Efficient construction of checkpoints for deep learning models.
method Lossy compression scheme using quantization and priority promotion with Huffman coding.
result LC-Checkpoint achieves up to 28x compression and 5.77x speedup over SCAR.
Develops robust knockoffs for controlling false discoveries in financial data.
problem Challenges in variable selection with highly correlated data in finance and economics.
method Robustified knockoff framework addressing high dependence and time correlation.
result Identifies new important groups of factors on top of known drivers.
The problem of population recovery refers to estimating a distribution based on incomplete or corrupted samples. Consider a random poll of sample size n conducted on a population of individuals, where each pollee is asked to answer d binary questions. We consider one of the two polling impediments: (a) in lossy pop…
New model captures long-term memory effects in epidemic dynamics.
problem Identifying memory effects in disease progression and recovery.
method Physics-informed neural networks (PINN) with fractional SEIRD model.
result Fractional memory order α improves predictive performance over classical models. We assume data independently sampled from a mixture distribution on the unit ball of the D-dimensional Euclidean space with K+1 components: the first component is a uniform distribution on that ball representing outliers and the other K components are uniform distributions along K d-dimensional linear subspaces restric…
For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation matrix completion in various fields such as the financial market and the low-ra…
Paper proposes GPM for simultaneous community detection and group synchronization.
problem Simultaneous community detection and group synchronization in networks.
method Generalized Power Method (GPM) for non-convex optimization.
result GPM achieves exact recovery in O(nlog2n) time, outperforming SDP. New clustering method recovers hidden tree structure from data.
problem Recovering hidden hierarchical structure in data.
method Maximum average dot product for merging clusters in hierarchical clustering.
result The algorithm produces a tree that accurately represents the underlying generative hierarchical structure.
Energy consumption is an important issue in continuous wireless telemonitoring of physiological signals. Compressed sensing (CS) is a promising framework to address it, due to its energy-efficient data compression procedure. However, most CS algorithms have difficulty in data recovery due to non-sparsity characteristic…
We study a data model in which the data matrix D can be expressed as D = L + S + C, where L is a low rank matrix, S an element-wise sparse matrix and C a matrix whose non-zero columns are outlying data points. To date, robust PCA algorithms have solely considered models with either S or C, but not both. As such, existi…
Spectral method for joint community detection and group synchronization.
problem Jointly detecting communities and synchronizing orthogonal groups in graphs.
method Spectral decomposition followed by CPQR factorization.
result Near-optimal guarantees for exact and stable recovery of cluster memberships and orthogonal transforms.
Sparse group Lasso optimizes sparse and grouped parameters in high-dimensional data.
problem Simultaneously sparse and grouped parameters in high-dimensional linear regression.
method Sparse group Lasso, debiased sparse group Lasso, statistical inference.
result Matching upper and lower bounds on sample complexity and estimation error.
Proposes methods to recover labels from shuffled networks using graph averages.
problem Recovering labels from a shuffled network using graph averages.
method Cluster networks into classes, then match the new graph to cluster-averages, minimizing the graph matching objective function.
result Higher fidelity matching performance when clustering networks into different classes.
GAME improves matrix completion by considering subgroup-specific latent structures.
problem Heterogeneous data with overlapping categories, smoothing away subgroup-specific variation.
method Group-Aware Matrix Estimation (GAME) with overlapping nuclear-norm penalties.
result GAME outperforms global low-rank estimators in structured missingness regimes.
Exact inference in structured prediction for various graphs.
problem Exact recovery of labels in structured prediction models.
method Analysis of graph structures and application of Cheeger's inequality.
result Exact recovery is possible and achievable in polynomial time for a large class of graphs.
Novel LRMC tackles missing data and outliers in large-scale low-rank data recovery.
problem Missing data and extreme outliers in low-rank data analysis.
method Learned Robust Matrix Completion (LRMC) using deep unfolding and flexible neural network framework.
result LRMC achieves optimum performance with low computational complexity and linear convergence.
We generalize Merton's asset valuation approach to systems of multiple financial firms where cross-ownership of equities and liabilities is present. The liabilities, which may include debts and derivatives, can be of differing seniority. We derive equations for the prices of equities and recovery claims under no-arbitr…
Unified framework for uniform signal recovery in nonlinear GCS with 1-bit/quantized measurements.
problem Uniform recovery guarantees for nonlinear generative compressed sensing.
method Unified framework using generalized Lasso and Lipschitz approximation.
result Uniform recovery of all signals in the ball up to an error of ε using approximately O(k/ε^2) samples.
Efficient algorithms recover two sparse models from a mix of linear queries.
problem Recovering two sparse models from a mix of linear queries.
method Efficient algorithms for query complexity problem.
result Improved query complexity for model recovery.
Mix-IRLS solves imbalanced mixed linear regression problems efficiently.
problem Imbalanced mixed linear regression problems.
method Sequential robust regression approach.
result Mix-IRLS outperforms other methods on imbalanced mixtures and real-world datasets.
New framework estimates graph from multimodal functional data.
problem Estimating graph from joint multimodal functional data.
method Integrative framework using partial correlation operator.
result Estimator converges to stationary point with quantifiable error.
Recovering a large matrix from limited measurements is a challenging task arising in many real applications, such as image inpainting, compressive sensing and medical imaging, and this kind of problems are mostly formulated as low-rank matrix approximation problems. Due to the rank operator being non-convex and discont…
Develops a method for estimating networks and covariate associations in compositional data.
problem Estimating network interactions and covariate associations for compositional data.
method Hierarchical Bayesian model with spike-and-slab priors for edge and covariate selection, variational EM for inference.
result The proposed method outperforms existing methods in network recovery accuracy.
A new method resolves permutation issues in shuffled linear regression for large-scale applications.
problem Estimating latent features through linear transformation with unknown permutations.
method Spectral matching method to align spectral components of measurement and feature covariances.
result Achieves accurate estimates in shuffled LS and LASSO settings with sufficient samples.
Paper tackles phase retrieval with robust gradient descent for noisy data.
problem Recover signals from magnitude measurements with noise and corruption.
method Robust gradient descent applied to Wirtinger Flow algorithm.
result Improves algorithm's robustness to heavy-tailed noise and adversarial corruption.
Bayesian Empirical Bayes extends EB to complex structures using probabilistic symmetry.
problem Improving simultaneous inference in complex settings like arrays and graphs.
method Generalized empirical Bayes approach based on probabilistic symmetry.
result BEB outperforms existing methods in denoising arrays and spatial data.
Paper estimates GMMs with unknown covariances using sparse regularization.
problem Estimating GMMs with unknown diagonal covariances from samples.
method Employed Beurling-LASSO (BLASSO) for sparse estimation of component means, covariances, and weights.
result Established non-asymptotic recovery guarantees with nearly parametric convergence rates.
A new framework CL embeds features and labels for multi-label classification.
problem Exponential growth of output space in multi-label classification.
method Compact Learning (CL) framework that embeds features and labels simultaneously.
result CMLL maximizes label-feature dependency and minimizes label space loss.