Convex optimization with expander matrices improves sparse recovery efficiency.
problem Sparse recovery from linear measurements using expander matrices.
method Use of expander matrices for linear sketches in convex optimization to recover block-sparse matrices.
result The recovery error can be expressed in terms of the model-based norm, ensuring the solution is within the model.
We derive an arbitrage free relationship between recovery swap rates, digital default swap spreads and conventional CDS spreads, and argue that the fair forward recovery rate used in recovery swaps must contain a convexity premium over the expected recovery value.
Robust tensor recovery plays an instrumental role in robustifying tensor decompositions for multilinear data analysis against outliers, gross corruptions and missing values and has a diverse array of applications. In this paper, we study the problem of robust low-rank tensor recovery in a convex optimization framework,…
We analyze a non-convex landscape for robust subspace recovery and prove exact recovery conditions.
problem Analyzing the robustness of subspace recovery in non-convex energy landscapes.
method Mathematical analysis and proof of conditions for exact recovery of the underlying subspace.
result A geodesic gradient descent method can exactly recover the underlying subspace under specific conditions.
Paper proposes a new clustering model that preserves cluster recovery with fewer dimensions.
problem Clustering high-dimensional data with limited embedding dimensions.
method Randomly projected convex clustering model with improved embedding dimension.
result Cluster recovery can be preserved with fewer dimensions, independent of data points.
Study iterative regularization for linear models with convex bias, improving robust sparse recovery.
problem Improving robust sparse recovery with iterative regularization for linear models.
method Primal-dual gradient approach, analyzing convergence in presence of noise, combining regularization and optimization.
result Theoretical results show state-of-the-art performances with computational speed-ups.
Global optimization for low-rank matrix recovery from noisy measurements.
problem Low-rank matrix recovery from noisy measurements.
method Factorized parametrization, curvature bound, stochastic gradient descent.
result Global convergence guarantee for stochastic gradient descent from random initialization.
New CSIM index improves image patch recovery from missing data.
problem Recovering missing image samples using sparse representation.
method Proposes a new convex similarity index (CSIM) and an iterative sparse recovery method.
result Proves the convergence of the algorithm to the globally optimal solution.
This work aims at recovering signals that are sparse on graphs. Compressed sensing offers techniques for signal recovery from a few linear measurements and graph Fourier analysis provides a signal representation on graph. In this paper, we leverage these two frameworks to introduce a new Lasso recovery algorithm on gra…
New method proves exact recovery for tensor decomposition under reshuffling.
problem Numerical defects limit practical applications of tensor decomposition.
method Proves exact-recovery property for latent convex tensor decomposition using reshuffling.
result Generalized LCTD achieves exact recovery under reshuffling.
Our work is focused on the joint sparsity recovery problem where the common sparsity pattern is corrupted by Poisson noise. We formulate the confidence-constrained optimization problem in both least squares (LS) and maximum likelihood (ML) frameworks and study the conditions for perfect reconstruction of the original r…
Paper proposes a new method for recovering missing samples in images.
problem Missing sample recovery in image signals.
method Iterative sparse recovery algorithm using constrained l1-norm minimization with a new CSIM fidelity metric. result Simulation results demonstrate the efficiency of the proposed method.
Study identifies key differences in convex relaxations for combinatorial penalties.
problem Understanding which structures are preserved by convex relaxations for combinatorial penalties.
method Examined homogeneous and non-homogeneous convex relaxations, introduced lower combinatorial envelope, and proposed adaptive estimator.
result Identified new necessary and sufficient conditions for support recovery in convex monotone regularizers.
Solves signal recovery from few linear measurements using convex duality.
problem Recovering signals from limited linear measurements in various applications.
method Develops a convex-concave min-max reformulation for linear inverse problems.
result Simple ascent-descent algorithms for solving linear inverse problems.
Convex program recovers mixture components in well-separated data.
problem Mixed linear regression with well-separated classes.
method Second-order cone program based on L1 minimization.
result The convex program exactly recovers mixture components under well-separation assumptions.
We consider the mixed regression problem with two components, under adversarial and stochastic noise. We give a convex optimization formulation that provably recovers the true solution, and provide upper bounds on the recovery errors for both arbitrary noise and stochastic noise settings. We also give matching minimax …
This paper advances FL algorithms for composite optimization and statistical recovery.
problem Federated learning optimization and statistical recovery in composite settings.
method Proposes Fast Federated Dual Averaging for strongly convex and smooth loss, and Multi-stage Federated Dual Averaging for restricted strongly convex and smooth loss.
result Establishes state-of-the-art iteration and communication complexity, and high probability complexity bound with linear speedup.
The paper tackles partial inference in structured prediction using a convex optimization approach.
problem Maximizing a score function with unary and pairwise potentials in graph label spaces.
method Generative model approach with two-stage convex optimization for label recovery.
result Conditions for recovering a majority of labels with provable guarantees.
New algorithm recovers model coefficients and supports from noisy data.
problem Simultaneous estimation and support recovery in linear models with Gaussian noise.
method Projection-based algorithm for STG regularized minimization problem, proving convergence and support recovery guarantees.
result New algorithm outperforms existing methods in support recovery for various data setups.
The subdifferential of convex functions of the singular spectrum of real matrices has been widely studied in matrix analysis, optimization and automatic control theory. Convex analysis and optimization over spaces of tensors is now gaining much interest due to its potential applications to signal processing, statistics…
New method recovers sparse vectors from compressed, noisy data.
problem Recovering sparse vectors from compressed and noisy measurements.
method Non-convex quadratic programming exploiting prior magnitude information.
result More efficient support recovery with sufficient conditions for success.
Convex optimization method recovers low-rank matrices from rank-one projections efficiently.
problem Recovering low-rank matrices from limited rank-one projections.
method Unlifted convex optimization with subgradient method.
result The estimator succeeds with high probability if the number of measurements exceeds r2(d1+d2) up to logarithmic factors. Paper proves tensor ring completion with high probability using convex optimization.
problem Recovering a multi-dimensional array from limited measurements.
method Tensor ring decomposition and convex optimization.
result High probability exact recovery with n^{d/2} r^2 ln^7(n^{d/2}) samples.
New AMP algorithm solves hard non-convex sparse recovery problem.
problem Sparse signal recovery with spike and slab priors.
method Greedy and adaptive matching pursuit algorithm.
result Superior cost-quality trade-off over existing alternatives.
Paper introduces a new regularization method for visual representations.
problem Learning sparse visual representations from over-complete data.
method Proposes leaky capped norm regularization (LCNR) and a majorization-minimization algorithm.
result LCNR outperforms ℓ1 regularization in monocular 3D shape recovery. Proposes a new sparse recovery method using generalized error function.
problem Sparse recovery in signal processing and imaging.
method Introduces a penalty function with shape and scale parameters for sparse recovery.
result The method improves MRI reconstruction and is theoretically sound.
New algorithm clusters networks with outliers, achieving exact recovery.
problem Clustering networks with outliers and degree corrections.
method Convex optimization with a penalization term for positive deviations.
result Achieves exact recovery of clusters under mild conditions.
Estimates spatio-temporal Hawkes processes using tensor recovery.
problem Estimating influence functions for spatio-temporal Hawkes processes.
method Formulates influence function as a tensor kernel, assumes low-rank structure, solves as convex optimization problem.
result Provides theoretical guarantees and demonstrates efficiency with simulations.
In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, a…
New bounds for convex clustering under graph connectivity.
problem Understanding clustering performance under different graph connectivity structures.
method Random walks and concentration inequalities for random graph models.
result Improved rates of convergence for centroid recovery.
HSNLD solves robust Hankel recovery efficiently and robustly.
problem Robust Hankel recovery of sparse outliers and missing entries.
method Hankel Structured Newton-Like Descent (HSNLD) algorithm.
result HSNLD achieves linear convergence independent of the condition number.
Paper solves TRPCA problem for tensor data with new tensor nuclear norm.
problem Exact recovery of tensor low-rank and sparse components.
method Introduces tensor-tensor product and new tensor nuclear norm to solve TRPCA.
result The new tensor nuclear norm guarantees exact recovery of tensor data.
New method recovers clusters in non-convex finite metric spaces with oracle queries.
problem Exact recovery of clusters in non-convex finite metric spaces.
method Introducing (β,γ)-convexity and a deterministic algorithm using oracle queries. result Clusters can be recovered using O(k2logn+k2(6/βγ)dens(X)) same-cluster queries. STARK learns structured dictionaries for tensor data.
problem Representing multidimensional data with structured dictionaries.
method Solves a convex relaxation of a nonconvex rank-1 tensor recovery problem.
result Empirical results show promising performance for tensors of any order.
This study improves graph signal denoising for vector-valued data with non-convex penalties.
problem Denoising piecewise smooth graph signals with varying smoothness levels.
method Extended graph trend filtering with non-convex penalties and ADMM algorithm.
result Non-convex penalties outperform convex ones in recovery performance.
New algorithms recover low-rank matrices from few noisy projections.
problem Estimating low-rank matrices from rank-one projections with noise.
method Two fast, non-convex algorithms for matrix recovery.
result Proposed algorithms achieve linear convergence and independent sample complexity of condition number.
The paper provides recovery guarantees for CNNs with multiple kernels under polynomial sample and computational complexities.
problem Parameter recovery for non-overlapping CNNs with multiple kernels.
method Showed local strong convexity of squared loss for most popular activations, used tensor methods for initialization, and proved convergence of gradient descent.
result Gradient descent following tensor initialization converges to the global optimal with polynomial time complexity.
New method estimates GGLM parameters, overcoming non-convexity.
problem Estimating parameters in GGLM with dependencies.
method Monotone operator-based variational inequality method.
result Guarantees for parameter recovery in GLM and GGLM.
Survey on nonconvex penalties for sparse and low-rank recovery in various fields.
problem Achieving sparsity and low-rankness in signal processing, statistics, and machine learning.
method Analysis of nonconvex penalties and their applications.
result Nonconvex penalties can significantly improve performance in various applications.
Paper tackles community recovery in binary symmetric SBM graphs.
problem Community detection in binary symmetric SBM graphs.
method Proposes a two-stage iterative method using projected power iterations and orthogonal iterations.
result Proposed method can exactly recover communities with high probability in logarithmic sparsity regime.
Convex optimization refines neural network training, improving model performance and reducing hyperparameter sensitivity.
problem Training deep neural networks using non-convex optimization methods often leads to suboptimal solutions and requires extensive tuning.
method Formulate neural network training as convex programs with regularization terms, leveraging sparse recovery models and semi-infinite programming theory.
result Convex models can achieve global optima and outperform traditional non-convex methods, with improved robustness to hyperparameters.
In recent years, spectral clustering has become a standard method for data analysis used in a broad range of applications. In this paper we propose a new class of algorithms for multiway spectral clustering based on optimization of a certain "contrast function" over the unit sphere. These algorithms, partly inspired by…
Given the superposition of a low-rank matrix plus the product of a known fat compression matrix times a sparse matrix, the goal of this paper is to establish deterministic conditions under which exact recovery of the low-rank and sparse components becomes possible. This fundamental identifiability issue arises with tra…
New model for multivariate discrete event data with flexible interactions.
problem Modeling multivariate discrete event data with categorical interactions.
method Developed a new modeling approach with convex constraints, two estimation procedures (LS and ML).
result Proposed model can capture arbitrary shapes of historical event influence.
Extends convex clustering to graph-structured data.
problem Handling graph-structured data with convex clustering.
method Formulates a convex objective and uses a proximal dual algorithm for efficient recovery.
result Demonstrates the effectiveness of the method on real-life datasets.
This work solves TRPCA under linear transforms, recovering low-rank and sparse components.
problem Exact recovery of tensor low-rank and sparse components from their sum.
method Convex optimization with weighted tensor nuclear norm and ℓ1-norm.
result The convex program exactly recovers the components under certain incoherence conditions.
Paper proposes a new method for exact recovery in robust tensor principal component analysis.
problem Exact recovery of low-rank and sparse components in tensors.
method Proposes a new method based on tensor-tensor product and t-SVD to solve a convex optimization problem.
result Exact recovery achieved in a deterministic fashion without randomness assumptions.
In this paper we introduce a new optimization formulation for sparse regression and compressed sensing, called CLOT (Combined L-One and Two), wherein the regularizer is a convex combination of the ℓ1- and ℓ2-norms. This formulation differs from the Elastic Net (EN) formulation, in which the regularizer is a…