arXiv research

Study shows DNNs can recover functions with fewer samples than model parameters at overparameterization.

This thesis presents the Conditional Value-at-Risk concept and combines an analysis that covers its application as a risk measure and as a vector norm. For both areas of application the theory is revised in detail and examples are given to show how to apply the concept in practice. In the first part, CVaR as a risk mea…

Unified approach to learn interpretable concepts from data.

In data stream mining, predictive models typically suffer drops in predictive performance due to concept drift. As enough data representing the new concept must be collected for the new concept to be well learnt, the predictive performance of existing models usually takes some time to recover from concept drift. To spe…

New SAE algorithm proves feature recovery for LLMs with theoretical guarantees.

We consider the numerical stability of the parameter recovery problem in Linear Structural Equation Model ($\LSEM$) of causal inference. A long line of work starting from Wright (1920) has focused on understanding which sub-classes of $\LSEM$ allow for efficient parameter recovery. Despite decades of study, this questi…

Given an overcomplete dictionary $A$ and a signal $b = Ac^*$ for some sparse vector $c^*$ whose nonzero entries correspond to linearly independent columns of $A$, classical sparse signal recovery theory considers the problem of whether $c^*$ can be recovered as the unique sparsest solution to $b = A c$. It is now well-…

New algorithms recover clusters with minimal queries, connecting margins to recoverability.

We connect Causal inference and low-rank recovery via RDT and free probability theory.

New method selects variables in groups with few nonzeros, improving support recovery.

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation matrix completion in various fields such as the financial market and the low-ra…

The paper analyzes sparse PCA for incomplete data and proves support recovery conditions.

Concept Factorization (CF) and its variants may produce inaccurate representation and clustering results due to the sensitivity to noise, hard constraint on the reconstruction error and pre-obtained approximate similarities. To improve the representation ability, a novel unsupervised Robust Flexible Auto-weighted Local…

In this paper, we investigate the unsupervised deep representation learning issue and technically propose a novel framework called Deep Self-representative Concept Factorization Network (DSCF-Net), for clustering deep features. To improve the representation and clustering abilities, DSCF-Net explicitly considers discov…

Low-rank modeling generally refers to a class of methods that solve problems by representing variables of interest as low-rank matrices. It has achieved great success in various fields including computer vision, data mining, signal processing and bioinformatics. Recently, much progress has been made in theories, algori…

In this paper, we study the problem of recovering a group sparse vector from a small number of linear measurements. In the past the common approach has been to use various "group sparsity-inducing" norms such as the Group LASSO norm for this purpose. By using the theory of convex relaxations, we show that it is also po…

Recovering a large matrix from limited measurements is a challenging task arising in many real applications, such as image inpainting, compressive sensing and medical imaging, and this kind of problems are mostly formulated as low-rank matrix approximation problems. Due to the rank operator being non-convex and discont…

HyperLISTA simplifies LISTA training with adaptive hyperparameters.

We derive an arbitrage free relationship between recovery swap rates, digital default swap spreads and conventional CDS spreads, and argue that the fair forward recovery rate used in recovery swaps must contain a convexity premium over the expected recovery value.

A new framework CL embeds features and labels for multi-label classification.

Method uses Seq2Seq learning to automatically generate recovery commands for ICT systems.

A new model explains U- and Swoosh-shaped stock price recovery during the COVID-19.

This paper improves support recovery in universal one-bit compressed sensing.

This work provides a guaranteed tensor recovery method by combining low-rankness and smoothness priors.

We discuss a general notion of "sparsity structure" and associated recoveries of a sparse signal from its linear image of reduced dimension possibly corrupted with noise. Our approach allows for unified treatment of (a) the "usual sparsity" and "usual $\ell_1$ recovery," (b) block-sparsity with possibly overlapping blo…

The restricted isometry property (RIP) is a universal tool for data recovery. We explore the implication of the RIP in the framework of generalized sparsity and group measurements introduced in the Part I paper. It turns out that for a given measurement instrument the number of measurements for RIP can be improved by o…

We consider the problem of signal recovery on graphs as graphs model data with complex structure as signals on a graph. Graph signal recovery implies recovery of one or multiple smooth graph signals from noisy, corrupted, or incomplete measurements. We propose a graph signal model and formulate signal recovery as a cor…

IRKSN algorithm achieves sparse recovery with wider applicability conditions.

Higher-order tensors can represent scores in a rating system, frames in a video, and images of the same subject. In practice, the measurements are often highly quantized due to the sampling strategies or the quality of devices. Existing works on tensor recovery have focused on data losses and random noises. Only a few …

In recent years research on credit risk modelling has mainly focused on default probabilities. Recovery rates are usually modelled independently, quite often they are even assumed constant. Then, however, the structural connection between recovery rates and default probabilities is lost and the tails of the loss distri…

Study optimal portfolio selection with Recovery Average Value at Risk, showing better control over liabilities.

The paper improves conditions for unique recovery in homomorphic sensing of subspaces.

HSNLD solves robust Hankel recovery efficiently and robustly.

Systems with long-range persistence and memory are shown to exhibit different precursory as well as recovery patterns in response to shocks of exogeneous versus endogeneous origins. By endogeneous, we envision either fluctuations resulting from an underlying chaotic dynamics or from a stochastic forcing origin which ma…

New method improves dictionary recovery from over-realized models.

Unified framework for pattern recovery in penalized and thresholded estimation.

Paper explores exact recovery of communities in weighted graphs using Gaussian and exponential distributions.

Guarantees sparse recovery for neural networks with iterative hard thresholding.

We propose and analyze a generic method for community recovery in stochastic block models and degree corrected block models. This approach can exactly recover the hidden communities with high probability when the expected node degrees are of order $\log n$ or higher. Starting from a roughly correct community partition …

New risk measure improves creditor protection in financial regulation.

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic noise, using block-$\ell_1$ regularization. While the current theory provides promis…

New method improves traffic data recovery for streaming data.

We consider the effect of recovery rates on a pool of credit assets. We allow the recovery rate to depend on the defaults in a general way. Using the theory of large deviations, we study the structure of losses in a pool consisting of a continuum of types. We derive the corresponding rate function and show that it has …

Unified framework for constructing nonconvex sparse recovery methods.

Improves sparse recovery with non-linear Fourier features.

We find that factors explaining bank loan recovery rates vary depending on the state of the economic cycle. Our modeling approach incorporates a two-state Markov switching mechanism as a proxy for the latent credit cycle, helping to explain differences in observed recovery rates over time. We are able to demonstrate ho…

While defaults are rare events, losses can be substantial even for credit portfolios with a large number of contracts. Therefore, not only a good evaluation of the probability of default is crucial, but also the severity of losses needs to be estimated. The recovery rate is often modeled independently with regard to th…

Study exact community recovery in noisy SBM with limited queries.