arXiv research

The paper studies phase transitions in random matrices and tensor unfolding for detecting signals.

The interplay between computational efficiency and statistical accuracy in high-dimensional inference has drawn increasing attention in the literature. In this paper, we study computational and statistical boundaries for submatrix localization. Given one observation of (one or multiple non-overlapping) signal submatrix…

Paper discusses new stochastic algorithms for sparse signal recovery.

Estimates KRR risk from training data for various kernels and hyperparameters.

Study of Langevin dynamics for tensor PCA recovery in high dimensions.

We develop mask iterative hard thresholding algorithms (mask IHT and mask DORE) for sparse image reconstruction of objects with known contour. The measurements follow a noisy underdetermined linear model common in the compressive sampling literature. Assuming that the contour of the object that we wish to reconstruct i…

Study evaluates thresholds for removing noise from DNN weights using random matrix theory.

New algorithm resists contamination in high-dimensional regression with optimal performance.

MLShrink integrates machine learning with wavelet shrinkage for denoising.

This work interprets GELU and related activations via a first-order loss function.

Simultaneous orthogonal matching pursuit (SOMP) and block OMP (BOMP) are two widely used techniques for sparse support recovery in multiple measurement vector (MMV) and block sparse (BS) models respectively. For optimal performance, both SOMP and BOMP require \textit{a priori} knowledge of signal sparsity or noise vari…

Study on detecting and recovering hidden dense cycles in random graphs.

Optimizes portfolio with two controls to minimize trades and maintain signal integrity.

Paper tackles 1-bit compressed sensing, presenting efficient algorithm for sparse signal estimation.

Iterative shrinkage/thresholding algorithm (ISTA) is a well-studied method for finding sparse solutions to ill-posed inverse problems. In this letter, we present a data-driven scheme for learning optimal thresholding functions for ISTA. The proposed scheme is obtained by relating iterations of ISTA to layers of a simpl…

In high-dimensional classification settings, we wish to seek a balance between high power and ensuring control over a desired loss function. In many settings, the points most likely to be misclassified are those who lie near the decision boundary of the given classification method. Often, these uninformative points sho…

In this paper, we investigate a multivariate multi-response (MVMR) linear regression problem, which contains multiple linear regression models with differently distributed design matrices, and different regression and output vectors. The goal is to recover the support union of all regression vectors using $l_1/l_2$-reg…

Study detects signals in spiked Wigner models using log likelihood ratio.

A new neural network captures and explains trajectory patterns.

Study reveals limits of PLS in multi-modal learning with correlated signals.

Improved AI lung ultrasound segmentation using expert confidence values.

In this paper, we implement multi-label neural networks with optimal thresholding to identify gas species among a multi gas mixture in a cluttered environment. Using infrared absorption spectroscopy and tested on synthesized spectral datasets, our approach outperforms conventional binary relevance - partial least squar…

Study on signal-plus-noise decomposition in nonlinear spiked random matrices.

In this paper we propose a mathematical framework to address the uncertainty emergingwhen the designer of a trading algorithm uses a threshold on a signal as a control. We rely ona theorem by Benveniste and Priouret to deduce our Inventory Asymptotic Behaviour (IAB)Theorem giving the full distribution of the inventory …

Simple online monitor detects unsafe LLM outputs.

In recent years, unfolding iterative algorithms as neural networks has become an empirical success in solving sparse recovery problems. However, its theoretical understanding is still immature, which prevents us from fully utilizing the power of neural networks. In this work, we study unfolded ISTA (Iterative Shrinkage…

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical optimization of such penalties involves solving problems with l1-norms in the ob…

This paper establishes conditions for sparse signal recovery with sparse measurements.

This letter presents the sparse vector signal detection from one bit compressed sensing measurements, in contrast to the previous works which deal with scalar signal detection. In this letter, available results are extended to the vector case and the GLRT detector and the optimal quantizer design are obtained. Also, a …

We study a spectral initialization method that serves a key role in recent work on estimating signals in nonconvex settings. Previous analysis of this method focuses on the phase retrieval problem and provides only performance bounds. In this paper, we consider arbitrary generalized linear sensing models and present a …

An algorithmically hard phase was described in a range of inference problems: even if the signal can be reconstructed with a small error from an information theoretic point of view, known algorithms fail unless the noise-to-signal ratio is sufficiently small. This hard phase is typically understood as a metastable bran…

Paper improves privacy-preserving measurement of advertising incrementality.

This paper presents a novel Block Iterative Bayesian Algorithm (Block-IBA) for reconstructing block-sparse signals with unknown block structures. Unlike the existing algorithms for block sparse signal recovery which assume the cluster structure of the nonzero elements of the unknown signal to be independent and identic…

We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that a certain number of generic rank-one or generic linear measurements are suffici…

Study detects signal in financial stock correlations using phase-ordering kinetics.

Much of modern practice in financial forecasting relies on technicals, an umbrella term for several heuristics applying visual pattern recognition to price charts. Despite its ubiquity in financial media, the reliability of its signals remains a contentious and highly subjective form of 'domain knowledge'. We investiga…

Coherent Multiplex analyzes real-time wavelet coherence among multiple signals.

Prospective display advertising poses a great challenge for large advertising platforms as the strongest predictive signals of users are not eligible to be used in the conversion prediction systems. To that end efforts are made to collect as much information as possible about each user from various data sources and to …

New method detects communities in complex hypergraphs, matching theoretical limits.

Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.

Study shows TAR model captures leverage effect in financial series.

Unified analysis of neural networks for sparse signal recovery.

In this letter, we propose enhanced factored three way restricted Boltzmann machines (EFTW-RBMs) for speech detection. The proposed model incorporates conditional feature learning by multiplying the dynamical state of the third unit, which allows a modulation over the visible-hidden node pairs. Instead of stacking prev…

AIHT improves online high-dimensional quantile regression by separating support discovery and refinement.

We analyze why some models resist unlearning using linear stability theory.

GEM learns a manifold for cross-modal data, capturing structure without modality dependence.

Paper learns hypergraph structures from signals with smoothness priors.

Study reveals efficient recovery of multi-modal signals via Bayesian methods and sequential learning.