High signal to noise ratio (SNR) consistency of model selection criteria in linear regression models has attracted a lot of attention recently. However, most of the existing literature on high SNR consistency deals with model order selection. Further, the limited literature available on the high SNR consistency of subs…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “high SNR consistency”
New techniques for compressive sensing without noise or signal statistics.
problem Support recovery in underdetermined linear regression models without prior noise and signal statistics.
method Proposes RRM and RRTA to operate OMP algorithm without noise variance or signal sparsity knowledge.
result Establishes high SNR consistency for OMP without prior noise and signal statistics.
In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive results are developed on both the statistical and computational limits for tensor …
Method-of-Moments Inference for GLMs and Doubly Robust Functionals under Proportional Asymptoticsmath.ST
Paper develops methods for estimating GLMs and SNR under proportional asymptotics.
problem Estimation of regression coefficients and SNR in high-dimensional GLMs.
method Method-of-Moments type estimators that bypass nuisance function estimation.
result Consistent and asymptotically normal estimators derived for targets of inference.
We study the community detection and recovery problem in partially-labeled stochastic block models (SBM). We develop a fast linearized message-passing algorithm to reconstruct labels for SBM (with nodes, blocks, intra and inter block connectivity) when proportion of node labels are revealed. The signa…
Obtaining magnetic resonance images (MRI) with high resolution and generating quantitative image-based biomarkers for assessing tissue biochemistry is crucial in clinical and research applications. How- ever, acquiring quantitative biomarkers requires high signal-to-noise ratio (SNR), which is at odds with high-resolut…
The problem of Poisson denoising appears in various imaging applications, such as low-light photography, medical imaging and microscopy. In cases of high SNR, several transformations exist so as to convert the Poisson noise into an additive i.i.d. Gaussian noise, for which many effective algorithms are available. Howev…
New loss function improves accuracy of MRI parameter estimation.
problem Systematic errors in parameter estimates at low SNR.
method Developed and implemented negative log Rician likelihood (NLR) loss.
result NLR loss shows higher accuracy in parameter estimation than MSE loss at low SNR.
This paper analyzes AJIVE for estimating shared subspace across multiple datasets, revealing its strengths and limitations.
problem Estimating shared subspace across multiple datasets with varying degrees of misalignment.
method Angle-based Joint and Individual Variation Explained (AJIVE) method, a two-stage spectral approach.
result AJIVE's performance in high signal-to-noise ratio (SNR) regimes and its non-diminishing error in low-SNR settings.
The interplay between computational efficiency and statistical accuracy in high-dimensional inference has drawn increasing attention in the literature. In this paper, we study computational and statistical boundaries for submatrix localization. Given one observation of (one or multiple non-overlapping) signal submatrix…
Random forests reduce bias and variance, especially in low SNR settings.
problem Reducing bias and variance in machine learning models, particularly in low SNR scenarios.
method Empirical study of random forests and bagging ensembles, focusing on the importance of tuning.
result Random forests reduce both bias and variance, outperforming bagging ensembles in high SNR settings.
KLT picker automates particle picking for cryo-EM, especially for low SNR images.
problem Challenges in particle picking, especially for low SNR micrographs.
method Data-driven optimal templates learned via Karhunen Loeve Transform.
result High-quality results with minimal manual effort on publicly available data sets.
DGPs with variational inference suffer from SNR issues that degrade gradient estimates, leading to unreliable training.
problem SNR issues in gradient estimates for DGPs with variational inference.
method Adapted doubly reparameterized gradient estimators for DGP training.
result Fix improves predictive performance of DGP models.
Study recovers spike order in noisy tensor estimation without SNR assumptions.
problem Estimating multiple signal vectors from noisy tensor observations.
method Gradient flow optimization of a nonconvex function.
result Determines sample complexity for efficient permutation recovery.
Efficient Training of Deep Classifiers for Wireless Source Identification using Test SNR Estimatescs.LG
Efficient deep learning for wireless source identification using test SNR estimates.
problem Training deep classifiers for wireless signal modulation and technology identification.
method Greedy training SNR Boosting and bootstrap aggregating (Bagging) based on training SNR values.
result Uniform improvement in accuracy across all SNR values with small subsets of training SNR values.
Deep learning improves automatic modulation classification from subsampled data.
problem Automatic recognition of wireless communication signal modulations from imperfect data.
method Developed and tested Convolutional Long Short-term Deep Neural Network (CLDNN), LSTM, and ResNet architectures.
result Achieved high classification accuracy (around 90%) at high SNR with minimal training data.
Transformers can learn mixture of linear models efficiently.
problem Existence and generalization of in-context learning for mixture models.
method Theoretical analysis and gradient flow optimization.
result Transformers achieve a prediction error of with high probability.
In this work, we investigate the value of employing deep learning for the task of wireless signal modulation recognition. Recently in [1], a framework has been introduced by generating a dataset using GNU radio that mimics the imperfections in a real wireless channel, and uses 10 different modulation types. Further, a …
We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constraint on the number of nonzero coefficients. While the best subset selection procedure is often perceiv…
Unbiased methods for alpha-divergence minimization struggle in high dimensions.
problem The difficulty of unbiased alpha-divergence minimization in high dimensions.
method Signal-to-Noise Ratio (SNR) analysis of gradient estimators.
result The SNR of the gradient estimator worsens exponentially with dimensionality.
Implicitly Normalized Online PCA: A Regularized Algorithm with Exact High-Dimensional Dynamicsstat.ML
Improved online PCA algorithm learns from evolving norm of parameter vector.
problem Discarding evolving norm in online PCA leads to suboptimal learning.
method Implicitly Normalized Online PCA (INO-PCA) removes unit-norm constraint.
result Parameter norm evolution leads to improved learning behavior.
The paper sets sample complexity bounds for learning high-dimensional simplices in noisy data.
problem Learning high-dimensional simplices from noisy data.
method Sample compression techniques and Fourier-based method for noisy observations.
result Established sample complexity bounds for simplex learning in noisy regimes.
Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
problem Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
method Reformulating Stein discrepancy construction as an explicit SNR^2 maximisation problem
result Avoiding exponential SNR^2 collapse and achieving stable SNR^2
Paper finds sample complexity for learning high-dimensional simplices from noisy data.
problem Learning high-dimensional simplices from noisy samples.
method Combines sample compression, high-dimensional geometry, and Fourier analysis.
result Proves sample complexity bound for achieving a simplex within a certain distance from the true simplex.
Study of Langevin dynamics for tensor PCA recovery in high dimensions.
problem Recovering hidden signal vectors (spikes) from noisy Gaussian tensor observations.
method Langevin dynamics approach for nonconvex optimization.
result Sample complexity matches the single-spike case but degrades for all spikes.
On the Minimax Optimality of the EM Algorithm for Learning Two-Component Mixed Linear Regressionstat.ML
EM algorithm achieves optimal sample complexity for learning two-component mixed linear regression.
problem Learning two-component mixed linear regression under varying signal-to-noise ratios.
method Analysis of EM algorithm convergence rates under different SNR regimes.
result EM algorithm achieves minimax optimal sample complexity in all SNR regimes.
SGD recovers multiple signal vectors in noisy tensor PCA.
problem Estimating multiple signal vectors from noisy tensor observations.
method Online stochastic gradient descent (SGD) in high dimensions with detailed analysis of correlations.
result Sequential elimination of correlations allows recovery of all spikes from samples.
When do Random Forests work?stat.ML
Random forest performance depends on SNR and covariate characteristics.
problem Understanding when random forests perform well.
method Systematic analysis of out-of-sample MSE for different SNR scenarios.
result Randomization effectiveness depends on SNR and covariate characteristics.
New method clusters tensors with heteroskedastic noise.
problem Clustering tensors with varying noise levels.
method Two-stage method: subspace estimation followed by approximate -means.
result Proves exact clustering for SNR above computational limit.
SVO improves particle diversity and variational bounds in filtering SMC.
problem Improving variational bounds in particle filtering with limited samples.
method Introduces Particle Smoothing Variational Objectives (SVO) for smoothed approximate posterior through subsampling.
result SVO outperforms filtered objectives with fewer Monte Carlo samples on nonlinear systems.
Optimizing over-the-air convex optimization, analog schemes are nearly optimal at low SNR.
problem Optimizing over-the-air convex optimization with coded gradients.
method Analyzes coded gradients over an additive Gaussian noise channel, considers analog coding schemes.
result Analog coding schemes nearly match the optimal convergence rate at low SNR, but a slowdown is inevitable.
The paper connects DNN generalization to node SNR using information theory.
problem Exploring the reasons behind DNN generalization performance.
method Using information theory, the paper derives SNR expressions for DNN nodes and uses them to quantify weight optimization.
result Good SNR performance in DNN nodes correlates with good generalization.
Spectral algorithm recovers community structure in sparse hypergraphs.
problem Community detection in sparse random hypergraphs with community structure and higher-order interactions.
method Spectral algorithm with three steps: hyperedge selection, spectral partition, and correction/merging.
result Weak consistency achieved for weak signal-to-noise ratio.
Alignment of neural network representations is influenced by SNR and sample size.
problem Understanding how neural network representations align across different conditions.
method Controlled training of neural networks on perturbed datasets, analyzing alignment and generalization.
result Alignment varies monotonically with SNR but non-monotonically with sample size, with minimal alignment near the interpolation threshold.
Study on sensor fusion algorithms under high dimensional noise.
problem Behavior of sensor fusion algorithms under high dimensional noise.
method Analysis of NCCA and AD algorithms using Gaussian kernel.
result Robustness of NCCA and AD to high dimensional noise depends on SNR and bandwidth selection.
Tyler's M-estimator's phase transition at DS-SNR = 1 is resolved.
problem Robust Subspace Recovery
method Tyler's M-estimator
result TME converges exactly to the true subspace for DS-SNR >= 1 under a new stability condition.
This paper demonstrates two novel methods to estimate the global SNR of speech signals. In both methods, Deep Neural Network-Hidden Markov Model (DNN-HMM) acoustic model used in speech recognition systems is leveraged for the additional task of SNR estimation. In the first method, the entropy of the DNN-HMM output is c…
New Fourier-based diffusion model improves high-frequency generation quality.
problem Diffusion models struggle with high-frequency details.
method Analyzed and modified the forward process in Fourier space to equalize noise corruption across frequencies.
result Improved generation quality for high-frequency components.
Recurrent CNNs improve image classification in low light conditions.
problem Poor performance of CNNs in noisy images.
method Added recurrent connections to CNN layers to enhance robustness.
result gruCNNs outperform cCNNs in low signal-to-noise ratio images.
Spectrum selectively trains LLMs based on SNR to save resources.
problem Efficiently training large language models with limited resources.
method Targeting layer modules based on SNR for selective training.
result Spectrum achieves similar performance to full fine-tuning but with reduced VRAM usage.
A new memory-efficient Adam variant reduces second moments when feasible.
problem Memory constraints in training machine learning models.
method Signal-to-Noise Ratio (SNR) analysis to identify dimensions where second moments can be replaced by means.
result Memory-efficient Adam variant (SlimAdam) matches performance and stability of Adam while saving up to 98% of second moments.
New algorithms sample spike-and-slab priors efficiently in high dimensions.
problem Sampling from spike-and-slab priors in high-dimensional settings.
method Provably efficient algorithms for posterior sampling with sublinear measurement count.
result First provable algorithms for spike-and-slab posterior sampling without strong SNR assumptions.
Study on benign overfitting in leaky ReLUs with moderate input dimensions.
problem Understanding when overfitting is beneficial in neural networks.
method Two-layer leaky ReLU networks trained with hinge loss, considering signal-to-noise ratio.
result Characterization of conditions for benign overfitting based on signal-to-noise ratio.
Novel approach to estimate P300 BCI efficiency using SNR.
problem Improving the accuracy of P300 BCI for severely disabled people.
method Introduced a novel approach considering P300 SNR for estimating efficiency, using a Gaussian noise model.
result P300 SNR significantly correlates with spelling accuracy, improving BCI efficiency.
The performance of a modulation classifier is highly sensitive to channel signal-to-noise ratio (SNR). In this paper, we focus on amplitude-phase modulations and propose a modulation classification framework based on centralized data fusion using multiple radios and the hybrid maximum likelihood (ML) approach. In order…
Improved predictive posterior density estimation through optimized importance sampling.
problem Low signal-to-noise ratio in posterior predictive densities.
method Optimized importance sampling using a test-time variational proxy.
result Significantly improved estimates of predictive posterior densities.
Deep learning improves one-bit OFDM receiver performance.
problem One-bit quantization complicates accurate channel estimation and data detection in OFDM receivers.
method Developed deep neural networks for channel estimation and data detection, using a two-step training policy.
result Deep learning-based designs achieve lower BER than unquantized OFDM at moderate SNRs.
Unified framework for structured principal subspace estimation with bounds and rates.
problem Structured principal subspace estimation problems.
method Unified framework, minimax lower and upper bounds, information-geometric complexity.
result Minimax rates of convergence for specific settings, including optimal rates for non-negative PCA/SVD.