We study signal recovery on graphs based on two sampling strategies: random sampling and experimentally designed sampling. We propose a new class of smooth graph signals, called approximately bandlimited, which generalizes the bandlimited class and is similar to the globally smooth class. We then propose two recovery s…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “sample recovery”
A new method trains and samples from energy-based models using diffusion recovery likelihood.
problem Training and sampling high-dimensional datasets with energy-based models is challenging.
method Trains EBMs with a diffusion recovery likelihood method, maximizing conditional probabilities of data at different noise levels.
result Generates high-fidelity images with low FID and inception scores, and accurately estimates normalized data density.
Study on sparse recovery with mixed-quality data, establishing sample-size conditions.
problem Sparse recovery with heterogeneous noise from high- and low-quality sources.
method Establishes linear trade-off for sufficient conditions, analyzes LASSO algorithm.
result Linear trade-off for sufficient conditions, robustness of LASSO to data heterogeneity.
Study shows DNNs can recover functions with fewer samples than model parameters at overparameterization.
problem Determining reliable function recovery in overparameterized deep neural networks.
method Introducing 'local linear recovery' (LLR) and proving upper bounds on sample sizes for recovery.
result Upper bounds on optimistic sample sizes for function recovery in overparameterized DNNs are achieved.
A Generic Sample Splitting Approach for Refined Community Recovery in Stochastic Block Modelsstat.ML
We propose and analyze a generic method for community recovery in stochastic block models and degree corrected block models. This approach can exactly recover the hidden communities with high probability when the expected node degrees are of order or higher. Starting from a roughly correct community partition …
New method recovers matrix column space with active sampling for better results.
problem Recovering column space of partially observed matrices with limited data.
method Alternating minimization with active sampling strategy.
result Active sampling improves convergence to true column space with higher probability.
In this paper, we study the missing sample recovery problem using methods based on sparse approximation. In this regard, we investigate the algorithms used for solving the inverse problem associated with the restoration of missed samples of image signal. This problem is also known as inpainting in the context of image …
The problem of population recovery refers to estimating a distribution based on incomplete or corrupted samples. Consider a random poll of sample size conducted on a population of individuals, where each pollee is asked to answer binary questions. We consider one of the two polling impediments: (a) in lossy pop…
Proposes CDRL to improve EBM training and generation quality.
problem Challenges in training energy-based models on high-dimensional data.
method Cooperative diffusion recovery likelihood (CDRL) approach.
result Significantly boosts EBM generation performance on CIFAR-10 and ImageNet.
This paper establishes conditions for sparse signal recovery with sparse measurements.
problem Recovering the support of a sparse signal using noisy projections with sparse measurement matrices.
method Establishes sufficient conditions for successful sparse recovery using sparse measurement matrices.
result A phase transition threshold for sparse recovery in the sparse setting is discovered, revealing a trade-off between sampling complexity and measurement sparsity.
SGA: A Robust Algorithm for Partial Recovery of Tree-Structured Graphical Models with Noisy Samplesstat.ML
Improved algorithm for partial recovery of tree-structured graphs with noisy data.
problem Learning Ising tree models with noisy observations.
method Symmetrized Geometric Averaging (SGA) algorithm with improved sample complexity.
result Significantly better sample complexity for partial tree recovery.
This paper improves support recovery in universal one-bit compressed sensing.
problem Support recovery in one-bit compressed sensing for sparse signals.
method Proposes approximate support recovery and superset recovery algorithms with polynomial-time complexity.
result Achieves improved support recovery with fewer measurements compared to existing methods.
New method optimizes MRI sampling patterns for faster scans.
problem Accelerate MRI scans without sacrificing image quality.
method Joint learning of adaptive sampling patterns and model-based recovery.
result Improved MR image quality compared to other methods.
Optimizes ranking of top-k players from partial comparison data.
problem Identifying the top-k players from incomplete pairwise comparisons.
method Maximum Likelihood Estimator (MLE) and Spectral Method.
result MLE achieves optimal partial and exact recovery, while Spectral Method is sub-optimal.
Study recovers spike order in noisy tensor estimation without SNR assumptions.
problem Estimating multiple signal vectors from noisy tensor observations.
method Gradient flow optimization of a nonconvex function.
result Determines sample complexity for efficient permutation recovery.
Posterior sampling estimator achieves near-optimal recovery guarantees for signals from any prior distribution.
problem Characterizing measurement complexity for signals from any prior distribution, including the entire space.
method Characterization of measurement complexity using posterior sampling estimator for Gaussian measurements and any prior distribution.
result Posterior sampling estimator achieves near-optimal recovery guarantees for signals from any prior distribution, robust to model mismatch.
Efficient algorithms for sparse parameter recovery in mixture models.
problem Support recovery of high-dimensional sparse latent vectors in mixture models.
method Efficient algorithms with logarithmic sample complexity dependence on dimensionality.
result First guarantees on support recovery for various mixture models.
Optimal sparse recovery with decision stumps achieves strong feature selection guarantees.
problem Sparse recovery of active features from high-dimensional data.
method Analysis of single-depth decision trees (decision stumps) for feature selection in linear regression.
result Tight sample performance guarantees for , improving upon previous bounds.
Two methods improve tensor recovery in Ising models, revealing gene interactions.
problem Improving tensor recovery in Ising models for complex data structures.
method Pseudolikelihood and interaction screening approaches for tensor learning.
result Both methods achieve tensor recovery with sample size logarithmic in nodes, exponential in strength and degree.
New insights into variable selection with different model assumptions.
problem Sparse recovery with error guarantees in variable selection.
method Separation between oblivious and adaptive models of sparse recovery.
result Proves a surprising contrast between oblivious and adaptive models in sparse recovery.
Scaled gradient descent improves matrix recovery for ill-conditioned matrices with optimal sampling complexity.
problem Recovering low-rank matrices from limited measurements efficiently and accurately.
method Scaled gradient descent (ScaledGD) with optimal sample complexity and improved iteration complexity.
result ScaledGD achieves optimal sample complexity and improved iteration complexity for ill-conditioned matrices.
The paper evaluates samplers on multi-modal targets, focusing on mode separation and recovery.
problem Handling multi-modality in sampling.
method Synthetic experimental setting focusing on mode relative importance recovery.
result Illustrates the challenges and potential of samplers in multi-modality.
WPCA improves subspace recovery robustness to outliers.
problem Improving subspace recovery in the presence of outliers.
method Winsorized PCA (WPCA) with theoretical analysis of accuracy and robustness.
result WPCA provides consistent subspace recovery from contaminated data.
Improved sampling strategy reduces Fourier measurements for neural network signals.
problem Efficiently sampling signals from neural networks with random Fourier matrices.
method Model-adapted sampling strategy with improved sample complexity.
result Reduced sample complexity from O(kdnα∞²) to O(kdα²₂) measurements.
In this paper, we consider the problem of estimating the underlying graph associated with an Ising model given a number of independent and identically distributed samples. We adopt an \emph{approximate recovery} criterion that allows for a number of missed edges or incorrectly-included edges, in contrast with the widel…
New framework for learning policies that converge in out-of-sample regions.
problem Reliable out-of-sample recovery in imitation learning.
method Contractive dynamical systems and recurrent equilibrium networks.
result Policy rollouts converge regardless of perturbations, enabling efficient OOS recovery.
Study shows generative priors improve rank-one matrix recovery with optimal sample complexity.
problem Recovering a rank-one signal matrix from noisy data with additional prior information.
method Analysis of a nonlinear least squares objective with a favorable global optimization landscape.
result Established optimal sample complexity for generative priors in rank-one matrix recovery.
The paper analyzes how good initial guesses affect the amount of data needed for low-rank matrix recovery.
problem Theoretical guarantee of local optimization algorithms requires excessive data to prevent spurious local minima.
method Quantifies the relationship between initial guess quality and sample complexity using restricted isometry constant.
result A linear improvement in initial guess quality leads to a constant factor improvement in sample complexity.
Higher-order tensors can represent scores in a rating system, frames in a video, and images of the same subject. In practice, the measurements are often highly quantized due to the sampling strategies or the quality of devices. Existing works on tensor recovery have focused on data losses and random noises. Only a few …
New method solves linear inverse problems using diffusion models.
problem Linear inverse problems in various domains.
method Posterior sampling with latent diffusion models.
result Provable sample recovery in linear models, outperforming previous methods.
This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery using a random subset of entries observed with additive noise under general non-unif…
A Theoretical Justification for Image Inpainting using Denoising Diffusion Probabilistic Modelsstat.ML
Theoretical justification for image inpainting using diffusion models.
problem Improving sample recovery in image inpainting without retraining.
method Analysis of RePaint algorithm and proposing RePaint to correct misalignment.
result RePaint algorithm provably recovers the true sample with linear convergence.
The paper improves support recovery in high-dimensional precision matrix estimation using meta learning.
problem Support recovery in high-dimensional precision matrix estimation with reduced sample complexity.
method Pooling samples from different tasks and using an improper -regularized log-determinant Bregman divergence to estimate a single precision matrix.
result The support of the improperly estimated single precision matrix is equal to the true support union with high probability.
New method recovers clean data from corrupted samples.
problem Recovering clean data from corrupted samples with uncertainty.
method Probabilistic Tomographic Auto-Encoder method that derives reduced entropy condition approximate inference.
result Superior performance in imputation and de-noising compared to existing methods.
Improved sample complexity for Gaussian Mixture Models using Pair Correlation Factor.
problem Understanding the sample complexity of Gaussian Mixture Models.
method Introducing Pair Correlation Factor (PCF) to measure clustering of component means and improving sample complexity bounds.
result The Pair Correlation Factor (PCF) more accurately determines the difficulty of parameter recovery in Gaussian Mixture Models.
In this paper, we investigate a multivariate multi-response (MVMR) linear regression problem, which contains multiple linear regression models with differently distributed design matrices, and different regression and output vectors. The goal is to recover the support union of all regression vectors using -reg…
Improved sample efficiency in learning sparse Ising models.
problem Learning the graph of a sparse Ising model with limited samples.
method Combining L0 and L2 norms to induce sparsity and model non-zero coefficients.
result Improved sample complexity, achieving new state-of-the-art recovery guarantees.
This paper improves support recovery in universal one-bit compressed sensing with fewer measurements.
problem Support recovery in universal one-bit compressed sensing.
method Developed algorithms to recover the support of sparse signals with a small number of false positives.
result Support recovery with measurements, improving to with known dynamic range.
Optimizes network sampling for efficient community detection.
problem Prohibitive cost of observing entire network for community detection.
method Chernoff-optimal dynamic sampling scheme for stochastic blockmodel.
result Significant resource savings while maintaining block structure recovery.
Functional neuroimaging can measure the brain?s response to an external stimulus. It is used to perform brain mapping: identifying from these observations the brain regions involved. This problem can be cast into a linear supervised learning task where the neuroimaging data are used as predictors for the stimulus. Brai…
New method recovers matrices with nonlinear structures using optimization on Grassmann manifold.
problem Recovering high-rank matrices with nonlinear structures like subspaces or clusters.
method Formulated as rank minimization of a nonlinear feature map, approximated by constrained non-convex optimization on the Grassmann manifold, using Riemannian and alternating minimization schemes.
result Global convergence and worst-case complexity bounds for alternating minimization scheme, leading to unique limit point.
We consider the mixed regression problem with two components, under adversarial and stochastic noise. We give a convex optimization formulation that provably recovers the true solution, and provide upper bounds on the recovery errors for both arbitrary noise and stochastic noise settings. We also give matching minimax …
This paper recovers smooth functions from noisy modulo samples using a three-stage strategy.
problem Recovering Hölder smooth functions from noisy modulo samples.
method Three-stage strategy: denoising with local polynomial estimators, unwrapping, and spline-based quasi-interpolant.
result Uniform error rates for Hölder class functions with high probability.
Telecommunication (Telco) outdoor position recovery aims to localize outdoor mobile devices by leveraging measurement report (MR) data. Unfortunately, Telco position recovery requires sufficient amount of MR samples across different areas and suffers from high data collection cost. For an area with scarce MR samples, i…
In this paper we study the problem of exact recovery of the pure-strategy Nash equilibria (PSNE) set of a graphical game from noisy observations of joint actions of the players alone. We consider sparse linear influence games --- a parametric class of graphical games with linear payoffs, and represented by directed gra…
We introduce a two step algorithm with theoretical guarantees to recover a jointly sparse and low-rank matrix from undersampled measurements of its columns. The algorithm first estimates the row subspace of the matrix using a set of common measurements of the columns. In the second step, the subspace aware recovery of …
Meta-learning improves support recovery in high-dimensional PCA.
problem Support recovery in high-dimensional Principal Component Analysis.
method Meta-learning approach to reduce sample complexity and support recovery.
result Support recovery can be achieved with significantly fewer samples than traditional methods.
The standard approach to compressive sampling considers recovering an unknown deterministic signal with certain known structure, and designing the sub-sampling pattern and recovery algorithm based on the known structure. This approach requires looking for a good representation that reveals the signal structure, and sol…