We consider the problem of approximately reconstructing a partially-observed, approximately low-rank matrix. This problem has received much attention lately, mostly using the trace-norm as a surrogate to the rank. Here we study low-rank matrix reconstruction using both the trace-norm, as well as the less-studied max-no…
Paper improves privacy for language models against reconstruction attacks.
problem Reconstruction attacks can regenerate training data from language models.
method Uses Rényi differential privacy with optimized privacy budgets.
result Better privacy guarantees for extraction of rare secrets.
Algorithm reconstructs triangle-free networks from data, certifying correctness.
problem Reconstructing triangle-free dynamic networks from observational data.
method Developed an algorithm for triangle-free networks, providing guarantees on correctness.
result Algorithm either certifies correctness or outputs a sparser graph with no false positives.
Framework for confidence estimation in deep CT reconstructions.
problem Uncertainty in deep learning-based CT reconstructions.
method Sequential likelihood mixing framework with log-linear forward model.
result Deep models yield tighter confidence regions than classical methods.
Neurally Augmented ALISTA improves sparse reconstruction performance.
problem Improving sparse reconstruction performance with theoretical guarantees and empirical improvements.
method Integrates an LSTM network to compute adaptive step sizes and thresholds for each target vector during reconstruction.
result Empirical performance is further improved, especially as compression ratios become more challenging.
This work provides statistical guarantees for VAEs using PAC-Bayesian theory.
problem Theoretical properties of VAEs remain open questions.
method PAC-Bayesian theory to derive statistical guarantees.
result Upper bounds on Wasserstein distance between input and generative model.
Paper tackles outlier detection in signals modeled by generative models with theoretical guarantees.
problem Recovering signals from linear measurements with sparse outliers.
method Proposes an iterative ADMM algorithm and gradient descent algorithm for outlier detection using ℓ1 and squared ℓ1 norm minimization. result Establishes theoretical recovery guarantees for signal reconstruction under sparse outliers.
The VAE's reconstruction ability is studied using PAC-Bayes theory.
problem Understanding the performance of VAEs for unseen data.
method PAC-Bayes theory is applied to analyze VAE's reconstruction error.
result Generalization bounds on VAE's reconstruction error are provided.
We address the two fundamental problems of spatial field reconstruction and sensor selection in heterogeneous sensor networks: (i) how to efficiently perform spatial field reconstruction based on measurements obtained simultaneously from networks with both high and low quality sensors; and (ii) how to perform query bas…
Paper addresses data reconstruction from privacy-protected templates using STCA.
problem Reconstructing privacy-sensitive data from protected templates.
method Sparse ternary coding with ambiguization (STCA) for privacy preservation.
result STCA maintains theoretical performance against deep reconstruction attacks for synthetic data but requires special measures for real images.
Study examines stability of image-reconstruction algorithms using variational regularization.
problem Stability and robustness of image-reconstruction algorithms in medical imaging.
method Review and novel stability results for ℓp-regularized linear inverse problems, focusing on p∈(1,∞). result Guarantees Lipschitz continuity for small p and Hölder continuity for larger p in Lp(Ω) function spaces. Develops a new robustness criterion for VAEs and provides theoretical guarantees.
problem Lack of formalization for robustness in VAEs.
method Introduces r-robustness criterion and derives reconstruction margins. result Derives theoretical guarantees for VAE robustness.
CoRAS adapts image acquisition rates for accurate reconstruction.
problem Determining when enough measurements are collected for accurate image reconstruction.
method Adaptive acquisition rate selection based on reconstruction error probability.
result CoRAS achieves target stopping-time coverage with fewer measurements.
Energy dissipating networks control neural network behavior during inference.
problem Lack of provable guarantees for neural networks during inference.
method Iteratively compute descent directions with respect to a given energy function, ensuring convergence to the global minimum.
result Proven convergence of descent directions to the global minimum of the energy function.
Geometric framework for inverse problems using foliations and dual connections.
problem Reconstruction problems in inverse problems.
method Vaisman foliations and Atiyah--Molino sequences to induce transverse foliations and dual connections.
result Unique, path-independent reconstruction with vanishing torsion and curvature duality.
Study recasts learning non-linear functions from noisy data as robust regression, proving reconstruction guarantees.
problem Learning non-linear functions from corrupted and dependent data.
method Sparse robust linear regression with ℓ1-optimization, incorporating unknown coefficients and corruptions. result Reconstruction guarantees for ℓ1-optimization problem with dependent data, proving null and stable null space properties. Paper proposes a generative model approach for outlier detection in signals.
problem Recovering signals from compressed measurements with sparse outliers.
method Iterative ADMM and gradient descent algorithms for ℓ1 and squared ℓ1 norm minimization. result Established recovery guarantees for generative models in the presence of outliers.
A neural network learns a convex regularizer for better image reconstruction.
problem Improving image reconstruction in inverse problems.
method Adversarial training of a data-adaptive ICNN as a convex regularizer.
result The convex regularizer leads to better convergence and error reduction in image reconstruction.
Improved neural network reconstruction from sparse measurements with theoretical guarantees.
problem Improving neural network performance in sparse signal reconstruction from few measurements.
method Combining iterative reconstruction algorithms with neural networks, analyzing generalization properties, and deriving a generalization bound.
result Theoretical guarantees for neural network reconstruction from compressive linear measurements, with generalization error scaling logarithmically in the number of layers and linearly in the number of measurements.
A new deep learning model speeds up MRI by reconstructing from undersampled data.
problem Slow MRI due to undersampling in k-space.
method Unrolling primal-dual hybrid gradient algorithm into a deep network, gradually relaxing constraints.
result Superior MR reconstructions from highly undersampled data.
Improved computed tomography reconstruction with deep learning and deep image prior.
problem Low data efficiency in computed tomography reconstruction.
method Combining learned primal-dual methods with deep image prior for improved quality and generalization.
result Proposed methods outperform state-of-the-art in low data regime.
New method improves signal reconstruction with nonconvex penalties and parameter control.
problem Reconstructing sparse signals with nonconvex penalties and nonconvexity control.
method Introduces nonconvex penalties (SCAD, MCP) with nonconvexity parameters and controls them to guide AMP trajectory.
result Achieves perfect reconstruction for relatively dense signals with small nonconvexity parameters.
Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing exploits the sparsity of images or image patches in a transform domain or synth…
Improves point-cloud reconstruction by optimizing projections with self-attention.
problem Inefficient and non-metric projection methods for sliced Wasserstein distances.
method Proposes distributional sliced Wasserstein distance with self-attention for permutation-invariant and metric optimization.
result Self-attention amortized distributional projection optimization achieves better performance in point-cloud reconstruction.
New anomaly score for generative models without manifold assumptions.
problem Reconstruction error's theoretical limitations for generative models.
method Defining a new anomaly score compatible with generative models.
result The new score is theoretically sound and practical for auto-encoders.
New method detects anomalies without bias, improving on autoencoder reconstruction errors.
problem Inherent biases in autoencoder-based anomaly detection methods.
method Introduces a Lipschitz anomaly discriminator trained to detect differences between training data and corruptions.
result Successfully detects anomalies with guarantees on certain Wasserstein distances.
New method reconstructs data subsets from limited published statistics.
problem Reconstructing tabular data from aggregate statistics when full datasets are not possible.
method Generates and verifies subsets of rows and columns that are guaranteed to be correct.
result Privacy violations can persist even with sparse published statistics.
Active learning reconstructs hierarchical tree cuts from leaf similarity.
problem Reconstructing hierarchical tree cuts from pairwise leaf similarity.
method Pairwise similarity over tree leaves; active learning; regret and query complexity bounds.
result Theoretical guarantees on statistical error and practical linear-time implementations.
This paper improves signal reconstruction using determinantal sampling from random nodes.
problem Approximating square-integrable functions from random node evaluations.
method Combines determinantal point processes and mixtures thereof for RKHS-adapted approximations.
result Proves mean-square guarantees in L2 norm and shows faster convergence rates. This paper provides statistical guarantees for WAE's latent space regeneration.
problem Lack of statistical analysis for Autoencoders, especially WAE.
method Utilizes Vapnik Chervonenkis (VC) theory and Optimal Transport of measures under the Wasserstein metric.
result WAE achieves the target distribution in the latent space and regenerates the input distribution.
The paper describes fitting submanifolds to data using Sussmann's orbit theorem.
problem Fitting an immersed submanifold to random samples.
method Uses Sussmann's orbit theorem to ensure submanifold fitting. Reconstruction involves encoding times and decoding via flows of vector fields.
result A high-probability bound on excess risk for the reconstruction error.
We propose to use Gaussian process regression to accurately estimate the diffusion MRI signal at arbitrary locations in q-space. By estimating the signal on a grid, we can do synthetic diffusion spectrum imaging: reconstructing the ensemble averaged propagator (EAP) by an inverse Fourier transform. We also propose an a…
We develop mask iterative hard thresholding algorithms (mask IHT and mask DORE) for sparse image reconstruction of objects with known contour. The measurements follow a noisy underdetermined linear model common in the compressive sampling literature. Assuming that the contour of the object that we wish to reconstruct i…
A new method enhances signal recovery with FDR control.
problem Challenging signal recovery in compressive sensing.
method Knockoff-guided compressive sensing framework with FDR control.
result Guaranteed FDR control leads to more accurate signal reconstruction.
Embedding RL policies in RKHS for robustness and theoretical guarantees.
problem Stability and theoretical guarantees in RL policy representation.
method Low-dimensional embedding of RL policies in RKHS.
result Embedded policies maintain high return with strong theoretical guarantees.
Paper tackles image reconstruction from limited data using polyhedral norms and convex regularizers.
problem Learning convex regularizers for image reconstruction from limited data.
method Imposes amplitude-equivariance, approximates functionals with polyhedral norms, identifies synthesis and analysis forms, proposes a trainable tight frame architecture.
result Proposed framework outperforms sparsity-based methods in denoising and biomedical image reconstruction.
Metalearning optimizes autoencoder dimensions for efficient data representation.
problem Selecting optimal dimension for autoencoder output to balance accuracy and complexity.
method Metalearning approach using actor-critic algorithm to dynamically adjust dimension.
result Automatic selection of minimum number of bases for optimal reconstruction.
Algorithm reconstructs interaction topology in linear dynamical systems.
problem Learning influence pathways in dynamically related processes.
method Physics-informed multivariate Wiener filtering.
result Topology of interactions can be exactly recovered for certain classes.
New quantum state reconstruction method accelerates convergence.
problem Quantum state reconstruction for larger systems.
method Momentum-Inspired Factored Gradient Descent (MiFGD) combining compressed sensing, non-convex optimization, and acceleration.
result Converges to true density matrix at an accelerated linear rate, provably close to the true matrix.
Transform learning improves MRI image reconstruction from sparse data.
problem Efficiently reconstruct MRI images from limited data.
method TL-based methods using learned models and transform domains.
result TL-based methods outperform classical CS methods in MRI reconstruction.
Paper evaluates and mitigates privacy risks in deep learning models.
problem Quantifying and defending against privacy attacks in deep learning.
method Quantitative evaluation of trade-offs, reformulating attacks, and proposing a novel SPN.
result Model accuracy improved by 5-20% while maintaining data privacy.
New algorithm improves signal reconstruction from noisy measurements with side information.
problem Reconstructing unknown signals from noisy linear measurements with side information.
method Integrates side information into approximate message passing (AMP) and tracks performance using state evolution.
result AMP-SI performance is accurately predicted by state evolution.
SDSR reconstructs species trees from genetic markers efficiently.
problem Challenges in reconstructing species trees from genetic data.
method Spectral divide-and-conquer approach based on graph theory.
result SDSR achieves up to 10-fold faster runtime with comparable accuracy.
With the recent advancement in the deep learning technologies such as CNNs and GANs, there is significant improvement in the quality of the images reconstructed by deep learning based super-resolution (SR) techniques. In this work, we propose a robust loss function based on the preservation of edges obtained by the Can…
We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that a certain number of generic rank-one or generic linear measurements are suffici…
We introduce a new family of matrix norms, the "local max" norms, generalizing existing methods such as the max norm, the trace norm (nuclear norm), and the weighted or smoothed weighted trace norms, which have been extensively used in the literature as regularizers for matrix reconstruction problems. We show that this…
Let M be a random (alpha n) x n matrix of rank r<<n, and assume that a uniformly random subset E of its entries is observed. We describe an efficient algorithm that reconstructs M from |E| = O(rn) observed entries with relative root mean square error RMSE <= C(rn/|E|)^0.5 . Further, if r=O(1), M can be reconstructed ex…
Mask-reconstruction pretraining helps in downstream tasks by capturing more semantic features.
problem How mask-reconstruction pretraining helps in downstream tasks and why it surpasses supervised learning.
method Theoretical analysis and experimental validation of mask-reconstruction pretraining (MRP) on auto-encoders.
result MRP provably captures more semantic features than supervised learning, leading to better performance in downstream tasks.