Study subjective perception of low light restored images and develop an unsupervised QA model.
problem Lack of subjective QA for low light restored images and challenges in collecting human opinion scores.
method Create a dataset, conduct subjective QA study, develop self-supervised contrastive learning technique to extract features.
result Unsupervised NR QA model achieves state-of-the-art performance for low light restored images.
New image restoration method using localized patches and external databases.
problem Image restoration challenges.
method Localized structured prediction and non-linear multi-task learning for optimizing a penalized energy function.
result Strong statistical guarantees and practical effectiveness demonstrated on various image restoration problems.
Improved image restoration using frequency-guided sampling.
problem Restoring high-quality images from degraded observations with known degradation processes.
method Proposed a frequency-guided sampling approach for diffusion-based image restoration, incorporating a time-varying low-pass filter.
result Significantly improved performance on challenging image restoration tasks, including motion deblurring and image dehazing.
RGI improves robustness of GAN-inversion for image restoration and anomaly detection.
problem Robustness of GAN-inversion to unknown gross corruptions.
method Proposes RGI and R-RGI methods with provable robustness guarantees.
result Restored images and corrupted region masks converge to ground truth under mild assumptions.
Unified framework for image restoration using equivariant denoisers.
problem Restoring images with realistic priors and invariant transformations.
method Unified framework named ERED based on equivariant denoisers and stochastic optimization.
result Unified framework ERED converges and improves image restoration.
Generative models improve image restoration from unknown transformations.
problem Restoring images distorted by unknown transformations.
method Combining maximum a-posteriori probability with maximum likelihood estimation.
result Restores images without requiring exact knowledge of transformations.
Pyramid Attention Networks improve image restoration by leveraging self-similarities across scales.
problem Lack of full exploitation of self-similarities in image restoration by recent deep learning methods.
method Introduces a Pyramid Attention module that processes multi-scale feature correspondences to borrow clean signals from coarser levels.
result Pyramid Attention module achieves state-of-the-art results in various image restoration tasks.
The problem of image restoration in cryo-EM entails correcting for the effects of the Contrast Transfer Function (CTF) and noise. Popular methods for image restoration include `phase flipping', which corrects only for the Fourier phases but not amplitudes, and Wiener filtering, which requires the spectral signal to noi…
Proposes a new model for image restoration combining deep learning and total variation.
problem Restoring images from limited data with low-rank constraints insufficient.
method Regularized Deep Matrix Factorized (RDMF) model using deep neural network's low-rank bias and total variation.
result Outperforms state-of-the-art models in image restoration from few observations.
Deep learning methods are becoming widely used for restoration of defects associated with fluorescence microscopy imaging. One of the major challenges in application of such methods is the availability of training data. In this work, we propose a unified method for reconstruction of multi-defect fluorescence microscopy…
The paper analyzes relationships between various image models for restoration.
problem Unclear relationships among popular image models for restoration.
method Theoretical analysis and experimental study of image models.
result Improved denoising performance by combining multiple image models.
SNORE applies denoiser only on images with noise of adequate level for image restoration.
problem Image restoration challenges with iterative algorithms and denoising.
method SNORE framework using stochastic regularization and stochastic gradient descent.
result SNORE is competitive with state-of-the-art methods on deblurring and inpainting tasks.
I2SB learns nonlinear diffusion processes between images.
problem Image restoration tasks, especially with limited structural information.
method Conditional diffusion models, Schrödinger bridge approach.
result I2SB outperforms standard models in various image restoration tasks. LVTINO improves high-definition video restoration with consistent temporal details.
problem Restoring high-definition video with fine spatial detail and temporal consistency.
method LVTINO uses Video Consistency Models to bypass frame-by-frame image-based LDMs, achieving perceptual quality and computational efficiency.
result Significant perceptual improvements over current methods, achieving state-of-the-art quality with minimal evaluations.
BP-DIP combines DIP and backprojection for image restoration.
problem Performance drop of deep learning methods due to mismatched observation models.
method Combines Deep Image Prior (DIP) and backprojection.
result BP-DIP outperforms DIP in deblurring tasks with higher PSNR and faster inference.
A new method detects hallucinations in medical image restoration using Fourier Ring Correlation.
problem Detecting hallucinations in DL outputs for medical image restoration.
method sFRC (s(c)can FRC) over small patches of DL outputs and reference images.
result sFRC effectively detects hallucinations in CT and MRI restoration problems.
We build a collaborative filtering recommender system to restore images with impulse noise for which the noisy pixels have been previously identified. We define this recommender system in terms of a new color image representation using three matrices that depend on the noise-free pixels of the image to restore, and two…
In this paper, we propose a new framework to remove parts of the systematic errors affecting popular restoration algorithms, with a special focus for image processing tasks. Generalizing ideas that emerged for ℓ1 regularization, we develop an approach re-fitting the results of standard methods towards the input d…
Aleatoric uncertainty is an intrinsic property of ill-posed inverse and imaging problems. Its quantification is vital for assessing the reliability of relevant point estimates. In this paper, we propose an efficient framework for quantifying aleatoric uncertainty for deep residual learning and showcase its significant …
Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this paper, we show that, on the contrary, the structure of a generator network is suf…
We apply basic statistical reasoning to signal reconstruction by machine learning -- learning to map corrupted observations to clean signals -- with a simple and powerful conclusion: it is possible to learn to restore images by only looking at corrupted examples, at performance at and sometimes exceeding training using…
Neural DEs improve single image super-resolution.
problem Challenging tasks in image super-resolution.
method Applied Neural Differential Equations to image super-resolution, using variational methods and backpropagation.
result Differential models match state-of-the-art performance.
Patch priors have become an important component of image restoration. A powerful approach in this category of restoration algorithms is the popular Expected Patch Log-Likelihood (EPLL) algorithm. EPLL uses a Gaussian mixture model (GMM) prior learned on clean image patches as a way to regularize degraded patches. In th…
Deep neural networks (DNNs) have achieved excellent performance on several tasks and have been widely applied in both academia and industry. However, DNNs are vulnerable to adversarial machine learning attacks, in which noise is added to the input to change the network output. We have devised an image-processing-based …
DAPS++ improves diffusion-based image restoration by decoupling prior and likelihood.
problem Decoupling prior and likelihood in diffusion-based inverse problems for better performance.
method Introducing DAPS++, which separates diffusion initialization from likelihood refinement.
result DAPS++ achieves high computational efficiency and robust reconstruction performance.
In general, image restoration involves mapping from low quality images to their high-quality counterparts. Such optimal mapping is usually non-linear and learnable by machine learning. Recently, deep convolutional neural networks have proven promising for such learning processing. It is desirable for an image processin…
DAPS++ improves diffusion-based image restoration by decoupling prior and likelihood.
problem Decoupling prior and likelihood in diffusion-based inverse problems.
method Introducing DAPS++, which fully decouples diffusion-based initialization from likelihood-driven refinement.
result Achieves high computational efficiency and robust reconstruction performance.
A new method uses compressive autoencoders for image restoration.
problem Efficient regularization of inverse problems in computational imaging.
method Variational Bayes Latent Estimation (VBLE) with compressive autoencoders.
result VBLE achieves similar performance to state-of-the-art PnP methods but faster.
A new method combines generative and feature-based approaches for unsupervised anomaly detection.
problem Identifying subtle anomalies in test samples compared to a normative distribution.
method A generative cold-diffusion pipeline trained to restore synthetically-corrupted images, combined with a novel synthetic anomaly generation procedure and ensembling restorations.
result Surpasses prior state-of-the-art for unsupervised anomaly detection in three Brain MRI datasets.
NF-ULA combines Langevin Monte Carlo with normalizing flows for imaging inverse problems.
problem Solving inverse problems in imaging with uncertainty quantification.
method Langevin Monte Carlo with normalizing flow prior.
result NF-ULA outperforms competing methods for severely ill-posed inverse problems.
Paper tackles Bayesian image restoration in low-photon Poisson imaging problems.
problem Bayesian inference in challenging low-photon Poisson imaging problems.
method Plug-and-play (PnP) Langevin sampling strategies with accelerated methods and mirror sampling.
result Effective PnP Langevin sampling methods for low-photon Poisson imaging problems.
The paper validates a method for recovering over-parameterized matrices and images from noisy measurements.
problem Recovering a low-rank matrix from noisy measurements when the rank is unknown.
method Using gradient descent with small random initialization on a nonconvex objective function built from a rank-overspecified factored representation of the matrix variable.
result Gradient descent iterations converge to the ground-truth matrix under certain conditions and can be stopped efficiently to detect a nearly optimal estimator.
VarDeepPCA refines medical image segmentation from small datasets, improving anatomical plausibility and reducing errors.
problem Medical image segmentation fails on out-of-distribution data due to variations in scanners and protocols.
method VarDeepPCA learns valid anatomical geometries using only small in-distribution datasets, providing uncertainty estimates.
result VarDeepPCA restores segmentation maps to OOD data, improving anatomical plausibility and reducing errors.
A method predicts posterior PCs for faster uncertainty quantification in imaging.
problem Uncertainty visualization in image restoration models is limited by per-pixel variances.
method Neural Posterior Principal Components (NPPC) method for predicting PCs in a single forward pass.
result Orders of magnitude faster uncertainty quantification compared to posterior samplers.
Generalized R2R handles non-Gaussian noise for deep network training.
problem Training deep networks from noisy data alone.
method Extending R2R to handle various noise distributions.
result GR2R loss is an unbiased estimator of supervised loss.
Enhances neural networks' robustness against adversarial samples without sacrificing clean sample generalization.
problem Limited generalization and time complexity of adversarial training.
method Feature Pyramid Decoder (FPD) framework that integrates denoising and image restoration modules into CNNs and constrains the Lipschitz constant.
result FPD-enhanced CNNs achieve sufficient robustness against general adversarial samples on various datasets.
New PnP algorithm converges with relaxed proximal gradient descent.
problem Convergence issues in PnP methods with deep denoisers.
method Relaxed proximal gradient descent for PnP with weakly convex regularization.
result Proposed PnP-αPGD converges for a wider range of regularization parameters. BNCR-GAN improves GANs to generate clean images from degraded inputs.
problem Generating clean images from blurred, noisy, and compressed degraded inputs.
method Multiple-generator model with image, blur-kernel, noise, and quality-factor generators, using masking architectures and adaptive consistency losses.
result BNCR-GAN effectively learns clean image generators from degraded images without degradation parameters.
This work introduces a method for visualizing high-dimensional posteriors using hierarchical tree-valued predictions.
problem Visualizing high-dimensional posterior distributions for complex problems like image restoration.
method A neural network predicts a tree-valued hierarchical summarization of the posterior distribution in a single forward pass.
result The method efficiently summarizes and visualizes posteriors, achieving comparable results to hierarchical clustering but at a much faster speed.
Computed tomography (CT) is widely used in screening, diagnosis, and image-guided therapy for both clinical and research purposes. Since CT involves ionizing radiation, an overarching thrust of related technical research is development of novel methods enabling ultrahigh quality imaging with fine structural details whi…
Variational approach improves diffusion models for solving inverse problems.
problem Challenges in solving inverse problems with diffusion models due to the nonlinear and iterative nature of the diffusion process.
method Proposes a variational approach to approximate the posterior distribution, leading to regularization by denoising diffusion process (RED-Diff).
result Demonstrates improved performance in image restoration tasks compared to state-of-the-art sampling-based diffusion models.
A new method approximates the exact posterior score for diffusion models.
problem Training-free guidance of diffusion models for image restoration and inverse problems.
method Presented a novel expression for the exact posterior score, leveraging it to compute step sizes on the fly.
result Demonstrated competitive performance with fewer time steps compared to state-of-the-art techniques.
Bayesian image reconstruction using pre-trained generative models.
problem Distribution shifts and latent variable changes in image data.
method Combining SOTA generative models with Bayes' theorem for image restoration tasks.
result Competitive performance on super-resolution and in-painting tasks without training.
Low-rank signal modeling has been widely leveraged to capture non-local correlation in image processing applications. We propose a new method that employs low-rank tensor factor analysis for tensors generated by grouped image patches. The low-rank tensors are fed into the alternative direction multiplier method (ADMM) …
The Perona-Malik model has been very successful at restoring images from noisy input. In this paper, we reinterpret the Perona-Malik model in the language of Gaussian scale mixtures and derive some extensions of the model. Specifically, we show that the expectation-maximization (EM) algorithm applied to Gaussian scale …
Bayesian filtering approach identifies nonlinear restoring forces in dynamic systems.
problem Identification of nonlinear dynamic systems in engineering.
method Modeling the nonlinear restoring force as a Gaussian process, converting it to a state-space model, and inferring internal states and the nonlinear restoring force through filtering and smoothing.
result The approach effectively identifies nonlinear restoring forces in both simulated and experimental datasets.
Efficiently solves inverse problems with diffusion and flow models in just a few steps.
problem Solving inverse problems like super-resolution, inpainting, or deblurring using diffusion or flow models.
method Conditional Conjugate Integrators framework that projects inverse problem dynamics into a more amenable space for sampling.
result Generates high-quality samples in as few as 5 conditional sampling steps, outperforming competing methods.
Convolutional Neural Networks are a well-known staple of modern image classification. However, it can be difficult to assess the quality and robustness of such models. Deep models are known to perform well on a given training and estimation set, but can easily be fooled by data that is specifically generated for the pu…