BNCR-GAN improves GANs to generate clean images from degraded inputs.
problem Generating clean images from blurred, noisy, and compressed degraded inputs.
method Multiple-generator model with image, blur-kernel, noise, and quality-factor generators, using masking architectures and adaptive consistency losses.
result BNCR-GAN effectively learns clean image generators from degraded images without degradation parameters.
Improved image restoration using frequency-guided sampling.
problem Restoring high-quality images from degraded observations with known degradation processes.
method Proposed a frequency-guided sampling approach for diffusion-based image restoration, incorporating a time-varying low-pass filter.
result Significantly improved performance on challenging image restoration tasks, including motion deblurring and image dehazing.
SR-NAM maps low-res images to multiple high-res images realistically.
problem Mapping low-resolution images to multiple high-resolution images realistically.
method SR-NAM using Non-Adversarial Mapping (NAM) technique and a degradation model.
result Realistic degradation and down-sampling of high-resolution images.
Humans outperform DNNs on image degradations, especially when signals weaken.
problem Comparing human and DNN robustness in object recognition under various image manipulations.
method Comparison of robustness between humans and DNNs (ResNet-152, VGG-19, GoogLeNet) on object recognition under 12 types of image degradations.
result Humans consistently outperform DNNs on object recognition, especially under weaker signals.
New video super-resolution method robust to multiple degradation models.
problem Current methods are not robust to mismatch between training and testing degradation models.
method Convolutional Neural Network with pseudo-inverse image formation model and perceptual losses.
result Outperforms current state-of-the-art methods and is robust to multiple degradations.
Self-supervised method enhances ultrasound images without needing clean targets.
problem Multiplicative speckle, acquisition blur, and scanner artifacts hamper ultrasound interpretation.
method Physics-guided degradation model trained on rotated/cropped patches with synthesized inputs.
result Achieves highest PSNR/SSIM across Gaussian and speckle noise levels, with significant improvements in heavy noise conditions.
Proposes an adversarial process using cosine similarity to improve robustness of models.
problem Improving robustness of models by eliminating subsidiary information.
method Adversarial process using cosine similarity to degrade subsidiary model performance.
result Cosine similarity-based adversarial process efficiently degrades subsidiary model performance.
Combines Integrated Gradients and PatternAttribution into PGIG, outperforming alternatives.
problem Improving neural network explainability methods.
method Combines Integrated Gradients and PatternAttribution into Pattern-Guided Integrated Gradients (PGIG).
result PGIG outperforms other explainability methods in a large-scale image degradation experiment.
A deep learning beamformer improves ultrasound imaging quality across varying conditions.
problem Poor image quality in ultrasound due to limited channel subsampling.
method A universal deep learning beamformer trained on data-driven methods.
result Significantly improved ultrasound images generated from sub-sampled data.
Generative Adversarial Network purifies images from steganography without degrading quality.
problem Destruction of image steganography while maintaining visual quality.
method Generative Adversarial Network (GAN) optimized for steganography destruction.
result High rate of steganographic content destruction with minimal visual quality degradation.
New method tackles video inverse problems using image diffusion models.
problem Spatio-temporal degradation in video inverse problems.
method Leverages image diffusion models to treat time dimension as batch dimension, introduces batch-consistent diffusion sampling.
result Achieves state-of-the-art reconstructions for various spatio-temporal degradations.
Enhances image quality to improve test-time adaptation accuracy.
problem Reducing accuracy loss due to distribution shift in deep networks.
method Integrates image enhancement with TTA methods to reduce prediction uncertainty.
result TECA method increases accuracy of TTA methods without hyperparameters.
New research shows semantic data matching can degrade SSDL performance.
problem The limits of semantic data set matching in semi-supervised learning.
method Demonstrated through simulations and a new dissimilarity measure.
result Semantic data matching can degrade SSDL performance under non-IID data.
Adversarial attacks degrade DRL-based EV energy management systems.
problem Adversarial attacks on DRL-based energy management systems of electric vehicles.
method Generated adversarial examples to degrade DRL performance using low-dimensional state representations.
result Adversarial attacks can significantly degrade DRL-based EV energy management systems.
Enhances deep networks robustness with data mollification and label smoothing.
problem Improving deep neural networks' robustness against corruptions.
method Coupling data mollification (image noising and blurring) with label smoothing.
result Improved robustness and uncertainty quantification on corrupted image benchmarks.
A new method improves robustness in image translation by modeling uncertainty.
problem Performance degradation in image translation models due to lack of robustness to outliers and uncertainty.
method UGAC method based on Uncertainty-aware Generalized Adaptive Cycle Consistency, modeling per-pixel residual with generalized Gaussian distribution.
result Our method exhibits stronger robustness towards unseen perturbations in test data.
Benchmark improves object detection robustness in winter weather.
problem Assessing object detection models' performance under image corruptions.
method Developed three benchmark datasets with various image corruptions; used data augmentation to improve robustness.
result Simple data augmentation significantly enhances model robustness across different corruptions and datasets.
A new tensor network method for image classification reduces computation cost.
problem Efficiently classifying images in high-dimensional spaces.
method Proposes a multi-layered tensor network (MLTN) that performs one MPS operation per layer, reducing computation cost.
result Reduces computation cost without degrading performance.
Image understanding is an important research domain in the computer vision due to its wide real-world applications. For an image understanding framework that uses the Bag-of-Words model representation, the visual codebook is an essential part. Random forest (RF) as a tree-structure discriminative codebook has been a po…
Adversarial autoencoders improve anomaly detection in images.
problem Anomaly detection in images is challenging when training data contains outliers.
method Adversarial autoencoders enforce a prior distribution on latent representations to identify and reject potential anomalies during training.
result Adversarial autoencoders significantly improve robustness to outliers during training.
Images seen during test time are often not from the same distribution as images used for learning. This problem, known as domain shift, occurs when training classifiers from object-centric internet image databases and trying to apply them directly to scene understanding tasks. The consequence is often severe performanc…
2DSig-Detect detects adversarial perturbations in images.
problem Adversarial attacks degrade image model performance.
method 2D-signature embedded semi-supervised framework using rough path theory.
result 2DSig-Detect outperforms other methods in detecting adversarial perturbations.
Recently, impressive denoising results have been achieved by Bayesian approaches which assume Gaussian models for the image patches. This improvement in performance can be attributed to the use of per-patch models. Unfortunately such an approach is particularly unstable for most inverse problems beyond denoising. In th…
A novel approach stores encoded images as centroids and covariance matrices to improve classification accuracy with less memory.
problem Catastrophic forgetting and memory limitations in continual learning.
method Trains autoencoders with Neural Style Transfer to encode images, replay encoded episodes to avoid forgetting, and use centroids and covariance matrices for pseudo-images when memory is full.
result Increases classification accuracy by 13-17% over state-of-the-art methods on benchmark datasets, while requiring 78% less storage space.
Simple noise training improves image recognition robustness.
problem Modern neural networks struggle with unseen image corruptions.
method Additive Gaussian and Speckle noise training, adversarial training against worst-case noise.
result Significant improvement in robustness on ImageNet-C and MNIST-C benchmarks.
I2SB learns nonlinear diffusion processes between images.
problem Image restoration tasks, especially with limited structural information.
method Conditional diffusion models, Schrödinger bridge approach.
result I2SB outperforms standard models in various image restoration tasks. Convolutional neural networks (CNNs) have shown promising results on several segmentation tasks in magnetic resonance (MR) images. However, the accuracy of CNNs may degrade severely when segmenting images acquired with different scanners and/or protocols as compared to the training data, thus limiting their practical u…
BP-DIP combines DIP and backprojection for image restoration.
problem Performance drop of deep learning methods due to mismatched observation models.
method Combines Deep Image Prior (DIP) and backprojection.
result BP-DIP outperforms DIP in deblurring tasks with higher PSNR and faster inference.
DECT-MULTRA improves material decomposition in CT images.
problem Noise and artifacts degrade material images in DECT imaging.
method Combines PWLS estimation with MULTRA model for efficient clustering and sparse coding.
result Superior material image quality and decomposition accuracy compared to other methods.
DeepCapture detects image spam emails using CNN and data augmentation.
problem Detecting new image spam emails with overfitting.
method CNN-XGBoost framework with data augmentation.
result DeepCapture achieves an F1-score of 88%.
Navigated 2D multi-slice dynamic Magnetic Resonance (MR) imaging enables high contrast 4D MR imaging during free breathing and provides in-vivo observations for treatment planning and guidance. Navigator slices are vital for retrospective stacking of 2D data slices in this method. However, they also prolong the acquisi…
A deep clustering method for hyperspectral images improves clustering performance by constraining intra-class distances.
problem Clustering performance degradation in hyperspectral images due to high dimensionality.
method Intra-class distance constrained deep clustering algorithm using auto-encoder network.
result The proposed algorithm outperforms state-of-the-art methods in clustering hyperspectral images.
We create a smooth manifold of triangular meshes with a geodesically complete metric.
problem Representing and manipulating 2D shapes as triangular meshes.
method Developed a geodesically complete Riemannian metric for triangular meshes.
result The metric preserves mesh connectivity and avoids mesh degradation.
ERNet reduces CNN bandwidth needs for imaging tasks.
problem High DRAM bandwidth requirements for CNNs in imaging.
method ERNet uses block-based inference and temporary layer expansion.
result ERNet outperforms state-of-the-art models in image denoising and super-resolution.
ScieNet improves deep learning resilience to input perturbations.
problem Deep learning's poor resilience to input perturbations in real-world scenarios.
method Hybrid architecture combining SNN for contextual info extraction and DNN for classification.
result Significant improvement in accuracy on noisy and rainy images without prior training.
In coronary CT angiography, a series of CT images are taken at different levels of radiation dose during the examination. Although this reduces the total radiation dose, the image quality during the low-dose phases is significantly degraded. To address this problem, here we propose a novel semi-supervised learning tech…
The paper analyzes how synthetic data training degrades diffusion models, providing bounds and characterizing different drift regimes.
problem The degradation of performance in diffusion models trained on synthetic data.
method Theoretical analysis of score-based diffusion models, focusing on the accumulated divergence between generated and target distributions.
result Upper and lower bounds on the accumulated divergence, providing the first lower bound for diffusion models.
Observations of astrophysical objects such as galaxies are limited by various sources of random and systematic noise from the sky background, the optical system of the telescope and the detector used to record the data. Conventional deconvolution techniques are limited in their ability to recover features in imaging da…
PoGDiff improves diffusion models on imbalanced datasets.
problem Diffusion models struggle with imbalanced text-image pairs.
method PoGDiff replaces ground-truth with a Product of Gaussians.
result PoGDiff enhances generation accuracy and quality on imbalanced datasets.
Meta-trained optimizers improve model robustness to image corruptions.
problem Robustness of deep learning models to input noise.
method Meta-training a learned optimizer to produce robust models.
result Meta-trained optimizers improve model robustness to Gaussian noise.
DeepConsensus improves robustness of image classification models.
problem Rapid degradation of accuracy in deep neural networks when classifying perturbed test samples.
method Augments existing convolutional neural networks with a novel architecture (DeepConsensus) that considers summaries of low and high level features.
result Significantly improved generalization to test-time perturbations on various datasets.
Develops a multichannel deep network for faster, artifact-free image CS.
problem Block-wise sampling artifacts in image CS with multiple sampling rates.
method Multichannel deep network for block-based image CS, removing blocking artifacts.
result Significantly outperforms state-of-the-art CS methods in objective and subjective metrics.
Compression-based similarity measures are effectively employed in applications on diverse data types with a basically parameter-free approach. Nevertheless, there are problems in applying these techniques to medium-to-large datasets which have been seldom addressed. This paper proposes a similarity measure based on com…
Study assesses deep neural networks' robustness in mammogram images.
problem Understanding deep neural networks' robustness in mammogram images for breast cancer screening.
method Measuring sensitivity to four perturbations and analyzing low-pass filtering effects.
result Mammogram image classifiers are sensitive to perturbations similar to natural images, but low-pass filtering degrades clinically meaningful features.
Patch priors have become an important component of image restoration. A powerful approach in this category of restoration algorithms is the popular Expected Patch Log-Likelihood (EPLL) algorithm. EPLL uses a Gaussian mixture model (GMM) prior learned on clean image patches as a way to regularize degraded patches. In th…
BEGAN-CS prevents mode collapse in GANs by adding a latent-space constraint.
problem Mode collapse in BEGAN during training.
method Introducing a latent-space constraint in the loss function of BEGAN.
result BEGAN-CS improves training stability and suppresses mode collapse.
Measures DNA quality degradation effects.
problem Identifying degraded DNA sequence data.
method Novel quality quantification based on intentional degradation effects.
result Quantified measures of degradation can be used for multiple purposes.
Modeling coating degradation with fewer data points.
problem Efficiently forecasting material degradation from high-frequency sensor data.
method Discrete degradation events using Hawkes processes.
result Forecasting future coating failure with superior performance.