New method processes large images with sampling and attention.
problem Computational and memory constraints in processing large images.
method Fully differentiable end-to-end trainable model that samples and processes only a fraction of the input image.
result Sampling from attention distribution results in an unbiased estimator of the full model with minimal variance.
BLISS detects and separates astronomical sources quickly and accurately.
problem Detecting and separating overlapping astronomical sources in large images.
method Bayesian Light Source Separator (BLISS) using deep generative models and variational inference.
result BLISS can process megapixel images in seconds and produce highly accurate catalogs.
Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators, especially in settings of generative adversarial networks (GANs). One special applicati…
Preconditioned non-convex gradient descent improves noisy matrix estimation.
problem Estimating low-rank matrices from noisy measurements.
method Preconditioned non-convex gradient descent for noisy measurements.
result Preconditioned method converges to minimax optimal estimate at a linear rate.
CatSIM measures image similarity robustly to small changes.
problem Measuring similarity between images, especially with small perturbations.
method Uses structural similarity image quality paradigm, robust to small location changes.
result Structural similarity between images rated higher when not entirely overlapping.
Develops statistical guarantees for image-to-image regression models.
problem Current image-to-image regression models lack statistical guarantees for model mistakes and hallucinations.
method Uncertainty quantification techniques with rigorous statistical guarantees for image-to-image regression problems.
result Derives uncertainty intervals around each pixel with formal mathematical guarantees.
AugurOne trains single image generators without GANs using image warps.
problem Training end-to-end single image generators without GANs.
method Non-affine augmentations of single input images for training an upscaling neural network.
result End-to-end training yields state-of-the-art performance on conditional generation tasks.
Total variation denoising improves image quality adaptively.
problem Improving image quality from noisy data.
method Total variation regularization for image denoising.
result Denoised images converge to true images at a parametric rate.
Transmission imaging, as an important imaging technique widely used in astronomy, medical diagnosis, and biology science, has been shown in [49] quite different from reflection imaging used in our everyday life. Understanding the structures of images (the prior information) is important for designing, testing, and choo…
A new metric FRD improves comparing medical images.
problem Comparing medical images for distribution or domain differences.
method Developed a new metric FRD using standardized radiomic features.
result FRD outperforms other metrics in various medical imaging applications.
This study investigates how much knowledge from natural images can be transferred to pathology images.
problem Quantifying how much knowledge from natural images can be transferred to pathology images.
method Proposes a framework to quantify knowledge gain by a particular layer, conducts empirical investigation in pathology image centered transfer learning.
result Early layers of deep models can transfer knowledge to pathology image classification tasks.
Generates high-resolution images from low-resolution inputs.
problem Generating realistic images from low-resolution inputs.
method Latent Adversarial Generator (LAG) using perceptual loss.
result Samples of high-resolution images from low-resolution inputs.
Few-shot unsupervised image-to-image translation model learns from a few examples.
problem Current unsupervised image-to-image translation methods require many images at training time.
method Coupling adversarial training with a novel network design for few-shot learning.
result Model achieves effective few-shot image-to-image translation.
Generates synthetic laparoscopic images for training deep neural networks.
problem Lack of large labeled data sets for laparoscopic image processing.
method Unpaired image-to-image translation to generate realistic synthetic images.
result Synthetic data set improves liver segmentation performance without manual labeling.
Computational ghost imaging is an imaging technique in which an object is imaged from light collected using a single-pixel detector with no spatial resolution. Recently, ghost cytometry has been proposed for a high-speed cell-classification method that involves ghost imaging and machine learning in flow cytometry. Ghos…
Content based image retrieval, a technique which uses visual contents of image to search images from large scale image databases according to users' interests. This paper provides a comprehensive survey on recent technology used in the area of content based face image retrieval. Nowadays digital devices and photo shari…
PG-IM uses neural-symbolic programs to manipulate images.
problem Creating holistic image representations and manipulations.
method PG-IM detects patterns, induces symbolic programs, and manipulates images using a neural network.
result PG-IM learns from a single image and achieves superior performance.
Paper introduces LLISE for image structure learning using SSIM.
problem Image quality assessment using MSE or ℓ2 norm is not promising. method Locally Linear Image Structural Embedding (LLISE) using SSIM.
result LLISE captures image structure features and discriminates distortions.
Paper proposes method to generate images from text using GANs trained on uncaptioned images.
problem Limited captioned image datasets for text-to-image synthesis.
method Conditional GANs trained on uncaptioned images with an Image Captioning Module.
result Promising preliminary results compared to unconditional GANs.
Latent feature models are attractive for image modeling, since images generally contain multiple objects. However, many latent feature models ignore that objects can appear at different locations or require pre-segmentation of images. While the transformed Indian buffet process (tIBP) provides a method for modeling tra…
The paper analyzes relationships between various image models for restoration.
problem Unclear relationships among popular image models for restoration.
method Theoretical analysis and experimental study of image models.
result Improved denoising performance by combining multiple image models.
Deep models generate images with missing high-frequency details.
problem Malicious use of realistic deep-generated images.
method Analysis of Fourier spectrum discrepancies between real and generated images.
result Detection method achieves up to 99.2% accuracy in classifying real and generated images.
StrokeCoder uses Transformers to generate images from single examples.
problem Creating diverse images from a single example.
method Transformer Neural Network learns from a single path-based example to generate a set of images.
result The model can generate a large set of deviated images that still represent the original image's style and concept.
New method reconstructs images from fMRI data using unlabeled data.
problem Challenges in acquiring labeled data for fMRI-to-image reconstruction.
method Self-supervised training with Encoder-Decoder and Decoder-Encoder networks.
result Reconstruction network adapts to new unlabeled test data.
Improved self-supervised learning for document images.
problem Performance of self-supervised pre-training on document images is poor.
method Proposed context-aware alternatives and a novel multi-modal method.
result Novel method outperforms other self-supervised methods on document image classification.
This paper proposes synthetic augmentation for nuclei image segmentation in medical pathology.
problem Rare and time-consuming labeling of tumor nuclei images for semantic segmentation.
method Label-to-image translation to generate synthetic images.
result Synthetic augmentation improves segmentation accuracy.
Style generators can invertibly generate images, useful for image enhancement and animation.
problem Generating all possible images and maintaining invertibility are challenging for GANs.
method Proposed style generators are invertible and can generate all possible images.
result Style generators outperform other GANs and Deep Image Prior as image priors.
Synthesizing images of the eye fundus is a challenging task that has been previously approached by formulating complex models of the anatomy of the eye. New images can then be generated by sampling a suitable parameter space. In this work, we propose a method that learns to synthesize eye fundus images directly from da…
Two-layer model sparsifies image residuals for CT image reconstruction.
problem Image reconstruction from limited and corrupted data.
method Pre-learning a two-layer sparsifying transform model with block coordinate descent optimization.
result Preliminary experiments show the two-layer model improves CT image reconstruction from low-dose measurements.
OTRE uses OT to improve retinal images, outperforming existing methods.
problem Improving quality of non-mydriatic retinal images for accurate diagnoses.
method OT theory for image-to-image translation, regularization by enhancing.
result OTRE outperforms state-of-the-art methods on various retinal image tasks.
Method screens similar capsule endoscopic images, reducing doctor workload and improving accuracy.
problem Time-consuming and high error rate in manual inspection of large numbers of similar capsule endoscopic images.
method Structural similarity analysis of visually salient areas and hierarchical clustering.
result 76% reduction in similar images, 100% lesion recall, 18-minute average play time.
IAGAN method improves medical image reconstruction by incorporating adaptive GAN priors.
problem Reconstructing high-fidelity medical images from incomplete data.
method Image-adaptive GAN-based reconstruction method (IAGAN).
result IAGAN can recover fine structures relevant for medical diagnosis.
LcGAN generates synthetic CT images for hemorrhagic lesion segmentation.
problem Scarce training data for hemorrhagic lesion segmentation.
method Lesion conditional Generative Adversarial Network (LcGAN) for synthetic image generation.
result Segmentation improved by 12.8% with synthetic data augmentation.
SR-NAM maps low-res images to multiple high-res images realistically.
problem Mapping low-resolution images to multiple high-resolution images realistically.
method SR-NAM using Non-Adversarial Mapping (NAM) technique and a degradation model.
result Realistic degradation and down-sampling of high-resolution images.
Local differential privacy method protects image privacy in machine learning.
problem Protecting image privacy in machine learning models from data owners.
method Locally perturbs image representations before releasing them to the data user.
result Proposes DCAConv, an image feature extractor that maintains high data utility while preserving privacy.
Image denoising is always a challenging task in the field of computer vision and image processing. In this paper, we have proposed an encoder-decoder model with direct attention, which is capable of denoising and reconstruct highly corrupted images. Our model consists of an encoder and a decoder, where the encoder is a…
Deep learning attacks chaos-based image encryption.
problem Chaos-based image encryption vulnerability.
method Project encrypted images to low-dimensional space, use deconvolutional generator to regenerate images.
result Proposes a key-independent, end-to-end trained method to attack chaos-based encryption.
Adapts deep learning models trained on simulated images for use with real images.
problem Difficulty in training deep neural networks on large amounts of experimental data.
method Adversarial domain adaptation method to mitigate domain shift between simulated and experimental image data.
result Adversarial domain adaptation successfully mitigates domain shift and improves numerical observer performance.
Image captioning has demonstrated models that are capable of generating plausible text given input images or videos. Further, recent work in image generation has shown significant improvements in image quality when text is used as a prior. Our work ties these concepts together by creating an architecture that can enabl…
In "extreme" computational imaging that collects extremely undersampled or noisy measurements, obtaining an accurate image within a reasonable computing time is challenging. Incorporating image mapping convolutional neural networks (CNN) into iterative image recovery has great potential to resolve this issue. This pape…
New model improves image captioning's ability to describe unseen concepts.
problem Image captioning models struggle with describing unseen combinations of concepts.
method Proposes a multi-task model combining caption generation and image-sentence ranking, with a decoding mechanism to re-rank captions based on image similarity.
result The model significantly outperforms state-of-the-art models in compositional generalization.
A novel generative encoder model for imaging and image processing.
problem Efficiently processing and recovering images with noise.
method A pre-training phase with a GAN and an AE, followed by an optimization phase.
result The GE model outperforms state-of-the-art algorithms in image recovery.
Novel framework uses few data for Bayesian inference in imaging.
problem Uncertainty estimation in machine learning for imaging requires large data volumes.
method Variational inference framework combining few data, domain expertise, and existing datasets.
result Bayesian models achieve state-of-the-art reconstructions with minimal data collection.
Detects and corrects adversarial images using image processing.
problem Vulnerability of deep neural networks to adversarial attacks.
method Image processing operations to detect and correct adversarial images.
result The method effectively detects and corrects adversarial images.
Generative modeling over natural images is one of the most fundamental machine learning problems. However, few modern generative models, including Wasserstein Generative Adversarial Nets (WGANs), are studied on manifold-valued images that are frequently encountered in real-world applications. To fill the gap, this pape…
Unsupervised image-to-image translation is an important and challenging problem in computer vision. Given an image in the source domain, the goal is to learn the conditional distribution of corresponding images in the target domain, without seeing any pairs of corresponding images. While this conditional distribution i…
Gaudy images help train deep neural networks with less data.
problem Training deep neural networks with limited real data from visual cortex neurons.
method Used high-contrast binarized natural images (gaudy images) to train DNNs.
result Reduced training data needed for accurate DNN predictions of visual cortex neuron responses.
Bayesian method improves star location and flux estimation from coadded images.
problem Statistical analysis of coadded astronomical images is complicated by pixel dependence.
method Bayesian approach that implicitly marginalizes single-exposure pixel intensities.
result Method outperforms single-exposure image training for star parameter estimation.