GANPOP uses deep learning to estimate optical properties from single images, improving accuracy over existing methods.
problem Estimating optical properties from single wide-field images.
method Conditional generative adversarial networks trained on paired images and optical property maps.
result GANPOP estimates optical properties with 58% higher accuracy than single-snapshot optical property technique in human gastrointestinal specimens.
Deep learning model detects and flags artefacts in polarimetric images.
problem Artifacts in polarimetric images contaminate areas of interest.
method Convolutional Neural Network (CNN) for automatic artefact detection.
result Model achieves 98% true positive and 97% true negative rates.
Convolutional neural network localizes OD and fovea in UWFoV-SLO images.
problem Localizing optic disc and fovea centers in ultra-widefield retinal images.
method Convolutional neural network trained on reflectance and autofluorescence images.
result 99.4% OD localisation accuracy and 99.1% fovea localisation accuracy.
Modeling the Point Spread Function (PSF) of wide-field surveys is vital for many astrophysical applications and cosmological probes including weak gravitational lensing. The PSF smears the image of any recorded object and therefore needs to be taken into account when inferring properties of galaxies from astronomical i…
A new method tracks retinal vessels more accurately than existing methods.
problem Tracking retinal vessels accurately in spherical images.
method Computing cusp-free, crossing-preserving geodesics on spherical positions and orientations.
result Crossing-preserving tracking shows clear advantages over non-crossing-preserving tracking.
Fluorescence microscopy has enabled a dramatic development in modern biology. Due to its inherently weak signal, fluorescence microscopy is not only much noisier than photography, but also presented with Poisson-Gaussian noise where Poisson noise, or shot noise, is the dominating noise source. To get clean fluorescence…
Enhances high-throughput imaging of microtubule networks, improving clarity and consistency.
problem Fluorescence noise obscures microtubule structures in high-throughput imaging.
method CycleGAN learning to enhance low-resolution images of microtubule networks.
result CycleGAN effectively identifies microtubules with high accuracy (0.93+ AUC-ROC).
We present an algorithm for converting an indoor spherical panorama into a photograph with a simulated overhead view. The resulting image will have an extremely wide field of view covering up to 4π steradians of the spherical panorama. We argue that our method complements the stereographic projection commonly used in t…
CNN identifies AGN host galaxies from Sloan Digital Sky Survey data.
problem Identifying AGN host galaxies using traditional methods is time-consuming.
method Trained a convolutional neural network on 210,000 galaxies.
result CNN can distinguish AGN host galaxies from non-active galaxies.
New Roman pipeline detects astronomical transients.
problem Automated detection of transients from Roman Space Telescope data.
method Machine learning model RuBR for distinguishing real from fake detections.
result Effective real-bogus classification in Roman era.
Convolutional neural networks (CNN) have led to many state-of-the-art results spanning through various fields. However, a clear and profound theoretical understanding of the forward pass, the core algorithm of CNN, is still lacking. In parallel, within the wide field of sparse approximation, Convolutional Sparse Coding…
We present RAPID (Real-time Automated Photometric IDentification), a novel time-series classification tool capable of automatically identifying transients from within a day of the initial alert, to the full lifetime of a light curve. Using a deep recurrent neural network with Gated Recurrent Units (GRUs), we present th…
Current economic theories miss most of economic dynamics.
problem Accuracy of economic theories and policies depend on economic variables and processes.
method Identify and analyze overlooked economic variables and processes.
result Many economic variables and processes not accounted for in current theories.
Optimizes machine learning and system identification for real-world physical systems.
problem Estimating parameters in complex, real-world physical systems.
method Combines classical system identification and modern machine learning techniques using optimization-based approaches.
result Developed regularization strategies to incorporate prior knowledge into flexible models.
CatSIM measures image similarity robustly to small changes.
problem Measuring similarity between images, especially with small perturbations.
method Uses structural similarity image quality paradigm, robust to small location changes.
result Structural similarity between images rated higher when not entirely overlapping.
Develops statistical guarantees for image-to-image regression models.
problem Current image-to-image regression models lack statistical guarantees for model mistakes and hallucinations.
method Uncertainty quantification techniques with rigorous statistical guarantees for image-to-image regression problems.
result Derives uncertainty intervals around each pixel with formal mathematical guarantees.
AugurOne trains single image generators without GANs using image warps.
problem Training end-to-end single image generators without GANs.
method Non-affine augmentations of single input images for training an upscaling neural network.
result End-to-end training yields state-of-the-art performance on conditional generation tasks.
Total variation denoising improves image quality adaptively.
problem Improving image quality from noisy data.
method Total variation regularization for image denoising.
result Denoised images converge to true images at a parametric rate.
Transmission imaging, as an important imaging technique widely used in astronomy, medical diagnosis, and biology science, has been shown in [49] quite different from reflection imaging used in our everyday life. Understanding the structures of images (the prior information) is important for designing, testing, and choo…
A new metric FRD improves comparing medical images.
problem Comparing medical images for distribution or domain differences.
method Developed a new metric FRD using standardized radiomic features.
result FRD outperforms other metrics in various medical imaging applications.
This study investigates how much knowledge from natural images can be transferred to pathology images.
problem Quantifying how much knowledge from natural images can be transferred to pathology images.
method Proposes a framework to quantify knowledge gain by a particular layer, conducts empirical investigation in pathology image centered transfer learning.
result Early layers of deep models can transfer knowledge to pathology image classification tasks.
Generates high-resolution images from low-resolution inputs.
problem Generating realistic images from low-resolution inputs.
method Latent Adversarial Generator (LAG) using perceptual loss.
result Samples of high-resolution images from low-resolution inputs.
Generates synthetic laparoscopic images for training deep neural networks.
problem Lack of large labeled data sets for laparoscopic image processing.
method Unpaired image-to-image translation to generate realistic synthetic images.
result Synthetic data set improves liver segmentation performance without manual labeling.
Computational ghost imaging is an imaging technique in which an object is imaged from light collected using a single-pixel detector with no spatial resolution. Recently, ghost cytometry has been proposed for a high-speed cell-classification method that involves ghost imaging and machine learning in flow cytometry. Ghos…
Content based image retrieval, a technique which uses visual contents of image to search images from large scale image databases according to users' interests. This paper provides a comprehensive survey on recent technology used in the area of content based face image retrieval. Nowadays digital devices and photo shari…
PG-IM uses neural-symbolic programs to manipulate images.
problem Creating holistic image representations and manipulations.
method PG-IM detects patterns, induces symbolic programs, and manipulates images using a neural network.
result PG-IM learns from a single image and achieves superior performance.
Paper introduces LLISE for image structure learning using SSIM.
problem Image quality assessment using MSE or ℓ2 norm is not promising. method Locally Linear Image Structural Embedding (LLISE) using SSIM.
result LLISE captures image structure features and discriminates distortions.
Paper proposes method to generate images from text using GANs trained on uncaptioned images.
problem Limited captioned image datasets for text-to-image synthesis.
method Conditional GANs trained on uncaptioned images with an Image Captioning Module.
result Promising preliminary results compared to unconditional GANs.
Latent feature models are attractive for image modeling, since images generally contain multiple objects. However, many latent feature models ignore that objects can appear at different locations or require pre-segmentation of images. While the transformed Indian buffet process (tIBP) provides a method for modeling tra…
The paper analyzes relationships between various image models for restoration.
problem Unclear relationships among popular image models for restoration.
method Theoretical analysis and experimental study of image models.
result Improved denoising performance by combining multiple image models.
Deep models generate images with missing high-frequency details.
problem Malicious use of realistic deep-generated images.
method Analysis of Fourier spectrum discrepancies between real and generated images.
result Detection method achieves up to 99.2% accuracy in classifying real and generated images.
StrokeCoder uses Transformers to generate images from single examples.
problem Creating diverse images from a single example.
method Transformer Neural Network learns from a single path-based example to generate a set of images.
result The model can generate a large set of deviated images that still represent the original image's style and concept.
New method reconstructs images from fMRI data using unlabeled data.
problem Challenges in acquiring labeled data for fMRI-to-image reconstruction.
method Self-supervised training with Encoder-Decoder and Decoder-Encoder networks.
result Reconstruction network adapts to new unlabeled test data.
Improved self-supervised learning for document images.
problem Performance of self-supervised pre-training on document images is poor.
method Proposed context-aware alternatives and a novel multi-modal method.
result Novel method outperforms other self-supervised methods on document image classification.
This paper proposes synthetic augmentation for nuclei image segmentation in medical pathology.
problem Rare and time-consuming labeling of tumor nuclei images for semantic segmentation.
method Label-to-image translation to generate synthetic images.
result Synthetic augmentation improves segmentation accuracy.
Style generators can invertibly generate images, useful for image enhancement and animation.
problem Generating all possible images and maintaining invertibility are challenging for GANs.
method Proposed style generators are invertible and can generate all possible images.
result Style generators outperform other GANs and Deep Image Prior as image priors.
Synthesizing images of the eye fundus is a challenging task that has been previously approached by formulating complex models of the anatomy of the eye. New images can then be generated by sampling a suitable parameter space. In this work, we propose a method that learns to synthesize eye fundus images directly from da…
Two-layer model sparsifies image residuals for CT image reconstruction.
problem Image reconstruction from limited and corrupted data.
method Pre-learning a two-layer sparsifying transform model with block coordinate descent optimization.
result Preliminary experiments show the two-layer model improves CT image reconstruction from low-dose measurements.
OTRE uses OT to improve retinal images, outperforming existing methods.
problem Improving quality of non-mydriatic retinal images for accurate diagnoses.
method OT theory for image-to-image translation, regularization by enhancing.
result OTRE outperforms state-of-the-art methods on various retinal image tasks.
Method screens similar capsule endoscopic images, reducing doctor workload and improving accuracy.
problem Time-consuming and high error rate in manual inspection of large numbers of similar capsule endoscopic images.
method Structural similarity analysis of visually salient areas and hierarchical clustering.
result 76% reduction in similar images, 100% lesion recall, 18-minute average play time.
IAGAN method improves medical image reconstruction by incorporating adaptive GAN priors.
problem Reconstructing high-fidelity medical images from incomplete data.
method Image-adaptive GAN-based reconstruction method (IAGAN).
result IAGAN can recover fine structures relevant for medical diagnosis.
LcGAN generates synthetic CT images for hemorrhagic lesion segmentation.
problem Scarce training data for hemorrhagic lesion segmentation.
method Lesion conditional Generative Adversarial Network (LcGAN) for synthetic image generation.
result Segmentation improved by 12.8% with synthetic data augmentation.
SR-NAM maps low-res images to multiple high-res images realistically.
problem Mapping low-resolution images to multiple high-resolution images realistically.
method SR-NAM using Non-Adversarial Mapping (NAM) technique and a degradation model.
result Realistic degradation and down-sampling of high-resolution images.
Local differential privacy method protects image privacy in machine learning.
problem Protecting image privacy in machine learning models from data owners.
method Locally perturbs image representations before releasing them to the data user.
result Proposes DCAConv, an image feature extractor that maintains high data utility while preserving privacy.
Image denoising is always a challenging task in the field of computer vision and image processing. In this paper, we have proposed an encoder-decoder model with direct attention, which is capable of denoising and reconstruct highly corrupted images. Our model consists of an encoder and a decoder, where the encoder is a…
Deep learning attacks chaos-based image encryption.
problem Chaos-based image encryption vulnerability.
method Project encrypted images to low-dimensional space, use deconvolutional generator to regenerate images.
result Proposes a key-independent, end-to-end trained method to attack chaos-based encryption.
Adapts deep learning models trained on simulated images for use with real images.
problem Difficulty in training deep neural networks on large amounts of experimental data.
method Adversarial domain adaptation method to mitigate domain shift between simulated and experimental image data.
result Adversarial domain adaptation successfully mitigates domain shift and improves numerical observer performance.
Image captioning has demonstrated models that are capable of generating plausible text given input images or videos. Further, recent work in image generation has shown significant improvements in image quality when text is used as a prior. Our work ties these concepts together by creating an architecture that can enabl…