Transforms improve CNNs' invariance to image transformations.
problem Current CNN models lack robustness to spatial transformations.
method Randomly transform feature maps during training to learn invariant representations.
result Significant improvements on benchmark tasks, including image recognition and retrieval.
Planar neural networks learn image transformations from sequences.
problem Learning image transformations for mental simulation.
method Using planar neural networks, the study investigates various factors affecting the learning of image transformations.
result The approach can effectively learn and transfer image transformations, including translation, rotation, and scaling.
Adversarial learning improves image augmentation for neural networks.
problem Improving data augmentation for neural networks with limited data.
method Adversarial learning using an encoder-decoder architecture with a spatial transformer network.
result Our approach outperforms previous generative data augmentation methods.
StrokeCoder uses Transformers to generate images from single examples.
problem Creating diverse images from a single example.
method Transformer Neural Network learns from a single path-based example to generate a set of images.
result The model can generate a large set of deviated images that still represent the original image's style and concept.
Two-layer model sparsifies image residuals for CT image reconstruction.
problem Image reconstruction from limited and corrupted data.
method Pre-learning a two-layer sparsifying transform model with block coordinate descent optimization.
result Preliminary experiments show the two-layer model improves CT image reconstruction from low-dose measurements.
New method certifies images against transformations like rotations and translations.
problem Certifying robustness of images against transformations like rotations and translations.
method Randomized smoothing with three different kinds of defenses.
result Individual certificates can be obtained via statistical error bounds or efficient online inverse computation.
ETs improve model robustness to transformations in images.
problem Improving model robustness to predefined transformations.
method Equivariant Transformers (ETs) incorporating functions equivariant to continuous transformation groups.
result ETs achieve up to 15% relative improvement in error rate on image classification tasks.
Probabilistic STNs improve image classification and robustness.
problem Training and robustness issues in STNs.
method Probabilistic extension of STNs that estimates stochastic transformations.
result Improved classification performance, robustness, and model calibration.
Our goal is to extract meaningful transformations from raw images, such as varying the thickness of lines in handwriting or the lighting in a portrait. We propose an unsupervised approach to learn such transformations by attempting to reconstruct an image from a linear combination of transformations of its nearest neig…
The paper addresses model vulnerability to image transformations.
problem Vulnerability of computer vision models to distributional shifts.
method Formulates a combinatorial optimization problem and uses search algorithms to evaluate vulnerability regions. Embeds this idea in a training procedure to define new data augmentation rules.
result Trains more robust models against distributional shifts and image manipulations.
Deep image clustering improved with STN and DAC.
problem Challenges in clustering images, especially with spatial transformations.
method Combining DAC with STN to reduce spatial transformation issues.
result The combined model outperformed baseline models on MNIST and FashionMNIST.
Compressed sensing is a powerful tool in applications such as magnetic resonance imaging (MRI). It enables accurate recovery of images from highly undersampled measurements by exploiting the sparsity of the images or image patches in a transform domain or dictionary. In this work, we focus on blind compressed sensing (…
Latent feature models are attractive for image modeling, since images generally contain multiple objects. However, many latent feature models ignore that objects can appear at different locations or require pre-segmentation of images. While the transformed Indian buffet process (tIBP) provides a method for modeling tra…
Generative models improve image restoration from unknown transformations.
problem Restoring images distorted by unknown transformations.
method Combining maximum a-posteriori probability with maximum likelihood estimation.
result Restores images without requiring exact knowledge of transformations.
Study proposes a new method for MRI image reconstruction using denoising autoencoders and undecimated wavelet transforms.
problem Efficient MRI image reconstruction using under-sampled data.
method Undecimated wavelet transform, denoising autoencoder, proximal gradient algorithm.
result The proposed method enhances MRI image reconstruction efficiency and robustness.
New approach learns image transformations directly for clustering.
problem Learning better deep representations for image clustering.
method Directly learns transformations and clusters in image space without abstract features.
result Jointly learns prototypes and transformations using deep learning modules.
DECT-MULTRA improves material decomposition in CT images.
problem Noise and artifacts degrade material images in DECT imaging.
method Combines PWLS estimation with MULTRA model for efficient clustering and sparse coding.
result Superior material image quality and decomposition accuracy compared to other methods.
Mixtures of Gaussians, factor analyzers (probabilistic PCA) and hidden Markov models are staples of static and dynamic data modeling and image and video modeling in particular. We show how topographic transformations in the input, such as translation and shearing in images, can be accounted for in these models by inclu…
GT-PCA improves PCA for image and time series data.
problem Lack of robustness to transformations in PCA.
method GT-PCA is a neural network that estimates components invariant to specific transformations.
result GT-PCA outperforms alternative methods in synthetic and real data experiments.
Faster and accurate JPEG2000 image classification without reconstruction.
problem Efficiently classify j2k-compressed images without reconstructing them.
method Train a deep CNN using DWT coefficients directly from j2k-compressed images, using different augmentation techniques.
result Achieved faster and more accurate classification of j2k images without additional computation.
We present a general theory of fractal transformations and show how it leads to a new type of method for filtering and transforming digital images. This work substantially generalizes earlier work on fractal tops. The approach involves fractal geometry, chaotic dynamics, and an interplay between discrete and continuous…
Method uses JPEG transform for faster image classification.
problem Efficient image classification with compressed data.
method Reformulates residual networks for JPEG compressed images.
result Mathematically equivalent to spatial domain networks up to ReLu approximation.
Transform learning improves MRI image reconstruction from sparse data.
problem Efficiently reconstruct MRI images from limited data.
method TL-based methods using learned models and transform domains.
result TL-based methods outperform classical CS methods in MRI reconstruction.
Learned data models based on sparsity are widely used in signal processing and imaging applications. A variety of methods for learning synthesis dictionaries, sparsifying transforms, etc., have been proposed in recent years, often imposing useful structures or properties on the models. In this work, we focus on sparsif…
Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing exploits the sparsity of images or image patches in a transform domain or synth…
Neural network iteratively refines image registration, achieving compactness and speed.
problem Non-compact representation of deformations in image registration.
method Recurrent registration neural network that computes local deformations iteratively.
result Our method achieves similar accuracy but is more compact and faster.
Algorithm extracts wavefront sets from images using deep learning.
problem Extracting wavefront sets from images for imaging sciences.
method Combines shearlet transform and deep neural networks.
result Algorithm outperforms other methods in edge and ramp orientation detection.
New properties of weighted Hilbert transform derived, useful for imaging applications.
problem Properties of weighted Hilbert transform in L2 spaces.
method Derivation of Plancherel-like equations, coerciveness, iterative sequences.
result Iterative sequences for inversion are applicable to specific cases.
We consider the problem of anomaly detection in images, and present a new detection technique. Given a sample of images, all known to belong to a "normal" class (e.g., dogs), we show how to train a deep neural model that can detect out-of-distribution images (i.e., non-dog objects). The main idea behind our scheme is t…
Generates high-quality images using sparse DCT representations.
problem Challenges in generating images due to high dimensionality.
method Transformers trained on sparse DCT block sequences.
result Competitive image generation quality with state-of-the-art methods.
A deep model learns to infer fluorescence labels from unlabeled microscopy images.
problem Challenges in obtaining high quality images of cellular structures due to complex environments and label staining limitations.
method Developed a novel deep model using global pixel transformer layers and dense blocks, incorporating multi-scale input strategy.
result Significantly outperforms state-of-the-art methods in fluorescence image prediction tasks.
The development of computed tomography (CT) image reconstruction methods that significantly reduce patient radiation exposure while maintaining high image quality is an important area of research in low-dose CT (LDCT) imaging. We propose a new penalized weighted least squares (PWLS) reconstruction method that exploits …
Proposes a new framework for learning image augmentations to improve classification performance.
problem Improving classification performance with a given class of predictors.
method Transformed Risk Minimization (TRM) framework that optimizes both predictive models and data transformations.
result Performance of TRM with SCALE algorithm compares favorably to prior methods on CIFAR10/100.
Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image denoising, inpainting, and medical image reconstruction. In this work, we focus in…
New algorithm defends against adversarial examples in image classification.
problem Defending against adversarial examples in image classification.
method Approximates Discrete Fourier transform of sparse signals corrupted by L0 noise. result Successfully defends against L0 adversaries in image classification. Sparse coding is a common approach to learning local features for object recognition. Recently, there has been an increasing interest in learning features from spatio-temporal, binocular, or other multi-observation data, where the goal is to encode the relationship between images rather than the content of a single ima…
This paper explores the problem of learning transforms for image compression via autoencoders. Usually, the rate-distortion performances of image compression are tuned by varying the quantization step size. In the case of autoen-coders, this in principle would require learning one transform per rate-distortion point at…
HW2MP-GAN tackles ancient handwritten text recognition.
problem Automatic text recognition from ancient handwritten records.
method Conditional Generative Adversarial Network (HW2MP-GAN) with Sliced Wasserstein distance and U-Net architectures.
result HW2MP-GAN outperforms state-of-the-art models in image-to-image translation and handwritten recognition.
DPI quantifies phase differences in 1D and multidimensional signals using Riesz transform.
problem Quantifying phase differences in signals of varying dimensions.
method Riesz transform framework for harmonic analysis.
result DPI detects hypersynchronization and subtle changes in images and artworks.
The complexity of a learning task is increased by transformations in the input space that preserve class identity. Visual object recognition for example is affected by changes in viewpoint, scale, illumination or planar transformations. While drastically altering the visual appearance, these changes are orthogonal to r…
A new image completion method inspired by brain cells.
problem Image restoration from corrupted data.
method Biologically-inspired sub-Riemannian model with frequency and phase.
result Completion of two-dimensional images using cortical cell responses.
New techniques save bits in image compression with upsampling.
problem Lack of context dependence in current image compression methods with upsampling.
method Simple, inexpensive techniques exploiting context to predict Laplace distribution parameters.
result Average savings of 0.645 bits per difference, up to 1.489 bits.
Multimodal bitransformer boosts image-text classification.
problem Combining text and image modalities for improved classification.
method Supervised multimodal bitransformer model integrating text and image encoders.
result State-of-the-art performance on multimodal classification benchmarks.
TokenCut detects and segments objects in images and videos without supervision.
problem Detecting and segmenting salient objects in images and videos without labeled data.
method Graph-based approach using self-supervised transformer features and Normalized Cut algorithm.
result Achieves state-of-the-art results on various detection and segmentation tasks.
Let x:M→Em be an isometric immersion of a Riemannian manifold M into a Euclidean m-space. Denote by Δ the Laplace operator of M. Then Δ gives rise to a differentiable map L:M→Em, called the Laplace map, defined by L(p)=(Δx)(p), p∈M. We call L(M) the Laplace image, and the transformat…
A dynamic ResNet model learns different routes for images from different classes.
problem Fixed structure in ResNet-like architectures limits their adaptability to diverse inputs.
method Develops a ResNet-based model that dynamically selects Computational Units for each input image.
result Achieves better results on CIFAR-10 test set compared to the original ResNet-38 architecture.
Images seen during test time are often not from the same distribution as images used for learning. This problem, known as domain shift, occurs when training classifiers from object-centric internet image databases and trying to apply them directly to scene understanding tasks. The consequence is often severe performanc…
A new UNet variant reduces spectral artifacts in image transformations.
problem Spectral artifacts caused by traditional UNet upsampling layers.
method Introduced a Guided UNet (GUNet) architecture using a novel upsampling module.
result GUNet produces higher fidelity outputs in image transformations.