HW2MP-GAN tackles ancient handwritten text recognition.
problem Automatic text recognition from ancient handwritten records.
method Conditional Generative Adversarial Network (HW2MP-GAN) with Sliced Wasserstein distance and U-Net architectures.
result HW2MP-GAN outperforms state-of-the-art models in image-to-image translation and handwritten recognition.
Fawkes protects images from unauthorized facial recognition models.
problem Unauthorized training of facial recognition models poses privacy risks.
method Fawkes adds imperceptible pixel-level changes (cloaks) to images before release.
result Fawkes can protect images from misidentification by 95% and 80% even when clean images are leaked.
It is proposed a new code for contours of plane images. This code was applied for optical character recognition of printed and handwritten characters. One can apply it to recognition of any visual images.
Efficiently processes high res images by selecting relevant patches.
problem High memory and compute requirements for processing large images.
method Differentiable Top-K operator to select relevant patches.
result End-to-end trainable model using backpropagation.
Paper introduces privacy-preserving few-shot learning for images.
problem Privacy risk in few-shot learning systems.
method Discrete embedding vectors and one-way hash functions.
result Achieves computational pan privacy without storing embeddings.
Proposes Moment Exchange to use moments in image recognition models, improving generalization.
problem Discarding moments in image recognition models reduces stability and training time.
method Moment Exchange: replaces moments of learned features with another image's moments and interpolates labels.
result Improves generalization of recognition models across multiple datasets.
AI enhances pollen recognition in veterinary imaging using holographic microscopy.
problem Challenges in recognizing pollen in holographic images due to speckle noise and artifacts.
method Training YOLOv8s and MobileNetV3L on dual-modality dataset, employing WGAN-SN for synthetic data augmentation.
result GAN-based augmentation improves object detection and classification in holographic images, closing the performance gap.
The paper addresses bias in visual recognition models by reweighting observations.
problem Bias in deep neural networks trained on biased image databases.
method Reweighting observations based on known biasing mechanisms to form a nearly debiased estimator.
result The approach can remedy representativeness issues in visual recognition systems.
Face recognition system trained with noisy labels.
problem Label noise in training deep learning classifiers.
method Review and apply recent methods to manage noisy annotations.
result Improved performance of face recognition system with noisy labels.
Proposes a new metric learning method for image recognition.
problem Improving image recognition performance using learned distance representations.
method Introduces a Generalized Hybrid Metric Loss (GHM-Loss) to learn hybrid proximity features combining geometric and probabilistic spaces.
result Demonstrates superior performance compared to existing methods on public datasets.
ChemGrapher uses deep learning to automatically convert chemical compound images into accurate graphs.
problem Automatically converting chemical compound images into accurate graphs with correct bond multiplicity and stereochemical information.
method Developed a deep neural network model for optical compound recognition, including segmentation and classification models.
result Significant error reductions in bond multiplicity and stereochemical information compared to existing tools.
ViewFool identifies adversarial viewpoints to test image recognition robustness.
problem Lack of robustness to viewpoint changes in visual recognition models.
method Neural Radiance Fields (NeRF) and entropic regularizer to find adversarial viewpoints.
result Common image classifiers are highly vulnerable to generated adversarial viewpoints.
Image recognition using Deep Learning has been evolved for decades though advances in the field through different settings is still a challenge. In this paper, we present our findings in searching for better image classifiers in offline and online environments. We resort to Convolutional Neural Network and its variatio…
Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
Transforms improve CNNs' invariance to image transformations.
problem Current CNN models lack robustness to spatial transformations.
method Randomly transform feature maps during training to learn invariant representations.
result Significant improvements on benchmark tasks, including image recognition and retrieval.
Simple noise training improves image recognition robustness.
problem Modern neural networks struggle with unseen image corruptions.
method Additive Gaussian and Speckle noise training, adversarial training against worst-case noise.
result Significant improvement in robustness on ImageNet-C and MNIST-C benchmarks.
Two-stage neural network for few-shot image recognition.
problem Few-shot image recognition for novel categories.
method Multi-layer neural network with feature extraction and classification stages.
result Competitive performance on four standard datasets.
Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial examples, raising concerns about the robustness of such systems. Adversarial exampl…
Predict steering angles of self-driving cars from images.
problem Predicting steering angles for self-driving cars using image data.
method Used deep learning techniques like Transfer Learning, 3D CNN, LSTM, and ResNet to predict steering angles.
result Both models placed in the top ten of Udacity's challenge.
The problem of identifying voice commands has always been a challenge due to the presence of noise and variability in speed, pitch, etc. We will compare the efficacies of several neural network architectures for the speech recognition problem. In particular, we will build a model to determine whether a one second audio…
In a real-world setting, visual recognition systems can be brought to make predictions for images belonging to previously unknown class labels. In order to make semantically meaningful predictions for such inputs, we propose a two-step approach that utilizes information from knowledge graphs. First, a knowledge-graph r…
A new approach to unsupervised learning using recognition-parametrised models.
problem Discovering meaningful latent structure in observational data.
method Recognition-Parametrised Model (RPM) combining parametric and non-parametric components.
result Effective learning of latent structure without explicit generative models.
Recently, two-dimensional canonical correlation analysis (2DCCA) has been successfully applied for image feature extraction. The method instead of concatenating the columns of the images to the one-dimensional vectors, directly works with two-dimensional image matrices. Although 2DCCA works well in different recognitio…
Boosts neural network performance by improving weight separability.
problem Improving the separability of weight vectors in neural networks.
method Proposes a new evaluation metric and feed-backward reconstruction loss to encourage weight separability.
result Improves visual recognition performance across various tasks.
Paper proposes ONTD for nonnegative tensor data.
problem Handling nonnegative tensor data efficiently.
method Orthogonal Nonnegative Tucker Decomposition (ONTD) with convex relaxation algorithm.
result Demonstrates effectiveness on real-world image data applications.
DeepEthnic classifies faces into ethnic groups with high accuracy.
problem Classifying faces into ethnic groups using machine learning.
method Transfer learning from a large-scale data recognition network.
result State-of-the-art success rates for four ethnic groups.
The paper uses VGG-19 for plant species classification from leaf images.
problem Manual inspection of plant species by botanists is time-consuming.
method Transfer learning with VGG-19 for feature extraction and classification.
result The model achieves 99.70% accuracy in predicting plant species.
Deep convolutional neural networks have recently achieved state-of-the-art performance on a number of image recognition benchmarks, including the ImageNet Large-Scale Visual Recognition Challenge (ILSVRC-2012). The winning model on the localization sub-task was a network that predicts a single bounding box and a confid…
Bayesian tensor network reduces conditional probability calculation to polynomial time.
problem Exponential cost of calculating conditional probabilities for multiple events.
method Bayesian tensor network (BTN) with polynomial complexity.
result Competitive performance in image recognition with simple tree structures.
Recognizing a hotel from an image of a hotel room is important for human trafficking investigations. Images directly link victims to places and can help verify where victims have been trafficked, and where their traffickers might move them or others in the future. Recognizing the hotel from images is challenging becaus…
Sparse Vision MoE matches dense networks in image recognition while using less compute.
problem Scaling vision models efficiently in computer vision.
method Vision MoE (V-MoE) - a sparse version of Vision Transformer.
result V-MoE matches state-of-the-art dense networks in image recognition with half the compute.
Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning (ZSL) aims to transfer knowledge from labeled classes into unlabeled classes to r…
The problem of domain generalization is to take knowledge acquired from a number of related domains where training data is available, and to then successfully apply it to previously unseen domains. We propose a new feature learning algorithm, Multi-Task Autoencoder (MTAE), that provides good generalization performance …
Detect knots from photos using machine learning and traditional algorithms.
problem Automatically recognize knots from images.
method Combining CNN and transformer architectures for image recognition with traditional knot invariants.
result Lightweight machine learning models can recover meaningful structural information from images.
Project creates new dataset for 'in the wild' emotions recognition.
problem Recognition of emotions in real-life unpredictable situations.
method Design and implement a new dataset and deep learning model.
result Demonstrates effectiveness of the new deep learning model for real-life emotions recognition.
In this work, we have proposed several enhancements to improve the performance of any facial emotion recognition (FER) system. We believe that the changes in the positions of the fiducial points and the intensities capture the crucial information regarding the emotion of a face image. We propose the use of the gradient…
V-HMN integrates memory mechanisms for improved image recognition.
problem Limited interpretability and high data requirements of existing vision backbones.
method Brain-inspired hierarchical memory modules with iterative refinement.
result V-HMN achieves strong performance on image classification benchmarks.
Improves neural network mapping functionality using latent feature generation.
problem Improving neural network performance in visual recognition tasks.
method Reversible learning for generating and learning latent features.
result The proposed method outperforms existing state-of-the-art methods in visual recognition.
Image modality recognition is essential for efficient imaging workflows in current clinical environments, where multiple imaging modalities are used to better comprehend complex diseases. Emerging biomarkers from novel, rare modalities are being developed to aid in such understanding, however the availability of these …
Study improves pollen detection in optical and holographic images using deep learning.
problem Improving pollen detection accuracy in holographic microscopy images.
method Used YOLOv8s for detection and MobileNetV3L for classification, addressing performance gaps through dataset expansion and automated labeling.
result Significant improvement in detection and classification performance on holographic images.
The past several years have seen both an explosion in the use of Convolutional Neural Networks (CNNs) and the design of accelerators to make CNN inference practical. In the architecture community, the lion share of effort has targeted CNN inference for image recognition. The closely related problem of video recognition…
Paper proposes a method to encrypt faces while maintaining visual similarity.
problem Protecting personal data from unauthorized face recognition.
method Targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
result TIP-IM provides 95%+ protection success rate against face recognition models.
Deep learning improves material recognition in construction monitoring.
problem Varying illuminations and low accuracy rates in material classification.
method Deep learning methods, including convolutional neural networks, were used to classify and recognize materials in construction sites.
result Achieved 97.35% accuracy rate for material classification.
This paper explores how facial recognition systems can be fooled by adversarial attacks.
problem Adversarial attacks on facial recognition systems.
method Applying Fast Gradient Sign Method and crafting various black-box attack algorithms.
result High levels of perturbation can significantly decrease classifier confidence and misclassification rates.
Researchers found PP-GANs can hide sensitive data in sanitized images, undermining privacy checks.
problem Lack of formal proofs of privacy in PP-GANs for image sanitization.
method Subverted PP-GANs for facial expression recognition to hide sensitive data in sanitized images.
result It is possible to hide sensitive identification data in sanitized PP-GAN output images, even allowing reconstruction of entire input images.
Understanding how images of objects and scenes behave in response to specific ego-motions is a crucial aspect of proper visual development, yet existing visual learning methods are conspicuously disconnected from the physical source of their images. We propose to exploit proprioceptive motor signals to provide unsuperv…
Deep learning automates bacterial image classification.
problem Manual bacterial classification is time-consuming and error-prone.
method ResNet-50 pre-trained CNN architecture with transfer learning.
result Average classification accuracy of 99.2%.
Gaussian Process upsampling boosts OCR accuracy from low-res images.
problem Low-quality and downsampled image data hinders OCR accuracy.
method Gaussian Process upsampling model for improving OCR on low-resolution documents.
result Upsampling improves OCR accuracy on low-resolution images.