This work generates synthetic 3D thermal facial data using 2D facial data and deep learning.
problem Creating large datasets for deep learning in computer vision.
method 3D facial modelling techniques and deep learning methodologies.
result Synthetic 3D thermal facial data created for deep learning applications.
Method converts facial expressions and voice of a source speaker into a target speaker.
problem Separate conversion of facial and acoustic features leads to unnatural results.
method Uses three neural networks: conversion, waveform generation, and image reconstruction.
result Significantly higher naturalness achieved when converting both features together.
Fawkes protects images from unauthorized facial recognition models.
problem Unauthorized training of facial recognition models poses privacy risks.
method Fawkes adds imperceptible pixel-level changes (cloaks) to images before release.
result Fawkes can protect images from misidentification by 95% and 80% even when clean images are leaked.
We present a method for synthesizing a frontal, neutral-expression image of a person's face given an input face photograph. This is achieved by learning to generate facial landmarks and textures from features extracted from a facial-recognition network. Unlike previous approaches, our encoding feature vector is largely…
This work introduces a framework to detect unintended bias in facial analysis models.
problem Detecting unintended biases in facial analysis models used in critical applications.
method Image counterfactual sensitivity analysis using generative adversarial networks.
result Identifies factors affecting facial classifier predictions, revealing unintended biases.
Content based image retrieval, a technique which uses visual contents of image to search images from large scale image databases according to users' interests. This paper provides a comprehensive survey on recent technology used in the area of content based face image retrieval. Nowadays digital devices and photo shari…
New method transfers emotions in facial images.
problem Transforming facial images to different emotions.
method Infinite task learning and vector-valued reproducing kernel Hilbert spaces.
result Achieves low reconstruction cost and high emotion classification accuracy.
Enhances facial emotion recognition with gradient and Laplacian images.
problem Improving the performance of facial emotion recognition systems.
method Proposes using gradient and Laplacian of input images with a CNN.
result Enhances FER systems by 3 to 5%.
Proposes k-Same-Siamese-GAN for de-identifying facial images efficiently and preserving privacy.
problem Ensuring privacy of facial images while preserving useful data.
method Uses k-Same-Anonymity, GAN, hyperparameter tuning, and mixed precision training.
result Efficient de-identification of high-resolution facial images with privacy guarantees.
We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial keypoints of an input image in an unsupervised manne…
This paper explores how facial recognition systems can be fooled by adversarial attacks.
problem Adversarial attacks on facial recognition systems.
method Applying Fast Gradient Sign Method and crafting various black-box attack algorithms.
result High levels of perturbation can significantly decrease classifier confidence and misclassification rates.
Generative adversarial network synthesizes sketches into realistic images.
problem Improving the quality and realism of facial sketches.
method Hybrid GAN with quality guided encoder and identity preserving network.
result Synthesized images are more realistic and maintain identity.
Facial attribute editing aims to manipulate single or multiple attributes of a face image, i.e., to generate a new face with desired attributes while preserving other details. Recently, generative adversarial net (GAN) and encoder-decoder architecture are usually incorporated to handle this task with promising results.…
GANs can bias synthetic data, affecting minority and female faces.
problem GANs can amplify biases in synthetic data augmentation.
method Examine GANs on face-shots with gender and skin tone biases.
result GANs generate biased synthetic data, skewing minority modes and features.
We propose a novel method for automatic pain intensity estimation from facial images based on the framework of kernel Conditional Ordinal Random Fields (KCORF). We extend this framework to account for heteroscedasticity on the output labels(i.e., pain intensity scores) and introduce a novel dynamic features, dynamic ra…
Task-assisted domain adaptation improves performance on synthetic-to-real image tasks.
problem Models trained on synthetic images often fail to generalize to real images due to domain shift.
method Introduce anchor tasks with easy-to-obtain annotations, apply reeze technique to learn cross-task guidance.
result Using anchor tasks on both synthetic and real domains improves performance compared to training on one domain.
A model separates visual style from digit type on MNIST and facial features from shape on CelebA.
problem Learning compact, independent factors of data.
method Explicitly encoded in a generative model with two latent spaces: spatial transformations and intrinsic appearance.
result The model separates visual style from digit type on MNIST and facial features from shape on CelebA.
Develops a fast non-invasive tool for diagnosing pediatric sleep apnea.
problem Diagnosing pediatric obstructive sleep apnea using an overnight sleep study is often impractical.
method Combines persistent homology, geometric shape analysis, and convolutional neural networks to classify facial images.
result Facial features associated with obstructive sleep apnea can be recognized for diagnosis.
Researchers found PP-GANs can hide sensitive data in sanitized images, undermining privacy checks.
problem Lack of formal proofs of privacy in PP-GANs for image sanitization.
method Subverted PP-GANs for facial expression recognition to hide sensitive data in sanitized images.
result It is possible to hide sensitive identification data in sanitized PP-GAN output images, even allowing reconstruction of entire input images.
AutoTune learns wireless identifiers for facial recognition in real-world settings.
problem Facial recognition requires extensive user training, making it impractical for widespread deployment.
method Uses ambient wireless identifiers to train deep neural networks for facial recognition without user effort.
result Demonstrates a system that continuously refines facial recognition using wireless identifiers over time.
New method compresses facial videos using GANs and latent space optimization.
problem Efficiently compressing facial videos at low bit rates.
method Leverages StyleGAN for latent space representation and compression, learns optimal compression through entropy model and perceptual loss.
result Significantly reduces perceptual distortion at low bit rates compared to state-of-the-art codecs.
Project uses GANs to recognize facial expressions and emotions from-the-wild with dual model approach.
problem Facial expression and emotion recognition in real-world scenarios.
method Created a dual GAN model architecture for Action Units and Valence Arousal annotations.
result Dual GAN model achieved better results than single model for emotion recognition.
Bayesian Neural Networks improve uncertainty modeling in facial emotion recognition.
problem High aleatoric uncertainty and visual ambiguity in facial emotion recognition.
method Bayesian Neural Networks approximated using MC-Dropout, MC-DropConnect, or Ensemble methods.
result Bayesian Neural Networks produce more human-like output probabilities.
Paper tackles multi-task learning for emotion recognition and generation using Aff-Wild dataset.
problem Developing a multi-task learning approach for emotion recognition and generation using Aff-Wild dataset.
method Deep neural network with shared hidden layers and GAN for multi-task learning and image generation.
result Good performance of the proposed approach on Aff-Wild dataset.
Unified facial behavior analysis network improves performance across tasks.
problem Independent study of facial behavior tasks.
method Single multi-task, multi-domain, multi-label network (FaceBehaviorNet).
result Joint training of facial behavior tasks yields better performance.
Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
Biometrics emerged as a robust solution for security systems. However, given the dissemination of biometric applications, criminals are developing techniques to circumvent them by simulating physical or behavioral traits of legal users (spoofing attacks). Despite face being a promising characteristic due to its univers…
Ensuring the security of transactions is currently one of the major challenges that banking systems deal with. The usage of face for biometric authentication of users is attracting large investments from banks worldwide due to its convenience and acceptability by people, especially in cross-domain scenarios, in which f…
This paper improves facial expression recognition using CNNs and coherence constraints.
problem Facial expression recognition from static images and video sequences is challenging.
method Investigates the use of Convolutional Neural Networks (CNNs) with coherence constraints in a semi-supervised setting.
result Coherence constraints improve facial expression recognition quality, especially in the presence of occlusions.
Paper tackles selfie cartoonization with a new GAN.
problem Cartoonization of selfies with artistic abstraction and exaggeration.
method Proposes scGAN with attentive adversarial network (AAN) for specific facial region emphasis.
result Method generates cartoon portraits with improved robustness and different styles.
Study uses stacked hourglass networks to improve facial landmark detection for medical diagnosis.
problem Improving accuracy of facial landmark detection for medical diagnosis.
method Conducted a study on landmark localisation methods using stacked hourglass networks.
result State-of-the-art stacked hourglass architecture outperforms traditional methods.
One of the goals of the ICML workshop on representation and learning is to establish benchmark scores for a new data set of labeled facial expressions. This paper presents the performance of a "Null" model consisting of convolutions with random weights, PCA, pooling, normalization, and a linear readout. Our approach fo…
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
Unsupervised model predicts facial attractiveness with high accuracy.
problem Capturing the complexity of facial attractiveness through machine learning.
method Infer probabilistic models of facial preferences using Maximum Entropy and neural networks.
result High prediction accuracy in gender classification of sculpting subjects.
New method improves fairness of facial recognition systems.
problem Facial recognition systems exhibit bias across different demographic groups.
method Optimizes centroid-based scores to reduce bias in pre-trained models.
result Demonstrates significant improvement in fairness with minimal loss in accuracy.
Polynomial fusion layer improves speech-driven facial animation.
problem Recent facial synthesis relies on low-dimensional representations and concatenation, ignoring higher-order interactions.
method Proposes a polynomial fusion layer to model higher-order interactions of facial encodings.
result Demonstrates improved video quality, audiovisual synchronisation, and blink generation.
Detect facial keypoints is a critical element in face recognition. However, there is difficulty to catch keypoints on the face due to complex influences from original images, and there is no guidance to suitable algorithms. In this paper, we study different algorithms that can be applied to locate keyponits. Specifical…
A method to produce personalized classification models to automatically review online dating profiles on Tinder is proposed, based on the user's historical preference. The method takes advantage of a FaceNet facial classification model to extract features which may be related to facial attractiveness. The embeddings fr…
ZNMF improves facial recognition performance using data-dependent penalties.
problem Facial recognition performance in the Cambridge ORL database.
method ZNMF uses data-dependent auxiliary constraints to modify NMF.
result ZNMF outperforms other constrained NMF algorithms in facial recognition.
New framework improves counterfactual predictions using causal inference.
problem Challenges in predicting counterfactual outcomes with limited covariates and high-dimensional outcomes.
method Variational Bayesian causal inference framework for counterfactual generative modeling.
result Framework encourages disentangled exogenous noise and correct identification of causal effects.
Paper introduces a method for generating interlocutor-aware facial gestures in dyadic settings.
problem Generating appropriate non-verbal behavior for conversational agents in dyadic settings.
method Probabilistic method using multi-modal cues from the interlocutor to synthesize facial gestures.
result The model successfully leverages multi-modal input from the interlocutor to generate more appropriate behavior.
Paper evaluates CNN-based facial landmark detection methods.
problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.
FEAFA dataset annotates facial expressions with high detail.
problem Lack of detailed facial expression annotations in existing datasets.
method Manual annotation of 122 participants' facial expressions.
result FEAFA dataset provides detailed annotations for facial expressions.
We present a novel approach for supervised domain adaptation that is based upon the probabilistic framework of Gaussian processes (GPs). Specifically, we introduce domain-specific GPs as local experts for facial expression classification from face images. The adaptation of the classifier is facilitated in probabilistic…
This review explores automated pain detection from facial expressions using FACS.
problem Automated detection of pain from facial expressions is challenging and underexplored.
method Examines progress in AFER and APD, focusing on FACS-based methods and deep learning.
result Limited studies on APD, highlighting the need for clinical applications.
Proposes a faster Isomap algorithm by reducing eigenvalue decomposition complexity.
problem High computational complexity of Isomap, especially in eigenvalue decomposition stage.
method Introduces a projection operator to reduce the complexity of the eigenvalue decomposition stage to linear order.
result Reduces Isomap's computational complexity to linear order while preserving structural information.
Efficient facial feature learning with shared representations reduces redundancy and improves accuracy.
problem Redundancy and high computational load in training deep ensemble models.
method Wide Ensemble-based Convolutional Neural Networks (ESRs) with varying branching levels.
result ESRs reduce residual generalization error and outperform state-of-the-art methods on facial expression recognition.
Paper proposes a method to combine multiple facial analysis models for better performance.
problem Facial analysis models from different sources have low transferability.
method Two-step process: 1) Auto-encoder for common embedding, 2) Distillation for lightweight model.
result Lightweight model outperforms state-of-the-art on 15 facial analysis tasks.