Proposes a linear model for facial action recognition without requiring large datasets.
problem Limited annotated data for facial expression and action units.
method Exploits low-rank property across frames and group sparsity to subtract neutral faces and recognize actions.
result One-shot automatic method on raw face videos performs competitively and better than previous methods.
Unified facial behavior analysis network improves performance across tasks.
problem Independent study of facial behavior tasks.
method Single multi-task, multi-domain, multi-label network (FaceBehaviorNet).
result Joint training of facial behavior tasks yields better performance.
Project uses GANs to recognize facial expressions and emotions from-the-wild with dual model approach.
problem Facial expression and emotion recognition in real-world scenarios.
method Created a dual GAN model architecture for Action Units and Valence Arousal annotations.
result Dual GAN model achieved better results than single model for emotion recognition.
New system detects pain from facial AU combinations using MIL and MCIL.
problem Detecting pain from facial expressions reliably.
method Weakly supervised learning, multiple instance learning, multiple clustered instance learning.
result 87% pain recognition accuracy on UNBC-McMaster Shoulder Pain Expression dataset.
Fawkes protects images from unauthorized facial recognition models.
problem Unauthorized training of facial recognition models poses privacy risks.
method Fawkes adds imperceptible pixel-level changes (cloaks) to images before release.
result Fawkes can protect images from misidentification by 95% and 80% even when clean images are leaked.
Survey examines public views on facial recognition technology.
problem Public acceptance and privacy concerns with facial recognition.
method Cross-national survey of 4 countries.
result Public views vary significantly across countries.
Paper tackles multi-task learning for emotion recognition and generation using Aff-Wild dataset.
problem Developing a multi-task learning approach for emotion recognition and generation using Aff-Wild dataset.
method Deep neural network with shared hidden layers and GAN for multi-task learning and image generation.
result Good performance of the proposed approach on Aff-Wild dataset.
This review explores automated pain detection from facial expressions using FACS.
problem Automated detection of pain from facial expressions is challenging and underexplored.
method Examines progress in AFER and APD, focusing on FACS-based methods and deep learning.
result Limited studies on APD, highlighting the need for clinical applications.
Bayesian Neural Networks improve uncertainty modeling in facial emotion recognition.
problem High aleatoric uncertainty and visual ambiguity in facial emotion recognition.
method Bayesian Neural Networks approximated using MC-Dropout, MC-DropConnect, or Ensemble methods.
result Bayesian Neural Networks produce more human-like output probabilities.
AutoTune learns wireless identifiers for facial recognition in real-world settings.
problem Facial recognition requires extensive user training, making it impractical for widespread deployment.
method Uses ambient wireless identifiers to train deep neural networks for facial recognition without user effort.
result Demonstrates a system that continuously refines facial recognition using wireless identifiers over time.
Synthesizes faces from facial features, invariant to pose and expression.
problem Creating realistic face images from facial features.
method Learning facial landmarks and textures from facial-recognition features, training on frontal, neutral-expression images.
result Generated images are invariant to lighting, pose, and expression.
New NMF algorithm uses Toeplitz matrix for facial recognition.
problem Facial recognition performance improvement.
method Proposes TNMF algorithm with Toeplitz penalty for NMF.
result TNMF outperforms ZNMF and other constrained NMF algorithms.
Enhances facial emotion recognition with gradient and Laplacian images.
problem Improving the performance of facial emotion recognition systems.
method Proposes using gradient and Laplacian of input images with a CNN.
result Enhances FER systems by 3 to 5%.
Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
FEAFA dataset annotates facial expressions with high detail.
problem Lack of detailed facial expression annotations in existing datasets.
method Manual annotation of 122 participants' facial expressions.
result FEAFA dataset provides detailed annotations for facial expressions.
This paper explores how facial recognition systems can be fooled by adversarial attacks.
problem Adversarial attacks on facial recognition systems.
method Applying Fast Gradient Sign Method and crafting various black-box attack algorithms.
result High levels of perturbation can significantly decrease classifier confidence and misclassification rates.
Paper studies facial keypoint detection using various algorithms.
problem Challenges in accurately detecting facial keypoints from complex images.
method Preprocess data with PCA and LBP, apply multiple algorithms including linear regression, tree models, neural networks, and CNNs.
result Demonstrates the effectiveness of the proposed framework through comprehensive experiments.
New method improves fairness of facial recognition systems.
problem Facial recognition systems exhibit bias across different demographic groups.
method Optimizes centroid-based scores to reduce bias in pre-trained models.
result Demonstrates significant improvement in fairness with minimal loss in accuracy.
Develops a fast non-invasive tool for diagnosing pediatric sleep apnea.
problem Diagnosing pediatric obstructive sleep apnea using an overnight sleep study is often impractical.
method Combines persistent homology, geometric shape analysis, and convolutional neural networks to classify facial images.
result Facial features associated with obstructive sleep apnea can be recognized for diagnosis.
ZNMF improves facial recognition performance using data-dependent penalties.
problem Facial recognition performance in the Cambridge ORL database.
method ZNMF uses data-dependent auxiliary constraints to modify NMF.
result ZNMF outperforms other constrained NMF algorithms in facial recognition.
Efficient facial feature learning with shared representations reduces redundancy and improves accuracy.
problem Redundancy and high computational load in training deep ensemble models.
method Wide Ensemble-based Convolutional Neural Networks (ESRs) with varying branching levels.
result ESRs reduce residual generalization error and outperform state-of-the-art methods on facial expression recognition.
This research improves facial emotion recognition using autoencoders and CNNs.
problem Facial emotion recognition as a challenging problem in computer vision.
method Two methods: autoencoders for representation and 8-layer CNN.
result CNN model outperforms state-of-the-art methods for emotion recognition.
This paper improves facial expression recognition using CNNs and coherence constraints.
problem Facial expression recognition from static images and video sequences is challenging.
method Investigates the use of Convolutional Neural Networks (CNNs) with coherence constraints in a semi-supervised setting.
result Coherence constraints improve facial expression recognition quality, especially in the presence of occlusions.
AI misidentifies facial expressions in videos, often misinterpreting happiness as sadness.
problem Automated facial emotion recognition in videos, especially with mixed modalities (visual and audio).
method Applied state-of-the-art visual and temporal networks, explored feature fusion methods.
result Machine learning models misclassify emotions, particularly happiness as sadness.
New graph convolution captures local features on non-Euclidean grids.
problem Capturing local features on irregular, coarse non-Euclidean grids.
method Low-rank learnable local filters in graph convolutions.
result Proves more expressive than previous spectral graph convolution methods.
New CNN architecture detects face spoofing with deep local features.
problem Face recognition systems are vulnerable to face spoofing attacks.
method Two-step CNN architecture: first learns features from facial regions, then fine-tunes on whole images.
result Improves face spoofing detection performance and convergence speed.
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
We propose a novel GP auto-encoder for ordinal facial action unit prediction.
problem Simultaneous feature fusion and modeling of discrete ordinal outputs.
method Variational Gaussian Process Auto-Encoder (GPAE) with latent space projection and ordinal label constraints.
result Our model achieves robust feature fusion and joint ordinal prediction of facial action units.
Predicts classifier accuracy scaling with more classes.
problem Estimating classifier performance with increasing number of classes.
method Uses statistical moments and data from a subset of classes.
result Expected accuracy can be estimated from a subset of classes.
Simpler CNN model with spatial attention and temporal pooling outperforms complex models.
problem Emotion recognition from videos with small face deformations and identity variations.
method Spatial attention mechanism and temporal softmax pooling applied to a pre-trained CNN.
result The approach achieves higher accuracy than state-of-the-art methods on the EmotiW dataset.
Researchers found PP-GANs can hide sensitive data in sanitized images, undermining privacy checks.
problem Lack of formal proofs of privacy in PP-GANs for image sanitization.
method Subverted PP-GANs for facial expression recognition to hide sensitive data in sanitized images.
result It is possible to hide sensitive identification data in sanitized PP-GAN output images, even allowing reconstruction of entire input images.
Classifies Tinder dating profiles using facial embeddings.
problem Automatically review and classify online dating profiles.
method Uses FaceNet facial embeddings to extract features and train logistic regression models.
result Simple logistic regression on 20 profiles achieved 65% validation accuracy.
Aff-Wild database expands facial expression recognition to real-world conditions.
problem Lack of spontaneous facial expression databases in real-world conditions.
method Collects spontaneous facial expressions from YouTube, annotates with valence and arousal, uses deep learning techniques.
result Developed an end-to-end DNN model achieving 0.555 CCC for valence and 0.499 CCC for arousal.
FrugalML optimizes API selection for cost and accuracy.
problem Challenges in choosing the best ML prediction APIs.
method Proposes FrugalML, a framework that learns API strengths and weaknesses.
result Achieves up to 90% cost reduction with matching accuracy.
Improved deep neural network training for emotion recognition across datasets.
problem Training deep neural networks with diverse datasets to avoid forgetting learned knowledge.
method Extended loss function incorporating information from similar networks trained on other datasets.
result Improved performance in emotion recognition across different datasets.
Probabilistic 2DCCA improves face recognition with superior loading factor estimation.
problem Lack of probabilistic interpretation in 2DCCA.
method Probabilistic 2DCCA with an EM-based iterative algorithm.
result Superior performance in loading factor estimation and robustness in face recognition tasks.
One of the goals of the ICML workshop on representation and learning is to establish benchmark scores for a new data set of labeled facial expressions. This paper presents the performance of a "Null" model consisting of convolutions with random weights, PCA, pooling, normalization, and a linear readout. Our approach fo…
Generative adversarial network synthesizes sketches into realistic images.
problem Improving the quality and realism of facial sketches.
method Hybrid GAN with quality guided encoder and identity preserving network.
result Synthesized images are more realistic and maintain identity.
The ICML 2013 Workshop on Challenges in Representation Learning focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge. We describe the datasets created for these challenges and summarize the results of the competitions. We provi…
FineHand learns hand shapes for better ASL recognition.
problem Difficult ASL recognition due to fast, articulate gestures.
method Combines manual and deep learning for hand shape embeddings, uses RNN for sequential gestures.
result Improved video gesture recognition accuracy on GMU-ASL51 benchmark.
The paper proposes a test to assess rater accuracy while accounting for rater covariates.
problem Assessing the accuracy of raters in medical imaging and forensic studies.
method Covariate-adjusted homogeneity test to determine differences in accuracy among multiple rater groups.
result The proposed test identifies statistically significant differences among five participant groups in a face recognition study.
The paper addresses bias in visual recognition models by reweighting observations.
problem Bias in deep neural networks trained on biased image databases.
method Reweighting observations based on known biasing mechanisms to form a nearly debiased estimator.
result The approach can remedy representativeness issues in visual recognition systems.
Paper proposes a framework to protect user anonymity in emotion recognition.
problem Preserving user anonymity in face-based emotion recognition systems.
method Adversarial learning framework using CNN architecture.
result The proposed approach minimizes identity-specific information and maximizes emotion-dependent information.
Paper proposes Roweisposes for 3D action recognition using generalized eigenvalue problem.
problem Need for basic methods in 3D action recognition.
method Roweisposes uses Roweis discriminant analysis for generalized subspace learning.
result Roweisposes is effective for 3D action recognition.
Improved animated faces using audiovisual and modality dropout.
problem Creating realistic animated faces using speech and visual cues.
method Training a deep learning model with modality dropout to balance audio and visual inputs.
result Modality dropout improves viewer preference for audiovisual-driven animation.
The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature recognition and analysis techniques are already in use and are based on physiol…
Study uses stacked hourglass networks to improve facial landmark detection for medical diagnosis.
problem Improving accuracy of facial landmark detection for medical diagnosis.
method Conducted a study on landmark localisation methods using stacked hourglass networks.
result State-of-the-art stacked hourglass architecture outperforms traditional methods.
New method generates unrestricted adversarial face images to bypass robust face recognition systems.
problem Vulnerability of face recognition systems to unrestricted adversarial examples.
method Image translation techniques to generate large perturbations in face images.
result Achieved high attack success rates (90% and 80%) under white- and black-box settings.