Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,922 papers · 148 categories

Trend · papers per month

1.6%3.2%4.8%6.5% · Feb 199719922001200920172026
48 results for facial affect

Efficient facial feature learning with shared representations reduces redundancy and improves accuracy.

problem Redundancy and high computational load in training deep ensemble models.
method Wide Ensemble-based Convolutional Neural Networks (ESRs) with varying branching levels.
result ESRs reduce residual generalization error and outperform state-of-the-art methods on facial expression recognition.

This work introduces a framework to detect unintended bias in facial analysis models.

problem Detecting unintended biases in facial analysis models used in critical applications.
method Image counterfactual sensitivity analysis using generative adversarial networks.
result Identifies factors affecting facial classifier predictions, revealing unintended biases.

Facial pain expression is an important modality for assessing pain, especially when the patient's verbal ability to communicate is impaired. The facial muscle-based action units (AUs), which are defined by the Facial Action Coding System (FACS), have been widely studied and are highly reliable as a method for detecting…

2018-11-13abs ↗pdf ↗

Unified tensor factorization for efficient 3D convolutions in spatio-temporal emotion analysis.

problem Training deep 3D convolutions is computationally expensive and requires large datasets.
method Tensor factorization framework for separable higher-order convolutions.
result Improved spatio-temporal emotion estimation on large datasets.

GANs can bias synthetic data, affecting minority and female faces.

problem GANs can amplify biases in synthetic data augmentation.
method Examine GANs on face-shots with gender and skin tone biases.
result GANs generate biased synthetic data, skewing minority modes and features.

Study uses stacked hourglass networks to improve facial landmark detection for medical diagnosis.

problem Improving accuracy of facial landmark detection for medical diagnosis.
method Conducted a study on landmark localisation methods using stacked hourglass networks.
result State-of-the-art stacked hourglass architecture outperforms traditional methods.

The group affect or emotion in an image of people can be inferred by extracting features about both the people in the picture and the overall makeup of the scene. The state-of-the-art on this problem investigates a combination of facial features, scene extraction and even audio tonality. This paper combines three addit…

2018-03-13abs ↗pdf ↗

Aff-Wild database expands facial expression recognition to real-world conditions.

problem Lack of spontaneous facial expression databases in real-world conditions.
method Collects spontaneous facial expressions from YouTube, annotates with valence and arousal, uses deep learning techniques.
result Developed an end-to-end DNN model achieving 0.555 CCC for valence and 0.499 CCC for arousal.

Unsupervised model predicts facial attractiveness with high accuracy.

problem Capturing the complexity of facial attractiveness through machine learning.
method Infer probabilistic models of facial preferences using Maximum Entropy and neural networks.
result High prediction accuracy in gender classification of sculpting subjects.

This work generates synthetic 3D thermal facial data using 2D facial data and deep learning.

problem Creating large datasets for deep learning in computer vision.
method 3D facial modelling techniques and deep learning methodologies.
result Synthetic 3D thermal facial data created for deep learning applications.

Fawkes protects images from unauthorized facial recognition models.

problem Unauthorized training of facial recognition models poses privacy risks.
method Fawkes adds imperceptible pixel-level changes (cloaks) to images before release.
result Fawkes can protect images from misidentification by 95% and 80% even when clean images are leaked.

We present a method for synthesizing a frontal, neutral-expression image of a person's face given an input face photograph. This is achieved by learning to generate facial landmarks and textures from features extracted from a facial-recognition network. Unlike previous approaches, our encoding feature vector is largely…

2017-01-17abs ↗pdf ↗

Polynomial fusion layer improves speech-driven facial animation.

problem Recent facial synthesis relies on low-dimensional representations and concatenation, ignoring higher-order interactions.
method Proposes a polynomial fusion layer to model higher-order interactions of facial encodings.
result Demonstrates improved video quality, audiovisual synchronisation, and blink generation.

Paper evaluates CNN-based facial landmark detection methods.

problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.

Paper introduces a method for generating interlocutor-aware facial gestures in dyadic settings.

problem Generating appropriate non-verbal behavior for conversational agents in dyadic settings.
method Probabilistic method using multi-modal cues from the interlocutor to synthesize facial gestures.
result The model successfully leverages multi-modal input from the interlocutor to generate more appropriate behavior.

Bayesian Neural Networks improve uncertainty modeling in facial emotion recognition.

problem High aleatoric uncertainty and visual ambiguity in facial emotion recognition.
method Bayesian Neural Networks approximated using MC-Dropout, MC-DropConnect, or Ensemble methods.
result Bayesian Neural Networks produce more human-like output probabilities.

We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial keypoints of an input image in an unsupervised manne…

2018-03-25abs ↗pdf ↗

Paper proposes a method to combine multiple facial analysis models for better performance.

problem Facial analysis models from different sources have low transferability.
method Two-step process: 1) Auto-encoder for common embedding, 2) Distillation for lightweight model.
result Lightweight model outperforms state-of-the-art on 15 facial analysis tasks.

AutoTune learns wireless identifiers for facial recognition in real-world settings.

problem Facial recognition requires extensive user training, making it impractical for widespread deployment.
method Uses ambient wireless identifiers to train deep neural networks for facial recognition without user effort.
result Demonstrates a system that continuously refines facial recognition using wireless identifiers over time.

This paper explores how facial recognition systems can be fooled by adversarial attacks.

problem Adversarial attacks on facial recognition systems.
method Applying Fast Gradient Sign Method and crafting various black-box attack algorithms.
result High levels of perturbation can significantly decrease classifier confidence and misclassification rates.

Develops a fast non-invasive tool for diagnosing pediatric sleep apnea.

problem Diagnosing pediatric obstructive sleep apnea using an overnight sleep study is often impractical.
method Combines persistent homology, geometric shape analysis, and convolutional neural networks to classify facial images.
result Facial features associated with obstructive sleep apnea can be recognized for diagnosis.

Content based image retrieval, a technique which uses visual contents of image to search images from large scale image databases according to users' interests. This paper provides a comprehensive survey on recent technology used in the area of content based face image retrieval. Nowadays digital devices and photo shari…

2014-02-20abs ↗pdf ↗

Facial attribute editing aims to manipulate single or multiple attributes of a face image, i.e., to generate a new face with desired attributes while preserving other details. Recently, generative adversarial net (GAN) and encoder-decoder architecture are usually incorporated to handle this task with promising results.…

2017-11-29abs ↗pdf ↗

Limited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features. However, a linear model with just several parameters normally is not demanding in terms of training data. In this paper, we propose an el…

2017-01-11abs ↗pdf ↗

AI misidentifies facial expressions in videos, often misinterpreting happiness as sadness.

problem Automated facial emotion recognition in videos, especially with mixed modalities (visual and audio).
method Applied state-of-the-art visual and temporal networks, explored feature fusion methods.
result Machine learning models misclassify emotions, particularly happiness as sadness.

Enhances 2D face recognition with 3D features using active illumination.

problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.

New method compresses facial videos using GANs and latent space optimization.

problem Efficiently compressing facial videos at low bit rates.
method Leverages StyleGAN for latent space representation and compression, learns optimal compression through entropy model and perceptual loss.
result Significantly reduces perceptual distortion at low bit rates compared to state-of-the-art codecs.

A model separates visual style from digit type on MNIST and facial features from shape on CelebA.

problem Learning compact, independent factors of data.
method Explicitly encoded in a generative model with two latent spaces: spatial transformations and intrinsic appearance.
result The model separates visual style from digit type on MNIST and facial features from shape on CelebA.

Estimation of facial expressions, as spatio-temporal processes, can take advantage of kernel methods if one considers facial landmark positions and their motion in 3D space. We applied support vector classification with kernels derived from dynamic time-warping similarity measures. We achieved over 99% accuracy - measu…

2013-06-08abs ↗pdf ↗