A simple deep model improves audiovisual emotion recognition with few data.
problem Improving audiovisual emotion recognition with limited training data.
method Simplified deep learning model with transfer learning, low-dimensional embedding, and frame selection.
result Achieved state-of-the-art accuracy of 60.64% on AFEW test set.
AVEC 2019 challenges AI in detecting depression and cross-cultural emotions.
problem Detecting depression and cross-cultural emotions from audiovisual data.
method Comparison of machine learning methods under standardized conditions.
result Baseline system performance on state-of-mind, depression, and cross-cultural tasks.
Method converts facial expressions and voice of a source speaker into a target speaker.
problem Separate conversion of facial and acoustic features leads to unnatural results.
method Uses three neural networks: conversion, waveform generation, and image reconstruction.
result Significantly higher naturalness achieved when converting both features together.
Improved audio event recognition using audiovisual transformers.
problem Weakly labeled audio event classification with limited temporal information.
method Adapted transformer architecture that combines audio and video inputs.
result State-of-the-art performance on audiovisual data set.
Paper presents an audiovisual model to recognize sounds from weakly labeled video data.
problem Sound recognition from weakly labeled video data.
method Audiovisual fusion model with attention mechanism.
result The model achieves a mean Average Precision (mAP) of 46.16 on AudioSet, outperforming state-of-the-art models.
Deep learning improves human affect recognition in natural settings.
problem Automatic recognition of human emotions in real-world scenarios.
method Review and analysis of 233 studies using deep neural networks.
result Deep learning significantly enhances affect recognition from multimodal sensor data.
Study shows emotion affects speaker recognition and vice versa.
problem Dependencies between emotion and speaker recognition.
method Transfer learning and fine-tuning for emotion classification.
result Fine-tuning improves emotion recognition performance by 30.40% on IEMOCAP, 7.99% on MSP-Podcast, and 8.61% on Crema-D.
Bayesian approach improves activity recognition accuracy and uncertainty quantification.
problem Lack of predictive uncertainty in multimodal audiovisual activity recognition.
method Uncertainty aware multimodal Bayesian fusion framework combining deterministic and variational layers.
result Improved precision-recall AUC by 10.2% on MiT dataset.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
Project extends emotion recognition database and trains neural networks for categorical and dimensional emotions.
problem Understanding and recognizing emotions for human-computer interaction, safety, and medical research.
method Training CNN + RNN models with emotion category and valence/arousal representations, comparing three model types.
result Categorical emotion recognition performance improves with combined model training.
Paper proposes a framework to protect user anonymity in emotion recognition.
problem Preserving user anonymity in face-based emotion recognition systems.
method Adversarial learning framework using CNN architecture.
result The proposed approach minimizes identity-specific information and maximizes emotion-dependent information.
Study shows stress affects emotion recognition models, improving generalizability.
problem Stress affects emotion recognition models, reducing their generalizability.
method Used adversarial networks to control for stress effects on emotion recognition.
result Emotion recognition models that control for stress during training have better generalizability.
Gait patterns reveal emotions, offering a non-invasive method for automated recognition.
problem Automated emotion recognition from gait patterns.
method Data collection, preprocessing, and classification techniques.
result Gait patterns can indicate different emotion states, making them a promising source for emotion detection.
Improved speech emotion recognition using pre-trained language models.
problem Challenging task of speech emotion recognition for natural human-machine interaction.
method Fine-tuning pre-trained language models for text emotion recognition, combining with speech emotion recognition.
result 73.5% accuracy in speech emotion recognition on a subset of IEMOCAP dataset.
Deep architecture learns transferable features for robust speech emotion recognition.
problem Robust and discriminative features for diverse speech emotion domains.
method Jointly uses CNN for domain-shared features and LSTM for domain-specific emotion classification.
result Transferable features provide gains up to 18.4% in speech emotion recognition.
Improved deep neural network training for emotion recognition across datasets.
problem Training deep neural networks with diverse datasets to avoid forgetting learned knowledge.
method Extended loss function incorporating information from similar networks trained on other datasets.
result Improved performance in emotion recognition across different datasets.
Improved animated faces using audiovisual and modality dropout.
problem Creating realistic animated faces using speech and visual cues.
method Training a deep learning model with modality dropout to balance audio and visual inputs.
result Modality dropout improves viewer preference for audiovisual-driven animation.
Paper explores deep learning features for complex emotion recognition.
problem Improving emotion recognition accuracy in complex emotions.
method Used pretrained networks (AudioSet Net, VoxCeleb Net, Deep Speech Net) and their deep layer features for emotion recognition.
result Achieved highest F1 score of 0.85 on EmoReact dataset.
This work tackles domain shift in speech emotion recognition by proposing class-wise adversarial domain adaptation.
problem Domain shift between corpora poses a challenge for speech emotion recognition, especially for positive/negative emotions.
method Class-wise adversarial domain adaptation to reduce shift between different corpora.
result Our method is effective even with limited target labeled examples, as demonstrated on EMODB and Aibo corpora.
Speech emotion recognition system using features and text.
problem Improving accuracy in emotion recognition from speech.
method Used speech features (Spectrogram, MFCC) and text, trained Deep Neural Networks.
result Combined MFCC-Text CNN model achieved highest accuracy.
Enhances speech emotion recognition using transfer learning.
problem Improving accuracy in speech emotion recognition.
method Transformer-based Predictive Coding with transfer learning.
result Significantly improved emotion recognition accuracy.
Deep learning directly extracts features for emotion recognition, outperforming traditional methods.
problem Emotion recognition using traditional feature encoding methods.
method Used deep learning networks to directly encode features for emotion recognition.
result Highest performance in emotion recognition on EmoDB dataset.
This paper presents our approach to the One-Minute Gradual-Emotion Recognition (OMG-Emotion) Challenge, focusing on dimensional emotion recognition through visual analysis of the provided emotion videos. The approach is based on a Convolutional and Recurrent (CNN-RNN) deep neural architecture we have developed for the …
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
Self-supervised ECG learning improves emotion recognition.
problem Improving emotion recognition from ECG signals.
method Multi-task deep learning framework with signal transformations as pretext tasks.
result Significant performance improvement in emotion classification.
Model improves emotion recognition using multiple physiological signals.
problem Single physiological signal is insufficient for accurate emotion recognition.
method Fused multiple modal physiological signals (EEG, EMG, EOG) for emotion classification.
result Best classification accuracy of 94.42% on arousal and 94.02% on valence in two-class tasks.
In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective emotion recognition model challenging. In this paper, we first build a multi-vie…
ResNet with Focal Loss improves speech emotion recognition.
problem Speech emotion recognition using plain text features is insufficient.
method Residual Convolutional Neural Network (ResNet) trained with Focal Loss.
result Focal Loss enhances model's focus on hard examples.
Speech emotion recognition improved with simpler machine learning models.
problem Identifying emotions from speech is ambiguous and challenging.
method Feature-engineering approach using hand-crafted audio features and text features. Comparison of traditional machine learning and deep learning models.
result Lighter machine learning models outperform deep learning models for emotion recognition.
Enhances speech emotion recognition by adapting to varying time scales.
problem Robust emotion recognition from speech audio with temporal variations.
method Introduces multi-time-scale (MTS) convolutional layers to CNNs.
result MTS layers improve generalization, especially on smaller datasets.
Paper proposes a CNN for speech emotion recognition using center loss and reconstruction.
problem Speech emotion recognition (SER) in audio signals.
method Convolutional Neural Network (CNN) with center loss and reconstruction as regularizers.
result Proposed method achieves highly discriminative features for SER.
End-to-end deep learning detects emotions in real-life emergency calls.
problem Recognizing emotions in real-life emergency call center recordings.
method Used an end-to-end deep learning architecture trained on IEMOCAP and CEMO datasets.
result Obtained 45.6% Unweighted Accuracy Recall on CEMO with 4 classes, 76.9% on 2 classes (Anger, Neutral).
This study applies variational inference to improve music emotion recognition.
problem Improving understanding and recognition of music emotions.
method Employed variational inference and Bayesian statistics techniques.
result Developed a flexible multivariate model for emotion recognition.
Deep Fusion improves audio-video emotion recognition accuracy.
problem Challenges in automatic emotion recognition due to abstract concept and multiple expressions of emotion.
method Introduces factorized bilinear pooling (FBP) with embedded attention mechanism to integrate audio and video features.
result Achieves an accuracy of 62.48% on AFEW database, outperforming state-of-the-art results.
Improved multi-modal emotion recognition using deep learning.
problem Combining acoustic and text modalities for emotion recognition.
method Proposes a deep learning-based approach to fuse text and acoustic data using SincNet for acoustic features and parallel DCNN and Bi-RNN branches for text processing with cross attention.
result Achieves 3.5% improvement in weighted accuracy compared to existing methods.
Study evaluates feature selection methods for emotion recognition in resource-constrained settings.
problem Reducing memory and computational requirements for emotion recognition in low-resource settings.
method Evaluation of three feature selection methods: ILFS, ReliefF, Fisher, and AFS.
result Smaller feature sets can achieve similar or better accuracy, reducing resource usage.
Bayesian Neural Networks improve uncertainty modeling in facial emotion recognition.
problem High aleatoric uncertainty and visual ambiguity in facial emotion recognition.
method Bayesian Neural Networks approximated using MC-Dropout, MC-DropConnect, or Ensemble methods.
result Bayesian Neural Networks produce more human-like output probabilities.
Dynamic weights improve multimodal emotion and gender recognition.
problem Improving performance in multiple classification tasks with a single model.
method Dynamic joint loss weights for multimodal emotion and gender recognition.
result Lower joint loss and better generalizability than static weights.
Paper presents a CNN-RNN method for multi-dimensional emotion recognition in-the-wild.
problem Dimensional emotion recognition in real-world scenarios.
method Pre-training with Aff-Wild and Aff-Wild2, extracting low-, mid-, and high-level features, using RNN subnets in a multi-task framework, and fusion of networks.
result Our approach outperformed state-of-the-art methods using only visual information.
A neural network tackles emotion recognition, attribution, and summarization.
problem Sparsity of emotional expressions in videos.
method Bi-stream Emotion Attribution-Classification Network (BEAC-Net) with two networks: attribution and classification.
result Superior performance on emotion attribution, recognition, and summarization tasks.
A fusion approach combines audio and video features for emotion recognition.
problem Continuous emotion recognition using both visual and auditory modalities.
method Pre-trained CNN features from video frames and minimalistic auditory descriptors. Fusion at feature or prediction level. SVR for prediction.
result Improves CCCs of 0.749 and 0.565 for arousal and valence respectively.
Enhances facial emotion recognition with gradient and Laplacian images.
problem Improving the performance of facial emotion recognition systems.
method Proposes using gradient and Laplacian of input images with a CNN.
result Enhances FER systems by 3 to 5%.
Emotion recognition system using EEG signals achieves high accuracy.
problem Developing an accurate emotion recognition system using EEG signals.
method EEG signals were decomposed into frequency bands using DWT, features were extracted, PCA was applied, and SVM, KNN, and ANN were used for classification.
result Cross-validated SVM with RBF kernel achieved 91.3% accuracy for arousal and 91.1% for valence in the beta frequency band.
Models predict emotional valence from narratives, matching human raters.
problem Predicting emotional valence from multimodal time-series data.
method Adapted attention-based mechanisms (Transformer, Memory Fusion Network) to emotional narratives.
result Models perform well, matching human raters on emotional valence prediction.
Recently, generative adversarial networks and adversarial autoencoders have gained a lot of attention in machine learning community due to their exceptional performance in tasks such as digit classification and face recognition. They map the autoencoder's bottleneck layer output (termed as code vectors) to different no…
Project creates new dataset for 'in the wild' emotions recognition.
problem Recognition of emotions in real-life unpredictable situations.
method Design and implement a new dataset and deep learning model.
result Demonstrates effectiveness of the new deep learning model for real-life emotions recognition.
Deep-AER system uses lightweight CNN models for EEG-based emotion recognition.
problem Challenging task of emotion recognition using EEG signals.
method Two-level ensemble of lightweight 1D-CNN models trained on a small dataset.
result Deep-AER achieved high accuracies (98.43% and 97.65%) for emotion detection.
Unimodal approach for group-level emotion recognition without individual features.
problem Privacy issues in individual-based emotion recognition models.
method Frugal approach using global features, state-of-the-art and synthetic corpora.
result 59.13% accuracy on VGAF test set, 11th place in EmotiW Challenge 2020.