A neural network tackles emotion recognition, attribution, and summarization.
problem Sparsity of emotional expressions in videos.
method Bi-stream Emotion Attribution-Classification Network (BEAC-Net) with two networks: attribution and classification.
result Superior performance on emotion attribution, recognition, and summarization tasks.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
Method converts emotions in nonparallel speech data.
problem Lack of parallel data for speech emotion conversion.
method Unsupervised style transfer technique for nonparallel training.
result Effectiveness demonstrated on nonparallel corpora with four emotions.
This article provides the first survey of computational models of emotion in reinforcement learning (RL) agents. The survey focuses on agent/robot emotions, and mostly ignores human user emotions. Emotions are recognized as functional in decision-making by influencing motivation and action selection. Therefore, computa…
Study shows stress affects emotion recognition models, improving generalizability.
problem Stress affects emotion recognition models, reducing their generalizability.
method Used adversarial networks to control for stress effects on emotion recognition.
result Emotion recognition models that control for stress during training have better generalizability.
Gait patterns reveal emotions, offering a non-invasive method for automated recognition.
problem Automated emotion recognition from gait patterns.
method Data collection, preprocessing, and classification techniques.
result Gait patterns can indicate different emotion states, making them a promising source for emotion detection.
Project extends emotion recognition database and trains neural networks for categorical and dimensional emotions.
problem Understanding and recognizing emotions for human-computer interaction, safety, and medical research.
method Training CNN + RNN models with emotion category and valence/arousal representations, comparing three model types.
result Categorical emotion recognition performance improves with combined model training.
Study shows emotion affects speaker recognition and vice versa.
problem Dependencies between emotion and speaker recognition.
method Transfer learning and fine-tuning for emotion classification.
result Fine-tuning improves emotion recognition performance by 30.40% on IEMOCAP, 7.99% on MSP-Podcast, and 8.61% on Crema-D.
Deep architecture learns transferable features for robust speech emotion recognition.
problem Robust and discriminative features for diverse speech emotion domains.
method Jointly uses CNN for domain-shared features and LSTM for domain-specific emotion classification.
result Transferable features provide gains up to 18.4% in speech emotion recognition.
EmTract extracts emotions from financial social media text.
problem Understanding investor emotions in financial markets.
method Annotated data, DistilBERT model, embedding space augmentation.
result EmTract outperforms existing emotion classifiers.
This paper presents our approach to the One-Minute Gradual-Emotion Recognition (OMG-Emotion) Challenge, focusing on dimensional emotion recognition through visual analysis of the provided emotion videos. The approach is based on a Convolutional and Recurrent (CNN-RNN) deep neural architecture we have developed for the …
This research improves emotion detection from speech, enhancing CCC by 30%.
problem Improving emotion detection from speech for categorical emotions.
method Used LSTM and TC-LSTM networks, trained with multiple datasets and robust features.
result Improved CCC for valence by 30% compared to baseline.
Emotions are intimately tied to motivation and the adaptation of behavior, and many animal species show evidence of emotions in their behavior. Therefore, emotions must be related to powerful mechanisms that aid survival, and, emotions must be evolutionary continuous phenomena. How and why did emotions evolve in nature…
End-to-end deep learning detects emotions in real-life emergency calls.
problem Recognizing emotions in real-life emergency call center recordings.
method Used an end-to-end deep learning architecture trained on IEMOCAP and CEMO datasets.
result Obtained 45.6% Unweighted Accuracy Recall on CEMO with 4 classes, 76.9% on 2 classes (Anger, Neutral).
New method transfers emotions in facial images.
problem Transforming facial images to different emotions.
method Infinite task learning and vector-valued reproducing kernel Hilbert spaces.
result Achieves low reconstruction cost and high emotion classification accuracy.
StockEmotions dataset for financial sentiment and emotion analysis.
problem Limited resources for financial sentiment analysis.
method Collects 10,000 English comments from StockTwits, categorizes emotions into 12 classes.
result DistilBERT outperforms other models in sentiment classification, and Temporal Attention LSTM model achieves best performance in multivariate time series forecasting.
Investor emotions predict earnings announcements, but excitement lowers returns.
problem The impact of investor emotions on earnings announcements and their returns.
method Social media data analysis over a decade to test the relationship between investor emotions and earnings announcements.
result Excitement about earnings announcements is associated with lower announcement returns.
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
Paper proposes a framework to protect user anonymity in emotion recognition.
problem Preserving user anonymity in face-based emotion recognition systems.
method Adversarial learning framework using CNN architecture.
result The proposed approach minimizes identity-specific information and maximizes emotion-dependent information.
Models predict emotional valence from narratives, matching human raters.
problem Predicting emotional valence from multimodal time-series data.
method Adapted attention-based mechanisms (Transformer, Memory Fusion Network) to emotional narratives.
result Models perform well, matching human raters on emotional valence prediction.
Generative model evaluates text emotion intensity, outperforming classification.
problem Limitations of discrete emotion classification in applied domains.
method Fine-tuning generative language models to output continuous emotion intensity scores.
result Generative model outperforms classification baselines and reveals generalization capabilities.
Paper improves emotion expression in AI chatbots.
problem AI chatbots generate responses that lack emotion.
method Developed neural models to express specific emotions in generated responses.
result An encoder-decoder model with multiple attention layers performs best in expressing required emotion.
Bayesian model predicts emotion from fitness tracker heartbeat data.
problem Predicting emotional valence from consumer fitness tracker heartbeat data.
method End-to-end Bayesian deep learning model using PPG data.
result Peak F1 score of 0.7 for emotional valence classification.
Speech emotion recognition system using features and text.
problem Improving accuracy in emotion recognition from speech.
method Used speech features (Spectrogram, MFCC) and text, trained Deep Neural Networks.
result Combined MFCC-Text CNN model achieved highest accuracy.
A key aspect of word of mouth marketing are emotions. Emotions in texts help propagating messages in conventional advertising. In word of mouth scenarios, emotions help to engage consumers and incite to propagate the message further. While the function of emotions in offline marketing in general and word of mouth marke…
End-to-end model detects emotions and predicts Facebook reactions.
problem Detecting emotions and predicting reactions on Facebook posts.
method Jointly learns emotions and reactions using neural model with logic formulas as constraints.
result Model improves both emotion classification and reaction prediction.
Study on mother-infant affect communication using audio recordings.
problem Lack of accurate emotional speech databases for real-life settings.
method Used RAVDESS database and trained a Convolutional Neural Nets model.
result Dominant emotions in mother-infant speech were angry and sad.
Improved speech emotion recognition using pre-trained language models.
problem Challenging task of speech emotion recognition for natural human-machine interaction.
method Fine-tuning pre-trained language models for text emotion recognition, combining with speech emotion recognition.
result 73.5% accuracy in speech emotion recognition on a subset of IEMOCAP dataset.
Paper explores deep learning features for complex emotion recognition.
problem Improving emotion recognition accuracy in complex emotions.
method Used pretrained networks (AudioSet Net, VoxCeleb Net, Deep Speech Net) and their deep layer features for emotion recognition.
result Achieved highest F1 score of 0.85 on EmoReact dataset.
BiLiNGAM model reveals brain emotion circuit development in adolescents.
problem Understanding brain emotion circuit development during adolescence.
method Bayesian incorporated linear non-Gaussian acyclic model (BiLiNGAM) for multiple DAGs estimation.
result BiLiNGAM reveals unique developmental hub structures and group-specific patterns in emotion-related intra- and inter-modular connectivity.
AVEC 2019 challenges AI in detecting depression and cross-cultural emotions.
problem Detecting depression and cross-cultural emotions from audiovisual data.
method Comparison of machine learning methods under standardized conditions.
result Baseline system performance on state-of-mind, depression, and cross-cultural tasks.
Paper proposes Experts Model for better emotion detection in tweets.
problem Estimating intensity of emotion in tweets.
method Inspired by Mixture of Experts (MoE) model, each expert learns different features.
result Our Experts Model stands at top-5 results in emotion detection.
In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective emotion recognition model challenging. In this paper, we first build a multi-vie…
Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states are often "overshadowed" by voice characteristics relating to emotional intensity …
This work tackles domain shift in speech emotion recognition by proposing class-wise adversarial domain adaptation.
problem Domain shift between corpora poses a challenge for speech emotion recognition, especially for positive/negative emotions.
method Class-wise adversarial domain adaptation to reduce shift between different corpora.
result Our method is effective even with limited target labeled examples, as demonstrated on EMODB and Aibo corpora.
The study predicts how discussions in mental disorder Reddit communities affect users' emotional states.
problem Improving mental health conditions through social support analysis.
method Text embedding techniques and RNNs for predicting emotional tone shifts.
result Users' emotional states can improve due to social support, as evidenced by positive comments following negative posts.
Study finds social media investor emotions predict stock prices.
problem Validation of social media sentiment models in predicting market behavior.
method Employed EmTract, an emotion model, to test social media sentiment against lab experiments.
result Firm-specific investor emotions forecast daily asset price movements.
Model improves emotion recognition using multiple physiological signals.
problem Single physiological signal is insufficient for accurate emotion recognition.
method Fused multiple modal physiological signals (EEG, EMG, EOG) for emotion classification.
result Best classification accuracy of 94.42% on arousal and 94.02% on valence in two-class tasks.
End-to-end network predicts and aligns continuous emotion labels.
problem Inconsistent alignment of continuous emotion labels with speech signals.
method Convolutional neural network with a multi-delay sinc layer.
result State-of-the-art results in predicting and aligning continuous emotion labels.
Paper presents a CNN-RNN method for multi-dimensional emotion recognition in-the-wild.
problem Dimensional emotion recognition in real-world scenarios.
method Pre-training with Aff-Wild and Aff-Wild2, extracting low-, mid-, and high-level features, using RNN subnets in a multi-task framework, and fusion of networks.
result Our approach outperformed state-of-the-art methods using only visual information.
Generates music with video emotion using deep neural networks.
problem Generating music with video emotion.
method Hybrid deep neural network combining ANFIS and LSTM.
result Low mean absolute errors and similar global features in spectrograms.
New model explains music emotion predictions with visualizable mid-level features.
problem Challenging to quantify and predict music emotion.
method VGG-style deep neural network with mid-level perceptual features.
result Small loss in performance justifies high explainability of predictions.
ResNet with Focal Loss improves speech emotion recognition.
problem Speech emotion recognition using plain text features is insufficient.
method Residual Convolutional Neural Network (ResNet) trained with Focal Loss.
result Focal Loss enhances model's focus on hard examples.
Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective features is crucial. Currently, handcrafted features are mostly used for speech emoti…
Deep Fusion improves audio-video emotion recognition accuracy.
problem Challenges in automatic emotion recognition due to abstract concept and multiple expressions of emotion.
method Introduces factorized bilinear pooling (FBP) with embedded attention mechanism to integrate audio and video features.
result Achieves an accuracy of 62.48% on AFEW database, outperforming state-of-the-art results.
Enhances speech emotion recognition using transfer learning.
problem Improving accuracy in speech emotion recognition.
method Transformer-based Predictive Coding with transfer learning.
result Significantly improved emotion recognition accuracy.
A fusion approach combines audio and video features for emotion recognition.
problem Continuous emotion recognition using both visual and auditory modalities.
method Pre-trained CNN features from video frames and minimalistic auditory descriptors. Fusion at feature or prediction level. SVR for prediction.
result Improves CCCs of 0.749 and 0.565 for arousal and valence respectively.
Speech emotion recognition improved with simpler machine learning models.
problem Identifying emotions from speech is ambiguous and challenging.
method Feature-engineering approach using hand-crafted audio features and text features. Comparison of traditional machine learning and deep learning models.
result Lighter machine learning models outperform deep learning models for emotion recognition.