Improved speech emotion recognition using pre-trained language models.
problem Challenging task of speech emotion recognition for natural human-machine interaction.
method Fine-tuning pre-trained language models for text emotion recognition, combining with speech emotion recognition.
result 73.5% accuracy in speech emotion recognition on a subset of IEMOCAP dataset.
Deep architecture learns transferable features for robust speech emotion recognition.
problem Robust and discriminative features for diverse speech emotion domains.
method Jointly uses CNN for domain-shared features and LSTM for domain-specific emotion classification.
result Transferable features provide gains up to 18.4% in speech emotion recognition.
Speech emotion recognition system using features and text.
problem Improving accuracy in emotion recognition from speech.
method Used speech features (Spectrogram, MFCC) and text, trained Deep Neural Networks.
result Combined MFCC-Text CNN model achieved highest accuracy.
Enhances speech emotion recognition using transfer learning.
problem Improving accuracy in speech emotion recognition.
method Transformer-based Predictive Coding with transfer learning.
result Significantly improved emotion recognition accuracy.
Paper proposes a CNN for speech emotion recognition using center loss and reconstruction.
problem Speech emotion recognition (SER) in audio signals.
method Convolutional Neural Network (CNN) with center loss and reconstruction as regularizers.
result Proposed method achieves highly discriminative features for SER.
ResNet with Focal Loss improves speech emotion recognition.
problem Speech emotion recognition using plain text features is insufficient.
method Residual Convolutional Neural Network (ResNet) trained with Focal Loss.
result Focal Loss enhances model's focus on hard examples.
This work tackles domain shift in speech emotion recognition by proposing class-wise adversarial domain adaptation.
problem Domain shift between corpora poses a challenge for speech emotion recognition, especially for positive/negative emotions.
method Class-wise adversarial domain adaptation to reduce shift between different corpora.
result Our method is effective even with limited target labeled examples, as demonstrated on EMODB and Aibo corpora.
VAE learns latent speech emotion features for classification.
problem Learning effective features for speech emotion recognition.
method Variational Autoencoders (VAEs) for generating latent speech emotion representations.
result VAEs produce state-of-the-art results for speech emotion classification.
Paper explores deep learning features for complex emotion recognition.
problem Improving emotion recognition accuracy in complex emotions.
method Used pretrained networks (AudioSet Net, VoxCeleb Net, Deep Speech Net) and their deep layer features for emotion recognition.
result Achieved highest F1 score of 0.85 on EmoReact dataset.
Enhances speech emotion recognition by adapting to varying time scales.
problem Robust emotion recognition from speech audio with temporal variations.
method Introduces multi-time-scale (MTS) convolutional layers to CNNs.
result MTS layers improve generalization, especially on smaller datasets.
Speech emotion recognition improved with simpler machine learning models.
problem Identifying emotions from speech is ambiguous and challenging.
method Feature-engineering approach using hand-crafted audio features and text features. Comparison of traditional machine learning and deep learning models.
result Lighter machine learning models outperform deep learning models for emotion recognition.
Novel bio-inspired masking for robust speech emotion recognition.
problem Noise degradation in speech emotion recognition.
method Cochlear cepstrogram-based contrastive learning with temporal and frequency masking.
result Improved speech emotion recognition performance on K-EmoCon benchmark.
This research improves emotion detection from speech, enhancing CCC by 30%.
problem Improving emotion detection from speech for categorical emotions.
method Used LSTM and TC-LSTM networks, trained with multiple datasets and robust features.
result Improved CCC for valence by 30% compared to baseline.
Adversarial autoencoders improve speech-based emotion recognition.
problem Improving speech-based emotion recognition accuracy.
method Adversarial autoencoders map feature vectors to different noise PDFs, allowing synthetic sample generation.
result Adversarial autoencoders can encode high-dimensional feature vectors into a compressed space with minimal loss of emotion class discriminability.
Enhanced speech emotion recognition using nonlinear recurrence dynamics.
problem Improving speech emotion recognition accuracy.
method Phase space reconstruction, Recurrence Plot, Recurrence Quantification Analysis, statistical functionals, feature fusion, Bidirectional Recurrent Neural Network.
result State-of-the-art performance on IEMOCAP with up to 10.7% improvement in accuracy.
End-to-end deep learning detects emotions in real-life emergency calls.
problem Recognizing emotions in real-life emergency call center recordings.
method Used an end-to-end deep learning architecture trained on IEMOCAP and CEMO datasets.
result Obtained 45.6% Unweighted Accuracy Recall on CEMO with 4 classes, 76.9% on 2 classes (Anger, Neutral).
ADDoG improves cross-dataset speech emotion recognition.
problem Cross-dataset speech emotion recognition failure.
method ADDoG uses an iterative approach to move representations closer together across datasets.
result ADDoG and MADDoG improve cross-dataset speech emotion recognition.
Enhances speech emotion recognition by integrating visual data with attention mechanisms.
problem Improving emotion detection accuracy by combining multiple modalities.
method Introducing an attention mechanism to combine audio, text, and video modalities.
result Significant improvement of 3.65% in weighted accuracy.
Study evaluates adversarial attacks on speech emotion recognition systems.
problem Adversarial examples challenge the robustness of speech emotion recognition systems.
method Proposes adversarial training and GAN as defenses.
result Demonstrates effective use of adversarial examples for robustness.
Bardo Composer generates tabletop RPG music based on player speech.
problem Creating immersive background music for tabletop RPGs.
method Speech recognition, emotion classification, and music generation using a novel beam search algorithm.
result Generated music pieces can be accurately identified by human subjects as conveying the intended emotion.
Approach to detect emotion from speech using majority voting and selected features.
problem Detecting human emotion from speech.
method Majority voting technique over machine learning models (NN, DT, SVM, KNN).
result Majority voting technique achieves better accuracy than individual models.
Improved speech emotion recognition using pitch-synchronous single frequency filtering spectrogram.
problem Uncertainty principles in STFT spectrogram limit time and frequency resolutions.
method Modified SFF spectrogram by averaging amplitudes between GCI locations, named pitch-synchronous SFF spectrogram.
result Improved SER accuracy (63.95% to 70.4%) on IEMOCAP dataset.
Study evaluates feature selection methods for emotion recognition in resource-constrained settings.
problem Reducing memory and computational requirements for emotion recognition in low-resource settings.
method Evaluation of three feature selection methods: ILFS, ReliefF, Fisher, and AFS.
result Smaller feature sets can achieve similar or better accuracy, reducing resource usage.
Survey on DNNs for speech processing, focusing on limited data challenges.
problem Challenges in training DNNs for speech tasks with limited data.
method Overview of techniques for few-shot speech processing.
result Promising few-shot techniques for speech processing.
FINs enhance performance in diverse datasets like finance, speech, and health.
problem Improving neural network performance across various domains.
method Feature Imitating Networks (FINs) initialize weights to approximate specific statistical features.
result FINs significantly improve performance in Bitcoin price prediction, speech emotion recognition, and chronic neck pain detection.
Privacy-preserving method protects user speech data from cloud services.
problem Privacy compromise in cloud-based speech analysis.
method Collects and sanitizes speech data before sharing, using transformation functions and voice conversion.
result Identification of sensitive emotional state reduced by ~96%.
Gait patterns reveal emotions, offering a non-invasive method for automated recognition.
problem Automated emotion recognition from gait patterns.
method Data collection, preprocessing, and classification techniques.
result Gait patterns can indicate different emotion states, making them a promising source for emotion detection.
Generative Adversarial Networks improve affective speech feature generation.
problem Improving feature representation for emotion recognition.
method Experimented with GAN architectures to generate feature vectors corresponding to emotions.
result GANs generate realistic synthetic samples for emotion recognition.
Improved multi-modal emotion recognition using deep learning.
problem Combining acoustic and text modalities for emotion recognition.
method Proposes a deep learning-based approach to fuse text and acoustic data using SincNet for acoustic features and parallel DCNN and Bi-RNN branches for text processing with cross attention.
result Achieves 3.5% improvement in weighted accuracy compared to existing methods.
Method converts emotions in nonparallel speech data.
problem Lack of parallel data for speech emotion conversion.
method Unsupervised style transfer technique for nonparallel training.
result Effectiveness demonstrated on nonparallel corpora with four emotions.
Study on mother-infant affect communication using audio recordings.
problem Lack of accurate emotional speech databases for real-life settings.
method Used RAVDESS database and trained a Convolutional Neural Nets model.
result Dominant emotions in mother-infant speech were angry and sad.
Improved anger detection in speech using transfer learning from SoundNet.
problem Detecting anger in speech with limited emotion datasets.
method Transfer learning from SoundNet, a multimodal audio classifier trained on video data.
result Improved performance and generalization on various speech emotion datasets.
Study shows emotion affects speaker recognition and vice versa.
problem Dependencies between emotion and speaker recognition.
method Transfer learning and fine-tuning for emotion classification.
result Fine-tuning improves emotion recognition performance by 30.40% on IEMOCAP, 7.99% on MSP-Podcast, and 8.61% on Crema-D.
Paper tackles OMG-Emotion Challenge with CNN-RNN for dimensional emotion recognition.
problem Dimensional emotion recognition in-the-wild from visual analysis.
method Developed a multi-component CNN-RNN deep neural architecture for AffWild Emotion Database.
result Best architectures for valence and arousal estimation over validation data.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
Project extends emotion recognition database and trains neural networks for categorical and dimensional emotions.
problem Understanding and recognizing emotions for human-computer interaction, safety, and medical research.
method Training CNN + RNN models with emotion category and valence/arousal representations, comparing three model types.
result Categorical emotion recognition performance improves with combined model training.
Paper proposes a framework to protect user anonymity in emotion recognition.
problem Preserving user anonymity in face-based emotion recognition systems.
method Adversarial learning framework using CNN architecture.
result The proposed approach minimizes identity-specific information and maximizes emotion-dependent information.
Study shows stress affects emotion recognition models, improving generalizability.
problem Stress affects emotion recognition models, reducing their generalizability.
method Used adversarial networks to control for stress effects on emotion recognition.
result Emotion recognition models that control for stress during training have better generalizability.
Improved deep neural network training for emotion recognition across datasets.
problem Training deep neural networks with diverse datasets to avoid forgetting learned knowledge.
method Extended loss function incorporating information from similar networks trained on other datasets.
result Improved performance in emotion recognition across different datasets.
Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states are often "overshadowed" by voice characteristics relating to emotional intensity …
AVEC 2019 challenges AI in detecting depression and cross-cultural emotions.
problem Detecting depression and cross-cultural emotions from audiovisual data.
method Comparison of machine learning methods under standardized conditions.
result Baseline system performance on state-of-mind, depression, and cross-cultural tasks.
Deep learning directly extracts features for emotion recognition, outperforming traditional methods.
problem Emotion recognition using traditional feature encoding methods.
method Used deep learning networks to directly encode features for emotion recognition.
result Highest performance in emotion recognition on EmoDB dataset.
audEERING improves emotion recognition in 1 minute.
problem Improving emotion recognition in short timeframes.
method Submissions and evaluations for the OMG emotion recognition challenge.
result Achieved high CCC scores for arousal and valence.
End-to-end network predicts and aligns continuous emotion labels.
problem Inconsistent alignment of continuous emotion labels with speech signals.
method Convolutional neural network with a multi-delay sinc layer.
result State-of-the-art results in predicting and aligning continuous emotion labels.
Paper explores unsupervised learning for speech synthesis control.
problem Learning control over speech output without labeled data.
method Study of unsupervised training heuristics and autoencoder models.
result Unsupervised methods can be interpreted as variational inference.
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
Self-supervised ECG learning improves emotion recognition.
problem Improving emotion recognition from ECG signals.
method Multi-task deep learning framework with signal transformations as pretext tasks.
result Significant performance improvement in emotion classification.
Model improves emotion recognition using multiple physiological signals.
problem Single physiological signal is insufficient for accurate emotion recognition.
method Fused multiple modal physiological signals (EEG, EMG, EOG) for emotion classification.
result Best classification accuracy of 94.42% on arousal and 94.02% on valence in two-class tasks.