New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
Recently, digital music libraries have been developed and can be plainly accessed. Latest research showed that current organization and retrieval of music tracks based on album information are inefficient. Moreover, they demonstrated that people use emotion tags for music tracks in order to search and retrieve them. In…
Bardo Composer generates tabletop RPG music based on player speech.
problem Creating immersive background music for tabletop RPGs.
method Speech recognition, emotion classification, and music generation using a novel beam search algorithm.
result Generated music pieces can be accurately identified by human subjects as conveying the intended emotion.
New model explains music emotion predictions with visualizable mid-level features.
problem Challenging to quantify and predict music emotion.
method VGG-style deep neural network with mid-level perceptual features.
result Small loss in performance justifies high explainability of predictions.
This study applies variational inference to improve music emotion recognition.
problem Improving understanding and recognition of music emotions.
method Employed variational inference and Bayesian statistics techniques.
result Developed a flexible multivariate model for emotion recognition.
Generates music with video emotion using deep neural networks.
problem Generating music with video emotion.
method Hybrid deep neural network combining ANFIS and LSTM.
result Low mean absolute errors and similar global features in spectrograms.
CNN improves spatiotemporal emotion recognition from EEG during music listening.
problem Improving emotion recognition from EEG signals during music listening.
method Conducted a study on CNN and its spatiotemporal feature extraction for emotion recognition.
result CNN outperforms SVM in leave-one-subject-out cross validation.
Music FaderNets learns high-level musical qualities from low-level attributes.
problem Learning high-level musical qualities from limited data and subjective labels.
method Model low-level attributes through feature disentanglement and latent regularization; infer high-level features from low-level representations using GM-VAEs.
result Model successfully learns intrinsic relationships between high-level features and low-level attributes with minimal labeled data.
Enhances speech emotion recognition by adapting to varying time scales.
problem Robust emotion recognition from speech audio with temporal variations.
method Introduces multi-time-scale (MTS) convolutional layers to CNNs.
result MTS layers improve generalization, especially on smaller datasets.
Automatically assessing emotional valence in human speech has historically been a difficult task for machine learning algorithms. The subtle changes in the voice of the speaker that are indicative of positive or negative emotional states are often "overshadowed" by voice characteristics relating to emotional intensity …
Paper improves multi-step chord prediction in jazz music.
problem Chord sequence prediction accuracy is poor in multi-step scenarios.
method Aggregated multi-scale encoder-decoder network architecture.
result Our model outperforms state-of-the-art methods in accuracy and perplexity.
We present proofs of classical results in Poisson geometry using techniques from Dirac geometry. This article is based on mini-courses at the Poisson summer school in Geneva, June 2016, and at the workshop "Quantum Groups and Gravity" at the University of Waterloo, April 2016.
Jukebox generates high-fidelity songs with singing in raw audio.
problem Generating music with singing in raw audio.
method Multi-scale VQ-VAE for compression, autoregressive Transformers for modeling.
result Generates high-fidelity and diverse songs with coherence up to multiple minutes.
Paper teaches robots to play piano with touch and learning.
problem Teaching robots to play piano with touch and emotion.
method Reinforcement learning from scratch with touch-augmented reward and curriculum.
result Robots can play piano with correct key positions and various requirements.
Adversarial autoencoder improves music latent space learning.
problem Learning effective latent spaces for symbolic music data.
method Adversarial regularization with Gaussian mixtures.
result MusAE outperforms standard VAEs in reconstruction and interpolation.
Realistic music generation is a challenging task. When building generative models of music that are learnt from data, typically high-level representations such as scores or MIDI are used that abstract away the idiosyncrasies of a particular performance. But these nuances are very important for our perception of musical…
This research improves neural synthesizers for music sounds from speech data.
problem Applying speech synthesis techniques to musical instrument sounds.
method Comparison of three neural synthesizers in three scenarios: training, zero-shot learning, and fine-tuning.
result Neural synthesizers trained on speech data and fine-tuned on music data perform better.
Study finds conformity bias drives music sampling traditions.
problem How frequency-based bias drives cultural diversity in music sampling.
method Agent-based simulations in approximate Bayesian computation framework.
result Sampling patterns at population-level consistent with conformity bias.
This paper introduces a new large-scale music dataset, MusicNet, to serve as a source of supervision and evaluation of machine learning methods for music research. MusicNet consists of hundreds of freely-licensed classical music recordings by 10 composers, written for 11 instruments, together with instrument/note annot…
Deep learning framework detects emotions from EEG data.
problem Detecting emotions from EEG signals.
method Temporal and spatial convolutional layers learn discriminative representations.
result TSception achieves 86.03% classification accuracy, significantly outperforming other methods.
Users create melodies with AI, harmonized in the style of Bach.
problem Making music composition accessible to non-experts.
method Simplified interface, machine learning model Coconet, optimized for web.
result Users spent 350 years worth of time playing with the Bach Doodle.
The paper tackles carousel personalization in music streaming apps using contextual bandits.
problem Selecting relevant items to display in carousels for personalized content recommendation.
method Modeling carousel personalization as a contextual multi-armed bandit problem with multiple plays, cascade-based updates and delayed batch feedback.
result Empirically shows the effectiveness of the framework in capturing characteristics of real-world carousels.
In this paper, we propose and develop the novel idea of treating musical sheets as literary documents in the traditional text analytics parlance, to fully benefit from the vast amount of research already existing in statistical text mining and topic modelling. We specifically introduce the idea of representing any give…
Emotional content is a crucial ingredient in user-generated videos. However, the sparsity of emotional expressions in the videos poses an obstacle to visual emotion analysis. In this paper, we propose a new neural approach, Bi-stream Emotion Attribution-Classification Network (BEAC-Net), to solve three related emotion …
This article provides the first survey of computational models of emotion in reinforcement learning (RL) agents. The survey focuses on agent/robot emotions, and mostly ignores human user emotions. Emotions are recognized as functional in decision-making by influencing motivation and action selection. Therefore, computa…
Over the past few years many research efforts have been devoted to the field of affect analysis. Various approaches have been proposed for: i) discrete emotion recognition in terms of the primary facial expressions; ii) emotion analysis in terms of facial Action Units (AUs), assuming a fixed expression intensity; iii) …
Study shows stress affects emotion recognition models, improving generalizability.
problem Stress affects emotion recognition models, reducing their generalizability.
method Used adversarial networks to control for stress effects on emotion recognition.
result Emotion recognition models that control for stress during training have better generalizability.
Gait patterns reveal emotions, offering a non-invasive method for automated recognition.
problem Automated emotion recognition from gait patterns.
method Data collection, preprocessing, and classification techniques.
result Gait patterns can indicate different emotion states, making them a promising source for emotion detection.
Project extends emotion recognition database and trains neural networks for categorical and dimensional emotions.
problem Understanding and recognizing emotions for human-computer interaction, safety, and medical research.
method Training CNN + RNN models with emotion category and valence/arousal representations, comparing three model types.
result Categorical emotion recognition performance improves with combined model training.
Study shows emotion affects speaker recognition and vice versa.
problem Dependencies between emotion and speaker recognition.
method Transfer learning and fine-tuning for emotion classification.
result Fine-tuning improves emotion recognition performance by 30.40% on IEMOCAP, 7.99% on MSP-Podcast, and 8.61% on Crema-D.
Deep architecture learns transferable features for robust speech emotion recognition.
problem Robust and discriminative features for diverse speech emotion domains.
method Jointly uses CNN for domain-shared features and LSTM for domain-specific emotion classification.
result Transferable features provide gains up to 18.4% in speech emotion recognition.
EmTract extracts emotions from financial social media text.
problem Understanding investor emotions in financial markets.
method Annotated data, DistilBERT model, embedding space augmentation.
result EmTract outperforms existing emotion classifiers.
This paper presents our approach to the One-Minute Gradual-Emotion Recognition (OMG-Emotion) Challenge, focusing on dimensional emotion recognition through visual analysis of the provided emotion videos. The approach is based on a Convolutional and Recurrent (CNN-RNN) deep neural architecture we have developed for the …
This research improves emotion detection from speech, enhancing CCC by 30%.
problem Improving emotion detection from speech for categorical emotions.
method Used LSTM and TC-LSTM networks, trained with multiple datasets and robust features.
result Improved CCC for valence by 30% compared to baseline.
Automatic understanding of human affect using visual signals is a problem that has attracted significant interest over the past 20 years. However, human emotional states are quite complex. To appraise such states displayed in real-world settings, we need expressive emotional descriptors that are capable of capturing an…
We address the problem of disambiguating large scale catalogs through the definition of an unknown artist clustering task. We explore the use of metric learning techniques to learn artist embeddings directly from audio, and using a dedicated homonym artists dataset, we compare our method with a recent approach that lea…
Emotions are intimately tied to motivation and the adaptation of behavior, and many animal species show evidence of emotions in their behavior. Therefore, emotions must be related to powerful mechanisms that aid survival, and, emotions must be evolutionary continuous phenomena. How and why did emotions evolve in nature…
End-to-end deep learning detects emotions in real-life emergency calls.
problem Recognizing emotions in real-life emergency call center recordings.
method Used an end-to-end deep learning architecture trained on IEMOCAP and CEMO datasets.
result Obtained 45.6% Unweighted Accuracy Recall on CEMO with 4 classes, 76.9% on 2 classes (Anger, Neutral).
We propose a nonparallel data-driven emotional speech conversion method. It enables the transfer of emotion-related characteristics of a speech signal while preserving the speaker's identity and linguistic content. Most existing approaches require parallel data and time alignment, which is not available in most real ap…
New method transfers emotions in facial images.
problem Transforming facial images to different emotions.
method Infinite task learning and vector-valued reproducing kernel Hilbert spaces.
result Achieves low reconstruction cost and high emotion classification accuracy.
StockEmotions dataset for financial sentiment and emotion analysis.
problem Limited resources for financial sentiment analysis.
method Collects 10,000 English comments from StockTwits, categorizes emotions into 12 classes.
result DistilBERT outperforms other models in sentiment classification, and Temporal Attention LSTM model achieves best performance in multivariate time series forecasting.
Investor emotions predict earnings announcements, but excitement lowers returns.
problem The impact of investor emotions on earnings announcements and their returns.
method Social media data analysis over a decade to test the relationship between investor emotions and earnings announcements.
result Excitement about earnings announcements is associated with lower announcement returns.
GACELA fills long gaps in musical audio with a GAN and context conditioning.
problem Restoring long gaps in musical audio with varying complexity and duration.
method Generative adversarial network (GAN) with five parallel discriminators and context conditioning.
result Reduced artifacts in inpaintings from unacceptable to mildly disturbing.
StarGAN model generates and recognizes emotions from facial expressions.
problem Emotion recognition and generation from facial expressions.
method Used StarGAN model to train on a new emotion dataset of 4K videos.
result Trained StarGAN model can generate and recognize emotions based on valence arousal scores.
Paper proposes a framework to protect user anonymity in emotion recognition.
problem Preserving user anonymity in face-based emotion recognition systems.
method Adversarial learning framework using CNN architecture.
result The proposed approach minimizes identity-specific information and maximizes emotion-dependent information.
Models predict emotional valence from narratives, matching human raters.
problem Predicting emotional valence from multimodal time-series data.
method Adapted attention-based mechanisms (Transformer, Memory Fusion Network) to emotional narratives.
result Models perform well, matching human raters on emotional valence prediction.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
Generative model evaluates text emotion intensity, outperforming classification.
problem Limitations of discrete emotion classification in applied domains.
method Fine-tuning generative language models to output continuous emotion intensity scores.
result Generative model outperforms classification baselines and reveals generalization capabilities.