Universal music translation network across instruments and genres.
problem Translating music across different instruments, genres, and styles.
method Multi-domain wavenet autoencoder with a shared encoder and disentangled latent space trained end-to-end on waveforms.
result Achieves convincing translations even from domains not seen during training.
New method predicts target genres from source genres, unifying music tag systems.
problem Automatic genre inference fails to handle music genre diversity and subjectivity.
method Knowledge-based, statistical, and hybrid translation models.
result Hybrid translation model is most effective for multilabel classification.
Study develops supervised algorithm for symbolic music style translation.
problem Transforming musical style while maintaining original content.
method Synthetic data generation for aligned training data, encoder-decoder model.
result Trained models produce meaningful accompaniments for real MIDI recordings.
This paper explores deep learning in music generation, from history to current techniques.
problem Creating music automatically using deep learning.
method Analysis of historical and recent deep learning music generation systems.
result Deep learning can learn musical styles and generate music samples.
Bardo Composer generates tabletop RPG music based on player speech.
problem Creating immersive background music for tabletop RPGs.
method Speech recognition, emotion classification, and music generation using a novel beam search algorithm.
result Generated music pieces can be accurately identified by human subjects as conveying the intended emotion.
This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings. The translation-invariant network discussed in this paper, which combines a traditional filterbank with a convolutional neural network, was the top-performin…
Paper proposes a bijective approach for signal/symbol translation using variational auto-encoders.
problem Extracting symbolic information from signals, especially in music, is challenging and non-generic.
method Turned into a density estimation task, using two variational auto-encoders with additive constraint.
result Bijective signal/symbol translation achieved, allowing both signal-to-symbol and symbol-to-signal inference.
Models learn to transform musical scores into expressive performances.
problem Creating large volumes of paired data for sequence transformations.
method Adapted GAN techniques to sequences, creating paired data through simple transformations.
result Models can plausibly invert transformations like quantization and removing voices.
Model generates coherent polyphonic music using deep reinforcement learning.
problem Creating music that follows musical rules and coherence.
method Deep reinforcement learning architecture with a Bi-axial LSTM trained with a pseudo-kernel and DQN for exploration and coherence.
result The model generates polyphonic music that performs well quantitatively and qualitatively.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
Model generates music to connect missing parts, leveraging latent space of VAE.
problem Music inpainting from missing or lost information.
method Deep learning model using VAE latent space and RNN to traverse latent space conditioned on past and future musical contexts.
result Model generates meaningful music inpaintings, connecting musical excerpts.
MIDI-VAE models music dynamics and instrumentation for style transfer.
problem Modeling and transferring musical style across different instruments and dynamics.
method Variational Autoencoder (VAE) for polyphonic music modeling and style transfer.
result MIDI-VAE successfully transfers musical style between different genres and instruments.
BachProp generates music in various styles using deep learning.
problem Creating music algorithms that can adapt to multiple styles.
method Developed a novel music representation and trained a deep network to predict note transitions.
result BachProp generates music scores that better capture features of original corpora.
Trains word embeddings from music and text data to link music contexts.
problem Varying vocabulary size and musical relevance in word embeddings.
method Combines general text and music-specific data to train word embeddings.
result Trained embeddings better associate music contexts with compositions.
Generative models learn from high-level music representations, but this work models music in raw audio.
problem Capturing long-range correlations in music generation.
method Exploring autoregressive discrete autoencoders (ADAs) to model raw audio waveforms.
result Unconditional generation of piano music in raw audio domain with long-range correlations.
Music SketchNet generates missing measures in incomplete music pieces, guided by user input.
problem Generating missing measures in incomplete monophonic musical pieces.
method Introducing SketchVAE for factorized representation of rhythm and pitch, and two discriminative architectures for guided music completion.
result Our approach outperforms state-of-the-art models in both objective and subjective evaluations.
Dual-track model generates classical piano music better than other methods.
problem Generating inter-dependent piano music.
method Dual-track architecture with various neural network models and music representations.
result Proposed model outperforms other methods in evaluation.
DSHL generates music using segment concatenation and hash learning.
problem Music generation using deep learning.
method Deep recurrent neural network and ranking-based hash learning.
result DSHL generates original and enjoyable music.
System composes polyphonic music using LSTM and RL.
problem Complex polyphonic music composition.
method Divided music into monophonic streams, trained LSTM to generate sequences, used RL to find pleasant compositions.
result System generates intricate melodies, chords, and contrapuntal sequences.
The study uses music chords to predict Brazilian music genres.
problem Classifying popular Brazilian music genres based on harmonic structures.
method Extracted and engineered harmonically related features from chords data, used random forest model for classification.
result Features from harmonic elements can predict Brazilian music genres.
Word2Vec captures musical relationships in complex polyphonic music.
problem Capturing meaningful relationships in musical contexts.
method Skip-gram version of word2vec applied to music slices from a large corpus.
result Word2Vec embeddings reveal functional chord and harmonic associations.
We propose a novel approach for the generation of polyphonic music based on LSTMs. We generate music in two steps. First, a chord LSTM predicts a chord progression based on a chord embedding. A second LSTM then generates polyphonic music from the predicted chord progression. The generated music sounds pleasing and harm…
Recently, digital music libraries have been developed and can be plainly accessed. Latest research showed that current organization and retrieval of music tracks based on album information are inefficient. Moreover, they demonstrated that people use emotion tags for music tracks in order to search and retrieve them. In…
Adversarial autoencoder improves music latent space learning.
problem Learning effective latent spaces for symbolic music data.
method Adversarial regularization with Gaussian mixtures.
result MusAE outperforms standard VAEs in reconstruction and interpolation.
Bi-LSTM with attention generates jazz music with rich nuances.
problem Challenges in producing realistic music with structure and rationality.
method Deep learning, Bi-directional Long Short Term Memory (Bi-LSTM) Neural Network with Attention.
result Bi-LSTMs with attention preserve the richness and technical nuances of old style music.
Paper introduces a new model for polyphonic music composition.
problem Creating music with multiple interwoven voices.
method Developed a coupled recurrent model using probabilistic factorization and neural network ideas.
result Trained models for single-voice and multi-voice composition on a large dataset.
Generative model creates realistic dance poses from music.
problem Generating human-like dance poses from music.
method Music feature encoder, pose generator, music genre classifier integrated.
result Generative autoregressive model synthesizes dance sequences up to 5,000 frames.
Generating music medleys is about finding an optimal permutation of a given set of music clips. Toward this goal, we propose a self-supervised learning task, called the music puzzle game, to train neural network models to learn the sequential patterns in music. In essence, such a game requires machines to correctly sor…
Paper applies GANs to symbolic music genre transfer.
problem Symbolic music genre transfer using GANs.
method CycleGAN architecture with additional discriminators to preserve structure.
result Fidelity of transformed music improved with additional discriminators.
This research improves neural synthesizers for music sounds from speech data.
problem Applying speech synthesis techniques to musical instrument sounds.
method Comparison of three neural synthesizers in three scenarios: training, zero-shot learning, and fine-tuning.
result Neural synthesizers trained on speech data and fine-tuned on music data perform better.
Anticipatory model generates music with control over events.
problem Controlling symbolic music generation.
method Interleaving event and control sequences to predict future events.
result Anticipatory model matches autoregressive models in performance and can infill control tasks.
New CRF model segments music into chords with rich features.
problem Harmonic analysis of music segments.
method Semi-Markov Conditional Random Field (semi-CRF) with segment-level features.
result Semi-CRF model performs better than previous approaches.
The paper models musical motif transformations in Beethoven's works.
problem Understanding how motifs transform in symbolic music.
method Developed a probabilistic framework using Conditional Random Fields.
result Identified patterns of motif transformations and their co-occurrences.
EC^2-VAE generates music analogies by disentangling pitch and rhythm representations.
problem Disentangling music representations for generating creative analogies.
method Explicitly-constrained variational autoencoder (EC^2-VAE) for disentangling pitch and rhythm representations.
result EC^2-VAE enables the generation of music analogies by borrowing representations from different pieces.
Paper compares XGB and BPNN for music style classification.
problem Efficient music style classification using different methods.
method Feature extraction for timbral texture, rhythmic content, and pitch content; comparative evaluation of XGB and BPNN.
result XGB outperforms BPNN for small datasets in music classification.
New dataset and models generate piano music with coherent structure across multiple timescales.
problem Generating coherent musical structure with neural networks is challenging.
method Used notes as an intermediate representation to model and synthesize music across multiple timescales.
result Trained models capable of transcribing, composing, and synthesizing audio waveforms with coherent musical structure.
Model creates a latent space for multitrack music measures.
problem Representing and exploring the structure of polyphonic music.
method Extended MusicVAE to a latent space, enabling various operations.
result Model can generate, interpolate, and manipulate musical measures.
The study assesses music as an investment asset class using discounted cashflow models.
problem Quantifying the risk and return characteristics of music royalty assets.
method Fitting three discounted cashflow models to Royalty Exchange platform transactions and backtesting performance.
result Life of Rights music assets had risk and return characteristics comparable to stocks in the S\&P500 over 5 years.
ragamAI uses machine learning to create concert recitals for Carnatic music.
problem Creating a comprehensive listening experience for Carnatic music concerts.
method Playlist and session-based recommender models, leveraging mathematical structure in past concerts.
result ragamAI generates concert recitals that perform 25%-50% better than baseline models.
Paper proposes LSTM for automatic music generation.
problem Generating music without human intervention.
method Recurrent Neural Networks (RNN), specifically LSTM.
result Model generates new melodies with high accuracy.
Transformer improves pop piano composition by incorporating beat-based structure.
problem Generating expressive pop piano compositions with coherent rhythmic structure.
method Improved data representation for Transformers, incorporating beat-bar-phrase structure.
result Composes pop piano music with better rhythmic structure than existing models.
FIGARO generates symbolic music with fine-grained control.
problem Minimal control over generated music sequences.
method Description-to-sequence task, learning conditional distribution of sequences given high-level descriptions.
result State-of-the-art controllable symbolic music generation.
A new neural network separates vocals from music accompaniment.
problem Separating vocals from music accompaniment in recordings.
method Self-attention convolutional neural network (CNN) with densely-connected blocks.
result 19.5% relative improvement in vocals separation.
Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is constructed (notes, chords, a complete musical score), can be naturally unified using Bayesian modell…
Graph neural networks improve music genre classification on audio datasets.
problem Difficulty in applying deep learning on spectrograms due to lack of quality data and augmentation.
method Combination of CNN and Graph Neural Networks (GNN) with Siamese Neural Networks.
result Achieved state-of-the-art results on GTZAN and AudioSet datasets.
Generating music has a few notable differences from generating images and videos. First, music is an art of time, necessitating a temporal model. Second, music is usually composed of multiple instruments/tracks with their own temporal dynamics, but collectively they unfold over time interdependently. Lastly, musical no…
Aug-Gen improves music generation by augmenting training data with model-produced examples.
problem Lack of high-quality training data for specific musical styles.
method Dataset augmentation using generated examples during training.
result Aug-Gen improves both training duration and quality of generated music.