Generative model creates realistic dance poses from music.
problem Generating human-like dance poses from music.
method Music feature encoder, pose generator, music genre classifier integrated.
result Generative autoregressive model synthesizes dance sequences up to 5,000 frames.
Predicting dance hits from 1985-2013 using musical features.
problem Predicting which songs will be dance hits.
method Built a database of dance hit songs with features, used multiple classifiers.
result Best model predicts top 10 dance hits with good accuracy.
Synthesizing human's movements such as dancing is a flourishing research field which has several applications in computer graphics. Recent studies have demonstrated the advantages of deep neural networks (DNNs) for achieving remarkable performance in motion and music tasks with little effort for feature pre-processing.…
Math and dance blend in choreographer's research.
problem Exploring intersections between dance and mathematics.
method Choreographic practice and mathematical concepts.
result Examples of fractals, braids in choreography.
Dance Dance Revolution (DDR) is a popular rhythm-based video game. Players perform steps on a dance platform in synchronization with music as directed by on-screen step charts. While many step charts are available in standardized packs, players may grow tired of existing charts, or wish to dance to a song for which no …
Study identifies personality traits from dance movements in music.
problem Predicting individual differences from music-induced movement.
method Identified Big Five personality traits and EQ/SQ scores from dance movements.
result Successfully explored unseen space for personality and EQ/SQ.
The waggle dance that honeybees perform is an astonishing way of communicating the location of food source. After over 60 years of its discovery, researchers still use manual labeling by watching hours of dance videos to detect different transitions between dance components thus extracting information regarding the dis…
Dancing polygons and rolling balls linked via a special geometric distribution.
problem Understanding the geometric and mechanical relationship between dancing polygons and rolling balls.
method Mapping dancing polygons to trajectories of a rolling ball on a 3D surface, both described by a specific geometric distribution.
result Non-degenerate dancing pairs of polygons exist for all n≥6 and correspond to rolling ball trajectories. DANCE improves prediction set efficiency for deep learning models.
problem Inefficient, overly conservative prediction sets for pre-trained models.
method DANCE combines adaptive kernel regression and nearest-neighbor approach.
result DANCE produces more efficient and robust prediction sets.
New AI tools generate and vary dance choreographies.
problem Creating original and customizable dance choreographies.
method Recurrent neural networks and autoencoders trained on movement data.
result Generated and varied dance sequences using machine learning.
The "dancing metric" is a pseudo-riemannian metric g of signature (2,2) on the space M4 of non-incident point-line pairs in the real projective plane RP2. The null-curves of (M4,g) are given by the "dancing condition": the point is moving towards a point on the line, about which the li…
This paper extends danceability concept to twisted virtual knots.
problem Danceability of knot diagrams on non-orientable surfaces.
method Expanding danceability concept to twisted virtual knot diagrams.
result Danceability properties of twisted virtual knots.
DANCE optimizes neural network and accelerator design for faster, more efficient DNN execution.
problem Challenges in optimizing neural network and accelerator design for efficient DNN execution.
method Differentiable approach to co-exploration of accelerator and network architecture design.
result Significantly shorter time to achieve superior accuracy and hardware cost metrics.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
Model generates music to connect missing parts, leveraging latent space of VAE.
problem Music inpainting from missing or lost information.
method Deep learning model using VAE latent space and RNN to traverse latent space conditioned on past and future musical contexts.
result Model generates meaningful music inpaintings, connecting musical excerpts.
Trains word embeddings from music and text data to link music contexts.
problem Varying vocabulary size and musical relevance in word embeddings.
method Combines general text and music-specific data to train word embeddings.
result Trained embeddings better associate music contexts with compositions.
Music SketchNet generates missing measures in incomplete music pieces, guided by user input.
problem Generating missing measures in incomplete monophonic musical pieces.
method Introducing SketchVAE for factorized representation of rhythm and pitch, and two discriminative architectures for guided music completion.
result Our approach outperforms state-of-the-art models in both objective and subjective evaluations.
Dual-track model generates classical piano music better than other methods.
problem Generating inter-dependent piano music.
method Dual-track architecture with various neural network models and music representations.
result Proposed model outperforms other methods in evaluation.
System composes polyphonic music using LSTM and RL.
problem Complex polyphonic music composition.
method Divided music into monophonic streams, trained LSTM to generate sequences, used RL to find pleasant compositions.
result System generates intricate melodies, chords, and contrapuntal sequences.
The study uses music chords to predict Brazilian music genres.
problem Classifying popular Brazilian music genres based on harmonic structures.
method Extracted and engineered harmonically related features from chords data, used random forest model for classification.
result Features from harmonic elements can predict Brazilian music genres.
A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a deep reinforcement learning architecture that predicts and generates polyphonic music aligned with musical rules. The probabilistic model presented is a Bi-axial LS…
We propose a novel approach for the generation of polyphonic music based on LSTMs. We generate music in two steps. First, a chord LSTM predicts a chord progression based on a chord embedding. A second LSTM then generates polyphonic music from the predicted chord progression. The generated music sounds pleasing and harm…
Recently, digital music libraries have been developed and can be plainly accessed. Latest research showed that current organization and retrieval of music tracks based on album information are inefficient. Moreover, they demonstrated that people use emotion tags for music tracks in order to search and retrieve them. In…
Adversarial autoencoder improves music latent space learning.
problem Learning effective latent spaces for symbolic music data.
method Adversarial regularization with Gaussian mixtures.
result MusAE outperforms standard VAEs in reconstruction and interpolation.
As deep learning advances, algorithms of music composition increase in performance. However, most of the successful models are designed for specific musical structures. Here, we present BachProp, an algorithmic composer that can generate music scores in many styles given sufficient training data. To adapt BachProp to a…
Music generation research has grown in popularity over the past decade, thanks to the deep learning revolution that has redefined the landscape of artificial intelligence. In this paper, we propose a novel approach to music generation inspired by musical segment concatenation methods and hash learning algorithms. Given…
Bi-LSTM with attention generates jazz music with rich nuances.
problem Challenges in producing realistic music with structure and rationality.
method Deep learning, Bi-directional Long Short Term Memory (Bi-LSTM) Neural Network with Attention.
result Bi-LSTMs with attention preserve the richness and technical nuances of old style music.
Generating music medleys is about finding an optimal permutation of a given set of music clips. Toward this goal, we propose a self-supervised learning task, called the music puzzle game, to train neural network models to learn the sequential patterns in music. In essence, such a game requires machines to correctly sor…
This research improves neural synthesizers for music sounds from speech data.
problem Applying speech synthesis techniques to musical instrument sounds.
method Comparison of three neural synthesizers in three scenarios: training, zero-shot learning, and fine-tuning.
result Neural synthesizers trained on speech data and fine-tuned on music data perform better.
Anticipatory model generates music with control over events.
problem Controlling symbolic music generation.
method Interleaving event and control sequences to predict future events.
result Anticipatory model matches autoregressive models in performance and can infill control tasks.
We introduce MIDI-VAE, a neural network model based on Variational Autoencoders that is capable of handling polyphonic music with multiple instrument tracks, as well as modeling the dynamics of music by incorporating note durations and velocities. We show that MIDI-VAE can perform style transfer on symbolic music by au…
We explore the potential of a popular distributional semantics vector space model, word2vec, for capturing meaningful relationships in ecological (complex polyphonic) music. More precisely, the skip-gram version of word2vec is used to model slices of music from a large corpus spanning eight musical genres. In this newl…
The paper models musical motif transformations in Beethoven's works.
problem Understanding how motifs transform in symbolic music.
method Developed a probabilistic framework using Conditional Random Fields.
result Identified patterns of motif transformations and their co-occurrences.
EC^2-VAE generates music analogies by disentangling pitch and rhythm representations.
problem Disentangling music representations for generating creative analogies.
method Explicitly-constrained variational autoencoder (EC^2-VAE) for disentangling pitch and rhythm representations.
result EC^2-VAE enables the generation of music analogies by borrowing representations from different pieces.
Paper compares XGB and BPNN for music style classification.
problem Efficient music style classification using different methods.
method Feature extraction for timbral texture, rhythmic content, and pitch content; comparative evaluation of XGB and BPNN.
result XGB outperforms BPNN for small datasets in music classification.
The study assesses music as an investment asset class using discounted cashflow models.
problem Quantifying the risk and return characteristics of music royalty assets.
method Fitting three discounted cashflow models to Royalty Exchange platform transactions and backtesting performance.
result Life of Rights music assets had risk and return characteristics comparable to stocks in the S\&P500 over 5 years.
ragamAI uses machine learning to create concert recitals for Carnatic music.
problem Creating a comprehensive listening experience for Carnatic music concerts.
method Playlist and session-based recommender models, leveraging mathematical structure in past concerts.
result ragamAI generates concert recitals that perform 25%-50% better than baseline models.
Study develops supervised algorithm for symbolic music style translation.
problem Transforming musical style while maintaining original content.
method Synthetic data generation for aligned training data, encoder-decoder model.
result Trained models produce meaningful accompaniments for real MIDI recordings.
RFC enhances humanoid control to imitate complex human motions.
problem Dynamics mismatch between humanoid models and real humans.
method Residual Force Control (RFC) augments control policies with external forces.
result RFC outperforms state-of-the-art methods in convergence speed and motion quality.
Realistic music generation is a challenging task. When building generative models of music that are learnt from data, typically high-level representations such as scores or MIDI are used that abstract away the idiosyncrasies of a particular performance. But these nuances are very important for our perception of musical…
Transformer improves pop piano composition by incorporating beat-based structure.
problem Generating expressive pop piano compositions with coherent rhythmic structure.
method Improved data representation for Transformers, incorporating beat-bar-phrase structure.
result Composes pop piano music with better rhythmic structure than existing models.
Paper proposes LSTM for automatic music generation.
problem Generating music without human intervention.
method Recurrent Neural Networks (RNN), specifically LSTM.
result Model generates new melodies with high accuracy.
We present recent results on counting and distribution of circles in a given circle packing invariant under a geometrically finite Kleinian group and discuss how the dynamics of flows on geometrically finite hyperbolic 3 manifolds are related. Our results apply to Apollonian circle packings, Sierpinski curves, Schott…
FIGARO generates symbolic music with fine-grained control.
problem Minimal control over generated music sequences.
method Description-to-sequence task, learning conditional distribution of sequences given high-level descriptions.
result State-of-the-art controllable symbolic music generation.
A new neural network separates vocals from music accompaniment.
problem Separating vocals from music accompaniment in recordings.
method Self-attention convolutional neural network (CNN) with densely-connected blocks.
result 19.5% relative improvement in vocals separation.
Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is constructed (notes, chords, a complete musical score), can be naturally unified using Bayesian modell…
Deep generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have recently been applied to style and domain transfer for images, and in the case of VAEs, music. GAN-based models employing several generators and some form of cycle consistency loss have been among the most suc…