Framework generates pop song melodies and piano accompaniment.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Generating music has a few notable differences from generating images and videos. First, music is an art of time, necessitating a temporal model. Second, music is usually composed of multiple instruments/tracks with their own temporal dynamics, but collectively they unfold over time interdependently. Lastly, musical no…
We present Piano Genie, an intelligent controller which allows non-musicians to improvise on the piano. With Piano Genie, a user performs on a simple interface with eight buttons, and their performance is decoded into the space of plausible piano music in real time. To learn a suitable mapping procedure for this proble…
Paper teaches robots to play piano with touch and learning.
Many of the recent approaches to polyphonic piano note onset transcription require training a machine learning model on a large piano database. However, such approaches are limited by dataset availability; additional training data is difficult to produce, and proposed systems often perform poorly on novel recording con…
PIANO speeds up multinomial logistic regression solving.
Dual-track model generates classical piano music better than other methods.
Transformer improves pop piano composition by incorporating beat-based structure.
It has been shown recently that deep convolutional generative adversarial networks (GANs) can learn to generate music in the form of piano-rolls, which represent music by binary-valued time-pitch matrices. However, existing models can only generate real-valued piano-rolls and require further post-processing, such as ha…
Music relies heavily on repetition to build structure and meaning. Self-reference occurs on multiple timescales, from motifs to phrases to reusing of entire sections of music, such as in pieces with ABA structure. The Transformer (Vaswani et al., 2017), a sequence model based on self-attention, has achieved compelling …
We advance the state of the art in polyphonic piano music transcription by using a deep convolutional and recurrent neural network which is trained to jointly predict onsets and frames. Our model predicts pitch onset events and then uses those predictions to condition framewise pitch predictions. During inference, we r…
Generating musical audio directly with neural networks is notoriously difficult because it requires coherently modeling structure at many different timescales. Fortunately, most music is also highly structured and can be represented as discrete note events played on musical instruments. Herein, we show that by using no…
Transformer adapts to multi-instrumental music generation using NES and Lakh MIDI datasets.
We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The acoustic model is a neural network used for estimating the probabilities of pitches in …
We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurrent neural network that is able to discover temporal dependencies in high-dimensional sequences. Our…
Deep Autotuner corrects singing pitch without scores, using vocal and accompaniment spectral data.
A semi-recurrent hybrid VAE-GAN model for generating sequential data is introduced. In order to consider the spatial correlation of the data in each frame of the generated sequence, CNNs are utilized in the encoder, generator, and discriminator. The subsequent frames are sampled from the latent distributions obtained b…
A new neural network separates vocals from music accompaniment.
Automatic Music Transcription (AMT) is one of the oldest and most well-studied problems in the field of music information retrieval. Within this challenging research field, onset detection and instrument recognition take important places in transcription systems, as they respectively help to determine exact onset times…
Bayesian inference engines improve density estimation accuracy and scalability.
Transformer autoencoder learns musical style from performances.
Model counts event occurrences to detect and locate events in data.
Realistic music generation is a challenging task. When building generative models of music that are learnt from data, typically high-level representations such as scores or MIDI are used that abstract away the idiosyncrasies of a particular performance. But these nuances are very important for our perception of musical…
The paper is accompanying "A general Duality Theorem for the Monge-Kantorovich Transport Problem". We explain the methods used in this article in an elementary setting and present two examples complementing the results obtained therein.
We describe the gauge-theoretic approach to transformations in integrable geometry through discussion of two classical examples: surfaces of constant negative Gauss curvature and isothermic surfaces. These are purely expository notes written to accompany some lectures I gave in Fukuoka in May 2015.
Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between time steps and series complicate the task. To obtain accurate prediction, it is cru…
Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch estimation, and sequential post-processing, i.e. correcting note segmentation using tr…
These notes accompany some lectures given at the autumn school "Tresses in Pau" in October 2009. The abelian Reidemeister torsion for 3-manifolds, and its refinements by Turaev, are introduced. Some applications, including relations between the Reidemeister torsion and other classical invariants, are surveyed.
New method separates music vocals from accompaniment without labeled data.
Anticipatory model generates music with control over events.
This paper gives an overview of some basic properties of Leibniz algebras. Some of the results were known earlier, but in the article they are accompanied by new simple proofs. Some of the results are new. The article can be viewed as a digest or a mini-manual for the basic theory of Leibniz algebras
Neural network generates music scores directly from polyphonic audio.
Automatic music transcription (AMT) aims to infer a latent symbolic representation of a piece of music (piano-roll), given a corresponding observed audio recording. Transcribing polyphonic music (when multiple notes are played simultaneously) is a challenging problem, due to highly structured overlapping between harmon…
Clarifies when certain stochastic PDEs have affine solutions.
The paper models musical motif transformations in Beethoven's works.
Automatic Music Transcription (AMT) consists in automatically estimating the notes in an audio recording, through three attributes: onset time, duration and pitch. Probabilistic Latent Component Analysis (PLCA) has become very popular for this task. PLCA is a spectrogram factorization method, able to model a magnitude …
One important effect of price shocks in the United States has been increased political attention paid to the structure and performance of oil and natural gas markets, along with some governmental support for energy conservation. This paper describes how price changes helped lead the emergence of a political agenda acco…
We show how to reduce the process of predicting general order statistics (and the median in particular) to solving classification. The accompanying theoretical statement shows that the regret of the classifier bounds the regret of the quantile regression under a quantile loss. We also test this reduction empirically ag…
This paper extends danceability concept to twisted virtual knots.
We define enhanced presentations of quandles via generators and relations with additional information comprising signed operations and an order structure on the set of generators. Such a presentation determines a virtual link diagram up to virtual moves. We list formal Reidemeister moves in which Tietze moves on the pr…
Generative adversarial network improves audio inpainting for long gaps.
The materials accompany a lecture short course presented at the 2011 Park City Mathematics Institute, Graduate Summer School on Moduli Spaces of Riemann Surfaces. The lectures were part of/coordinated with an overall program, including lectures by Ursula Hamenstadt on Teichmueller Theory, Andy Putman on Mapping Class a…
Python toolkit for symbolic Poisson geometry calculations.
Compound interest as well as inflation grows exponentially with time, whereas other means to repay debt grow polynomially. For this and other, mostly political, reasons, debt without inflation is unsustainable. We suggest a discontinuous way to eliminate debt by nullifying it. This scenario is preferable to current cen…
Technical report classifies all principal congruence link groups.
One of the main issues affecting the Italian NHS is the healthcare deficit: according to current agreements between the Italian State and its Regions, public funding of regional NHS is now limited to the amount of regional deficit and is subject to previous assessment of strict adherence to constraint on regional healt…
Study develops supervised algorithm for symbolic music style translation.
Optimizes embedding accuracy for data variance and error.