Scattering transform improves note onset detection and instrument recognition in music transcription.
problem Note onset detection and instrument recognition in music transcription.
method Multiscale scattering operators applied to MIDI-driven datasets and real musical pieces.
result Scattering transform outperforms other sound representations for note onset detection and instrument recognition.
Study uses neural networks to classify musical instruments from audio samples.
problem Classifying musical instruments from audio samples.
method Trained an Artificial Neural Network on audio samples transformed to frequency domain. Analyzed features in time and frequency domains.
result Accuracy decreased when using only attack features or initial 100 Hz.
SVM classifier outperforms other models in classifying musical instruments from IRMAS data.
problem Musical instrument classification from audio signals.
method Implemented supervised (SVM) and unsupervised (Hierarchical Clustering) learning algorithms.
result SVM classifier achieved 79% accuracy on IRMAS data.
This paper proposes a method for instrument classification in polyphonic music using monophonic data.
problem Instrument classification in polyphonic music from monophonic data.
method Data augmentation techniques including overlaying audio segments of the same genre, pitch, and tempo synchronization. Convolutional Neural Networks used for classification.
result An ensemble of VGG-like classifiers trained on non-augmented, pitch-synchronized, tempo-synchronized and genre-similar excerpts achieved above 80% LRAP.
MIDI-VAE models music dynamics and instrumentation for style transfer.
problem Modeling and transferring musical style across different instruments and dynamics.
method Variational Autoencoder (VAE) for polyphonic music modeling and style transfer.
result MIDI-VAE successfully transfers musical style between different genres and instruments.
Universal music translation network across instruments and genres.
problem Translating music across different instruments, genres, and styles.
method Multi-domain wavenet autoencoder with a shared encoder and disentangled latent space trained end-to-end on waveforms.
result Achieves convincing translations even from domains not seen during training.
Neural model synthesizes music with flexible timbre controls.
problem Creating audio samples with varied timbres from musical scores.
method Recurrent neural network conditioned on learned instrument embedding followed by WaveNet vocoder.
result Learned embedding space captures diverse timbres and enables interpolation for morphing.
New system for automatic music emotion recognition considers multiple emotions simultaneously.
problem Automatic recognition of simultaneous and multiplicity of emotions in music.
method Comparison of multilabel and multiclass machine learning algorithms on the Emotify dataset.
result The Geneva Emotional Music Scale 9 is adopted for multilabel and multiclass classification of music emotions.
Transformer adapts to multi-instrumental music generation using NES and Lakh MIDI datasets.
problem Generating multi-instrumental music scores with Transformers.
method Adapted Transformer architecture to multi-instrumental setting, used NES-MDB and Lakh MIDI datasets for pre-training.
result Pre-training with Lakh MIDI dataset improves performance for multi-instrumental music generation.
A new method separates instruments in music using shared embeddings.
problem Separating individual instruments in a musical mixture.
method Common embedding space for all instruments, auxiliary Gaussian mixture model.
result Outperforms mask-inference baseline on MUSDB-18 dataset.
Model disentangles timbre and pitch for musical instruments.
problem Learning disentangled representations of musical instrument sounds.
method Gaussian mixture variational autoencoders with two separate encoders for timbre and pitch.
result Model successfully disentangles timbre and pitch, enabling controllable synthesis and transfer.
Proposes COALA method for learning audio representations aligned with tags.
problem Lack of annotated data for high-performance audio representation learning.
method Aligns latent representations of audio and tags using a contrastive loss.
result Audio embedding model captures both acoustic and semantic characteristics.
Semi-supervised singing voice separation using synthetic mixtures.
problem Singing voice separation with limited labeled data.
method Trains a single mapping function g on synthetic mixtures of singing and instrumental music.
result Performance comparable to fully supervised methods, better than semi-supervised alternatives.
DeepDrum generates drum rhythms under musical constraints.
problem Generating rhythms that adhere to musical style and constraints.
method Adaptive Neural Network with Conditional Layers containing musical parameters and instrumentation.
result DeepDrum effectively generates rhythms that resemble learned styles while conforming to given constraints.
Challenge aims to recognize music genres from audio.
problem Recognizing music genres from audio recordings.
method Open data challenge with submissions evaluated.
result Results presented from the challenge.
Model creates a latent space for multitrack music measures.
problem Representing and exploring the structure of polyphonic music.
method Extended MusicVAE to a latent space, enabling various operations.
result Model can generate, interpolate, and manipulate musical measures.
New music dataset for machine learning research.
problem No specific problem stated; focuses on dataset creation.
method Defined a large-scale music dataset and evaluated machine learning architectures.
result End-to-end models learned frequency selective filters.
This research improves neural synthesizers for music sounds from speech data.
problem Applying speech synthesis techniques to musical instrument sounds.
method Comparison of three neural synthesizers in three scenarios: training, zero-shot learning, and fine-tuning.
result Neural synthesizers trained on speech data and fine-tuned on music data perform better.
New CRF model segments music into chords with rich features.
problem Harmonic analysis of music segments.
method Semi-Markov Conditional Random Field (semi-CRF) with segment-level features.
result Semi-CRF model performs better than previous approaches.
TimbreTron transfers musical timbre using CQT and WaveNet.
problem Transfer musical timbre while preserving pitch, rhythm, and loudness.
method Apply image domain style transfer to CQT representation, then generate high-quality waveform with WaveNet.
result TimbreTron recognizably transfers timbre while preserving musical content.
This study applies variational inference to improve music emotion recognition.
problem Improving understanding and recognition of music emotions.
method Employed variational inference and Bayesian statistics techniques.
result Developed a flexible multivariate model for emotion recognition.
New algorithm separates vocals from music recordings efficiently.
problem Separate vocal and instrumental parts in music recordings.
method Informed group-sparse representation for linear-time singing voice separation.
result Efficacy confirmed on iKala dataset; music accompaniment follows group-sparse structure.
The paper proposes a novel approach to music analysis using text mining techniques.
problem Analyzing musical documents using traditional text mining methods.
method Developed a Naive Dictionary of 'muselets' (musical words) of uniform length.
result Demonstrated reasonable topic modeling and pattern recognition results with a simplified dictionary.
SING generates musical notes from instruments in real-time.
problem Efficiently generating high-quality audio from MIDI data.
method Frame-by-frame waveform generation with a single decoder, using a new loss function.
result SING produces significantly improved audio quality compared to state-of-the-art models, with 32x faster training and 2,500x faster inference.
Enhanced feature extraction pipeline boosts music genre recognition.
problem Improving music genre classification accuracy.
method Extended feature engineering pipeline with multiple stages and feedback loops.
result The method significantly improves classification performance on the GTZAN dataset.
MCLNN improves music genre classification by learning frequency bands.
problem Classifying music genres using neural networks adapted from image recognition.
method MCLNN learns frequency bands, reducing susceptibility to frequency shifts and enabling concurrent exploration of feature combinations.
result MCLNN outperforms state-of-the-art Convolutional Neural Networks on the Ballroom music dataset.
Bardo Composer generates tabletop RPG music based on player speech.
problem Creating immersive background music for tabletop RPGs.
method Speech recognition, emotion classification, and music generation using a novel beam search algorithm.
result Generated music pieces can be accurately identified by human subjects as conveying the intended emotion.
CNN improves spatiotemporal emotion recognition from EEG during music listening.
problem Improving emotion recognition from EEG signals during music listening.
method Conducted a study on CNN and its spatiotemporal feature extraction for emotion recognition.
result CNN outperforms SVM in leave-one-subject-out cross validation.
Review of deep learning techniques for audio signal processing.
problem Improving audio signal processing using deep learning.
method Analysis of various deep learning models and techniques.
result Advancements in speech, music, and environmental sound processing.
New dataset and models generate piano music with coherent structure across multiple timescales.
problem Generating coherent musical structure with neural networks is challenging.
method Used notes as an intermediate representation to model and synthesize music across multiple timescales.
result Trained models capable of transcribing, composing, and synthesizing audio waveforms with coherent musical structure.
HMMs improve music transcription accuracy.
problem Improving automatic transcription of music.
method Employed PLCA for multi-pitch estimation and integrated HMMs for note segmentation and post-processing.
result HMMs enhance transcription accuracy on different instruments.
The musical notes from a hyperbolic marimba can identify the shape of hyperbolic surfaces.
problem Identifying hyperbolic surfaces based on their musical notes.
method Assigning musical notes to geodesics hitting labeled curves on hyperbolic surfaces.
result The melodies produced by hyperbolic marimbas can characterize hyperbolic surfaces up to isometry.
The paper categorizes music emotions and improves music retrieval.
problem Inefficient music retrieval based on album information.
method Categorical emotion expression, Fisher's separation theorem, feature extraction, Support Vector Machines.
result Maximum separability occurs between relaxing and epic music parts.
Neural nets classify Thai Lukthung songs from other genres.
problem Classifying Thai Lukthung songs for personalized music recommendations.
method Developed neural networks using lyrics and audio features.
result Combined model yields F1 score of 0.86 for Lukthung classification. Paper proposes GAN models for generating multi-track music.
problem Generating music with multiple tracks and temporal dynamics.
method Generative adversarial networks (GANs) for multi-track music generation.
result Models can generate coherent music of four bars right from scratch.
A musical instrument based on moduli spaces lets users hear geometric concepts.
problem Understanding geometric structures through auditory means.
method Developed a plastic hormonica based on Farey tessellations and Poincaré disk decorations.
result Users can audibly experience paths in Riemann moduli spaces and listen to mapping classes.
DeepPhase uses deep learning to recognize surgical phases in cataract surgery videos.
problem Automating surgical workflow analysis for better standardization and post-surgical assessment.
method Deep learning for instrument detection and phase classification in cataract surgery videos.
result DeepPhase models achieve 99% accuracy in instrument detection and 78% in phase recognition.
Paper proposes LSTM for automatic music generation.
problem Generating music without human intervention.
method Recurrent Neural Networks (RNN), specifically LSTM.
result Model generates new melodies with high accuracy.
Paper proposes a bijective approach for signal/symbol translation using variational auto-encoders.
problem Extracting symbolic information from signals, especially in music, is challenging and non-generic.
method Turned into a density estimation task, using two variational auto-encoders with additive constraint.
result Bijective signal/symbol translation achieved, allowing both signal-to-symbol and symbol-to-signal inference.
Spectrogram-Channels U-Net separates sounds by treating each channel as a source's spectrogram.
problem Sound source separation in music information retrieval.
method Adapting U-Net to treat each channel of the output as a source's spectrogram, balancing volumes between sources.
result State-of-the-art performance on singing voice and multi-instrument separation.
This paper explores deep learning in music generation, from history to current techniques.
problem Creating music automatically using deep learning.
method Analysis of historical and recent deep learning music generation systems.
result Deep learning can learn musical styles and generate music samples.
New system tracks musical performances in raw sheet images without preprocessing.
problem Lack of direct score position estimation in raw sheet images.
method Proposes an Audio-Conditioned U-Net architecture.
result Direct score position estimation in entire unprocessed sheet images.
Paper presents a novel waveform-to-waveform model for music source separation.
problem Isolating individual instruments from mixed music recordings.
method Adapted Conv-Tasnet to waveform domain and developed Demucs with U-Net and bidirectional LSTM.
result Demucs achieves superior performance on music source separation tasks, surpassing existing state-of-the-art.
Improved music transcription accuracy using Particle Filtering for PLCA model.
problem Limited performance of EM-based PLCA models in automatic music transcription.
method Employed Particle Filtering (PF) to overcome EM algorithm's limitations.
result Achieved 61.8% and 59.5% note-level transcription accuracy on two instrument repertoires.
New model explains music emotion predictions with visualizable mid-level features.
problem Challenging to quantify and predict music emotion.
method VGG-style deep neural network with mid-level perceptual features.
result Small loss in performance justifies high explainability of predictions.
Generative adversarial network improves audio inpainting for long gaps.
problem Generating missing audio content in long-range gaps using WGAN.
method Proposed WGAN architecture with short-range and long-range neighboring borders.
result The proposed model outperforms classical WGAN in reconstructing high-frequency content.
We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The acoustic model is a neural network used for estimating the probabilities of pitches in …
Transfer learning artist group factors for more accurate music genre classification.
problem Automated music genre classification from audio is challenging due to subjective and noisy genre labels.
method Apply transfer learning to learn artist-related factors for genre classification, using different transfer methods.
result Achieved highest validation accuracy on FMA dataset through multi-task learning.