New method synthesizes piano training data, improving transcription performance.
problem Lack of large piano datasets limits note onset transcription models.
method Synthesizes arbitrary training data, models piano dynamics, avoids disentanglement problem.
result Achieves good transcription performance on MAPS dataset and excellent generalization.
Improved piano transcription by predicting onsets and frames together.
problem Polyphonic piano music transcription accuracy.
method Deep convolutional and recurrent neural network trained to predict pitch onsets and frames.
result Over 100% relative improvement in note F1 score on MAPS dataset.
We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurrent neural network that is able to discover temporal dependencies in high-dimensional sequences. Our…
We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The acoustic model is a neural network used for estimating the probabilities of pitches in …
Automatic Music Transcription (AMT) is one of the oldest and most well-studied problems in the field of music information retrieval. Within this challenging research field, onset detection and instrument recognition take important places in transcription systems, as they respectively help to determine exact onset times…
Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch estimation, and sequential post-processing, i.e. correcting note segmentation using tr…
Neural network generates music scores directly from polyphonic audio.
problem Transcribing music scores directly from polyphonic audio.
method Convolutional Recurrent Neural Network (CRNN) with CTC loss function.
result Model can learn to transcribe scores directly from audio signals.
Automatic Music Transcription (AMT) consists in automatically estimating the notes in an audio recording, through three attributes: onset time, duration and pitch. Probabilistic Latent Component Analysis (PLCA) has become very popular for this task. PLCA is a spectrogram factorization method, able to model a magnitude …
Piano Genie lets non-musicians improvise on a piano.
problem Improvising on the piano for non-musicians.
method Trained recurrent neural network autoencoders with discrete bottlenecks to learn mappings between user inputs and piano pieces.
result Piano Genie allows users to improvise on the piano with musically meaningful constraints.
Paper teaches robots to play piano with touch and learning.
problem Teaching robots to play piano with touch and emotion.
method Reinforcement learning from scratch with touch-augmented reward and curriculum.
result Robots can play piano with correct key positions and various requirements.
Framework generates pop song melodies and piano accompaniment.
problem Creating high-quality pop songs with automated systems.
method Unified strategy using three models: harmony alternation, melody generation, and melody integration.
result Generated melodies rated significantly higher than those from LSTM, and accompaniment comparable to Band in a Box.
PIANO speeds up multinomial logistic regression solving.
problem Handling large datasets and many classes in logistic regression.
method Parallel iterative algorithm based on Majorization Minimization.
result PIANO converges to a stationary point of Multinomial and Sparse Multinomial Logistic Regression.
Dual-track model generates classical piano music better than other methods.
problem Generating inter-dependent piano music.
method Dual-track architecture with various neural network models and music representations.
result Proposed model outperforms other methods in evaluation.
Convolutional GANs with binary neurons directly generate binary piano-rolls.
problem Generating music in binary format without post-processing.
method Appended refiner network with binary neurons to directly create binary piano-rolls.
result Deterministic binary neurons outperform stochastic ones in both objective and subjective tests.
Transformer improves pop piano composition by incorporating beat-based structure.
problem Generating expressive pop piano compositions with coherent rhythmic structure.
method Improved data representation for Transformers, incorporating beat-bar-phrase structure.
result Composes pop piano music with better rhythmic structure than existing models.
New dataset and models generate piano music with coherent structure across multiple timescales.
problem Generating coherent musical structure with neural networks is challenging.
method Used notes as an intermediate representation to model and synthesize music across multiple timescales.
result Trained models capable of transcribing, composing, and synthesizing audio waveforms with coherent musical structure.
Automatic music transcription (AMT) aims to infer a latent symbolic representation of a piece of music (piano-roll), given a corresponding observed audio recording. Transcribing polyphonic music (when multiple notes are played simultaneously) is a challenging problem, due to highly structured overlapping between harmon…
Recent advances in high-throughput cDNA sequencing (RNA-Seq) technology have revolutionized transcriptome studies. A major motivation for RNA-Seq is to map the structure of expressed transcripts at nucleotide resolution. With accurate computational tools for transcript reconstruction, this technology may also become us…
End-to-end ASR error detection using audio-transcript entailment.
problem Detecting transcription errors in ASR systems to prevent error propagation.
method Proposes a novel end-to-end approach using audio-transcript entailment, with acoustic and linguistic encoders.
result Achieves CER of 26.2% on all transcription errors and 23% on medical errors specifically, improving by 12% and 15.4% respectively over a strong baseline.
TF-MoDISco finds transcription factor motifs from genomic data.
problem Identifying transcription factor motifs from genomic sequence data.
method Algorithm for motif discovery from basepair-level importance scores.
result Improved version v0.5.6.5 of TF-MoDISco.
Adversarial learning improves music transcription accuracy.
problem Conditional independence of labels in deep learning models limits transcription performance.
method Adversarial training scheme operating on time-frequency representations to reduce inter-label dependencies.
result Adversarial learning reduces error rate and increases model confidence.
Hybrid VAE-GAN model generates sequential data with spatial correlations.
problem Generating sequences with spatial correlations between frames.
method Semi-recurrent CNNs in encoder, generator, and discriminator; sampling subsequent frames from latent distributions.
result Maintains dependencies between frames in generated sequences.
siRF identifies transcription factor binding near enhancers in flies.
problem Identifying functional transcription factor binding near enhancers.
method Signed iterative random forests (siRF) for machine learning.
result Infers regulatory interactions among transcription factors and enhancers.
Computational approaches to transcription factor binding site identification have been actively researched for the past decade. Negative examples have long been utilized in de novo motif discovery and have been shown useful in transcription factor binding site search as well. However, understanding of the roles of nega…
This study identifies sentence relationships in legal transcripts.
problem Improving understanding of legal case proceedings through sentence relationships.
method Combining machine learning and rule-based approach to classify sentence relationships.
result First study to use discourse relationships for legal court case transcripts.
Inverse Drum Machine separates drum mixes using transcription and synthesis.
problem Separating individual drum tracks from mixed recordings.
method Analysis-by-synthesis framework combining deep learning and automatic transcription.
result Separation quality comparable to supervised methods requiring isolated stems.
Improves audio transcription on scarce data with factorized tasks.
problem Weakly labelled data and lack of training samples.
method Factorizing audio transcription into multiple tasks and training a stacked CNN-RNN model.
result Different training methods for intermediate tasks have varying advantages and disadvantages.
Physically-inspired Gaussian process models study post-transcriptional regulation in Drosophila.
problem Understanding spatiotemporal interactions between mRNAs and gap proteins in post-transcriptional regulation.
method Two physically-inspired Gaussian process models based on reaction-diffusion equations, tested with mRNA expression data.
result Novel GP model requires only kernel function differentiation, simplifying spatial discretisation.
Paper improves music transcription models with invariance and data augmentation.
problem Improving accuracy of frame-based music transcription models.
method Translation-invariant network combining filterbank and CNN, trained with pitch-shift augmented data.
result Top-performing model in MIREX evaluation, reducing model complexity and avoiding overfitting.
Motivation: Cell-biological processes are regulated through a complex network of interactions between genes and their products. The processes, their activating conditions, and the associated transcriptional responses are often unknown. Organism-wide modeling of network activation can reveal unique and shared mechanisms…
Paper proposes M2H-GAN to improve speech theme identification.
problem Limited ASR transcripts for speech theme identification.
method Uses M2H-GAN, a GAN-based approach, to generate TRS-like ASR transcripts.
result Improves speech theme identification performance close to human levels.
Study of SK-N-AS cells' response to methamidophos using transcriptomics.
problem Understanding the transcriptional response of SK-N-AS cells to methamidophos exposure.
method Combination of statistical and machine learning methods for anomaly detection and causal network inference.
result Identification of key processes and transcripts involved in the response to methamidophos.
Generative AI predicts economic activity from corporate transcripts.
problem Predicting economic activity using existing measures like surveys.
method Extracted managerial expectations from transcripts using generative AI.
result AI Economy Score predicts economic activity up to 10 quarters ahead.
Generative models learn from high-level music representations, but this work models music in raw audio.
problem Capturing long-range correlations in music generation.
method Exploring autoregressive discrete autoencoders (ADAs) to model raw audio waveforms.
result Unconditional generation of piano music in raw audio domain with long-range correlations.
Study detects SLI in children from spontaneous narrative transcripts.
problem Detecting Specific Language Impairment (SLI) in children.
method Three-stage pipeline: feature extraction, dimensionality reduction, and classification.
result 97.13% accuracy in identifying SLI from transcripts.
Transformer adapts to multi-instrumental music generation using NES and Lakh MIDI datasets.
problem Generating multi-instrumental music scores with Transformers.
method Adapted Transformer architecture to multi-instrumental setting, used NES-MDB and Lakh MIDI datasets for pre-training.
result Pre-training with Lakh MIDI dataset improves performance for multi-instrumental music generation.
Model earnings call transcripts for better stock price prediction.
problem Predicting future stock price movements using earnings call transcripts.
method Deep learning framework with an attention mechanism to encode text data into vectors for predicting stock price movements.
result The proposed model outperforms traditional machine learning methods in stock price prediction.
To survive environmental conditions, cells transcribe their response activities into encoded mRNA sequences in order to produce certain amounts of protein concentrations. The external conditions are mapped into the cell through the activation of special proteins called transcription factors (TFs). Due to the difficult …
Study analyzes deep learning models for financial sentiment in earnings calls.
problem Leveraging NLP for sentiment analysis in financial transcripts.
method Comparative analysis of BERT, FinBERT, and ULMFiT models.
result Models' strengths and limitations in financial sentiment analysis.
Neural networks predict TED Talk ratings from transcripts, removing bias.
problem Predicting public speaking performance from speech transcripts.
method Causal diagram modeling, word sequence and dependency tree based neural networks.
result Average F-score of 0.77, significantly outperforming baseline methods.
New task aligns molecular structure with gene expression changes.
problem Modeling the relationship between chemical structure and gene expression changes.
method Developed a cross-modal small molecule retrieval task and a coordinated deep learning approach to align chemical structure and gene expression profiles.
result Demonstrated the feasibility of the new task and highlighted the limitations of current data and systems.
The paper improves ASR accuracy using semi-supervised learning and dropout.
problem Improving ASR accuracy with limited labeled data.
method Training a seed model on limited labeled data, using dropout for uncertainty, and data selection for diversity.
result The approach significantly reduces ASR errors compared to baseline.
Predicts customer call intent for auto dealerships using CNN.
problem Understanding customer intent from phone calls for better service.
method Developed a CNN-based supervised learning model for multi-class classification.
result CNN model performs well on customer call intent classification.
The paper uses attention networks for character-based handwritten text transcription.
problem Handwritten text recognition with improved character-level alignment.
method Attentional encoder-decoder networks trained on character sequences, comparing different activation functions.
result Softmax attention provides more precise character alignment than sigmoid attention.
Study combines speaker verification and voice trigger detection in a single network.
problem Separate training for speaker verification and voice trigger detection.
method Multi-task learning with a single network trained on both tasks.
result Single network achieves comparable accuracy to independent models for each task.
Model predicts active and passive cosponsorship motivations in Congress.
problem Identifying motivations behind cosponsorship in U.S. Congress.
method Encoder+RGCN model learning from bill texts and speeches.
result F1-score of 0.88 for predicting active and passive cosponsorship.
Anonymization reduces economic signal extraction from financial texts.
problem Reducing meaningful economic signals from financial texts due to anonymization.
method Analyzed the impact of anonymization on textual understanding and economic signal extraction.
result Information loss due to anonymization is severe and pervasive, outweighing its benefits in certain financial applications.
Paper proposes GAN models for generating multi-track music.
problem Generating music with multiple tracks and temporal dynamics.
method Generative adversarial networks (GANs) for multi-track music generation.
result Models can generate coherent music of four bars right from scratch.