End-to-end ASR error detection using audio-transcript entailment.
problem Detecting transcription errors in ASR systems to prevent error propagation.
method Proposes a novel end-to-end approach using audio-transcript entailment, with acoustic and linguistic encoders.
result Achieves CER of 26.2% on all transcription errors and 23% on medical errors specifically, improving by 12% and 15.4% respectively over a strong baseline.
Improves audio transcription on scarce data with factorized tasks.
problem Weakly labelled data and lack of training samples.
method Factorizing audio transcription into multiple tasks and training a stacked CNN-RNN model.
result Different training methods for intermediate tasks have varying advantages and disadvantages.
Neural network generates music scores directly from polyphonic audio.
problem Transcribing music scores directly from polyphonic audio.
method Convolutional Recurrent Neural Network (CRNN) with CTC loss function.
result Model can learn to transcribe scores directly from audio signals.
Black-box adversarial examples improve ASR system accuracy.
problem Improving ASR system accuracy through targeted adversarial examples.
method Combining genetic algorithms and gradient estimation for black-box attacks.
result Achieved 89.25% targeted attack similarity with 94.6% audio file similarity.
Universal audio perturbations fool ASR systems.
problem Speech recognition systems are vulnerable to adversarial attacks.
method Developed an algorithm to create universal perturbations that fool ASR models.
result Universal perturbations can fool ASR systems across different models.
Improved piano transcription by predicting onsets and frames together.
problem Polyphonic piano music transcription accuracy.
method Deep convolutional and recurrent neural network trained to predict pitch onsets and frames.
result Over 100% relative improvement in note F1 score on MAPS dataset.
Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is constructed (notes, chords, a complete musical score), can be naturally unified using Bayesian modell…
AV-ASR system improves speech recognition with visual context.
problem Improving speech recognition accuracy with visual information.
method Transformer-based architecture with multiresolution and multimodal training.
result Multiresolution training speeds up convergence and improves WER by 18%.
A scalable system learns acoustic models from 1 Million hours of untranscribed audio.
problem Learning acoustic models from large, untranscribed audio datasets.
method Semi-supervised learning with a student/teacher learning paradigm, focusing on the data and model pipelines.
result Relative accuracy improvements of 10-20% in noisy conditions, with no extensive hyper-parameter tuning.
Paper proposes a bijective approach for signal/symbol translation using variational auto-encoders.
problem Extracting symbolic information from signals, especially in music, is challenging and non-generic.
method Turned into a density estimation task, using two variational auto-encoders with additive constraint.
result Bijective signal/symbol translation achieved, allowing both signal-to-symbol and symbol-to-signal inference.
Automatic Music Transcription (AMT) consists in automatically estimating the notes in an audio recording, through three attributes: onset time, duration and pitch. Probabilistic Latent Component Analysis (PLCA) has become very popular for this task. PLCA is a spectrogram factorization method, able to model a magnitude …
New unsupervised speaker adaptation method for speech synthesis.
problem Adapting speech synthesis to new speakers with minimal data.
method Concatenating audio and text inputs, proposing new training schemes.
result Improves adaptation to unseen speakers and multi-speaker modeling.
Automatic music transcription (AMT) aims to infer a latent symbolic representation of a piece of music (piano-roll), given a corresponding observed audio recording. Transcribing polyphonic music (when multiple notes are played simultaneously) is a challenging problem, due to highly structured overlapping between harmon…
Robust ASR model removes fast-changing features to resist attacks.
problem Vulnerability of ASR systems to adversarial attacks.
method Removing fast-changing features using slow feature analysis or low-pass filtering.
result Hybrid ASR models are more than four times more robust against targeted attacks.
We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The acoustic model is a neural network used for estimating the probabilities of pitches in …
Recent advances in high-throughput cDNA sequencing (RNA-Seq) technology have revolutionized transcriptome studies. A major motivation for RNA-Seq is to map the structure of expressed transcripts at nucleotide resolution. With accurate computational tools for transcript reconstruction, this technology may also become us…
Improved animated faces using audiovisual and modality dropout.
problem Creating realistic animated faces using speech and visual cues.
method Training a deep learning model with modality dropout to balance audio and visual inputs.
result Modality dropout improves viewer preference for audiovisual-driven animation.
Improved voice trigger detection in noisy environments.
problem Complex acoustic environments and lack of trigger phrase training data.
method Two-stage cascaded architecture with multi-task learning.
result Model reduces errors by half compared to baseline in challenging conditions.
TF-MoDISco finds transcription factor motifs from genomic data.
problem Identifying transcription factor motifs from genomic sequence data.
method Algorithm for motif discovery from basepair-level importance scores.
result Improved version v0.5.6.5 of TF-MoDISco.
Adversarial learning improves music transcription accuracy.
problem Conditional independence of labels in deep learning models limits transcription performance.
method Adversarial training scheme operating on time-frequency representations to reduce inter-label dependencies.
result Adversarial learning reduces error rate and increases model confidence.
This paper investigates how the order of token generation affects language model quality.
problem The influence of token generation order on model quality in autoregressive language models.
method A novel two-pass language model that produces partially-filled sentence templates and then fills in missing tokens. Various strategies for structuring these two passes are compared.
result The most effective strategy generates function words in the first pass followed by content words in the second.
siRF identifies transcription factor binding near enhancers in flies.
problem Identifying functional transcription factor binding near enhancers.
method Signed iterative random forests (siRF) for machine learning.
result Infers regulatory interactions among transcription factors and enhancers.
Large speech dataset for commercial use with 9.98% word error rate.
problem Creating a diverse speech recognition dataset for commercial purposes.
method Internet search for licensed audio data with transcriptions, training model on the dataset.
result Model trained on dataset achieves 9.98% word error rate on Librispeech's test-clean test set.
Computational approaches to transcription factor binding site identification have been actively researched for the past decade. Negative examples have long been utilized in de novo motif discovery and have been shown useful in transcription factor binding site search as well. However, understanding of the roles of nega…
This study identifies sentence relationships in legal transcripts.
problem Improving understanding of legal case proceedings through sentence relationships.
method Combining machine learning and rule-based approach to classify sentence relationships.
result First study to use discourse relationships for legal court case transcripts.
Inverse Drum Machine separates drum mixes using transcription and synthesis.
problem Separating individual drum tracks from mixed recordings.
method Analysis-by-synthesis framework combining deep learning and automatic transcription.
result Separation quality comparable to supervised methods requiring isolated stems.
ACI converts call center conversations into actionable data.
problem Real-time spoken language understanding for call center conversations.
method Combines speech recognition, entity and intent recognition, and a business rules engine.
result ACI converts live audio into structured events for real-time supervision and assistance.
New method synthesizes piano training data, improving transcription performance.
problem Lack of large piano datasets limits note onset transcription models.
method Synthesizes arbitrary training data, models piano dynamics, avoids disentanglement problem.
result Achieves good transcription performance on MAPS dataset and excellent generalization.
Physically-inspired Gaussian process models study post-transcriptional regulation in Drosophila.
problem Understanding spatiotemporal interactions between mRNAs and gap proteins in post-transcriptional regulation.
method Two physically-inspired Gaussian process models based on reaction-diffusion equations, tested with mRNA expression data.
result Novel GP model requires only kernel function differentiation, simplifying spatial discretisation.
Paper improves music transcription models with invariance and data augmentation.
problem Improving accuracy of frame-based music transcription models.
method Translation-invariant network combining filterbank and CNN, trained with pitch-shift augmented data.
result Top-performing model in MIREX evaluation, reducing model complexity and avoiding overfitting.
Motivation: Cell-biological processes are regulated through a complex network of interactions between genes and their products. The processes, their activating conditions, and the associated transcriptional responses are often unknown. Organism-wide modeling of network activation can reveal unique and shared mechanisms…
Paper proposes M2H-GAN to improve speech theme identification.
problem Limited ASR transcripts for speech theme identification.
method Uses M2H-GAN, a GAN-based approach, to generate TRS-like ASR transcripts.
result Improves speech theme identification performance close to human levels.
Proposes a self-supervised method for generating spatial audio from monaural audio and video.
problem Generating spatial audio from monaural audio and video recordings is challenging and expensive.
method Uses a self-supervised network with an auxiliary classifier to classify video channels and generate spatial audio.
result The proposed method effectively generates spatial audio from monaural audio and video.
Deep audio prior uses neural networks to solve audio problems without data.
problem Challenging audio problems like source separation, editing, and synthesis.
method Randomly-initialized neural network with carefully designed audio prior.
result Superior audio results on Universal-150 benchmark dataset.
Zero-shot audio classification using class label embeddings.
problem Classifying audio without labeled data.
method Bilinear model with audio feature embeddings and class label embeddings.
result Achieved accuracy up to 39.7% for natural audio categories.
Study of SK-N-AS cells' response to methamidophos using transcriptomics.
problem Understanding the transcriptional response of SK-N-AS cells to methamidophos exposure.
method Combination of statistical and machine learning methods for anomaly detection and causal network inference.
result Identification of key processes and transcripts involved in the response to methamidophos.
A new autoencoder speeds up audio style transfer.
problem Efficiently generating stylized audio from content audio.
method Autoencoder architecture for real-time audio style transfer.
result Single forward pass for stylized audio generation.
Generative AI predicts economic activity from corporate transcripts.
problem Predicting economic activity using existing measures like surveys.
method Extracted managerial expectations from transcripts using generative AI.
result AI Economy Score predicts economic activity up to 10 quarters ahead.
Study detects SLI in children from spontaneous narrative transcripts.
problem Detecting Specific Language Impairment (SLI) in children.
method Three-stage pipeline: feature extraction, dimensionality reduction, and classification.
result 97.13% accuracy in identifying SLI from transcripts.
The paper proposes a method to predict audio ad quality using acoustic features.
problem Improving user experience in online music streaming services by ensuring high quality audio advertisements.
method The paper proposes predicting audio ad quality using acoustic features and a proxy metric called Long Click Rate (LCR). A deep learning model is also introduced.
result The proposed deep learning model outperforms other models trained on hand-crafted features for audio ad quality prediction.
Method learns audio embeddings with contextualized tags.
problem Align audio and tags for cross-modal tasks.
method Audio autoencoder, word embeddings, multi-head self-attention, contrastive loss.
result Multi-head self-attention improves audio representations.
Study improves radio show segmentation using audio embeddings.
problem Automated segmentation of radio shows.
method Created audio embeddings from multi-class classification tasks on different datasets, evaluated performance against text-only baseline.
result Audio embeddings from non-speech sound event classification significantly outperformed text-only baseline by 32.3% in F1-measure.
Model earnings call transcripts for better stock price prediction.
problem Predicting future stock price movements using earnings call transcripts.
method Deep learning framework with an attention mechanism to encode text data into vectors for predicting stock price movements.
result The proposed model outperforms traditional machine learning methods in stock price prediction.
Generative model improves audio synthesis from TF features.
problem Challenges in generating high-quality audio from TF features.
method Used a GAN to generate invertible TF features from short-time Fourier transforms.
result Generated TF features from GAN outperformed direct waveform generation.
Task describes tagging audio clips from 41 categories.
problem Tagging audio clips from diverse categories.
method Baseline system using AudioSet labels.
result Demonstrates feasibility of general-purpose audio tagging.
To survive environmental conditions, cells transcribe their response activities into encoded mRNA sequences in order to produce certain amounts of protein concentrations. The external conditions are mapped into the cell through the activation of special proteins called transcription factors (TFs). Due to the difficult …
AVDCNN combines audio and visual data for better speech enhancement.
problem Improving speech quality by reducing noise in audio signals.
method Proposes an AVDCNN model that integrates audio and visual streams into a unified deep CNN network for end-to-end training.
result AVDCNN outperforms audio-only and conventional SE methods in enhancing speech quality.
Study analyzes deep learning models for financial sentiment in earnings calls.
problem Leveraging NLP for sentiment analysis in financial transcripts.
method Comparative analysis of BERT, FinBERT, and ULMFiT models.
result Models' strengths and limitations in financial sentiment analysis.