Zero-shot audio classification using class label embeddings.
problem Classifying audio without labeled data.
method Bilinear model with audio feature embeddings and class label embeddings.
result Achieved accuracy up to 39.7% for natural audio categories.
Study improves radio show segmentation using audio embeddings.
problem Automated segmentation of radio shows.
method Created audio embeddings from multi-class classification tasks on different datasets, evaluated performance against text-only baseline.
result Audio embeddings from non-speech sound event classification significantly outperformed text-only baseline by 32.3% in F1-measure.
Study improves animal audio classification using data augmentation.
problem Improving automated animal audio classification accuracy.
method Exploits different data augmentation techniques for training CNNs.
result Best recognition rates on animal audio classification datasets.
Capsule networks improve audio classification performance.
problem Improving audio classification accuracy.
method Dynamic routing-by-agreement mechanism for capsule networks.
result Significant improvements in performance compared to baseline models.
This thesis evaluates text-based vs audio-based classification of mental health interviews.
problem Classifying psychiatric illness using text-based methods.
method Design and evaluate a text classification network on mental health interviews, using belabBERT.
result Text-based classification is a strong alternative to audio-based methods.
CRNN improves artist classification with temporal audio features.
problem Artist classification using deep learning with temporal structure.
method Convolutional Recurrent Neural Network (CRNN) applied to music artist identification dataset.
result Best model achieves an average F1 score of 0.937.
Self-supervised attention model improves weakly labeled audio event classification.
problem Efficiently classify audio events with minimal labeled data.
method Develops a self-supervised attention model for weakly labeled audio clips.
result Self-supervised attention model performs comparably to strongly supervised model trained with strong labels.
CNNs improve generalization to unseen audio devices with increased width, not depth.
problem CNNs are sensitive to specific audio recording devices in acoustic scene classification.
method Investigated the relationship between over-parameterization and generalization in CNNs for audio classification.
result Increasing width improves generalization to unseen devices without increasing the number of parameters.
Convolutional Neural Networks (CNNs) have proven very effective in image classification and show promise for audio. We use various CNN architectures to classify the soundtracks of a dataset of 70M training videos (5.24 million hours) with 30,871 video-level labels. We examine fully connected Deep Neural Networks (DNNs)…
Improved audio classification with limited labels using multitask and self-supervised learning.
problem Limited labeled data for audio classification.
method Multitask learning and self-supervised learning on unlabeled data.
result Significant improvement in performance (up to 6%) through multitask and self-supervised learning.
Paper proposes a robust audio classification method against adversarial attacks.
problem Adversarial attacks can fool machine learning models into making incorrect predictions.
method Proposes a novel SVM-based approach using DWT and SURF features.
result The proposed method provides a good balance between accuracy and resilience against adversarial attacks.
Automated speaker fluency level assessment using machine learning.
problem Time-consuming manual evaluation of non-native English speakers' fluency levels.
method Built a dataset of labeled audio conversations, extracted features, and trained machine learning models.
result Support vector machine achieved 94.39% classification accuracy.
AclNet improves audio classification with high accuracy and reduced complexity.
problem Efficiently classifying audio data with high accuracy.
method Proposed AclNet architecture with data augmentation and regularization.
result Achieved state-of-the-art performance on ESC-50 corpus with 85.65% accuracy.
Proposes COALA method for learning audio representations aligned with tags.
problem Lack of annotated data for high-performance audio representation learning.
method Aligns latent representations of audio and tags using a contrastive loss.
result Audio embedding model captures both acoustic and semantic characteristics.
New neural network improves audio classification accuracy.
problem Challenging audio classification problem in pattern recognition.
method Introduces a Classifier-Attention-Based Convolutional Neural Network (CAB-CNN) with an attention mechanism to reduce classifier complexity.
result Significantly improves audio classification performance, achieving more than 10% improvements.
Unsupervised learning identifies sound categories from unlabeled audio.
problem Learning sound categories from unlabeled audio recordings.
method Class-agnostic semantic constraints and triplet loss-based training.
result Low-dimensional embeddings recover 41% and 84% of supervised performance.
Graph neural networks improve music genre classification on audio datasets.
problem Difficulty in applying deep learning on spectrograms due to lack of quality data and augmentation.
method Combination of CNN and Graph Neural Networks (GNN) with Siamese Neural Networks.
result Achieved state-of-the-art results on GTZAN and AudioSet datasets.
Improved acoustic scene classification with factorized CNN.
problem Acoustic scene classification in varying environments.
method Large-margin factorized CNN with triplet loss.
result Improved performance and better generalization on unseen data.
Improved audio event recognition using audiovisual transformers.
problem Weakly labeled audio event classification with limited temporal information.
method Adapted transformer architecture that combines audio and video inputs.
result State-of-the-art performance on audiovisual data set.
Transfer learning artist group factors for more accurate music genre classification.
problem Automated music genre classification from audio is challenging due to subjective and noisy genre labels.
method Apply transfer learning to learn artist-related factors for genre classification, using different transfer methods.
result Achieved highest validation accuracy on FMA dataset through multi-task learning.
Study presents a dataset and methods to handle noisy labels in sound event classification.
problem Label noise in sound event classification datasets.
method Developed a dataset with noisy labels and evaluated CNN baseline systems.
result Training with large amounts of noisy data can outperform training with carefully-labeled data.
Method learns audio embeddings with contextualized tags.
problem Align audio and tags for cross-modal tasks.
method Audio autoencoder, word embeddings, multi-head self-attention, contrastive loss.
result Multi-head self-attention improves audio representations.
Self-paced ensemble learning improves audio classification models.
problem Improving performance of individual models in speech and audio classification.
method A self-paced ensemble learning scheme where models learn from each other over several iterations.
result SPEL significantly outperforms baseline ensemble models.
A model classifies music genres from MP3 files using metric learning and feature extraction.
problem Classifying music genres from MP3 files efficiently and accurately.
method Metric learning and feature extraction using MFCC and PCA.
result Promising results in classification accuracy compared to baseline algorithms.
Enhances sound texture in CNN for better acoustic scene classification.
problem Limited understanding of how CNNs perceive audio scenes.
method Used Class Activation Mapping (CAM) to analyze log-Mel features and proposed edge enhancement using DoG and Sobel operators.
result Edge-enhanced log-Mel features improve CNN performance in acoustic scene classification.
MCLNN improves audio classification with binary masks.
problem Improving audio classification accuracy.
method Binary mask applied to CLNN for feature preservation and combination exploration.
result Competitive recognition accuracies on GTZAN and ISMIR2004 datasets.
This paper analyzes sound event detection in synthetic office audio, comparing different systems.
problem Comparing sound event detection systems in synthetic office audio.
method Analysis of systems submitted to DCASE 2016 task, using synthetic office sounds.
result Statistical analysis of results, highlighting system performance under controlled conditions.
End-to-end DA method for domain-invariant CNNs using parallel audio recordings.
problem Distribution mismatches between training and application data in machine listening.
method Enforcing equal hidden layer representations for domain-parallel samples.
result Learn domain-invariant classifiers without requiring classification labels.
Transformer model estimates keywords for better audio captioning.
problem Indeterminacy in word selection for audio events/scenes.
method Transformer-based model with keyword estimation.
result Achieved state-of-the-art performance in AAC.
System tackles indeterminacies in automated audio captioning.
problem Word selection and sentence length indeterminacies in automated audio captioning.
method Solves caption generation and sub-indeterminacy problems through multi-task learning to estimate keywords and sentence length.
result Model achieved 20.7 SPIDEr score, significantly outperforming baseline.
Neural nets classify Thai Lukthung songs from other genres.
problem Classifying Thai Lukthung songs for personalized music recommendations.
method Developed neural networks using lyrics and audio features.
result Combined model yields F1 score of 0.86 for Lukthung classification. Classifiers and beamforming algorithms improved audio surveillance detection accuracy.
problem Detecting surveillance sound events with high accuracy and efficiency.
method Evaluated seven classifiers and two beamforming algorithms; used data augmentation and tested with varying SNR levels.
result SVM and Delay-and-Sum (DaS) combination achieved the highest accuracy (86.0%), but had high computational cost.
Paper finds universal speech command perturbations that fool models.
problem Existence of universal adversarial examples in speech command classification.
method Proposed a novel analytical framework for evaluating universal perturbations and a detailed distortion measurement method.
result Universal perturbations can fool speech command classification models across different models.
End-to-end CNN classifies environmental sounds from audio signals.
problem Classifying environmental sounds from audio signals.
method 1D Convolutional Neural Network (CNN) with overlapped frames and Gammatone filterbank initialization.
result 89% mean accuracy on UrbanSound8k dataset.
End-to-end ASR error detection using audio-transcript entailment.
problem Detecting transcription errors in ASR systems to prevent error propagation.
method Proposes a novel end-to-end approach using audio-transcript entailment, with acoustic and linguistic encoders.
result Achieves CER of 26.2% on all transcription errors and 23% on medical errors specifically, improving by 12% and 15.4% respectively over a strong baseline.
Study improves CNNs for audio scene classification by restricting receptive fields and adding frequency awareness.
problem Improving CNNs for robust acoustic scene classification.
method Investigated different receptive field configurations for various CNN architectures and introduced Frequency Aware CNNs.
result Several well-performing submissions to DCASE 2019 Challenge were achieved.
FSD50K provides an open dataset of over 51k audio clips for sound event recognition.
problem Small and domain-specific sound event recognition datasets.
method Creation of an open dataset with over 51k audio clips manually labeled using 200 classes.
result FSD50K is a new open benchmark for sound event recognition research.
This paper improves sentiment classification by combining text, audio, and video data using DCCA.
problem Improving sentiment classification accuracy using multi-modal data.
method Deep Canonical Correlation Analysis (DCCA) for combining text, audio, and video embeddings.
result One-Step DCCA outperforms current state-of-the-art in multi-modal embedding learning.
This paper proposes a method for instrument classification in polyphonic music using monophonic data.
problem Instrument classification in polyphonic music from monophonic data.
method Data augmentation techniques including overlaying audio segments of the same genre, pitch, and tempo synchronization. Convolutional Neural Networks used for classification.
result An ensemble of VGG-like classifiers trained on non-augmented, pitch-synchronized, tempo-synchronized and genre-similar excerpts achieved above 80% LRAP.
Universal audio perturbations fool multiple classification models.
problem Creating audio adversarial perturbations that work across different models.
method Two methods: greedy iterative approach and novel penalty formulation.
result The penalty method produces more successful attacks with limited training data.
Enhances ASC using time- and frequency-liked CNNs and bilinear pooling.
problem Improving acoustic scene classification accuracy.
method Harmonic and percussive source separation, two-stream CNN architecture, bilinear pooling.
result Improved accuracy on DCASE 2019 sub task 1a dataset.
Machine learning detects frog calls in audio recordings with high accuracy.
problem Estimating frog presence in audio recordings from tropical environments.
method Gaussian mixture model classification of frog calls with 20 cepstral features.
result The algorithm achieved an average weighted error rate of 0.9% for nine species classification.
Acoustic sensors identify vehicles using spectral embedding.
problem Vehicle recognition from roadside audio sensors.
method Extract frequency signatures, apply spectral embedding for dimensionality reduction.
result K-nearest neighbors achieve accurate vehicle identification after dimensionality reduction.
Unified detection of isolated and overlapping audio events using CNN-RNN.
problem Detecting both isolated and overlapping audio events simultaneously.
method Multi-label multi-task framework based on CNN-RNN, with sequential losses.
result Good generalization on isolated and overlapping audio event detection datasets.
We introduce a new learned descriptor for audio signals which is efficient for event representation. The entries of the descriptor are produced by evaluating a set of regressors on the input signal. The regressors are class-specific and trained using the random regression forests framework. Given an input signal, each …
Neural network generates music scores directly from polyphonic audio.
problem Transcribing music scores directly from polyphonic audio.
method Convolutional Recurrent Neural Network (CRNN) with CTC loss function.
result Model can learn to transcribe scores directly from audio signals.
SVM classifier outperforms other models in classifying musical instruments from IRMAS data.
problem Musical instrument classification from audio signals.
method Implemented supervised (SVM) and unsupervised (Hierarchical Clustering) learning algorithms.
result SVM classifier achieved 79% accuracy on IRMAS data.
Study uses neural networks to classify musical instruments from audio samples.
problem Classifying musical instruments from audio samples.
method Trained an Artificial Neural Network on audio samples transformed to frequency domain. Analyzed features in time and frequency domains.
result Accuracy decreased when using only attack features or initial 100 Hz.