New algorithm separates audio sources better using alpha-stable distributions.
problem Improving audio source separation using complex distributions.
method Estimating mixtures of alpha-stable distributions using characteristic function matching.
result Better separation performance than Gaussian-based methods.
New method separates multiple voices in mixed audio.
problem Separating multiple simultaneous speakers in audio.
method Gated neural networks trained at multiple steps, selecting actual number of speakers.
result Outperforms current state of the art for more than two speakers.
New NMF model for better audio source separation.
problem Blind audio source separation from single-microphone recordings.
method Minimum-volume beta-divergence NMF with multiplicative updates.
result Model identifies and interprets sources more effectively.
The paper analyzes how speech enhancement and recognition can be improved in noisy environments.
problem Improving speech recognition in multi-talker scenarios with limited resources.
method Developed and trained two LSTM-based models for speech enhancement and phone recognition, then studied their joint optimization.
result Joint optimization of speech enhancement and recognition leads to a significant reduction in Phone Error Rate (PER).
Data augmentation improves keyword spotting accuracy in noisy conditions.
problem Maintaining low false reject rates in far-field KWS with playback interference.
method Artificially corrupted training data with mixed music and TV audio.
result 30-45% reduction in false reject rates under audio playback.
Novel unsupervised audio source separation using generative priors.
problem Challenges of supervised methods in audio source separation.
method Generative priors trained on individual sources using projected gradient descent optimization.
result Effective recovery of constituent sources with good-quality estimates.
New method separates mixed distributions without requiring samples of each source.
problem Separating mixed distributions in machine learning and signal processing.
method Neural Egg Separation method iteratively learns to separate known from unknown distributions.
result Neural Egg Separation outperforms current methods in audio and image separation tasks.
This paper proposes a method for instrument classification in polyphonic music using monophonic data.
problem Instrument classification in polyphonic music from monophonic data.
method Data augmentation techniques including overlaying audio segments of the same genre, pitch, and tempo synchronization. Convolutional Neural Networks used for classification.
result An ensemble of VGG-like classifiers trained on non-augmented, pitch-synchronized, tempo-synchronized and genre-similar excerpts achieved above 80% LRAP.
Proposes a self-supervised method for generating spatial audio from monaural audio and video.
problem Generating spatial audio from monaural audio and video recordings is challenging and expensive.
method Uses a self-supervised network with an auxiliary classifier to classify video channels and generate spatial audio.
result The proposed method effectively generates spatial audio from monaural audio and video.
Deep audio prior uses neural networks to solve audio problems without data.
problem Challenging audio problems like source separation, editing, and synthesis.
method Randomly-initialized neural network with carefully designed audio prior.
result Superior audio results on Universal-150 benchmark dataset.
Zero-shot audio classification using class label embeddings.
problem Classifying audio without labeled data.
method Bilinear model with audio feature embeddings and class label embeddings.
result Achieved accuracy up to 39.7% for natural audio categories.
A new autoencoder speeds up audio style transfer.
problem Efficiently generating stylized audio from content audio.
method Autoencoder architecture for real-time audio style transfer.
result Single forward pass for stylized audio generation.
Improved audio source separation for underdetermined conditions.
problem Underdetermined source separation challenges for non-NMF-compliant sound sources.
method Generalized Multichannel Variational Autoencoder (GMVAE) that extends Conditional VAE for underdetermined cases.
result The GMVAE method outperformed MNMF in underdetermined source separation tasks.
The paper proposes a method to predict audio ad quality using acoustic features.
problem Improving user experience in online music streaming services by ensuring high quality audio advertisements.
method The paper proposes predicting audio ad quality using acoustic features and a proxy metric called Long Click Rate (LCR). A deep learning model is also introduced.
result The proposed deep learning model outperforms other models trained on hand-crafted features for audio ad quality prediction.
Method learns audio embeddings with contextualized tags.
problem Align audio and tags for cross-modal tasks.
method Audio autoencoder, word embeddings, multi-head self-attention, contrastive loss.
result Multi-head self-attention improves audio representations.
Study improves radio show segmentation using audio embeddings.
problem Automated segmentation of radio shows.
method Created audio embeddings from multi-class classification tasks on different datasets, evaluated performance against text-only baseline.
result Audio embeddings from non-speech sound event classification significantly outperformed text-only baseline by 32.3% in F1-measure.
While graphical models for continuous data (Gaussian graphical models) and discrete data (Ising models) have been extensively studied, there is little work on graphical models linking both continuous and discrete variables (mixed data), which are common in many scientific applications. We propose a novel graphical mode…
Generative model improves audio synthesis from TF features.
problem Challenges in generating high-quality audio from TF features.
method Used a GAN to generate invertible TF features from short-time Fourier transforms.
result Generated TF features from GAN outperformed direct waveform generation.
Task describes tagging audio clips from 41 categories.
problem Tagging audio clips from diverse categories.
method Baseline system using AudioSet labels.
result Demonstrates feasibility of general-purpose audio tagging.
We consider the problem of speaker diarization, the problem of segmenting an audio recording of a meeting into temporal segments corresponding to individual speakers. The problem is rendered particularly difficult by the fact that we are not allowed to assume knowledge of the number of people participating in the meeti…
AVDCNN combines audio and visual data for better speech enhancement.
problem Improving speech quality by reducing noise in audio signals.
method Proposes an AVDCNN model that integrates audio and visual streams into a unified deep CNN network for end-to-end training.
result AVDCNN outperforms audio-only and conventional SE methods in enhancing speech quality.
Adversarial attacks on spectrograms can fool audio classifiers trained on waveforms.
problem Susceptibility of audio classifiers to adversarial attacks on spectrograms.
method Applying adversarial attacks to spectrograms and reconstructing audio waveforms.
result Perturbed spectrograms can fool 2D CNNs and 1D CNNs trained on audio waveforms.
Study improves animal audio classification using data augmentation.
problem Improving automated animal audio classification accuracy.
method Exploits different data augmentation techniques for training CNNs.
result Best recognition rates on animal audio classification datasets.
MicAugment transfers audio style from few seconds of input to match target conditions.
problem Audio model robustness to diverse acquisition conditions.
method Identifies and applies transformations learned from target audio to input audio.
result MicAugment significantly improves model robustness in downstream tasks.
Detects audio adversarial examples using anomalous pattern detection.
problem Identifies adversarial audio attacks in deep neural networks.
method Applies anomalous pattern detection in activation space of audio models.
result Can detect adversarial examples with up to 0.98 AUC, no degradation on benign samples.
Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent success of convolutional neural networks (CNNs) in SE, we propose an audio-visual de…
Unified model for audio control and style transfer.
problem Explicit control and style transfer in music generation.
method Diffusion autoencoders for semantic feature extraction, disentanglement using adversarial criterion.
result Model generates audio matching timbre targets with specified structure.
Transformer model estimates keywords for better audio captioning.
problem Indeterminacy in word selection for audio events/scenes.
method Transformer-based model with keyword estimation.
result Achieved state-of-the-art performance in AAC.
Audio fingerprinting, also named as audio hashing, has been well-known as a powerful technique to perform audio identification and synchronization. It basically involves two major steps: fingerprint (voice pattern) design and matching search. While the first step concerns the derivation of a robust and compact audio si…
GANSynth uses GANs to efficiently synthesize high-fidelity audio.
problem Efficient and high-fidelity audio synthesis is challenging.
method Model log magnitudes and instantaneous frequencies with GANs.
result GANSynth outperforms WaveNet on automated and human evaluation metrics.
LumièreNet creates lecture videos from audio narration.
problem Creating high-quality lecture videos from audio narration.
method Modular deep-learning architecture that learns from audio to video.
result Synthesizes high-quality lecture videos from any length of audio.
Review of deep learning techniques for audio signal processing.
problem Improving audio signal processing using deep learning.
method Analysis of various deep learning models and techniques.
result Advancements in speech, music, and environmental sound processing.
AV-CPL uses continuous pseudo-labels for AVSR combining labeled and unlabeled data.
problem Improving AVSR performance with labeled and unlabeled data.
method Semi-supervised method using continuous pseudo-labels generated by the same AVSR model.
result Significant improvements in VSR performance on LRS3 dataset.
MelNet generates high-fidelity audio with long-range structure.
problem Capturing long-range dependencies in audio waveforms.
method Generative model in frequency domain, leveraging spectrograms.
result Improves audio generation in various tasks.
HEAR benchmark evaluates audio representations for diverse tasks.
problem Developing a general-purpose audio representation for various tasks.
method Evaluated 29 models across 19 tasks using 16 datasets.
result No single audio representation performs holistically.
Proposes COALA method for learning audio representations aligned with tags.
problem Lack of annotated data for high-performance audio representation learning.
method Aligns latent representations of audio and tags using a contrastive loss.
result Audio embedding model captures both acoustic and semantic characteristics.
Combines symbolic and raw audio models for structured, realistic-sound music generation.
problem Lack of long-range dependencies in raw audio models and unstructured music.
method Uses a Long Short Term Memory network for melodic structure and WaveNet for raw audio generation with symbolic conditioning.
result Creates structured, realistic-sounding compositions using both symbolic and raw audio models.
Paper introduces a noisy-labeled audio tagging challenge.
problem Acoustic mismatch and noisy labels in audio tagging.
method Large dataset with minimal supervision, convolutional neural network baseline.
result Demonstrates effectiveness of minimal supervision in noisy conditions.
Efficient sparse GP model improves audio source separation.
problem Sparse Gaussian Process (GP) inference is computationally expensive for long audio frames.
method Used GP regression, spectral mixture kernels, and variational sparse GPs.
result Proposed method outperforms LD-PSDTF, KL-NMF, and IS-NMF.
Machine learning identifies species by voice in remote areas.
problem Continuous monitoring of endangered species in remote areas.
method Training machine learning models on audio data to recognize species.
result Machine learning can accurately classify and recognize various species sounds.
A new method for audio denoising using deep neural networks.
problem Improving audio quality by removing background noise.
method Combines time and time-frequency domain processing; trains a deep neural network to fit the signal.
result The method effectively disentangles clean audio from noisy signals.
Capsule networks improve audio classification performance.
problem Improving audio classification accuracy.
method Dynamic routing-by-agreement mechanism for capsule networks.
result Significant improvements in performance compared to baseline models.
Mic2Mic reduces microphone variability for speech systems.
problem Microphone variability impacts speech system accuracy.
method Cycle-consistent GANs for learning microphone variability reduction.
result Mic2Mic recovers 66% to 89% of lost accuracy due to microphone variability.
Neural networks and audio processing improve speaker clustering accuracy.
problem Differentiating speakers in audio recordings.
method Neural networks (CNN) followed by clustering and audio processing.
result Reach similar accuracy to state-of-the-art methods.
FSD50K provides an open dataset of over 51k audio clips for sound event recognition.
problem Small and domain-specific sound event recognition datasets.
method Creation of an open dataset with over 51k audio clips manually labeled using 200 classes.
result FSD50K is a new open benchmark for sound event recognition research.
Paper proposes a robust audio classification method against adversarial attacks.
problem Adversarial attacks can fool machine learning models into making incorrect predictions.
method Proposes a novel SVM-based approach using DWT and SURF features.
result The proposed method provides a good balance between accuracy and resilience against adversarial attacks.
Nonnegative matrix factorization (NMF) is now a common tool for audio source separation. When learning NMF on large audio databases, one major drawback is that the complexity in time is O(FKN) when updating the dictionary (where (F;N) is the dimension of the input power spectrograms, and K the number of basis spectra),…
New method clusters unknown music artists using audio metrics.
problem Disambiguating large catalogs of unknown artists.
method Metric learning from audio data with negative sampling.
result Our method outperforms a classifier-based approach when audio data is available.