Improved music source separation using spectrogram feature loss.
problem Music source separation quality improvement.
method Added a high-level feature loss term from spectrograms using a VGG net to a deep learning model.
result Improvement in separation quality of drums and vocals from songs.
End-to-end models perform better with learned log-scaled mel-spectrogram features.
problem End-to-end neural network models struggle with performance compared to models using high-level data representations.
method Trained first layers of a CNN model on log-scaled mel-spectrogram transformation and then used these learned features to initialize an end-to-end CNN classifier.
result Convergence and performance on ESC-50 dataset are similar to a model trained on pre-processed log-scaled mel-spectrogram features.
CycleGAN-VC3 improves CycleGAN-VCs for mel-spectrogram conversion.
problem Ambiguity in CycleGAN-VC/VC2 effectiveness for mel-spectrogram conversion.
method Proposes CycleGAN-VC3 with time-frequency adaptive normalization (TFAN).
result CycleGAN-VC3 outperforms or matches CycleGAN-VC2 for mel-spectrogram conversion.
Deep learning detects atrial fibrillation with high accuracy.
problem Detecting atrial fibrillation in ECG signals.
method Extracted deep features from spectrograms using convolutional networks.
result Convolutional network achieved 93.16% classification accuracy.
Paper presents a deep learning framework for classifying respiratory anomalies and lung diseases from sound recordings.
problem Classifying respiratory anomalies and lung diseases from respiratory sound recordings.
method The framework uses front-end feature extraction to transform sound into spectrograms, and a deep learning network to classify these features.
result The proposed deep learning system outperforms current state-of-the-art methods on the ICBHI benchmark dataset.
Paper proposes a novel unsupervised feature learning approach for environmental sound classification.
problem Classifying environmental sounds without labeled data.
method Cycle-consistent GAN for high-level data augmentation, unsupervised feature learning, codebook construction.
result Improves classification rate by 3.51% to 14.34% compared to state-of-the-art classifiers.
ResNet with Focal Loss improves speech emotion recognition.
problem Speech emotion recognition using plain text features is insufficient.
method Residual Convolutional Neural Network (ResNet) trained with Focal Loss.
result Focal Loss enhances model's focus on hard examples.
SRMD uses random features for efficient time-frequency analysis.
problem Efficiently analyzing time-series data with low computational cost.
method Sparse Random Mode Decomposition (SRMD) constructs a sparse approximation to the spectrogram.
result SRMD outperforms other methods in signal representation, outlier removal, and mode decomposition.
iSTFTNet speeds up mel-spectrogram vocoders without sacrificing quality.
problem Efficiently converting mel-spectrograms to speech with minimal computation.
method Replaces convolutional layers with iSTFT after frequency dimension reduction.
result Significant reduction in computational cost with comparable quality.
Paper enhances speech by estimating RI spectrograms and optimizing multiple metrics.
problem Difficulty in phase estimation and lack of multi-metric optimization in speech enhancement.
method Proposes a CNN model for RI spectrogram estimation and multi-metrics learning.
result Unified objective function improves speech enhancement metrics.
Adversarial attacks on spectrograms can fool audio classifiers trained on waveforms.
problem Susceptibility of audio classifiers to adversarial attacks on spectrograms.
method Applying adversarial attacks to spectrograms and reconstructing audio waveforms.
result Perturbed spectrograms can fool 2D CNNs and 1D CNNs trained on audio waveforms.
A deep learning framework learns wavelet packet transforms for efficient feature extraction.
problem Efficiently extracting meaningful time-frequency features from high-frequency signals.
method Learnable wavelet packet transforms using deep learning.
result Improved spectral leakage and enhanced anomaly detection performance.
Spectrogram-Channels U-Net separates sounds by treating each channel as a source's spectrogram.
problem Sound source separation in music information retrieval.
method Adapting U-Net to treat each channel of the output as a source's spectrogram, balancing volumes between sources.
result State-of-the-art performance on singing voice and multi-instrument separation.
AaSP improves audio self-supervised learning by addressing aliasing issues.
problem Alias issues in audio spectrogram transformers.
method AaSP combines aliasing-aware patch representation, teacher-student masked modeling, cross-attention predictor, and contrastive regularization.
result AaSP learns more stable representations that integrate high-frequency cues.
SpecGrad improves neural vocoder sound quality by adapting diffusion noise to log-mel spectrogram.
problem Improving neural vocoder sound quality, especially in high-frequency bands.
method Adapting the diffusion noise distribution to the conditioning log-mel spectrogram through time-varying filtering.
result SpecGrad generates higher-fidelity speech waveform than conventional DDPM-based neural vocoders.
Study compares new audio representation methods for limited data music retrieval.
problem Improving machine learning for audio data with limited training data.
method Investigated mel-spectrogram and Mel scattering representations, and augmented target loss function.
result All proposed methods outperform standard mel-spectrogram when using limited data.
Improves speech separation by integrating time and frequency domains.
problem Speech separation using deep learning techniques.
method Proposes a framework that combines time and frequency domain features, using an embedding network and clustering.
result Obtained state-of-the-art results on WSJ0-2mix dataset.
New music dataset for machine learning research.
problem No specific problem stated; focuses on dataset creation.
method Defined a large-scale music dataset and evaluated machine learning architectures.
result End-to-end models learned frequency selective filters.
Improved speech emotion recognition using pitch-synchronous single frequency filtering spectrogram.
problem Uncertainty principles in STFT spectrogram limit time and frequency resolutions.
method Modified SFF spectrogram by averaging amplitudes between GCI locations, named pitch-synchronous SFF spectrogram.
result Improved SER accuracy (63.95% to 70.4%) on IEMOCAP dataset.
Study improves voice conversion model with Mel-spectrogram augmentation.
problem Insufficient speech pairs data for training sequence-to-sequence voice conversion models.
method Experimented with Mel-spectrogram augmentation using SpecAugment policies and proposed new augmentation policies.
result Time axis warping policies showed better performance in training the voice conversion model.
Generative adversarial network improves signal reconstruction from magnitude spectrograms.
problem Reconstructing a time-domain signal from a magnitude spectrogram.
method Deep neural network and generative adversarial network approach.
result Our method reconstructs signals faster with higher quality than the Griffin-Lim method.
MCLNN improves sound classification with fewer parameters.
problem Improving sound classification accuracy with fewer parameters.
method MCLNN uses a binary mask to induce sparseness in frequency bands, automating feature exploration.
result MCLNN achieves competitive results on Urbansound8k with 12% fewer parameters.
VoiceFilter separates target speaker from multi-speaker signals.
problem Speech recognition in multi-speaker environments.
method Speaker recognition network and spectrogram masking network trained together.
result Significant reduction in speech recognition WER on multi-speaker signals.
Paper proposes MVAE for semi-blind source separation using CVAE.
problem Semi-blind source separation in multichannel mixtures.
method Multichannel variational autoencoder (MVAE) with conditional VAE (CVAE).
result MVAE outperforms baseline method in separation performance.
Improved U-Nets with various intermediate blocks enhance singing voice separation.
problem Improving singing voice separation accuracy using U-Net architectures.
method Implemented and compared U-Nets with different intermediate spectrogram transformation blocks.
result A specific block type achieves state-of-the-art SDR by 0.9 dB.
Deep learning models predict hit songs from audio features.
problem Predicting hit songs from audio features.
method Used convolutional neural networks and JYnet models for hit song prediction.
result Deep learning models are more accurate than shallow models in predicting song popularity.
Novel CSK kernel improves GP model generalization for non-stationary patterns.
problem Improving generalization of Gaussian process models for non-stationary data.
method Introduced convolutional spectral kernel (CSK) derived from convolution of imaginary radial basis functions, using Fourier transform for interpretation.
result CSK improves GP model generalization on spatiotemporal datasets.
Paper tackles speaker verification by removing reverberation using deep LSTM networks.
problem Improving speaker verification accuracy in reverberant environments.
method Dual-label deep LSTM networks trained to map reverberant to clean speech features.
result Evaluates performance using EERs, showing improved accuracy.
A new neural network separates singing voices more effectively.
problem Separating singing voices from mixed signals with high accuracy.
method MBR-FCN that processes different frequency bands with varying resolutions and filters.
result The MBR-FCN achieves better performance with fewer parameters.
A new RBM model handles both linear and log-amplitude spectrograms.
problem Handling amplitude spectra with existing models.
method Proposed gamma-Bernoulli RBM that uses gamma distribution.
result The model can naturally handle positive numbers and log-amplitude spectrograms.
Optimal transport improves speech BSS by better aligning spectrogram frequencies.
problem Speech BSS with improved frequency alignment.
method Developed optimal transport NMF for supervised speech BSS.
result Optimal transport NMF leads to better perceptual results than Euclidean NMF.
Novel fusion of autoencoders predicts sleepiness from speech.
problem Predicting sleepiness from speech recordings.
method Attention-based and recurrent sequence to sequence autoencoders for unsupervised representation learning.
result Fusion of autoencoders' representations achieves higher correlation with sleepiness scales.
Conditional GANs enhance speech in noisy conditions.
problem Improving speech system performance in noisy environments.
method Conditional Generative Adversarial Networks (cGANs) trained on spectrograms.
result cGAN method outperforms classical SE algorithms and is comparable to deep neural networks.
Speech emotion recognition system using features and text.
problem Improving accuracy in emotion recognition from speech.
method Used speech features (Spectrogram, MFCC) and text, trained Deep Neural Networks.
result Combined MFCC-Text CNN model achieved highest accuracy.
Deep model generates high-quality speech from spectrograms.
problem Speech reconstruction from spectrograms.
method Deep generative model with Gaussian and von Mises distributions for magnitude and phase, variational autoencoder framework.
result Generated speech has high perceptual quality and intelligibility.
VPFD uses vocoder features for adversarial training in VC.
problem Adversarial training on waveform data is time-consuming and memory-intensive.
method VPFD employs vocoder features for adversarial training.
result VPFD achieves VC performance comparable to waveform discriminators with reduced training time and memory.
Paper proposes a time-frequency analysis method for blind modulation classification in MIMO systems.
problem Blind modulation classification in MIMO systems with overlapping signals and unknown channel parameters.
method Time-frequency analysis using windowed short-time Fourier transform, conversion to RGB spectrogram images, convolutional neural network for classification, decision fusion.
result Proposed scheme achieves high classification accuracy at different SNRs, outperforming existing methods.
WaveGlow generates high-quality speech from spectrograms.
problem Speech synthesis quality and efficiency.
method WaveGlow combines Glow and WaveNet insights, using a single network and cost function for efficient, high-quality audio synthesis.
result WaveGlow produces audio samples at over 500 kHz, matching WaveNet quality.
System separates sounds from mixtures without ground truth info.
problem Sound separation from multi-channel mixtures without labeled data.
method Deep clustering on multi-channel mixtures, projecting bins to spatially correlated clusters.
result Performance matches ground truth separation using only multi-channel mixtures.
Solution for voice conversion with limited data using hierarchical seq2seq and attention models.
problem Voice conversion between speakers with limited parallel audio pairs.
method Hierarchical sequence to sequence model with attention-based decoder, trained on single speaker dataset.
result Improved voice conversion quality using mel spectrograms and wavenet vocoder.
Graph neural networks improve music genre classification on audio datasets.
problem Difficulty in applying deep learning on spectrograms due to lack of quality data and augmentation.
method Combination of CNN and Graph Neural Networks (GNN) with Siamese Neural Networks.
result Achieved state-of-the-art results on GTZAN and AudioSet datasets.
X-DC improves speech separation by making DNNs more interpretable.
problem Black-box nature of DNNs in speech separation tasks.
method Introduces X-DC, a DNN architecture that interprets as spectrogram template fitting followed by Wiener filtering.
result X-DC achieves comparable speech separation performance to DC but with enhanced interpretability.
MaskCycleGAN-VC improves voice conversion without parallel data.
problem Limited ability to convert mel-spectrogram data without parallel data.
method Integrates a novel auxiliary task called filling in frames (FIF) to learn time-frequency structures.
result MaskCycleGAN-VC outperforms existing methods with similar model size.
CLCNet improves noise reduction in hearing aids with deep learning.
problem Noise reduction in hearing aids is challenging due to real-time and frequency resolution constraints.
method Proposes CLCNet, a deep learning framework based on complex linear coding.
result CLCNet outperforms traditional methods in noisy environments.
Paper proposes a CNN for speech emotion recognition using center loss and reconstruction.
problem Speech emotion recognition (SER) in audio signals.
method Convolutional Neural Network (CNN) with center loss and reconstruction as regularizers.
result Proposed method achieves highly discriminative features for SER.
iSTFTNet2 improves iSTFTNet's speed and lightness with 1D-2D CNN.
problem Efficiently synthesizing high-fidelity speech.
method Improved iSTFTNet using 1D-2D CNNs for temporal and spectrogram structures.
result iSTFTNet2 is faster and more lightweight with comparable speech quality.
RawNet synthesizes speech without relying on human-designed features.
problem Speech synthesis models rely heavily on human-designed spectral features.
method End-to-end neural vocoder using auto-encoder structure, learning features and audio recovery directly from raw waveform.
result RawNet achieves better speech quality with a simplified model architecture and faster inference speed.
Paper proposes a robust audio classification method against adversarial attacks.
problem Adversarial attacks can fool machine learning models into making incorrect predictions.
method Proposes a novel SVM-based approach using DWT and SURF features.
result The proposed method provides a good balance between accuracy and resilience against adversarial attacks.