Paper proposes singing voice conversion without parallel data.
problem Convert singing voices without parallel data.
method Phonetic posterior feature, DBLSTM, vocoder.
result Successfully converts singing voices without parallel data.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “singing voice”
Semi-supervised singing voice separation using synthetic mixtures.
problem Singing voice separation with limited labeled data.
method Trains a single mapping function g on synthetic mixtures of singing and instrumental music.
result Performance comparable to fully supervised methods, better than semi-supervised alternatives.
Investigating U-Nets with various Intermediate Blocks for Spectrogram-based Singing Voice Separationeess.AS
Improved U-Nets with various intermediate blocks enhance singing voice separation.
problem Improving singing voice separation accuracy using U-Net architectures.
method Implemented and compared U-Nets with different intermediate spectrogram transformation blocks.
result A specific block type achieves state-of-the-art SDR by 0.9 dB.
WeSinger improves singing voice synthesis with data augmentation and specialized modules.
problem Improving the accuracy and naturalness of synthesized singing voices.
method Developed a multi-singer Chinese neural singing voice synthesis system with deep bi-directional LSTM, Transformer, LPCNet, and data augmentation.
result WeSinger achieves state-of-the-art performance on the Opencpop corpus.
Wave-U-Net with MHE regularization improves singing voice separation.
problem Singing voice separation from mixed music recordings.
method Wave-U-Net architecture with MHE regularization applied to 1D filters.
result Adding MHE regularization to the loss function consistently improves singing voice separation.
A new neural network separates singing voices more effectively.
problem Separating singing voices from mixed signals with high accuracy.
method MBR-FCN that processes different frequency bands with varying resolutions and filters.
result The MBR-FCN achieves better performance with fewer parameters.
Deep learning converts one singer's voice to another without supervision.
problem Unsupervised singing voice conversion.
method Deep learning network with a single CNN encoder, WaveNet decoder, and classifier.
result Natural, recognizable singing voices converted without supervision.
New neural network separates singing voices from music using cross entropy loss.
problem Separating singing voices from music accompaniment.
method Deep Convolutional Neural Network (CNN) trained with Ideal Binary Mask (IBM) and cross entropy loss.
result Proposed CNN outperforms existing systems in MIREX evaluations.
New algorithm separates vocals from music recordings efficiently.
problem Separate vocal and instrumental parts in music recordings.
method Informed group-sparse representation for linear-time singing voice separation.
result Efficacy confirmed on iKala dataset; music accompaniment follows group-sparse structure.
New algorithms separate singing voices from accompaniment using complex and quaternionic principal component pursuit.
problem Separating singing voices from instrumental accompaniment using phase information.
method Extended principal component pursuit to complex and quaternionic cases, developed new proximity operators, applied inexact augmented Lagrange multiplier algorithm.
result Phase information improves singing voice separation.
Deep clustering outperforms conventional networks in singing voice separation.
problem Challenging music source separation tasks.
method Combining deep clustering and conventional networks for better performance.
result Hybrid network outperforms both components.
Deep Autotuner corrects singing pitch without scores, using vocal and accompaniment spectral data.
problem Automatic pitch correction without musical scores for singing performances.
method Convolutional Gated Recurrent Unit (CGRU) model trained on karaoke data.
result The model predicts pitch correction from vocal and accompaniment spectral contents, making the voice sound in tune with the accompaniment.
ABIPNN improves neural network performance by processing vectors in each neuron.
problem Traditional neural networks fail to model associations among adjacent scalars.
method ABIPNN uses arbitrary bilinear products to process vector-valued neurons.
result ABIPNN outperforms conventional neural networks in multispectral image denoising and singing voice separation.
Spectrogram-Channels U-Net separates sounds by treating each channel as a source's spectrogram.
problem Sound source separation in music information retrieval.
method Adapting U-Net to treat each channel of the output as a source's spectrogram, balancing volumes between sources.
result State-of-the-art performance on singing voice and multi-instrument separation.
Efficiently generates and selects explanations for neural networks using GANs and FID.
problem Manual selection of hyper-parameters for generating interpretable neural network explanations is slow and requires qualitative evaluation.
method Proposes a novel metric using Fréchet Inception Distance (FID) and a GAN-based method for efficient search and realistic output generation.
result Successfully selects hyper-parameters leading to interpretable examples, avoiding manual evaluation.
Framework converts singer identity and vocal technique from non-parallel corpora.
problem Converts singer identity and vocal technique from non-parallel corpora.
method Uses variational autoencoders with separate encoders for singer identity and vocal technique.
result Successfully disentangles and converts singer identity and vocal technique.
Change your singer: a transfer learning generative adversarial framework for song to song conversioncs.LG
SCM-GAN converts any song to sound like a different singer.
problem Converting songs to sound like a different artist.
method Transfer learning and GANs to separate vocals and instruments, then convert and merge.
result SCM-GAN improves song conversion metrics by 35% GV and 13% MS.
Hybrid f0 extraction method for various speech modes with high accuracy.
problem Reliable f0 extraction across different speech modes.
method Ordinal regression CNN and filtering/autocorrelation for pitch estimation.
result Significantly reduces pitch detection error and generalizes to unseen modes.
Deep Autotuner corrects singing pitch using neural networks.
problem Automatic pitch correction for singing performances.
method Neural network model trained on spectrograms of singing and accompaniment.
result Neural network predicts continuous pitch shifts, allowing for improvisation and harmonization.
Deep Learning for Singing Processing: Achievements, Challenges and Impact on Singers and Listenerscs.SD
Deep learning improves singing processing tasks.
problem Lack of data and computing resources for singing processing.
method State-of-the-art deep learning techniques.
result Advances in accuracy and sound quality.
SING improves state inference in latent SDE models for better drift function estimation.
problem Intractable posterior inference in latent SDE models.
method Natural gradient variational inference.
result SING provides faster and more reliable inference in latent SDE models.
We study codimension one (transversally oriented) foliations $\fa$ on oriented closed manifolds having non-empty compact singular set $\sing(\fa)$ which is locally defined by Bott-Morse functions. We prove that if the transverse type of $\fa$ at each singular point is a center and $\fa$ has a compact leaf with fini…
Jukebox generates high-fidelity songs with singing in raw audio.
problem Generating music with singing in raw audio.
method Multi-scale VQ-VAE for compression, autoregressive Transformers for modeling.
result Generates high-fidelity and diverse songs with coherence up to multiple minutes.
Unified approach to DP problems using Gumbel distribution and variational Bayesian inference.
problem Solving classical optimal path problems in a probabilistic framework.
method Gumbel distribution and variational Bayesian inference for latent optimal paths.
result Unified approach transforms DP problems into directed acyclic graphs with Gibbs distribution.
A system is presented that segments, clusters and predicts musical audio in an unsupervised manner, adjusting the number of (timbre) clusters instantaneously to the audio input. A sequence learning algorithm adapts its structure to a dynamically changing clustering tree. The flow of the system is as follows: 1) segment…
This research investigates reliable local explanations for machine listening models.
problem Generating reliable local explanations for machine listening models.
method Investigates the sensitivity of SoundLIME explanations to input perturbations and proposes a novel method for identifying suitable content types.
result SoundLIME explanations are sensitive to the content in occluded input regions, and the average magnitude of input mel-spectrogram bins is the most suitable content type for temporal explanations.
This paper converts speech to match a face image and vice versa.
problem Matching speech to a face image and vice versa.
method Proposes a model with speech converter, face encoder/decoder, and voice encoder.
result Trained model converts speech to match a face image and generates a face image that matches the voice of input speech.
Solution for voice conversion with limited data using hierarchical seq2seq and attention models.
problem Voice conversion between speakers with limited parallel audio pairs.
method Hierarchical sequence to sequence model with attention-based decoder, trained on single speaker dataset.
result Improved voice conversion quality using mel spectrograms and wavenet vocoder.
Simplicial sets deformation retract onto transverse simplices.
problem Deformation retraction of simplicial sets.
method Showed deformation retraction of singular simplicial set onto transverse simplices.
result Singular simplicial set deformation retracts onto transverse simplices.
Convolutional network converts speaker voices without text.
problem Speaker conversion without text-based methods.
method Fully convolutional wav-to-wav network with ASR pre-training.
result Successfully converts TTS robot's voice to narrated audiobook voices.
LSTM model detects voice disorders with high accuracy.
problem Automated detection of voice disorders is challenging due to continuous audio data.
method Used Long Short Term Memory (LSTM) model for feature extraction and classification of voice disorders.
result 22% sensitivity, 97% specificity, 56% unweighted average recall.
Parallel transport in a fibre bundle with respect to smooth paths in the base space B have recently been extended to representations of the smooth singular simplicial set Sing_{smooth}(B). Inspired by these extensions,I revisit the development of a notion of `parallel' transport in the topological setting of fibrations…
A fast voice conversion method using diffusion models.
problem One-shot many-to-many voice conversion.
method Diffusion probabilistic modeling with Fast Maximum Likelihood Sampling Scheme.
result Superior quality compared to state-of-the-art approaches.
Voice-controlled e-commerce app enhances user experience for visually impaired.
problem Limited user experience for visually impaired in e-commerce applications.
method Proposes a voice-controlled e-commerce application using IBM Watson speech-to-text.
result Demonstrates enhanced usability for visually impaired users.
Study improves voice disorder detection system robust to channel effects.
problem Voice signals are sensitive to recording devices.
method Bidirectional LSTM network with domain adversarial training (DAT).
result Increased PR-AUC from 0.8448 to 0.9455 (and 0.9522 with labels).
End-to-end voice conversion without vocoder.
problem Speech conversion without vocoder.
method Transformer network for raw spectrum conversion.
result Transformer model converts real voices efficiently.
Improved voice conversion with semi-supervised learning.
problem Voice conversion with limited parallel data.
method Amortized variational inference with parallel and non-parallel utterances.
result Semi-supervised training improves voice conversion performance.
One-shot VC model converts voices without parallel data.
problem Limited VC applicability due to training data restriction.
method Disentangles speaker and content representations with instance normalization.
result Model converts voices from unseen speakers with high similarity.
AUTOVC converts voices without parallel data, achieving state-of-the-art results.
problem Non-parallel many-to-many voice conversion and zero-shot voice conversion.
method Only an autoencoder with a carefully designed bottleneck is used, training on a self-reconstruction loss.
result AUTOVC achieves state-of-the-art results in many-to-many voice conversion with non-parallel data and performs zero-shot voice conversion.
SING generates musical notes from instruments in real-time.
problem Efficiently generating high-quality audio from MIDI data.
method Frame-by-frame waveform generation with a single decoder, using a new loss function.
result SING produces significantly improved audio quality compared to state-of-the-art models, with 32x faster training and 2,500x faster inference.
Wave-U-Net improves audio source separation by modeling phase information.
problem Fixed spectral transformations and high sampling rates limit audio source separation performance.
method Wave-U-Net adapts U-Net to time-domain, using repeated resampling to capture different time scales.
result Wave-U-Net achieves comparable performance to spectrogram-based U-Net on singing voice separation.
New method separates multiple voices in mixed audio.
problem Separating multiple simultaneous speakers in audio.
method Gated neural networks trained at multiple steps, selecting actual number of speakers.
result Outperforms current state of the art for more than two speakers.
We prove the factoriality of the following nodal threefolds: a complete intersection of hypersurfaces and of degree and respectively, where is smooth, , ; a double cover of a smooth hypersurface $F\subset\mathbb{P}^{…
Study improves low-quality speech data for voice cloning.
problem Feasibility of training spoofing systems with low-quality data.
method Developed a GAN-based speech enhancement system, trained TTS and voice conversion models.
result Significant improvement in SNR and perceptual cleanliness of low-quality data.
The paper uses neural networks to convert one speaker's voice to another.
problem Identifying speakers uniquely based on their voice.
method Uses convolutional neural networks to manipulate pitch and timbre.
result Preliminary results show encouraging voice conversion.
Privacy-preserving method protects user speech data from cloud services.
problem Privacy compromise in cloud-based speech analysis.
method Collects and sanitizes speech data before sharing, using transformation functions and voice conversion.
result Identification of sensitive emotional state reduced by ~96%.
A new algorithm for training generative models using Sinkhorn divergence.
problem Training generative adversarial networks (GANs).
method Sinkhorn Natural Gradient (SiNG) algorithm for steepest descent on probability space.
result Explicit expression and efficient evaluation of the Sinkhorn information matrix (SIM).
Improved autoencoder for F0-consistent voice conversion.
problem Non-parallel many-to-many voice conversion with prosodic information leakage.
method Conditional autoencoder with information-constraining bottlenecks.
result Controlled F0 contour and improved speech quality.