LSTM model detects voice disorders with high accuracy.
problem Automated detection of voice disorders is challenging due to continuous audio data.
method Used Long Short Term Memory (LSTM) model for feature extraction and classification of voice disorders.
result 22% sensitivity, 97% specificity, 56% unweighted average recall.
Cheap model diagnoses vocal disorders accurately.
problem Diagnosing vocal disorders without expensive equipment.
method Used Mel-Cepstrum vectors and Support Vector Machine.
result Accurately diagnosed three vocal disorders.
Many people are suffering from voice disorders, which can adversely affect the quality of their lives. In response, some researchers have proposed algorithms for automatic assessment of these disorders, based on voice signals. However, these signals can be sensitive to the recording devices. Indeed, the channel effect …
Paper proposes singing voice conversion without parallel data.
problem Convert singing voices without parallel data.
method Phonetic posterior feature, DBLSTM, vocoder.
result Successfully converts singing voices without parallel data.
This paper converts speech to match a face image and vice versa.
problem Matching speech to a face image and vice versa.
method Proposes a model with speech converter, face encoder/decoder, and voice encoder.
result Trained model converts speech to match a face image and generates a face image that matches the voice of input speech.
Solution for voice conversion with limited data using hierarchical seq2seq and attention models.
problem Voice conversion between speakers with limited parallel audio pairs.
method Hierarchical sequence to sequence model with attention-based decoder, trained on single speaker dataset.
result Improved voice conversion quality using mel spectrograms and wavenet vocoder.
Convolutional network converts speaker voices without text.
problem Speaker conversion without text-based methods.
method Fully convolutional wav-to-wav network with ASR pre-training.
result Successfully converts TTS robot's voice to narrated audiobook voices.
Deep learning converts one singer's voice to another without supervision.
problem Unsupervised singing voice conversion.
method Deep learning network with a single CNN encoder, WaveNet decoder, and classifier.
result Natural, recognizable singing voices converted without supervision.
A fast voice conversion method using diffusion models.
problem One-shot many-to-many voice conversion.
method Diffusion probabilistic modeling with Fast Maximum Likelihood Sampling Scheme.
result Superior quality compared to state-of-the-art approaches.
End-to-end voice conversion without vocoder.
problem Speech conversion without vocoder.
method Transformer network for raw spectrum conversion.
result Transformer model converts real voices efficiently.
Improved voice conversion with semi-supervised learning.
problem Voice conversion with limited parallel data.
method Amortized variational inference with parallel and non-parallel utterances.
result Semi-supervised training improves voice conversion performance.
One-shot VC model converts voices without parallel data.
problem Limited VC applicability due to training data restriction.
method Disentangles speaker and content representations with instance normalization.
result Model converts voices from unseen speakers with high similarity.
AUTOVC converts voices without parallel data, achieving state-of-the-art results.
problem Non-parallel many-to-many voice conversion and zero-shot voice conversion.
method Only an autoencoder with a carefully designed bottleneck is used, training on a self-reconstruction loss.
result AUTOVC achieves state-of-the-art results in many-to-many voice conversion with non-parallel data and performs zero-shot voice conversion.
Semi-supervised singing voice separation using synthetic mixtures.
problem Singing voice separation with limited labeled data.
method Trains a single mapping function g on synthetic mixtures of singing and instrumental music.
result Performance comparable to fully supervised methods, better than semi-supervised alternatives.
New method separates multiple voices in mixed audio.
problem Separating multiple simultaneous speakers in audio.
method Gated neural networks trained at multiple steps, selecting actual number of speakers.
result Outperforms current state of the art for more than two speakers.
A new neural network separates singing voices more effectively.
problem Separating singing voices from mixed signals with high accuracy.
method MBR-FCN that processes different frequency bands with varying resolutions and filters.
result The MBR-FCN achieves better performance with fewer parameters.
Improved U-Nets with various intermediate blocks enhance singing voice separation.
problem Improving singing voice separation accuracy using U-Net architectures.
method Implemented and compared U-Nets with different intermediate spectrogram transformation blocks.
result A specific block type achieves state-of-the-art SDR by 0.9 dB.
Privacy-preserving method protects user speech data from cloud services.
problem Privacy compromise in cloud-based speech analysis.
method Collects and sanitizes speech data before sharing, using transformation functions and voice conversion.
result Identification of sensitive emotional state reduced by ~96%.
Wave-U-Net with MHE regularization improves singing voice separation.
problem Singing voice separation from mixed music recordings.
method Wave-U-Net architecture with MHE regularization applied to 1D filters.
result Adding MHE regularization to the loss function consistently improves singing voice separation.
Automatic voice-controlled systems have changed the way humans interact with a computer. Voice or speech recognition systems allow a user to make a hands-free request to the computer, which in turn processes the request and serves the user with appropriate responses. After years of research and developments in machine …
Improved autoencoder for F0-consistent voice conversion.
problem Non-parallel many-to-many voice conversion with prosodic information leakage.
method Conditional autoencoder with information-constraining bottlenecks.
result Controlled F0 contour and improved speech quality.
Proposes a new voice conversion model that preserves pitch patterns.
problem Preserving pitch patterns while changing speaker identity.
method Variational-autoencoder-based model with an auxiliary network.
result Ensures the conversion result correctly reflects specified F0/timbre information.
Blow converts non-parallel raw audio voices efficiently.
problem Voice conversion with non-parallel data.
method Single-scale normalizing flow with hypernetwork conditioning.
result Blow outperforms existing flow-based architectures in voice conversion.
Study uses interviews to automatically detect BD and BPD with good accuracy.
problem Challenges in distinguishing BD and BPD from clinical interviews.
method Developed a multi-modal dataset and used a linear classifier with selected features from interviews.
result Different sets of features characterize BD and BPD, providing insights into their differences.
Improved speech recognition for voice assistants by analyzing speech data.
problem Reducing false triggers in speech-enabled assistants.
method Post-processing LVCSR hypothesis lattice with a Bidirectional Lattice Recurrent Neural Network (LatticeRNN).
result LatticeRNN significantly improves detection accuracy over traditional methods.
WeSinger improves singing voice synthesis with data augmentation and specialized modules.
problem Improving the accuracy and naturalness of synthesized singing voices.
method Developed a multi-singer Chinese neural singing voice synthesis system with deep bi-directional LSTM, Transformer, LPCNet, and data augmentation.
result WeSinger achieves state-of-the-art performance on the Opencpop corpus.
This paper introduces a novel recurrent model for music composition that is tailored to the structure of polyphonic music. We propose an efficient new conditional probabilistic factorization of musical scores, viewing a score as a collection of concurrent, coupled sequences: i.e. voices. To model the conditional distri…
Many-to-Many VTN improves voice conversion across multiple speakers.
problem Voice conversion across multiple speakers.
method Sequence-to-sequence learning framework with many-to-many VTN architecture.
result Improved sound quality and speaker similarity compared to baseline methods.
Mobile technologies offer opportunities for higher resolution monitoring of health conditions. This opportunity seems of particular promise in psychiatry where diagnoses often rely on retrospective and subjective recall of mood states. However, getting actionable information from these rather complex time series is cha…
Study improves voice conversion model with Mel-spectrogram augmentation.
problem Insufficient speech pairs data for training sequence-to-sequence voice conversion models.
method Experimented with Mel-spectrogram augmentation using SpecAugment policies and proposed new augmentation policies.
result Time axis warping policies showed better performance in training the voice conversion model.
ED-Filter improves eating disorder classification on Twitter.
problem High dimensionality and extensive feature sets in Twitter data for ED classification.
method Informed branch and bound search technique with hybrid greedy-based deep learning.
result Significant improvements in classification accuracy and efficiency.
Study on a pinning model with random walk increments, showing convergence to a critical disordered pinning measure.
problem Understanding the critical behavior of a disordered pinning model.
method Analyzing a disordered pinning model induced by a random walk with specific moment conditions, showing convergence to a limiting measure.
result Convergence of point-to-point partition functions to the critical disordered pinning measure in the critical window.
Thanks to the growing availability of spoofing databases and rapid advances in using them, systems for detecting voice spoofing attacks are becoming more and more capable, and error rates close to zero are being reached for the ASVspoof2015 database. However, speech synthesis and voice conversion paradigms that are not…
New minimal surfaces show stacking disorder in periodic structures.
problem Reproducing experimental twinning defects in periodic minimal surfaces.
method Constructing non-periodic minimal surfaces that lift to disordered stacking in 3D.
result Reproduced twinning defects in periodic minimal surfaces as stacking disorder.
New neural network separates singing voices from music using cross entropy loss.
problem Separating singing voices from music accompaniment.
method Deep Convolutional Neural Network (CNN) trained with Ideal Binary Mask (IBM) and cross entropy loss.
result Proposed CNN outperforms existing systems in MIREX evaluations.
Dr.VOT measures both positive and negative VOTs accurately in natural speech.
problem Accurate measurement of VOT in natural speech.
method Deep-learning model based on RNNs for structured prediction.
result Dr.VOT improves over state-of-the-art performance on VOT estimation.
Personal VAD detects target speaker voice activity efficiently.
problem Efficiently detect target speaker voice activity for reduced computational cost and battery usage.
method Trains a neural network conditioned on speaker embedding or verification score, outputs probabilities for three speech classes.
result Trained model with 130K parameters outperforms combined standard VAD and speaker recognition networks.
In this paper, we propose a classification based glottal closure instants (GCI) detection from pathological acoustic speech signal, which finds many applications in vocal disorder analysis. Till date, GCI for pathological disorder is extracted from laryngeal (glottal source) signal recorded from Electroglottograph, a d…
Deep learning predicts mental disorders from audio and text samples.
problem Predicting mental disorders from speech samples.
method Multimodal deep learning structure using various pre-trained models for audio and text embeddings, transfer learning, and auxiliary corpora.
result Acceptable accuracy in predicting mental disorders through multimodal analysis.
Paper presents a method to diagnose schizophrenia using fMRI dynamics from healthy controls.
problem Early diagnosis of mental disorders like schizophrenia using fMRI.
method Self-supervised pre-training on fMRI dynamics of healthy controls for transfer learning.
result Effective classification of schizophrenia using fMRI dynamics with small datasets.
A-StarGAN improves nonparallel voice conversion speed and realism.
problem Nonparallel voice conversion without parallel data.
method Augmented classifier StarGAN (A-StarGAN) for nonparallel voice conversion.
result A-StarGAN generates realistic-sounding speech quickly and efficiently.
Transformer models show distinct spectral fingerprints under voice changes.
problem Detecting architectural biases in transformer models.
method Spectral analysis of attention-induced token graphs.
result Clear architectural signatures in model fingerprints correlate with language-specific behavior.
Study compares neural and statistical models for Parkinson's disease progression from voice data.
problem Difficult statistical analysis of longitudinal voice biomarkers due to subject correlation, small cohorts, and varied disease trajectories.
method Evaluated Neural Mixed Effects (NME), Generalized Neural Network Mixed Models (GNMMs), and semi-parametric Generalized Additive Mixed Models (GAMMs).
result GAMMs achieve stronger predictive performance and retain interpretable smooth effects and subject-level structure.
MaskCycleGAN-VC improves voice conversion without parallel data.
problem Limited ability to convert mel-spectrogram data without parallel data.
method Integrates a novel auxiliary task called filling in frames (FIF) to learn time-frequency structures.
result MaskCycleGAN-VC outperforms existing methods with similar model size.
Whole MILC learns brain disorder dynamics from unlabeled data.
problem Learning spatio-temporal brain disorder dynamics from unlabeled data.
method Self-supervised pre-training of whole MILC on unlabeled healthy control data.
result Whole MILC outperforms existing methods and provides diagnostic insights.
The study predicts how discussions in mental disorder Reddit communities affect users' emotional states.
problem Improving mental health conditions through social support analysis.
method Text embedding techniques and RNNs for predicting emotional tone shifts.
result Users' emotional states can improve due to social support, as evidenced by positive comments following negative posts.
Joint training model for TTS and VC tasks using Tacotron and WaveNet.
problem Training a shared model for text-to-speech and voice conversion.
method Extended Tacotron model with dual attention mechanism for shared tasks, WaveNet for waveform generation.
result Joint training of a shared model achieves both TTS and VC tasks efficiently.
The opioid epidemic in the United States claims over 40,000 lives per year, and it is estimated that well over two million Americans have an opioid use disorder. Over-prescription and misuse of prescription opioids play an important role in the epidemic. Individuals who are prescribed opioids, and who are diagnosed wit…