arXiv research

Curiosity enhanced by audio-visual associations improves learning efficiency.

OtoWorld helps agents learn to navigate by listening in interactive environments.

Deep learning models generate music with arbitrary control strategies.

This paper proposes a zero-shot learning approach for audio classification based on the textual information about class labels without any audio samples from target classes. We propose an audio classification system built on the bilinear model, which takes audio feature embeddings and semantic class label embeddings as…

Recently, there has been great interest in the field of audio style transfer, where a stylized audio is generated by imposing the style of a reference audio on the content of a target audio. We improve on the current approaches which use neural networks to extract the content and the style of the audio signal and propo…

Deep convolutional neural networks are known to specialize in distilling compact and robust prior from a large amount of data. We are interested in applying deep networks in the absence of training dataset. In this paper, we introduce deep audio prior (DAP) which leverages the structure of a network and the temporal in…

Spatial audio is an essential medium to audiences for 3D visual and auditory experience. However, the recording devices and techniques are expensive or inaccessible to the general public. In this work, we propose a self-supervised audio spatialization network that can generate spatial audio given the corresponding vide…

Method learns audio embeddings with contextualized tags.

Study improves radio show segmentation using audio embeddings.

Online audio advertising is a particular form of advertising used abundantly in online music streaming services. In these platforms, which tend to host tens of thousands of unique audio advertisements (ads), providing high quality ads ensures a better user experience and results in longer user engagement. Therefore, th…

MicAugment transfers audio style from few seconds of input to match target conditions.

Detects audio adversarial examples using anomalous pattern detection.

Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent success of convolutional neural networks (CNNs) in SE, we propose an audio-visual de…

Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent success of convolutional neural networks (CNNs) in SE, we propose an audio-visual de…

Unified model for audio control and style transfer.

Audio fingerprinting, also named as audio hashing, has been well-known as a powerful technique to perform audio identification and synchronization. It basically involves two major steps: fingerprint (voice pattern) design and matching search. While the first step concerns the derivation of a robust and compact audio si…

Transformer model estimates keywords for better audio captioning.

Introduces a natural parallel translation for navigation data.

This paper describes Task 2 of the DCASE 2018 Challenge, titled "General-purpose audio tagging of Freesound content with AudioSet labels". This task was hosted on the Kaggle platform as "Freesound General-Purpose Audio Tagging Challenge". The goal of the task is to build an audio tagging system that can recognize the c…

AV-CPL uses continuous pseudo-labels for AVSR combining labeled and unlabeled data.

Time-frequency (TF) representations provide powerful and intuitive features for the analysis of time series such as audio. But still, generative modeling of audio in the TF domain is a subtle matter. Consequently, neural audio synthesis widely relies on directly modeling the waveform and previous attempts at unconditio…

HEAR benchmark evaluates audio representations for diverse tasks.

Proposes COALA method for learning audio representations aligned with tags.

This paper shows the susceptibility of spectrogram-based audio classifiers to adversarial attacks and the transferability of such attacks to audio waveforms. Some commonly used adversarial attacks to images have been applied to Mel-frequency and short-time Fourier transform spectrograms, and such perturbed spectrograms…

Challenge to separate Earth's magnetic field from vehicle's magnetic field for accurate navigation.

Most common navigation tasks in human environments require auxiliary arm interactions, e.g. opening doors, pressing buttons and pushing obstacles away. This type of navigation tasks, which we call Interactive Navigation, requires the use of mobile manipulators: mobile bases with manipulation capabilities. Interactive N…

In this paper we present ensembles of classifiers for automated animal audio classification, exploiting different data augmentation techniques for training Convolutional Neural Networks (CNNs). The specific animal audio classification problems are i) birds and ii) cat sounds, whose datasets are freely available. We tra…

Navigation in Lorentz Finsler geometry induces isoparametric hypersurfaces.

Mic2Mic reduces microphone variability for speech systems.

As the technology is advancing, audio recognition in machine learning is improved as well. Research in audio recognition has traditionally focused on speech. Living creatures (especially the small ones) are part of the whole ecosystem, monitoring as well as maintaining them are important tasks. Species such as animals …

FSD50K provides an open dataset of over 51k audio clips for sound event recognition.

The paper solves navigation problems on conic Kropina manifolds and establishes curvature relationships.

Robotic navigation improves with RL and ultrasound images.

Improved robot navigation using multi-head attention for natural language instructions.

Nonnegative matrix factorization (NMF) is now a common tool for audio source separation. When learning NMF on large audio databases, one major drawback is that the complexity in time is O(FKN) when updating the dictionary (where (F;N) is the dimension of the input power spectrograms, and K the number of basis spectra),…

The problem of pursuing a moving target is always one of the main topics in navigation. In the literatures, there are two well-known algorithms called Pure Pursuit and Pure Rendezvous navigation in the 3-dimensional space $\mathbb{R}^3$. In this paper, these two methods are combined to introduce a novel family of pursu…

This research tackles backdoor attacks on audio data using a stochastic investment approach.

Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and high-dimensionality of sensorimotor spaces which are inherent in such problems. We present a nov…

WaveGrad generates high-fidelity audio using gradient estimation.

GACELA fills long gaps in musical audio with a GAN and context conditioning.

SLAM-net learns to navigate visually in challenging indoor environments.

Given the recent surge in developments of deep learning, this article provides a review of the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered side-by-side, in order to point out similarities and differences between the domains, hig…

System tackles indeterminacies in automated audio captioning.

A new framework enhances binaural audio for moving talkers.

Improves AI agents' 3D navigation by learning from failures and 3D spatial relationships.

Bayesian model for energy consumption helps electric vehicles navigate efficiently.

Proposes GAAE for high-fidelity audio generation and representation learning.

New method allows real-time audio synthesis using non-causal convolutions.