RESEARCH
SPEECH & AUDIO
A Universal Music Translation Network
May 5, 2019
Abstract
We present a method for translating music across musical instruments and styles. This method is based on unsupervised training of a multi-domain wavenet autoencoder, with a shared encoder and a domain-independent latent space that is trained end-to-end on waveforms. Employing a diverse training dataset and large net capacity, the single encoder allows us to translate also from musical domains that were not seen during training. We evaluate our method on a dataset collected from professional musicians, and achieve convincing translations. We also study the properties of the obtained translation and demonstrate translating even from a whistle, potentially enabling the creation of instrumental music by untrained humans.
AUTHORS
Research Topics
Speech & AudioRelated Publications
July 28, 2019
SPEECH & AUDIO
COMPUTER VISION
Learning to Optimize Halide with Tree Search and Random Programs | Facebook AI Research
We present a new algorithm to automatically schedule Halide programs for high-performance image processing and deep learning. We significantly improve upon the performance of previous methods, which considered a limited subset of schedules. We…
Andrew Adams, Karima Ma, Luke Anderson, Riyadh Baghdadi, Tzu-Mao Li, Michaël Gharbi, Benoit Steiner, Steven Johnson, Kayvon Fatahalian, Frédo Durand, Jonathan Ragan-Kelley
July 28, 2019
September 15, 2019
SPEECH & AUDIO
Who Needs Words? Lexicon-Free Speech Recognition | Facebook AI Research
Lexicon-free speech recognition naturally deals with the problem of out-of-vocabulary (OOV) words. In this paper, we show that character-based language models (LM) can perform as well as word-based LMs for speech recognition, in word error…
Tatiana Likhomanenko, Gabriel Synnaeve, Ronan Collobert
September 15, 2019
December 04, 2018
SPEECH & AUDIO
Non-Adversarial Mapping with VAEs | Facebook AI Research
The study of cross-domain mapping without supervision has recently attracted much attention. Much of the recent progress was enabled by the use of adversarial training as well as cycle constraints. The practical difficulty of adversarial…
Yedid Hoshen
December 04, 2018
December 03, 2018
HUMAN & MACHINE INTELLIGENCE
SPEECH & AUDIO
Forward Modeling for Partial Observation Strategy Games | Facebook AI Research
We formulate the problem of defogging as state estimation and future state prediction from previous, partial observations in the context of real-time strategy games. We propose to employ encoder-decoder neural networks for this task, and…
Gabriel Synnaeve, Zeming Lin, Jonas Gehring, Dan Gant, Vegard Mella, Vasil Khalidov, Nicolas Carion, Nicolas Usunier
December 03, 2018
Related Work
