RESEARCH
NLP
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
April 27, 2020
Abstract
We propose vq-wav2vec to learn discrete representations of audio segments through a wav2vec-style self-supervised context prediction task. The algorithm uses either a Gumbel-Softmax or online k-means clustering to quantize the dense representations. Discretization enables the direct application of algorithms from the NLP community which require discrete inputs. Experiments show that BERT pre-training achieves a new state of the art on TIMIT phoneme classification and WSJ speech recognition.
AUTHORS
Research Areas
Related Publications
August 01, 2019
NLP
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives | Facebook AI Research
Yi Tay, Shuohang Wang, Luu Anh Tuan, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang
August 01, 2019
July 29, 2019
NLP
Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlations | Facebook AI Research
Jiatao Gu, Yong Wang, Kyunghyun Cho, Victor O.K. Li
July 29, 2019
June 11, 2019
NLP
COMPUTER VISION
Adversarial Inference for Multi-Sentence Video Description | Facebook AI Research
Jae Sung Park, Marcus Rohrbach, Trevor Darrell, Anna Rohrbach
June 11, 2019
June 10, 2019
NLP
COMPUTER VISION
Mixture Models for Diverse Machine Translation: Tricks of the Trade | Facebook AI Research
Tianxiao Shen, Myle Ott, Michael Auli, Marc'Aurelio Ranzato
June 10, 2019
