Armand Joulin

Armand Joulin is a research scientist at Facebook Artificial Intelligence Research. He obtained his PhD in 2012 from the INRIA and the Ecole Normale Superieure. His advisors were Francis Bach and Jean Ponce. Before joining Facebook, Armand was a postdoctoral fellow at Stanford University, working with Daphne Koller and Fei-Fei Li.

Armand's Publications

May 19, 2020

RESEARCH

ML APPLICATIONS

Reducing Transformer Depth on Demand with Structured Dropout

Overparameterized transformer networks have obtained state of the art results in various natural language processing tasks, such as machine translation, language modeling, and question answering. These models contain hundreds of millions of parameters…

Angela Fan, Edouard Grave, Armand Joulin

May 19, 2020

May 19, 2020

RESEARCH

ML APPLICATIONS

And the bit goes down: Revisiting the quantization of neural networks

In this paper, we address the problem of reducing the memory footprint of convolutional network architectures. We introduce a vector quantization method that aims at preserving the quality of the reconstruction of the network outputs rather than…

Pierre Stock, Armand Joulin, Rémi Gribonval, Benjamin Graham, Herve Jegou

May 19, 2020

May 19, 2020

RESEARCH

ML APPLICATIONS

Unsupervised Pre-Training of Image Features on Non-Curated Data

Pre-training general-purpose visual features with convolutional neural networks without relying on annotations is a challenging and important task. Most recent efforts in unsupervised feature learning have focused on either small or highly curated datasets like ImageNet, whereas using non-curated raw datasets was found to decrease the feature quality when evaluated…

Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin

May 19, 2020