Sida Wang

Sida Wang is a Research Scientist at Facebook AI Research in Seattle working on natural language processing. Previously he was a research instructor at Princeton University and the Institute for Advanced Study. He completed his PhD at Stanford University co-advised by Chris Manning and Percy Liang.

Sida's Publications

December 06, 2020

RESEARCH

NLP

Pre-training via Paraphrasing

We introduce MARGE, a pre-trained sequence-to-sequence model learned with an unsupervised multi-lingual multi-document paraphrasing objective. MARGE provides an alternative to the dominant masked language modeling paradigm, where we self-supervise the reconstruction of target text by retrieving a set of related texts (in many languages)…

Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida Wang, Luke Zettlemoyer

December 06, 2020