Mike Lewis

Mike Lewis is a Research Scientist at Facebook AI Research in Seattle working on natural language processing. Previously he was a postdoc at the University of Washington, working with Luke Zettlemoyer on search based structured prediction. He completed his PhD at the University of Edinburgh (advised by Mark Steedman) based on combining distributional and logical approaches to semantics. Mike has a Masters degree from the University of Oxford, and won a Best Paper award at EMNLP 2016.

Mike's Publications

June 19, 2020

RESEARCH

ML APPLICATIONS

Generalization through Memorization: Nearest Neighbor Language Models

We introduce kNN-LMs, which extend a pre-trained neural language model (LM) by linearly interpolating it with a k-nearest neighbors (kNN) model. The nearest neighbors are computed according to distance in the pre-trained LM embedding space, and…

Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis

June 19, 2020

June 19, 2020

RESEARCH

ML APPLICATIONS

Hierarchical Decision Making by Generating and Following Natural Language Instructions

We explore using latent natural language instructions as an expressive and compositional representation of complex actions for hierarchical decision making. Rather than directly selecting micro-actions, our agent first generates a latent plan in…

Hengyuan Hu, Denis Yarats, Qucheng Gong, Yuandong Tian, Mike Lewis

June 19, 2020

June 19, 2020

RESEARCH

ML APPLICATIONS

Strategies for Structuring Story Generation

Writers often rely on plans or sketches to write long stories, but most current language models generate word by word from left to right. We explore coarse-to-fine models for creating narrative texts of several hundred words, and introduce…

Angela Fan, Mike Lewis, Yann Dauphin

June 19, 2020