Mike Lewis
Mike Lewis is a Research Scientist at Facebook AI Research in Seattle working on natural language processing. Previously he was a postdoc at the University of Washington, working with Luke Zettlemoyer on search based structured prediction. He completed his PhD at the University of Edinburgh (advised by Mark Steedman) based on combining distributional and logical approaches to semantics. Mike has a Masters degree from the University of Oxford, and won a Best Paper award at EMNLP 2016.
Mike's Publications
June 19, 2020
RESEARCH
ML APPLICATIONS
Generalization through Memorization: Nearest Neighbor Language Models
We introduce kNN-LMs, which extend a pre-trained neural language model (LM) by linearly interpolating it with a k-nearest neighbors (kNN) model. The nearest neighbors are computed according to distance in the pre-trained LM embedding space, and…
Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis
June 19, 2020
June 19, 2020
RESEARCH
ML APPLICATIONS
Hierarchical Decision Making by Generating and Following Natural Language Instructions
We explore using latent natural language instructions as an expressive and compositional representation of complex actions for hierarchical decision making. Rather than directly selecting micro-actions, our agent first generates a latent plan in…
Hengyuan Hu, Denis Yarats, Qucheng Gong, Yuandong Tian, Mike Lewis
June 19, 2020
June 19, 2020
RESEARCH
ML APPLICATIONS
Strategies for Structuring Story Generation
Writers often rely on plans or sketches to write long stories, but most current language models generate word by word from left to right. We explore coarse-to-fine models for creating narrative texts of several hundred words, and introduce…
Angela Fan, Mike Lewis, Yann Dauphin
June 19, 2020
