Stephen Roller

Stephen is a Research Engineer at Facebook AI Research. His research interests include natural language processing, deep learning, language generation, conversational agents, and textual inference. Prior to FAIR, Stephen studied for his Ph.D. in natural language processing at UT Austin and was affiliated with the UTCS Machine Learning lab.

Stephen's Publications

April 07, 2020

RESEARCH

COMPUTER VISION

What makes a good conversation? How controllable attributes affect human judgments

A good conversation requires balance – between simplicity and detail; staying on topic and changing it; asking questions and answering them. Although dialogue agents are commonly evaluated via human judgments of overall quality, the…

Abigail See, Stephen Roller, Douwe Kiela, Jason Weston,

April 07, 2020

April 07, 2020

RESEARCH

COMPUTER VISION

Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings

We consider the task of inferring is-a relationships from large text corpora. For this purpose, we propose a new method combining hyperbolic embeddings and Hearst patterns. This approach allows us to set appropriate constraints for inferring…

Matt Le, Stephen Roller, Laetitia Papaxanthos, Douwe Kiela, Maximilian Nickel,

April 07, 2020

April 07, 2020

RESEARCH

NLP

Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corpora

Methods for unsupervised hypernym detection may broadly be categorized according to two paradigms: pattern-based and distributional methods. In this paper, we study the performance of both approaches on several hypernymy tasks and find that…

Stephen Roller, Douwe Kiela, Maximilian Nickel,

April 07, 2020