RESEARCH

CONVERSATIONAL AI

Explore-Exploit: A Framework for Interactive and Online Learning

December 3, 2018

Abstract

Interactive user interfaces need to continuously evolve based on the interactions that a user has (or does not have) with the system. This may require constant exploration of various options that the system may have for the user and obtaining signals of user preferences on those. However, such an exploration, especially when the set of available options itself can change frequently, can lead to suboptimal user experiences. We present Explore-Exploit: a framework designed to collect and utilize user feedback in an interactive and online setting that minimizes regressions in end-user experience. This framework provides a suite of online learning operators for various tasks such as personalization ranking, candidate selection and active learning. We demonstrate how to integrate this framework with run-time services to leverage online and interactive machine learning out-of-the-box. We also present results demonstrating the efficiencies that can be achieved using the Explore-Exploit framework.

Download the Paper

Related Publications

December 03, 2018

CONVERSATIONAL AI

Explore-Exploit: A Framework for Interactive and Online Learning | Facebook AI Research

Honglei Liu, Anuj Kumar, Wenhai Yang, Benoit Dumoulin

December 03, 2018

November 05, 2019

NLP

CONVERSATIONAL AI

Memory Grounded Conversational Reasoning | Facebook AI Research

Shane Moon, Pararth Shah, Anuj Kumar, Rajen Subba

November 05, 2019

December 04, 2018

CONVERSATIONAL AI

NLP

Improving Semantic Parsing for Task Oriented Dialog | Facebook AI Research

Arash Einolghozati, Panupong Pasupat, Sonal Gupta, Rushin Shah, Mrinal Mohit, Mike Lewis, Luke Zettlemoyer

December 04, 2018

July 29, 2019

CONVERSATIONAL AI

NLP

OpenDialKG: Explainable Conversational Reasoning with Attention-based Walks over Knowledge Graphs | Facebook AI Research

Shane Moon, Pararth Shah, Anuj Kumar, Rajen Subba

July 29, 2019

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.