RESEARCH
ML APPLICATIONS
IR-VIC: Unsupervised Discovery of Sub-goals for Transfer in RL
January 5, 2021
Abstract
We propose a novel framework to identify subgoals useful for exploration in sequential decision making tasks under partial observability. We utilize the variational intrinsic control framework (Gregor et.al., 2016) which maximizes empowerment – the ability to reliably reach a diverse set of states and show how to identify sub-goals as states with high necessary option information through an information theoretic regularizer. Despite being discovered without explicit goal supervision, our subgoals provide better exploration and sample complexity on challenging grid-world navigation tasks compared to supervised counterparts in prior work.
AUTHORS
Written by
Nirbhay Modhe
Prithvijit Chattopadhyay
Mohit Sharma
Abhishek Das
Devi ParikhDhruv BatraRamakrishna VedantamPublisher
International Joint Conference on Artificial Intelligence (IJCAI)
Related Publications
June 03, 2019
NLP
FAIRSEQ: A Fast, Extensible Toolkit for Sequence Modeling | Facebook AI Research
FAIRSEQ is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports…
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
June 03, 2019
June 02, 2019
NLP
Cooperative Learning of Disjoint Syntax and Semantics | Facebook AI Research
There has been considerable attention devoted to models that learn to jointly infer an expression’s syntactic structure and its semantics. Yet, Nangia and Bowman (2018) has recently shown that the current best systems fail to learn the correct…
Serhii Havrylov, Germán Kruszewski, Armand Joulin
June 02, 2019
June 15, 2019
COMPUTER VISION
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search | Facebook AI Research
Designing accurate and efficient ConvNets for mobile devices is challenging because the design space is combinatorially large. Due to this, previous neural architecture search (NAS) methods are computationally expensive. ConvNet architecture…
Bichen Wu, Xiaoliang Dai, Peizhao Zhang, Yanghan Wang, Fei Sun, Yiming Wu, Yuandong Tian, Peter Vajda, Yangqing Jia, Kurt Keutzer
June 15, 2019
April 28, 2019
COMPUTER VISION
Inverse Path Tracing for Joint Material and Lighting Estimation | Facebook AI Research
Modern computer vision algorithms have brought significant advancement to 3D geometry reconstruction. However, illumination and material reconstruction remain less studied, with current approaches assuming very simplified models for materials…
Dejan Azinović, Tzu-Mao Li, Anton Kaplanyan, Matthias Nießner
April 28, 2019
Related Work
