HUMAN & MACHINE INTELLIGENCE

RESEARCH

Forward Modeling for Partial Observation Strategy Games - A StarCraft Defogger

December 03, 2018

Abstract

We formulate the problem of defogging as state estimation and future state prediction from previous, partial observations in the context of real-time strategy games. We propose to employ encoder-decoder neural networks for this task, and introduce proxy tasks and baselines for evaluation to assess their ability of capturing basic game rules and high-level dynamics. By combining convolutional neural networks and recurrent networks, we exploit spatial and sequential correlations and train well-performing models on a large dataset of human games of StarCraft: Brood War. Finally, we demonstrate the relevance of our models to downstream tasks by applying them for enemy unit prediction in a state-of-the-art, rule-based StarCraft bot. We observe improvements in win rates against several strong community bots.

Download the Paper

AUTHORS

Written by

Gabriel Synnaeve

Daniel Gant

Jonas Gehring

Nicolas Carion

Nicolas Usunier

Vasil Khalidov

Vegard Mella

Zeming Lin

Publisher

NIPS

Related Publications

December 15, 2021

RESEARCH

Sample-and-threshold differential privacy: Histograms and applications

Akash Bharadwaj, Graham Cormode

December 15, 2021

January 09, 2021

RESEARCH

COMPUTER VISION

Tarsier: Evolving Noise Injection in Super-Resolution GANs

Baptiste Rozière, Camille Couprie, Olivier Teytaud, Andry Rasoanaivo, Hanhe Lin, Nathanaël Carraz Rakotonirina, Vlad Hosu

January 09, 2021

January 09, 2021

RESEARCH

Improved Sample Complexity for Incremental Autonomous Exploration in MDPs

Jean Tarbouriech, Alessandro Lazaric, Matteo Pirotta, Michal Valko

January 09, 2021

December 07, 2020

RESEARCH

COMPUTER VISION

Labelling unlabelled videos from scratch with multi-modal self-supervision

Mandela Patrick

December 07, 2020