RESEARCH
COMPUTER VISION
Tarsier: Evolving Noise Injection in Super-Resolution GANs
January 9, 2021
Abstract
Super-resolution aims at increasing the resolution and level of detail within an image. The current state of the art in general single-image super-resolution is held by NESRGAN+, which injects a Gaussian noise after each residual layer at training time. In this paper, we harness evolutionary methods to improve NESRGAN+ by optimizing the noise injection at inference time. More precisely, we use Diagonal CMA to optimize the injected noise according to a novel criterion combining quality assessment and realism. Our results are validated by the PIRM perceptual score and a human study. Our method outperforms NESRGAN+ on several standard super-resolution datasets. More generally, our approach can be used to optimize any method based on noise injection.
AUTHORS
Written by
Baptiste Roziere
Nathanaël Carraz Rakotonirina
Vlad Hosu
Andry Rasoanaivo
Hanhe Lin
Camille Couprie
Olivier Teytaud
Publisher
International Association of Pattern Recognition ICPR 2020
Research Topics
Computer VisionRelated Publications
May 17, 2019
COMPUTER VISION
SPEECH & AUDIO
GLoMo: Unsupervised Learning of Transferable Relational Graphs | Facebook AI Research
Modern deep transfer learning approaches have mainly focused on learning generic feature vectors from one task that are transferable to other tasks, such as word embeddings in language and pretrained convolutional features in vision. However,…
Zhilin Yang, Jake (Junbo) Zhao, Bhuwan Dhingra, Kaiming He, William W. Cohen, Ruslan Salakhutdinov, Yann LeCun
May 17, 2019
May 06, 2019
COMPUTER VISION
NLP
No Training Required: Exploring Random Encoders for Sentence Classification | Facebook AI Research
We explore various methods for computing sentence representations from pre-trained word embeddings without any training, i.e., using nothing but random parameterizations. Our aim is to put sentence embeddings on more solid footing by 1) looking…
John Wieting, Douwe Kiela
May 06, 2019
May 06, 2019
NLP
COMPUTER VISION
Efficient Lifelong Learning with A-GEM | Facebook AI Research
In lifelong learning, the learner is presented with a sequence of tasks, incrementally building a data-driven prior which may be leveraged to speed up learning of a new task. In this work, we investigate the efficiency of current lifelong…
Arslan Chaudhry, Marc'Aurelio Ranzato, Marcus Rohrbach, Mohamed Elhoseiny
May 06, 2019
May 06, 2019
COMPUTER VISION
Learning Exploration Policies for Navigation | Facebook AI Research
Numerous past works have tackled the problem of task-driven navigation. But, how to effectively explore a new environment to enable a variety of down-stream tasks has received much less attention. In this work, we study how agents can…
Tao Chen, Saurabh Gupta, Abhinav Gupta
May 06, 2019
