Research

Core Machine Learning

Mind the pad – CNNS can develop blind spots

May 4, 2021

Abstract

We show how feature maps in convolutional networks are susceptible to spatial bias. Due to a combination of architectural choices, the activation at certain loca- tions is systematically elevated or weakened. The major source of this bias is the padding mechanism. Depending on several aspects of convolution arithmetic, this mechanism can apply the padding unevenly, leading to asymmetries in the learned weights. We demonstrate how such bias can be detrimental to certain tasks such as small object detection: the activation is suppressed if the stimulus lies in the impacted area, leading to blind spots and misdetection. We propose solutions to mitigate spatial bias and demonstrate how they can improve model accuracy.

Download the Paper

AUTHORS

Written by

Bilal Alsallakh

Narine Kokhlikyan

Vivek Miglani

Jun Yuan

Orion Reblitz-Richardson

Publisher

ICLR 2021

Research Topics

Core Machine Learning

Related Publications

December 05, 2020

Robotics

Reinforcement Learni9ng

Neural Dynamic Policies for End-to-End Sensorimotor Learning

Deepak Pathak, Abhinav Gupta, Mustafa Mukadam, Shikhar Bahl

December 05, 2020

December 07, 2020

Reinforcement Learni9ng

Joint Policy Search for Collaborative Multi-agent Imperfect Information Games

Yuandong Tian, Qucheng Gong, Tina Jiang

December 07, 2020

March 13, 2021

Reinforcement Learni9ng

On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning

Baohe Zhang, Raghu Rajan, Luis Pineda, Nathan Lambert, Andre Biedenkapp, Kurtland Chua, Frank Hutter, Roberto Calandra

March 13, 2021

October 10, 2020

Computer Vision

Reinforcement Learni9ng

Active MR k-space Sampling with Reinforcement Learning

Luis Pineda, Sumana Basu, Adriana Romero,Roberto CalandraRoberto Calandra, Michal Drozdzal

October 10, 2020

December 05, 2020

Reinforcement Learni9ng

An Asymptotically Optimal Primal-Dual Incremental Algorithm for Contextual Linear Bandits

Andrea Tirinzonin, Matteo Pirotta, Marcello Restelli, Alessandro Lazaric

December 05, 2020

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.