COMPUTER VISION
CORE MACHINE LEARNING
Debugging the Internals of Convolutional Networks
December 06, 2021
Abstract
The filters learned by Convolutional Neural Networks (CNNs) and the feature maps these filters compute are sensitive to convolution arithmetic. Several architectural choices that dictate this arithmetic can result in feature-map artifacts. These artifacts can interfere with the downstream task and impact the accuracy and robustness. We provide a number of visual-debugging means to surface feature-map artifacts and to analyze how they emerge in CNNs. Our means help analyze the impact of these artifacts on the weights learned by the model. Guided by our analysis, model developers can make informed architectural choices that can verifiably mitigate harmful artifacts and improve the model’s accuracy and its shift robustness.
AUTHORS
Written by
Bilal Alsallakh
Vivek Miglani
Shubham Muttepawar
Edward Wang (AI Infra)
Sara Zhang
David Adkins
Orion Reblitz-Richardson
Publisher
NeurIPS Workshop
Related Publications
November 28, 2022
RESEARCH
CORE MACHINE LEARNING
Neural Attentive Circuits
Nicolas Ballas, Bernhard Schölkopf, Chris Pal, Francesco Locatello, Li Erran, Martin Weiss, Nasim Rahaman, Yoshua Bengio
November 28, 2022
November 23, 2022
THEORY
CORE MACHINE LEARNING
Generalization Bounds for Deep Transfer Learning Using Majority Predictor Accuracy
Tal Hassner, Cuong N. Nguyen, Cuong V. Nguyen, Lam Si Tung Ho, Vu Dinh
November 23, 2022
November 16, 2022
RESEARCH
NLP
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Kushal Tirumala, Aram H. Markosyan, Armen Aghajanyan, Luke Zettlemoyer
November 16, 2022
November 10, 2022
RESEARCH
COMPUTER VISION
Learning State-Aware Visual Representations from Audible Interactions
Unnat Jain, Abhinav Gupta, Himangi Mittal, Pedro Morgado
November 10, 2022
Latest News
