When Neural Networks Fail to Generalize? A Model Sensitivity Perspective

12/01/2022
by   Jiajin Zhang, et al.
16

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where only a single source domain is available for training. To tackle this challenge, we first try to understand when neural networks fail to generalize? We empirically ascertain a property of a model that correlates strongly with its generalization that we coin as "model sensitivity". Based on our analysis, we propose a novel strategy of Spectral Adversarial Data Augmentation (SADA) to generate augmented images targeted at the highly sensitive frequencies. Models trained with these hard-to-learn samples can effectively suppress the sensitivity in the frequency space, which leads to improved generalization performance. Extensive experiments on multiple public datasets demonstrate the superiority of our approach, which surpasses the state-of-the-art single-DG methods.

READ FULL TEXT

page 2

page 4

page 6

08/26/2021

Learning to Diversify for Single Domain Generalization

Domain generalization (DG) aims to generalize a model trained on multipl...
03/30/2020

Learning to Learn Single Domain Generalization

We are concerned with a worst-case scenario in model generalization, in ...
02/14/2023

Robust Representation Learning with Self-Distillation for Domain Generalization

Domain generalization is a challenging problem in machine learning, wher...
05/24/2021

A Fourier-based Framework for Domain Generalization

Modern deep neural networks suffer from performance degradation when eva...
01/20/2022

Domain Generalization via Frequency-based Feature Disentanglement and Interaction

Data out-of-distribution is a meta-challenge for all statistical learnin...
03/23/2023

Improving Generalization with Domain Convex Game

Domain generalization (DG) tends to alleviate the poor generalization ca...

Please sign up or login with your details

Forgot password? Click here to reset