Towards Analyzing Semantic Robustness of Deep Neural Networks

by   Abdullah Hamdi, et al.

Despite the impressive performance of Deep Neural Networks (DNNs) on various vision tasks, they still exhibit erroneous high sensitivity toward semantic primitives (e.g. object pose). We propose a theoretically grounded analysis for DNNs robustness in the semantic space. We qualitatively analyze different DNNs semantic robustness by visualizing the DNN global behavior as semantic maps and observe interesting behavior of some DNNs. Since generating these semantic maps does not scale well with the dimensionality of the semantic space, we develop a bottom-up approach to detect robust regions of DNNs. To achieve this, We formalize the problem of finding robust semantic regions of the network as optimization of integral bounds and develop expressions for update directions of the region bounds. We use our developed formulations to quantitatively evaluate the semantic robustness of different famous network architectures. We show through extensive experimentation that several networks, though trained on the same dataset and while enjoying comparable accuracy, they do not necessarily perform similarly in semantic robustness. For example, InceptionV3 is more accurate despite being less semantically robust than ResNet50. We hope that this tool will serve as the first milestone towards understanding the semantic robustness of DNNs.


page 1

page 4

page 14

page 15

page 19

page 20

page 21

page 22


Training Certifiably Robust Neural Networks Against Semantic Perturbations

Semantic image perturbations, such as scaling and rotation, have been sh...

Interpreting Robustness Proofs of Deep Neural Networks

In recent years numerous methods have been developed to formally verify ...

Semantics for Global and Local Interpretation of Deep Neural Networks

Deep neural networks (DNNs) with high expressiveness have achieved state...

Analytical Moment Regularizer for Gaussian Robust Networks

Despite the impressive performance of deep neural networks (DNNs) on num...

Analysis of Invariance and Robustness via Invertibility of ReLU-Networks

Studying the invertibility of deep neural networks (DNNs) provides a pri...

XAI Model for Accurate and Interpretable Landslide Susceptibility

Landslides are notoriously difficult to predict. Deep neural networks (D...

Mechanisms of Artistic Creativity in Deep Learning Neural Networks

The generative capabilities of deep learning neural networks (DNNs) have...

Please sign up or login with your details

Forgot password? Click here to reset