On the Robustness of Human Pose Estimation

by   Sahil Shah, et al.

This paper provides, to the best of our knowledge, the first comprehensive and exhaustive study of adversarial attacks on human pose estimation. Besides highlighting the important differences between well-studied classification and human pose-estimation systems w.r.t. adversarial attacks, we also provide deep insights into the design choices of pose-estimation systems to shape future work. We compare the robustness of several pose-estimation architectures trained on the standard datasets, MPII and COCO. In doing so, we also explore the problem of attacking non-classification based networks including regression based networks, which has been virtually unexplored in the past. We find that compared to classification and semantic segmentation, human pose estimation architectures are relatively robust to adversarial attacks with the single-step attacks being surprisingly ineffective. Our study show that the heatmap-based pose-estimation models fare better than their direct regression-based counterparts and that the systems which explicitly model anthropomorphic semantics of human body are significantly more robust. We find that the targeted attacks are more difficult to obtain than untargeted ones and some body-joints are easier to fool than the others. We present visualizations of universal perturbations to facilitate unprecedented insights into their workings on pose-estimation. Additionally, we show them to generalize well across different networks on both the datasets.


page 1

page 3

page 5

page 7

page 8

page 9

page 10

page 13


An Integral Pose Regression System for the ECCV2018 PoseTrack Challenge

For the ECCV 2018 PoseTrack Challenge, we present a 3D human pose estima...

DeepPose: Human Pose Estimation via Deep Neural Networks

We propose a method for human pose estimation based on Deep Neural Netwo...

Self Adversarial Training for Human Pose Estimation

This paper presents a deep learning based approach to the problem of hum...

Adversarial Attacks on Monocular Pose Estimation

Advances in deep learning have resulted in steady progress in computer v...

A Comprehensive Analysis of Deep Regression

Deep learning revolutionized data science, and recently, its popularity ...

When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks

Human pose estimation is a fundamental yet challenging task in computer ...

Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypotheses

Many prediction tasks contain uncertainty. In some cases, uncertainty is...

Please sign up or login with your details

Forgot password? Click here to reset