KPTransfer: improved performance and faster convergence from keypoint subset-wise domain transfer in human pose estimation

by   Kanav Vats, et al.

In this paper, we present a novel approach called KPTransfer for improving modeling performance for keypoint detection deep neural networks via domain transfer between different keypoint subsets. This approach is motivated by the notion that rich contextual knowledge can be transferred between different keypoint subsets representing separate domains. In particular, the proposed method takes into account various keypoint subsets/domains by sequentially adding and removing keypoints. Contextual knowledge is transferred between two separate domains via domain transfer. Experiments to demonstrate the efficacy of the proposed KPTransfer approach were performed for the task of human pose estimation on the MPII dataset, with comparisons against random initialization and frozen weight extraction configurations. Experimental results demonstrate the efficacy of performing domain transfer between two different joint subsets resulting in a PCKh improvement of up to 1.1 over random initialization on joints such as wrists and knee in certain joint splits with an overall PCKh improvement of 0.5. Domain transfer from a different set of joints not only results in improved accuracy but also results in faster convergence because of mutual co-adaptations of weights resulting from the contextual knowledge of the pose from a different set of joints.


Human Pose Estimation using Deep Consensus Voting

In this paper we consider the problem of human pose estimation from a si...

Bottom-Up Human Pose Estimation by Ranking Heatmap-Guided Adaptive Keypoint Estimates

The typical bottom-up human pose estimation framework includes two stage...

2D Human Pose Estimation with Explicit Anatomical Keypoints Structure Constraints

Recently, human pose estimation mainly focuses on how to design a more e...

Learning Local-Global Contextual Adaptation for Fully End-to-End Bottom-Up Human Pose Estimation

This paper presents a method of learning Local-GlObal Contextual Adaptat...

Stochastic Modeling for Learnable Human Pose Triangulation

We propose a stochastic modeling framework for 3D human pose triangulati...

Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation

We observe that human poses exhibit strong group-wise structural correla...

Semi-supervised Human Pose Estimation in Art-historical Images

Gesture as language of non-verbal communication has been theoretically e...

Please sign up or login with your details

Forgot password? Click here to reset