Simultaneous Multi-View Camera Pose Estimation and Object Tracking with Square Planar Markers

by   Hamid Sarmadi, et al.

Object tracking is a key aspect in many applications such as augmented reality in medicine (e.g. tracking a surgical instrument) or robotics. Squared planar markers have become popular tools for tracking since their pose can be estimated from their four corners. While using a single marker and a single camera limits the working area considerably, using multiple markers attached to an object requires estimating their relative position, which is not trivial, for high accuracy tracking. Likewise, using multiple cameras requires estimating their extrinsic parameters, also a tedious process that must be repeated whenever a camera is moved. This work proposes a novel method to simultaneously solve the above-mentioned problems. From a video sequence showing a rigid set of planar markers recorded from multiple cameras, the proposed method is able to automatically obtain the three-dimensional configuration of the markers, the extrinsic parameters of the cameras, and the relative pose between the markers and the cameras at each frame. Our experiments show that our approach can obtain highly accurate results for estimating these parameters using low resolution cameras. Once the parameters are obtained, tracking of the object can be done in real time with a low computational cost. The proposed method is a step forward in the development of cost-effective solutions for object tracking.


page 2

page 4

page 8

page 13


Keypoint-based object tracking and localization using networks of low-power embedded smart cameras

Object tracking and localization is a complex task that typically requir...

Pose-Assisted Multi-Camera Collaboration for Active Object Tracking

Active Object Tracking (AOT) is crucial to many visionbased applications...

Efficient Circle-Based Camera Pose Tracking Free of PnP

Camera pose tracking attracts much interest both from academic and indus...

HVC-Net: Unifying Homography, Visibility, and Confidence Learning for Planar Object Tracking

Robust and accurate planar tracking over a whole video sequence is vital...

Determining ellipses from low resolution images with a comprehensive image formation model

When determining the parameters of a parametric planar shape based on a ...

Three-dimensional Human Tracking of a Mobile Robot by Fusion of Tracking Results of Two Cameras

This paper proposes a process that uses two cameras to obtain three-dime...

A Gauss-Newton Approach to Real-Time Monocular Multiple Object Tracking

We propose an algorithm for real-time 6DOF pose tracking of rigid 3D obj...

Please sign up or login with your details

Forgot password? Click here to reset