Wide-Baseline Multi-Camera Calibration using Person Re-Identification

by   Yan Xu, et al.

We address the problem of estimating the 3D pose of a network of cameras for large-environment wide-baseline scenarios, e.g., cameras for construction sites, sports stadiums, and public spaces. This task is challenging since detecting and matching the same 3D keypoint observed from two very different camera views is difficult, making standard structure-from-motion (SfM) pipelines inapplicable. In such circumstances, treating people in the scene as "keypoints" and associating them across different camera views can be an alternative method for obtaining correspondences. Based on this intuition, we propose a method that uses ideas from person re-identification (re-ID) for wide-baseline camera calibration. Our method first employs a re-ID method to associate human bounding boxes across cameras, then converts bounding box correspondences to point correspondences, and finally solves for camera pose using multi-view geometry and bundle adjustment. Since our method does not require specialized calibration targets except for visible people, it applies to situations where frequent calibration updates are required. We perform extensive experiments on datasets captured from scenes of different sizes, camera settings (indoor and outdoor), and human activities (walking, playing basketball, construction). Experiment results show that our method achieves similar performance to standard SfM methods relying on manually labeled point correspondences.


page 1

page 2

page 4

page 5

page 7


Joint Person Segmentation and Identification in Synchronized First- and Third-person Videos

In a world in which cameras are becoming more and more pervasive, scenes...

Learning to Align Multi-Camera Domain for Unsupervised Video Person Re-Identification

Most video person re-identification (re-ID) methods are mainly based on ...

Online Marker-free Extrinsic Camera Calibration using Person Keypoint Detections

Calibration of multi-camera systems, i.e. determining the relative poses...

FRIDA: Fisheye Re-Identification Dataset with Annotations

Person re-identification (PRID) from side-mounted rectilinear-lens camer...

CAN: Composite Appearance Network and a Novel Evaluation Metric for Person Tracking

Tracking multiple people across multiple cameras is an open problem. It ...

Indoor Future Person Localization from an Egocentric Wearable Camera

Accurate prediction of future person location and movement trajectory fr...

Hybrid Focal Stereo Networks for Pattern Analysis in Homogeneous Scenes

In this paper we address the problem of multiple camera calibration in t...

Please sign up or login with your details

Forgot password? Click here to reset