DVGaze: Dual-View Gaze Estimation

by   Yihua Cheng, et al.

Gaze estimation methods estimate gaze from facial appearance with a single camera. However, due to the limited view of a single camera, the captured facial appearance cannot provide complete facial information and thus complicate the gaze estimation problem. Recently, camera devices are rapidly updated. Dual cameras are affordable for users and have been integrated in many devices. This development suggests that we can further improve gaze estimation performance with dual-view gaze estimation. In this paper, we propose a dual-view gaze estimation network (DV-Gaze). DV-Gaze estimates dual-view gaze directions from a pair of images. We first propose a dual-view interactive convolution (DIC) block in DV-Gaze. DIC blocks exchange dual-view information during convolution in multiple feature scales. It fuses dual-view features along epipolar lines and compensates for the original feature with the fused feature. We further propose a dual-view transformer to estimate gaze from dual-view features. Camera poses are encoded to indicate the position information in the transformer. We also consider the geometric relation between dual-view gaze directions and propose a dual-view gaze consistency loss for DV-Gaze. DV-Gaze achieves state-of-the-art performance on ETH-XGaze and EVE datasets. Our experiments also prove the potential of dual-view gaze estimation. We release codes in https://github.com/yihuacheng/DVGaze.


page 3

page 5

page 8


Gaze-Net: Appearance-Based Gaze Estimation using Capsule Networks

Recent studies on appearance based gaze estimation indicate the ability ...

Resolving Camera Position for a Practical Application of Gaze Estimation on Edge Devices

Most Gaze estimation research only works on a setup condition that a cam...

Rotation-Constrained Cross-View Feature Fusion for Multi-View Appearance-based Gaze Estimation

Appearance-based gaze estimation has been actively studied in recent yea...

Extended Gaze Following: Detecting Objects in Videos Beyond the Camera Field of View

In this paper we address the problems of detecting objects of interest i...

PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation

Gaze estimation methods learn eye gaze from facial features. However, am...

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

In recent years we have witnessed an increasing number of interactive sy...

Dual In-painting Model for Unsupervised Gaze Correction and Animation in the Wild

In this paper we address the problem of unsupervised gaze correction in ...

Please sign up or login with your details

Forgot password? Click here to reset