A Differential Approach for Gaze Estimation

by   Gang Liu, et al.

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and their output usually exhibit high variance as well as biases which are subject dependent. Therefore, increasing accuracy is usually done through calibration, allowing gaze predictions for a subject to be mapped to his/her actual gaze. In this paper, we introduce a novel image differential method for gaze estimation. We propose to directly train a differential convolutional neural network to predict the gaze differences between two eye input images of the same subject. Then, given a set of subject specific calibration images, we can use the inferred differences to predict the gaze direction of a novel eye sample. The assumption is that by allowing the comparison between two eye images, annoyance factors (alignment, eyelid closing, illumination perturbations) which usually plague single image prediction methods can be much reduced, allowing better prediction altogether. Experiments on 3 public datasets validate our approach which constantly outperforms state-of-the-art methods even when using only one calibration sample or when the latter methods are followed by subject specific gaze adaptation.


page 1

page 2

page 3

page 5

page 7


GEDDnet: A Network for Gaze Estimation with Dilation and Decomposition

Appearance-based gaze estimation from RGB images provides relatively unc...

Gaze Estimation Approach Using Deep Differential Residual Network

Gaze estimation, which is a method to determine where a person is lookin...

One Eye is All You Need: Lightweight Ensembles for Gaze Estimation with Single Encoders

Gaze estimation has grown rapidly in accuracy in recent years. However, ...

Efficient Eye Typing with 9-direction Gaze Estimation

Vision based text entry systems aim to help disabled people achieve text...

Appearance-Based Gaze Estimation via Gaze Decomposition and Single Gaze Point Calibration

Appearance-based gaze estimation provides relatively unconstrained gaze ...

The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation

We propose a novel method on refining cross-person gaze prediction task ...

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

As an indicator of human attention gaze is a subtle behavioral cue which...

Please sign up or login with your details

Forgot password? Click here to reset