A robust gaze detection method by compensating for facial movements based on corneal specularities

In this paper, we propose an analytical method for robust gaze detection by compensating for facial movements based on corneal specularities. Our method has following four novelties compared to previous works. (i) We used a USB (Universal Serial Bus) camera with four IR-LED (infra-red light emitting diodes) which were attached on each corner of a monitor, so we could simply calculate the user’s gaze position based on 2D relations between the center of pupil and four corneal reflections without considering the complex 3D relations among the camera, the monitor and the pupil coordinates, (ii) the detection accuracy of four corneal reflections was much enhanced by removing the imposter reflections based on the analysis of 3D structure of the human eye, (iii) by analyzing and compensating the shape change of quadrangle which was formed by four corneal reflections according to facial movement, we could reduce the gaze detection errors caused by facial movements, (iv) by compensating the error caused by angle Kappa based on user-dependent calibration, we could much enhance the accuracy of our gaze detection method.Experimental results showed that the gaze detection error was about 1.0° and we could know our method could track user’s gaze position at real-time speed.