Method, apparatus and system for line-of-sight estimation

Abstract

The embodiment of the present application discloses a method of line-of-sight estimation, a device and a system. The method comprises: analyzing the pupil shape information used for describing the geometrical parameters of the elliptical pupil image from the current human eye image by real-time collecting the current human eye image, calculating the plane normal direction of the pupil in the three-dimensional world coordinate system by using the two-dimensional pupil shape information analyzed by the pupil image, and marking it as the human eye axis direction; a human eye visual axis directionbeing obtained by compensating the human eye visual axis direction with a preset compensation angle, and the fixation direction and/or fixation point corresponding to the current human eye image being determined according to the human eye visual axis direction. Thus, by quantifying the pupil shape information in the current human eye image, calculating and compensating to determine the fixation direction and/or fixation point of the human eye, the real-time and accurate detection of the fixation direction and/or fixation point of the human eye can be realized in a wider range.

Description

technical field [0001] The present application relates to the technical field of eye control, and in particular to a method, device and system for visual line estimation. Background technique [0002] Eye control technology, also called line of sight estimation technology, can track and detect the line of sight of the human eye, so that the line of sight of the human eye can be used to realize some application functions. Wherein, the line of sight of the human eye may be the gaze direction of the human eye or the gaze point of the human eye. Currently, gaze direction and gaze point are usually detected by corneal reflectometry. Specifically, a pair of light sources are deployed on both sides of a camera for capturing human eye images. Since the cornea of ​​the human eye can be approximately considered as a spherical mirror, when a pair of light sources shine on the cornea, two specularly reflected light spots will be generated on the cornea, so that the two light spots can...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved in this application is to provide a method, device and system for line of sight estimation, so that even when the gaze direction of the human eye deviates too much from the optical axis of the camera and the camera cannot capture the two spots, it can detect The gaze direction or gaze point of the human eye can be detected, so that the gaze direction and gaze point in a wide range can be detected

Images