Gaze Tracking Method Based on Projection Mapping Correction and Gaze Compensation under Natural Light
A projection mapping and gaze tracking technology, applied in the field of gaze tracking, can solve the problems of inaccurate gaze point estimation, eye movement vector changes, etc. real-time effects
Inactive Publication Date: 2019-05-14
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, the main difficulty of this method lies in: (1) How to accurately extract eye movement feature information when there is illumination change and low contrast in the image without auxiliary infrared light source; (2) How to find A robust eye movement vector that can represent eye movement; (3) Solve the problem that the eye movement vector changes with the head movement, resulting in the inability to accurately estimate the fixation point
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0027] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings.
[0028] Such as figure 1 , the hardware configuration of the present invention requires an ordinary camera, located directly above the center of the screen, to capture face images in real time.
[0029] Such as figure 2 , the specific implementation steps of the present invention are as follows:
[0030] Step 1. Collect images in real time and extract eye movement feature information;
[0031] Step 2, dynamic eye movement vector correction;
[0032] Step 3, constructing a polynomial mapping model;
[0033] Step 4: Train the gaze point compensation model to calculate the gaze point.
[0034] Wherein the concrete implementation of step 1 is:
[0035] 1. Initial positioning of face feature points
[0036] The face image is obtained from the camera, and the shape regression method based on local binary features (FaceAlignment via Regressi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a line-of-sight tracking method based on projection mapping correction and fixation point compensation under natural light. The method firstly extracts the iris center of both eyes, the inner and outer corners of the eyes, and the features of the corners of the mouth, and then calculates the rectangle formed by the inner and outer corners of the eyes and the corners of the mouth. The projection mapping relationship between the rectangular information when the head is at the calibration position, and then the projection mapping correction is performed on the center position of the iris and the inner and outer corners of the eye to eliminate the impact of head movement; then, the corrected left and right eyes The center of the iris forms 4 vectors with the inner and outer corners of the left and right eyes respectively, combined with the polynomial mapping model to obtain the real-time fixation point, and finally compensates the fixation point through the support vector regression model. The invention provides a high-precision solution capable of reducing the impact of head movement for line-of-sight tracking under natural light.
Description
technical field [0001] The invention relates to the technical field of gaze tracking, in particular to a gaze tracking method based on projection mapping correction and gaze point compensation under natural light. Background technique [0002] Gaze tracking has changed the way humans interact with machines and equipment, has become the source of new technologies or system ideas, and has expanded the use of various information systems. It is an important field of human-computer interaction research. [0003] Gaze tracking methods are mainly classified into contact methods and non-contact methods. The camera-based non-contact method is more user-friendly, has natural and direct advantages, and is currently the mainstream research direction of eye-tracking as a human-computer interaction method. In the non-contact eye-tracking method based on camera, the eye-tracking algorithm under natural light does not need other auxiliary light sources, which can be better popularized and ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/013G06V40/18
Inventor 秦华标胡大正卓林海
Owner SOUTH CHINA UNIV OF TECH