Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Visual line tracking method based on projection mapping correction and ocular fixation point compensation under natural light

A projection mapping and eye-tracking technology, applied in the field of eye-tracking, can solve problems such as changes in eye movement vectors and inability to accurately estimate gaze points, so as to reduce the influence of eye movement characteristics, better resist head movement interference, improve accuracy and real-time effect

Inactive Publication Date: 2016-11-02
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the main difficulty of this method lies in: (1) How to accurately extract eye movement feature information when there is illumination change and low contrast in the image without auxiliary infrared light source; (2) How to find A robust eye movement vector that can represent eye movement; (3) Solve the problem that the eye movement vector changes with the head movement, resulting in the inability to accurately estimate the fixation point

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual line tracking method based on projection mapping correction and ocular fixation point compensation under natural light
  • Visual line tracking method based on projection mapping correction and ocular fixation point compensation under natural light
  • Visual line tracking method based on projection mapping correction and ocular fixation point compensation under natural light

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

[0028] Such as figure 1 , the hardware configuration of the present invention requires an ordinary camera, located directly above the center of the screen, to capture face images in real time.

[0029] Such as figure 2 , the specific implementation steps of the present invention are as follows:

[0030] Step 1. Collect images in real time and extract eye movement feature information;

[0031] Step 2, dynamic eye movement vector correction;

[0032] Step 3, constructing a polynomial mapping model;

[0033] Step 4: Train the gaze point compensation model to calculate the gaze point.

[0034] Wherein the concrete implementation of step 1 is:

[0035] 1. Initial positioning of face feature points

[0036] The face image is obtained from the camera, and the shape regression method based on local binary features (FaceAlignment via Regressi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a visual line tracking method based on projection mapping correction and ocular fixation point compensation under natural lights; the method comprises the following steps: extracting double-eye iris center and eye inner and outer angle point and mouth corner point characteristics; calculating a projection mapping relation between a rectangle formed by the eye inner and outer angle points and mouth corner points and the rectangle information when the head is in a calibrated position, thus carrying out projection mapping correction for iris center positions and eye inner and outer angle point positions, and eliminating influences caused by head motions; using corrected left and right eye iris centers to respectively form 4 vectors with the left and right eye inner and outer angle points, and a polynomial mapping model is combined to obtain a real time ocular fixation point; finally using a support vector regression model to carry out ocular fixation point compensation. The visual line tracking method is high in precision, can reduce head motion influences, and can realize visual line tracking under natural lights.

Description

technical field [0001] The invention relates to the technical field of gaze tracking, in particular to a gaze tracking method based on projection mapping correction and gaze point compensation under natural light. Background technique [0002] Gaze tracking has changed the way humans interact with machines and equipment, has become the source of new technologies or system ideas, and has expanded the use of various information systems. It is an important field of human-computer interaction research. [0003] Gaze tracking methods are mainly classified into contact methods and non-contact methods. The camera-based non-contact method is more user-friendly, has natural and direct advantages, and is currently the mainstream research direction of eye-tracking as a human-computer interaction method. In the non-contact eye-tracking method based on camera, the eye-tracking algorithm under natural light does not need other auxiliary light sources, which can be better popularized and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/013G06V40/18
Inventor 秦华标胡大正卓林海
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com