Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Fast Eye Tracking Method Based on Convolutional Neural Network

A convolutional neural network and human eye tracking technology, applied in the field of fast eye tracking based on convolutional neural network, can solve problems such as slow speed, high error rate, inability to deal with complex real scenes, etc., to improve reliability, Provides accuracy and prevents tracking errors

Active Publication Date: 2021-08-10
SOUTH CHINA UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to overcome the shortcomings and deficiencies of the prior art, and propose a fast human eye tracking method based on convolutional neural network, which breaks through the problems of high error rate and slow speed of the existing tracking method, and cannot cope with complex real-life scenes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Fast Eye Tracking Method Based on Convolutional Neural Network
  • A Fast Eye Tracking Method Based on Convolutional Neural Network
  • A Fast Eye Tracking Method Based on Convolutional Neural Network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The present invention will be further described below in conjunction with specific examples.

[0039] The fast human eye tracking method based on the convolutional neural network provided by this embodiment first makes a training data set, and the process is as follows image 3 shown; then use the data set to train the human eye tracking convolutional network and the human eye verification convolutional network, the results of the human eye tracking convolutional network are as follows figure 2 ; Afterwards, the trained convolutional network can be used for human eye tracking. The tracking process is as follows: figure 1 shown. Specifically, the following steps are included:

[0040] 1) Create a human eye tracking data set and human eye verification data set, as follows:

[0041] 1.1) Obtain the public face data set AFLW. The AFLW face data set has about 25,000 pictures, and each picture is marked with the coordinates of feature points such as the face and the cente...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fast human eye tracking method based on a convolutional neural network, comprising the steps of: 1) making a human eye tracking data set and a human eye verification data set; 2) using the human eye tracking data set to train a human eye tracking convolution network , using the human eye verification data set to train the human eye verification convolutional network, the training method is the small batch gradient descent method with momentum, and the loss function is the mean square error; 3) Obtain the initial human eye position in the video; 4) Use the human eye Track the human eye in subsequent video frames by the tracking convolutional network; 5) Use the human eye verification convolutional network to verify whether the human eye tracking result is accurate; 6) If step 5) determines that the human eye tracking result is inaccurate, then re-enter step 3 ) to obtain the initial human eye position; if it is accurate, read the next video frame and return to step 4) to continue tracking the human eye. The present invention breaks through the problems of high error rate and slow speed of the existing tracking method, which cannot deal with complicated real scenes.

Description

technical field [0001] The invention relates to the technical field of image recognition, in particular to a fast human eye tracking method based on a convolutional neural network. Background technique [0002] Eye detection and tracking is a necessary step in face recognition, expression recognition, eye movement analysis, iris recognition, fatigue detection and other technologies, and has extensive application and research significance. [0003] In recent years, the convolutional neural network has made a qualitative improvement in the technical performance of computer vision and image recognition, and the accuracy of computer vision tasks such as target detection, target recognition, and target classification has greatly surpassed previous technologies, even surpassing the human eye. However, there are very few researches and inventions on the use of convolutional neural networks for tracking human eyes. Therefore, this paper invents a convolutional neural network for tra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/165G06V40/19G06N3/045
Inventor 张凌吴家贤
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products