Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, apparatus, device and storage medium for realizing eyeball three-dimensional line-of-sight tracking

A gaze tracking, eyeball technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve the problem of only detecting two-dimensional information of the eyeball

Active Publication Date: 2019-03-22
GUANGDONG UNIV OF TECH
View PDF10 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The object of the present invention is to provide a method, device, equipment and computer-readable storage medium for realizing eyeball three-dimensional line of sight tracking, so as to solve the problems in the prior art based on deep learning. The problem that the eye tracking algorithm can only detect the two-dimensional information of the eye

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, apparatus, device and storage medium for realizing eyeball three-dimensional line-of-sight tracking
  • Method, apparatus, device and storage medium for realizing eyeball three-dimensional line-of-sight tracking
  • Method, apparatus, device and storage medium for realizing eyeball three-dimensional line-of-sight tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The core of the present invention is to provide a method, device, device and computer-readable storage medium for realizing eyeball three-dimensional line of sight tracking, which can obtain the three-dimensional line of sight vector of the eyeball through two-dimensional face images, and has a wide range of application scenarios.

[0044] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0045] Please refer to figure 1 , figure 1 It is a flow chart of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method, an apparatus, a device and a computer-readable storage medium for realizing eyeball three-dimensional line-of-sight tracking, which comprises the following steps: inputting a face image to be detected into a preset head posture detection network to obtain a head posture in the face image; Inputting the face image into a preset eye movement detection network to obtain the eye movement of the face image; The head posture and the eye movement are input to a pre-constructed three-dimensional line-of-sight vector detection network to obtain a three-dimensional line-of-sight direction vector of the eye in the face image. The method, the device, the device and the computer-readable storage medium provided by the invention can extract the three-dimensional line-of-sight direction vector of the eyeball of the photographed person from the two-dimensional face image, and have a wide range of application scenes.

Description

technical field [0001] The present invention relates to the technical field of eyeball tracking, in particular to a method, device, device and computer-readable storage medium for realizing eyeball three-dimensional line-of-sight tracking. Background technique [0002] The research on eye tracking algorithm has achieved relatively mature results, and has been successfully implemented in many commercial applications, such as VR / AR technology. Although traditional eye tracking technology can achieve high precision, the current eye tracking algorithm is basically It is based on the traditional image processing method, relies on expensive infrared equipment, and needs to install special detection equipment on the head to detect the characteristics of the eyeball. The detection accuracy of traditional image processing methods is affected by light changes, and the detection distance is severely restricted. Therefore, there is an urgent need for an algorithm that can realize eye t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/171G06V40/20G06N3/045
Inventor 张国生李东冯广章云
Owner GUANGDONG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com