Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pixel-level precision human eye fixation point positioning method

A positioning method and gaze point technology, applied in three-dimensional object recognition, instrument, character and pattern recognition, etc., can solve the problem of difficult popularization of sensor equipment, and achieve the effect of increasing practicability, enhancing user experience, and eliminating limitations.

Pending Publication Date: 2021-02-05
北京中科虹星科技有限公司
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method has high accuracy, it is limited by expensive sensor equipment and is difficult to popularize.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pixel-level precision human eye fixation point positioning method
  • Pixel-level precision human eye fixation point positioning method
  • Pixel-level precision human eye fixation point positioning method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0030] figure 1 The embodiment of the present invention provides a flow chart of a method for locating the fixation point of human eyes with pixel-level precision, and the method includes the following steps:

[0031] Step S1, build face key point detection and pose estimation network model:

[0032] Specifically, S1.1 selects the basic network resnet18 network as the backbone (backbone network), returns 468 3D face key points, and constructs face key points and head pose data (such as figure 2 As shown, the left picture is a spatial schematic diagram of 468 3D key points, and the right picture is the rendering of the 3D key points projected onto the face image): Based on the 98 key point data set, the head pose is calc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pixel-level precision human eye fixation point positioning method. The method comprises the steps of calculating the gradient of an eye region image after passing through a key point of a depth network, and further correcting the central position of a pupil. Compared with an existing sight line estimation method, the pupil center position can be positioned more accurately, and especially under the condition that head or eyeball offset is large. According to the embodiment of the invention, the sight line estimation precision can be effectively improved, and the position of an implementation fixation point of a user is further positioned. In addition, the distance from the eyes to the screen is estimated through the deep network, and then the fixation point of theuser on the screen is estimated. And compared with a pupil corneal reflex method, only a single network camera is adopted, so that the equipment cost is greatly reduced. Compared with an existing single-image processing method, the method does not need to limit the posture of the head, and the robustness of the algorithm is greatly improved. Through matching with the 3D face model, the limitationproblem that an existing database cannot represent all postures is solved, and the practicability of the method is improved.

Description

technical field [0001] Embodiments of the present invention relate to a method for locating a gaze point of a human eye with pixel-level precision, and in particular to a method for locating a gaze point of a human eye with pixel-level precision. Background technique [0002] With the development of computer science, human-computer interaction has gradually become a hot field. The sight of the human eye can reflect the information that people pay attention to, and it is also an important source of information input in human-computer interaction. Human-computer interaction based on line-of-sight estimation has broad prospects for development in military, medical, entertainment and other fields. [0003] Generally speaking, sight line estimation methods can be divided into two categories: Geometry Based Methods and Appearance Based Methods. The basic idea of ​​the geometry-based method is to detect some features of the eyes (such as key points such as eye corners and pupil p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V20/64G06V40/172G06V40/10G06V40/197
Inventor 李海青罗智侯广琦
Owner 北京中科虹星科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com