Sight line tracking method and device, equipment and storage medium

A technology of eye-tracking and line-of-sight, applied in the field of image processing, which can solve problems such as long tracking time and reduced user experience, and achieve the effects of enhancing user experience, improving eye-tracking efficiency, and reducing eye-tracking time

Pending Publication Date: 2020-12-18
北京七鑫易维科技有限公司 +1
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the number of calibration points that the user gazes at is usually 9 or 16. Due to the large number of calibration points, it takes a long time to track the user's gaze each time, which reduces the user experience.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sight line tracking method and device, equipment and storage medium
  • Sight line tracking method and device, equipment and storage medium
  • Sight line tracking method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Figure 1A It is a schematic flowchart of a gaze tracking method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation where gaze tracking is performed on a gazing user, and the method may be executed by a gaze tracking device, which is implemented by software and / or hardware and configured in a terminal device. The gaze tracking method includes:

[0031] S110. Obtain an infrared thermal image and user status information when the user is gazing.

[0032] Wherein, the infrared thermal imaging image includes an image of heat or temperature radiated by the user's eye area. Wherein, the eye area may include the pupil, iris, white of the eye, upper eyelid and lower eyelid.

[0033] In nature, all objects above absolute zero (-273°C) can radiate infrared rays. Therefore, when the user looks at the display plane, there is also a difference between the infrared radiant heat of the user and the background, so that an infrared therma...

Embodiment 2

[0063] figure 2 It is a schematic flow chart of a gaze tracking method provided by Embodiment 2 of the present invention. The embodiments of the present invention further refine and add on the basis of the technical solutions of the above-mentioned embodiments.

[0064] Further, after the feature "determine gaze information based on the feature information and the pre-stored line-of-sight calibration data", "update the pre-stored line-of-sight calibration data according to the feature information and the user status information" is added to Realize the update with the pre-stored line of sight calibration data.

[0065] Further, after the feature "acquire the infrared thermal imaging image when the user is gazing", add "based on the infrared thermal imaging image, determine the infrared thermal imaging eye pattern when the user is gazing" to limit the acquisition of the infrared thermal imaging image Timing, and further improve the acquisition method of infrared thermal imagi...

Embodiment 3

[0105] image 3 It is a schematic structural diagram of a gaze tracking device provided in Embodiment 3 of the present invention. This embodiment is applicable to the situation where gaze tracking is performed on a gazing user, and the device includes: an acquisition module 310 , a characteristic information determination module 320 , a calibration data search module 330 and a gaze information determination module 340 .

[0106] Wherein, the obtaining module 310 is used to obtain the infrared thermal imaging map and user state information when the user is gazing; wherein, the user state information includes user position information;

[0107] A feature information determining module 320, configured to determine corresponding feature information based on the temperature values ​​of each pixel in the infrared thermal imaging image;

[0108] Calibration data search module 330, configured to obtain pre-stored line-of-sight calibration data corresponding to the user position infor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a sight tracking method and device, equipment and a storage medium. The method comprises the following steps: acquiring an infrared thermal imaging eye pattern and user state information when a user watches; determining corresponding feature information based on the temperature value of each pixel point in the infrared thermal imaging eye pattern; acquiring pre-stored sight calibration data corresponding to user position information included in user state information; and determining gaze information based on the feature information and pre-stored gazecalibration data. By adopting the technical scheme, the technical problem of long sight line tracking time consumption caused by the fact that a user needs to gaze a plurality of calibration points in advance for sight line calibration during sight line tracking is solved, the sight line tracking time is shortened, the sight line tracking efficiency is improved, and meanwhile, the use experienceof the user is enhanced.

Description

technical field [0001] Embodiments of the present invention relate to the field of image processing, and in particular, to a gaze tracking method, device, equipment, and storage medium. Background technique [0002] Eye-tracking technology, also known as eye-tracking technology, mainly estimates the gaze and / or fixation position of the eyes by measuring eye movement data. With the development of human-computer interaction technology, the technology of using eye-tracking technology to control the display screen for operation is gradually mature. [0003] In the prior art, it is usually necessary for the user to gazing at several calibration points on the display screen to perform line-of-sight calibration, so as to obtain eye images when the user gazing at each gaze point on the display screen, according to the image characteristics of each eye image and each The position of the calibration point corresponding to the eye diagram determines a gaze point mapping function for e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/19G06V40/193
Inventor 赵海杰王云飞黄通兵
Owner 北京七鑫易维科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap