Unlock instant, AI-driven research and patent intelligence for your innovation.

Image recognition method and device based on eyeball tracking and storage medium

An image recognition and eye tracking technology, applied in the field of image processing, can solve the problems of ignoring details, poor user experience, one-way, etc., and achieve the effect of improving interactivity and user experience

Inactive Publication Date: 2021-05-28
GUANGZHOU LANGO ELECTRONICS TECH CO LTD
View PDF10 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, eye tracking is a technology that captures eye movement information, models and simulates it, and then estimates the direction of sight or the position of the eye's fixation point. Through eye tracking technology, it is possible to better understand human reactions to certain things; however, now Some eye-tracking technologies are commonly used to reflect the position of the user's focus when seeing an object through eye-tracking, but this process is one-way, making the existing eye-tracking technology less interactive
In addition, the existing eye tracking technology only converts the user's eye movement trajectory into a moving path in computer language, and cannot read the characteristics of the things the user is currently paying attention to, so that many details in the image are ignored, causing users to The user experience is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image recognition method and device based on eyeball tracking and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] This embodiment provides an image recognition method based on eye tracking. By using this method, more detailed features in the image that cannot be noticed by the naked eye can be read, and the interaction degree of the eye tracking technology can also be improved, and the user's sense of experience and sense of use can be improved. Interesting.

[0032] Such as figure 1 As shown, the image recognition method based on eye tracking in this embodiment specifically includes the following steps:

[0033] Step S1: collecting image data, and establishing a virtual image model according to the image data.

[0034] Wherein, the image data includes two-dimensional image data and three-dimensional image data, a two-dimensional virtual image model is established according to the two-dimensional image data, and a three-dimensional virtual image model is established according to the three-dimensional image data. The image data can be the image data of a single object, or it can b...

Embodiment 2

[0050] This embodiment provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, the first embodiment is implemented. The image recognition method based on eye tracking; in addition, this embodiment also provides a storage medium on which a computer program is stored, and when the computer program is executed, the above image recognition method based on eye tracking is realized.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image recognition method and device based on eyeball tracking and a storage medium, and the recognition method comprises the steps: S1, collecting image data, and building a virtual image model according to the image data; s2, collecting eye movement data, judging whether the fixation duration of any coordinate in the virtual image model exceeds a preset duration or not according to the eye movement data, and if yes, marking the coordinate as a reference point and recording the marking time for the reference point; s3, sequentially connecting the plurality of datum points according to the marking time of the datum points, judging whether the connecting lines among the plurality of datum points form a closed area or not, and if so, marking the closed area as a datum area; and S4, performing image recognition on the reference region in the virtual image model to generate feature information of the reference region. According to the invention, the interactivity of the eyeball tracking technology can be improved, and meanwhile, the user experience is improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an image recognition method, device and storage medium based on eye tracking. Background technique [0002] At present, eye tracking is a technology that captures eye movement information, models and simulates it, and then estimates the direction of sight or the position of the eye's fixation point. Through eye tracking technology, it is possible to better understand human reactions to certain things; however, now Some eye tracking technologies are generally used to reflect the position of the user's attention point when seeing a certain object through eye tracking, but this process is one-way, which makes the existing eye tracking technology less interactive. In addition, the existing eye tracking technology only converts the user's eye movement trajectory into a moving path in computer language, and cannot read the characteristics of the things the user is curr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06T17/00
CPCG06F3/013G06T17/00G06V20/64
Inventor 谭贵勇岑加堂
Owner GUANGZHOU LANGO ELECTRONICS TECH CO LTD