Sight line estimation method, system and device and storage medium

A technique of line-of-sight estimation and vector estimation, applied in the field of line-of-sight estimation, can solve the problems of poor user experience, low estimation accuracy, strong scene dependence, etc., and achieve the effect of reasonable line-of-sight direction estimation

Pending Publication Date: 2021-07-09
SUN YAT SEN UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Line of sight estimation technology is a technology that studies how to accurately track human visual direction and visual attention. Line of sight estimation technology has a wide range of application scenarios and great application value in real life. It can be applied in cognitive science, psychology, medical research, Car driving, entertainment, advertising and marketing research and other fields bring convenience to people's lives and comprehensively improve the level of social science and technolog

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sight line estimation method, system and device and storage medium
  • Sight line estimation method, system and device and storage medium
  • Sight line estimation method, system and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. For the step numbers in the following embodiments, it is only set for the convenience of illustration and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art sexual adjustment.

[0053] refer to figure 1 and figure 2 , the present invention provides a line of sight estimation method, the method comprising the following steps:

[0054] S1. Obtain a face image and perform key point detection and 3D model fitting processing to obtain a human eye image and a 3D head rotation vector;

[0055] S2. Data normalization is performed on the human eye image and the 3D head rotation vector to obtain the normalized human eye image and the head pose estimation vector;

[0056] S3. Input the normalized h...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sight line estimation method, system and device and a storage medium, and the method comprises the steps: obtaining a face image, and carrying out the key point detection and 3D model fitting processing, and obtaining a human eye image and a 3D head rotation vector; performing data regularization on the human eye image and the 3D head rotation vector to obtain a regularized human eye image and a head posture estimation vector; and inputting the regularized human eye image and the head posture estimation vector into a pre-trained CNN network, and converting network output into a 3D sight line direction vector. The system comprises an image preprocessing module, a data regularization module and a result output module. The device comprises a memory and a processor used for executing the sight line estimation method. According to the invention, a high-precision sight line estimation result can be obtained. The sight line estimation method, system and device and the storage medium can be widely applied to the field of sight line estimation.

Description

technical field [0001] The present invention relates to the field of line of sight estimation, in particular to a line of sight estimation method, system, device and storage medium. Background technique [0002] Line of sight estimation technology is a technology that studies how to accurately track human visual direction and visual attention. Line of sight estimation technology has a wide range of application scenarios and great application value in real life. It can be applied in cognitive science, psychology, medical research, Car driving, entertainment, advertising and marketing research and other fields bring convenience to people's lives and comprehensively improve the level of social science and technology. With the continuous improvement of optical imaging technology and image processing capabilities, especially the development of computer vision, image-based line of sight Estimation methods have begun to become dominant. The current line-of-sight estimation methods ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/161G06N3/045
Inventor 梁姗姗张航
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap