Gaze estimation method and gaze estimation device

A line of sight estimation and line-of-sight feature technology, applied in the field of line-of-sight estimation, can solve the problems of poor stability, poor adaptability to head motion, and low accuracy of line-of-sight estimation, so as to improve accuracy and stability and improve head motion adaptability. Effect

Active Publication Date: 2014-12-03
HANVON CORP
View PDF1 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Regarding the above-mentioned line of sight estimation method, the inventors found that there are at least the following problems in the prior art: the appearance-based line of sight estimation method extracts the appearance features of the entire eye, so it has poor adaptability to head movement; the line of sight estimation method based on PCCR technology only extracts the center of the pupil and the location information of bright spots, resulting in low accuracy and poor stability of line of sight estimation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gaze estimation method and gaze estimation device
  • Gaze estimation method and gaze estimation device
  • Gaze estimation method and gaze estimation device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054]The method and device for line of sight estimation provided by the embodiments of the present invention will be described exemplarily below with reference to the accompanying drawings.

[0055] The line of sight estimation method provided by the embodiment of the present invention can be applied to scenes with dual light sources or multiple light sources. scene, the test sample is also a scene containing dual light sources, etc. Since the specific implementation manner in a multi-light source scenario is based on the implementation manner in a dual-light-source scenario, the following embodiments describe that the line-of-sight estimation method is applied to a scenario with dual-light sources.

[0056] see figure 1 , is a line of sight estimation method provided by an embodiment of the present invention, which is applied to a scene containing at least two light sources, and the method includes:

[0057] 101: Obtain an eye appearance descriptor and a pupil center corne...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a gaze estimation method and a gaze estimation device applied to a scene at least including double glints, relates to the field of computer vision and image processing, and is used for improving the adaptability to the head movement and improving the precision and the stability of the gaze estimation. The method provided by the embodiment of the invention comprises the following steps: obtaining an eye appearance descriptor and a PCCR (Pupil Center-Cornea Reflection) descriptor based on the double glints; carrying out feature fusion on the glints-centered descriptor and the PCCR descriptor to obtain a mixed gaze feature descriptor, wherein the mixed gaze feature descriptor comprises a mixed gaze feature descriptor of a training sample and a mixed gaze feature descriptor of a test sample; and carrying out PoR (Point of Regard) estimation on the test sample according to the mixed gaze feature descriptor of the training sample to obtain the PoR coordinate of the test sample.

Description

technical field [0001] The present invention relates to the field of computer vision and image processing, in particular to a method and device for line of sight estimation. Background technique [0002] Line of sight estimation is used to determine the gaze direction (Gaze direction) or specific viewpoint (Point of regard, referred to as PoR), and has great applications in many fields such as psychology, market analysis, advertising analysis, medical research, and human-computer interaction. value. [0003] At present, commonly used gaze estimation methods include Appearance-based methods and Feature-based methods. The appearance-based method specifically includes: locating the eye area; establishing the mapping relationship between the eye image and the coordinates of the viewpoint on the screen; and completing the line of sight estimation through the mapping function. The most commonly used feature-based method is the line-of-sight estimation method based on Pupil Cente...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
Inventor 黄磊熊春水
Owner HANVON CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products