Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and device for line-of-sight estimation

A line of sight estimation and line-of-sight feature technology, applied in the field of line-of-sight estimation, can solve the problems of poor head motion adaptability, poor stability, and low line-of-sight estimation accuracy, and achieve the goal of improving head motion adaptability, accuracy and stability. Effect

Active Publication Date: 2017-07-18
HANVON CORP
View PDF1 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Regarding the above-mentioned line of sight estimation method, the inventors found that there are at least the following problems in the prior art: the appearance-based line of sight estimation method extracts the appearance features of the entire eye, so it has poor adaptability to head movement; the line of sight estimation method based on PCCR technology only extracts the center of the pupil and the location information of bright spots, resulting in low accuracy and poor stability of line of sight estimation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for line-of-sight estimation
  • A method and device for line-of-sight estimation
  • A method and device for line-of-sight estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054]The method and device for line of sight estimation provided by the embodiments of the present invention will be described exemplarily below with reference to the accompanying drawings.

[0055] The line of sight estimation method provided by the embodiment of the present invention can be applied to scenes with dual light sources or multiple light sources. scene, the test sample is also a scene containing dual light sources, etc. Since the specific implementation manner in a multi-light source scenario is based on the implementation manner in a dual-light-source scenario, the following embodiments describe that the line-of-sight estimation method is applied to a scenario with dual-light sources.

[0056] see figure 1 , is a line of sight estimation method provided by an embodiment of the present invention, which is applied to a scene containing at least two light sources, and the method includes:

[0057] 101: Obtain an eye appearance descriptor and a pupil center corne...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present invention discloses a method and device for line of sight estimation, which is applied to scenes containing at least double bright spots, relates to the fields of computer vision and image processing, and is used to improve the adaptability to head movement and improve the accuracy of line of sight estimation and stability. The method provided by the embodiment of the present invention includes: obtaining the eye appearance descriptor and the pupil center corneal reflection PCCR descriptor based on double bright spots; performing feature fusion on the eye appearance descriptor and the PCCR descriptor to obtain a mixed line of sight feature descriptor, a mixed line of sight The feature descriptor includes the mixed line of sight feature descriptor of the training sample and the mixed line of sight feature descriptor of the test sample; the viewpoint estimation of the test sample is performed according to the mixed line of sight feature descriptor of the training sample, and the viewpoint coordinates of the test sample are obtained.

Description

technical field [0001] The present invention relates to the field of computer vision and image processing, in particular to a method and device for line of sight estimation. Background technique [0002] Line of sight estimation is used to determine the gaze direction (Gaze direction) or specific viewpoint (Point of regard, referred to as PoR), and has great applications in many fields such as psychology, market analysis, advertising analysis, medical research, and human-computer interaction. value. [0003] At present, commonly used gaze estimation methods include Appearance-based methods and Feature-based methods. The appearance-based method specifically includes: locating the eye area; establishing the mapping relationship between the eye image and the coordinates of the viewpoint on the screen; and completing the line of sight estimation through the mapping function. The most commonly used feature-based method is the line-of-sight estimation method based on Pupil Cente...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
Inventor 黄磊熊春水
Owner HANVON CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products