Unlock instant, AI-driven research and patent intelligence for your innovation.

A method, device and system for line of sight estimation

A technology of line-of-sight estimation and gaze direction, which is applied in the field of line-of-sight estimation to achieve the effect of accurate detection

Active Publication Date: 2020-09-22
BEIJING 7INVENSUN TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved in this application is to provide a method, device and system for line of sight estimation, so that even when the gaze direction of the human eye deviates too much from the optical axis of the camera and the camera cannot capture the two spots, it can detect The gaze direction or gaze point of the human eye can be detected, so that the gaze direction and gaze point in a wide range can be detected

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method, device and system for line of sight estimation
  • A method, device and system for line of sight estimation
  • A method, device and system for line of sight estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0063] After research, the inventor found that in some application functions, it is necessary to track and detect the line of sight of the user's eyes (represented by the gaze direction and / or gaze point). The existing human eye detection methods include corneal reflection method, that is, through the irradiation of two light sources, two specularly reflected light spots are generated on the human eye cornea in the human eye image collected by the camera. The two light spots on the cornea can analyze the gaze point and gaze direction. However, if the gaze direction of the human eye deviates too much from the optical axis of the camera, then the human eye image collected by the camera may not produce two ideally shaped light spots, so that the existing corneal reflection method cannot detect the human eye. gaze direction and gaze point.

[0064] Based on this, in the embodiment of the present application, in order to be able to detect the gaze direction and gaze point in a lar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application discloses a method, device and system for line of sight estimation. By collecting the current human eye image in real time, the pupil shape information used to describe the geometric parameters imaged by the elliptical pupil is analyzed from the current human eye image. Use the two-dimensional pupil shape information analyzed by the pupil imaging to calculate the normal direction of the plane where the pupil is located in the three-dimensional world coordinate system, and record it as the direction of the optical axis of the human eye; then compensate the direction of the optical axis of the human eye with a preset compensation angle to obtain the visual axis direction, that is, the gaze direction and / or gaze point corresponding to the current human eye image can be determined according to the visual axis direction of the human eye. In this way, by quantifying the pupil shape information in the current human eye image, calculating and compensating to determine the gaze direction and / or gaze point of the human eye, real-time, accurate detection.

Description

technical field [0001] The present application relates to the technical field of eye control, and in particular to a method, device and system for visual line estimation. Background technique [0002] Eye control technology, also called line of sight estimation technology, can track and detect the line of sight of the human eye, so that the line of sight of the human eye can be used to realize some application functions. Wherein, the line of sight of the human eye may be the gaze direction of the human eye or the gaze point of the human eye. Currently, gaze direction and gaze point are usually detected by corneal reflectometry. Specifically, a pair of light sources are deployed on both sides of a camera for capturing human eye images. Since the cornea of ​​the human eye can be approximately considered as a spherical mirror, when a pair of light sources shine on the cornea, two specularly reflected light spots will be generated on the cornea, so that the two light spots can...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06T7/73
CPCG06T7/73G06T2207/30196G06V40/193G06V40/18
Inventor 付阳王云飞黄通兵
Owner BEIJING 7INVENSUN TECH