An eyeball parameter calibration and sight line direction tracking method based on a three-dimensional eyeball model

A line-of-sight and parameter calibration technology, applied in the field of computer vision and graphics, can solve problems such as differences in imaging characteristics and occlusion, and achieve the effect of high-precision line-of-sight direction tracking

Active Publication Date: 2019-06-14
TSINGHUA UNIV
View PDF10 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the complete eyeball cannot be captured in the color video used by most methods, and most of it is blocked by the eyelids, the calculated line of sight direction is usually very different from the imaging characteristics of the real eyeball

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An eyeball parameter calibration and sight line direction tracking method based on a three-dimensional eyeball model
  • An eyeball parameter calibration and sight line direction tracking method based on a three-dimensional eyeball model
  • An eyeball parameter calibration and sight line direction tracking method based on a three-dimensional eyeball model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0024] The following describes the eyeball parameter calibration and gaze direction tracking method based on the three-dimensional eyeball model according to the embodiments of the present invention with reference to the accompanying drawings.

[0025] figure 1 It is a flow chart of a method for calibrating eyeball parameters and tracking gaze direction based on a three-dimensional eyeball model according to an embodiment of the present invention.

[0026] Such as figure 1 As shown, the eyeball parameter calibration and line of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an eyeball parameter calibration and sight line direction tracking method based on a three-dimensional eyeball model, and the method comprises the following steps: S1, fixing acharacter viewpoint in a three-dimensional space, shooting a face video, calibrating eye parameters of a character through the face video, and estimating the position of the character viewpoint at the same time; and S2, calculating viewpoint positions in any other facial videos of the character by utilizing the eye parameters to obtain a sight line direction, and tracking the sight line direction. According to the method, an energy function is established by utilizing a corresponding projection relation between a three-dimensional eyeball model and an eye image, eye parameters are calibrated,a sight line direction model closer to a real condition is established, and high-precision sight line direction tracking is realized.

Description

technical field [0001] The invention relates to the technical fields of computer vision and graphics, in particular to a method for calibrating eyeball parameters and tracking a line of sight direction based on a three-dimensional eyeball model. Background technique [0002] Human eye gaze tracking is an important and basic problem in the field of computer vision and computer graphics. It also has a very wide range of applications in the fields of human-computer interaction, virtual reality and augmented reality. For example, in computer vision, the gaze point of the human eye on the screen can be used to complete various human-computer interaction functions; in augmented reality, the gaze direction can be used to adjust the displayed content to produce a better sense of reality. It is precisely because the eyes can express the rich emotions of human beings that the research of human eye gaze tracking has extremely high scientific research and application value. [0003] Hi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
Inventor 徐枫温佺雍俊海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products