Three-dimensional human face sight line calculation method

A technology of 3D face and calculation method, which is applied in the field of 3D face reconstruction and line of sight estimation, which can solve the problems of poor line of sight accuracy and low visual quality of eye area images

Pending Publication Date: 2022-02-15
BEIHANG UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, all existing methods focus on directly changing the texture or shape of the eye region to achieve eye contact, which has two main limitations. One is that the reconstructed eye region image is still of low visual quality.
But the accuracy of line-of-sight contact is still poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional human face sight line calculation method
  • Three-dimensional human face sight line calculation method
  • Three-dimensional human face sight line calculation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these examples are provided so that the understanding of this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

[0042] It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings. In the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0043] It should be noted that conc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three-dimensional human face sight line calculation method. A three-dimensional human face is accurately reconstructed, so that the sight line direction of the human face is accurately calculated. According to the method, a sight line direction calculation task is decomposed into two sub-tasks of sight line aligned three-dimensional face reconstruction and sight line contact realized through rotation. The method comprises the steps: reconstructing a basic three-dimensional face by using a three-dimensional deformation model and taking a two-dimensional reference face image as input; performing shape adjustment on the basic three-dimensional face to obtain a three-dimensional reconstructed face with an aligned shape so as to ensure that the eye region of the three-dimensional face is accurately aligned with the eye region of the input reference two-dimensional face image; and finally, acquiring the three-dimensional face with the aligned sight lines by replacing the texture of the eye region of the three-dimensional face with the aligned shape. For the sub-task of sight line contact, the invention provides a brand-new method for realizing sight line contact by rotating the three-dimensional face, and the method does not depend on excessive hypotheses and can be widely applied to the field of virtual reality.

Description

technical field [0001] The invention relates to the technical field of three-dimensional human face reconstruction and line of sight estimation, and relates to a method for calculating a three-dimensional human face line of sight. Background technique [0002] For a long time, 3D face reconstruction has been the most popular research field in computer vision and computer graphics. A large number of existing works use single face images, multi-view images, video RGBD images and specific target image sets as input. Complete the reconstruction of 3D face. The present invention focuses on three-dimensional human face reconstruction using a two-dimensional reference human face image as an input to complete line-of-sight alignment, which has wide applications in the field of line-of-sight calculation and virtual reality. As a novel way of human-computer interaction, gaze tracking technology is of great significance for understanding user behavior intentions. More than 80% of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T19/20G06N3/04G06N3/08
CPCG06T17/00G06T19/20G06N3/08G06T2219/2016G06N3/045G06T17/20G06V10/454G06V10/82G06V40/193G06V20/64G06V40/168G06T15/04
Inventor 陆峰梁家栋
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap