Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

3D face image reconstruction method and device and compute readable storage medium

A three-dimensional face and image reconstruction technology, applied in the field of three-dimensional reconstruction, can solve the problem that the face does not conform to the real results.

Active Publication Date: 2019-01-11
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem solved by this disclosure is to provide a three-dimensional face image reconstruction method to at least partially solve the technical problem that the reconstructed face does not conform to the real result

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D face image reconstruction method and device and compute readable storage medium
  • 3D face image reconstruction method and device and compute readable storage medium
  • 3D face image reconstruction method and device and compute readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0090] Embodiments of the present disclosure are described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Apparently, the described embodiments are only some of the embodiments of the present disclosure, not all of them. The present disclosure can also be implemented or applied through different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection sc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 3D face image reconstruction method, a 3D face image reconstruction device, a three-dimensional face image reconstruction hardware device and a computer-readable storage medium. The 3-D face image reconstruction method comprises the steps of acquiring real 2D face key points and predicting 2D face key points; iteratively optimizing the expression coefficients by solving the first loss function which is composed of the real 2D face key points, the predicted 2D face key points and the preset additional regular constraint terms. The expression coefficients are used to represent the real state of the face, and the 3D face image is reconstructed according to the expression coefficients. The expression coefficients are optimized iteratively by the first loss function which is composed of the predicted two-dimensional face key points and the preset additional regular constraint terms to constrain the expression coefficients, so that the expression coefficients can represent the real state of the face, and the 3D face image reconstruction technology can be optimized to obtain the real state of the face.

Description

technical field [0001] The present disclosure relates to the technical field of three-dimensional reconstruction, in particular to a three-dimensional facial image reconstruction method, device and computer-readable storage medium. Background technique [0002] With the improvement of equipment computing power and the development of 3D technology, 3D face has attracted more and more attention from academia and industry, and its application fields have become more and more extensive. 3D reconstruction technology is the source technology of 3D technology. Traditional 3D reconstruction technology relies on high-precision laser radar or multi-view 3D reconstruction. Although these methods are reliable, lidar has high requirements for equipment, and multi-view 3D reconstruction relying on feature point matching is quite time-consuming. Therefore, restoring a 3D model from a single image has become a research hotspot. 3D face image reconstruction can be used in face changing, exp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/50G06T19/20
CPCG06T7/50G06T19/20G06T2207/20081G06T2207/20084G06T2200/04G06T2207/30196G06V20/653G06V20/647G06V40/175G06V40/166G06V40/168G06T17/00G06T15/00G06T2215/16G06T2219/2016G06V40/172G06V40/174
Inventor 陈志兴
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products