Large-scale three-dimensional face synthesis system for sample similarity suppression

A three-dimensional face and similarity technology, applied in the field of three-dimensional face reconstruction, can solve the problem that the optimization model does not consider the special requirements of face data privacy, and achieve the effect of meeting the special requirements of privacy and improving computing power.

Active Publication Date: 2020-10-09
EAST CHINA JIAOTONG UNIVERSITY
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to overcome the existing three-dimensional human face synthesis model in the prior art, which only focuses on the optimization model and does not take into account the special requirements for the privacy of human face data required by the three-dimensional human face synthesis model technology,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale three-dimensional face synthesis system for sample similarity suppression
  • Large-scale three-dimensional face synthesis system for sample similarity suppression
  • Large-scale three-dimensional face synthesis system for sample similarity suppression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] figure 1 A large-scale three-dimensional face synthesis system for sample similarity suppression according to an exemplary embodiment of the present invention is shown, including:

[0043] A three-dimensional scanning device, configured to acquire a three-dimensional face model and its point cloud data, and output them to the first processing module;

[0044] The first processing module is configured to preprocess the acquired 3D face model to obtain a first 3D face model set; and output the first 3D face model set to the second processing module and the The third processing module;

[0045] The second processing module is used to configure a large-scale three-dimensional face synthesis network model (the large-scale three-dimensional face synthesis network model is a trained generative confrontation network model fused with a self-attention network), the scale three-dimensional face synthesis network The model can synthesize a three-dimensional face model according t...

Embodiment 2

[0054] In a further embodiment of the present invention, a large-scale three-dimensional face synthesis method with sample similarity suppression is also provided, including:

[0055] Step 1, using a 3D scanning device to obtain a 3D face model, and preprocessing the obtained 3D face model through the first processing module, to obtain the following: image 3 The first three-dimensional face model set shown, and output to the second processing module and the third processing module

[0056] Step 2, the large-scale 3D face synthesis network model configured in the second processing module, input the first 3D face model set to the large-scale 3D face synthesis network model to synthesize the 3D face model, and obtain the following: Figure 5 The synthetic three-dimensional human face model shown is output to the third processing module;

[0057] Simultaneously, the third processing module down-samples the first three-dimensional face model set to obtain the following Figure 4...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-scale three-dimensional face synthesis system for sample similarity suppression. The system comprises three-dimensional scanning equipment which is used for obtaining athree-dimensional face model and point cloud data thereof; the first processing module is used for preprocessing the acquired three-dimensional face model and the point cloud data thereof; the secondprocessing module is used for synthesizing the human face three-dimensional model to obtain a synthesized three-dimensional human face model; and the third processing module is used for carrying outsimilarity detection on the synthesized three-dimensional face model and the sampled three-dimensional face model set so as to output the synthesized three-dimensional face model meeting the similarity requirement. According to the system, on the basis of carrying out three-dimensional face model synthesis; the problem of data privacy required to be considered by a three-dimensional face model synthesis technology is fully considered, and the similarity between a synthesis model and a real acquired face model is suppressed by designing a similarity test model, so that an output three-dimensional face synthesis result can meet the special requirement of face data privacy.

Description

technical field [0001] The invention relates to the technical field of three-dimensional face reconstruction, in particular to a large-scale three-dimensional face synthesis system with sample similarity suppression. Background technique [0002] At the World Virtual Reality Industry Conference in October 2018, Professor Huang Tiejun of Peking University pointed out that traditional two-dimensional images and videos are not the real visual media for the human visual nervous system to observe the world. It can be seen that the research on 3D models is more in line with the objective existence of human observation objects. Among common 3D model data, 3D face model data has been widely used in many fields such as games, film and television, and virtual human simulation in simulation systems due to the individual identity representation of 3D face models, the special attributes of personal images and interactive portals. For example, the widely known faceID technology for Apple...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/20G06K9/62G06T7/50
CPCG06T17/20G06T7/50G06T2207/10028G06T2207/20081G06T2207/20084G06T2207/30201G06F18/22
Inventor 罗国亮陈强王睿肖美华杨辉肖乾陈梦成黄晓生
Owner EAST CHINA JIAOTONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products