3D human body model generation method and system and related equipment

Abstract

The embodiment of the invention provides a 3D human body model generation method and system and related equipment, and aims to generate a 3D human body model based on a 2D image and reduce the construction cost of the 3D human body model. The method provided by the embodiment of the invention comprises the following steps: constructing a parameter estimation network of a 3D face model, and training the parameter estimation network by adopting a 2D face image in a preset training set to obtain an optimized 3D face model; constructing a preliminary mapping network of a 2D face image mapping 3D human body model; migrating knowledge learned by the optimized 3D face model to the preliminary mapping network to generate a 3D human body transformation network from a 2D face image to a 3D human body model; and receiving a target 2D face image, and generating a corresponding 3D human body model by adopting the 3D human body transformation network.

Description

technical field [0001] The invention relates to the technical field of 3D human body model generation, in particular to a 3D human body model generation method, system and related equipment. Background technique [0002] With the rapid iteration of communication technology and the rapid rise of extended reality technology, people hope to interact with the outside world in a more comprehensive way. For example, in VR, MR and online fitting scenarios, people hope to achieve high-quality 3D information collection and interaction. [0003] At present, the technology to directly realize high-quality acquisition of 3D information is not yet mature. Whether it is an indirect modeling solution using a laser scanner or a direct modeling solution using a color scanner, expensive hardware costs are required. At the same time, these solutions all have the problem of unsatisfactory direct scanning effects and subsequent manual adjustments, which further increase the cost of 3D modeling....

AI Technical Summary

Problems solved by technology

[0003] At present, the technology to directly realize the high-quality acquisition of 3D information is not yet mature. Whether it is an indirect modeling scheme using a laser scanner or a direct modeling scheme directly using a color scanner, expensive hardware costs are required

At the same time, these solutions all have the problem of unsatisfactory direct scanning effects and need for subsequent manual adjustments, which further increases the cost of 3D modeling. These two solutions basically lose the possibility of large-scale promotion at this stage

Images