Text-based three-dimensional voxel model generation method

Abstract

The invention discloses a text-based three-dimensional voxel model generation method, and belongs to the field of cross-modal generation from a text to a three-dimensional voxel model. The method comprises the following steps of: processing a natural language into a text vector which can be understood by a computer through a text encoder; enabling a generator to obtain the capability of generating a matched text description model through a conditional generative adversarial network framework; using discriminators for reconstructing model labels to guide the generator to train and generate a more delicate model; making the generator generate three-dimensional voxel models under different resolutions in different stages, transmitting the three-dimensional voxel models to the discriminators in different stages, and performing combined training on results, so as to enable the generator to cope with a high-resolution model generation task, and the generated model to be more exquisite; adding a local discriminator into a high-resolution model discriminator, so as to improve the high data volume and model detail processing capability of the high-resolution model discriminator, and improve the delicacy and resolution of a three-dimensional voxel model generation result. The method has the advantages of wide applicability and good generation effect.

Description

technical field [0001] The invention relates to a method for generating a color three-dimensional voxel model based on text, and belongs to the field of cross-modal generation from text to three-dimensional voxel model. Background technique [0002] In recent years, with the rapid development of computer technology, technologies such as computer graphics and virtual reality have become more popular in production and life, the application scenarios of 3D models have increased significantly, and people's demand for color 3D models has also increased significantly. There are a large number of application scenarios in production and life, such as 3D games, furniture design, visualization of design-oriented educational resources, etc. However, the current 3D model production work is highly dependent on model building tools such as CAD and the modeling ability of the manufacturer. This ability is not popular in society, and people are not able to mass-produce it. This work is ver...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the problem that the generated three-dimensional voxel model is not refined enough and the resolution is low, the technical problem to be solved by a text-based three-dimensional voxel model generation method disclosed in the present invention is: processing natural language into computer The text vector that can be understood; the conditional generation against the network framework enables the generator to obtain the ability to generate a matching text description model; by reconstructing the discriminator of the model label, it guides the generator to train to generate a more refined model; Generate 3D voxel models at different resolutions, pass the 3D voxel models to discriminators at different stages, and conduct joint training on the results, so that the generator can cope with high-resolution model generation tasks and the generated models are more refined ; By adding a local discriminator to the high-resolution model discriminator, it can improve its ability to process high data volume and model details, and improve the refinement and resolution of the 3D voxel model generation results

Images