Three-dimensional model chartlet manufacturing method based on AIGC and related device

Abstract

The invention discloses a three-dimensional model chartlet making method based on AIGC and a related device, and relates to the technical field of content generation, and the method comprises the following steps: for a to-be-processed three-dimensional model, rendering the to-be-processed three-dimensional model based on an optimal observation visual angle selected by a user, and then rendering the to-be-processed three-dimensional model based on text description and a rendering result input by the user; redrawing the map of the to-be-processed three-dimensional model by using an AIGC tool to obtain a redrawn map of the current observation view angle; based on the uv graph of the to-be-processed three-dimensional model, reversely projecting the redrawn chartlet of the current observation visual angle to the to-be-processed three-dimensional model, and updating the to-be-updated area data; and then changing the current observation view angle and repeating the steps until the map redrawing of each observation view angle of the to-be-processed three-dimensional model is completed, and obtaining the three-dimensional model after the map redrawing is completed. According to the scheme provided by the invention, the advantages of the AIGC technology in the aspect of image generation are combined, the making efficiency of the three-dimensional model map is improved, and the cost is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of content generation, and particularly to a method for making 3D model textures based on AIGC and related devices. Background Art

[0002] With the continuous progress of AIGC (Artificial Intelligence Generated Content) technology, applications such as text-to-image and image-to-image have become increasingly mature and have begun to be widely used in multiple practical scenarios. However, most current application cases focus on the generation of two-dimensional images, and there is little involvement in the production of 3D model-related resources. Nevertheless, the demand for 3D model texture making is extremely large. Especially after the completion of 3D model mesh data, texture making often requires a large amount of time. Therefore, in the production process of 3D models, how to effectively utilize the powerful resource generation ability of AIGC technology has become a research topic of great practical significance. Summary of the Invention

[0003] The purpose of the present application is to provide a method for making 3D model textures based on AIGC and related devices, which can improve the production efficiency of 3D model textures and reduce costs.

[0004] To achieve the above purpose, the present application provides the following solutions:

[0005] In a first aspect, the present application provides a method for making 3D model textures based on AIGC, including the following steps:

[0006] Obtain a 3D model to be processed input by the user, and generate an initial texture and data of the area to be updated for the 3D model to be processed; the data of the area to be updated is a two-dimensional image with a resolution size exactly corresponding to the initial texture, and is used to represent the target redrawing area of the 3D model to be processed.

[0007] Obtain the best viewing angle selected by the user, and use the best viewing angle as the current viewing angle.

[0008] Based on the current viewing angle, render the 3D model to be processed to obtain an area map to be updated, an initial effect map of the 3D model to be processed, and a uv map; the area map to be updated is a two-dimensional image rendered based on the data of the area to be updated from the current viewing angle, and the area map to be updated is used to represent the target redrawing area of the 3D model to be processed from the current viewing angle.

[0009] Based on the text description input by the user, the initial effect map of the 3D model to be processed, and the area map to be updated, use an AIGC tool to redraw the texture of the 3D model to be processed to obtain a redrawn texture from the current viewing angle.

[0010] Based on the UV map of the 3D model to be processed, project the redrawn texture map of the current observation perspective onto the 3D model to be processed, and update the data of the area to be updated.

[0011] Change the current observation perspective and jump to the step "Based on the current observation perspective, render the 3D model to be processed to obtain the area map to be updated, the initial effect diagram of the 3D model to be processed, and the UV map", until the texture map redrawing of each observation perspective of the 3D model to be processed is completed, and obtain the 3D model with the texture map redrawing completed.

[0012] Optionally, based on the text description input by the user, the initial effect diagram of the 3D model to be processed, and the area map to be updated, use the AIGC tool to redraw the texture map of the 3D model to be processed to obtain the redrawn texture map of the current observation perspective, which specifically includes the following steps:

[0013] Use the initial effect diagram of the 3D model to be processed as the input image for image generation and input it into the AIGC tool.

[0014] According to the text description input by the user, guide the AIGC tool to redraw the target redrawing area in the input image; the target redrawing area is determined based on the area map to be updated.

[0015] Optionally, based on the UV map of the 3D model to be processed, project the redrawn texture map of the current observation perspective onto the 3D model to be processed, and update the data of the area to be updated, which specifically includes the following steps:

[0016] Within the target redrawing area determined based on the area map to be updated, project the redrawn texture map of the current observation perspective onto the texture map of the 3D model to be processed according to the UV vector information represented on the UV map.

[0017] Based on the update of the texture map of the 3D model to be processed, update the target redrawing area in the data of the area to be updated; the update of the target redrawing area is to remove the redrawn texture pixels in the target redrawing area to ensure that the redrawn area is not modified in subsequent redrawing processes.

[0018] Optionally, according to the comparison result between the target redrawing area and the texture map redrawing area threshold, determine whether the texture map redrawing of each observation perspective of the 3D model to be processed is completed; if the target redrawing area is greater than the texture map redrawing area threshold, it is determined that the texture map redrawing of each observation perspective of the 3D model to be processed is not completed, change the current observation perspective, and jump to the step "Based on the current observation perspective, render the 3D model to be processed to obtain the area map to be updated, the initial effect diagram of the 3D model to be processed, and the UV map"; if the target redrawing area is greater than the texture map redrawing area threshold, it is determined that the texture map redrawing of each observation perspective of the 3D model to be processed is completed, and obtain the 3D model with the texture map redrawing completed.

[0019] Optionally, after obtaining the three-dimensional model with the texture redrawing completed, it further includes: in the three-dimensional model with the texture redrawing completed, performing a filling operation on the holes generated during the texture back-projection process to ensure that the texture in the three-dimensional model with the texture redrawing completed is complete without defects.

[0020] Optionally, bilinear filtering is used to perform a filling operation on the holes generated during the texture back-projection process, and the value of a pixel is calculated using the average value of the 8 pixels surrounding the pixel where the hole is located.

[0021] In a second aspect, the present application provides a three-dimensional model texture production system based on AIGC, including the following modules:

[0022] A model initial image generation module, configured to obtain the three-dimensional model to be processed input by the user, and generate an initial texture and data of the area to be updated for the three-dimensional model to be processed; the data of the area to be updated is a two-dimensional image whose resolution size exactly corresponds to the initial texture, and is used to represent the target redrawing area of the three-dimensional model to be processed.

[0023] An optimal viewing angle selection module, configured to obtain the optimal viewing angle selected by the user, and use the optimal viewing angle as the current viewing angle.

[0024] A current viewing angle model rendering module, configured to render the three-dimensional model to be processed based on the current viewing angle to obtain an area map to be updated, an initial effect diagram of the three-dimensional model to be processed, and a uv map; the area map to be updated is a two-dimensional image rendered based on the data of the area to be updated at the current viewing angle, and the area map to be updated is used to represent the target redrawing area of the three-dimensional model to be processed at the current viewing angle.

[0025] A current viewing angle texture redrawing module, configured to redraw the texture of the three-dimensional model to be processed based on the text description input by the user, the initial effect diagram of the three-dimensional model to be processed, and the area map to be updated, using an AIGC tool to obtain a redrawn texture at the current viewing angle.

[0026] A redrawn texture back-projection module, configured to back-project the redrawn texture at the current viewing angle onto the three-dimensional model to be processed based on the uv map of the three-dimensional model to be processed, and update the data of the area to be updated.

[0027] A current viewing angle re-selection module, configured to change the current viewing angle, and repeatedly call the current viewing angle model rendering module, the current viewing angle texture redrawing module, and the redrawn texture back-projection module until the texture redrawing of each viewing angle of the three-dimensional model to be processed is completed, obtaining a three-dimensional model with the texture redrawing completed.

[0028] In a third aspect, the present application provides a computer device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the aforementioned method for making a three-dimensional model texture map based on AIGC.

[0029] In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the aforementioned method for making a three-dimensional model texture map based on AIGC.

[0030] In a fifth aspect, the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the steps of the aforementioned method for making a three-dimensional model texture map based on AIGC.

[0031] According to the specific embodiments provided by the present application, the following technical effects are disclosed in the present application:

[0032] The present application provides a method for making a three-dimensional model texture map based on AIGC and related devices. First, for the three-dimensional model to be processed input by the user, an initial texture map and data of the area to be updated are generated. After rendering the three-dimensional model to be processed based on the best viewing angle selected by the user, and then based on the text description input by the user and the rendering result, an AIGC tool is used to redraw the texture map of the three-dimensional model to be processed to obtain a redrawn texture map from the current viewing angle. Then, based on the uv map of the three-dimensional model to be processed, the redrawn texture map from the current viewing angle is back-projected onto the three-dimensional model to be processed, and the data of the area to be updated is updated. Subsequently, the current viewing angle is changed and the above steps are repeated until the texture map redrawing of each viewing angle of the three-dimensional model to be processed is completed, and a three-dimensional model with the texture map redrawing completed is obtained. Through the solution provided by the present application, the user can use common AIGC tools to quickly and efficiently make and redraw the texture map of the three-dimensional model in the way of text-to-image and image-to-image, combining the advantages of AIGC technology in image generation, thereby improving the production efficiency of the three-dimensional model texture map and reducing costs. Description of the Drawings

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0034] Figure 1 It is a flowchart of a method for making a three-dimensional model texture map based on AIGC provided by an embodiment of the present application.

[0035] Figure 2 Flow chart of step A4 in a method for making a 3D model texture map based on AIGC provided by an embodiment of the present application.

[0036] Figure 3 Flow chart of step A5 in a method for making a 3D model texture map based on AIGC provided by an embodiment of the present application.

[0037] Figure 4 Schematic diagram of functional modules of a 3D model texture map making system based on AIGC provided by an embodiment of the present application.

[0038] Figure 5 Schematic diagram of the structure of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0039] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0040] To make the above objects, features, and advantages of the present application more obvious and understandable, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation manners.

[0041] In an exemplary embodiment, as Figure 1 shown, a method for making a 3D model texture map based on AIGC is provided, including the following steps:

[0042] A1. Obtain the to-be-processed 3D model input by the user, and generate an initial texture map and to-be-updated area data for the to-be-processed 3D model; the to-be-updated area data is a two-dimensional image whose resolution size exactly corresponds to the initial texture map, and is used to represent the target redrawing area of the to-be-processed 3D model, that is, to indicate which areas of the texture map of the 3D model have not been filled with AIGC redrawing data.

[0043] A2. Obtain the best viewing angle selected by the user, and use the best viewing angle as the current viewing angle. The user can select a better viewing angle through repeated tests. Starting from different viewing angles may lead to different results. Starting the initial AIGC redrawing from a better viewing angle has a more stable effect.

[0044] A3. Based on the current observation perspective, render the 3D model to be processed to obtain an area-to-be-updated map, an initial rendering of the 3D model to be processed, and a UV map. The area-to-be-updated map is a 2D image rendered based on the area-to-be-updated data from the current observation perspective, and it is used to represent the target redrawing area of the 3D model to be processed from the current observation perspective. The initial rendering obtained here is the rendering of the 3D model to be processed with textures applied. The area-to-be-updated map, the initial rendering, and the UV map all have the same resolution.

[0045] A4. Based on the text description input by the user, the initial rendering of the 3D model to be processed, and the area-to-be-updated map, use an AIGC tool to redraw the textures of the 3D model to be processed to obtain a redrawn texture for the current observation perspective. In this embodiment, as Figure 2 shown in the flowchart, step A4 specifically includes the following steps:

[0046] A41. Use the initial rendering of the 3D model to be processed as the input image for image-to-image generation and input it into the AIGC tool.

[0047] A42. According to the text description input by the user, guide the AIGC tool to redraw the target redrawing area in the input image. The target redrawing area is determined based on the area-to-be-updated map.

[0048] A5. Based on the UV map of the 3D model to be processed, reverse-project the redrawn texture for the current observation perspective onto the 3D model to be processed and update the area-to-be-updated data. In this embodiment, as Figure 3 shown in the flowchart, step A5 specifically includes the following steps:

[0049] A51. Within the target redrawing area determined based on the area-to-be-updated map, reverse-project the redrawn texture for the current observation perspective onto the texture of the 3D model to be processed according to the UV vector information represented on the UV map.

[0050] A52. Based on the update of the texture of the 3D model to be processed, update the target redrawing area in the area-to-be-updated data. The update of the target redrawing area is to remove the redrawn texture pixels in the target redrawing area to ensure that the redrawn area will not be modified in subsequent redrawing processes.

[0051] A6. Change the current observation perspective and repeat the above steps A3 - A5 until the texture redrawing for all observation perspectives of the 3D model to be processed is completed, obtaining a 3D model with completed texture redrawing.

[0052] In an exemplary embodiment of the present application, according to the comparison result between the target redrawing area and the texture map redrawing area threshold, it is determined whether the texture map redrawing of each viewing angle of the three-dimensional model to be processed is completed; if the target redrawing area is greater than the texture map redrawing area threshold, it is determined that the texture map redrawing of each viewing angle of the three-dimensional model to be processed is not completed, the current viewing angle is changed, and the process jumps to step A3; if the target redrawing area is greater than the texture map redrawing area threshold, it is determined that the texture map redrawing of each viewing angle of the three-dimensional model to be processed is completed, and the three-dimensional model with the texture map redrawing completed is obtained.

[0053] In another exemplary embodiment of the present application, after obtaining the three-dimensional model with the texture map redrawing completed, it further includes: in the three-dimensional model with the texture map redrawing completed, a filling operation is performed on the holes generated during the texture map back-projection process to ensure that the texture map in the three-dimensional model with the texture map redrawing completed is complete without defects.

[0054] Specifically in this embodiment, bilinear filtering is used to perform a filling operation on the holes generated during the texture map back-projection process, and the value of a pixel is calculated using the average value of the 8 pixels surrounding the pixel where the hole is located.

[0055] In a specific example, rely on AIGC to automatically generate a material texture map for a three-dimensional part. Generally, a material texture map will have a color texture map. First, create this color texture map, assuming it is 512*512 in size, and then create an updated area marker texture map as the data of the area to be updated, also 512*512 in size.

[0056] Then select a viewing angle, assuming it is the front view in the projected three-view drawing, and render this three-dimensional part to render multiple two-dimensional pictures, including the picture of the area to be updated, the uv map, and the initial effect picture. Assume that the pictures generated from this viewing angle are all 512*512 in size, where the uv map represents the uv information of the three-dimensional part, and the initial effect picture represents the effect picture of the three-dimensional part with the texture map. Before applying the texture map, it is the contour of the three-dimensional part.

[0057] Based on the effect picture of the three-dimensional part (initially only the contour, without any color, 512*512 in size), let the AIGC tool perform coloring according to the text description input by the user. For example, whether it is a brand-new part or a rusty part, the AIGC can draw a suitable redrawing texture map (with color, 512*512 in size) according to the contour in the picture.

[0058] Take the redrawn texture map generated by redrawing, for each pixel on the rendering of the 3D part, first query the pixel information at the same position on the area map to be updated, determine whether it has been updated. If not, then query the pixel information at the same position on the uv map, query the corresponding uv value, and write the color value on the redrawn texture map generated by redrawing to the corresponding pixel on the texture map of the 3D model according to the uv value. If it has been updated, skip it. Until all the colors on the entire redrawn texture map are mapped to the texture map of the 3D model.

[0059] After processing from the front view perspective, switch to other perspectives (such as the top view or perspective view) to supplement the areas that are not visible in the previous perspective, and switch repeatedly until all areas of the texture map of the 3D part have been processed, completing the production or redrawing of the texture map of the 3D part.

[0060] Through the solution provided by this application, users can use common AIGC tools to quickly and efficiently produce and redraw texture maps for 3D models in the ways of text-to-image and image-to-image, combining the advantages of AIGC technology in image generation, thereby improving the production efficiency of 3D model texture maps and reducing costs.

[0061] Based on the same inventive concept, the embodiments of this application also provide a system for implementing the above-mentioned AIGC-based 3D model texture map production method. The solution provided by this system to solve problems is similar to the solution described in the above method. In an exemplary embodiment, as Figure 4 shown, a 3D model texture map production system based on AIGC is provided, including the following modules:

[0062] A model initial image generation module, configured to obtain a 3D model to be processed input by a user, and generate an initial texture map and data of an area to be updated for the 3D model to be processed; the data of the area to be updated is a two-dimensional image with a resolution size exactly corresponding to the initial texture map, and is used to represent the target redrawing area of the 3D model to be processed.

[0063] An optimal viewing angle selection module, configured to obtain the optimal viewing angle selected by the user, and use the optimal viewing angle as the current viewing angle.

[0064] A current perspective model rendering module, configured to render the 3D model to be processed based on the current viewing angle to obtain an area map to be updated, an initial rendering of the 3D model to be processed, and a uv map; the area map to be updated is a two-dimensional image rendered based on the data of the area to be updated from the current viewing angle, and the area map to be updated is used to represent the target redrawing area of the 3D model to be processed from the current viewing angle.

[0065] The current viewing angle texture redrawing module is used to redraw the texture of the 3D model to be processed based on the text description input by the user, the initial effect diagram of the 3D model to be processed, and the area to be updated diagram, using the AIGC tool to obtain the redrawn texture of the current viewing angle.

[0066] The redrawn texture back-projection module is used to back-project the redrawn texture of the current viewing angle onto the 3D model to be processed based on the uv map of the 3D model to be processed, and update the data of the area to be updated.

[0067] The current viewing angle re-selection module is used to change the current viewing angle, and repeatedly call the current viewing angle model rendering module, the current viewing angle texture redrawing module, and the redrawn texture back-projection module until the texture redrawing of each viewing angle of the 3D model to be processed is completed, and a 3D model with the texture redrawing completed is obtained.

[0068] Of course, Figure 4 The architecture shown is only exemplary. When implementing different functions, one or at least two components in the Figure 4 shown system can be omitted according to actual needs.

[0069] In an exemplary embodiment, a computer device is provided. The computer device can be a server or a terminal, and its internal structure diagram can be as Figure 5 shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals through a network connection. When the computer program is executed by the processor, it can implement a method for making a 3D model texture based on AIGC provided in the above embodiment.

[0070] Those skilled in the art can understand that Figure 5 the structure shown in

[0071] In an exemplary embodiment, a computer device is further provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0072] In an exemplary embodiment, a computer-readable storage medium is provided, storing a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0073] In an exemplary embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0074] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0075] Those of ordinary skill in the art can understand that all or part of the processes of implementing the above method embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium, and when the computer program is executed, it can include the processes of the above method embodiments. Among them, any reference to a memory, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random-access memory (ReRAM), magnetoresistive random-access memory (MRAM), ferroelectric random-access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0076] In each of the embodiments provided in this application, the databases involved may include at least one of a relational database and a non-relational database. The non-relational database may include a distributed database based on blockchain, etc., without limitation. In each of the embodiments provided in this application, the processor may be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without limitation.

[0077] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0078] Specific examples are used in this article to elaborate on the principles and implementation manners of this application. The description of the above embodiments is only used to help understand the method and its core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

1. A method for making 3D model texture maps based on AIGC, characterized in that, Including: Obtain the three-dimensional model to be processed input by the user, and generate an initial texture map and data of the area to be updated for the three-dimensional model to be processed; The data of the area to be updated is a two-dimensional image whose resolution size exactly corresponds to the initial texture map, and is used to represent the target redrawing area of the three-dimensional model to be processed; Obtain the best viewing angle selected by the user, and use the best viewing angle as the current viewing angle; Based on the current viewing angle, render the three-dimensional model to be processed to obtain a map of the area to be updated, an initial effect diagram of the three-dimensional model to be processed, and a uv map; the map of the area to be updated is a two-dimensional image rendered based on the data of the area to be updated from the current viewing angle, and the map of the area to be updated is used to represent the target redrawing area of the three-dimensional model to be processed from the current viewing angle; Based on the text description input by the user, the initial effect diagram of the three-dimensional model to be processed, and the map of the area to be updated, use the AIGC tool to redraw the texture map of the three-dimensional model to be processed to obtain a redrawn texture map from the current viewing angle; Based on the uv map of the three-dimensional model to be processed, reverse-project the redrawn texture map from the current viewing angle onto the three-dimensional model to be processed, and update the data of the area to be updated; Change the current viewing angle, and jump to the step of "Based on the current viewing angle, render the three-dimensional model to be processed to obtain a map of the area to be updated, an initial effect diagram of the three-dimensional model to be processed, and a uv map", until the texture map redrawing of each viewing angle of the three-dimensional model to be processed is completed, and a three-dimensional model with the texture map redrawing completed is obtained.

2. The method for making a texture map of a 3D model based on AIGC according to claim 1, wherein Based on the text description input by the user, the initial effect diagram of the three-dimensional model to be processed, and the map of the area to be updated, use the AIGC tool to redraw the texture map of the three-dimensional model to be processed to obtain a redrawn texture map from the current viewing angle, specifically including: Use the initial effect diagram of the three-dimensional model to be processed as the input image for image-to-image generation and input it into the AIGC tool; According to the text description input by the user, guide the AIGC tool to redraw the target redrawing area in the input image; the target redrawing area is determined based on the map of the area to be updated.

3. The method for making texture mapping of a 3D model based on AIGC according to claim 2, wherein Based on the uv map of the three-dimensional model to be processed, reverse-project the redrawn texture map from the current viewing angle onto the three-dimensional model to be processed, and update the data of the area to be updated, specifically including: Within the target redrawing area determined based on the map of the area to be updated, according to the uv vector information represented on the uv map, reverse-project the redrawn texture map from the current viewing angle onto the texture map of the three-dimensional model to be processed; Based on the update of the texture map of the three-dimensional model to be processed, update the target redrawing area in the data of the area to be updated; the update of the target redrawing area is to remove the redrawn texture pixels in the target redrawing area to ensure that the redrawn area is not modified in subsequent redrawing processes.

4. The method for making texture mapping of a 3D model based on AIGC according to claim 3, wherein Based on the comparison result between the target redrawing area and the texture mapping redrawing area threshold, determine whether the texture mapping redrawing of each observation view of the to-be-processed 3D model is completed; if the target redrawing area is greater than the texture mapping redrawing area threshold, it is determined that the texture mapping redrawing of each observation view of the to-be-processed 3D model is not completed, change the current observation view, and jump to the step "Based on the current observation view, render the to-be-processed 3D model to obtain the to-be-updated area map, the initial effect map of the to-be-processed 3D model, and the uv map"; if the target redrawing area is greater than the texture mapping redrawing area threshold, it is determined that the texture mapping redrawing of each observation view of the to-be-processed 3D model is completed, and a 3D model with completed texture mapping is obtained.

5. The method for making a three-dimensional model texture map based on AIGC according to claim 4, wherein After obtaining the 3D model with completed texture mapping, it further includes: in the 3D model with completed texture mapping, perform a hole filling operation on the holes generated during the texture mapping back-projection process to ensure that the texture in the 3D model with completed texture mapping is complete without defects.

6. The method for making 3D model texture mapping based on AIGC according to claim 5, wherein, Use bilinear filtering to perform a hole filling operation on the holes generated during the texture mapping back-projection process, and calculate the value of a pixel using the average value of 8 pixels around the pixel where the hole is located.

7. A three-dimensional model texture mapping production system based on AIGC, characterized in that, It includes: A model initial image generation module, configured to obtain the to-be-processed 3D model input by the user, and generate an initial texture map and to-be-updated area data for the to-be-processed 3D model; The to-be-updated area data is a two-dimensional image whose resolution size exactly corresponds to the initial texture map, and is used to represent the target redrawing area of the to-be-processed 3D model; An optimal observation view selection module, configured to obtain the optimal observation view selected by the user, and use the optimal observation view as the current observation view; A current view model rendering module, configured to render the to-be-processed 3D model based on the current observation view to obtain a to-be-updated area map, the initial effect map of the to-be-processed 3D model, and the uv map; the to-be-updated area map is a two-dimensional image rendered based on the to-be-updated area data under the current observation view, and the to-be-updated area map is used to represent the target redrawing area of the to-be-processed 3D model under the current observation view; A current view texture mapping redrawing module, configured to redraw the texture mapping of the to-be-processed 3D model based on the text description input by the user, the initial effect map of the to-be-processed 3D model, and the to-be-updated area map, using an AIGC tool to obtain the redrawn texture map of the current observation view; A redrawn texture mapping back-projection module, configured to back-project the redrawn texture map of the current observation view onto the to-be-processed 3D model based on the uv map of the to-be-processed 3D model, and update the to-be-updated area data; A current observation view re-selection module, configured to change the current observation view, and repeatedly call the current view model rendering module, the current view texture mapping redrawing module, and the redrawn texture mapping back-projection module until the texture mapping redrawing of each observation view of the to-be-processed 3D model is completed, and a 3D model with completed texture mapping is obtained.

8. A computer device, comprising: A memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that the processor executes the computer program to implement the method for making a three-dimensional model texture based on AIGC according to any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the method for making a three-dimensional model texture based on AIGC according to any one of claims 1-6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the method for making a three-dimensional model texture based on AIGC according to any one of claims 1-6.

Images