Rendering picture processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a rendering picture processing method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining an original rendering picture and texture mapping information of an asset model; the texture mapping information is two-dimensional coordinate information on two-dimensional coordinates of at least one quadrant after the asset model is expanded; obtaining a current material map; performing mapping connection on the current material map and the texture mapping information to obtain a target material map; mapping the target material map to the asset model distributed in the quadrant of the two-dimensional coordinates; obtaining target color information data of the target material map; generating a target rendering picture according to the target color information data and the original rendering picture; and previewing the target rendering picture. According to the embodiment of the invention, the manufacturing efficiency of the material chartlet of the asset model is improved, and the manufacturing efficiency of film and television works corresponding to the asset model is further improved.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of computer technologies, and particularly to a method for processing a rendered image, a device for processing a rendered image, an electronic device, and a computer-readable storage medium. Background Art

[0002] In a film and television CG (Computer Graphics) project, the production of texture maps for high-precision model assets involves the production process of texture maps for asset models in multiple quadrants. In the later stage of the project, DCC (Digital Content Creation) production software can generate a rendered image based on the asset model and the texture map mapped on the asset model, and preview the rendered image. If the director is not satisfied with the texture details of the texture map of the asset model according to the rendered image, they need to return to the DCC production software again to adjust the texture map, re-render the rendered image, and preview the rendered image until the rendered image is the final effect image that the director hopes to present to the audience. It can be seen that the overall process is cumbersome. If there are many scene resources in the project, it often occurs that the system freezes or crashes during the production of the texture map, which is time-consuming. Therefore, the production efficiency of the texture map of the asset model is not high, which in turn leads to low production efficiency of film and television products (rendered images). Summary of the Invention

[0003] Embodiments of the present invention provide a method for processing a rendered image, a device, an electronic device, and a computer-readable storage medium to solve the problem that the production efficiency of the texture map of the asset model is not high, which in turn leads to low production efficiency of film and television products.

[0004] Embodiments of the present invention disclose a method for processing a rendered image, the method including:

[0005] Obtaining an original rendered image of an asset model and texture mapping information; the texture mapping information is two-dimensional coordinate information on two-dimensional coordinates in at least one quadrant after the asset model is unfolded;

[0006] Obtaining a current texture map;

[0007] Performing a mapping connection on the current texture map and the texture mapping information to obtain a target texture map; the target texture map is mapped to the asset model distributed in the quadrant of the two-dimensional coordinates;

[0008] Obtaining target color information data of the target texture map;

[0009] Generating a target rendered image based on the target color information data and the original rendered image, and previewing the target rendered image.

[0010] An embodiment of the present invention also discloses a rendering picture processing device, which includes:

[0011] A rendering picture acquisition module, configured to acquire an original rendering picture of an asset model and texture mapping information; the texture mapping information is two-dimensional coordinate information on two-dimensional coordinates in at least one quadrant after the asset model is unfolded;

[0012] A material texture map acquisition module, configured to acquire a current material texture map;

[0013] A mapping connection module, configured to perform mapping connection on the material texture map and the texture mapping information to obtain a target material texture map; the target material texture map is mapped to the asset model distributed in the quadrant of the two-dimensional coordinates;

[0014] A target color information data acquisition module, configured to acquire target color information data of the target material texture map;

[0015] A target rendering picture preview module, configured to generate a target rendering picture according to the target color information data and the original rendering picture, and preview the target rendering picture.

[0016] An embodiment of the present invention also discloses an electronic device, including a processor, a communication interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete communication with each other through the communication bus;

[0017] The memory is used to store a computer program;

[0018] When the processor is used to execute the program stored on the memory, the method described in the embodiment of the present invention is implemented.

[0019] An embodiment of the present invention also discloses one or more computer-readable storage media, on which instructions are stored. When executed by one or more processors, the processors are caused to execute the method described in the embodiment of the present invention.

[0020] An embodiment of the present invention also discloses a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the embodiment of the present invention.

[0021] The embodiment of the present invention has the following advantages:

[0022] In an embodiment of the present invention, an original rendering image of an asset model and texture mapping information are obtained. The texture mapping information is two-dimensional coordinate information on the two-dimensional coordinates of at least one quadrant after the asset model is unfolded. A current material texture map is obtained, and the current material texture map and the texture mapping information are mapped and connected to obtain a target material texture map. The target material texture map can be mapped to the asset model distributed in the quadrant of the two-dimensional coordinates. Then, target color information data of the target material texture map is obtained, and further, a target rendering image can be generated and previewed based on the target color information data and the original rendering image. In the related technical solutions, when making the material texture map of an asset model, if the relevant personnel are not satisfied with the effect of the rendering image obtained by rendering the asset model, they need to remake the material texture map in the production software for the rendering image and then re-render. Re-rendering takes a certain amount of time. However, in the present application, when making the material texture map of an asset model, especially for a high-precision asset model (i.e., an asset model with multiple quadrants on the two-dimensional coordinates), the current material texture map can be mapped to the original rendering image of the asset model to obtain a target rendering image and preview. The target rendering image is the final effect image of the asset model to be presented to the audience. The relevant personnel can determine whether the material texture map meets the requirements by observing the target rendering image to determine whether the current material texture map needs to be remade. Even if the current material texture map needs to be remade, there is no need to remake the material texture map in the production software and then re-render, which improves the production efficiency of the material texture map of the asset model, and further improves the production efficiency of the corresponding film and television work (rendering image) of the asset model. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a flowchart of the steps of a method for processing a rendering image provided in an embodiment of the present invention;

[0024] Figure 2 is a schematic diagram of an original rendering image provided in an embodiment of the present invention;

[0025] Figure 3 is a schematic diagram of the texture mapping information of an original rendering image provided in an embodiment of the present invention;

[0026] Figure 4 is a schematic diagram of a noise texture map provided in an embodiment of the present invention;

[0027] Figure 5 is a comparison schematic diagram of a noise texture map before and after adding a bevel emboss effect provided in an embodiment of the present invention;

[0028] Figure 6 is a comparison schematic diagram of a locally enlarged original rendering texture map and a material texture map in the related technical solution after local enlargement provided in an embodiment of the present invention;

[0029] Figure 7 It is a comparison schematic diagram of an adjusted locally enlarged original rendering texture map and a texture map in a related technical solution after local enlargement provided in an embodiment of the present invention;

[0030] Figure 8 It is a schematic diagram of a quadrant provided in an embodiment of the present invention;

[0031] Figure 9 It is a schematic diagram of multiple quadrants provided in an embodiment of the present invention;

[0032] Figure 10 It is a schematic diagram of the distribution of an asset model in multiple quadrants provided in an embodiment of the present invention;

[0033] Figure 11 It is an error schematic diagram of a target texture map connected to an original rendering image, a texture map, and texture mapping information provided in an embodiment of the present invention;

[0034] Figure 12 It is a schematic diagram of a spliced displacement texture map obtained by merging a current texture map with a displacement texture map provided in an embodiment of the present invention;

[0035] Figure 13 , it is one of the comparison schematic diagrams of an original rendering image and a target texture map provided in an embodiment of the present invention;

[0036] Figure 14 It is a schematic diagram of a spliced displacement texture map obtained by merging a current texture map with two displacement texture maps provided in an embodiment of the present invention;

[0037] Figure 15 It is the second of the comparison schematic diagrams of an original rendering image and a target texture map provided in an embodiment of the present invention;

[0038] Figure 16 , it is a schematic diagram of a spliced displacement texture map obtained by merging a current texture map with four displacement texture maps provided in an embodiment of the present invention;

[0039] Figure 17 , it is the third of the comparison schematic diagrams of an original rendering image and a target texture map provided in an embodiment of the present invention;

[0040] Figure 18 It is a comparison schematic diagram of an original rendering image, an unprocessed texture map, and a processed target texture map provided in an embodiment of the present invention;

[0041] Figure 19 It is a schematic diagram of the relationship between an object of an asset model and a quadrant provided in an embodiment of the present invention;

[0042] Figure 20It is a schematic diagram showing that objects of an asset model provided in an embodiment of the present invention use textures of the same density size;

[0043] Figure 21 It is a schematic diagram showing that objects of an enlarged asset model provided in an embodiment of the present invention use textures of the same density size;

[0044] Figure 22 It is a comparison schematic diagram showing that a current material map and a displacement material map use textures of different density sizes;

[0045] Figure 23 It is a schematic diagram showing an image after a current material map and a displacement material map use textures of different density sizes;

[0046] Figure 24 It is a schematic diagram showing an operation mode and a target map area;

[0047] Figure 25 It is a schematic diagram showing RGBA average color information data;

[0048] Figure 26 It is a schematic diagram showing average color information data of each color channel;

[0049] Figure 27 It is a schematic diagram showing adding an expression to the average color information data of the R color channel;

[0050] Figure 28 It is a schematic diagram showing adding an expression to the average color information data of the G color channel;

[0051] Figure 29 It is a schematic diagram showing adding an expression to the average color information data of the B color channel;

[0052] Figure 30 It is a comparison schematic diagram showing the color information data of a target material map without adding an expression and the target color information data with an added expression;

[0053] Figure 31 It is a schematic diagram showing an enlarged target rendering image;

[0054] Figure 32 It is a schematic diagram showing an enlarged original rendering image;

[0055] Figure 33It is a schematic diagram of a target rendering image after performing a merge operation on an enlarged target texture map of a material and an original rendering image in an embodiment of the present invention;

[0056] Figure 34 It is a block diagram of a rendering image processing device provided in an embodiment of the present invention;

[0057] Figure 35 It is a block diagram of an electronic device provided in an embodiment of the present invention. Detailed implementation manners

[0058] To make the above objects, features, and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific implementation manners.

[0059] Refer to Figure 1 , which shows a step flowchart of a rendering image processing method provided in an embodiment of the present invention, and specifically may include the following steps:

[0060] Step 101: Obtain an original rendering image of an asset model and texture mapping information; the texture mapping information is two-dimensional coordinate information on two-dimensional coordinates in at least one quadrant after the asset model is unfolded;

[0061] In a specific implementation, a rendering image refers to a final effect image generated according to an asset model (3D solid model) through computer graphics technology. Specifically, a rendering image is a 2D image rendered and output after a series of processes on an asset model and a texture map mapped on the asset model. Rendering images can form scene shots, and scene shots form a film and television product.

[0062] The original rendering image is the rendering image of the asset model obtained from the production software for making the rendering image. For example, the rendering image (sequence frame file) rendered by DCC production software. Among them, the DCC software is a tool for creating, editing, and managing digital content, and is currently widely used in fields such as film and television products, games, animations, and advertisements, and can cover the entire process from modeling, animation, rendering to post-production synthesis. In an embodiment of the present invention, refer to Figure 2, which is a schematic diagram of an original rendered image provided in an embodiment of the present invention. After obtaining the rendered image from a DCC production software, the rendered image can be used as the original rendered image and imported into a post-processing software for processing. Among them, the post-processing software can be Nuke post-processing software. Specifically, Nuke post-processing software is a high-end node-based compositing software mainly used for post-compositing in film and television products, games, animations, and advertising production, and is one of the standard tools in the post-production industry of film and television products. Of course, in practical applications, the original rendered image can also be imported into other software or tools for processing, such as post-processing software like After Effects, and the embodiments of the present invention do not need to limit this.

[0063] In an embodiment of the present invention, referring to Figure 3 , which is a schematic diagram of texture mapping information of an original rendered image provided in an embodiment of the present invention. After importing the original rendered image of the asset model rendered by the DCC production software into the Nuke post-processing software, and further obtaining the texture mapping information (UV information) of the original rendered image. Specifically, the texture mapping information is used to map the surface of the asset model to the two-dimensional coordinate information (UV coordinates) on the two-dimensional plane. The texture mapping information can be obtained by rendering with the DCC production software, and the purpose is to reflect the UV information in the asset model). In practical applications, the more surfaces the asset model has, the higher the precision of the asset model, and then the asset model will be distributed in multiple quadrants of the two-dimensional coordinate after being unfolded.

[0064] Step 102: Obtain the current material texture map;

[0065] In a specific implementation, the material texture map (texture map) is an image used to define the surface appearance attributes of the asset model. The material texture map can be mapped to the two-dimensional coordinates of the asset model through UV information, adding details such as bumps, reflections, and colors to the surface of the asset model, enhancing the visual effect of the asset model, and bringing a better visual experience to users. Among them, the current material texture map is the material texture map of the rendered image that needs to be assigned to the asset model currently. The target material texture map can enhance the details and realism of the rendered image, so as to achieve the final effect image required by relevant personnel (such as the director).

[0066] In an alternative embodiment of the present invention, the current material texture map can be a noise map (noise texture map) created in the Nuke post-processing software. Among them, considering that the material texture map Figure 1 is generally square in proportion, a noise map with a resolution of square 4096*4096 can be created as the current material texture map.

[0067] Step 103: Map and connect the current material texture and the texture mapping information to obtain a target material texture; map the target material texture to the asset model distributed in the quadrant of the two-dimensional coordinate;

[0068] In the embodiment of the present invention, the current material texture and the texture mapping information (UV information) can be mapped and connected to obtain a target material texture. The mapping connection is to map the current material texture to the surface of the asset model according to the UV information, so as to generate a target material texture that meets the requirements. Exemplarily, the STMap tool in the Nuke post-processing software can be used to connect the current material texture and the UV information, so as to map the current material texture to the surface of the asset model.

[0069] Step 104: Obtain the target color information data of the target material texture;

[0070] Among them, the target color information data is generated according to the color information data of the target material texture. Among them, the color information data can be RGBA color information data. The RGBA color information data is a data format used to represent the color of an image, including four color channels: red (R), green (G), blue (B), and transparency (A).

[0071] Step 105: Generate a target rendered image according to the target color information data and the original rendered image, and preview the target rendered image.

[0072] In the embodiment of the present invention, after obtaining the target color information data of the target material texture, a target rendered image can be generated according to the target color information data and the original rendered image, and the target rendered image can be previewed, so that relevant personnel can determine whether the current material texture meets the requirements by observing the target rendered image, and further determine whether it is necessary to remanufacture the current material texture. It should be noted that if relevant personnel determine that the current material texture meets the requirements by observing the target rendered image, then the target rendered image can be used as the final effect image, what you see is what you get.

[0073] In specific implementation, the film and television products of large-scale film and television CG projects are usually completed by the cooperation of multiple suppliers. Therefore, if requirements are put forward again after the rendered image has been accepted, for example, it is necessary to remanufacture a material texture that meets the requirements, the whole process will take a relatively long time. However, in the embodiment of the present invention, the original rendered images provided by multiple suppliers are processed in the Nuke post-processing software, and the controllability is higher. And even if the material texture does not meet the requirements, the target rendered image, that is, the final effect image of the film and television product, can be made to meet the requirements by adjusting the current material texture in the Nuke post-processing software.

[0074] In addition, when debugging a film and television product in a large-scale film and television CG project, the DCC production software may experience lag, freeze, or even crash. Moreover, the accurate preview effect of the final rendered image can only be seen through rendering, and the rendering process also takes a certain amount of time. If multiple shots in a scene require re-making of material textures, the time consumption for the entire process will be relatively serious. However, in the embodiment of the present invention, the current material texture is obtained in the Nuke post-processing software, and the target material texture is obtained by performing mapping connection based on the current material texture and texture mapping information. Then, the target rendered image can be generated based on the target color data information of the target material texture and the original rendered image, and the target rendered image can be previewed, enabling relevant personnel to quickly determine whether the target rendered image meets the requirements. Even if it does not meet the requirements, only the current material texture needs to be re-obtained, without experiencing lag, freeze, or even crash, nor the need to re-render in the DCC production software. Therefore, the time for the entire process is shorter, improving the production efficiency of film and television products.

[0075] In the above method for processing the rendered image, in the embodiment of the present invention, the original rendered image of the asset model and the texture mapping information are obtained. The texture mapping information is the two-dimensional coordinate information on the two-dimensional coordinates in at least one quadrant after the asset model is unfolded. The current material texture is obtained, and the current material texture and the texture mapping information are mapped and connected to obtain the target material texture. Among them, the target material texture can be mapped to the asset model distributed in the quadrant of the two-dimensional coordinates. Then, the target color information data of the target material texture is obtained, and further, the target rendered image can be generated based on the target color information data and the original rendered image and previewed. In the related technical solutions, when making the material texture of the asset model, if the relevant personnel are not satisfied with the effect of the rendered image obtained by rendering the asset model, they need to re-make the material texture in the production software for making the rendered image and then re-render, which takes a certain amount of time. However, in this application, when making the material texture of the asset model, especially the material texture of a high-precision asset model (i.e., an asset model with multiple quadrants in the two-dimensional coordinates), the current material texture can be mapped to the original rendered image of the asset model to obtain the target rendered image and preview. The target rendered image is the final effect image of the asset model to be presented to the audience. The relevant personnel can determine whether the material texture meets the requirements by observing the target rendered image to determine whether the current material texture needs to be re-made. Even if the current material texture needs to be re-made, there is no need to re-make the material texture in the production software and then re-render, improving the production efficiency of the material texture of the asset model, and thus enhancing the production efficiency of the film and television work (rendered image) corresponding to the asset model.

[0076] In one embodiment of the present invention, step 102, obtaining the current material texture, may include:

[0077] Create the current material texture map;

[0078] Adjust the texture parameters of the current material texture map; the texture parameters of the current material texture map at least include the size, color, and image effect of the current material texture map.

[0079] In the embodiments of the present invention, a material texture map for an asset model can be created, and the texture parameters of the current material texture map can be adjusted according to requirements, such as the size, color, and image effect of the current material texture map, so that the target rendering image finally generated based on the current material texture map meets the requirements.

[0080] In a specific example, a noise texture map is created as the current material texture map in Nuke post-processing. The resolution of the noise texture map can be square 4096*4096. The type of the noise texture map can be set to turbulence in Nuke post-processing, and the size of the noise texture map can be reduced, for example, the size can be adjusted to 5. Also, the color of the noise texture map can be adjusted. For example, if the values of the gain and gamma of the noise texture map are adjusted to 1, the adjusted current material texture map can be obtained. Refer to Figure 4 , which is a schematic diagram of a noise texture map provided in the embodiments of the present invention. Among them, the left side is the initially created current material texture map, and the right side is the current material texture map after adjusting the texture parameters. The texture of the adjusted current material texture map is more delicate.

[0081] In addition, the embodiments of the present invention can also add an image effect to the current material texture map according to requirements. For example, if the relevant personnel hope that the final target rendering image can simulate the surface of a shadow puppet, an emboss effect of bevel and emboss can be added to the current material texture map. By adding the bevel and emboss effect, the finally generated rendering image can be made more realistic and delicate. Refer to Figure 5 , which is a comparison schematic diagram of a noise texture map before and after adding the bevel and emboss effect provided in the embodiments of the present invention. Among them, the left side is the noise texture map before adding the bevel and emboss effect, and the right side is the noise texture map after adding the bevel and emboss effect.

[0082] In the above embodiments, the purpose of adjusting the texture parameters of the current material texture map is to simulate the texture and texture of the surface of a shadow puppet. The advantage of using the noise texture map in the Nuke post-processing software is that the texture reference controllability of the noise texture map is higher, and compared with other material texture maps such as picture texture maps, the resolution clarity is not affected.

[0083] In an embodiment of the present invention, step 103, mapping and connecting the current material texture map and the texture mapping information to obtain a target material texture map, may include:

[0084] Copy the current material texture map;

[0085] Displace the copied current material texture map according to the size of the current material texture map to obtain a displaced material texture map;

[0086] Stitch the current material texture map and the displaced material texture map to obtain a stitched material texture map;

[0087] Map and connect the stitched material texture map and the texture mapping information to obtain a target material texture map.

[0088] In the related technical solution, after obtaining the current material texture map, the current material texture map and the texture mapping information (UV information) are connected through the STMap tool in the Nuke post-processing software. The purpose is to achieve UV mapping texture, and at this time, an incorrect result will be obtained. Specifically, refer to Figure 5 , which is a schematic diagram of the effect of an incorrect material texture map provided in the embodiment of the present invention. Observe Figure 5 It can be seen that if the current material texture map and the UV information are directly connected in the related technical solution, the mapped material texture map will have the problem of incomplete UV assignment, that is, the material texture map cannot be mapped to all asset models. The reason is that the texture map of the asset model uses the udim multi-quadrant texture map. If the current material texture map is not processed specifically, many objects in the rendered image of the asset model will not be able to map the corresponding material texture map. Specifically, refer to Figure 6 , which is a comparison schematic diagram of a partially enlarged original rendered texture map (left) and a partially enlarged material texture map in the related technical solution (right) provided in the embodiment of the present invention. For the convenience of observing the comparison schematic diagram, Figure 6 Can be further adjusted. Specifically, refer to Figure 7 , a comparison schematic diagram of a partially enlarged original rendered texture map (left) and a partially enlarged material texture map in the related technical solution (right) provided in the embodiment of the present invention after adjustment. If the material texture map in the related technical solution is used, the material texture map cannot be mapped to all asset models.

[0089] Refer to Figure 8, which is a schematic diagram of a quadrant provided in an embodiment of the present invention. The default UV map (material map) is saved in a quadrant. Assuming that the drawing area (the lines in the right figure) is the UV set of all objects in the original rendered image, then directly performing texture mapping can assign the material map to all asset models corresponding to the original rendered image. However, some asset models with higher precision are distributed in multiple quadrants. Specifically, refer to Figure 9 , which is a schematic diagram of a multi - quadrant provided in an embodiment of the present invention. Based on Figure 9 the example of the quadrant, assume that the UVs of all objects of the asset models in the original rendered image are distributed in quadrants 1001, 1002, and 1003. Specifically, refer to Figure 10 , which is a schematic diagram of the distribution of an asset model in multiple quadrants provided in an embodiment of the present invention. Then, using the default material map mapping, the material map can only be assigned to the objects of the asset models distributed in quadrant 1001. Refer to Figure 11 , which is a schematic diagram of an error of the target material map (right) connecting the original rendered image, the material map (left), and the texture mapping information (UV information). Since the material map can only be assigned to the objects of the asset models distributed in quadrant 1001, the target material map (right) can only map the objects of the asset models in quadrant 1001. Furthermore, it can be determined that the objects of the asset models enclosed by the line frame in the original rendered image (left) are in quadrant 1001.

[0090] To solve the above - mentioned problems, in an embodiment of the present invention, after obtaining the current material map, it is necessary to adjust the current material map so that the adjusted current material map can be mapped to the asset models of the original rendered image distributed in different quadrants. In a specific example, assume that the UVs of all objects of the asset models in the original rendered image are distributed in quadrants 1001, 1002, and 1003. The current material map can be copied to obtain a copied material map, and a transform displacement is added to the copied material map to translate it one unit (the size of the current material map) to the right, resulting in a displacement material map (displacement material map Figure 1 ). For example, assume that the resolution of the current material map is 4096 * 4096. Then, the copied material map can be displaced 4096 pixel units to the right, and then the current material map and the displacement material map Figure 1 are spliced (merged) to obtain a spliced displacement material map. Refer to Figure 12 , which is a schematic diagram of a spliced displacement material map obtained by merging the current material map and a displacement material map in an embodiment of the present invention. If the merged spliced displacement material map and the texture mapping information (UV information) are mapped and connected through an STMap node, then the obtained target material map, refer to Figure 13, which is one of the schematic diagrams comparing the original rendered image (left) and the target material texture map (right) provided in the embodiments of the present invention. Compared with only using the current material texture map, the target material texture map after merging a displacement material texture map can map more asset models.

[0091] Similarly, if a transform displacement is added to the copied material texture map to translate it two units (the size of the current material texture map) to the right, a displacement material texture map (displacement material texture Figure 2 ) is obtained. Referring to Figure 14 , which is a schematic diagram of a spliced displacement material texture map obtained by merging two displacement material texture maps with the current material texture map provided in the embodiments of the present invention. If the current material texture map is merged with the displacement material texture Figure 1 and the displacement material texture Figure 2 , a spliced displacement material texture map can be obtained. If the merged spliced displacement material texture map is mapped and connected with texture mapping information (UV information) through an STMap node, the resulting target material texture map is obtained. Referring to Figure 15 , which is the second schematic diagram comparing the original rendered image (left) and the target material texture map (right) provided in the embodiments of the present invention. Compared with the target material texture map after merging one displacement material texture map, the target material texture map after merging two displacement material texture maps can map more asset models.

[0092] Similarly, a spliced displacement material texture map (displacement material texture Figure 3 ) obtained by merging three displacement material texture maps with the current material texture map, and a schematic diagram of a spliced displacement material texture map after merging four displacement material texture maps (displacement material texture Figure 4 ) can be obtained. Referring to Figure 16 , which is a schematic diagram of a spliced displacement material texture map obtained by merging four displacement material texture maps with the current material texture map provided in the embodiments of the present invention. If the merged spliced displacement material texture map is mapped and connected with texture mapping information (UV information) through an STMap node, the resulting target material texture map is obtained. Referring to Figure 17 , which is the third schematic diagram comparing the original rendered image (left) and the target material texture map (right) provided in the embodiments of the present invention. Compared with the target material texture map after merging two displacement material texture maps, the target material texture map after merging two displacement material texture maps can map all asset models.

[0093] Referring to Figure 18, is a comparison schematic diagram of an original rendering image (left), an unprocessed material texture map (middle), and a processed target material texture map (right) provided in an embodiment of the present invention. Obviously, the unprocessed target material texture map can map the asset models in part of the original rendering image, and the processed target material texture map can map all the asset models in the original rendering image.

[0094] In an embodiment of the present invention, before copying the current material texture map, the method further includes:

[0095] In response to a user's zoom operation on the current material texture map, adjust the size of the current material texture map.

[0096] In a specific implementation, the proportions of asset models distributed in multiple quadrants may vary. Therefore, the user can be allowed to perform a zoom operation on the current material texture map so that the adjusted current material texture map adapts to the asset models. Exemplarily, referring to Figure 19 , is a schematic diagram of the relationship between the objects of an asset model and quadrants provided in an embodiment of the present invention. The objects of the asset model can include a character person, a bird, an environmental mountain, and leaves, etc. Among them, the UV plane (two-dimensional plane) unfolding diagrams of the character person and the bird in the asset model occupy the 1001 quadrant space, and the plane UV unfolding diagrams of the environmental mountain, leaves, and other objects occupy the 1002 quadrant space. In the process of generating a displacement material texture map by translating the current material texture map, the user can perform a zoom operation on the current material texture map based on the asset model to adjust the size of the current material texture map, so as to ensure that the proportion of the target material texture map is reasonable, and thus make the accuracy of the target rendering image generated based on the target material texture map higher.

[0097] In an embodiment of the present invention, before copying the current material texture map, the method further includes:

[0098] In response to a user's adjustment operation on the texture density of the current material texture map, adjust the texture density of the current material texture map.

[0099] In a specific implementation, if the current material texture map and the displacement material texture map use textures of the same density size, the texture effect can be referred to Figure 20 , is a schematic diagram of an asset model object using textures of the same density size provided in an embodiment of the present invention. For easy observation, referring to Figure 21, which is a schematic diagram of using textures of the same density for the objects in the enlarged asset model in the embodiments of the present invention. It can be observed that the texture density of the mountains in the asset model is relatively reasonable, but the texture gap of the birds is too large, resulting in weak texture quality. Therefore, during the process of generating the displacement texture map by translating the current texture map according to the current material map, the user can adjust the texture density of the current texture map based on the asset model, so as to adjust the texture density of the current texture map, making the texture density of the subsequent generated displacement texture map different from that of the current texture map. Refer to Figure 22 , which is a comparison schematic diagram of using textures of different density sizes for the current texture map and the displacement texture map in the embodiments of the present invention. In this way, by ensuring the reasonable texture density of the texture map (depending on the subjective judgment of the artist / user on the picture), refer to Figure 23 , which is a schematic diagram of the picture after using textures of different density sizes for the current texture map and the displacement texture map in the embodiments of the present invention, so that the accuracy of the finally generated target rendering picture is delicate, providing a better image viewing experience for the user.

[0100] In an embodiment of the present invention, obtaining the displacement texture map by displacing the copied current texture map according to the size of the current texture map may include:

[0101] According to the distribution of the asset model in the quadrant of the two-dimensional coordinate, obtaining the displacement texture map by displacing the copied current texture map according to the size of the current texture map.

[0102] In the embodiments of the present invention, according to the distribution of the asset model in the quadrant of the two-dimensional coordinate, the copied current texture map can be displaced according to the size of the current texture map to obtain the displacement texture map, so as to ensure that the spliced texture map after merging the current texture map and the displacement texture map can be mapped to all the asset models, ensuring that all the objects of the asset model can be displayed in the finally generated target rendering picture of the asset model.

[0103] In an embodiment of the present invention, obtaining the target color information data of the target texture map includes:

[0104] Responding to the user's selection operation on the target texture map, selecting a target map area from the target texture map; the target map area is the area where the model asset is mapped on the target texture map;

[0105] Obtaining the color information data in the target map area;

[0106] Performing an averaging process on the color information data to obtain average color information data.

[0107] In an embodiment of the present invention, average color information data can be generated according to a target texture map, and used to perform an overlay process with an original rendered image to generate a final target rendered image. Exemplarily, referring to Figure 24 , which is a schematic diagram of an operation mode and a target texture map area provided in an embodiment of the present invention. Use the curvetools tool of the Nuke post-processing software to connect the target texture map, and select a reasonable area (target texture map area) from the target texture map for operation. The operation mode (curve type) is selected as avg intensities, and finally an RGBA average color information data will be obtained. This value represents the average color value of the selected target texture map area. Specifically, refer to Figure 25 , which is a schematic diagram of an RGBA average color information data provided in an embodiment of the present invention. The color displayed under this data is gray.

[0108] In an embodiment of the present invention, the average color information data is the average color information data of each color channel of the target texture map; generating a target rendered image according to the target color information data and the original rendered image may include:

[0109] Generating target color information data according to the average color information data of each color channel and a specified expression;

[0110] Performing an overlay process on the target color information data and the original rendered image to generate a target rendered image.

[0111] In an embodiment of the present invention, referring to Figure 26 , which is a schematic diagram of the average color information data of each color channel provided in an embodiment of the present invention. Add a Multiply node to the target texture map in the Nuke post-processing software, connect the average color information data to the Multiply node, and then add a specified expression to each color channel. Exemplarily, referring to Figures 27 - 29 , which are schematic diagrams of adding expressions to the average color information data of the R color channel, G color channel, and B color channel respectively provided in an embodiment of the present invention. Then generate target color information data according to the average color information data of each color channel and the specified expression. Refer to Figure 30 , which is a comparison schematic diagram of the color information data of the target texture map without adding an expression and the target color information data with an added expression provided in an embodiment of the present invention. Perform a merge and overlay process (Multiply operation) on the target color information data and the original rendered image to obtain a target rendered image. Refer to Figure 31 , which is a schematic diagram of an enlarged target rendered image provided in an embodiment of the present invention. Refer to Figure 32, which is a schematic diagram of an enlarged original rendered image provided in an embodiment of the present invention. By comparison, it can be seen that the target rendered image is more delicate and refined.

[0112] It should be noted that if the target material texture map is directly subjected to a merge blending operation with the original rendered image, then the effect of obtaining the target rendered image can be referred to Figure 33 , which is a schematic diagram of a target rendered image after a merge blending operation of an enlarged target material texture map and the original rendered image in an embodiment of the present invention. Since the multiply operation is a multiplication operation of colors, and the value of a pure white layer is 1 in the Nuke post-processing software, then multiplying the pure white layer by the original rendered image results in the original rendered image. The value of the gray layer is 0.5, so multiplying it by the original rendered image will reduce the brightness of the original rendered image by half. The purpose of generating target color data information according to the target material texture map in the embodiment of the present invention is to increase the value of the target material texture map to 1 as a whole. Then, when performing the multiplication operation, the final brightness will not change significantly, and the shadow play texture can be given to the original rendered image.

[0113] In the embodiment of the present invention, the method of using the curvetools tool to connect the target material texture map and selecting a reasonable area for calculation to obtain the average color information data is more accurate and automated compared with the related technical solutions. Specifically, the related technical solution is to brighten the target material texture map by an artist and use vision to judge whether the target material texture map is close to pure white, while the embodiment of the present invention operates by obtaining the average color information data, and the whole process will be more accurate, and the value of the target material texture map will approach 1 infinitely as a whole.

[0114] In an embodiment of the present invention, before generating target color information data according to the average color information data of each color channel and a specified expression, the method may further include:

[0115] Responding to the user's selection operation to determine a specified expression for the original rendered image.

[0116] In the embodiment of the present invention, the specified expression can be selected by the user according to actual needs. Exemplarily, the specified expression (Expression) can be determined in the Nuke post-processing software. Subsequently, target color information data will be generated according to the average color information data of each color channel and the determined specified expression.

[0117] The technical problem to be solved by the embodiments of the present invention is to quickly implement a UDIM texture mapping production process for high-precision assets in the Nuke post-processing software. The related processing method is to re-feed the DCC production software process for texture update production and then render. If the scene resource volume is large and involves multiple sessions, then a relatively long time will be spent during the adjustment process. However, the embodiments of the present invention are more flexible in implementation and suitable for multi-person team collaboration, greatly improving the production efficiency of session shots. Specifically, the embodiments of the present invention provide a convenient debugging tool and technical solution, and its core content may include:

[0118] 1) Import the original rendered image and texture mapping information (UV information);

[0119] 2) Generate the current material texture (noise texture) in the Nuke post-processing software and add an emboss bevel relief effect to it;

[0120] 3) Displace and splice the current material texture to splice and generate a spliced material texture of multiple material textures;

[0121] 4) Map the spliced material texture in step 3 and add STMap and texture mapping information (UV information) to generate the target material texture;

[0122] 5) Add the curvetools tool to the target material texture to calculate the average color information data of the picked area, assign a specified expression to its data, and then link the value with the assigned expression to the multiply node to generate the target color information data;

[0123] 6) Merge the target color information data and the original rendered image together using the overlay mode to generate the final target rendered image.

[0124] Applying the production solution of the embodiments of the present invention can batch-process the textures of the session shots of film and television products. Compared with the related production solutions, the final effect of the embodiments of the present invention is what you see is what you get, with higher controllability, eliminating the lag during the adjustment process of the material texture, and this process can be toolized and applied to the shots of multiple sessions, greatly improving the production efficiency of session shots and achieving unified effects.

[0125] It should be noted that for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequence, because according to the embodiments of the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present invention.

[0126] Referring to Figure 34 , a structural block diagram of a rendering image processing device provided in an embodiment of the present invention is shown, which may specifically include the following modules:

[0127] A rendering image acquisition module 3401, configured to acquire an original rendering image of an asset model and texture mapping information; the texture mapping information is two-dimensional coordinate information on two-dimensional coordinates in at least one quadrant after the asset model is unfolded;

[0128] A material texture acquisition module 3402, configured to acquire a current material texture;

[0129] A mapping connection module 3403, configured to perform mapping connection on the material texture and the texture mapping information to obtain a target material texture; the target material texture is mapped to the asset model distributed in the quadrant of the two-dimensional coordinates;

[0130] A target color information data acquisition module 3404, configured to acquire target color information data of the target material texture;

[0131] A target rendering image preview module 3405, configured to generate a target rendering image according to the target color information data and the original rendering image, and preview the target rendering image.

[0132] In an embodiment of the present invention, the material texture acquisition module 3402 is configured to:

[0133] Create a current material texture;

[0134] Adjust the texture parameters of the current material texture; the texture parameters of the current material texture at least include the size, color, and image effect of the current material texture.

[0135] In an embodiment of the present invention, the mapping connection module 3403 is configured to:

[0136] Copy the current material texture;

[0137] Displace the copied current material texture according to the size of the current material texture to obtain a displaced material texture;

[0138] Stitch the current material texture and the displaced material texture to obtain a stitched material texture;

[0139] Perform mapping connection on the stitched material texture and the texture mapping information to obtain a target material texture.

[0140] In an embodiment of the present invention, the device further includes: a scaling module, configured to:

[0141] In response to the user's zoom operation on the current texture map, adjust the size of the current texture map.

[0142] In an embodiment of the present invention, the device further includes: an adjustment module, configured to:

[0143] In response to the user's adjustment operation on the texture density of the current texture map, adjust the texture density of the current texture map.

[0144] In an embodiment of the present invention, the mapping connection module 3403 is configured to:

[0145] According to the distribution of the asset model in the quadrants of the two-dimensional coordinate, displace the copied current texture map according to the size of the current texture map to obtain a displaced texture map.

[0146] In an embodiment of the present invention, the color information data acquisition module 3404 is configured to:

[0147] In response to the user's selection operation on the target texture map, select a target map area from the target texture map; the target map area is the area of the target texture map where the model asset is mapped;

[0148] Acquire the color information data in the target map area;

[0149] Perform an averaging process on the color information data to obtain average color information data.

[0150] In an embodiment of the present invention, the average color information data is the average color information data of each color channel of the target texture map; the target rendering image generation module 3405 is configured to:

[0151] Generate target color information data according to the average color information data of each color channel and a specified expression;

[0152] Overlay the target color information data with the original rendering image to generate a target rendering image.

[0153] In an embodiment of the present invention, the device further includes: an expression determination module, configured to:

[0154] In response to the user's selection operation, determine a specified expression for the original rendering image.

[0155] For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the related parts, please refer to the partial description of the method embodiment.

[0156] In addition, an embodiment of the present invention further provides an electronic device, which may include electronic devices such as a terminal device, a server (cluster), etc. For example, Figure 35 as shown, it includes a processor 1301, a communication interface 1302, a memory 1303, and a communication bus 1304. Among them, the processor 1301, the communication interface 1302, and the memory 1303 complete mutual communication through the communication bus 1304.

[0157] The memory 1303 is used to store a computer program.

[0158] When the processor 1301 is used to execute the program stored on the memory 1303, the steps of the above method are implemented.

[0159] The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity, only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0160] The communication interface is used for communication between the above terminal and other devices.

[0161] The memory may include a Random Access Memory (RAM), and may also include a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located far from the aforementioned processor.

[0162] The above-mentioned processor may be a general-purpose processor, including a Central Processing Unit (CPU for short), a Network Processor (NP for short), etc.; it may also be a Digital Signal Processor (DSP for short), an Application Processor (AP for short), a Graphics Processing Unit (GPU for short), an Image Signal Processor (ISP for short), a modulation / demodulation processor, a controller, a memory, a video codec, a baseband processor, a Neural-network Processing Unit (NPU for short), an Application Specific Integrated Circuit (ASIC for short), a Field-Programmable Gate Array (FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Among them, the controller may be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching instructions and executing instructions.

[0163] It should be noted that the above description of the structure of the electronic device is only for example. In practice, the electronic device may include more components than those shown in the figure. For example, the electronic device may also include a camera, a battery, a mobile communication module, a wireless communication module, an antenna, a receiver, a speaker, a microphone, a sensor, a button, a display screen, etc. Of course, the electronic device may also include fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. In addition, the components of the electronic device shown in the above figure may be implemented by hardware, software, or a combination of software and hardware. The embodiments of the present invention do not limit this.

[0164] The embodiments of the present invention also provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, it implements each step of the above-mentioned embodiment of the rendering screen processing method.

[0165] The embodiments of the present invention provide a computer program product. The program product is stored in a storage medium. The program product is executed by at least one processor to implement each process of the above-mentioned embodiment of the rendering screen processing method, and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0166] It should be noted that, in this article, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including such element.

[0167] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described method of the embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0168] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many forms without departing from the spirit and scope protected by the present invention and the claims, and all of them belong to the protection scope of the present invention.

[0169] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in the embodiments of the present invention can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0170] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described systems, devices and units can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0171] In the embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections between each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical or other forms.

[0172] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0173] In addition, in each embodiment of the present invention, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.

[0174] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical discs that can store program codes.

[0175] The above is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A rendering picture processing method, characterized in that: The method comprises: Acquire an original rendering image and texture mapping information of the asset model; the texture mapping information is two-dimensional coordinate information of the two-dimensional coordinates of at least one quadrant after the asset model is unfolded; Get the current material map; The current material map and the texture mapping information are mapped and connected to obtain a target material map; the target material map is mapped to the asset model distributed in the quadrant of the two-dimensional coordinate; Obtain target color information data of the target material map; A target rendering picture is generated according to the target color information data and the original rendering picture, and the target rendering picture is previewed.

2. The method according to claim 1, characterized in that Get the current material map, including: Create the current material map; Adjust the mapping parameters of the current material map; the mapping parameters of the current material map at least include the size, color and image effect of the current material map.

3. The method according to claim 2, characterized in that Mapping and connecting the current material map and the texture mapping information to obtain a target material map, including: Copying the current material map; Displacing the copied current texture map according to the size of the current texture map to obtain a displacement texture map; Splicing the current texture map and the displacement texture map to obtain a spliced ​​texture map; The spliced ​​material map and the texture mapping information are mapped and connected to obtain a target material map.

4. The method according to claim 3, characterized in that Before copying the current material map, the method further includes: In response to a user's scaling operation on the current texture map, a size of the current texture map is adjusted.

5. The method according to claim 3, characterized in that: Before copying the current material map, the method further includes: In response to a user's adjustment operation on the texture density of the current material map, the texture density of the current material map is adjusted.

6. The method according to claim 3, characterized in that Displacing the copied current texture map according to the size of the current texture map to obtain a displacement texture map, including: According to the distribution of the asset model in the quadrant of the two-dimensional coordinates, the copied current texture map is displaced according to the size of the current texture map to obtain a displaced texture map.

7. The method according to claim 1, characterized in that Obtaining target color information data of the target material map, including: In response to a user's selection operation on the target material map, a target map area is selected from the target material map; the target map area is an area of ​​the target material map where the model asset is mapped; Acquire color information data in the target map area; The color information data is averaged to obtain average color information data.

8. The method according to claim 7, characterized in that The average color information data is the average color information data of each color channel of the target material map; generating a target rendering picture according to the target color information data and the original rendering picture, including: Generate target color information data according to the average color information data of each color channel and a specified expression; The target color information data is superimposed on the original rendering picture to generate a target rendering picture.

9. The method according to claim 8, characterized in that Before generating target color information data according to the average color information data of each color channel and a specified expression, the method further includes: In response to a selection operation of the user, a specified expression for the original rendering picture is determined.

10. A rendering image processing device, characterized in that: The device comprises: A rendering image acquisition module, used to acquire an original rendering image and texture mapping information of an asset model; the texture mapping information is two-dimensional coordinate information of the asset model in at least one quadrant after the asset model is unfolded; The material map acquisition module is used to obtain the current material map; A mapping connection module, used for mapping and connecting the material map and the texture mapping information to obtain a target material map; the target material map is mapped to the asset model distributed in the quadrant of the two-dimensional coordinate; A color information data acquisition module, used to acquire target color information data of the target material map; The target rendering picture preview module is used to generate a target rendering picture according to the target color information data and the original rendering picture, and preview the target rendering picture.

11. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is used to store computer programs; The processor is used to implement the method according to any one of claims 1 to 9 when executing the program stored in the memory.

12. One or more computer-readable storage media having instructions stored thereon, which when executed by one or more processors cause the processors to perform the method according to any one of claims 1 to 9.

Images