Three-dimensional model processing method and device

Abstract

The embodiment of the invention discloses a three-dimensional model processing method and device, relates to the technical field of media, and is used for improving the flexibility of editing a three-dimensional model. The method includes receiving first information. And determining second information according to the first information. And sending the second information. Wherein the first information is used for indicating the change of at least one local area of the to-be-edited three-dimensional model and the change degree of the to-be-edited three-dimensional model, and the to-be-edited three-dimensional model comprises a plurality of local areas. The second information is used for indicating a change mode of at least one local area of the to-be-edited three-dimensional model.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of media technology, and in particular to a three-dimensional model processing method and device. Background Art

[0002] Three-dimensional (3D) modeling refers to building a model with three-dimensional data through a virtual three-dimensional space, that is, a three-dimensional model. The created models include but are not limited to characters and scenes such as people, machines, trees, and houses. Modeling is mainly divided into two parts: modeling and texturing. The modeling process can be simply understood as "bone shaping" and the texturing process can be understood as "beauty".

[0003] In the related art, the 3D model obtained by 3D modeling can be edited again, but the editing flexibility is poor. For example, in the related art, a user wants to edit the lips in the 3D facial model obtained by 3D modeling, but the editing process will edit the entire 3D facial model, thereby affecting the user experience.

[0004] Therefore, how to improve the flexibility of editing three-dimensional models is one of the problems that technical personnel in this field need to solve urgently. Summary of the invention

[0005] The embodiment of the present application provides a 3D model processing method and device for improving the flexibility of editing 3D models. To achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a three-dimensional model processing method, the method comprising: receiving first information. Determining second information based on the first information. Sending the second information. The first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, and the three-dimensional model to be edited includes multiple local areas. The second information is used to indicate the change mode of at least one local area of ​​the three-dimensional model to be edited.

[0007] It can be seen that the method provided in the embodiment of the present application divides the entire 3D model into multiple local areas, and the second information can be generated through the input information to edit one or more local areas of the 3D model. Compared with the related art, it is impossible to make further local edits on the basis of the mesh and texture of the 3D model. The method provided in the embodiment of the present application divides the entire 3D model into multiple local areas, so as to achieve further local edits on the basis of the mesh and texture of the 3D model, thereby improving the flexibility of editing the 3D model.

[0008] In a possible implementation manner, the first information includes at least one of text, picture, voice or the three-dimensional model.

[0009] In a possible implementation, the first information may be input into a target network model to obtain the second information, and a training set of the target network model includes at least one of a three-dimensional model, the first information, the second information, or a changed three-dimensional model.

[0010] It can be seen that the embodiment of the present application can train the target network model through the three-dimensional model before and after deformation and the second information, so that the trained target network model can output the second information.

[0011] In one possible implementation, the second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature. The grid incremental feature is used to characterize the change direction and amount of change of at least one grid in the three-dimensional model. The texture incremental feature is used to characterize the change direction and amount of change of at least one texture in the three-dimensional model. The local range incremental feature is used for the change direction and amount of change of at least one local area in the standard three-dimensional model.

[0012] In a second aspect, an embodiment of the present application provides another three-dimensional model processing method, the method comprising: sending first information, the first information being used to indicate a change in at least one local area of ​​a three-dimensional model to be edited and a degree of change in the three-dimensional model to be edited, the three-dimensional model to be edited comprising multiple local areas; receiving second information, the second information being used to indicate a change manner in at least one local area of ​​the three-dimensional model to be edited; and editing the three-dimensional model to be edited according to the second information to obtain a target three-dimensional model.

[0013] In a possible implementation manner, the to-be-edited three-dimensional model may be edited according to the second information to obtain a plurality of temporary three-dimensional models; and the target three-dimensional model may be determined according to the plurality of temporary three-dimensional models.

[0014] In a possible implementation, the above-mentioned three-dimensional model to be edited can be edited according to the above-mentioned second information to obtain a temporary three-dimensional model; the above-mentioned temporary three-dimensional model can be deformed according to the three-dimensional model to be edited; at least one mesh of the above-mentioned temporary three-dimensional model can be changed according to the three-dimensional model to be edited and the above-mentioned local range incremental feature and the above-mentioned mesh incremental feature; at least one texture of the above-mentioned temporary three-dimensional model can be changed according to the three-dimensional model to be edited and the above-mentioned local range incremental feature and the above-mentioned texture incremental feature; wherein the above-mentioned mesh incremental feature is used to characterize the change direction and change amount of at least one mesh in the three-dimensional model, the above-mentioned texture incremental feature is used to characterize the change direction and change amount of at least one texture in the three-dimensional model, and the above-mentioned local range incremental feature is used for the change direction and change amount of at least one local area in the standard three-dimensional model.

[0015] In a possible implementation manner, third information may also be received, where the third information is used to indicate a change in the second information; and the second information is changed according to the third information.

[0016] In a third aspect, an embodiment of the present application provides a three-dimensional model processing device, which includes: a transceiver unit and a processing unit. The transceiver unit is used to receive first information, and the first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, and the three-dimensional model to be edited includes multiple local areas. The processing unit is used to determine second information based on the first information, and the second information is used to indicate the change mode of at least one local area of ​​the three-dimensional model to be edited. The transceiver unit is also used to send the second information.

[0017] In a possible implementation manner, the first information includes at least one of text, picture, voice or the three-dimensional model.

[0018] In a possible implementation, the processing unit is specifically used to: input the first information into a target network model to obtain the second information, and the training set of the target network model includes at least one of a three-dimensional model, the first information, the second information, or a changed three-dimensional model.

[0019] In one possible implementation, the second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature. The grid incremental feature is used to characterize the change direction and amount of change of at least one grid in the three-dimensional model. The texture incremental feature is used to characterize the change direction and amount of change of at least one texture in the three-dimensional model. The local range incremental feature is used for the change direction and amount of change of at least one local area in the standard three-dimensional model.

[0020] In a fourth aspect, an embodiment of the present application provides another three-dimensional model processing device, which includes: a transceiver unit and a processing unit. The transceiver unit is used to send a first message, and the first message is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, and the three-dimensional model to be edited includes multiple local areas. The transceiver unit is also used to receive a second message, and the second message is used to indicate the change mode of at least one local area of ​​the three-dimensional model to be edited. The processing unit is used to edit the three-dimensional model to be edited according to the second information to obtain a target three-dimensional model.

[0021] In a possible implementation, the processing unit is specifically configured to: edit the to-be-edited three-dimensional model according to the second information to obtain a plurality of temporary three-dimensional models; and determine the target three-dimensional model according to the plurality of temporary three-dimensional models.

[0022] In a possible implementation, the processing unit is specifically used to: edit the 3D model to be edited according to the second information to obtain a temporary 3D model; deform the temporary 3D model according to the 3D model to be edited; change at least one mesh of the temporary 3D model according to the 3D model to be edited and the local range incremental feature and the mesh incremental feature; change at least one texture of the temporary 3D model according to the 3D model to be edited and the local range incremental feature and the texture incremental feature. The mesh incremental feature is used to characterize the change direction and amount of at least one mesh in the 3D model, the texture incremental feature is used to characterize the change direction and amount of at least one texture in the 3D model, and the local range incremental feature is used for the change direction and amount of at least one local area in the standard 3D model.

[0023] In a possible implementation, the transceiver unit is further used to: receive third information, where the third information is used to indicate a change in the second information;

[0024] In a possible implementation manner, the processing unit is further configured to: change the second information according to the third information.

[0025] In a fifth aspect, an embodiment of the present application further provides a three-dimensional model processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, it implements the method described in the above first aspect or any possible implementation method thereof.

[0026] Optionally, the three-dimensional model processing device may further include at least one memory, and the at least one memory is used to store the program code or instruction.

[0027] In a sixth aspect, an embodiment of the present application further provides a chip, comprising: an input interface, an output interface, and at least one processor. Optionally, the chip further comprises a memory. The at least one processor is used to execute the code in the memory, and when the at least one processor executes the code, the chip implements the method described in the first aspect or any possible implementation thereof.

[0028] Optionally, the above chip may also be an integrated circuit.

[0029] In a seventh aspect, an embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program includes methods for implementing the method described in the above-mentioned first aspect or any possible implementation thereof.

[0030] In an eighth aspect, an embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the method described in the first aspect or any possible implementation thereof.

[0031] The three-dimensional model processing device, computer storage medium, computer program product and chip provided in this embodiment are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the method provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 A schematic diagram of a communication system provided in an embodiment of the present application;

[0034] Figure 2 A schematic diagram of a process flow of a three-dimensional model processing method provided in an embodiment of the present application;

[0035] Figure 3 A schematic diagram of a first information generation process provided in an embodiment of the present application;

[0036] Figure 4 A schematic diagram of a second information generation process provided in an embodiment of the present application;

[0037] Figure 5 A schematic diagram of a target three-dimensional model generation process provided in an embodiment of the present application;

[0038] Figure 6 A schematic diagram of the structure of a three-dimensional model processing device provided in an embodiment of the present application;

[0039] Figure 7 A schematic diagram of the structure of another three-dimensional model processing device provided in an embodiment of the present application;

[0040] Figure 8 A schematic diagram of the structure of a chip provided in an embodiment of the present application;

[0041] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0042] Fig.10 A schematic diagram of the structure of another three-dimensional model processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0043] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0044] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0045] The terms "first" and "second" and the like in the description and drawings of the embodiments of the present application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.

[0046] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0047] It should be noted that in the description of the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as having priority or advantage over other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0048] First, the terms involved in the embodiments of the present application are explained.

[0049] Mesh: A collection of vertices and polygons used to represent models in computer graphics, where the polygons are usually triangles.

[0050] Texture Mapping: Also known as texture mapping or material mapping, it is a technology that maps a bitmap to the surface of a rendered object. Using texture mapping can give the model surface rich details and achieve a very realistic rendering effect.

[0051] Local area: used to act on meshes and textures to represent local information of meshes and textures.

[0052] Incremental Features: Indicates the amount of change in a mesh or texture in a certain state, used to superimpose the mesh or texture in the current state.

[0053] That is, it represents the change in the mesh, texture or deformation range of the three-dimensional model in a certain state, which is used to superimpose the mesh, texture or deformation range in the current state. The current patent incremental features have three types: mesh incremental features, texture incremental features, and local range incremental features.

[0054] For example, if you input "nose becomes straighter", the corresponding grid incremental feature will be output. The grid is a collection of points, lines and surfaces, where the point set can be regarded as Nx3 data, N points, each point has 3 coordinates (xyz). Changing the value of the point in the point set will cause visual deformation of the grid. The grid incremental feature is also Nx3 data. Each "point" of the grid incremental feature represents the offset of the corresponding point of the current grid. The current grid data plus the grid incremental feature multiplied by a certain coefficient (0 to 1) results in a new grid. The new grid is deformed based on the current grid. Visually, the points in the nose range of the grid have changed, resulting in a "bigger" effect. By adjusting the coefficient, the effect range of the new grid can be controlled within the current grid (coefficient is 0) and the grid after the nose becomes bigger (coefficient is 1). Of course, the coefficient can be greater than 1 to make the nose bigger. Note: In order to facilitate understanding, the calculation rule of this example is simple addition. It is not based on this in actual operation, and the calculation rules of different incremental feature types are not necessarily the same. Similarly, if you input "nose becomes whiter", the corresponding texture map incremental features will be returned; if you input "nose range expands to the left and right", the corresponding local range incremental features will be returned.

[0055] In the related art, the 3D model obtained by 3D modeling can be edited again, but the editing flexibility is poor. For example, in the related art, a user wants to edit the lips in the 3D facial model obtained by 3D modeling, but the editing process will edit the entire 3D facial model, thereby affecting the user experience.

[0056] To this end, an embodiment of the present application provides a three-dimensional model processing method for improving the flexibility of editing three-dimensional models. The method can be applied to a communication system. Figure 1 Schematic diagram of a communication system 100 provided in an embodiment of the present application. Figure 1 The communication system 100 shown may include: a server 101 and a terminal device 102 .

[0057] Exemplarily, the server in the embodiments of the present application can be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, a vehicle-mounted device, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, etc. The embodiments of the present application do not impose any special restrictions on the specific form of the device.

[0058] Exemplarily, the terminal device 102 in the embodiment of the present application can be a virtual reality (VR) display device, a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, a vehicle-mounted device, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, etc. When the electronic device is a mobile phone, the electronic device needs to be used in conjunction with VR glasses. Among them, the mobile phone can receive VR scene video streams, and VR glasses are used to display VR scene videos. In addition, the electronic device can also be a personal digital assistant (PDA), an augmented reality (AR)\virtual reality (VR) device, etc., and the embodiment of the present application does not impose any special restrictions on the specific form of the device.

[0059] Exemplarily, the terminal device 102 may receive and process the data returned by the server 101 by installing a software development kit (SDK).

[0060] Figure 2 A three-dimensional model processing method provided in an embodiment of the present application is shown, and the method includes:

[0061] S201. The terminal device sends first information to the server.

[0062] Correspondingly, the server receives the first information from the terminal device.

[0063] The first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, and the three-dimensional model to be edited includes multiple local areas.

[0064] Exemplarily, the terminal device may send the first information to the server in the form of an application (APP), a web page, a design software plug-in, etc.

[0065] Exemplarily, the 3D model to be edited may be a basic 3D model, an initialized template model, a 3D model edited in the last round, or a model uploaded by a user that complies with the editing rules.

[0066] Among them, the editing rules include: the topological semantics of the mesh need to be consistent, the mesh vertices, lines, and faces need to be consistent with the template 3D mesh, the semantics of the points need to be consistent (for example, if the vertex in the middle of the nose is numbered 100, then the vertex in the middle of the nose of the model uploaded by the user must also be numbered 100); the UV coordinates of the 3D model need to be consistent with the template 3D model; and the 3D model mapping needs to be based on the UV coordinates of the template 3D model.

[0067] In a possible implementation manner, the first information includes at least one of text, picture, voice or the three-dimensional model.

[0068] For example, Figure 3 As shown, the terminal device can generate first sub-information indicating the change of at least one local area of ​​the three-dimensional model to be edited through text, pictures, voice or other information input by the user, and then adjust the degree of change of the three-dimensional model to be edited through the control.

[0069] like Figure 3 As shown, the user can generate the corresponding first sub-information through text information such as "expand the left and right range of the nose a little more", "make the nose a little bigger", "make the skin color a little brighter" etc. input by the user, and then display the control of the first sub-information. The user adjusts the increment coefficient of the first sub-information of the control (i.e., the degree of change of the local area corresponding to the first sub-information) through the plus key and minus key in the adjustment control of the first sub-information. Among them, the number in the control represents the magnitude of the degree of change, and the larger the number in the control, the greater the degree of change of the local area corresponding to the control.

[0070] In a possible implementation manner, the first information may also be used to indicate a preset three-dimensional model.

[0071] For example, multiple 3D models (such as common objects, people, animals, etc.) can be preset, and then the user can indicate the change of the 3D model to be edited to the preset 3D model and the degree of change through text, voice, etc. For example, it can be indicated to change the facial 3D model to be edited to the 3D model of the preset person, and the degree of change can be indicated by the incremental coefficient. The larger the incremental coefficient, the more the facial 3D model to be edited will resemble the 3D model of the preset person after the change.

[0072] S202: The server determines second information according to the first information.

[0073] The second information is used to indicate a change mode of at least one local area of ​​the three-dimensional model to be edited.

[0074] In a possible implementation, the variation of at least one local area includes multiple variation of one local area.

[0075] In one possible implementation, the first information may be input into a target network model to obtain the second information, and the training set of the target network model includes multiple groups of training data, each group of training data includes at least one of a three-dimensional model, the first information, the second information, or a changed three-dimensional model.

[0076] In one possible implementation, the second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature. The grid incremental feature is used to characterize the change direction and amount of change of at least one grid in the three-dimensional model. The texture incremental feature is used to characterize the change direction and amount of change of at least one texture in the three-dimensional model. The local range incremental feature is used for the change direction and amount of change of at least one local area in the standard three-dimensional model.

[0077] For example, Figure 4 As shown, the server can input the first sub-information and the incremental coefficient of the first sub-information (ie, the first information) into the target network model to obtain mesh incremental features, texture incremental features, and local range incremental features (ie, the second information).

[0078] like Figure 4 As shown, in the case where the first information includes the three-dimensional model to be edited, the three-dimensional model to be edited can also be input into the target network model.

[0079] In a possible implementation manner, the target network model may also be trained according to the second information.

[0080] For example, Figure 4 As shown, after obtaining the second information, a grid superposition operation can be performed on the basic three-dimensional model according to the grid increment feature, a texture superposition operation can be performed on the basic three-dimensional model according to the texture increment feature, and a grid superposition operation can be performed on the basic three-dimensional model according to the local increment feature to obtain a superimposed three-dimensional model (i.e., a deformed three-dimensional model). Loss calculation is performed based on the superimposed three-dimensional model and the real deformed three-dimensional model in the training set, and the target network model is trained through back propagation.

[0081] The basic 3D model may be a basic 3D model that matches the 3D model to be edited. For example, if the 3D model to be edited is a 3D model of a male face, the basic 3D model selected by the target network model is a basic 3D model of a male face.

[0082] Exemplarily, the target network model may include a generative network or other networks. For example, the target network model may include a variational auto encoder (VAE) network, a generative adversarial network (GAN), and a diffusion network.

[0083] In a possible implementation, different types of incremental features may have different operation rules, and the above-mentioned superposition includes but is not limited to addition.

[0084] For example, for the grid incremental feature, the above superposition can be a simple addition, which shows how to get the edited effect by translating each point. It can be the addition of the current grid point coordinates (x, y, z) and the incremental feature (x', y', z') of the same point sequence (for example, the 100th point) based on the coefficient k. More complex operation rules can also be used, such as each point has a scaling and rotation based on a certain point (such as the origin) in addition to the displacement.

[0085] In a possible implementation, the coordinate f of the superimposed i-th grid point in the three-dimensional model is i Can satisfy:

[0086] f i =s i +z i *k

[0087] Among them, s i Represents the (x, y, z) coordinates of the i-th grid point in the current 3D model, z i Represents the incremental feature (x', y', z') coordinates of the ith grid point in the current 3D model.

[0088] For another example, for texture incremental features, such as grid addition, RGB or other spatial translation is performed on each pixel, and image algorithms such as various filtering algorithms are used to act on the incremental features and then fused with the current texture.

[0089] For another example, for local range incremental features, the above-mentioned superposition may include corrosion and expansion operation rules to increase or decrease the current area.

[0090] S203: The server sends second information to the terminal device.

[0091] Correspondingly, the terminal device receives the second information from the server.

[0092] S204: The terminal device edits the to-be-edited three-dimensional model according to the second information to obtain a target three-dimensional model.

[0093] In a possible implementation, the to-be-edited three-dimensional model may be edited according to the second information to obtain a plurality of temporary three-dimensional models, and the target three-dimensional model may be determined according to the plurality of temporary three-dimensional models.

[0094] Exemplarily, the terminal can edit the above-mentioned 3D model to be edited according to the above-mentioned second information to obtain multiple temporary 3D models, and render them in real time to present a preview effect to the user, so that the user can determine the target 3D model from multiple temporary 3D models according to the preview effect.

[0095] In one possible implementation, Figure 5 As shown, the 3D model to be edited can be edited according to the second information to obtain a temporary 3D model. The temporary 3D model is deformed according to the 3D model to be edited. At least one mesh of the temporary 3D model is changed according to the 3D model to be edited, the local range increment feature, and the mesh increment feature. At least one texture of the temporary 3D model is changed according to the 3D model to be edited, the local range increment feature, and the texture increment feature.

[0096] The embodiments of the present application do not limit the specific manner in which the temporary 3D model is deformed according to the 3D model to be edited. For example, the temporary 3D model can be based on the 3D model to be edited, with a local area as a calibration target, and scaled and rigidly transformed so that the temporary 3D model has the same area size as the 3D model to be edited, the area edges are aligned, and the normals are in the same direction.

[0097] In a possible implementation, the terminal device may receive third information, and change the second information according to the third information, wherein the third information is used to indicate the change of the second information.

[0098] For example, the terminal device can generate new first information through the received third information, obtain new second information through the new first information, edit the target 3D model through the new second information, and generate a new target 3D model, and repeat this process until a 3D model satisfactory to the user is obtained.

[0099] In a possible implementation, the method provided in the embodiment of the present application can be independently executed by a server, that is, the above S201 to S204 can be independently executed by a server.

[0100] In another possible implementation, the method provided in the embodiment of the present application may be independently executed by a terminal device, that is, the above S201 to S204 may be independently executed by a terminal device.

[0101] It can be seen that the method provided in the embodiment of the present application divides the entire 3D model into multiple local areas, and the second information can be generated through the input information to edit one or more local areas of the 3D model. Compared with the related art, it is impossible to make further local edits on the basis of the mesh and texture of the 3D model. The method provided in the embodiment of the present application divides the entire 3D model into multiple local areas, so as to achieve further local edits on the basis of the mesh and texture of the 3D model, thereby improving the flexibility of editing the 3D model.

[0102] The following will be combined Figure 6 and Figure 7 A three-dimensional model processing device for executing the above three-dimensional model processing method is introduced.

[0103] It is understandable that, in order to realize the above functions, the three-dimensional model processing device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0104] The embodiment of the present application can divide the functional modules of the three-dimensional model processing device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0105] In the case of dividing each functional module into corresponding functional modules, Figure 6 A possible composition diagram of the three-dimensional model processing device involved in the above embodiment is shown, and the device can be a server, or a module applied to the server (such as a processor, a chip or a chip system, etc.), or a logical node, a logical module or software that can realize all or part of the server functions. Figure 6 As shown, the three-dimensional model processing device 600 may include: a transceiver unit 601 and a processing unit 602 .

[0106] The transceiver unit 601 is used to receive first information, where the first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, and the three-dimensional model to be edited includes multiple local areas;

[0107] The processing unit 602 is configured to determine second information according to the first information, wherein the second information is used to indicate a change mode of at least one local area of ​​the three-dimensional model to be edited;

[0108] The transceiver unit 601 is further configured to send the second information.

[0109] In a possible implementation manner, the first information includes at least one of text, picture, voice or the three-dimensional model.

[0110] In a possible implementation, the processing unit 602 is specifically used to: input the first information into a target network model to obtain the second information, and the training set of the target network model includes at least one of the three-dimensional model, the first information, the second information, or the changed three-dimensional model.

[0111] In one possible implementation, the second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature. The grid incremental feature is used to characterize the change direction and amount of change of at least one grid in the three-dimensional model. The texture incremental feature is used to characterize the change direction and amount of change of at least one texture in the three-dimensional model. The local range incremental feature is used for the change direction and amount of change of at least one local area in the standard three-dimensional model.

[0112] In the case of dividing each functional module into corresponding functional modules, Figure 7 A possible composition diagram of the three-dimensional model processing device involved in the above embodiment is shown, and the device can be a terminal device, or a module applied to the terminal device (such as a processor, a chip or a chip system, etc.), or a logical node, a logical module or software that can realize all or part of the functions of the terminal device. Figure 7 As shown, the three-dimensional model processing device 700 may include: a transceiver unit 701 and a processing unit 702 .

[0113] The transceiver unit 701 is used to send first information, where the first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited. The three-dimensional model to be edited includes multiple local areas.

[0114] The transceiver unit 701 is further used to receive second information, where the second information is used to indicate a change mode of at least one local area of ​​the three-dimensional model to be edited.

[0115] The processing unit 702 is configured to edit the to-be-edited 3D model according to the second information to obtain a target 3D model.

[0116] In a possible implementation, the processing unit 702 is specifically configured to: edit the to-be-edited 3D model according to the second information to obtain a plurality of temporary 3D models; and determine the target 3D model according to the plurality of temporary 3D models.

[0117] In a possible implementation, the processing unit 702 is specifically used to: edit the 3D model to be edited according to the second information to obtain a temporary 3D model; deform the temporary 3D model according to the 3D model to be edited; change at least one mesh of the temporary 3D model according to the 3D model to be edited and the local range incremental feature and the mesh incremental feature; change at least one texture of the temporary 3D model according to the 3D model to be edited and the local range incremental feature and the texture incremental feature. The mesh incremental feature is used to characterize the change direction and amount of at least one mesh in the 3D model, the texture incremental feature is used to characterize the change direction and amount of at least one texture in the 3D model, and the local range incremental feature is used for the change direction and amount of at least one local area in the standard 3D model.

[0118] In a possible implementation, the transceiver unit 701 is further used to: receive third information, where the third information is used to indicate a change in the second information;

[0119] In a possible implementation manner, the processing unit 702 is further configured to: change the second information according to the third information.

[0120] The embodiment of the present application also provides a chip. Figure 8 800 is a schematic diagram showing the structure of a chip 800. The chip 800 includes one or more processors 801 and an interface circuit 802. Optionally, the chip 800 may also include a bus 803.

[0121] The processor 801 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above three-dimensional model processing method may be completed by an integrated logic circuit of hardware in the processor 801 or by instructions in the form of software.

[0122] Optionally, the processor 801 may be a general purpose processor, a digital signal processing (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods and steps disclosed in the embodiments of the present application may be implemented or executed. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0123] The interface circuit 802 can be used to send or receive data, instructions or information. The processor 801 can use the data, instructions or other information received by the interface circuit 802 to process, and can send the processing completion information through the interface circuit 802.

[0124] Optionally, the chip also includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).

[0125] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).

[0126] Optionally, the chip can be used in the three-dimensional model processing device involved in the embodiment of the present application. Optionally, the interface circuit 802 can be used to output the execution result of the processor 801. The three-dimensional model processing method provided by one or more embodiments of the embodiment of the present application can refer to the aforementioned embodiments, which will not be repeated here.

[0127] It should be noted that the functions corresponding to the processor 801 and the interface circuit 802 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0128] Fig. 9 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application, the electronic device 900 may be a processor or a chip or a functional module in a processor. Fig. 9 As shown, the electronic device 900 includes a processor 901 , a transceiver 902 and a communication circuit 903 .

[0129] Among them, the processor 901 is used to execute any step in the three-dimensional model processing method provided in the embodiment of the present application, and in the process of executing any step in the three-dimensional model processing method provided in the embodiment of the present application, the transceiver 902 and the communication line 903 can be selectively called to complete the corresponding operation.

[0130] Furthermore, the electronic device 900 may also include a memory 904. The processor 901, the memory 904 and the transceiver 902 may be connected via a communication line 903.

[0131] The processor 901 is a processor, a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 901 may also be other devices with processing functions, such as circuits, devices, or software modules, without limitation.

[0132] The transceiver 902 is used to communicate with other devices or other communication networks, and other communication networks may be Ethernet, radio access network (RAN), wireless local area network (WLAN), etc. The transceiver 902 may be a module, a circuit, a transceiver or any device capable of achieving communication.

[0133] The transceiver 902 is mainly used for sending and receiving commands and information, etc., and may include a transmitter and a receiver, which respectively send and receive commands and information, etc.; operations other than sending and receiving commands and information, etc. are implemented by the processor.

[0134] The communication line 903 is used to transmit information between the components included in the electronic device 900.

[0135] In one design, the processor may be considered as the logic circuit and the transceiver may be considered as the interface circuit.

[0136] The memory 904 is used to store instructions, where the instructions may be computer programs.

[0137] The memory 904 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DRRAM). The memory 904 may also be a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disk, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, etc. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0138] It should be noted that the memory 904 can exist independently of the processor 901, or can be integrated with the processor 901. The memory 904 can be used to store instructions or program codes or some data, etc. The memory 904 can be located inside the electronic device 900, or outside the electronic device 900, without limitation. The processor 901 is used to execute the instructions stored in the memory 904 to implement the method provided in the above embodiment of the present application.

[0139] In one example, the processor 901 may include one or more processors, such as Fig. 9 Processor 0 and processor 1 in.

[0140] As an optional implementation, the electronic device 900 includes multiple processors, for example, Fig. 9 In addition to the processor 901, a processor 907 may also be included.

[0141] As an optional implementation, the electronic device 900 further includes an output device 905 and an input device 906. Exemplarily, the input device 906 is a keyboard, a mouse, a microphone, a joystick, and the like, and the output device 905 is a display screen, a speaker, and the like.

[0142] It should be noted that the electronic device 900 may be a chip system or a Fig. 9 Devices with similar structures in the chip system. Among them, the chip system can be composed of chips, or it can include chips and other discrete devices. The actions, terms, etc. involved in the various embodiments of this application can refer to each other without limitation. The message name or parameter name in the message exchanged between the various devices in the embodiment of this application is only an example, and other names can also be used in the specific implementation without limitation. In addition, Fig. 9 The components shown in the figure do not constitute a limitation on the electronic device 900. Fig. 9 In addition to the components shown, the electronic device 900 may include Fig. 9 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.

[0143] The processor and transceiver described in the present application can be implemented in an integrated circuit (IC), an analog IC, a radio frequency integrated circuit, a mixed signal IC, an application specific integrated circuit (ASIC), a printed circuit board (PCB), an electronic device, etc. The processor and transceiver can also be manufactured using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), N-type metal oxide semiconductor (NMOS), P-type metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (GaAs), etc.

[0144] Fig.10The following is a schematic diagram of the structure of a 3D model processing device provided in an embodiment of the present application. The 3D model processing device can be applied to the scenario shown in the above method embodiment. For ease of explanation, Fig.10 Only the main components of the three-dimensional model processing device are shown, including a processor 1001, a memory 1002, a control circuit 1003, and an input-output device 1004. The processor 1001 is mainly used to process the communication protocol and communication data, execute the software program, and process the data of the software program. The memory 1002 is mainly used to store the software program and data. The control circuit 1003 is mainly used for power supply and transmission of various electrical signals. The input-output device 1004 is mainly used to receive data input by the user and output data to the user.

[0145] When the three-dimensional model processing device is a processor 1001, the control circuit 1003 can be a mainboard, the memory 1002 includes a hard disk, RAM, ROM and other media with storage functions, the processor 1001 can include a baseband processor 1001 and a central processing unit, the baseband processor is mainly used to process the communication protocol and communication data, the central processing unit is mainly used to control the entire three-dimensional model processing device, execute software programs, and process the data of the software programs, and the input and output device 1004 includes a display screen, a keyboard and a mouse, etc.; the control circuit 1003 can further include or connect a transceiver circuit or a transceiver, such as: a network cable interface, etc., for sending or receiving data or signals, such as data transmission and communication with other devices. Further, it can also include an antenna for sending and receiving wireless signals, and for data / signal transmission with other devices.

[0146] An embodiment of the present application also provides a three-dimensional model processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, the above-mentioned related method steps are implemented to implement the three-dimensional model processing method in the above-mentioned embodiment.

[0147] Optionally, the device may further include at least one memory, and the at least one memory is used to store the program code or instruction.

[0148] An embodiment of the present application also provides a computer storage medium, which stores computer instructions. When the computer instructions are executed on a three-dimensional model processing device, the three-dimensional model processing device executes the above-mentioned related method steps to implement the three-dimensional model processing method in the above-mentioned embodiment.

[0149] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the three-dimensional model processing method in the above-mentioned embodiment.

[0150] The embodiment of the present application also provides a three-dimensional model processing device, which can be a chip, an integrated circuit, a component or a module. Specifically, the device may include a connected processor and a memory for storing instructions, or the device includes at least one processor for obtaining instructions from an external memory. When the device is running, the processor can execute instructions so that the chip executes the three-dimensional model processing method in the above-mentioned method embodiments.

[0151] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0152] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0153] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0154] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0155] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, and may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0156] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0157] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the above methods in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0158] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A three-dimensional model processing method, characterized in that: The method comprises: receiving first information, wherein the first information is used to indicate at least one local area of ​​a to-be-edited three-dimensional model that is changed and a degree of change of the to-be-edited three-dimensional model, wherein the to-be-edited three-dimensional model includes a plurality of local areas; determining second information according to the first information, where the second information is used to indicate a change mode of at least one local area of ​​the to-be-edited three-dimensional model; The second information is sent.

2. The method according to claim 1, characterized in that The first information includes at least one of text, picture, voice or the three-dimensional model.

3. The method according to claim 1 or 2, characterized in that: The determining the second information according to the first information includes: The first information is input into a target network model to obtain the second information, wherein a training set of the target network model includes at least one of a three-dimensional model, the first information, the second information, or a changed three-dimensional model.

4. The method according to any one of claims 1 to 3, characterized in that: The second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature, the grid incremental feature is used to characterize the change direction and change amount of at least one grid in the three-dimensional model, the texture incremental feature is used to characterize the change direction and change amount of at least one texture in the three-dimensional model, and the local range incremental feature is used for the change direction and change amount of at least one local area in the standard three-dimensional model.

5. A three-dimensional model processing method, characterized in that: The method comprises: Sending first information, where the first information is used to indicate that at least one local area of ​​the three-dimensional model to be edited is changed and the degree of change of the three-dimensional model to be edited, where the three-dimensional model to be edited includes a plurality of local areas; receiving second information, where the second information is used to indicate a change mode of at least one local area of ​​the to-be-edited three-dimensional model; The three-dimensional model to be edited is edited according to the second information to obtain a target three-dimensional model.

6. The method according to claim 5, characterized in that The step of editing the to-be-edited three-dimensional model according to the second information to obtain a target three-dimensional model includes: Edit the to-be-edited three-dimensional model according to the second information to obtain a plurality of temporary three-dimensional models; A target three-dimensional model is determined according to the plurality of temporary three-dimensional models.

7. The method according to claim 5 or 6, characterized in that: The second information includes a mesh increment feature, a texture increment feature, and a local range increment feature, and the editing of the to-be-edited three-dimensional model according to the second information to obtain a target three-dimensional model includes: Edit the to-be-edited three-dimensional model according to the second information to obtain a temporary three-dimensional model; Deforming the temporary three-dimensional model according to the three-dimensional model to be edited; Changing at least one grid of the temporary three-dimensional model according to the three-dimensional model to be edited, the local range incremental feature, and the grid incremental feature; Changing at least one texture of the temporary three-dimensional model according to the three-dimensional model to be edited, the local range incremental feature, and the texture incremental feature; Among them, the grid incremental feature is used to characterize the change direction and change amount of at least one grid in the three-dimensional model, the texture incremental feature is used to characterize the change direction and change amount of at least one texture in the three-dimensional model, and the local range incremental feature is used for the change direction and change amount of at least one local area in the standard three-dimensional model.

8. The method according to any one of claims 5 to 7, characterized in that The method further comprises: receiving third information, where the third information is used to indicate a change in the second information; The second information is changed according to the third information.

9. A three-dimensional model processing device, characterized in that: The device comprises a transceiver unit and a processing unit; The transceiver unit is used to receive first information, where the first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, where the three-dimensional model to be edited includes multiple local areas; The processing unit is used to determine second information according to the first information, where the second information is used to indicate a change mode of at least one local area of ​​the three-dimensional model to be edited; The transceiver unit is further used to send the second information.

10. The device according to claim 9, characterized in that The first information includes at least one of text, picture, voice or the three-dimensional model.

11. The device according to claim 9 or 10, characterized in that The processing unit is specifically used for: The first information is input into a target network model to obtain the second information, wherein a training set of the target network model includes at least one of a three-dimensional model, the first information, the second information, or a changed three-dimensional model.

12. The device according to any one of claims 9 to 11, characterized in that The second information includes at least one of a grid incremental feature, a texture incremental feature or a local range incremental feature, the grid incremental feature is used to characterize the change direction and change amount of at least one grid in the three-dimensional model, the texture incremental feature is used to characterize the change direction and change amount of at least one texture in the three-dimensional model, and the local range incremental feature is used for the change direction and change amount of at least one local area in the standard three-dimensional model.

13. A three-dimensional model processing device, characterized in that: The device comprises a transceiver unit and a processing unit; The transceiver unit is used to send first information, where the first information is used to indicate the change of at least one local area of ​​the three-dimensional model to be edited and the degree of change of the three-dimensional model to be edited, where the three-dimensional model to be edited includes multiple local areas; The transceiver unit is further used to receive second information, where the second information is used to indicate a change mode of at least one local area of ​​the three-dimensional model to be edited; The processing unit is used to edit the to-be-edited three-dimensional model according to the second information to obtain a target three-dimensional model.

14. The device according to claim 13, characterized in that The processing unit is specifically used for: Edit the to-be-edited three-dimensional model according to the second information to obtain a plurality of temporary three-dimensional models; A target three-dimensional model is determined according to the plurality of temporary three-dimensional models.

15. The device according to claim 13 or 14, characterized in that The second information includes a grid increment feature, a texture increment feature and a local range increment feature, and the processing unit is specifically used for: Edit the to-be-edited three-dimensional model according to the second information to obtain a temporary three-dimensional model; Deforming the temporary three-dimensional model according to the three-dimensional model to be edited; Changing at least one grid of the temporary three-dimensional model according to the three-dimensional model to be edited, the local range incremental feature, and the grid incremental feature; Changing at least one texture of the temporary three-dimensional model according to the three-dimensional model to be edited, the local range incremental feature, and the texture incremental feature; Among them, the grid incremental feature is used to characterize the change direction and change amount of at least one grid in the three-dimensional model, the texture incremental feature is used to characterize the change direction and change amount of at least one texture in the three-dimensional model, and the local range incremental feature is used for the change direction and change amount of at least one local area in the standard three-dimensional model.

16. The device according to any one of claims 13 to 15, characterized in that The transceiver unit is also used for: receiving third information, where the third information is used to indicate a change in the second information; The processing unit is further configured to change the second information according to the third information.

17. A three-dimensional model processing device, comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory so that the three-dimensional model processing device implements the method according to any one of claims 1 to 8.

18. A computer-readable storage medium for storing a computer program, characterized in that: When the computer program is executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 8.

19. A computer program product, comprising instructions, characterized in that: When the instructions are executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 8.

20. A chip comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory so that the three-dimensional model processing device implements the method according to any one of claims 1 to 8.

Images