Virtual character expression processing method and device, electronic equipment and storage medium

Abstract

The application provides a virtual character expression processing method and device, electronic equipment and storage medium, relates to the technical field of cloud computing, and includes the following steps: obtaining a skin model of a face and a neck of a virtual character model to be processed, positions of a plurality of feature points related to facial expressions in a polygon model, and positions of a plurality of first positioning points in a skin model of a face and a neck of a target character model; based on the positions of the plurality of feature points in the polygon model, determining positions of a plurality of second positioning points corresponding to the plurality of feature points in the skin model of the face and the neck of the virtual character model to be processed; and processing an expression of the virtual character model into an expression of the target character model according to the positions of the plurality of first positioning points, the positions of the plurality of second positioning points, and expression information of the target character model. In the embodiment, the positioning points do not need to be manually determined by designers, the production efficiency of the expression model can be improved, and the expression model with stable quality can be output.

Description

Technical Field

[0001] This application relates to the field of cloud computing technology, and in particular to a method, apparatus, electronic device and storage medium for processing virtual character expressions. Background Technology

[0002] In the process of creating virtual character models, virtual character creation tools (such as Daz, Character Creator, etc.) are often used to customize and generate virtual characters. The character models generated by these methods need to go through processes such as redirecting bone binding and facial expression fusion deformation model creation before they can be used in a standardized character-driven process to generate character animations.

[0003] When creating facial expression models for virtual characters, designers need to manually determine the positioning points for each expression. This makes it impossible to guarantee that the points will be in the optimal position every time, resulting in low production efficiency. Furthermore, the expression matching process is cumbersome, and the quality of the output facial expression models for virtual characters is unstable. Summary of the Invention

[0004] This application provides a method, apparatus, electronic device, and storage medium for processing virtual character expressions, in order to solve the problems of low efficiency and unstable quality in creating expression models for virtual characters.

[0005] In a first aspect, embodiments of this application provide a method for processing virtual character expressions, the method comprising:

[0006] The process involves obtaining the skin models of the face and neck of the virtual character model to be processed, the positions of multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin models of the face and neck of the target character model; based on the positions of the multiple feature points in the polygon model, determining the positions of multiple second positioning points corresponding to the multiple feature points in the skin models of the face and neck of the virtual character model to be processed; and processing the expression of the virtual character model into the expression of the target character model based on the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model.

[0007] Secondly, embodiments of this application provide a virtual character expression processing device, the device comprising:

[0008] The acquisition module is used to acquire the skin model of the face and neck of the virtual character model to be processed, the positions of multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin model of the face and neck of the target character model; the determination module is used to determine the positions of multiple second positioning points corresponding to the multiple feature points in the skin model of the face and neck of the virtual character model to be processed, based on the positions of the multiple feature points in the polygon model; the processing module is used to process the expression of the virtual character model into the expression of the target character model according to the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model.

[0009] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory, wherein the processor implements any of the methods described above when executing the computer program.

[0010] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the method described in any of the above-mentioned embodiments.

[0011] Compared with the prior art, this application has the following advantages:

[0012] This application provides a method, apparatus, electronic device, and storage medium for processing virtual character expressions. The method involves acquiring the skin model of the face and neck of a virtual character model to be processed, the positions of multiple feature points related to facial expressions in a polygonal model, and the positions of multiple first positioning points in the skin model of the face and neck of a target character model. Based on the positions of the multiple feature points in the polygonal model, the method determines the positions of multiple second positioning points corresponding to the multiple feature points in the skin model of the face and neck of the virtual character model to be processed. Based on the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model, the expression of the virtual character model is processed into the expression of the target character model. In this embodiment, the positions of multiple positioning points in the virtual character model to be processed are determined based on the positions of multiple feature points related to facial expressions in the polygonal model. This eliminates the need for designers to manually determine the positioning points, improving the efficiency of expression model production. Furthermore, the accurate positioning results in a stable output expression model.

[0013] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application, it can be implemented according to the contents of the specification. In order to make the above and other objects, features and advantages of this application more obvious and understandable, specific embodiments of this application are given below. Attached Figure Description

[0014] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the various drawings denote the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings depict only some embodiments according to this application and should not be construed as limiting the scope of this application.

[0015] Figure 1 A schematic diagram illustrating an application scenario of the virtual character facial expression processing method provided in this application;

[0016] Figure 2 This is a flowchart of a virtual character facial expression processing method according to an embodiment of this application;

[0017] Figure 3 This is a schematic diagram of multiple positioning points of the face of a virtual character model to be processed according to an embodiment of this application;

[0018] Figure 4 This is a schematic diagram of 52 facial expression models of a virtual character model to be processed according to an embodiment of this application;

[0019] Figure 5 This is a schematic diagram of the skin model of the virtual character model to be processed according to an embodiment of this application;

[0020] Figure 6 This is a structural block diagram of a virtual character expression processing device according to an embodiment of this application; and

[0021] Figure 7 This is a block diagram of an electronic device used to implement embodiments of this application. Detailed Implementation

[0022] In the following description, only certain exemplary embodiments are briefly described. As those skilled in the art will recognize, the described embodiments can be modified in various ways without departing from the concept or scope of this application. Therefore, the drawings and description are considered to be exemplary in nature and not restrictive.

[0023] To facilitate understanding of the technical solutions of the embodiments of this application, the relevant technologies of the embodiments of this application are described below. The following relevant technologies are optional solutions and can be combined with the technical solutions of the embodiments of this application in any way, and all of them fall within the protection scope of the embodiments of this application.

[0024] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0025] As computer graphics technology evolves at an accelerated pace, consumers are demanding higher fidelity in the expressions of virtual characters. This requires virtual character creators to provide higher quality virtual character facial animations while simultaneously improving the efficiency of character facial model production and reducing time costs through various methods.

[0026] In view of this, the present application provides a virtual character expression processing method. Based on the positions of multiple feature points related to facial expressions in a polygon model, the positions of multiple positioning points are determined in the skin model of the virtual character model to be processed. This eliminates the need for designers to manually determine the positioning points, thereby improving the efficiency of expression model production. Moreover, the positioning is accurate, resulting in a stable expression model output.

[0027] Figure 1 This is a schematic diagram illustrating an application scenario of the virtual character expression processing method provided in this application. In this embodiment, since multiple virtual character models with different appearances created by the same 3D creation tool (e.g., Daz, Character Creator, etc.) have the same topological structure, the positions of multiple feature points related to facial expressions can be pre-marked in the polygonal model of the 3D creation tool. Based on the positions of these feature points, the positions of the positioning points of the multiple virtual character models with different appearances created by the same 3D creation tool are determined. The method in this embodiment can be used in conjunction with a node-based 3D visual creation tool (e.g., SideFX Houdini) via a plugin. The plugin can automatically associate the various nodes of the 3D visual creation tool to form a complete model creation process. Based on the input skin model of the face and neck of the virtual character model to be processed, the positions of multiple feature points in the polygonal model, and the positions of multiple first positioning points of the skin model of the face and neck of the target character model, the expression model of the virtual character model can be output, making the expression model creation process more standardized.

[0028] In this embodiment, the skin models of the face and neck of the virtual character model to be processed, the positions of multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin models of the face and neck of the target character model are obtained; based on the positions of the multiple feature points in the polygon model, the positions of multiple second positioning points corresponding to the multiple feature points are determined in the skin models of the face and neck of the virtual character model to be processed; according to the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model, the expression of the virtual character model is processed into the expression of the target character model to obtain the expression model.

[0029] Among them, the positions of multiple feature points in the polygon model, and the positions of multiple first localization points in the skin model of the target person model (such as...) Figure 1 The right image shows pre-marked and stored data. Multiple first and second positioning points are matched and displayed within the skin model of the virtual character model to be processed. Figure 1 As shown in the left figure, the first positioning point is as follows: Figure 1 The dot shown, the second positioning point is as follows Figure 1 The points shown are used to represent the topological structure of the target character model. Based on the positions of multiple first positioning points and multiple second positioning points, the topological structure of the target character model can be transferred to the virtual character model to be processed.

[0030] Based on multiple facial expressions of the target character model, the expressions of the virtual character model after topological transfer can be processed into multiple expressions of the target character model. Instead of manually marking positioning points for each expression in the virtual character model, multiple second positioning points are automatically determined based on the positions of multiple feature points in the polygon model. These second positioning points are then matched and fused with each expression of the target character model to obtain multiple expression models, which can further improve the efficiency of expression model production.

[0031] This application provides a method for processing virtual character expressions. This method can be applied to a computing device, which may include a user terminal, etc. Figure 2 The diagram shown is a flowchart of a virtual character expression processing method according to an embodiment of this application, including:

[0032] Step S201: Obtain the skin model of the face and neck of the virtual character model to be processed, the positions of multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin model of the face and neck of the target character model.

[0033] Step S202: Based on the positions of multiple feature points in the polygon model, determine the positions of multiple second positioning points corresponding to the multiple feature points in the skin model of the face and neck of the virtual character model to be processed.

[0034] Step S203: Based on the positions of multiple first positioning points, multiple second positioning points, and the facial expression information of the target character model, process the facial expression of the virtual character model into the facial expression of the target character model.

[0035] Since multiple virtual character models of different shapes created by the same 3D modeling tool (e.g., Daz, Character Creator, etc.) share the same topological structure, the positions of multiple feature points related to facial expressions can be pre-marked and stored in the polygonal model. Based on the positions of these feature points in the polygonal model, the positions of the positioning points for multiple virtual character models of different shapes created by the same 3D modeling tool can be determined. This eliminates the need for users of 3D modeling tools to manually mark positioning points each time they create an expression model, achieving automatic marking of positioning points and improving the efficiency of expression model creation. The polygonal model is a two-dimensional model consisting of a mesh of shared vertices and edges used in 3D modeling.

[0036] The positions of multiple feature points within the polygon model include their indices on the polygon faces and their coordinates (UV coordinates). These feature points can be pre-defined points related to facial expressions, representing facial features and located at corresponding positions on the face and neck associated with expressions, such as the edges of facial features like the corners of the eyes, eyebrows, mouth, and nose, as well as the middle of the neck. The first localization point is a point in the 3D coordinate system of the skin model of the target character model's face and neck, and the second localization point is a point in the 3D coordinate system of the skin model of the virtual character model to be processed.

[0037] Based on the positions of multiple first positioning points, multiple second positioning points, and the facial expression information of the target character model, facial expression fusion processing is performed on the virtual character model to be processed. For example, facial expression fusion processing can be achieved through nodes in a node-based 3D visual creation tool (e.g., SideFX Houdini), transferring the facial expression of the target character model to the virtual character model to be processed, so that the facial expression of the virtual character model to be processed is the facial expression of the target character model.

[0038] This application provides a method for processing virtual character expressions. The method involves obtaining the skin models of the face and neck of a virtual character model to be processed, the positions of multiple feature points related to facial expressions in a polygonal model, and the positions of multiple first positioning points in the skin models of the face and neck of the target character model. Based on the positions of the multiple feature points in the polygonal model, the methods determine the positions of multiple second positioning points corresponding to the multiple feature points in the skin models of the face and neck of the virtual character model to be processed. Based on the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model, the expression of the virtual character model is processed into the expression of the target character model. In this embodiment, the positions of multiple positioning points in the virtual character model to be processed are determined based on the positions of multiple feature points related to facial expressions in the polygonal model. This eliminates the need for designers to manually determine the positioning points, improving the efficiency of expression model production. Furthermore, the accurate positioning results in a stable output expression model.

[0039] In one implementation, based on the positions of multiple feature points in the polygon model, the positions of multiple second positioning points corresponding to the multiple feature points are determined in the skin model of the face and neck of the virtual character model to be processed. This includes: determining the coordinates of the multiple second positioning points in the three-dimensional coordinate system of the skin model of the face and neck of the virtual character model to be processed based on the sequence number of the polygon face corresponding to the multiple feature points in the polygon model and the coordinates in the polygon face.

[0040] The location of a feature point within the polygonal model includes the polygon face number and its coordinates (UV coordinates) within that face. The second positioning point is a point in the 3D coordinate system of the skin model of the face and neck of the virtual character model to be processed. Based on the polygon face number, the feature point's coordinates, and the morphological information of the skin model of the face and neck of the virtual character model, coordinate transformation is performed to obtain the positioning points in the 3D coordinate system of the skin model of the face and neck of the virtual character model to be processed. This enables automatic point marking, improving the accuracy and efficiency of the positioning point location. The coordinate transformation can be implemented using the built-in scripting language of the 3D visual authoring tool SideFX Houdini within the Attribute Wrangler node.

[0041] Since multiple virtual character models of different shapes created using the same 3D modeling tool have the same topological structure, feature points are pre-marked in the polygon model. That is, the sequence number of the polygon face where the feature point is located and its coordinates in the polygon face are determined and stored. This can be applied to multiple virtual character models of different shapes with the same topological structure, automatically obtaining the second positioning point corresponding to each virtual character model, without the need for designers to manually determine the positioning point in each virtual character model.

[0042] In one example, such as Figure 3 This is a schematic diagram of multiple positioning points on the face of the virtual character model to be processed, such as... Figure 3 As shown, based on the positions of five feature points in the polygon model, five positioning points are determined on the face of the virtual character model to be processed. The positioning points are located at the ear tip, the outer corner of the eye, the inner corner of the eye, the tip of the nose, and the corner of the mouth. The polygon face number corresponding to the positioning point at the ear tip is 1744, and its coordinates in the polygon face are 0.007362, 0.073377, 0; the polygon face number corresponding to the positioning point at the outer corner of the eye is 72, and its coordinates in the polygon face are 0.185739. 0.8976, 0; The polygonal face number corresponding to the positioning point at the corner of the eye is 37, and its coordinates in the polygonal face are 0.514784, 0.806574, 0; The polygonal face number corresponding to the positioning point at the tip of the nose is 331, and its coordinates in the polygonal face are 0.005821, 0.01619, 0; The polygonal face number corresponding to the positioning point at the corner of the mouth is 1518, and its coordinates in the polygonal face are 0.632136, 0.2724, 0.

[0043] In another example, the positions of the feature points and the second location point in the polygon model are shown in Table 1:

[0044] Serial Number P[x] P[y] P[z] TGPrim TGPrimUV[0] TGPrimUV[1] TGPrimUV[2] 0 0.0105992 171.856 9.85152 338 0.664658 0.0189874 0.0 1 -1.47077 172.128 9.03487 1143 0.993054 0.00729246 0.0 2 1.46882 172.128 9.0369 242 0.00218241 00124544 0.0

[0045] Table 1

[0046] Wherein, P[x], P[y], and P[z] represent the coordinates of the second positioning point in the three-dimensional coordinate system of the virtual character model to be processed; TGPrim represents the number of the polygon in which the feature point is located in the polygon model; and TGPrimUV[0], TGPrimUV[1], and TGPrimUV[2] represent the coordinates of the feature point in the polygon face.

[0047] In one implementation, the expression of the virtual character model is processed into the expression of the target character model based on the positions of multiple first positioning points, multiple second positioning points, and the expression information of the target character model. This includes: establishing a correlation between the positions of the multiple first positioning points and the positions of the multiple second positioning points; processing the topological structure of the skin model of the face and neck of the virtual character model into the topological structure of the skin model of the face and neck of the target character model based on the multiple correlations; and processing the processed expression of the virtual character model into the expression of the target character model based on the expression information of the target character model.

[0048] In practical applications, multiple positioning points in the virtual character model to be processed are matched with multiple positioning points in the target character model, i.e., association relationships are established. For example, the positioning points at the corners of the eyes of the virtual character model to be processed are associated with the positioning points at the corners of the eyes of the target character model, and the positioning points at the tip of the nose of the virtual character model to be associated with the positioning points at the tip of the nose of the target character model, and so on. After establishing the association relationships, the topological structure of the skin model of the face and neck of the virtual character model is processed to match the topological structure of the skin model of the face and neck of the target character model. Then, expression fusion is performed based on the expression information of the target character model, and the expression of the processed virtual character model is processed to match the expression of the target character model.

[0049] In one implementation, the expression of the processed virtual character model is processed to match the expression of the target character model based on the expression information of the target character model. This includes: adjusting the vertex coordinates of the multiple polygon faces of the processed virtual character model according to the vertex coordinates of the multiple polygon faces corresponding to the expression information of the target character model, so that the expression of the processed virtual character model is displayed as the expression of the target character model.

[0050] In this process, different facial expressions in the target character model result in different vertex coordinates for the polygon faces in the skin models of the face and neck. The vertex coordinates of the polygon faces in the virtual character model after topology transfer are adjusted to match the vertex coordinates of the polygon faces corresponding to the target character models with different facial expressions, so that the processed virtual character model displays the facial expressions of the target character model.

[0051] In one implementation, the method further includes: acquiring multiple facial expression information of the target character model, wherein the multiple facial expression information is determined according to a facial expression driving standard.

[0052] Among them, facial expression-driven standards, such as the Arkit expression standard, consist of 52 basic facial expression models used to fuse various human facial expressions. Based on the vertex coordinates of the polygon faces corresponding to each of the 52 expressions, the vertex coordinates of the polygon faces of the virtual character model after topology transfer are adjusted, thus processing the virtual character model's expressions into 52 expression models, such as... Figure 4 As shown, multiple facial expression models are created by varying the vertex positions within the same topology, and then these models are merged to produce a variety of facial expressions.

[0053] In this embodiment, for users who use 3D visual creation tools to create facial expression models, it is not necessary to determine the positioning points of the virtual character model to be processed for each expression one by one. Instead, multiple facial expression models are generated based on the virtual character model to be processed with automatically determined positioning points and the target character models of multiple expressions, which improves the efficiency of facial expression model production.

[0054] Optionally, the nodes of the 3D visual creation tool SideFX Houdini can be used to achieve the facial expression fusion and deformation of the virtual character model, so that the expression of the virtual character model is displayed as the expression of the target character model.

[0055] Optionally, after processing the virtual character model's expressions into multiple expressions of the target character model, the resulting expression model can be post-processed, such as smoothing, and the processed model can be used as the final expression model.

[0056] In one implementation, obtaining the positions of multiple first positioning points in the skin model of the face and neck of the target character model includes: determining the positions of multiple first positioning points in the skin model of the face and neck of the target character model according to feature marking instructions. The target character model can be a model created by performing a 3D scan of a real person and using the data obtained from the scan. This results in a more realistic expression in the model, and a more vivid expression in a virtual character model created based on such a target character model. The positions of the multiple first positioning points on the face and neck of the target character model can be pre-marked and stored after being marked once, eliminating the need for users of 3D visual creation tools to mark them multiple times.

[0057] In one implementation, obtaining the skin models of the face and neck of the virtual character model to be processed includes: receiving an unskinning binding instruction for the virtual character model to unbind the bones and skin of the virtual character model; receiving a selection instruction for the head and neck corresponding regions of the unbound skin to obtain the skin models of the face and neck of the virtual character model to be processed.

[0058] In practical applications, for virtual character models output from the 3D creation tool Daz3D, they are opened in other 3D creation tools (such as Autodesk Maya, Blender, Autodesk 3ds Max, etc.). The skeleton and skin are unbound using the unskinning command, and the model in the first and second quadrants along the U-axis of the UV coordinate system is separated using the selection command. The resulting files are output as OBJ or FBX format files, serving as the skin models for the face and neck of the virtual character model to be processed. For example... Figure 5 As shown, the left image is a skin model of the ear, the inside of the eye socket, and the face, while the right image is a skin model of the neck.

[0059] Corresponding to the application scenarios and methods provided in the embodiments of this application, the embodiments of this application also provide a virtual character expression processing device. For example... Figure 6 The diagram shown is a structural block diagram of a virtual character expression processing device according to an embodiment of this application. The device includes:

[0060] The acquisition module 601 is used to acquire the skin model of the face and neck of the virtual character model to be processed, the positions of multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin model of the face and neck of the target character model.

[0061] The determination module 602 is used to determine the positions of multiple second positioning points corresponding to the multiple feature points in the skin model of the face and neck of the virtual character model to be processed, based on the positions of multiple feature points in the polygon model.

[0062] The processing module 603 is used to process the expression of the virtual character model into the expression of the target character model based on the positions of multiple first positioning points, multiple second positioning points, and the expression information of the target character model.

[0063] This application provides a virtual character expression processing device. It acquires the skin model of the face and neck of a virtual character model to be processed, the positions of multiple feature points related to facial expressions in a polygonal model, and the positions of multiple first positioning points in the skin model of the face and neck of the target character model. Based on the positions of the multiple feature points in the polygonal model, it determines the positions of multiple second positioning points corresponding to the multiple feature points in the skin model of the face and neck of the virtual character model to be processed. Based on the positions of the multiple first positioning points, the positions of the multiple second positioning points, and the expression information of the target character model, it processes the expression of the virtual character model into the expression of the target character model. In this embodiment, the positions of multiple positioning points in the virtual character model to be processed are determined based on the positions of multiple feature points related to facial expressions in the polygonal model. This eliminates the need for designers to manually determine the positioning points, improving the efficiency of expression model production. Furthermore, the accurate positioning results in a stable output expression model.

[0064] In one implementation, the determining module 602 is used to: determine the coordinates of multiple second positioning points in the three-dimensional coordinate system of the skin model of the face and neck of the virtual character model to be processed, based on the index of the polygon face corresponding to the multiple feature points in the polygon model and the coordinates in the polygon face.

[0065] In one implementation, the processing module 603 is used to: establish a relationship between the positions of multiple first positioning points and the positions of multiple second positioning points; process the topology of the skin model of the face and neck of the virtual character model into the topology of the skin model of the face and neck of the target character model according to the multiple relationships; and process the expression of the processed virtual character model into the expression of the target character model according to the expression information of the target character model.

[0066] In one implementation, when the acquisition module 601 processes the expression of the processed virtual character model into the expression of the target character model based on the expression information of the target character model, it is used to: adjust the vertex coordinates of the multiple polygon faces of the processed virtual character model according to the vertex coordinates of the multiple polygon faces corresponding to the expression information of the target character model, so that the expression of the processed virtual character model is displayed as the expression of the target character model.

[0067] In one implementation, the device is further configured to: acquire multiple facial expression information of a target person model, wherein the multiple facial expression information is determined according to a facial expression driving standard.

[0068] In one implementation, the acquisition module 601 is further configured to: determine the positions of multiple first positioning points in the skin model of the face and neck of the target person model according to the feature marking instructions.

[0069] In one implementation, when acquiring the skin models of the face and neck of the virtual character model to be processed, the acquisition module 601 is configured to: receive an unskinning binding instruction for the virtual character model to unbind the bones and skin of the virtual character model; receive a selection instruction for the head and neck regions corresponding to the unbound skin to obtain the skin models of the face and neck of the virtual character model to be processed.

[0070] The functions of each module in each device in the embodiments of this application can be found in the corresponding description in the above method, and they have corresponding beneficial effects, which will not be repeated here.

[0071] Figure 7 This is a block diagram of an electronic device used to implement embodiments of this application. Figure 7 As shown, the electronic device includes a memory 710 and a processor 720. The memory 710 stores a computer program that can run on the processor 720. When the processor 720 executes the computer program, it implements the method described in the above embodiments. The number of memories 710 and processors 720 can be one or more.

[0072] The electronic device also includes:

[0073] The communication interface 730 is used to communicate with external devices and perform data exchange and transmission.

[0074] If the memory 710, processor 720, and communication interface 730 are implemented independently, they can be interconnected via a bus to communicate with each other. This bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0075] Optionally, in a specific implementation, if the memory 710, processor 720, and communication interface 730 are integrated on a single chip, then the memory 710, processor 720, and communication interface 730 can communicate with each other through an internal interface.

[0076] This application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method provided in this application.

[0077] This application also provides a chip including a processor for calling and executing instructions stored in a memory, causing a communication device with the chip installed to perform the method provided in this application.

[0078] This application also provides a chip, including: an input interface, an output interface, a processor, and a memory. The input interface, output interface, processor, and memory are connected through an internal connection path. The processor is used to execute code in the memory. When the code is executed, the processor is used to execute the method provided in the application embodiment.

[0079] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. General-purpose processors can be microprocessors or any conventional processor. It is worth noting that the processor can be a processor supporting Advanced Reduced Instruction Set Machines (ARM) architecture.

[0080] Further, optionally, the aforementioned memory may include read-only memory and random access memory. The memory may be volatile memory or non-volatile memory, or may include both. Non-volatile memory may include read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available. Examples include Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DR RAM).

[0081] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another.

[0082] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of those different embodiments or examples.

[0083] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0084] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process. Furthermore, the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functionality involved.

[0085] The logic and / or steps described in the flowchart or otherwise herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a processor-included system or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).

[0086] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. All or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware, the program being stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiments.

[0087] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. This storage medium can be a read-only memory, a disk, or an optical disk, etc.

[0088] The above description is merely an exemplary embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various variations or substitutions within the technical scope described in this application, and these should all be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for processing virtual character expressions, characterized in that, The method includes: The process involves obtaining the skin models of the face and neck of the virtual character model to be processed, the sequence numbers and coordinates of multiple feature points related to facial expressions in the polygon model corresponding to the polygon faces, and the positions of multiple first positioning points in the skin models of the face and neck of the target character model. Based on the sequence number of the polygon face and the coordinates in the polygon face, determine the coordinates of multiple second positioning points corresponding to the multiple feature points in the three-dimensional coordinate system of the skin model of the face and neck of the virtual character model to be processed; Based on the positions of the plurality of first positioning points, the coordinates in the three-dimensional coordinate system corresponding to the plurality of second positioning points, and the facial expression information of the target character model, the facial expression of the virtual character model is processed into the facial expression of the target character model.

2. The method according to claim 1, characterized in that, The step of processing the expression of the virtual character model into the expression of the target character model based on the positions of the plurality of first positioning points, the coordinates in the three-dimensional coordinate system corresponding to the plurality of second positioning points, and the expression information of the target character model includes: Establish a correlation between the positions of the plurality of first positioning points and the coordinates in the three-dimensional coordinate system corresponding to the plurality of second positioning points, and process the topological structure of the skin model of the face and neck of the virtual character model into the topological structure of the skin model of the face and neck of the target character model according to the plurality of correlation relationships. Based on the facial expression information of the target character model, the facial expression of the processed virtual character model is processed to become the facial expression of the target character model.

3. The method according to claim 2, characterized in that, The step of processing the expression of the processed virtual character model into the expression of the target character model based on the expression information of the target character model includes: Based on the vertex coordinates of the multiple polygon faces corresponding to the facial expression information of the target character model, the vertex coordinates of the multiple polygon faces of the processed virtual character model are adjusted so that the facial expression of the processed virtual character model is displayed as the facial expression of the target character model.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: Multiple facial expression information of the target character model are obtained, and the multiple facial expression information is determined according to the facial expression driving standard.

5. The method according to any one of claims 1-3, characterized in that, Obtain the positions of multiple primary localization points in the skin model of the face and neck of the target character model, including: According to the feature marking instructions, the positions of multiple first positioning points are determined in the skin model of the face and neck of the target person model.

6. The method according to any one of claims 1-3, characterized in that, The process of obtaining the skin model of the face and neck of the virtual character model to be processed includes: Receive a command to unskin the virtual character model and unbind the skeleton and skin of the virtual character model; Receive a selection instruction for the head and neck regions corresponding to the unbound skin to obtain the skin model of the face and neck of the virtual character model to be processed.

7. A virtual character expression processing device, characterized in that, The device includes: The acquisition module is used to acquire the skin model of the face and neck of the virtual character model to be processed, the sequence number and coordinates of the polygon face corresponding to multiple feature points related to facial expressions in the polygon model, and the positions of multiple first positioning points in the skin model of the face and neck of the target character model. The determination module is used to determine, based on the sequence number of the polygon face and the coordinates in the polygon face, the coordinates of multiple second positioning points corresponding to the multiple feature points in the three-dimensional coordinate system of the skin model of the face and neck of the virtual character model to be processed; The processing module is used to process the expression of the virtual character model into the expression of the target character model based on the positions of the plurality of first positioning points, the coordinates in the three-dimensional coordinate system corresponding to the plurality of second positioning points, and the expression information of the target character model.

8. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory, wherein the processor, when executing the computer program, implements the method of any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method of any one of claims 1-6.

Images