Animation display method, device, equipment, medium and product

Abstract

The disclosed embodiments provide an animation display method, apparatus, device, medium, and product. The method may include: determining the human body posture data corresponding to the action image generated by the user performing the target action; based on the skeletal coordinate system of the standard skeletal model, converting the human body posture data into human body rotation data corresponding to the standard skeletal model; according to the skeletal mapping relationship between the animation skeletal model of the animation to be displayed and the standard skeletal model, converting the default posture data of the animation skeletal model into skeletal rotation data relative to the standard skeletal model; and according to the human body rotation data and the skeletal rotation data, controlling the animation to be displayed to be rendered and displayed according to the target action. This solves the problem that the application scope of animation control is not high.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular to an animation display method, apparatus, device, medium, and product. Background Art

[0002] With the rapid development of information technology, by detecting the posture of the object and driving the animation according to the object posture, the fusion display of object movement and animation drive can be achieved, which can be applied to sports technology, special effects technology, virtual reality, games and human-computer interaction.

[0003] In the existing technology, sensors are usually used to detect the user's posture and map the user's posture detected by the sensor to the three-dimensional model corresponding to the animation. However, this technical solution is limited by the sensor and is greatly affected by the scene during use, resulting in a limited scope of application of animation display control. Summary of the Invention

[0004] The embodiments of the present disclosure provide an animation display method, apparatus, device, medium, and product to overcome the problem of low efficiency in data model management of feed streams.

[0005] In a first aspect, an embodiment of the present disclosure provides an animation display method, comprising:

[0006] Determining human body posture data corresponding to an action image generated by a user performing a target action;

[0007] Based on the skeleton coordinate system of the standard skeleton model, the human body posture data is converted into human body rotation data corresponding to the standard skeleton model;

[0008] According to the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model, the default posture data of the animation skeleton model is converted into skeleton rotation data relative to the standard skeleton model;

[0009] According to the human body rotation data and the skeleton rotation data, the animation to be displayed is controlled to be rendered and displayed according to the target action.

[0010] In a second aspect, an embodiment of the present disclosure provides an animation display device, comprising:

[0011] A posture determination unit, configured to determine human body posture data corresponding to an action image generated by a user performing a target action;

[0012] A data conversion unit, configured to convert the human body posture data into human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model;

[0013] a posture conversion unit, configured to convert the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model according to a skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model;

[0014] The animation display unit is used to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0015] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0016] The memory stores computer-executable instructions;

[0017] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the animation display method as described in the first aspect and various possible designs of the first aspect.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the animation display method described in the first aspect and various possible designs of the first aspect is implemented.

[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the animation display method described in the first aspect and various possible designs of the first aspect.

[0020] The present embodiment can determine that the user performs the corresponding human posture data of the action image that the target action produces. And then based on the skeleton coordinate system of the standard skeleton model, the human posture data is converted to the human body rotation data corresponding to the standard skeleton model. In addition, the default posture of the animation skeleton model can also be converted to the skeleton rotation data of the relative standard skeleton model according to the skeleton constraint relationship of the animation skeleton model and the annotation skeleton model of the animation to be displayed. Utilize the standard skeleton model to obtain the rotation data of human posture data and the animation skeleton model, realize the calculation unification of human body and animation, and control the animation to be displayed to render and display according to the target action according to the human body rotation data and the skeleton rotation data. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A schematic diagram of a data model of an information flow provided by an embodiment of the present disclosure;

[0023] Figure 2 An example diagram of an application of an animation display method provided by an embodiment of the present disclosure;

[0024] Figure 3 A flowchart of an information processing method for an information flow provided by an embodiment of the present disclosure;

[0025] Figure 4 A schematic diagram of information flow display provided by an embodiment of the present disclosure;

[0026] Figure 5 Another flowchart of an animation display method provided by an embodiment of the present disclosure;

[0027] Figure 6 A structural diagram of an animation display device provided by an embodiment of the present disclosure;

[0028] Figure 7 An exemplary structural diagram of an information processing device provided in an embodiment of the present disclosure;

[0029] Figure 8 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0031] The technical solution disclosed in the present invention can be applied to the solution of controlling animation display by human body posture. The standard skeleton model realizes the display mapping of human body posture data and the animation to be displayed, and realizes the animation display from image acquisition to motion control. Using the image as the control basis of the animation can improve the display efficiency of the animation.

[0032] Related technologies control the display of animations based on the object's posture, ensuring consistency between the object's and the animation's movements. For example, if the object's movement is lowering its head, the animation will also be lowering its head. Typically, various sensors are used to capture the object's posture, and then the posture is mapped to the corresponding three-dimensional model of the animation. However, this technical solution is limited by the sensors and relies heavily on them, resulting in low animation driver utilization.

[0033] In order to solve the above technical problems, the inventors thought about whether it is possible to use a camera to capture the user's action images, and then use the actions in the action images to control the corresponding animations. After research, it was found that the posture data generated by identifying the action images is based on the coordinate system of the image. For the engine rendering animation, the posture data based on image recognition cannot be directly used, and there are obstacles to the control of posture and animation. In order to solve this technical problem, the present invention adopts a standard skeleton model as an intermediate conversion object to map the posture and animation to the standard skeleton model respectively, and the standard skeleton model can be directly used by the animation engine to realize the process from image action detection to animation control. Due to the wide application of cameras, the utilization rate of object action control animation display can be improved.

[0034] Accordingly, in the embodiment of the present disclosure, it is possible to determine the human body posture data corresponding to the action image generated by the user performing the target action. Afterwards, the human body posture data can be converted into the human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model. In addition, the default posture of the animation skeleton model can also be converted into the skeleton rotation data of the relative standard skeleton model based on the skeleton constraint relationship of the animation skeleton model of the animation to be displayed and the annotation skeleton model. The standard skeleton model is utilized to obtain the rotation data of the human body posture data and the animation skeleton model, so as to realize the calculation unification of the human body and the animation, and to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0035] The following will describe in detail the technical solutions of the present disclosure and how they solve the above-mentioned technical problems using specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. The following embodiments of the present disclosure are described in detail with reference to the accompanying drawings.

[0036] Figure 1This is an application network architecture diagram according to the animation display method disclosed in the present invention. The application network architecture according to the embodiment of the present invention may include an electronic device and a client that is connected to the electronic device through a local area network or a wide area network. Assuming that the electronic device can be a personal computer, an ordinary server, a super personal computer, a cloud server or other types of servers, the present invention does not make too many restrictions on the specific type of the electronic device. The client can be, for example, a mobile phone, a tablet computer, a personal computer, a smart home appliance, a wearable device or other terminal device, and the present invention does not make too many restrictions on the specific type of the client. Figure 1 As shown, taking the electronic device as a cloud server 1 and the first client 2 as a mobile phone 21 or a tablet computer 22 as an example, any first client 2 can provide an action image and an animation to be displayed to the cloud server 1. The cloud server 1 can obtain the action image and animation to be displayed sent by any first client 2, and based on the animation display method provided in the embodiment of the present disclosure, control the animation to be displayed to play according to the action in the action image, thereby achieving accurate control and display of the animation and improving the utilization rate of animation display control.

[0037] refer to Figure 2 , Figure 2 This is a flowchart of an embodiment of an animation display method provided by an embodiment of the present disclosure. The animation display method can be configured as an animation display device, which can be located in an electronic device. The animation display method can include the following steps:

[0038] 201: Determine human body posture data corresponding to an action image generated when a user performs a target action.

[0039] The camera can capture action video as the user performs a target action. The captured video can be sent from the terminal device where the camera is located to the electronic device. The electronic device can receive the action video and extract action images from the action video. Specifically, the action images can be extracted from the action video at a certain acquisition frequency, which can be set according to actual usage requirements. Of course, in some embodiments, each image frame can be sequentially acquired from the action video according to the timestamp, and each image frame can be used as an action image for animation control.

[0040] In practical applications, human posture generally refers to multiple joints of the human body and the connection relationships between each joint. The connection relationship between each joint can refer to the parent node determined for each joint, and the posture sub-data of each joint relative to the parent node. In the present disclosure, human posture data can be obtained by performing posture or limb detection on action images. In order to accurately define human posture data, human posture data can include posture sub-data corresponding to multiple standard joints.

[0041] The detection of human posture data can be accomplished using multiple standard joints defined in a standard skeletal model. Specifically, the posture sub-data corresponding to each standard joint of the action image can be determined by using the multiple standard joints in the standard skeletal model and the connection relationship between each joint. For example, the standard skeletal model can include standard hand joints, which can specifically exist in the form of joint points. The human posture data can also include hand joints that match the standard hand joints. A joint correspondence can exist between the joints of the human posture and the joints of the standard skeletal model, so that the detection of human posture data can be achieved using the standard skeletal model.

[0042] Human body posture data may include posture sub-data corresponding to multiple standard joints. The posture sub-data corresponding to the standard joints can be obtained by detecting the coordinate points of the standard joints in the action image through the image coordinate system or the pixel coordinate system. The posture sub-data represented by the image coordinate system or the pixel coordinate system cannot be directly applied to the rendering engine, and needs to be converted into human body rotation data of the skeletal coordinate system of the standard skeletal model corresponding to the rendering engine.

[0043] Optionally, the technical solution of the present disclosure can be implemented by a rendering engine located in an electronic device. That is, the rendering engine can obtain human body posture data and convert the human body posture data into rotation data.

[0044] 202: Based on the skeleton coordinate system of the standard skeleton model, the human body posture data is converted into human body rotation data corresponding to the standard skeleton model.

[0045] The standard skeleton model can specifically include multiple standard joints and the connection relationship between each standard joint. A joint can also be called a joint point, which can be a location point with a point as a joint. The connection relationship between each standard joint can specifically refer to the parent node determined by each standard joint based on its location. Each joint point can have a parent node, and two adjacent joint points are connected as edges. For ease of understanding, in a possible design, such as Figure 3 As shown in FIG, the standard skeleton model can include 24 standard joints, namely standard joint 0 to standard joint 23. Figure 3 , standard joint 1 can be used as the parent node of standard joint 3, and standard joint 9 can be used as the parent node of standard joint 1. The specific connection relationship of each standard joint can be set, that is, the parent node of each standard joint can be set according to actual use requirements. The corresponding relationship between the parent and child nodes of each standard joint can be different under different connection relationships. For example, Figure 3 , standard joint 3 can also be the parent node of standard joint 1.

[0046] Human body rotation data may refer to the rotation sub-data corresponding to multiple standard joints after the coordinate transformation of the human body posture data. The rotation sub-data may be the local coordinate data obtained after the posture sub-data is transformed into the skeletal coordinate system of the standard skeletal model.

[0047] 203: According to the bone mapping relationship between the animation bone model of the animation to be displayed and the standard bone model, convert the default posture data of the animation bone model into bone rotation data relative to the standard bone model.

[0048] The animation to be displayed may include a cartoon image set as an action image, the trunk of the cartoon image being highly similar to the overall structure of the human trunk, but the corresponding number of joints may be different from the standard skeleton model. Therefore, in order to map the animation to be displayed to the standard skeleton model and achieve the unification of the human joints and the animation joints, the skeleton mapping relationship between the animation skeleton model and the standard skeleton model may be determined first, and the skeleton mapping relationship may be utilized to convert the default posture data of the animation skeleton model into the skeleton rotation data of the relative standard skeleton model. The skeleton rotation data of the relative standard skeleton model may refer to the skeleton rotation data generated according to the marked skeleton model using the marked skeleton model as the conversion basis.

[0049] A bone mapping relationship refers to the joint correspondence between multiple animation joints in an animation skeleton model and multiple standard joints in a standard skeleton model. This can be one animation joint to one standard joint, one animation joint to multiple standard joints, or multiple animation joints to one standard joint. For example, one hand joint in an animation can correspond to two hand joints in a standard skeleton model, and two torso joints in an animation can correspond to one torso joint in a standard skeleton model.

[0050] For ease of understanding, Figure 4 As shown, the animation skeleton model may include 12 animation joints, namely animation joints 400 to animation joints 411, and Figure 3 The skeleton mapping relationship of the standard skeleton model shown can include, for example, a mapping relationship between animation joint 404 and standard joint 23 and standard joint 21. Animation joint 403 can also be mapped to standard joint 19. In this way, the standard joints corresponding to the animation joints can be defined. Of course, this mapping relationship is merely illustrative and should not constitute a specific limitation on the technical solutions disclosed herein.

[0051] The bone mapping relationship can be obtained by presetting, for example, the bone mapping relationship between the set animation bone model and the standard bone model can be stored in a mapping file, and the bone mapping relationship between the animation bone model and the standard bone model can be obtained by reading from the mapping file.

[0052] Optionally, the default posture data of the animation skeleton model may include posture sub-data corresponding to multiple animation joints of the animation skeleton model, and the posture sub-data may identify the rotation angle of the animation joint relative to its parent node. In order to distinguish different joint meanings, the joints of the standard skeleton model may be referred to as standard joints. Converting the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model may include: determining the posture sub-data corresponding to multiple standard joints of the standard skeleton model, determining the standard joint corresponding to any animation joint in the animation skeleton model, calculating the rotation data of the posture sub-data of the animation joint relative to the standard joint corresponding to the animation joint, and obtaining the rotation sub-data corresponding to the animation joint. The skeleton rotation data may include the rotation sub-data of the standard joint of the standard skeleton model at its corresponding animation joint.

[0053] 204: Control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0054] In some embodiments, the action images generated by the user performing the target action may include multiple images. For example, an action video of the user performing the target action may be captured. When controlling the animation to be displayed to be rendered according to the target action, the target animations corresponding to the animation to be displayed may be displayed sequentially according to the timestamps corresponding to the action images to form an animation video, which is then rendered and displayed, allowing the user to view a continuous animation video.

[0055] In the disclosed embodiment, the human body posture data corresponding to the action image generated by the user performing the target action is determined. Afterwards, the human body posture data can be converted into human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model. In addition, the default posture of the animation skeleton model can also be converted into skeleton rotation data relative to the standard skeleton model based on the skeleton constraint relationship between the animation skeleton model of the animation to be displayed and the annotation skeleton model. The standard skeleton model is utilized to obtain rotation data of the human body posture data and the animation skeleton model, so as to achieve the calculation unification of the human body and the animation, and to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0056] As an example, Figure 5 As shown, step 204 controls the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data, which may include:

[0057] 501: Perform rotation fusion based on the human body rotation data and the skeleton rotation data to obtain the target animation action.

[0058] 502: According to the target animation action, determine the target animation corresponding to the target action of the animation to be displayed, and render and display the target animation.

[0059] Among them, the human body rotation data may include posture sub-data corresponding to multiple standard joints in the skeletal coordinate system. The number and position of the joints of the human body posture can match the number and position of the joints of multiple standard joints of the standard skeletal model. For example, the standard joint of the hand includes a joint node at the tip of the middle finger, and the human body posture data may also have a joint node at the tip of the middle finger.

[0060] Optionally, any rotation sub-data can be represented using the quaternion data format. The quaternion can calibrate the difference between the angle data of the limbs in the action image and the standard angle corresponding to the standard posture in the standard skeleton model. For example, the angle data between the upper arm and the forearm in the human posture data is 30 degrees, while the standard angle of the upper arm and the forearm in the standard skeleton model is 0 degrees. The quaternion corresponding to the upper arm and the forearm represents the angle difference between 30 degrees and 0 degrees. That is, the quaternion of any joint can include the rotation angle of each joint relative to its parent node coordinate system. The quaternion is represented by four floating-point values ​​(x, y, z, w). The quaternion itself represents the rotation of a vector, that is, the rotation from vector A to vector B. The quaternion can be represented by Q. The difference in rotation angle between two quaternions Q1 and Q2 can be expressed as Q3, then Q3=Q2*Q1.

[0061] Of course, in practical applications, the rotation sub-data can also be represented in other data formats, such as the data format of three-dimensional coordinate points. The data fusion method for different data formats can be different and can be specifically defined according to the data format. However, the target animation motion of the animation image can be determined through data fusion.

[0062] In the embodiment of the present disclosure, by performing rotational fusion on the human body rotation number and the bone rotation data, a target animation action can be obtained. According to the target animation action, the posture of the animation to be displayed is adjusted to obtain the corresponding target animation. By fusing the rotation data, the target animation action can be accurately obtained, and the target animation action can be accurately adjusted, thereby improving the efficiency and cost of using the animation posture and improving the display accuracy of the animation.

[0063] Animation actions can be complex actions that are based on various joint nodes, their rotation sub-data, action events, and other complex actions. To obtain accurate animation actions, as an embodiment, rotation fusion is performed based on human body rotation data and skeleton rotation data to obtain the target animation action, which may include:

[0064] Converting the human body rotation data into first motion data according to the data format of the motion data;

[0065] Convert the bone rotation data into second motion data according to the data format of the motion data;

[0066] Performing posture fusion calculation based on the first motion data and the second motion data to obtain a target animation motion.

[0067] The motion data may include motion (POSE) data for controlling the change of animation posture. The motion data may be a data type that can be processed by the rendering engine and can be superimposed with the animation. The specific data type may be predefined and obtained.

[0068] In order to ensure that the human body rotation data and the bone rotation data can be fused and calculated, it is necessary to convert the human body rotation data and the bone rotation data into motion data that can be fused with the animation image to obtain the first motion data corresponding to the human body rotation data and the second motion data corresponding to the bone rotation data.

[0069] Among them, obtaining the target animation action based on the rotational fusion of the first action data and the second action data may include: fusing the action sub-data corresponding to the standard joint of the first action data and the action sub-data corresponding to the standard joint of the second action data to obtain the animation sub-action corresponding to the standard joint, so as to obtain the animation sub-actions corresponding to multiple standard joints respectively; combining the animation sub-actions corresponding to multiple standard joints according to their respective joint positions to obtain the target animation action.

[0070] In the disclosed embodiment, the data format of the posture data can be predefined so that both the human body rotation data and the bone rotation data can be converted into the same data format according to the posture, thereby opening up a fusion path for the human body rotation data and the bone rotation data, and realizing accurate calculation of the first action data and the second action data, thereby obtaining accurate target animation actions and improving the efficiency and accuracy of acquiring animation postures.

[0071] In one possible design, before converting the posture data, the method may further include:

[0072] Start the animation blueprint corresponding to the rendering engine. The animation blueprint includes a data conversion script.

[0073] The step of converting the human body rotation data into the first motion data according to the data format of the motion data may include:

[0074] Inputting the human body rotation data into the animation blueprint, and using the data conversion script in the animation blueprint to represent the human body rotation data as first motion data according to the data format of motion data;

[0075] Converting the bone rotation data into the second motion data according to the data format of the motion data includes:

[0076] The bone rotation data is input into the animation blueprint, and the bone rotation data is represented as second action data according to the data format of the action data through the data conversion script in the animation blueprint.

[0077] Animation Blueprints are a special type of asset (assertion) processing plug-in that can create logical elements, detect variable data with an intuitive, node-based interface, convert variable data into actions and level script events, and use wires to connect nodes, events, functions, and variables to create complex gameplay elements. After inputting either skeletal rotation data or body rotation data into an Animation Blueprint, the Animation Blueprint can use each joint as a node, and the corresponding rotation sub-data of each joint as a variable, combined with the definition of joint functions, and automatically generate the corresponding action data through the conversion of the data conversion script.

[0078] In the disclosed embodiment, the animation blueprint corresponding to the rendering engine can be started. The data conversion script in the animation blueprint can convert the data format of the human body rotation data and the bone rotation data, realize automatic data conversion, and improve data conversion efficiency.

[0079] The steps for converting human body posture data into rotation sub-data corresponding to at least one standard joint can be as follows: Figure 6 The steps shown are converted. Figure 6 FIG. 2 is a flow chart of another embodiment of the animation display method provided by the present disclosure, which differs from the aforementioned embodiment in that the above step 202, which converts the human body posture data into human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model, may include the following steps:

[0080] 601: Determine the world coordinate system where the standard skeleton model is located.

[0081] 602: Convert the human body posture data into the world coordinate system to obtain global rotation data;

[0082] 603: Based on the joint connection relationship corresponding to the standard skeleton model, the global rotation data is converted into local rotation data corresponding to the standard joint.

[0083] 604: Determine human body rotation data based on the local rotation data corresponding to each standard joint of the standard skeleton model.

[0084] Optionally, the local rotation data may include rotation sub-data corresponding to the standard joint. The world coordinate system may be a world coordinate system corresponding to the rendering engine.

[0085] In the disclosed embodiment, human body posture data can be converted into the world coordinate system where the standard joints are located, and global rotation data can be obtained. Based on the joint connection relationship corresponding to the standard skeletal model, the global rotation data can be converted into local rotation data of the corresponding bone key, realizing the local transformation of the joint coordinate system. The local rotation data obtained is the local rotation data relative to each joint, which can more accurately represent the rotation data of each human body posture at each joint, thereby improving the data accuracy of the human body rotation data.

[0086] As an embodiment, determining the human body rotation data based on the local rotation data corresponding to each standard joint of the standard skeleton model may include:

[0087] According to the local rotation data of the standard joint and the rotation constraint information of the standard joint, determining whether the local rotation data satisfies the rotation constraint information;

[0088] If the local rotation data satisfies the rotation constraint information, it is determined that the local rotation data of the standard joint is in a normal state;

[0089] If the local rotation data corresponding to each standard joint of the standard skeleton model are all in a normal state, it is determined that the local rotation data corresponding to each standard joint of the standard skeleton model are human body rotation data.

[0090] Optionally, the rotation constraint information may refer to constraint information of a rotation angle or a numerical value. The rotation constraint information of each standard joint may be set according to the function of different joints in the human body. A standard joint may include a joint point, which may be consistent with the bone where the joint point is located, that is, a standard joint may also correspond to a bone. The bone may specifically refer to a mathematical model built for a part of the skeleton of the human body. For example, in practical applications, the bone may be represented by a cone. The local rotation data corresponding to each standard joint may refer to the rotation angle between the standard joint and its parent node. The rotation constraint information of the standard joint may include the angle constraint relationship between the bone of the standard joint and the bone of the parent node of the standard joint.

[0091] The rotation constraint information of any standard joint can be used to impose an angle constraint on the local rotation data of that standard joint, thereby determining whether the local rotation data satisfies the rotation constraint information. Satisfying the rotation constraint information specifically means that the rotation angle represented by the local rotation data falls within the range of the rotation constraint information. Not satisfying the rotation constraint information specifically means that the rotation angle represented by the local rotation data does not fall within the range of the rotation constraint information.

[0092] In the disclosed embodiment, the rotation constraint information of the standard joint can be used to perform constraint judgment on the local rotation data of the standard joint, so as to correctly identify the rotation of the standard joint, avoid local rotation data anomalies, and ensure the accuracy of the rotation data.

[0093] As an embodiment, the above step 201: determining the human body posture data corresponding to the action image generated by the user performing the target action may include:

[0094] Receive human body posture data corresponding to an action image generated by a user performing a target action sent by a client; the human body posture data is obtained by the client performing action recognition on the action image.

[0095] The client can use the camera to detect the user's action video and collect action images from the action video. The frequency of action image collection is determined by the control accuracy of the animation. The higher the animation display accuracy, the higher the collection frequency; the lower the animation display frequency, the lower the collection frequency.

[0096] In the embodiment of the present disclosure, the acquisition of human posture data can be completed by the client, and the client can send the human posture data corresponding to the animated image generated by the user performing the target action to the electronic device, thereby realizing effective interaction between the user and the background and improving the efficiency of information interaction.

[0097] In some embodiments, receiving human body posture data corresponding to an action image generated by a user performing a target action, sent by a client, includes:

[0098] Based on the data transmission protocol defined with the client, human body posture data corresponding to the action image generated by the user performing the target action sent by the client is received.

[0099] Optionally, the data transmission protocol between the electronic device and the client may include, for example, a UDP (User Datagram Protocol) protocol.

[0100] In the disclosed embodiment, the electronic device can receive the human body posture data sent by the client based on the data transmission protocol defined with the client. The setting of the data transmission protocol can achieve stable and efficient communication of data, thereby improving the communication efficiency of data.

[0101] As another embodiment, before converting the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model according to the skeleton mapping relationship between the animation skeleton model and the standard skeleton model, the method further includes:

[0102] Determine the animation skeleton model of the animation to be displayed;

[0103] According to the animation joints in the animation skeleton model and the standard joints in the standard skeleton model, the standard joints are matched to obtain the skeleton mapping relationship between the animation joints and the standard joints.

[0104] The skeleton mapping relationship may include an animated joint and its corresponding standard joint, or vice versa. The skeleton mapping relationship enables accurate conversion of the animation's posture data to the posture data of the standard skeleton model. Specific conversion methods may include, for example, distance calculations and matrix calculations for the posture sub-data. For details, please refer to the detailed description of the aforementioned embodiments.

[0105] In the disclosed embodiment, an animation skeletal model of an animation to be displayed can be determined, and a standard joint mapping relationship between the animation joints in the animation skeletal model and the standard joints in the standard skeletal model can be performed. By performing joint mapping between the animation joints and the standard joints, the skeletal mapping relationship between the animation skeletal model and the standard skeletal model can be accurately determined, thereby improving the accuracy of the skeletal mapping of the animation skeletal model.

[0106] In some embodiments, step 203 of converting the default posture data of the animation skeletal model into skeletal rotation data relative to the standard skeletal model based on the skeletal mapping relationship between the animation skeletal model of the animation to be displayed and the standard skeletal model may include the following steps:

[0107] Determine the animation joints in the animation skeleton model and the standard joints in the standard skeleton model;

[0108] According to the bone mapping relationship between the animation skeleton model and the standard skeleton model, the target animation joints that match the standard joints are determined;

[0109] Calculate the rotation angle of the posture sub-data corresponding to the target animation joint in the default posture data relative to the standard joint, and obtain the rotation sub-data corresponding to the target animation joint;

[0110] Determine that the rotation sub-data corresponding to all animation joints corresponding to the animation skeleton model is the skeleton rotation data.

[0111] In the disclosed embodiment, the animation joints in the animation skeleton model and the standard joints in the standard skeleton model can be determined, so as to determine the target animation joints that match the joints of the standard skeleton model based on the skeleton mapping relationship between the animation skeleton model and the standard skeleton model. By calculating the posture sub-data corresponding to the target animation joint in the default posture data and the rotation angle of the standard joint, the rotation sub-data corresponding to the target animation joint can be obtained to determine that the rotation sub-data corresponding to all animation joints corresponding to the animation skeleton model are skeleton rotation sub-data. The acquisition of the selected sub-data can be achieved by calculating the sub-data of the animation skeleton model and the standard overlay model, thereby improving the accuracy of the skeleton rotation data.

[0112] As a possible implementation, based on the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model, before converting the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model, the method may further include:

[0113] Receive resource loading commands sent by the client;

[0114] In response to the resource loading command, an animation skeleton model of the animation to be displayed that matches the action image is loaded, and default posture data of the animation skeleton model is determined.

[0115] The resource loading command can be triggered by the user. For example, a page can be provided for video recording and animation selection. After the user completes the video recording and animation selection, the resource loading control can be triggered. At this point, the client can detect the user triggering the resource loading control, generate a resource loading command, and send it to the electronic device.

[0116] In an embodiment of the present disclosure, an electronic device can receive a resource loading command sent by a client and, in response to the resource loading command, load an animation skeletal model of an animation to be displayed that matches an action image and determine default posture data for the animation skeletal model. The resource loading command can initiate the technical solution of the present disclosure, load the animation skeletal model, and achieve rapid loading of the animation skeletal model.

[0117] like Figure 7 FIG. 1 is a schematic diagram of the structure of an embodiment of an animation display device provided by an embodiment of the present disclosure. The animation display device 700 may include the following units:

[0118] Posture determination unit 701: used to determine human body posture data corresponding to an action image generated when a user performs a target action.

[0119] The data conversion unit 702 is used to convert the human body posture data into the human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model.

[0120] The posture conversion unit 703 is used to convert the default posture data of the animation skeleton model into the skeleton rotation data relative to the standard skeleton model according to the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model.

[0121] Animation display unit 704: used to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0122] In one possible design, the animation display unit 704 may include:

[0123] The posture acquisition module is used to perform rotation fusion based on the human body rotation data and the skeleton rotation data to obtain the target animation action;

[0124] The animation display module is used to determine the target animation corresponding to the target action of the animation to be displayed according to the target animation action, and render and display the target animation.

[0125] In some embodiments, the posture acquisition module may include:

[0126] A first conversion submodule, configured to convert the human body rotation data into first motion data according to the data format of the motion data;

[0127] A second conversion submodule is used to convert the skeleton rotation data into second motion data according to the data format of the motion data;

[0128] The data fusion submodule is used to perform posture fusion calculation based on the first action data and the second action data to obtain the target animation action.

[0129] As yet another embodiment, further comprising:

[0130] The blueprint startup unit is used to start the animation blueprint corresponding to the rendering engine; the animation blueprint includes a data conversion script;

[0131] The first conversion submodule can be used to:

[0132] Inputting the human body rotation data into the animation blueprint, and using the data conversion script in the animation blueprint to represent the human body rotation data as first motion data according to the data format of motion data;

[0133] The second conversion submodule can be used to:

[0134] The bone rotation data is input into the animation blueprint, and the bone rotation data is represented as second action data according to the data format of the action data through the data conversion script in the animation blueprint.

[0135] As another embodiment, the data conversion unit 702 may include:

[0136] A first determination module is used to determine the world coordinate system where the standard skeleton model is located;

[0137] The data acquisition module is used to convert the human body posture data into the world coordinate system to obtain the global rotation data;

[0138] The joint conversion module is used to convert the global rotation data into the local rotation data of the corresponding standard joints based on the joint connection relationship corresponding to the standard skeleton model;

[0139] The second determination module is used to determine the human body rotation data based on the local rotation data corresponding to each standard joint of the standard skeleton model.

[0140] In some embodiments, the second determining module may include:

[0141] The constraint detection submodule is used to determine whether the local rotation data satisfies the rotation constraint information based on the local rotation data of the standard joint and the rotation constraint information of the standard joint;

[0142] A first determining submodule is configured to determine that the local rotation data of the standard joint is in a normal state if the local rotation data satisfies the rotation constraint information;

[0143] The second determining submodule is used to determine that the local rotation data corresponding to each standard joint of the standard skeleton model is human body rotation data if the local rotation data corresponding to each standard joint of the standard skeleton model are all in a normal state.

[0144] In some embodiments, the posture determination unit may include:

[0145] The data receiving module is used to receive human body posture data corresponding to the action image generated by the user performing the target action sent by the client; the human body posture data is obtained by the client performing action recognition on the action image.

[0146] In some embodiments, the data receiving module may include:

[0147] The posture acquisition submodule is used to receive human posture data corresponding to the action image generated by the user performing the target action sent by the client based on the data transmission protocol defined with the client.

[0148] In some embodiments, the apparatus may further include:

[0149] Animation determination unit, used to determine the animation skeleton model of the animation to be displayed;

[0150] The mapping acquisition unit is used to match the standard joints according to the animation joints in the animation skeleton model and the standard joints in the standard skeleton model, and obtain the skeleton mapping relationship between the animation joints and the standard joints.

[0151] As another embodiment, the posture conversion unit may include:

[0152] A skeleton determination module, used for determining animation joints in an animation skeleton model and standard joints in a standard skeleton model;

[0153] The joint matching module is used to determine the target animation joint that matches the standard joint based on the bone mapping relationship between the animation skeleton model and the standard skeleton model;

[0154] A numerical calculation module is used to calculate the posture sub-data corresponding to the target animation joint in the default posture data and the rotation angle of the standard joint, and obtain the rotation sub-data corresponding to the target animation joint;

[0155] The skeleton rotation module is used to determine that the rotation sub-data corresponding to all animation joints corresponding to the animation skeleton model are skeleton rotation data.

[0156] In some embodiments, further comprising:

[0157] The command receiving module is used to receive the resource loading command sent by the client;

[0158] The command response module is used to load the animation skeleton model of the animation to be displayed that matches the action image in response to the resource loading command, and determine the default posture data of the animation skeleton model.

[0159] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0160] In order to implement the above embodiment, the embodiment of the present disclosure further provides an electronic device.

[0161] refer to Figure 8 , which shows a schematic structural diagram of an electronic device 800 suitable for implementing an embodiment of the present disclosure. The electronic device 800 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0162] like Figure 8 As shown, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 are also stored in the RAM 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0163] Typically, the following devices may be connected to the I / O interface 805: an input device 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 8 The electronic device 800 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0164] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0165] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0166] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0167] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0168] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0169] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0170] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0171] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0172] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0173] In a first aspect, according to one or more embodiments of the present disclosure, there is provided an animation display method, comprising:

[0174] Determining human body posture data corresponding to an action image generated by a user performing a target action;

[0175] Based on the skeleton coordinate system of the standard skeleton model, the human body posture data is converted into the human body rotation data corresponding to the standard skeleton model;

[0176] According to the bone mapping relationship between the animation bone model of the animation to be displayed and the standard bone model, the default posture data of the animation bone model is converted into bone rotation data relative to the standard bone model;

[0177] According to the human body rotation data and the skeleton rotation data, the animation to be displayed is controlled to be rendered and displayed according to the target action.

[0178] According to one or more embodiments of the present disclosure, controlling the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data includes:

[0179] Perform rotation fusion based on human body rotation data and skeleton rotation data to obtain target animation action;

[0180] According to the target animation action, the target animation corresponding to the target action is determined, and the target animation is rendered and displayed.

[0181] According to one or more embodiments of the present disclosure, rotation fusion is performed based on human body rotation data and skeleton rotation data to obtain a target animation action, including:

[0182] Converting the human body rotation data into first motion data according to the data format of motion data;

[0183] Convert the bone rotation data into second motion data according to the data format of the motion data;

[0184] Performing posture fusion calculation based on the first motion data and the second motion data to obtain a target animation motion.

[0185] According to one or more embodiments of the present disclosure, the present invention further includes:

[0186] Start the animation blueprint corresponding to the rendering engine; the animation blueprint includes the data conversion script;

[0187] Converting the human body rotation data into first motion data according to the data format of the motion data includes:

[0188] Inputting the human body rotation data into the animation blueprint, and using the data conversion script in the animation blueprint to represent the human body rotation data as first motion data according to the data format of motion data;

[0189] Converting the bone rotation data into the second motion data according to the data format of the motion data includes:

[0190] The bone rotation data is input into the animation blueprint, and the bone rotation data is represented as second action data according to the data format of the action data through the data conversion script in the animation blueprint.

[0191] According to one or more embodiments of the present disclosure, based on the skeleton coordinate system of the standard skeleton model, converting human posture data into human rotation data corresponding to the standard skeleton model includes:

[0192] Determine the world coordinate system where the standard skeleton model is located;

[0193] Convert the human body posture data into the world coordinate system to obtain the global rotation data;

[0194] Based on the joint connection relationship corresponding to the standard skeleton model, the global rotation data is converted into the local rotation data of the corresponding standard joints;

[0195] The human body rotation data is determined based on the local rotation data corresponding to each standard joint of the standard skeleton model.

[0196] According to one or more embodiments of the present disclosure, determining human body rotation data based on local rotation data corresponding to each standard joint of a standard skeleton model includes:

[0197] According to the local rotation data of the standard joint and the rotation constraint information of the standard joint, determining whether the local rotation data satisfies the rotation constraint information;

[0198] If the local rotation data satisfies the rotation constraint information, it is determined that the local rotation data of the standard joint is in a normal state;

[0199] If the local rotation data corresponding to each standard joint of the standard skeleton model are all in a normal state, it is determined that the local rotation data corresponding to each standard joint of the standard skeleton model are human body rotation data.

[0200] According to one or more embodiments of the present disclosure, determining human body posture data corresponding to an action image generated by a user performing a target action includes:

[0201] Receive human body posture data corresponding to an action image generated by a user performing a target action sent by a client; the human body posture data is obtained by the client performing action recognition on the action image.

[0202] According to one or more embodiments of the present disclosure, receiving human body posture data corresponding to an action image generated by a user performing a target action, sent by a client, includes:

[0203] Based on the data transmission protocol defined with the client, human body posture data corresponding to the action image generated by the user performing the target action sent by the client is received.

[0204] According to one or more embodiments of the present disclosure, before converting the default posture data of the animation skeleton model into the skeleton rotation data relative to the standard skeleton model based on the skeleton mapping relationship between the animation skeleton model and the standard skeleton model, the method further includes:

[0205] Determine the animation skeleton model of the animation to be displayed;

[0206] According to the animation joints in the animation skeleton model and the standard joints in the standard skeleton model, the standard joints are matched to obtain the skeleton mapping relationship between the animation joints and the standard joints.

[0207] According to one or more embodiments of the present disclosure, based on the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model, the default posture data of the animation skeleton model is converted into skeleton rotation data relative to the standard skeleton model, including:

[0208] Determine the animation joints in the animation skeleton model and the standard joints in the standard skeleton model;

[0209] According to the bone mapping relationship between the animation skeleton model and the standard skeleton model, the target animation joints that match the standard joints are determined;

[0210] Calculate the rotation angle of the posture sub-data corresponding to the target animation joint in the default posture data and the standard joint to obtain the rotation sub-data corresponding to the target animation joint;

[0211] Determine that the rotation sub-data corresponding to all animation joints corresponding to the animation skeleton model is the skeleton rotation data.

[0212] According to one or more embodiments of the present disclosure, the present invention further includes:

[0213] Receive resource loading commands sent by the client;

[0214] In response to the resource loading command, an animation skeleton model of the animation to be displayed that matches the action image is loaded, and default posture data of the animation skeleton model is determined.

[0215] In a second aspect, according to one or more embodiments of the present disclosure, there is provided an animation display device, comprising:

[0216] A posture determination unit, configured to determine human body posture data corresponding to an action image generated by a user performing a target action;

[0217] A data conversion unit, configured to convert the human body posture data into human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model;

[0218] A posture conversion unit, configured to convert the default posture data of the animation skeleton model into the skeleton rotation data relative to the standard skeleton model according to the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model;

[0219] The animation display unit is used to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data.

[0220] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0221] Memory stores computer-executable instructions;

[0222] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the animation driving method of the first aspect and various possible designs of the first aspect.

[0223] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the animation driving method as described in the first aspect and various possible designs of the first aspect are implemented.

[0224] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the animation driving method of the first aspect and various possible designs of the first aspect.

[0225] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0226] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0227] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. An animation display method, characterized in that: include: Determining human body posture data corresponding to an action image generated by a user performing a target action; Based on the skeleton coordinate system of the standard skeleton model, the human body posture data is converted into human body rotation data corresponding to the standard skeleton model; According to the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model, the default posture data of the animation skeleton model is converted into skeleton rotation data relative to the standard skeleton model; Controlling the animation to be displayed to be rendered and displayed according to the target action according to the human body rotation data and the skeleton rotation data; The step of controlling the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data includes: Performing rotation fusion based on the human body rotation data and the skeleton rotation data to obtain a target animation action; According to the target animation action, a target animation corresponding to the target action of the animation to be displayed is determined, and the target animation is rendered and displayed.

2. The method according to claim 1, characterized in that The performing rotation fusion based on the human body rotation data and the skeleton rotation data to obtain a target animation action includes: Converting the human body rotation data into first motion data according to the data format of motion data; Converting the skeleton rotation data into second motion data according to the data format of the motion data; Perform motion fusion calculation based on the first motion data and the second motion data to obtain the target animation motion.

3. The method according to claim 2, characterized in that Also includes: Start the animation blueprint corresponding to the rendering engine; The animation blueprint includes a data conversion script; The converting the human body rotation data into first motion data according to the data format of the motion data includes: Inputting the human body rotation data into the animation blueprint, and using a data conversion script in the animation blueprint to represent the human body rotation data as the first motion data in the data format of the motion data; The converting the skeleton rotation data into second motion data according to the data format of the motion data includes: The bone rotation data is input into the animation blueprint, and the bone rotation data is represented as second action data according to the data format of the action data through a data conversion script in the animation blueprint.

4. The method according to claim 1, wherein The skeleton coordinate system based on the standard skeleton model converts the human body posture data into human body rotation data corresponding to the standard skeleton model, including: Determine the world coordinate system where the standard skeleton model is located; Converting the human body posture data into the world coordinate system to obtain global rotation data; Based on the joint connection relationship corresponding to the standard skeleton model, the global rotation data is converted into local rotation data corresponding to the standard joint; The human body rotation data is determined based on the local rotation data corresponding to each standard joint of the standard skeleton model.

5. The method according to claim 4, characterized in that The determining of the human body rotation data based on the local rotation data corresponding to each standard joint of the standard skeleton model includes: Determining, based on the local rotation data of the standard joint and the rotation constraint information of the standard joint, whether the local rotation data satisfies the rotation constraint information; If the local rotation data satisfies the rotation constraint information, determining that the local rotation data of the standard joint is in a normal state; If the local rotation data corresponding to each standard joint of the standard skeleton model are all in a normal state, the local rotation data corresponding to each standard joint of the standard skeleton model are determined to be the human body rotation data.

6. The method according to claim 1, characterized in that The step of determining the human body posture data corresponding to the action image generated by the user performing the target action includes: Receive human body posture data corresponding to an action image generated by a user performing a target action, which is sent by a client; the human body posture data is obtained by the client performing action recognition on the action image.

7. The method according to claim 6, characterized in that The receiving of human body posture data corresponding to an action image generated by a user performing a target action sent by the client includes: Based on the data transmission protocol defined with the client, human body posture data corresponding to the action image generated by the user performing the target action sent by the client is received.

8. The method according to claim 1, characterized in that Before converting the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model according to the skeleton mapping relationship between the animation skeleton model and the standard skeleton model, the method further includes: Determine the animation skeleton model of the animation to be displayed; The standard joints are matched according to the animation joints in the animation skeleton model and the standard joints in the standard skeleton model, so as to obtain the skeleton mapping relationship between the animation joints and the standard joints.

9. The method according to claim 1, characterized in that The step of converting the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model according to the skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model comprises: Determining animation joints in the animation skeleton model and standard joints in the standard skeleton model; Determining a target animation joint that matches the standard joint according to a skeleton mapping relationship between the animation skeleton model and the standard skeleton model; Calculating the posture sub-data corresponding to the target animation joint in the default posture data and the rotation angle of the standard joint to obtain the rotation sub-data corresponding to the target animation joint; The rotation sub-data corresponding to all animation joints corresponding to the animation skeleton model are determined as the skeleton rotation data.

10. The method according to claim 1, characterized in that Also includes: Receive resource loading commands sent by the client; In response to the resource loading command, an animation skeleton model of the animation to be displayed that matches the action image is loaded, and default posture data of the animation skeleton model is determined.

11. An animation display device, characterized in that: include: A posture determination unit, configured to determine human body posture data corresponding to an action image generated by a user performing a target action; A data conversion unit, configured to convert the human body posture data into human body rotation data corresponding to the standard skeleton model based on the skeleton coordinate system of the standard skeleton model; a posture conversion unit, configured to convert the default posture data of the animation skeleton model into skeleton rotation data relative to the standard skeleton model according to a skeleton mapping relationship between the animation skeleton model of the animation to be displayed and the standard skeleton model; An animation display unit, configured to control the animation to be displayed to be rendered and displayed according to the target action based on the human body rotation data and the skeleton rotation data; The animation display unit is specifically configured to perform rotation fusion based on the human body rotation data and the skeleton rotation data to obtain a target animation action; According to the target animation action, a target animation corresponding to the target action of the animation to be displayed is determined, and the target animation is rendered and displayed.

12. An electronic device, characterized in that: include: Processor, memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor is configured with the animation display method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the animation display method according to any one of claims 1 to 10 is implemented.

14. A computer program product comprising a computer program, characterized in that The computer program is executed by a processor to configure the animation display method according to any one of claims 1 to 10.

Images