Skeleton binding method, device, electronic device and storage medium

Abstract

The present application discloses a skeletal binding method, apparatus, electronic device, and computer-readable storage medium. The present application can obtain a base skeleton of an organism model; generate the musculoskeletal structure of the organism model based on the base skeleton; obtain a binding relationship between the musculoskeletal structure and the base skeleton; and bind the musculoskeletal structure based on the binding relationship to obtain a target skeleton of the organism model. The present application can simulate more detailed deformation details of an organism, such as muscles, thereby enhancing the expressiveness of realistic deformation details caused by movements such as twisting of the organism model.

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to a skeletal binding method, device, electronic device, and computer-readable storage medium. Background Art

[0002] In 3D animation production, multiple models such as virtual humans or objects are usually involved. In the existing technology, skeleton binding is performed on biological models such as human models to enhance the movement performance of the biological models.

[0003] However, when using existing bone binding methods to bind biological models, such as the bone binding method provided by 3D Max, a 3D animation rendering and production software, it is difficult for the biological model to show the real deformation details caused by the biological movement such as twisting. Summary of the Invention

[0004] The embodiments of the present application provide a skeletal binding method, device, electronic device, and computer-readable storage medium, which can simulate more delicate muscle and other deformation details of an organism, and improve the expressiveness of realistic deformation details caused by movements such as twisting of the organism model.

[0005] In a first aspect, an embodiment of the present application provides a skeleton binding method, comprising:

[0006] Obtain the basic skeleton of the organism model;

[0007] generating the musculoskeletal structure of the organism model on the basic skeleton;

[0008] Obtaining a binding relationship between the musculoskeletal structure and the basic skeleton;

[0009] The muscles and skeleton are bound according to the binding relationship to obtain the target skeleton of the organism model.

[0010] In some embodiments, generating the musculoskeletal structure of the organism model on the basic skeleton includes:

[0011] In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton;

[0012] In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

[0013] In some embodiments, in response to the first creation instruction of the root node position of the musculoskeletal structure of the organism model, determining the target position of the root node of the musculoskeletal structure on the base bone based on a first preset positional relationship between the base bone and the root node of the musculoskeletal structure and the position of the base bone includes:

[0014] In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton;

[0015] In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0016] In some embodiments, in response to the second creation instruction of the musculoskeletal structure of the biological model, generating the musculoskeletal structure of the biological model on the basic skeleton based on the target position includes:

[0017] In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton;

[0018] determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton;

[0019] Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

[0020] In some embodiments, the method further comprises:

[0021] Obtaining the view orientation of the base skeleton;

[0022] From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

[0023] In some embodiments, the binding relationship includes a motion constraint relationship between the musculoskeletal structure and the base skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0024] According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0025] In some embodiments, obtaining the binding relationship between the musculoskeletal structure and the basic skeleton includes:

[0026] Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

[0027] In some embodiments, the musculoskeletal structure is located at a joint of the base skeleton, and the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the base skeleton;

[0028] Binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0029] According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0030] In some embodiments, the motion constraint relationship includes a compression-stretch deformation relationship between the musculoskeletal structure and the underlying skeleton;

[0031] Binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0032] According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0033] In some embodiments, binding the musculoskeletal structure to the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0034] obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure;

[0035] Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton;

[0036] The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

[0037] In some embodiments, the binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0038] According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0039] In a second aspect, an embodiment of the present application further provides a skeleton binding device, comprising:

[0040] A first acquisition unit is used to acquire a basic skeleton of the organism model;

[0041] A generating unit, configured to generate the musculoskeletal system of the organism model based on the basic skeleton;

[0042] A second acquiring unit, configured to acquire a binding relationship between the musculoskeletal structure and the basic skeleton;

[0043] The binding unit is used to bind the muscles and bones according to the binding relationship to obtain the target bones of the organism model.

[0044] In some embodiments, the generating unit is specifically configured to:

[0045] In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton;

[0046] In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

[0047] In some embodiments, the generating unit is specifically configured to:

[0048] In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton;

[0049] In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0050] In some embodiments, the generating unit is specifically configured to:

[0051] In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton;

[0052] determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton;

[0053] Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

[0054] In some embodiments, the skeleton binding device further includes a third acquisition unit, and the third acquisition unit is specifically configured to:

[0055] Obtaining the view orientation of the base skeleton;

[0056] From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

[0057] In some embodiments, the binding relationship includes a motion constraint relationship between the musculoskeletal structure and the basic skeleton, and the binding unit is specifically configured to:

[0058] According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0059] In some embodiments, the second acquiring unit is specifically configured to:

[0060] Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

[0061] In some embodiments, the musculoskeletal structure is located at a joint point of the base skeleton, the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the base skeleton, and the binding unit is specifically configured to:

[0062] According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0063] In some embodiments, the motion constraint relationship includes a compression-stretching deformation relationship between the musculoskeletal structure and the basic skeleton, and the binding unit is specifically configured to:

[0064] According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0065] In some embodiments, the binding unit is specifically configured to:

[0066] obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure;

[0067] Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton;

[0068] The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

[0069] In some embodiments, the binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton, and the binding unit is specifically configured to:

[0070] According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0071] In a third aspect, an embodiment of the present application further provides an electronic device, comprising a memory storing a plurality of instructions; the processor loads instructions from the memory to execute the steps in any one of the skeletal binding methods provided in the embodiments of the present application.

[0072] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a plurality of instructions, wherein the instructions are suitable for loading by a processor to execute the steps in any one of the skeletal binding methods provided in the embodiment of the present application.

[0073] The embodiment of the present application generates a musculoskeletal system on the basic skeleton of the organism model. On the one hand, the deformation of the basic skeleton can be used to simulate the basic movement of the organism model; on the other hand, the musculoskeletal system and the basic skeleton are bound based on binding relationships such as link relationships and motion constraint relationships. Therefore, when the basic skeleton of the organism model moves, the musculoskeletal system can undergo corresponding model deformation along with the movement of the basic skeleton. Therefore, the musculoskeletal system can be used to simulate deformations such as muscles that occur along with the basic movement of the organism model, thereby simulating more delicate deformation details of the organism such as muscles, thereby improving the expressiveness of real deformation details brought about by movements such as twisting of the organism model. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0075] Figure 1 This is a schematic diagram of an embodiment of the skeleton binding method provided in the embodiment of the present application;

[0076] Figure 2 This is a schematic diagram of a scenario of a user interface of a musculoskeletal binding tool provided in an embodiment of the present application;

[0077] Figure 3 Schematic diagram illustrating the determination of the root node position provided in an embodiment of the present application;

[0078] Figure 4 Schematic diagram illustrating adjustment of the root node position provided in an embodiment of the present application;

[0079] Figure 5 This is a schematic diagram illustrating the generation of muscles and bones provided in the embodiments of the present application;

[0080] Figure 6 This is a schematic diagram of the movement effect before and after adding a muscle skeleton with a rotational constraint relationship with the basic skeleton provided in an embodiment of the present application;

[0081] Figure 7 It is a structural diagram of the skeleton binding device provided in an embodiment of the present application;

[0082] Figure 8 It is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0083] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application. At the same time, in the description of the embodiments of the present application, the terms "first", "second", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0084] Embodiments of the present application provide a skeleton binding method, apparatus, electronic device, and computer-readable storage medium.

[0085] Specifically, this embodiment will be described from the perspective of a skeleton binding device, which can be integrated into an electronic device. That is, the skeleton binding method of the embodiment of the present application can be executed by an electronic device, which can be a terminal, a server, or other device. Among them, the terminal can be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a touch screen, a game console, or a personal computer (PC); the server can be a single server or a server cluster composed of multiple servers.

[0086] For example, the electronic device can be a mobile terminal, which can obtain the basic skeleton of the organism model through the network; generate the muscle skeleton of the organism model on the basic skeleton; obtain the binding relationship between the muscle skeleton and the basic skeleton; bind the muscle skeleton according to the binding relationship to obtain the target skeleton of the organism model.

[0087] In some embodiments, the skeleton binding device can also be integrated into multiple electronic devices. For example, the skeleton binding device can be integrated into multiple servers, and the skeleton binding method of the present application can be implemented by multiple servers. For another example, the skeleton binding device can be integrated into multiple terminals, and the skeleton binding method of the present application can be implemented by multiple terminals.

[0088] In some embodiments, the server can also be implemented in the form of a terminal. For example, a personal computer can be set as a server to integrate the skeleton binding device, and the server set up by the personal computer can implement the skeleton binding method of the present application.

[0089] The following is an example of an electronic device being the execution subject of the skeleton binding method, and is described in detail in conjunction with the accompanying drawings. For the sake of simplicity, the execution subject will be omitted in the following text. It should be noted that the description order of the following embodiments does not limit the preferred order of the embodiments. Although a logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown in the drawings.

[0090] like Figure 1 As shown, the specific process of the skeleton binding method can be as follows: Step 101 to Step 104, wherein:

[0091] 101. Obtain the basic skeleton of the organism model.

[0092] The organism model refers to a model of an organism, for example, a human body model or an animal body model in game animation.

[0093] The basic skeleton refers to the main skeleton of an organism. The deformation of the basic skeleton can be used to simulate the basic movements of the organism model (such as flexion, extension, and twisting). For example, the basic skeleton of a human body model can specifically be the human trunk skeleton (such as the limbs). The basic skeleton can specifically be the basic skeleton of a part of the organism model (such as the human arm), or it can include the basic skeletons of multiple parts of the organism model (such as the basic skeleton of the arm and the basic skeleton of the leg of the human body model).

[0094] There are many ways to obtain the basic skeleton in step 101, illustratively including:

[0095] 1) Construct the basic skeleton of the organism model in real time.

[0096] 2) Identify existing skeletons in pre-built organism models and use them as the base skeleton for the organism. For example, in a game character animation scene, the BIP skeleton (BIP files are commonly used action files for footstep controllers and are commonly used in animation and 3D production. BIP is a format unique to 3D Max CS) in the pre-built game character can be identified and used as the base skeleton for the game character.

[0097] 102. Generate the musculoskeletal structure of the organism model based on the basic skeleton.

[0098] The musculoskeletal structure is the skeleton constructed to simulate muscles in an organism model. Specifically, it is used to simulate the deformation of the organism's muscles as the main skeleton moves. The deformation of the musculoskeletal structure can be used to simulate the muscle deformation that occurs with the basic movement of the organism model (such as the corresponding torsional deformation of the corresponding muscle when the organism model's joints are twisted). For example, in a human body model, the deformation of the biceps brachii can be represented by constructing a skeleton. The skeleton used to represent the deformation of the biceps brachii is the musculoskeletal structure.

[0099] The musculoskeletal system may specifically include the musculoskeletal system of a certain part of a biological body, such as the musculoskeletal system of a human arm, or the musculoskeletal system may specifically include the musculoskeletal system of multiple parts of a biological body, such as the abdominal muscles, chest muscles, thigh muscles, calf muscles, etc.

[0100] There are many ways to generate the musculoskeletal system of the organism model on the basic skeleton in step 102, illustratively including:

[0101] (1) On the basic skeleton of the organism model, the muscles and skeleton of the organism model are constructed in real time, thereby realizing the generation of the muscles and skeleton of the organism model on the basic skeleton.

[0102] (2) Automatically generate the musculoskeletal system based on the pre-established relationship between the basic skeleton and the musculoskeletal system (e.g., the positional relationship between the root nodes of the basic skeleton and the musculoskeletal system, the size relationship between the basic skeleton and the musculoskeletal system, etc.). In this case, step 102 may specifically include the following steps 1021A to 1022A, wherein:

[0103] 1021A. In response to a first creation instruction for the root node position of the musculoskeletal system of the organism model, the target position of the root node of the musculoskeletal system is determined on the basic skeleton based on a first preset positional relationship between the basic skeleton and the root node of the musculoskeletal system, and the position of the basic skeleton.

[0104] The root node position indicates the location of the root node of the musculoskeletal structure on the base skeleton. For example, if the base skeleton is the human arm and the musculoskeletal structure is the upper arm muscle, the root node position refers to the location of the root node of the upper arm muscle on the human arm.

[0105] The first creation instruction is an instruction for generating the root node position of the musculoskeletal structure of the organism model. For example, the user pre-constructs a first preset position relationship between the root node of the basic skeleton and the musculoskeletal structure, and a binding relationship between the basic skeleton and the musculoskeletal structure, and writes a musculoskeletal binding tool based on the first preset position relationship and binding relationship to automatically generate and bind the musculoskeletal structure on the basic skeleton, such as Figure 2 As shown, Figure 2 This is a scene diagram of the user interface of the musculoskeletal binding tool. When the user clicks "Create Root Node Position", the musculoskeletal binding tool will call the first preset position relationship constructed by the preset, and automatically generate the root node position of the musculoskeletal structure on the basic skeleton; that is, when the user clicks "Create Root Node Position", the first creation instruction will be triggered.

[0106] The target position is the position of the root node of the musculoskeletal structure on the base bone, which is ultimately used to generate the musculoskeletal structure.

[0107] The position of the basic bones is used to indicate the coordinate position of the basic bones in the drawing software.

[0108] The first preset positional relationship is used to indicate the positional relationship between the base bone and the root nodes of the musculoskeletal structure. For example, if the base bone is a human arm, the two root nodes of a musculoskeletal structure are located at 1 / 4 and 3 / 4 of the length of the base bone (human arm) from top to bottom, respectively.

[0109] There are multiple ways to determine the target location of the root node in step 1021A, illustratively including:

[0110] ①The generated root node position is directly used as the target position.

[0111] For example, when a creation operation of the root node position of the musculoskeletal structure of the organism model is detected (e.g., Figure 2 As shown, when the user clicks "Create root node position"), the first creation instruction of the root node position of the musculoskeletal model of the organism will be triggered; in step 1021A, in response to the first creation instruction of the root node position of the musculoskeletal model of the organism, first, the first preset position relationship between the basic bone and the root node of the musculoskeletal model is obtained; then, based on the first preset position relationship between the basic bone and the root node of the musculoskeletal model, and the position of the basic bone, the root node position of the musculoskeletal model is automatically calculated, and the automatically calculated root node position of the musculoskeletal model is used as the target position of the root node.

[0112] like Figure 2 and Figure 3 As shown, taking the basic skeleton as the human arm (including the upper arm and lower arm) and the musculoskeletal muscle as the upper arm as an example, it is assumed that the first preset position relationship is: the root node of one end of the upper arm musculoskeletal muscle is at 1 / 4 of the length from the top to the bottom of the human upper arm, and the root node of the other end of the upper arm musculoskeletal muscle is at 3 / 4 of the length from the top to the bottom of the human upper arm. Figure 2 When the user interface of the muscle-bone binding tool shown in the figure clicks "Create Root Node Position", the root node is located at 1 / 4 of the length from top to bottom of the upper arm of the human body (such as Figure 3 As shown in point a), 3 / 4 length (as shown in point a), Figure 3 (as shown in point b) to generate the root node position of the upper arm muscle skeleton, as shown in Figure 3 shown.

[0113] ② Manually adjust the automatically generated root node position, and use the adjusted root node position as the target position. Since the automatically generated root node position is only a theoretical value of the root node position generated based on the first preset position relationship, and the sizes and shapes of different basic bones themselves are different, the theoretical value may be slightly different from the actual value. In order to improve the accuracy of the root node position of the musculoskeletal system, the automatically generated root node position can also be adjusted, and the adjusted root node position can be used as the target position. At this time, step 1021A can specifically include the following steps A1 to A2, wherein:

[0114] A1. In response to the first creation instruction, based on a first preset positional relationship between the basic skeleton and the root node of the musculoskeletal skeleton, and the position of the basic skeleton, determine the initial position of the root node of the musculoskeletal skeleton on the basic skeleton.

[0115] The initial position refers to the root node position of the musculoskeletal system automatically generated based on the first preset position relationship.

[0116] For example, when a creation operation of the root node position of the musculoskeletal structure of the organism model is detected (e.g., Figure 2 As shown, when the user clicks "Create root node position"), the first creation instruction of the root node position of the musculoskeletal model of the organism will be triggered; in step A1, in response to the first creation instruction of the root node position of the musculoskeletal model of the organism, first, the first preset position relationship between the basic bone and the root node of the musculoskeletal model is obtained; then, based on the first preset position relationship between the basic bone and the root node of the musculoskeletal model, and the position of the basic bone, the root node position of the musculoskeletal model is automatically calculated, and the automatically calculated root node position of the musculoskeletal model is used as the initial position of the root node.

[0117] A2. In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0118] The adjustment instruction refers to an instruction for adjusting the initial position of the root node (generated automatically based on the first preset position). The adjustment instruction carries the specified position of the adjusted root node, and the specified position corresponding to the adjustment instruction refers to the specified position of the adjusted root node carried by the adjustment instruction.

[0119] For example, when an adjustment operation of the root node position of the musculoskeletal structure of the organism model is detected (e.g., Figure 4 As shown, the user selects the initial position of the root node automatically generated based on the first preset position (such as Figure 4 (as shown by point a in the figure), dragging it to point a' will trigger the adjustment instruction of the initial position of the root node. In step A2, in response to the adjustment instruction of the initial position, the root node position will be adjusted from the initial position to the specified position corresponding to the adjustment instruction, as the target position of the root node of the musculoskeletal system.

[0120] It can be seen that by responding to the adjustment instruction of the initial position, the root node position is adjusted from the initial position to the specified position corresponding to the adjustment instruction, which serves as the target position of the root node of the musculoskeletal system. On the one hand, a large amount of work required for manually constructing the root node of the musculoskeletal system is saved, thereby improving the construction speed of the musculoskeletal system. On the other hand, the position accuracy of the root node of the musculoskeletal system can be improved to improve the position accuracy of the musculoskeletal system, so that the subsequently generated musculoskeletal system can better fit the actual physiological shape of the organism, thereby improving the movement performance of the musculoskeletal system.

[0121] Furthermore, since the positional relationship between the base skeleton and the root node of the musculoskeletal structure will be different if the perspective of the organism model is different under the same coordinate reference system, in order to improve the positional accuracy of the generated musculoskeletal structure, different positional relationships can be pre-constructed for different perspectives, and the root node position can be determined using different positional relationships at different perspectives. That is, the skeletal binding method also includes: obtaining the view orientation of the base skeleton; and obtaining an orientation positional relationship that matches the view orientation of the base skeleton from each preset orientation positional relationship as the first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure.

[0122] Each orientation position relationship refers to the positional relationship between the base bone and the root node of the musculoskeletal system for the orientation view.

[0123] For example, first, the view orientation of the base skeleton (such as the front view) can be determined based on the user's selection or input; then, from the pre-built orientation position relationships (such as the front view position relationship, the back view position relationship, etc.), the orientation position relationship (i.e., the front view position relationship) that matches the view orientation of the base skeleton is obtained as the first preset position relationship between the base skeleton and the root node of the musculoskeletal structure. For example, Figure 2 As shown, first, the user clicks to select "Front View", and then the user clicks "Create Root Node Position". At this time, the front view position relationship will be obtained from the pre-built front view position relationship and back view position relationship as the first preset position relationship between the base skeleton and the root node of the musculoskeletal structure. In step 1021A, the root node position of the musculoskeletal structure is automatically calculated based on the front view position relationship and the position of the base skeleton, and the automatically calculated root node position of the musculoskeletal structure is used as the target position of the root node.

[0124] 1022A. In response to a second creation instruction for the musculoskeletal system of the biological model, generate the musculoskeletal system of the biological model on the basic skeleton based on the target position.

[0125] The second creation instruction is an instruction for generating the musculoskeletal structure of the organism model. For example, the user pre-constructs a first preset positional relationship, size relationship, and binding relationship between the root nodes of the basic skeleton and the musculoskeletal structure, and writes a musculoskeletal binding tool based on the first preset positional relationship, size relationship, and binding relationship to automatically generate and bind the musculoskeletal structure on the basic skeleton, such as Figure 2As shown, first, the user clicks "Create Root Node Position", the musculoskeletal binding tool will call the first preset position relationship of the preset construction, and automatically generate the root node position of the musculoskeletal structure on the basic skeleton; then, the user clicks "Create Musculoskeletal Structure", the musculoskeletal binding tool will call the preset size relationship, and generate the musculoskeletal structure of the organism model on the basic skeleton according to the automatically generated root node position of the musculoskeletal structure.

[0126] There are many ways to generate the musculoskeletal structure in step 1022A, including, for example:

[0127] ①Generate according to fixed muscle and bone sizes (e.g., default size, user-defined size) and target positions of root nodes.

[0128] For example, when a musculoskeletal creation operation of the organism model is detected (e.g., Figure 2 As shown, when the user clicks "Create Musculoskeletons"), a second creation instruction of the musculoskeletons of the organism model will be triggered; in step 1022A, in response to the second creation instruction of the musculoskeletons of the organism model, the musculoskeletons of the organism model will be automatically generated on the basic skeleton according to the target position of the root node of the musculoskeletons and the fixed musculoskeletal size.

[0129] like Figure 2 、 Figure 3 and Figure 5 As shown, taking the basic skeleton as the human arm (including the upper arm and lower arm) and the musculoskeletal structure as the upper arm musculoskeletal structure as an example, first, the user is based on the following Figure 2 The user interface of the muscle-bone binding tool shown in the figure clicks "Create Root Node Position" to generate the root node positions of the upper arm muscle bones at 1 / 4 and 3 / 4 of the length from top to bottom of the human arm, as shown in the figure. Figure 3 Then, when the user is based on Figure 2 When the user clicks "Create Muscles and Bones" on the user interface of the Muscles and Bones Binding Tool shown, the upper arm musculoskeletal structure of the human arm will be automatically generated on the basic skeleton based on the root node position of the upper arm musculoskeletal structure (i.e., the 1 / 4 length and 3 / 4 length of the upper arm from top to bottom) and the default thickness of the musculoskeletal structure. Figure 5 shown.

[0130] ② Generate according to the preset size relationship and the target position of the root node. The size of the musculoskeletal model is determined according to the preset size relationship between the basic skeleton and the musculoskeletal model; based on the target position of the root node and the size of the musculoskeletal model, the musculoskeletal model is automatically generated on the basic skeleton. This can make the automatically generated musculoskeletal model more realistic, thereby reducing the workload required for bone binding and increasing the speed of bone binding. At this time, step 1022A can specifically include the following steps B1 to B3, wherein:

[0131] B1. In response to the second creation instruction, obtain the size relationship between the basic skeleton and the musculoskeletal skeleton.

[0132] The size relationship refers to the size ratio between the basic bones and the musculoskeletal structure. For example, the thickness of the musculoskeletal structure is half the thickness of the basic bones.

[0133] The size relationship may be pre-built or acquired in real time based on user input.

[0134] B2. Determine the size of the musculoskeletal structure based on the size relationship and the size of the underlying skeleton.

[0135] B3. Based on the target position and the size of the musculoskeletal system, generate the musculoskeletal system of the organism model on the basic skeleton.

[0136] Taking the example that the size relationship is the size relationship between the pre-built musculoskeletal and basic bones, when the creation operation of the musculoskeletal of the organism model is detected (for example, Figure 2 As shown, when the user clicks "Create Musculoskeletons"), a second creation instruction for the musculoskeletons of the organism model will be triggered; in step B1, in response to the second creation instruction for the musculoskeletons of the organism model, the size relationship between the pre-built basic bones and the musculoskeletons will be obtained. In step B2, first, the size of the basic bones is calculated based on the position of the basic bones; then, based on the pre-built size relationship and the size of the basic bones, the size of the musculoskeletons is determined. In step B3, based on the size of the musculoskeletons determined in step B2 and the target position of the root node determined in step 1021A, the basic bones of the organism model are generated on the basic bones.

[0137] Taking the example of the size relationship between the musculoskeletal system and the basic skeleton input by the user in real time, when the creation operation of the musculoskeletal system of the organism model is detected (for example, Figure 2 As shown, the user clicks "Create Musculoskeletons"), which will trigger the second creation instruction of the musculoskeletons of the organism model; in step B1, in response to the second creation instruction of the musculoskeletons of the organism model, the size relationship between the musculoskeletons and the basic bones input by the user in real time is received. In step B2, first, the size of the basic bones is calculated according to the position of the basic bones; then, based on the size relationship between the musculoskeletons and the basic bones input by the user in real time and the size of the basic bones, the size of the musculoskeletons is determined. In step B3, based on the size of the musculoskeletons determined in step B2 and the target position of the root node determined in step 1021A, the basic bones of the organism model are generated on the basic bones.

[0138] It can be seen that the target position of the root node of the musculoskeletal system is determined on the basic skeleton based on the first preset position relationship between the basic skeleton and the root node of the musculoskeletal system, as well as the position of the basic skeleton; based on the target position, the musculoskeletal system of the organism model is automatically generated on the basic skeleton; a large amount of manual construction of the root node of the musculoskeletal system and / or the workload required for manual construction of the musculoskeletal system can be saved, thereby improving the construction speed of the musculoskeletal system and thereby improving the binding speed of the musculoskeletal system.

[0139] 103. Obtain a binding relationship between the musculoskeletal structure and the basic skeleton.

[0140] Among them, the binding relationship is used to indicate the constraint relationship between the musculoskeletal system and the basic skeleton, such as the link relationship between the musculoskeletal system and the basic skeleton, and the motion constraint relationship between the musculoskeletal system and the basic skeleton.

[0141] There are many ways to obtain the binding relationship in step 103, illustratively including:

[0142] (1) Real-time construction is obtained.

[0143] For example, the binding relationship between the real-time constructed musculoskeletal system and the underlying skeleton may include a link relationship between the musculoskeletal system and the underlying skeleton, a motion constraint relationship between the musculoskeletal system and the underlying skeleton, etc. For ease of understanding, the following examples illustrate the classification and function of the binding relationship between the real-time constructed musculoskeletal system and the underlying skeleton.

[0144] 1. The connection relationship between the musculoskeletal system and the basic skeleton. Specifically, the connection relationship between the musculoskeletal system and the basic skeleton is constructed according to the actual connection relationship between the musculoskeletal system and the basic skeleton of the organism model. The function of the connection relationship between the musculoskeletal system and the basic skeleton is to be used for subsequent skeletal binding to connect the musculoskeletal system and the basic skeleton, so that the movement of the organism model is more realistic and the movement expression of the organism model is improved.

[0145] 2. Motion constraint relationships between the musculoskeletal structure and the underlying skeleton. These motion constraint relationships are used to indicate the deformation that the musculoskeletal structure undergoes when the underlying skeleton moves. There are many types of motion constraint relationships between the musculoskeletal structure and the underlying skeleton, including but not limited to the following:

[0146] ① When basic bones move (such as rotation), the muscles and bones rotate.

[0147] ② When basic bones move (such as shaking), the muscles and bones shake.

[0148] ③ During basic skeletal movements (such as bending or straightening), the muscles and bones are squeezed or stretched.

[0149] Further, in order to achieve the model deformation of musculoskeletal model of simulation of different degrees, in order to improve the model deformation expression of musculoskeletal model, specifically can be based on the preset spring motion property coefficient, construct the motion constraint relationship between the musculoskeletal model and the basic skeleton. Wherein, the preset spring motion property coefficient is a parameter pre-constructed for simulating the deformation direction and deformation amplitude of the spring with the size and direction of the external force it receives. In the present embodiment, the motion constraint relationship between the musculoskeletal model and the basic skeleton is constructed by referring to the preset spring motion property coefficient, so that the motion constraint relationship constructed can be used to simulate the deformation direction and deformation amplitude of the musculoskeletal model with the size and direction of the force squeezed or stretched by the basic skeleton. For example, the spring motion property coefficient is provided in the drawing software (such as 3D Max, a three-dimensional animation rendering and production software) for simulating the deformation direction and deformation amplitude of the spring with the size and direction of the external force it receives; Therefore, the spring motion property coefficient provided by the drawing software can be used as a preset spring motion property coefficient to construct the motion constraint relationship between the musculoskeletal model and the basic skeleton.

[0150] Similarly, the motion constraint relationship between different muscles and bones can also be constructed based on the preset spring motion property coefficients.

[0151] Furthermore, to enhance the expressiveness of musculoskeletal structures, binding relationships between different musculoskeletal structures can be constructed, such as link relationships and motion constraint relationships between different musculoskeletal structures. The following examples illustrate the classification and function of binding relationships between different musculoskeletal structures constructed in real time.

[0152] 1. Links between different muscles and bones. Specifically, the links between different muscles and bones are constructed according to the actual connection between the different muscles and bones in the organism model. The role of the links between different muscles and bones is to be used for subsequent skeletal binding to connect different muscles and bones, so that the movement of the organism model is more realistic and the movement expressiveness of the organism model is improved.

[0153] 2. Motion constraint relationships between different musculoskeletal structures. These relationships are used to indicate the deformation of one musculoskeletal structure as another musculoskeletal structure moves. There are many types of motion constraint relationships between different musculoskeletal structures, including but not limited to the following:

[0154] ① When one musculoskeletal muscle moves (such as rotation), the other musculoskeletal muscle rotates.

[0155] ② When one muscle or bone moves (such as shaking), the other muscle or bone shakes.

[0156] ③ When one muscle or bone moves (such as bending or straightening), the other muscle or bone is squeezed or stretched.

[0157] (2) The pre-built binding relationship between the musculoskeletal system and the basic skeleton is stored in the preset database (for example, the binding relationship can be pre-built by referring to the construction method in (1)), and is directly read from the preset database in step 103. By obtaining the pre-built binding relationship, the musculoskeletal system is automatically bound. On the one hand, the musculoskeletal system of multiple sets of biological models can be automatically bound based on the binding relationship built once, avoiding the repeated workload of musculoskeletal system binding. On the other hand, even people who are not familiar with the complex constraint relationship between the musculoskeletal system and the basic skeleton can automatically generate and bind the musculoskeletal system through a simple one-click creation operation of the musculoskeletal system binding tool built based on the binding relationship, thereby reducing the difficulty of musculoskeletal system binding and improving the efficiency of bone binding.

[0158] 104. Bind the muscles and skeleton according to the binding relationship to obtain a target skeleton of the organism model.

[0159] The target bone refers to the bone obtained by creating a musculoskeletal structure on the base bone and binding the musculoskeletal structure.

[0160] The following describes the binding of muscles and bones in step 104, using the binding relationships as the link relationship between bones and the motion constraint relationship between bones.

[0161] 1. Binding relationship is the link relationship between bones.

[0162] ① When the binding relationship is specifically a link between a musculoskeletal structure and a base skeleton, step 104 may specifically include: binding the musculoskeletal structure to the base skeleton according to the link between the musculoskeletal structure and the base skeleton, thereby obtaining the target skeleton of the organism model. By linking the musculoskeletal structure and the base skeleton, the organism model's movement can be made more realistic, improving the organism model's expressiveness.

[0163] For example, taking the example of the basic skeleton being the human arm (including the upper arm basic skeleton and the lower arm basic skeleton) and the musculoskeletons being the upper arm musculoskeletons and the lower arm musculoskeletons, the upper arm musculoskeletons can be linked and bound with the upper arm basic skeleton, and the lower arm musculoskeletons can be linked and bound with the lower arm basic skeleton to obtain the target skeleton of the human arm.

[0164] ② When the binding relationship specifically involves linking different muscles and bones, step 104 may specifically include: binding the different muscles and bones according to the linking relationships between the different muscles and bones to obtain the target skeleton of the organism model. By linking the different muscles and bones, the movement of the organism model can be made more realistic, improving the movement expressiveness of the organism model.

[0165] For example, taking the example of the basic skeleton being the human arm (including the upper arm basic skeleton and the lower arm basic skeleton) and the musculoskeletons being the upper arm musculoskeletons and the lower arm musculoskeletons, the upper arm musculoskeletons and the lower arm musculoskeletons can be linked and bound to obtain the target skeleton of the human arm.

[0166] 2. Binding relationship is the motion constraint relationship between bones.

[0167] ① When the binding relationship is specifically a motion constraint relationship between the musculoskeletal system and the basic skeleton, step 104 may specifically include: binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship between the musculoskeletal system and the basic skeleton to obtain the target skeleton of the organism model.

[0168] Specifically, a motion constraint relationship between the musculoskeletal system and the base skeleton can be added through a controller to achieve binding of the musculoskeletal system and the base skeleton. At this time, before binding the musculoskeletal system, the controller point of the musculoskeletal system needs to be determined, and then the motion constraint relationship between the musculoskeletal system and the base skeleton is added to the controller point of the musculoskeletal system. That is, before the step of "binding the musculoskeletal system and the base skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model", the following steps C1 to C2 can be further included:

[0169] C1. Obtain a second preset position relationship between the basic skeleton and the controller point of the musculoskeletal system.

[0170] The second preset positional relationship is used to indicate the positional relationship between the basic skeleton and the controller point of the musculoskeletal system.

[0171] The controller points are the control points of the musculoskeletal controller. The control points of the musculoskeletal controller are used to add motion constraints (such as rotational deformation, squeezing and stretching deformation, etc.) between the musculoskeletal structure and the underlying skeleton to control the deformation of the musculoskeletal structure.

[0172] C2. Determine the position of the controller point of the musculoskeletal system on the basic skeleton based on the second preset position relationship and the position of the basic skeleton.

[0173] The position of the controller point of the musculoskeletal structure is the position of the controller used to add a motion constraint relationship between the musculoskeletal structure and the base skeleton.

[0174] The implementation of steps C1 to C2 is similar to the above step 1021A, and will not be repeated here for simplicity.

[0175] In some embodiments, the position of the musculoskeletal controller point is the same as the musculoskeletal root node. In this case, the position of the musculoskeletal controller point can be directly determined on the base skeleton using the method described in step 1021A. Alternatively, the musculoskeletal root node position determined in step 1021A can be directly obtained as the position of the musculoskeletal controller point.

[0176] Correspondingly, the step of "binding the musculoskeletal system to the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model" may specifically include: binding the musculoskeletal system to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model. It can be seen that by determining the position of the controller point of the musculoskeletal system and adding the motion constraint relationship between the musculoskeletal system and the basic skeleton to the position of the controller point of the musculoskeletal system, the binding of the musculoskeletal system and the basic skeleton can be effectively achieved, thereby ensuring the expression of muscle deformation of the organism model.

[0177] For example, see Figure 6 As shown, Figure 6 (a) is at the joint point of the basic skeleton ( Figure 6 The model before adding the muscle skeleton with a rotation constraint relationship with the basic bones) at the joint point between the human thigh and hip. Figure 6 (b) in the figure is a model after adding a musculoskeletal model with a rotational constraint relationship with the base skeleton at the joint point of the base skeleton. When the musculoskeletal model is located at the joint point of the base skeleton (such as the joint point between the thigh and hip of the human body), the motion constraint relationship between the musculoskeletal model and the base skeleton is specifically the rotational deformation relationship between the musculoskeletal model and the base skeleton. At this time, the rotational deformation relationship between the musculoskeletal model and the base skeleton can be added to the position of the controller point of the musculoskeletal model (such as the joint point between the thigh and hip of the human body) to achieve the binding of the musculoskeletal model and the base skeleton to obtain the target skeleton of the organism model. Therefore, since the musculoskeletal model with a rotational deformation relationship with the base skeleton is added to the joint point of the base skeleton, the muscles at the joint point of the organism model can rotate with the movement of the base skeleton, making the distortion transition of the model at the joint point more natural, thereby improving the motion deformation expression of the organism model.

[0178] For example, the motion constraint relationship between the musculoskeletal structure and the underlying skeleton is specifically a compression-stretching relationship between the musculoskeletal structure and the underlying skeleton. In this case, the compression-stretching relationship between the musculoskeletal structure and the underlying skeleton can be added to the controller point of the musculoskeletal structure to bind the musculoskeletal structure to the underlying skeleton, thereby obtaining the target skeleton of the organism model. Thus, since the underlying skeleton is bound to a musculoskeletal structure that has a compression-stretching relationship with the underlying skeleton, the muscles of the organism model can be compressed and stretched in response to the movement of the underlying skeleton, making the muscle deformation of the organism model more natural and thus improving the expressiveness of the motion deformation of the organism model.

[0179] ② When the binding relationship is specifically a motion constraint relationship between different muscles and bones, step 104 may specifically include: binding the different muscles and bones according to the motion constraint relationship between the different muscles and bones to obtain the target skeleton of the organism model.

[0180] For example, the motion constraint relationship between different muscles and bones is specifically the rotational deformation relationship between different muscles and bones. At this time, the rotational deformation relationship between different muscles and bones can be added to the position of the controller point of the muscles and bones to realize the binding of different muscles and bones and obtain the target skeleton of the organism model.

[0181] For example, the motion constraint relationship between different muscles and bones is specifically the extrusion and stretching deformation relationship between different muscles and bones. At this time, the extrusion and stretching deformation relationship between different muscles and bones can be added to the position of the controller point of the muscles and bones to achieve binding between different muscles and bones and obtain the target skeleton of the organism model.

[0182] It can be seen that the target skeleton of the organism model is obtained by binding the musculoskeletons to the basic skeleton according to the motion constraint relationship between the musculoskeletons and the basic skeleton. Since the musculoskeletons bound to the basic skeleton with a motion constraint relationship can be added to the basic skeleton, the muscles of the organism model can undergo corresponding model deformation with the movement of the basic skeleton, making the muscle deformation of the organism model more natural, thereby improving the motion deformation expression of the organism model.

[0183] For ease of understanding, the above example illustrates the binding of muscles and bones by sequentially executing step 102 and step 104. It is understandable that in actual applications, muscles and bones can be generated first and then bound, or they can be bound at the same time as they are generated. That is, step 102 can be executed first and then step 104, or they can be executed simultaneously. For example, Figure 2 As shown, when the user clicks “Create Musculoskeletal Structure”, the execution of steps 102 and 104 is triggered simultaneously.

[0184] From the above content, it can be seen that in this embodiment, by generating musculoskeletons on the basic skeleton of the organism model, on the one hand, the deformation of the basic skeleton can be used to simulate the basic movement of the organism model; on the other hand, since the musculoskeletons and the basic skeleton are bound based on binding relationships such as link relationships and motion constraint relationships, when the basic skeleton of the organism model moves, the musculoskeletons can undergo corresponding model deformation along with the movement of the basic skeleton. Therefore, the musculoskeletons can be used to simulate deformations such as muscles that occur along with the basic movement of the organism model, thereby simulating more delicate deformation details of muscles and the like of the organism, thereby improving the expressiveness of real deformation details brought about by movements such as twisting of the organism model.

[0185] In order to better implement the above method, an embodiment of the present application further provides a skeleton binding device, which can be specifically integrated into an electronic device, such as a computer device, which can be a terminal, server, or other device.

[0186] Among them, the terminal can be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a personal computer and other devices; the server can be a single server or a server cluster composed of multiple servers.

[0187] For example, in this embodiment, the method of the embodiment of the present application will be described in detail by taking the skeleton binding device specifically integrated into a computer as an example.

[0188] For example, Figure 7 As shown, the skeleton binding device may include:

[0189] A first acquisition unit 701 is used to acquire a basic skeleton of the organism model;

[0190] A generating unit 702 is configured to generate the musculoskeletal structure of the organism model based on the basic skeleton;

[0191] A second acquiring unit 703 is configured to acquire a binding relationship between the musculoskeletal system and the basic skeleton;

[0192] The binding unit 704 is configured to bind the muscles and skeleton according to the binding relationship to obtain a target skeleton of the organism model.

[0193] In some embodiments, the generating unit 702 is specifically configured to:

[0194] In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton;

[0195] In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

[0196] In some embodiments, the generating unit 702 is specifically configured to:

[0197] In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton;

[0198] In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0199] In some embodiments, the generating unit 702 is specifically configured to:

[0200] In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton;

[0201] determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton;

[0202] Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

[0203] In some embodiments, the skeleton binding device further includes a third acquisition unit (not shown in the figure), and the third acquisition unit is specifically used to:

[0204] Obtaining the view orientation of the base skeleton;

[0205] From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

[0206] In some embodiments, the binding relationship includes a motion constraint relationship between the musculoskeletal structure and the basic skeleton, and the binding unit 704 is specifically configured to:

[0207] According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0208] In some embodiments, the second acquiring unit 703 is specifically configured to:

[0209] Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

[0210] In some embodiments, the musculoskeletal structure is located at a joint point of the base skeleton, the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the base skeleton, and the binding unit 704 is specifically configured to:

[0211] According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0212] In some embodiments, the motion constraint relationship includes a compression-stretching deformation relationship between the musculoskeletal structure and the basic skeleton, and the binding unit 704 is specifically configured to:

[0213] According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0214] In some embodiments, the binding unit 704 is specifically configured to:

[0215] obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure;

[0216] Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton;

[0217] The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

[0218] In some embodiments, the binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton, and the binding unit 704 is specifically configured to:

[0219] According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0220] As can be seen from the above, the skeleton binding device of this embodiment can be composed of a first acquisition unit 701 for acquiring the basic skeleton of the organism model; a generation unit 702 for generating the musculoskeletal structure of the organism model on the basic skeleton; a second acquisition unit 703 for acquiring the binding relationship between the musculoskeletal structure and the basic skeleton; and a binding unit 704 for binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model. Therefore, in the first aspect of the embodiment of the present application, since the deformation of the basic skeleton can be used to simulate the basic movement of the organism model; in the second aspect, since the musculoskeletal structure and the basic skeleton are bound based on the binding relationship between the two, such as the link relationship, the motion constraint relationship, etc., when the basic skeleton of the organism model moves, the musculoskeletal structure can undergo corresponding model deformation along with the movement of the basic skeleton. Therefore, the musculoskeletal structure can be used to simulate the deformation of muscles, etc., along with the basic movement of the organism model, thereby simulating more detailed deformation details of the organism's muscles, etc., thereby improving the expressiveness of the real deformation details brought about by movements such as twisting of the organism model.

[0221] Accordingly, the embodiment of the present application also provides an electronic device, which may be a terminal, such as a smart phone, a tablet computer, a laptop computer, a touch screen, a game console, a personal computer (PC), a personal digital assistant (PDA), or other terminal devices. Figure 8 As shown, Figure 8 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 800 includes a processor 801 having one or more processing cores, a memory 802 having one or more computer-readable storage media, and a computer program stored in the memory 802 and executable on the processor. The processor 801 is electrically connected to the memory 802. It will be understood by those skilled in the art that the electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0222] The processor 801 is the control center of the electronic device 800. It uses various interfaces and lines to connect various parts of the entire electronic device 800. By running or loading software programs and / or modules stored in the memory 802 and calling data stored in the memory 802, it executes various functions of the electronic device 800 and processes data, thereby monitoring the electronic device 800 as a whole.

[0223] In the embodiment of the present application, the processor 801 in the electronic device 800 loads instructions corresponding to one or more application processes into the memory 802 according to the following steps, and the processor 801 runs the application stored in the memory 802 to implement various functions:

[0224] Obtain the basic skeleton of the organism model;

[0225] generating the musculoskeletal structure of the organism model on the basic skeleton;

[0226] Obtaining a binding relationship between the musculoskeletal structure and the basic skeleton;

[0227] The muscles and skeleton are bound according to the binding relationship to obtain the target skeleton of the organism model.

[0228] In some embodiments, generating the musculoskeletal structure of the organism model on the basic skeleton includes:

[0229] In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton;

[0230] In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

[0231] In some embodiments, in response to the first creation instruction of the root node position of the musculoskeletal structure of the organism model, determining the target position of the root node of the musculoskeletal structure on the base bone based on a first preset positional relationship between the base bone and the root node of the musculoskeletal structure and the position of the base bone includes:

[0232] In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton;

[0233] In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0234] In some embodiments, in response to the second creation instruction of the musculoskeletal structure of the biological model, generating the musculoskeletal structure of the biological model on the basic skeleton based on the target position includes:

[0235] In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton;

[0236] determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton;

[0237] Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

[0238] In some embodiments, the method further comprises:

[0239] Obtaining the view orientation of the base skeleton;

[0240] From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

[0241] In some embodiments, the binding relationship includes a motion constraint relationship between the musculoskeletal structure and the base skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0242] According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0243] In some embodiments, obtaining the binding relationship between the musculoskeletal structure and the basic skeleton includes:

[0244] Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

[0245] In some embodiments, the musculoskeletal structure is located at a joint of the base skeleton, and the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the base skeleton;

[0246] The step of binding the musculoskeletal structure and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0247] According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0248] In some embodiments, the motion constraint relationship includes a compression-stretch deformation relationship between the musculoskeletal structure and the underlying skeleton;

[0249] The step of binding the musculoskeletal structure and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0250] According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0251] In some embodiments, binding the musculoskeletal structure to the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0252] obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure;

[0253] Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton;

[0254] The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

[0255] In some embodiments, the binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0256] According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0257] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0258] Optional, such as Figure 8 As shown, the electronic device 800 further includes: a touch screen 803, a radio frequency circuit 804, an audio circuit 805, an input unit 806, and a power supply 807. Among them, the processor 801 is electrically connected to the touch screen 803, the radio frequency circuit 804, the audio circuit 805, the input unit 806, and the power supply 807 respectively. Those skilled in the art will understand that Figure 8 The electronic device structure shown in the figure does not constitute a limitation to the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0259] The touch display screen 803 can be used for displaying a graphical user interface and receiving an operation instruction generated by the user acting on the graphical user interface. The touch display screen 803 can include a display panel and a touch panel. Among them, the display panel can be used for displaying information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light emitting diode (OLED, Organic Light-Emitting Diode) or the like. The touch panel can be used for collecting the user's touch operation on or near it (such as the user uses any suitable object or accessory such as a finger, a stylus on the touch panel or near the touch panel) and generates corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 801, and can receive the command sent by the processor 801 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 801 to determine the type of touch event, and then the processor 801 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 803 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 803 can also be used as part of the input unit 806 to realize the input function.

[0260] The radio frequency circuit 804 may be used to transmit and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to transmit and receive signals with the network device or other electronic devices.

[0261] The audio circuit 805 can be used to provide an audio interface between the user and the electronic device through a speaker and microphone. The audio circuit 805 can convert the received audio data into an electrical signal and transmit it to the speaker, which then converts it into a sound signal for output. On the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 805 and converted into audio data. The audio data is then output to the processor 801 for processing, and then sent to another electronic device through the radio frequency circuit 804, or the audio data is output to the memory 802 for further processing. The audio circuit 805 may also include an earphone jack to provide communication between external headphones and the electronic device.

[0262] The input unit 806 may be configured to receive input digital, character information, or user feature information (such as fingerprint, iris, or facial information), and to generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control.

[0263] Power supply 807 is used to supply power to various components of electronic device 800. Optionally, power supply 807 can be logically connected to processor 801 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. Power supply 807 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0264] although Figure 8 Not shown in the figure, the electronic device 800 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0265] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0266] As can be seen from the above, the electronic device provided by this embodiment can obtain the basic skeleton of the organism model; generate the musculoskeletal system of the organism model on the basic skeleton; obtain the binding relationship between the musculoskeletal system and the basic skeleton; bind the musculoskeletal system according to the binding relationship to obtain the target skeleton of the organism model. The electronic device provided by this embodiment generates the musculoskeletal system on the basic skeleton of the organism model. On the one hand, the deformation of the basic skeleton can be used to simulate the basic movement of the organism model; on the other hand, the musculoskeletal system and the basic skeleton are bound based on the binding relationship between the two, such as the link relationship, the motion constraint relationship, etc. Therefore, when the basic skeleton of the organism model moves, the musculoskeletal system can undergo corresponding model deformation along with the movement of the basic skeleton. Therefore, the musculoskeletal system can be used to simulate the deformation of muscles and the like that occurs along with the basic movement of the organism model, thereby simulating more delicate deformation details of the organism's muscles and the like, thereby improving the expressiveness of the real deformation details brought about by movements such as twisting of the organism model.

[0267] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0268] To this end, an embodiment of the present application provides a computer-readable storage medium storing a plurality of computer programs, which can be loaded by a processor to execute the steps of any of the skeletal binding methods provided in the embodiments of the present application. For example, the computer program can execute the following steps:

[0269] Obtain the basic skeleton of the organism model;

[0270] generating the musculoskeletal structure of the organism model on the basic skeleton;

[0271] Obtaining a binding relationship between the musculoskeletal structure and the basic skeleton;

[0272] The muscles and skeleton are bound according to the binding relationship to obtain the target skeleton of the organism model.

[0273] In some embodiments, generating the musculoskeletal structure of the organism model on the basic skeleton includes:

[0274] In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton;

[0275] In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

[0276] In some embodiments, in response to a first creation instruction for the root node position of the musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base bone based on a first preset positional relationship between the base bone and the root node of the musculoskeletal structure and the position of the base bone includes:

[0277] In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton;

[0278] In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

[0279] In some embodiments, in response to the second creation instruction of the musculoskeletal structure of the biological model, generating the musculoskeletal structure of the biological model on the basic skeleton based on the target position includes:

[0280] In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton;

[0281] determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton;

[0282] Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

[0283] In some embodiments, the method further comprises:

[0284] Obtaining the view orientation of the base skeleton;

[0285] From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

[0286] In some embodiments, the binding relationship includes a motion constraint relationship between the musculoskeletal structure and the base skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0287] According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0288] In some embodiments, obtaining the binding relationship between the musculoskeletal structure and the basic skeleton includes:

[0289] Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

[0290] In some embodiments, the musculoskeletal structure is located at a joint of the base skeleton, and the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the base skeleton;

[0291] The step of binding the musculoskeletal structure and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0292] According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0293] In some embodiments, the motion constraint relationship includes a compression-stretch deformation relationship between the musculoskeletal structure and the underlying skeleton;

[0294] The step of binding the musculoskeletal structure and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0295] According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0296] In some embodiments, binding the musculoskeletal structure to the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes:

[0297] obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure;

[0298] Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton;

[0299] The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

[0300] In some embodiments, the binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton, and binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes:

[0301] According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

[0302] It can be seen that the computer program can be loaded by the processor to execute the steps of any one of the skeletal binding methods provided in the embodiments of the present application, thereby bringing about the following technical effects: by generating musculoskeletons on the basic skeleton of the organism model, on the one hand, the deformation of the basic skeleton can be used to simulate the basic movement of the organism model; on the other hand, since the musculoskeletons and the basic skeleton are bound based on binding relationships such as link relationships and motion constraint relationships between the two, when the basic skeleton of the organism model moves, the musculoskeletons can undergo corresponding model deformation along with the movement of the basic skeleton. Therefore, the musculoskeletons can be used to simulate deformations such as muscles that occur along with the basic movement of the organism model, thereby simulating more delicate deformation details of the organism such as muscles, thereby improving the expressiveness of the real deformation details brought about by movements such as twisting of the organism model.

[0303] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0304] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0305] Since the computer program stored in the computer-readable storage medium can execute the steps in any one of the skeletal binding methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the skeletal binding methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0306] The above is a detailed introduction to a skeletal binding method, device, electronic device and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core ideas. At the same time, for those skilled in the art, according to the ideas of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present application.

Claims

1. A skeleton binding method, characterized in that: include: Obtain the basic skeleton of the organism model; generating the musculoskeletal structure of the organism model on the basic skeleton; Obtaining a binding relationship between the musculoskeletal structure and the basic skeleton; Binding the muscles and skeleton according to the binding relationship to obtain a target skeleton of the organism model; Wherein, generating the musculoskeletal system of the organism model on the basic skeleton includes: In response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determining a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton; In response to a second creation instruction for the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is automatically generated on the basic skeleton based on the target position.

2. The skeleton binding method according to claim 1, wherein: The step of determining, in response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton, comprises: In response to the first creation instruction, determining an initial position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure, and the position of the base skeleton; In response to the initial position adjustment instruction, the root node position is adjusted from the initial position to a designated position corresponding to the adjustment instruction as the target position of the musculoskeletal root node.

3. The skeleton binding method according to claim 1, wherein: The step of generating the musculoskeletal structure of the biological model on the basic skeleton in response to the second instruction for creating the musculoskeletal structure of the biological model based on the target position comprises: In response to the second creation instruction, obtaining a size relationship between the basic skeleton and the musculoskeletal skeleton; determining a size of the musculoskeletal structure based on the size relationship and a size of the underlying skeleton; Based on the target position and the size of the musculoskeletal structure, the musculoskeletal structure of the biological model is generated on the basic skeleton.

4. The skeleton binding method according to claim 1, wherein: The method further comprises: Obtaining the view orientation of the base skeleton; From the preset orientation position relationships, an orientation position relationship that matches the view orientation of the basic skeleton is obtained as a first preset position relationship between the basic skeleton and the root node of the musculoskeletal structure.

5. The skeleton binding method according to claim 1, wherein: The binding relationship includes a motion constraint relationship between the musculoskeletal structure and the basic skeleton. Binding the musculoskeletal structure according to the binding relationship to obtain a target skeleton of the organism model includes: According to the motion constraint relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

6. The skeleton binding method according to claim 5, wherein: The obtaining of the binding relationship between the musculoskeletal structure and the basic skeleton includes: Based on the preset spring motion property coefficient, a motion constraint relationship between the musculoskeletal system and the basic skeleton is constructed.

7. The skeleton binding method according to claim 5, wherein: The musculoskeletal structure is located at a joint point of the basic skeleton, and the motion constraint relationship includes a rotational deformation relationship between the musculoskeletal structure and the basic skeleton; Binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes: According to the rotational deformation relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

8. The skeleton binding method according to claim 5, wherein: The motion constraint relationship includes an extrusion-stretching deformation relationship between the musculoskeletal structure and the basic skeleton; Binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes: According to the compression-stretching deformation relationship, the musculoskeletal system is bound to the basic skeleton to obtain the target skeleton of the organism model.

9. The skeleton binding method according to claim 5, wherein: Binding the musculoskeletal system and the basic skeleton according to the motion constraint relationship to obtain the target skeleton of the organism model includes: obtaining a second preset positional relationship between the basic skeleton and the controller point of the musculoskeletal structure; Determining the position of the controller point of the musculoskeletal system on the basic skeleton according to the second preset positional relationship and the position of the basic skeleton; The musculoskeletal system is bound to the basic skeleton according to the motion constraint relationship and the position of the controller point to obtain the target skeleton of the organism model.

10. The skeleton binding method according to any one of claims 1 to 9, characterized in that: The binding relationship includes a link relationship between the musculoskeletal structure and the basic skeleton. Binding the musculoskeletal structure according to the binding relationship to obtain the target skeleton of the organism model includes: According to the link relationship, the musculoskeletal structure is bound to the basic skeleton to obtain the target skeleton of the organism model.

11. A skeleton binding device, characterized in that: include: A first acquisition unit is used to acquire a basic skeleton of the organism model; A generating unit, configured to generate the musculoskeletal system of the organism model based on the basic skeleton; A second acquiring unit, configured to acquire a binding relationship between the musculoskeletal structure and the basic skeleton; a binding unit, configured to bind the muscles and skeleton according to the binding relationship to obtain a target skeleton of the organism model; The generating unit is further configured to, in response to a first creation instruction for a root node position of a musculoskeletal structure of the organism model, determine a target position of the root node of the musculoskeletal structure on the base skeleton based on a first preset positional relationship between the base skeleton and the root node of the musculoskeletal structure and the position of the base skeleton; In response to a second creation instruction of the musculoskeletal system of the biological model, the musculoskeletal system of the biological model is generated on the basic skeleton based on the target position.

12. An electronic device, characterized in that: The system comprises a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the skeleton binding method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the skeletal binding method according to any one of claims 1 to 10.

Images