Local editing-based model maintenance method, device, product and electronic equipment

Abstract

The present disclosure provides a local editing-based model maintenance method, device, product and electronic equipment. The method comprises: obtaining asset data to be maintained and local editing information when a target model is locally edited; generating a joint constraint graph of the target model according to the asset data to be maintained and a skeleton specification corresponding to the target model; the joint constraint graph is used to represent a constraint relationship between a component node, a joint node and a skeleton specification node; determining a local maintenance range according to the local editing information and the joint constraint graph; performing local skeleton and local binding consistency maintenance within the local maintenance range based on the joint constraint graph to obtain updated local skeleton and local binding; and outputting maintained asset data of the target model after local editing based on the updated local skeleton and local binding. The present disclosure realizes efficient maintenance of skeleton and binding consistency when a model is locally edited by constructing a joint constraint graph.

Description

Technical Field

[0001] This disclosure relates to the field of model making technology, and in particular to a model maintenance method, apparatus, product and electronic device based on local editing. Background Technology

[0002] Increasingly, 3D model assets are no longer monolithic, indivisible meshes, but rather composite assets with component structures, supporting local control and capable of repeated editing. However, when locally editing such assets, their original skeleton hierarchy, joint assignments, binding influence domains, and boundary transitions are often disrupted, potentially leading to problems such as animation interleaving, misalignment, or local distortion. Rebinding the entire model asset to avoid these issues introduces significant efficiency losses. Therefore, how to efficiently maintain the consistency of the skeleton and bindings during local model editing has become a pressing problem.

[0003] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] This disclosure provides a model maintenance method, a model maintenance device, a computer program product, and an electronic device based on local editing, to at least partially solve the problems of large asset maintenance losses caused by local model editing in related technologies.

[0005] According to a first aspect of this disclosure, a model maintenance method based on local editing is provided. The method includes: acquiring asset data to be maintained and local editing information of a target model during local editing; generating a joint constraint graph of the target model based on the asset data to be maintained and the skeleton specification corresponding to the target model; the joint constraint graph being used to characterize the constraint relationships between component nodes, joint nodes, and skeleton specification nodes; determining a local maintenance scope based on the local editing information and the joint constraint graph; performing local skeleton and local binding consistency maintenance within the local maintenance scope based on the joint constraint graph to obtain an updated local skeleton and local binding; and outputting the maintained asset data of the target model after local editing based on the updated local skeleton and local binding.

[0006] According to a second aspect of this disclosure, a model maintenance apparatus based on local editing is provided. The apparatus includes: an asset acquisition module, configured to acquire asset data to be maintained and local editing information of a target model during local editing; a constraint construction module, configured to generate a joint constraint diagram of the target model based on the asset data to be maintained and the skeleton specification corresponding to the target model; the joint constraint diagram is used to characterize the constraint relationships between component nodes, joint nodes, and skeleton specification nodes; a range determination module, configured to determine the local maintenance range based on the local editing information and the joint constraint diagram; an update maintenance module, configured to perform local skeleton and local binding consistency maintenance within the local maintenance range based on the joint constraint diagram, to obtain an updated local skeleton and local binding; and an asset output module, configured to output the maintained asset data of the target model after local editing based on the updated local skeleton and local binding.

[0007] According to a third aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the model maintenance method based on local editing described in the first aspect and possible implementations thereof.

[0008] According to a fourth aspect of this disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the model maintenance method based on local editing of the first aspect and possible implementations thereof by executing the executable instructions.

[0009] The technical solution disclosed herein has the following beneficial effects: In the aforementioned model maintenance process based on local editing, the following steps are taken: First, the asset data to be maintained and the local editing information of the target model during local editing are acquired. Second, a joint constraint graph of the target model is generated based on the asset data to be maintained and the corresponding skeleton specification of the target model. Third, the joint constraint graph represents the constraint relationships between component nodes, joint nodes, and skeleton specification nodes. Fourth, the local maintenance scope is determined based on the local editing information and the joint constraint graph. Fifth, local skeleton and local binding consistency maintenance is performed within the local maintenance scope based on the joint constraint graph, resulting in updated local skeleton and local binding. Finally, based on the updated local skeleton and local binding, the maintained asset data of the target model after local editing is output. This disclosure constructs a joint constraint graph based on the asset data to be maintained and the corresponding skeleton specification data of the target model during local editing. This allows for precise location of the local scope that needs maintenance during model local editing, avoiding unnecessary global maintenance and achieving efficient maintenance of skeleton and binding consistency during model local editing. This not only improves the continuous editability of model assets but also ensures that the target model remains animable after local editing. Attached Figure Description

[0010] Figure 1 A flowchart illustrating a model maintenance method based on local editing in this exemplary embodiment is shown. Figure 2 A flowchart illustrating a joint constraint graph for generating a target model in this exemplary embodiment is shown. Figure 3 A flowchart illustrating a method for determining the local maintenance scope of a target model in this exemplary embodiment is shown. Figure 4 This illustrates a flowchart of a local skeleton and local binding consistency maintenance in this exemplary embodiment; Figure 5 A structural block diagram of a model maintenance device based on local editing is shown in this exemplary embodiment; Figure 6 An electronic device for implementing the above-described model maintenance method based on local editing is shown in this exemplary embodiment. Detailed Implementation

[0011] Exemplary embodiments of this disclosure will be described more fully below with reference to the accompanying drawings.

[0012] The accompanying drawings are schematic illustrations of this disclosure and are not necessarily drawn to scale. Some block diagrams shown in the drawings may be functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in hardware modules or integrated circuits, or in networks, processors, or microcontrollers. Implementations can be carried out in various forms and should not be construed as limited to the examples set forth herein. The features, structures, or characteristics described in this disclosure can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough description of embodiments of this disclosure. However, those skilled in the art will recognize that one or more specific details may be omitted when implementing the technical solutions of this disclosure, or other methods, components, apparatuses, steps, etc., may be used to replace one or more specific details.

[0013] Exemplary embodiments of this disclosure provide a model maintenance method based on local editing, a model maintenance apparatus based on local editing, a computer program product, and an electronic device.

[0014] In one alternative implementation, refer to Figure 1 The flowchart shown illustrates a model maintenance method based on local editing, specifically including the following steps S110 to S150: Step S110: Obtain the asset data to be maintained and the local editing information when the target model is partially edited; Step S120: Based on the asset data to be maintained and the skeleton specification corresponding to the target model, generate a joint constraint diagram of the target model; the joint constraint diagram is used to characterize the constraint relationships between component nodes, joint nodes and skeleton specification nodes. Step S130: Determine the local maintenance scope based on the local editing information and the joint constraint diagram; Step S140: Based on the joint constraint graph, perform consistency maintenance of the local skeleton and local bindings within the local maintenance scope to obtain the updated local skeleton and local bindings; Step S150: Based on the updated local skeleton and local binding, output the maintained asset data of the target model after local editing.

[0015] Figure 1 The method shown constructs a joint constraint graph based on the asset data to be maintained and the corresponding skeleton specification data when the target model is partially edited. This can accurately locate the local range that needs to be maintained when the model is partially edited, avoid unnecessary global maintenance, and achieve efficient maintenance of the skeleton and binding consistency when the model is partially edited. This not only improves the continuous editability of the model assets, but also allows the target model to still maintain its animability after partial editing.

[0016] The following is about Figure 1 Each step in the process will be explained in detail.

[0017] In step S110, the asset data to be maintained and the local editing information are obtained when the target model is partially edited.

[0018] The target model can be a 3D model object that requires local editing and consistent maintenance. This target model is not a single, indivisible monolithic mesh, but rather a composite 3D model composed of multiple model parts. Each model part can possess structured information that can be individually identified and manipulated, thereby supporting local editing and maintenance of the target model.

[0019] Taking the target model as a humanoid mecha character as an example, its model parts include, but are not limited to, the torso, shoulder armor, upper arm guards, forearm guards, and hand accessories.

[0020] Taking the target model as a mechanical quadruped character as an example, its model parts include, but are not limited to, the main tail chain, the tail side wing plates, and the tail tip stabilizer.

[0021] The asset data to be maintained refers to the asset data required for local editing and maintenance of the target model. Optionally, the asset data to be maintained may include: asset data with an explicit component tree and / or asset data used to infer component structures, which can provide the necessary data foundation for subsequent construction of joint constraint diagrams.

[0022] Asset data with an explicit component tree can contain hierarchical component structure information. For example, the asset data predefines the root component, child components, and their parent-child relationships, forming a complete component hierarchy tree. For instance, an explicit component tree for a character model might have "body" as the root component, "arms," ​​"legs," and "head" as first-level child components, and "hands" and "fingers" as next-level child components of "arms."

[0023] The asset data used to infer component structures does not directly provide a complete component hierarchy tree, but it carries auxiliary information that can infer the component structure of the model. This information may include one or more of the following: component masks, component segmentation results, component generation metadata, and assembly relationships between components. By analyzing and processing this auxiliary information, the component structure of the target model can be inferred, providing the necessary component node information for the subsequent construction of a unified constraint graph.

[0024] Among them, component masks and component segmentation results can be used to identify local geometric regions, component boundaries, and semantic regions of the model.

[0025] Among them, the component generation metadata can be used to supplement information such as component name, category, generation level, semantic prompt words, component identifier, left and right side attributes or generation order, so as to help determine which semantic component a certain geometric region should belong to.

[0026] Among them, the assembly relationship between components can be used to determine the parent-child relationship, adjacency relationship, connection relationship or dependency relationship between components. For example, shoulder armor is attached to the shoulder area, and forearm guards are adjacent to the wrist boundary.

[0027] In one optional embodiment of this disclosure, component nodes and their geometric boundaries can be determined based on component masks or component segmentation results, component semantics, hierarchy, or identification information can be determined based on component generated metadata, and the adjacency, dependency, or parent-child relationships between components can be determined based on the assembly relationships between components, thereby forming a component structure diagram of the target model.

[0028] The local editing information describes the current editing operation and provides a necessary basis for determining the scope of subsequent maintenance. It may include one or more of the following: the edited component identifier, the editing type, the editing area, the replacement source of the edited component, and the regeneration command for the edited component.

[0029] The edit component identifier uniquely indicates the target component for this editing operation. For example, the edit component identifier can be the component name, component number, or the component's path in the hierarchy tree, thereby accurately locating the component object being edited.

[0030] The "Edit Type" describes the specific operation category of this editing action. For example, the Edit Type may include component deletion, replacement, deformation, regeneration, or parameter adjustment.

[0031] The editing area is used to define the spatial scope involved in this editing operation.

[0032] The "Replacement Source for Edited Components" option is used in edit operations of the component replacement type to specify the new component asset or its data source for replacement.

[0033] The component regeneration command is used to carry the parameters or rules required to regenerate the component in the component regeneration type editing operation.

[0034] In step S120, a joint constraint diagram of the target model is generated based on the asset data to be maintained and the skeleton specification corresponding to the target model. The joint constraint diagram is used to characterize the constraint relationship between component nodes, joint nodes and skeleton specification nodes.

[0035] Among them, the skeleton specification refers to the specification information used to guide and constrain the skeleton structure of the target model. The skeleton specification can define the skeleton hierarchy, joint configuration, and bone topology that the model should follow after editing and maintenance, and is an important constraint basis for constructing the joint constraint diagram.

[0036] Taking a humanoid mecha character as an example, its corresponding skeleton specification can be a standard humanoid skeleton specification; taking a mechanical quadruped character as an example, its corresponding skeleton specification can be a non-humanoid customized skeleton specification. This disclosure does not impose specific limitations on this.

[0037] The joint constraint graph integrates the originally scattered component information, joint information, and skeleton specification information of the target model into a unified graph data structure. Through the joint constraint graph, various structural information can be compressed into a single, maintainable object, thereby enabling a centralized representation of the constraint relationships between component nodes, joint nodes, and skeleton specification nodes.

[0038] Because editing local components of a model not only affects the local geometry itself, but also the joints to which the component belongs, adjacent bone segments, binding influence domains, and boundary transitions with unedited regions, a joint constraint graph can ensure that the maintenance scope is neither too large nor misses key interconnected areas.

[0039] In one alternative implementation, such as Figure 2 As shown, the joint constraint diagram of the target model, generated based on the asset data to be maintained and the skeleton specification corresponding to the target model, can be achieved through the following steps: Step S210: Based on the asset data to be maintained and the skeleton specification corresponding to the target model, determine the component node set, joint node set, skeleton specification node set, and the constraint relationship between nodes of the target model. Step S220: Generate a joint constraint diagram of the target model based on the set of component nodes, the set of joint nodes, the set of skeleton specification nodes, and the constraint relationships between nodes of the target model.

[0040] Optionally, the constraint relationships between nodes may include one or more of the following: assembly relationships between component nodes, attribution relationships between component nodes and joint nodes, correspondence relationships between joint nodes and skeleton specification nodes, binding influence domains, and boundary continuity relationships.

[0041] Specifically, the nodes in the joint constraint diagram can include component nodes, joint nodes, and skeleton specification nodes; the edges in the diagram are used to represent various constraint relationships between nodes, such as the assembly relationship between component nodes, the attribution relationship between component nodes and joint nodes, the correspondence relationship between joint nodes and skeleton specification nodes, the binding influence domain, and the boundary continuity relationship.

[0042] Among them, the assembly relationship between component nodes refers to the relationship describing how different component nodes are connected, their relative positions, and what spatial constraints exist.

[0043] Among them, the attribution relationship between component nodes and joint nodes refers to the relationship that a certain component node is controlled by which one or more joint nodes, that is, the subordinate binding relationship of the component under the skeleton drive.

[0044] The correspondence between joint nodes and skeleton specification nodes refers to describing which skeleton specification node in the skeleton specification of the target model the joint node is mapped to.

[0045] Among them, the binding influence domain is a cross-node influence range constraint relationship. It connects the source node and the affected node, and constrains the boundary of the skinning weight effect of the former on the latter.

[0046] Among them, boundary continuity relationship is a constraint relationship between adjacent nodes that requires maintaining geometric continuity and skin deformation continuity at the boundary.

[0047] By representing the assembly relationships between component nodes, the affiliation relationships between component nodes and joint nodes, the correspondence relationships between joint nodes and skeleton specification nodes, the binding influence domain, and the boundary continuity relationships in the same diagram, when a local component is replaced, enhanced, deleted, or regenerated, the part of the structure that is truly affected can be found without having to rebind the entire model.

[0048] For example, a joint constraint graph can be constructed: Where P represents the set of component nodes, J represents the set of joint nodes, and S represents the set of skeleton specification nodes; This indicates the assembly relationship between component nodes. This indicates the affiliation relationship between component nodes and joint nodes. This indicates the correspondence between joint nodes and skeleton specification nodes. This indicates a binding influence domain or boundary continuity relationship.

[0049] By constructing a joint constraint graph, the structural composition and internal relationships of the target model can be fully described within a unified graph framework, providing a structured basis for determining the scope of subsequent local maintenance and maintaining local consistency. Compared to the decentralized approach of maintaining component levels, joint configurations, and skeleton specifications separately, the joint constraint graph improves maintenance efficiency in local editing scenarios.

[0050] In step S130, the local maintenance scope is determined based on the local editing information and the joint constraint diagram.

[0051] The local maintenance scope refers to the spatial and structural range that requires skeleton updates and binding consistency maintenance after local editing of the target model. This local maintenance scope does not cover the entire target model, but rather the area directly or indirectly related to the editing operation, thus avoiding unnecessary calculations and processing on unaffected parts of the model.

[0052] Optionally, the scope of local maintenance may include the component sub-graphs, skeletal sub-graphs, and editing boundary transition areas affected by the editing. The component sub-graphs affected by the editing may include a set of component nodes consisting of the edited component and its adjacent components associated with it through assembly relationships; the skeletal sub-graph affected by the editing may include a set of skeletal nodes consisting of joint nodes that have a binding relationship with the edited component and their upstream and downstream skeletal nodes associated with it in the skeleton hierarchy; the editing boundary transition area is the boundary area between the edited area and the unedited area.

[0053] In one alternative implementation, the determination of the local maintenance scope of the target model based on local editing information and joint constraint graph can be achieved through the following steps: determining the set of editable components based on local editing information; using the set of editable components as seeds, performing editing influence propagation processing in the joint constraint graph to determine the local maintenance scope of the target model.

[0054] For example, if the local editing information contains an editing component identifier, an editing component set can be formed directly based on the editing component identifier.

[0055] For example, if the local editing information includes an editing region, the spatial range of the editing region can be compared with the component structure of the target model, and the component nodes located in or intersecting with the region can be identified as the editing components.

[0056] For example, if the local editing information contains a component mask, the corresponding component node can be found through the relevant mask and used as the editing component.

[0057] For example, if the local editing information contains a replacement source for the edited component, the target component to be replaced can be determined by the semantic category, anchor point position, or assembly constraints carried in the replacement source, and then used as the edited component.

[0058] Once the set of editable components is determined, the set of editable components can be used as a seed to perform the editing effect propagation process in the joint constraint diagram, so as to accurately locate the local maintenance scope of the target model.

[0059] For example, if the local editing information includes an editing type, the rules for the propagation of editing effects can be determined based on the editing type, thereby more accurately controlling the scope of the propagation of editing effects and subsequent maintenance strategies. Different editing types correspond to different impact propagation rules: When the editing type is "replace," the anchor point alignment between the replaced component and adjacent components needs to be rechecked, as well as whether the adjacent bone segments bound to the component are compatible with the new component. In this case, the editing impact propagation process can cover the assembly relationship adjacent nodes and belonging joint nodes of the replaced component. When the editing type is "delete," the original assembly connection relationship between the deleted component and adjacent components will be destroyed. In this case, the editing impact propagation process can cover all adjacent component nodes that have a direct assembly connection or dependency relationship with the deleted component. When the editing type is "local deformation," the editing operation only changes the geometry of the component without changing the component structure itself. In this case, the editing impact propagation process can cover the binding influence domain of the editing area and the boundary transition area between the editing area and the unedited area. When the editing type is "regenerate," the component will be regenerated, and its geometry, semantic information, and joint affiliation may all change. In this case, the editing impact propagation process can fully cover the assembly adjacent nodes, belonging joint nodes, and corresponding skeleton specification nodes of the component.

[0060] For example, if the local editing information includes an editing area, the editing area can be used to define the spatial range and boundary range in order to distinguish the editing area, transition area and frozen area, and avoid the maintenance range being too large or too small.

[0061] For example, if the local editing information includes a replacement source, the replacement source can be used to provide the geometry, semantic category, scale pose, anchor point or assembly constraints of the new part, so as to determine the correspondence between the new part nodes and the original part nodes, the correspondence between the joint nodes to which the new part belongs and the skeleton specification nodes.

[0062] For example, if the local editing information contains a regeneration instruction, the regeneration instruction can be used to provide generation semantics, target shape or local structural requirements, so as to determine whether the regenerated part still corresponds to the original part node, and whether it is necessary to update the part boundary, joint affiliation or binding influence domain, etc.

[0063] In one alternative implementation, such as Figure 3 As shown, the above method, using the set of editable components as seeds, performs edit impact propagation processing in the joint constraint graph to determine the local maintenance scope of the target model. This can be achieved through the following steps: Step S310: Using the set of edited components as seeds, perform closure operations in the joint constraint graph to obtain the component subgraph and skeleton subgraph affected by the editing. Step S320: Using the set of editable parts as seeds, perform cross-boundary constraint propagation processing based on the joint constraint graph to obtain the editable boundary transition region; Step S330: Based on the component subgraphs and skeleton subgraphs affected by the editing, as well as the transition area of ​​the editing boundary, the local maintenance range of the target model is obtained.

[0064] The closure operation refers to starting from the seed node and expanding layer by layer along various constraint edges in the joint constraint graph until all nodes that are directly or indirectly related to the editing operation are covered, forming a set of affected nodes of a closure.

[0065] Optionally, during the closure operation, the edit component identifier in the local edit information can be used to determine the seed node; the edit type can be used to determine the influence propagation rules; the edit region can be used to define the spatial boundary; and the replacement source or regeneration instruction can be used to determine the correspondence between the new component node and the original component node, the correspondence between the joint node to which the new component belongs and the skeleton specification node, etc.

[0066] For example, it can be calculated This yields the subgraph H affected by the editing. The subgraph H affected by the editing can include component subgraphs and skeleton subgraphs. Closure() is a closure operation. Represents a collection of editable components. This indicates the assembly relationship between component nodes. This indicates the affiliation relationship between component nodes and joint nodes. This indicates the correspondence between joint nodes and skeleton specification nodes. This indicates a binding influence domain or boundary continuity relationship.

[0067] For example, taking a humanoid mecha character as the target model, when a user replaces or edits the forearm armor component of the target model, the component node corresponding to the forearm armor is used as the seed, and the process can be extended along the assembly relationship edges between component nodes to the hand and upper arm components adjacent to the armor, incorporating them into the affected component subgraph; the process can also be located to the forearm joint along the affiliation relationship between component nodes and joint nodes, and extended along the skeleton level to the parent elbow joint and the child wrist joint, incorporating them into the affected skeleton subgraph. When a user replaces or edits the right shoulder armor component of the target model, the component node corresponding to the right shoulder armor component is used as the seed, and the process can be extended along the assembly relationship edges between component nodes to the right upper arm component and torso component, incorporating them into the affected component subgraph; the process can also be located to the right shoulder joint along the affiliation relationship between component nodes and joint nodes, and extended along the skeleton level to the parent clavicle joint and the child right upper arm joint, incorporating them into the affected skeleton subgraph.

[0068] For example, taking a mechanical quadruped character as the target model, when the tail side wing is partially regenerated due to art requirements, the regenerated part can be used as a seed to include the adjacent tail main chain and tail tip stabilizer into the affected part subgraph, and the affected tail skeleton subgraph can be identified.

[0069] Cross-boundary constraint propagation refers to the process of propagating constraints from the set of edited components to the unedited regions adjacent to the edited region along the boundary continuity relationship in the joint constraint graph.

[0070] Using the set of editable components as seeds, cross-boundary constraint propagation processing is performed based on the joint constraint graph to obtain the transition region of the editable boundary.

[0071] For example, taking a humanoid mecha character as the target model, when a user replaces and edits the forearm guard part of the target model, the seam area between the forearm guard part and the hand part, and the seam area between the forearm guard part and the upper arm part can be found along the binding influence domain and / or boundary continuity relationship, that is, the editing boundary transition area.

[0072] For example, taking a mechanical quadruped character as the target model, when the tail wing is partially regenerated due to art requirements, the regenerated tail wing component can be used as a seed to determine the transition area of ​​the editing boundary along the binding influence domain and / or boundary continuity relationship.

[0073] By identifying the component sub-graphs and skeletal sub-graphs affected by editing, as well as the transition areas of the editing boundaries, precise boundary criteria can be provided for determining the scope of subsequent local maintenance and for maintenance operations.

[0074] After determining the scope of local maintenance, step S140 can be executed.

[0075] In step S140, based on the joint constraint graph, local skeleton and local binding consistency maintenance is performed within the local maintenance scope to obtain the updated local skeleton and local binding.

[0076] Local skeleton and local binding consistency maintenance refers to the process of adjusting and optimizing the skeleton and binding relationships affected by editing operations within a defined local maintenance scope. Optionally, consistency maintenance may include at least one of the following: local joint position update, local bone segment assignment adjustment, local weight reallocation, and boundary smooth transition.

[0077] For example, taking a humanoid mecha character as the target model, if the scope of local maintenance is determined to include: affected component sub-images, such as forearm guard parts, hand parts, and upper arm parts; affected skeletal sub-images, such as forearm joints, elbow joints, and wrist joints; and editing boundary transition areas, such as the seam area between the forearm guard parts and the hand, and the seam area between the forearm guard parts and the upper arm, consistent maintenance can be performed within this scope of local maintenance.

[0078] For example, taking a mechanical quadruped character as the target model, if it is determined that the local maintenance scope does not include the head, torso, and limbs, then the skeletal structure of the head, torso, and limbs will not be changed.

[0079] It is understandable that when local parts of the model are replaced, detailed, or deleted, this disclosure can automatically identify the affected area and maintain consistency locally to avoid potential problems such as abnormal local stretching, stiff boundary transitions, or local following distortion. In this process, only the structural area disturbed by the editing operation needs to be processed, and there is no need to redo the entire automatic binding process every time a local edit is performed. This can effectively reduce the workload of manual bone-by-bone trimming and local re-refreshing of weights.

[0080] In one alternative implementation, such as Figure 4 As shown, the above-mentioned local skeleton and local binding consistency maintenance, based on the joint constraint graph, is performed within the local maintenance scope to obtain the updated local skeleton and local binding. This can be achieved through the following steps: Step S410: Based on the joint constraint diagram, determine the joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints; Step S420: Using the local skeleton and local binding within the local maintenance scope as variables, construct the target constraint function based on joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints; Step S430: With minimizing the objective constraint function as the maintenance objective, determine the updated local skeleton and local binding.

[0081] Specifically, joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints can be extracted from the joint constraint graph. Joint attribution constraints constrain the attribution relationship between component nodes and joint nodes; skeleton specification constraints constrain the correspondence between joint nodes and skeleton specification nodes in the affected bone subgraph; boundary continuity constraints constrain the geometric and deformation continuity between the edited and unedited regions at the boundary; and local binding constraints constrain the skinning weight distribution of the edited component and its adjacent regions.

[0082] For example, based on the joint constraint graph, an objective constraint function can be constructed with the goal of minimizing the function value as the maintenance objective: .in, Represents local skeleton variables within the scope of local maintenance; This represents a locally bound variable within the scope of local maintenance. Indicates the component joint attribution constraint; Indicates skeleton specification constraints; Indicates boundary continuity constraints; This represents a local binding constraint. , , , These are constraint coefficients, used to control the influence of joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints, respectively.

[0083] By constructing objective constraint functions, the maintenance of local skeleton and local binding consistency is transformed into an optimization problem under multiple constraints, thereby generating updated results that satisfy structural rationality and deformation continuity within the scope of local maintenance.

[0084] After determining the updated local skeleton and local binding, step S150 can be executed.

[0085] In step S150, based on the updated local skeleton and local binding, the maintained asset data after local editing of the target model is output.

[0086] For example, the updated local skeleton and local bindings can be written back to the asset data of the target model to obtain the maintained asset data after local editing of the target model. The output maintained asset data can be a structured asset package, which may include at least one of the updated component anchors, skeleton instances, and local binding maintenance results, and may also include information related to this editing, information related to local maintenance, and compatibility tags for subsequent exports. This disclosure does not specifically limit this. Among them, the compatibility tags can be used to identify the compatibility status between the asset and downstream tools or processes, and may include identifiers such as format version, skeleton specification type, binding method, local maintenance status, or export target platform, so that downstream processes can correctly parse and use the asset. This disclosure does not specifically limit this.

[0087] Optionally, the output maintained asset data can be incorporated into the animation process or used as the asset data to be maintained in the next round of modifications.

[0088] For example, taking the target model as a humanoid mecha character, the output maintained asset data can be directly entered into the downstream animation production stage and applied to animation processes such as arm swinging, weapon holding, and sprinting, without the need for additional adjustments or reconstruction of the animation control chain, thus improving the overall efficiency of asset iteration and animation production.

[0089] For example, taking a mechanical quadruped character as the target model, its global skeleton specification can remain stable even during multiple rounds of local editing. In subsequent animation production, the tail swing animation and the following relationship of accessories when running can directly use the pre-set animation control chain, improving the efficiency of the connection between iterative editing and animation production of assets.

[0090] In 3D model production, model assets may require multiple rounds of modifications, and artists may repeatedly replace model parts. If a complete rebinding is required for each round of modifications, the production pace will be significantly slowed down. In one implementation, this disclosure can serve as a unified maintenance layer in the model asset editing chain: the upstream can come from AI generation, scan reconstruction, or digital content creation and editing, while the downstream can be from skeleton-driven animation, engine import, and export. In this way, model assets can simultaneously maintain "structural editability" and "animation usability" in local iterations. It should be noted that this disclosure does not require binding to specific generators, segmenters, or joint detectors. It can serve as a universal maintenance layer between upstream asset generation tools that can output asset generation tools with component structural information and downstream tools that perform binding, animation production, or export operations on the model, and has the ability to link multiple tools. This disclosure does not require a complete automatic binding to be redone for every local edit. Instead, it first identifies the affected scope, then maintains consistency in the local area, while keeping the global skeleton specification intact. The final output is a structured asset that can continue to be used in animation, export, and subsequent editing. Moreover, these assets can continue to be iterated locally after entering the animation pipeline, without repeatedly breaking the overall skeleton specification due to local edits, thus improving the continuous editability of model assets.

[0091] Exemplary embodiments of this disclosure also provide a model maintenance apparatus based on local editing, referencing Figure 5 As shown, the model maintenance device 500 based on local editing may include the following program modules: The asset acquisition module 510 is used to acquire the asset data to be maintained and the local editing information when the target model is partially edited. The constraint construction module 520 is used to generate a joint constraint diagram of the target model based on the asset data to be maintained and the skeleton specification corresponding to the target model; the joint constraint diagram is used to represent the constraint relationship between component nodes, joint nodes and skeleton specification nodes; The scope determination module 530 is used to determine the local maintenance scope based on local editing information and joint constraint diagram; The update maintenance module 540 is used to perform local skeleton and local binding consistency maintenance within the local maintenance scope based on the joint constraint diagram, so as to obtain the updated local skeleton and local binding. The asset output module 550 is used to output the maintained asset data after local editing of the target model based on the updated local skeleton and local binding.

[0092] In one alternative implementation, based on the aforementioned scheme, the asset data to be maintained includes: asset data with an explicit component tree and / or asset data used to infer component structure.

[0093] In one alternative implementation, asset data for inferring component structure based on the aforementioned scheme includes one or more of the following: component mask, component segmentation result, component generation metadata, and assembly relationship between components.

[0094] In one optional implementation, based on the aforementioned scheme, the local editing information includes one or more of the following: editing component identifier, editing type, editing area, replacement source of the editing component, and regeneration instruction of the editing component.

[0095] In an optional implementation, based on the aforementioned scheme, the constraint construction module 520 can be configured to: determine the component node set, joint node set, skeleton specification node set, and inter-node constraint relationships of the target model according to the asset data to be maintained and the skeleton specification corresponding to the target model; and generate a joint constraint diagram of the target model according to the component node set, joint node set, skeleton specification node set, and inter-node constraint relationships of the target model.

[0096] In one optional implementation, based on the aforementioned scheme, the constraint relationships between nodes include one or more of the following: assembly relationships between component nodes, attribution relationships between component nodes and joint nodes, correspondence relationships between joint nodes and skeleton specification nodes, binding influence domains, and boundary continuity relationships.

[0097] In an optional implementation, based on the aforementioned scheme, the scope determination module 530 includes: an editable component determination module, used to determine an editable component set based on local edit information; and an influence propagation processing module, used to perform edit influence propagation processing in the joint constraint graph using the editable component set as a seed, to determine the local maintenance scope of the target model.

[0098] In an optional implementation, based on the aforementioned scheme, the influence propagation processing module can be configured as follows: using the set of edited components as seeds, performing closure operations in the joint constraint graph to obtain the component subgraph and skeleton subgraph affected by editing; using the set of edited components as seeds, performing cross-boundary constraint propagation processing based on the joint constraint graph to obtain the editing boundary transition region; and obtaining the local maintenance range of the target model based on the component subgraph and skeleton subgraph affected by editing and the editing boundary transition region.

[0099] In an optional implementation, based on the aforementioned scheme, the update maintenance module 540 can be configured to: determine joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints based on the joint constraint graph; construct a target constraint function based on the joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints, using the local skeleton and local binding within the local maintenance scope as variables; and determine the updated local skeleton and local binding with minimizing the target constraint function as the maintenance objective.

[0100] The specific details of each part of the above-mentioned device have been described in detail in the method section of the implementation plan. For any undisclosed details, please refer to the implementation plan of the method section, and therefore will not be repeated here.

[0101] Exemplary embodiments of this disclosure also provide a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the aforementioned model maintenance method based on local editing.

[0102] In one implementation, the computer program product can be a tangible product containing a computer program, such as a computer-readable storage medium storing the computer program. The readable storage medium can be a storage medium based on electrical, magnetic, optical, electromagnetic, infrared, or other signals, including but not limited to: random access memory (RAM), read-only memory (ROM), magnetic tape, floppy disk, flash memory, hard disk drive (HDD), solid-state drive (SSD), etc. For example, the computer program product can be implemented as a non-volatile storage medium storing a computer program, such as read-only memory, NAND flash memory, etc.

[0103] In one implementation, the computer program product can be an intangible product containing a computer program. For example, the computer program product can be implemented as a virtual digital product, such as an executable file, installation package, or other digital file storing the computer program.

[0104] Computer program code can be written in one or more programming languages. Examples of programming languages ​​include C, Java, and C++. Program code can execute entirely on the user's computing device, partially on the user's computing device, or as a standalone software package. It can also execute partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, such as a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via an internet connection provided by a mobile network operator).

[0105] Computer programs can be carried or transmitted via signals such as electrical, magnetic, optical, electromagnetic, and infrared rays. Electronic devices can convert signals carrying computer programs into digital signals, thereby running the computer programs. When a computer program runs on an electronic device, its code is used to cause the electronic device to execute (more specifically, to be executed by the processor of the electronic device) the method steps of various exemplary embodiments of this disclosure.

[0106] For example, the following steps may be included: Acquire the asset data to be maintained and the local editing information when performing partial editing on the target model; Based on the asset data to be maintained and the skeleton specification corresponding to the target model, a joint constraint diagram of the target model is generated; the joint constraint diagram is used to represent the constraint relationship between component nodes, joint nodes and skeleton specification nodes; The scope of local maintenance is determined based on local editing information and joint constraint diagrams; Based on the joint constraint graph, local skeleton and local binding consistency maintenance are performed within the local maintenance scope to obtain the updated local skeleton and local binding. Based on the updated local skeleton and local bindings, the maintained asset data after local editing of the target model is output.

[0107] This disclosure constructs a joint constraint graph based on the asset data to be maintained and the corresponding skeleton specification data when the target model is partially edited. This graph can accurately locate the local area that needs to be maintained when the model is partially edited, avoid unnecessary global maintenance, and achieve efficient maintenance of the skeleton and binding consistency when the model is partially edited. This not only improves the continuous editability of the model assets, but also allows the target model to still maintain its animability after partial editing.

[0108] Exemplary embodiments of this disclosure also provide an electronic device capable of implementing the above-described model maintenance method based on local editing. The electronic device may include a processor and a memory. The memory stores executable instructions for the processor, such as program code. The processor executes the executable instructions to perform the method of this exemplary embodiment.

[0109] The following is for reference. Figure 6 The electronic device is illustrated by way of a general-purpose computing device. It should be understood that... Figure 6 The electronic device 600 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0110] like Figure 6 As shown, the electronic device 600 may include: a processor 610, a memory 620, a bus 630, an I / O (input / output) interface 640, and a network adapter 650.

[0111] Memory 620 may include volatile memory, such as RAM 621 and cache unit 622, and may also include non-volatile memory, such as ROM 623. Memory 620 may also include one or more program modules 624, such program modules 624 including, but not limited to: operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. For example, program module 624 may include the modules in the above-described device.

[0112] The processor 610 may include one or more processing units, such as an AP (Application Processor), a modem processor, a GPU (Graphics Processing Unit), an ISP (Image Signal Processor), a controller, an encoder, a decoder, a DSP (Digital Signal Processor), a baseband processor, and / or an NPU (Neural-Network Processing Unit).

[0113] The processor 610 can be used to execute executable instructions stored in the memory 620, such as performing any one or more method steps in this exemplary embodiment.

[0114] For example, processor 610 may perform the following steps: Acquire the asset data to be maintained and the local editing information when performing partial editing on the target model; Based on the asset data to be maintained and the skeleton specification corresponding to the target model, a joint constraint diagram of the target model is generated; the joint constraint diagram is used to represent the constraint relationship between component nodes, joint nodes and skeleton specification nodes; The scope of local maintenance is determined based on local editing information and joint constraint diagrams; Based on the joint constraint graph, local skeleton and local binding consistency maintenance are performed within the local maintenance scope to obtain the updated local skeleton and local binding. Based on the updated local skeleton and local bindings, the maintained asset data after local editing of the target model is output.

[0115] This disclosure constructs a joint constraint graph based on the asset data to be maintained and the corresponding skeleton specification data when the target model is partially edited. This graph can accurately locate the local area that needs to be maintained when the model is partially edited, avoid unnecessary global maintenance, and achieve efficient maintenance of the skeleton and binding consistency when the model is partially edited. This not only improves the continuous editability of the model assets, but also allows the target model to still maintain its animability after partial editing.

[0116] Bus 630 is used to connect different components of electronic device 600 and may include a data bus, an address bus and a control bus.

[0117] Electronic device 600 can communicate with one or more external devices 700 (such as keyboard, mouse, external controller, etc.) through I / O interface 640.

[0118] Electronic device 600 can communicate with one or more networks via network adapter 650. For example, network adapter 650 can provide mobile communication solutions such as 3G / 4G / 5G, or wireless communication solutions such as wireless LAN, Bluetooth, and near-field communication. Network adapter 650 can communicate with other modules of electronic device 600 via bus 630.

[0119] although Figure 6 As not shown in the diagram, other hardware and / or software modules may also be configured in the electronic device 600, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems.

[0120] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to exemplary embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0121] Those skilled in the art will understand that various aspects of this disclosure can be implemented as systems, methods, or program products. Therefore, various aspects of this disclosure can be embodied in entirely hardware implementations, entirely software implementations (including firmware, microcode, etc.), or implementations combining hardware and software aspects, collectively referred to herein as “circuit,” “module,” or “system.” Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0122] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is defined only by the appended claims.

Claims

1. A method for model maintenance based on local edits, characterized in that, The method includes: Acquire the asset data to be maintained and the local editing information when performing partial editing on the target model; Based on the asset data to be maintained and the skeleton specification corresponding to the target model, a joint constraint diagram of the target model is generated; the joint constraint diagram is used to represent the constraint relationships between component nodes, joint nodes and skeleton specification nodes; The scope of local maintenance is determined based on the local editing information and the joint constraint diagram; Based on the joint constraint graph, local skeleton and local binding consistency maintenance are performed within the local maintenance scope to obtain the updated local skeleton and local binding. Based on the updated local skeleton and local bindings, the maintained asset data of the target model after local editing is output.

2. The method of claim 1, wherein, The asset data to be maintained includes: Asset data with an explicit component tree and / or asset data used to infer component structure.

3. The method according to claim 2, characterized in that, The asset data used to infer the component structure includes one or more of the following: Component mask, component segmentation results, component generation metadata, and assembly relationships between components.

4. The method according to claim 1, characterized in that, The local editing information includes one or more of the following: Edit component identifier, edit type, edit area, replacement source of edit component, and regeneration command of edit component.

5. The method according to claim 1, characterized in that, The step of generating a joint constraint diagram of the target model based on the asset data to be maintained and the skeleton specification corresponding to the target model includes: Based on the asset data to be maintained and the skeleton specification corresponding to the target model, determine the component node set, joint node set, skeleton specification node set, and the constraint relationships between nodes of the target model; Based on the set of component nodes, the set of joint nodes, the set of skeleton specification nodes, and the constraint relationships between nodes of the target model, a joint constraint diagram of the target model is generated.

6. The method according to claim 5, characterized in that, The constraints between nodes include one or more of the following: Assembly relationships between component nodes, attribution relationships between component nodes and joint nodes, correspondence between joint nodes and skeleton specification nodes, binding influence domain, and boundary continuity relationships.

7. The method according to claim 1, characterized in that, Determining the local maintenance scope of the target model based on the local editing information and the joint constraint graph includes: Based on the local editing information, determine the set of editing components; Using the set of editable components as seeds, the editing effect propagation process is performed in the joint constraint graph to determine the local maintenance scope of the target model.

8. The method according to claim 7, characterized in that, The step of using the set of editable components as seeds to perform edit impact propagation processing in the joint constraint graph to determine the local maintenance scope of the target model includes: Using the set of editable components as seeds, perform a closure operation on the joint constraint graph to obtain component subgraphs and skeleton subgraphs affected by the editing. Using the set of editable components as seeds, cross-boundary constraint propagation processing is performed based on the joint constraint graph to obtain the editable boundary transition region; Based on the edited component subgraphs and skeleton subgraphs, as well as the edit boundary transition region, the local maintenance range of the target model is obtained.

9. The method according to claim 1, characterized in that, Based on the joint constraint graph, the process of performing local skeleton and local binding consistency maintenance within the local maintenance scope to obtain the updated local skeleton and local binding includes: Based on the joint constraint diagram, joint attribution constraints, skeleton specification constraints, boundary continuity constraints, and local binding constraints are determined. Using the local skeleton and local binding within the local maintenance range as variables, a target constraint function is constructed based on the joint attribution constraint, the skeleton specification constraint, the boundary continuity constraint, and the local binding constraint. With minimizing the target constraint function as the maintenance objective, the updated local skeleton and local bindings are determined.

10. A model maintenance device based on local editing, characterized in that, The device includes: The asset acquisition module is used to acquire the asset data to be maintained and the local editing information when the target model is being partially edited. The constraint construction module is used to generate a joint constraint graph of the target model based on the asset data to be maintained and the skeleton specification corresponding to the target model; the joint constraint graph is used to represent the constraint relationship between component nodes, joint nodes and skeleton specification nodes; The scope determination module is used to determine the local maintenance scope based on the local editing information and the joint constraint diagram; The update maintenance module is used to perform local skeleton and local binding consistency maintenance within the local maintenance scope based on the joint constraint graph, so as to obtain the updated local skeleton and local binding. The asset output module is used to output the maintained asset data of the target model after local editing, based on the updated local skeleton and local binding.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method according to any one of claims 1 to 9.

12. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the method of any one of claims 1 to 9 by executing the executable instructions.

Images