Model disassembling method through gesture recognition

Abstract

A model disassembly method based on gesture recognition comprises a disassembly method based on a local position and a disassembly method based on a bounding box calculation position, a user can select a proper disassembly method according to complexity and operation requirements of a model, and the disassembly methods can adapt to model structures with different complexities. It is ensured that a user can achieve accurate control and interactive operation of the model through natural gestures, so that the optimal operation experience and the optimal model control effect are achieved; wherein the local position-based disassembling method is suitable for a relatively simple model, the model can be quickly disassembled and recovered, and the operation is simple, convenient and efficient; the disassembling method based on the bounding box calculation position is suitable for the complex model, even if the local positions of the sub-objects are the same, the system can provide different disassembling paths through the bounding box calculation position, and it is ensured that the disassembling effect of the complex model is reasonable.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual reality and augmented reality, and is applicable to model interaction and operation in virtual reality (VR) devices and augmented reality (AR) devices, in particular to a model disassembly method through gesture recognition. Background Art

[0002] With the rapid development of virtual reality and augmented reality technologies, gesture recognition has been widely used in various interactive scenarios, especially in virtual model operation and disassembly. Users can control the decomposition and operation of virtual objects through natural gestures. However, existing model disassembly methods have certain limitations. For example, the following limitations exist:

[0003] Limitation 1: Existing model disassembly mostly relies on a single disassembly direction, usually based on the relative position or spatial distance calculation of the model, resulting in a relatively simple disassembly effect and unable to flexibly cope with the structural characteristics of complex models.

[0004] Limitation 2: For some complex 3D models, the relative position relationship of their sub-objects is complex. Traditional disassembly methods cannot effectively handle the same sub-objects in different positions, resulting in unsatisfactory disassembly results.

[0005] Therefore, the prior art requires a more flexible and efficient model disassembly method that can achieve a variety of different disassembly effects based on gesture recognition to meet the needs of different scenarios. Summary of the invention

[0006] The present invention aims to solve the problems in the prior art such as the single model disassembly effect and the inability to adapt to complex model structures, and provides a model disassembly method through gesture recognition. By proposing two model disassembly methods based on local position and bounding box calculation position, combined with gesture recognition technology, users can easily realize multiple model disassembly methods according to gestures, adapt to different application scenarios, and improve the interactive experience in the virtual environment.

[0007] The technical solution adopted by the present invention to solve its technical problem is:

[0008] A model disassembly method through gesture recognition, the model disassembly method uses gesture recognition technology, including a disassembly method based on local position and a disassembly method based on bounding box calculation position. Users can choose a suitable disassembly method according to the complexity of the model and operation requirements, both of which can adapt to model structures of different complexities and ensure that users can achieve precise control and interactive operation of the model through natural gestures to achieve the best operation experience and model control effect; wherein: the disassembly method based on local position is suitable for relatively simple models, can quickly realize the disassembly and restoration of the model, and is easy and efficient to operate; the disassembly method based on bounding box calculation position is suitable for complex models, even if the local positions of sub-objects are the same, the system can provide different disassembly paths through the bounding box calculation position to ensure that the disassembly effect of the complex model is reasonable.

[0009] The present invention also has the following additional technical features:

[0010] As a further specific optimization of the technical solution of the present invention:

[0011] The local location based disassembly method includes the following steps:

[0012] 1. System initialization

[0013] 1.1 Model loading

[0014] First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management. During the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment.

[0015] 1.2 Gesture Recognition Initialization

[0016] The system also initializes the gesture recognition function and uses a gesture recognition device (such as MetaQuest3) to capture the user's hand movements in real time. The system triggers the model disassembly and restoration operations based on the movement distance of the left and right hand fingers. When the user's fingers move closer or farther away, the system captures the gesture information and controls the model's disassembly progress.

[0017] 2. Model disassembly based on local location

[0018] 2.1 Local Location Storage

[0019] After the model is loaded, the system automatically records the initial local position of each child object (relative to the parent object's coordinates) and their initial rotation state. The local position will be used as a reference for model disassembly to determine the disassembly direction and path of each child object.

[0020] 2.2 Calculate the disassembly direction

[0021] The local position of each child object is used to calculate the disassembly direction. By normalizing the local position vector, the system is able to generate a disassembly direction that ensures that the child objects are separated in the direction of their initial position. This direction is determined by the position of the child object relative to the parent object, and each child object will move in the predetermined direction when disassembling.

[0022] 2.3 Gesture-driven disassembly process

[0023] The user operates through gestures, and the system monitors the distance between fingers in real time and maps the distance to the progress of disassembly. As the finger distance increases, the child object gradually moves away from the parent object along the calculated direction, and the model is gradually disassembled. When the fingers move closer, the disassembly progress decreases, and the child object gradually returns to the initial position.

[0024] 2.4 Model restoration as a whole

[0025] When the fingers are completely closed, the sub-objects are restored to their initial local positions, and the entire model is restored to the state when it was loaded. The restoration process corresponds to the disassembly process, ensuring that the sub-objects can be reassembled into a complete model.

[0026] 3. Movement of child objects during disassembly

[0027] 3.1 Movement processing in local position disassembly

[0028] In the local position disassembly method, if the user manually moves a sub-object, the system will update the latest local position of the sub-object in real time and recalculate the disassembly path based on the new position. During restoration, the sub-object will be restored to the new initial position along the updated local position to ensure the integrity of the model during restoration.

[0029] 3.2 Model overall movement or rotation processing

[0030] When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent. Regardless of how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent.

[0031] 4. Gesture recognition and model interaction

[0032] The system captures the user's hand movements through gesture recognition devices. The closeness or separation of fingers triggers the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

[0033] As a further specific optimization of the technical solution of the present invention:

[0034] The method for calculating the position based on the bounding box includes the following steps:

[0035] 1. System initialization

[0036] 1.1 Model loading

[0037] First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management. During the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment.

[0038] 1.2 Gesture Recognition Initialization

[0039] The system also initializes the gesture recognition function and uses a gesture recognition device (such as MetaQuest3) to capture the user's hand movements in real time. The system triggers the model disassembly and restoration operations based on the movement distance of the left and right hand fingers. When the user's fingers move closer or farther away, the system captures the gesture information and controls the model's disassembly progress.

[0040] 2. Model disassembly based on bounding box calculation position

[0041] 2.1 Bounding box calculation position

[0042] After the model is loaded, the system will calculate the bounding box for each sub-object and determine the disassembly direction of the sub-object by the center position of the bounding box. The center point and size of the bounding box reflect the size and relative position of the sub-object. Even if the local positions of the sub-objects are the same, the system can still provide a reasonable disassembly direction by calculating the position of the bounding box.

[0043] 2.2 Disassembly direction based on bounding box calculation position

[0044] The system calculates the disassembly direction based on the center position of the child object's bounding box. The child object will move along the calculated position of the bounding box, that is, each child object will move outward based on its relative bounding box center point when disassembled. The calculated position of the bounding box ensures that even if the local positions of the child objects are consistent, the disassembly direction is still reasonable and does not overlap.

[0045] 2.3 Gesture-driven disassembly process

[0046] Similar to the local position disassembly method, the system controls the disassembly progress of the child object according to the change in the distance between the fingers. As the fingers separate, the child object gradually separates along the position direction calculated by the bounding box. When the fingers move closer, the child object gradually returns to the vicinity of the parent object, completing the disassembly and restoration.

[0047] 2.4 Dynamically adjust the bounding box calculation position

[0048] During the disassembly or restoration of the model, if the model as a whole moves or scales, the system will dynamically adjust the calculated position of the bounding box of the child object to ensure that the disassembly and restoration effect of the model is not affected. When the position information of the child object changes, the system will recalculate the position of the bounding box to ensure that all child objects can form a complete whole when restored.

[0049] 2.5 Model restoration as a whole

[0050] As the user's finger gradually approaches, the sub-objects gradually recover to their initial state based on the calculated position of the bounding box. When the system detects that the finger is completely closed, it will ensure that all sub-objects are reassembled into a complete model and are no longer in a disassembled state. Regardless of the complexity of the model, all sub-objects will be restored as a whole to ensure the integrity of the model.

[0051] 3. Movement of child objects during disassembly

[0052] 3.1 Movement Processing in Bounding Box Calculation Position Decomposition

[0053] For the disassembly method based on bounding box position calculation, the system will recalculate the bounding box position when the child object moves, and readjust the disassembly direction based on the new position. During the restoration process, the child object will be returned based on the updated bounding box position to ensure that all child objects can return to the whole and ensure the accuracy of model restoration.

[0054] 3.2 Model overall movement or rotation processing

[0055] When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent. Regardless of how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent.

[0056] 4. Gesture recognition and model interaction

[0057] The system captures the user's hand movements through gesture recognition devices. The closeness or separation of fingers triggers the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

[0058] Compared with the prior art, the present invention has the following advantages:

[0059] Diverse disassembly methods: The present invention provides two different disassembly methods. Users can choose to use the local position or bounding box calculation method according to actual needs, and flexibly respond to different model structures and scene requirements.

[0060] Improved interactive experience: Through gesture recognition technology, users can interact with the model naturally, the operation is simple, the disassembly effect is intuitive, and the immersive experience in the virtual environment is enhanced.

[0061] Applicable to complex models: The bounding box calculation position disassembly method is particularly suitable for processing complex models. It can automatically adapt to the size and position of sub-objects, solving the problem that sub-objects with the same local position cannot be disassembled.

[0062] Performance optimization: Compared with complex geometric calculations, the local position method in the present invention has less calculation amount and is suitable for scenes that require efficient processing, while the bounding box position calculation method provides a more accurate disassembly effect and is suitable for processing complex model interactions. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 It is a schematic diagram of the model disassembly method of the present invention. DETAILED DESCRIPTION

[0064] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings.

[0065] Example 1

[0066] The local location based disassembly method includes the following steps:

[0067] 1. System initialization

[0068] 1.1 Model loading

[0069] First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management; during the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment;

[0070] 1.2 Gesture Recognition Initialization

[0071] The system also initializes the gesture recognition function and captures the user's hand movements in real time through gesture recognition equipment (such as MetaQuest3). The system triggers the disassembly and restoration of the model based on the movement distance of the left and right hand fingers. When the user's fingers move closer or farther away, the system captures the gesture information and controls the decomposition progress of the model.

[0072] 2. Model disassembly based on local location

[0073] 2.1 Local Location Storage

[0074] After the model is loaded, the system automatically records the initial local position of each child object (relative to the parent object's coordinates) and their initial rotation state; the local position will be used as a reference for model disassembly to determine the disassembly direction and path of each child object;

[0075] 2.2 Calculate the disassembly direction

[0076] The local position of each child object is used to calculate the disassembly direction. By normalizing the local position vector, the system can generate a disassembly direction to ensure that the child objects are separated in the direction of their initial positions. This direction is determined by the position of the child object relative to the parent object. When disassembling, each child object will move in the predetermined direction.

[0077] 2.3 Gesture-driven disassembly process

[0078] The user operates through gestures, and the system monitors the distance between fingers in real time and maps the distance to the progress of disassembly. As the distance between fingers increases, the child object gradually moves away from the parent object along the calculated direction, and the model is gradually disassembled. When the fingers move closer, the disassembly progress decreases, and the child object gradually returns to the initial position.

[0079] 2.4 Model restoration as a whole

[0080] When the fingers are completely closed, the sub-objects are restored to their initial local positions, and the entire model is restored to the state when it was loaded; the restoration process corresponds to the disassembly process, ensuring that the sub-objects can be reassembled into a complete model;

[0081] 3. Movement of child objects during disassembly

[0082] 3.1 Movement processing in local position disassembly

[0083] In the local position disassembly method, if the user manually moves a sub-object, the system will update the latest local position of the sub-object in real time and recalculate the disassembly path based on the new position; when restoring, the sub-object will be restored to the new initial position along the updated local position to ensure the integrity of the model when restoring;

[0084] 3.2 Model overall movement or rotation processing

[0085] When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent; no matter how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent;

[0086] 4. Gesture recognition and model interaction

[0087] The system captures the user's hand movements through gesture recognition devices. The proximity or separation of fingers will trigger the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

[0088] Example 2

[0089] The method for calculating the position based on the bounding box includes the following steps:

[0090] 1. System initialization

[0091] 1.1 Model loading

[0092] First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management; during the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment;

[0093] 1.2 Gesture Recognition Initialization

[0094] The system also initializes the gesture recognition function and captures the user's hand movements in real time through gesture recognition equipment (such as MetaQuest3). The system triggers the disassembly and restoration of the model based on the movement distance of the left and right hand fingers. When the user's fingers move closer or farther away, the system captures the gesture information and controls the decomposition progress of the model.

[0095] 2. Model disassembly based on bounding box calculation position

[0096] 2.1 Bounding box calculation position

[0097] After the model is loaded, the system will calculate the bounding box for each sub-object and determine the disassembly direction of the sub-object by the center position of the bounding box. The center point and size of the bounding box reflect the size and relative position of the sub-object. Even if the local positions of the sub-objects are the same, the system can still provide a reasonable disassembly direction by calculating the position of the bounding box.

[0098] 2.2 Disassembly direction based on bounding box calculation position

[0099] The system calculates the disassembly direction based on the center position of the child object's bounding box. The child object will move along the calculated position of the bounding box, that is, each child object will move outward based on its relative bounding box center point when disassembled. The calculated position of the bounding box ensures that even if the local positions of the child objects are consistent, the disassembly direction is still reasonable and will not overlap.

[0100] 2.3 Gesture-driven disassembly process

[0101] Similar to the local position disassembly method, the system controls the disassembly progress of the child object according to the change in the distance between the fingers; as the fingers separate, the child object gradually separates along the position direction calculated by the bounding box; when the fingers move closer, the child object gradually returns to the vicinity of the parent object, completing the disassembly and restoration;

[0102] 2.4 Dynamically adjust the bounding box calculation position

[0103] During the disassembly or restoration of a model, if the model as a whole moves or scales, the system will dynamically adjust the calculated position of the bounding box of the child object to ensure that the disassembly and restoration effect of the model is not affected; when the position information of the child object changes, the system will recalculate the position of the bounding box to ensure that all child objects can form a complete whole during restoration;

[0104] 2.5 Model restoration as a whole

[0105] As the user's finger gradually approaches, the sub-objects are gradually restored to their initial state based on the calculated position of the bounding box; when the system detects that the finger is completely closed, it will ensure that all sub-objects are reassembled into a complete model and are no longer in a disassembled state; regardless of the complexity of the model, all sub-objects will be restored as a whole to ensure the integrity of the model;

[0106] 3. Movement of child objects during disassembly

[0107] 3.1 Movement Processing in Bounding Box Calculation Position Decomposition

[0108] For the disassembly method based on bounding box position calculation, the system will recalculate the bounding box position when the child object moves, and readjust the disassembly direction based on the new position; during the restoration process, the child object will be returned based on the updated bounding box position to ensure that all child objects can return to the whole and ensure the accuracy of model restoration;

[0109] 3.2 Model overall movement or rotation processing

[0110] When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent; no matter how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent;

[0111] 4. Gesture recognition and model interaction

[0112] The system captures the user's hand movements through gesture recognition devices. The proximity or separation of fingers will trigger the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

[0113] Example 3

[0114] A model disassembly method through gesture recognition, the model disassembly method uses gesture recognition technology, including a disassembly method based on local position and a disassembly method based on bounding box calculation position. Users can choose a suitable disassembly method according to the complexity of the model and operation requirements, both of which can adapt to model structures of different complexities and ensure that users can achieve precise control and interactive operation of the model through natural gestures to achieve the best operation experience and model control effect; wherein: the disassembly method based on local position is suitable for relatively simple models, can quickly realize the disassembly and restoration of the model, and is easy and efficient to operate; the disassembly method based on bounding box calculation position is suitable for complex models, even if the local positions of sub-objects are the same, the system can provide different disassembly paths through the bounding box calculation position to ensure that the disassembly effect of the complex model is reasonable.

[0115] The following is a detailed introduction to the operation process of the two methods and their handling during model disassembly and restoration.

[0116] 1. System initialization

[0117] 1.1 Model loading

[0118] First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management. During the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment.

[0119] 1.2 Gesture Recognition Initialization

[0120] The system also initializes the gesture recognition function and uses a gesture recognition device (such as MetaQuest3) to capture the user's hand movements in real time. The system triggers the model disassembly and restoration operations based on the movement distance of the left and right hand fingers. When the user's fingers move closer or farther away, the system captures the gesture information and controls the model's disassembly progress.

[0121] 2. Model disassembly based on local location

[0122] 2.1 Local Location Storage

[0123] After the model is loaded, the system automatically records the initial local position of each child object (relative to the parent object's coordinates) and their initial rotation state. The local position will be used as a reference for model disassembly to determine the disassembly direction and path of each child object.

[0124] 2.2 Calculate the disassembly direction

[0125] The local position of each child object is used to calculate the disassembly direction. By normalizing the local position vector, the system is able to generate a disassembly direction that ensures that the child objects are separated in the direction of their initial position. This direction is determined by the position of the child object relative to the parent object, and each child object will move in the predetermined direction when disassembling.

[0126] 2.3 Gesture-driven disassembly process

[0127] The user operates through gestures, and the system monitors the distance between fingers in real time and maps the distance to the progress of disassembly. As the finger distance increases, the child object gradually moves away from the parent object along the calculated direction, and the model is gradually disassembled. When the fingers move closer, the disassembly progress decreases, and the child object gradually returns to the initial position.

[0128] 2.4 Model restoration as a whole

[0129] When the fingers are completely closed, the sub-objects are restored to their initial local positions, and the entire model is restored to the state when it was loaded. The restoration process corresponds to the disassembly process, ensuring that the sub-objects can be reassembled into a complete model.

[0130] 3. Model disassembly based on bounding box calculation position

[0131] 3.1 Bounding box calculation position

[0132] After the model is loaded, the system will calculate the bounding box for each sub-object and determine the disassembly direction of the sub-object by the center position of the bounding box. The center point and size of the bounding box reflect the size and relative position of the sub-object. Even if the local positions of the sub-objects are the same, the system can still provide a reasonable disassembly direction by calculating the position of the bounding box.

[0133] 3.2 Disassembly direction based on bounding box calculation position

[0134] The system calculates the disassembly direction based on the center position of the child object's bounding box. The child object will move along the calculated position of the bounding box, that is, each child object will move outward based on its relative bounding box center point when disassembled. The calculated position of the bounding box ensures that even if the local positions of the child objects are consistent, the disassembly direction is still reasonable and does not overlap.

[0135] 3.3 Gesture-driven disassembly process

[0136] Similar to the local position disassembly method, the system controls the disassembly progress of the child object according to the change in the distance between the fingers. As the fingers separate, the child object gradually separates along the position direction calculated by the bounding box; when the fingers move closer, the child object gradually returns to the vicinity of the parent object, completing the disassembly and restoration.

[0137] 3.4 Dynamically adjust the bounding box calculation position

[0138] During the disassembly or restoration of the model, if the model as a whole moves or scales, the system will dynamically adjust the calculated position of the bounding box of the child object to ensure that the disassembly and restoration effect of the model is not affected. When the position information of the child object changes, the system will recalculate the position of the bounding box to ensure that all child objects can form a complete whole when restored.

[0139] 3.5 Model restoration as a whole

[0140] As the user's finger gradually approaches, the sub-objects gradually recover to their initial state based on the calculated position of the bounding box. When the system detects that the finger is completely closed, it will ensure that all sub-objects are reassembled into a complete model and are no longer in a disassembled state. Regardless of the complexity of the model, all sub-objects will be restored as a whole to ensure the integrity of the model.

[0141] 4. Movement of child objects during disassembly

[0142] 4.1 Movement Processing in Local Location Disassembly

[0143] In the local position disassembly method, if the user manually moves a sub-object, the system will update the latest local position of the sub-object in real time and recalculate the disassembly path based on the new position. During restoration, the sub-object will be restored to the new initial position along the updated local position to ensure the integrity of the model during restoration.

[0144] 4.2 Movement Processing in Bounding Box Calculation Position Decomposition

[0145] For the disassembly method based on bounding box position calculation, the system will recalculate the bounding box position when the child object moves, and readjust the disassembly direction based on the new position. During the restoration process, the child object will be returned based on the updated bounding box position to ensure that all child objects can return to the whole and ensure the accuracy of model restoration.

[0146] 4.3 Model overall movement or rotation processing

[0147] When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent. Regardless of how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent.

[0148] 5. Gesture recognition and model interaction

[0149] The system captures the user's hand movements through gesture recognition devices. The closeness or separation of fingers triggers the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

[0150] 6. Combination and selection of two disassembly methods

[0151] The system provides two decomposition methods: local position and bounding box calculation position. Users can choose according to the complexity of the model and operation requirements:

[0152] In summary, Example 1-Example 3,

[0153] The present invention provides diversified disassembly methods: The present invention provides two different disassembly methods. Users can choose to use the local position or bounding box calculation position method according to actual needs, and flexibly respond to different model structures and scene requirements.

[0154] The present invention improves the interactive experience: through gesture recognition technology, the user can interact with the model naturally, the operation is simple, the disassembly effect is intuitive, and the immersive experience in the virtual environment is enhanced.

[0155] The present invention is applicable to complex models: the bounding box calculation position disassembly method is particularly suitable for processing complex models, can automatically adapt to the size and position of sub-objects, and solves the problem that sub-objects with the same local position cannot be disassembled.

[0156] The performance of the present invention is optimized: compared with complex geometric calculations, the local position method in the present invention has a smaller amount of calculation and is suitable for scenes that require efficient processing, while the bounding box position calculation method provides a more accurate disassembly effect and is suitable for processing complex model interactions.

[0157] The above detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention but merely represents selected embodiments of the present invention.

Claims

1. A model disassembly method through gesture recognition, characterized in that: The model disassembly method uses gesture recognition technology, including a disassembly method based on local position and a disassembly method based on bounding box calculation position. Users can choose the appropriate disassembly method according to the complexity of the model and the operation requirements. Both methods can adapt to model structures of different complexities and ensure that users can achieve precise control and interactive operations of the model through natural gestures to achieve the best operation experience and model control effect; among them: the disassembly method based on local position is suitable for simpler models, and can quickly realize the disassembly and restoration of the model, with simple and efficient operation; the disassembly method based on bounding box calculation position is suitable for complex models. Even if the local positions of the sub-objects are the same, the system can provide different disassembly paths through the bounding box calculation position to ensure that the disassembly effect of the complex model is reasonable.

2. The model disassembly method through gesture recognition according to claim 1, characterized in that: The local location based disassembly method includes the following steps:

1. System initialization 1.1 Model loading First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management; during the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment; 1.2 Gesture Recognition Initialization The system also initializes the gesture recognition function, and uses the gesture recognition device to capture the user's hand movements in real time. The system triggers the disassembly and restoration of the model based on the movement distance of the left and right hand fingers. When the user's fingers move closer or further apart, the system captures the gesture information and controls the decomposition progress of the model.

2. Model disassembly based on local location 2.1 Local Location Storage After the model is loaded, the system automatically records the initial local position of each sub-object and their initial rotation state; the local position will be used as a reference for model disassembly to determine the disassembly direction and path of each sub-object; 2.2 Calculate the disassembly direction The local position of each child object is used to calculate the disassembly direction. By normalizing the local position vector, the system can generate a disassembly direction to ensure that the child objects are separated in the direction of their initial positions. This direction is determined by the position of the child object relative to the parent object. When disassembling, each child object will move in the predetermined direction. 2.3 Gesture-driven disassembly process The user operates through gestures, and the system monitors the distance between fingers in real time and maps the distance to the progress of disassembly. As the distance between fingers increases, the child object gradually moves away from the parent object along the calculated direction, and the model is gradually disassembled. When the fingers move closer, the disassembly progress decreases, and the child object gradually returns to the initial position. 2.4 Model restoration as a whole When the fingers are completely closed, the sub-objects are restored to their initial local positions, and the entire model is restored to the state when it was loaded; the restoration process corresponds to the disassembly process, ensuring that the sub-objects can be reassembled into a complete model; 3. Movement of child objects during disassembly 3.1 Movement processing in local position disassembly In the local position disassembly method, if the user manually moves a sub-object, the system will update the latest local position of the sub-object in real time and recalculate the disassembly path based on the new position; when restoring, the sub-object will be restored to the new initial position along the updated local position to ensure the integrity of the model when restoring; 3.2 Model overall movement or rotation processing When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent; no matter how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent; 4. Gesture recognition and model interaction The system captures the user's hand movements through gesture recognition devices. The proximity or separation of fingers will trigger the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

3. The model disassembly method through gesture recognition according to claim 1, characterized in that: The method for calculating the position based on the bounding box includes the following steps:

1. System initialization 1.1 Model loading First, the system loads the 3D model selected by the user and records all the sub-objects of the model in a list for management; during the model loading process, the system parses the model's mesh, material, and texture to ensure that the model can be fully displayed in the virtual environment; 1.2 Gesture Recognition Initialization The system also initializes the gesture recognition function, and uses the gesture recognition device to capture the user's hand movements in real time. The system triggers the disassembly and restoration of the model based on the movement distance of the left and right hand fingers. When the user's fingers move closer or further apart, the system captures the gesture information and controls the decomposition progress of the model.

2. Model disassembly based on bounding box calculation position 2.1 Bounding box calculation position After the model is loaded, the system will calculate the bounding box for each sub-object and determine the disassembly direction of the sub-object by the center position of the bounding box. The center point and size of the bounding box reflect the size and relative position of the sub-object. Even if the local positions of the sub-objects are the same, the system can still provide a reasonable disassembly direction by calculating the position of the bounding box. 2.2 Disassembly direction based on bounding box calculation position The system calculates the disassembly direction based on the center position of the child object's bounding box. The child object will move along the calculated position of the bounding box, that is, each child object will move outward based on its relative bounding box center point when disassembled. The calculated position of the bounding box ensures that even if the local positions of the child objects are consistent, the disassembly direction is still reasonable and will not overlap. 2.3 Gesture-driven disassembly process Similar to the local position disassembly method, the system controls the disassembly progress of the child object according to the change in the distance between the fingers; as the fingers separate, the child object gradually separates along the position direction calculated by the bounding box; when the fingers move closer, the child object gradually returns to the vicinity of the parent object, completing the disassembly and restoration; 2.4 Dynamically adjust the bounding box calculation position During the disassembly or restoration of a model, if the model as a whole moves or scales, the system will dynamically adjust the calculated position of the bounding box of the child object to ensure that the disassembly and restoration effect of the model is not affected; when the position information of the child object changes, the system will recalculate the position of the bounding box to ensure that all child objects can form a complete whole during restoration; 2.5 Model restoration as a whole As the user's finger gradually approaches, the sub-objects are gradually restored to their initial state based on the calculated position of the bounding box; when the system detects that the finger is completely closed, it will ensure that all sub-objects are reassembled into a complete model and are no longer in a disassembled state; regardless of the complexity of the model, all sub-objects will be restored as a whole to ensure the integrity of the model; 3. Movement of child objects during disassembly 3.1 Movement Processing in Bounding Box Calculation Position Decomposition For the disassembly method based on bounding box position calculation, the system will recalculate the bounding box position when the child object moves, and readjust the disassembly direction based on the new position; during the restoration process, the child object will be returned based on the updated bounding box position to ensure that all child objects can return to the whole and ensure the accuracy of model restoration; 3.2 Model overall movement or rotation processing When the model as a whole moves or rotates, the system will uniformly adjust the local position of the child objects or the bounding box calculation position to ensure that the disassembly direction and path of the child objects are consistent; no matter how the position of the model changes in the virtual environment, the disassembly and restoration operations will remain consistent; 4. Gesture recognition and model interaction The system captures the user's hand movements through gesture recognition devices. The proximity or separation of fingers will trigger the disassembly and restoration of the model. The change in distance between fingers directly determines the disassembly progress of the model, ensuring that users can control the decomposition and restoration process of the model through natural gestures. Gesture operations are closely related to the path and direction of model disassembly, and users can accurately control the interactive effect of the model through gestures.

Images