Spacecraft assembly collision error risk suppression method based on augmented reality
By building the virtual and real fusion of virtual scenes and augmented reality helmets, real-time monitoring and prompting collision risks during spacecraft assembly, the problem of high error risk in small spaces is solved and operational safety is improved.
Patent Information
- Application Number
- CN202411062665.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-05
- Publication Date
- 2024-12-03
AI Technical Summary
Due to the narrow space and compact configuration during the spacecraft assembly process, the risk of errors such as equipment bumps and switches is significantly increased. The existing augmented reality technology is only used for visual guidance of process content, and lacks monitoring and prompts for the risks of assembly operation.
Build a virtual scene containing risk envelope model, mannequin model and tracking object model, realize the integration of virtual and real through augmented reality helmets, track the assembly personnel and object position in real time, generate collision risk areas and levels, adjust risk warnings based on geometric interference data, including Lights, sounds and models flash.
Effectively monitor and early warning of collision risks during the assembly process, reduce the impact of errors and improve operational safety.
Smart Images

Figure CN119067440A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of manufacturing and assembly, and in particular to a method for preventing collision errors in spacecraft assembly based on augmented reality. Background Art
[0002] Spacecraft assembly is the integrated assembly and testing of spacecraft product subsystems. A large number of operations in the spacecraft assembly process, such as equipment disassembly and assembly, cable laying, electrical connector plugging and unplugging, and fastener loading and unloading, rely on manual work, and the coordinated assembly actions of both hands account for more than 70% of the entire assembly workload. Due to the limitations of rocket carrying capacity and launch costs, the weight of structural parts needs to be reduced as much as possible, and the configuration of spacecraft tends to be compact, which in turn creates a large number of manual work requirements in small spaces. Assembly operations in small spaces are more demanding on operators and inspectors, and the risk of errors such as equipment collisions, accidental switch touches, and personnel squeeze injuries has increased significantly, requiring effective suppression of assembly errors. In the assembly process, augmented reality can effectively indicate the object, location, and method information of the operation, and has been widely used in the current spacecraft manufacturing industry.
[0003] However, current augmented reality methods are only used for visual guidance of process content, and lack monitoring and prompting of assembly operation risks. Summary of the invention
[0004] The present invention provides a method for preventing collision errors in spacecraft assembly based on augmented reality, so as to solve the risk that in the prior art, the collision risk cannot be monitored and prompted in the assembly.
[0005] In a first aspect, the present invention provides a method for preventing collision errors in spacecraft assembly based on augmented reality, comprising:
[0006] Construct a virtual scene including a risk envelope model, a human model, and a tracked object model;
[0007] Based on the virtual-real fusion of the virtual scene and the augmented reality helmet, the collision risk content is displayed to the general assembly personnel;
[0008] Performing real-time posture tracking on the assembler and the tracked object respectively to determine the real-time posture of the assembler and the tracked object;
[0009] Synchronizing the real-time positions of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene;
[0010] Traversing the risk envelope model in the virtual scene to determine geometric interference data with the synchronized human body model and tracking object model;
[0011] Based on the geometric interference data, the collision risk content is adjusted, and the collision risk content includes a collision area and a collision level.
[0012] According to a method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention, before constructing a virtual scene including a risk envelope model, a human body model and a tracking object model, the method includes:
[0013] Determine the products and areas that may collide in the virtual scene and obtain the risk area;
[0014] An equidistant envelope model of a risk level different from that of the risk area is generated in a virtual scene, and the equidistant envelope model is bound to the risk area to obtain a risk envelope model.
[0015] According to a method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention, generating an equidistant envelope model with a risk level different from that of the risk area in a virtual scene comprises:
[0016] Based on the risk areas, different risk levels are determined;
[0017] generating different isometric volume models based on different risk levels;
[0018] Among them, the distance of the envelope model corresponding to the low risk level is greater than that of the envelope model corresponding to the medium risk level, and the distance of the envelope model corresponding to the medium risk level is greater than that of the envelope model corresponding to the high risk level.
[0019] According to the present invention, a method for preventing collision errors in spacecraft assembly based on augmented reality also includes:
[0020] Determine human body characteristic parameters based on motion capture;
[0021] A human body model corresponding to the human body characteristic parameters is constructed in the virtual scene.
[0022] According to the present invention, a method for preventing collision errors in spacecraft assembly based on augmented reality also includes:
[0023] Based on object tracking, determine the characteristic identification parameters of the running objects in the assembly process;
[0024] Based on the feature identification parameters, a tracking object model is constructed in the virtual scene.
[0025] According to a method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention, the feature identification parameters include at least one of the number, appearance and QR code of the tracking target.
[0026] According to a method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention, the collision risk content is adjusted based on the geometric interference data, and the collision risk content includes a collision area and a collision level, including:
[0027] determining a risk level of the geometric interference data;
[0028] Based on the different risk levels, corresponding risk warnings are issued.
[0029] According to a method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention, the method of issuing corresponding risk warnings based on the different risk levels includes:
[0030] When the risk level is low risk or medium risk, different prompts such as light and sound are emitted;
[0031] When the risk level is a high risk, the obstacle model flashes in the helmet prompt box.
[0032] In a second aspect, the present invention further provides a spacecraft assembly collision error risk suppression device based on augmented reality, comprising:
[0033] A construction module, used for constructing a virtual scene including a risk envelope model, a human body model and a tracked object model;
[0034] A display module, used to display collision risk content to the general assembly personnel based on the virtual and real fusion of the virtual scene and the augmented reality helmet;
[0035] A determination module, used to respectively track the real-time posture of the assembler and the tracked object, and determine the real-time posture of the assembler and the tracked object;
[0036] A synchronization module, used to synchronize the real-time postures of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene;
[0037] A monitoring module, configured to traverse the risk envelope model in the virtual scene and determine geometric interference data with the synchronized human body model and the tracking object model;
[0038] The prompt module is used to adjust the collision risk content based on the geometric interference data, and the collision risk content includes a collision area and a collision level.
[0039] In a third aspect, the present invention further provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for preventing collision errors in spacecraft assembly based on augmented reality as described in any one of the above-mentioned methods.
[0040] In a fourth aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for suppressing the risk of collision errors in spacecraft assembly based on augmented reality as described in any one of the above-mentioned methods.
[0041] In a fifth aspect, the present invention further provides a computer program product, comprising a computer program, which, when executed by a processor, implements any of the above-mentioned augmented reality-based methods for preventing collision-related errors in spacecraft assembly.
[0042] The method for preventing collision errors in spacecraft assembly based on augmented reality provided by the present invention constructs a virtual scene including a risk envelope model, a human body model and a tracking object model; based on the virtual-real fusion of the virtual scene and the augmented reality helmet, displays the collision risk content to the assembly personnel; respectively tracks the real-time posture of the assembly personnel and the tracking object to determine the real-time posture of the assembly personnel and the tracking object; synchronizes the real-time posture of the assembly personnel and the tracking object to the human body model and the tracking object model in the virtual scene; traverses the risk envelope model in the virtual scene to determine the geometric interference data with the synchronized human body model and the tracking object model; adjusts the collision risk content based on the geometric interference data, the collision risk content includes the collision area and the collision level, and can timely carry out risk warning by simulating the data of the human body and the object in the real scene in the virtual scene and combining the monitoring of the collision level in the way of augmented reality, thereby reducing the impact caused by the collision. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0044] Figure 1 is a flow chart of a method for preventing collision errors in spacecraft assembly based on augmented reality provided in this embodiment;
[0045] Figure 2 is a schematic diagram of an assembly scenario provided in this embodiment;
[0046] Figure 3is a schematic diagram of the field of view of an assembly worker provided in this embodiment when moving in a target direction;
[0047] Figure 4 This is one of the risk warning diagrams provided in this embodiment;
[0048] Figure 5 This is the second risk warning diagram provided in this embodiment;
[0049] Figure 6 is a schematic structural diagram of a spacecraft assembly collision error risk suppression device based on augmented reality provided in this embodiment;
[0050] Figure 7 It is a schematic diagram of the structure of the electronic device provided in this embodiment. DETAILED DESCRIPTION
[0051] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0052] Combine the following Figure 1-Figure 7 The present invention describes a method for preventing collision errors in spacecraft assembly based on augmented reality.
[0053] Figure 1 is a flow chart of a method for preventing collision errors in spacecraft assembly based on augmented reality provided in this embodiment. Figure 2 is a schematic diagram of an assembly scenario provided in this embodiment, Figure 3 is a schematic diagram of the field of view of the assembler when moving in the target direction provided by this embodiment, Figure 4 This is one of the risk warning diagrams provided in this embodiment. Figure 5 This is the second risk warning diagram provided in this embodiment.
[0054] like Figure 1 As shown, the method for preventing collision errors in spacecraft assembly based on augmented reality provided by an embodiment of the present invention mainly includes the following steps:
[0055] 101. Construct a virtual scene including a risk envelope model, a human body model, and a tracked object model.
[0056] In a specific implementation process, such as Figure 2As shown, the assembler 1 wears an augmented reality helmet 2 and holds the product to be assembled 3 in both hands and walks in direction 4. During the walking process, he may collide with obstacles A and B. In order to ensure that the collision risk can be suppressed in time, a virtual scene is first established, that is, the assembly scene is virtualized, and a human model, a tracking object model and a risk envelope model are constructed in the virtual scene, and the current actual application scene is virtually restored through the virtual scene.
[0057] Among them, the risk envelope model refers to the area where collision may occur, determined based on the results of the collision risk assessment. That is, when a person comes into contact with the model, a risk warning is issued. The human body model refers to the parameters such as the virtual human body shape constructed in the virtual scene. The tracking object model refers to the construction of the product to be assembled in the virtual scene, so that the relative position relationship between the assembler, the risk area and the product to be assembled can be fully and accurately restored in the virtual scene.
[0058] Building a virtual scene can be understood as data accuracy, and data preparation provides data support and conditional support for subsequent personnel assembly.
[0059] 102. Based on the integration of virtual scenes and augmented reality helmets, the collision risk content is displayed to the assembly personnel.
[0060] Figure 3 Schematic diagram of the field of vision of the assembly personnel when moving in the target direction provided by this embodiment. Figure 3 As shown, after the assembly personnel 1 wears the augmented reality helmet 2, the augmented reality helmet 2 displays the collision risk area and related text descriptions to the personnel through the virtual-real fusion method. Figure 4 and Figure 5 As shown. That is, the helmet can be used to know whether a collision will occur at the moment, and voice and text prompts can also be given. The augmented reality helmet realizes the information exchange between the current real assembly scene and the virtual scene. Through the model calculation and judgment of the virtual scene, the information that a collision may occur is transmitted to the assembly personnel through the helmet, thereby realizing the integration of the virtual scene and the real scene to suppress and detect the collision.
[0061] After wearing the helmet, the field of vision when facing the +X direction is as follows: Figure 4 and Figure 5 As shown in the figure, the system indicates the risk area through the virtual-real fusion method. Among them, the obstacle A is outside the field of view, and the helmet prompts the direction of the risk area relative to the current field of view, such as Figure 4 As shown in the middle collision risk area 41 and the collision risk area 42, that is, the area within the range of 41 is the safe area of obstacle A, and obstacle B is within the field of view 43. The helmet marks its collision risk at obstacle B, as shown in FIG. Figure 551 indicates the collision risk area and 52 indicates the collision risk: medium. Be careful with the product to be installed. Figure 5 The visual field of the assembler 1 is the area shown in 53. Therefore, the visual field of the assembler 1 after wearing the augmented reality helmet 2 is as follows: Figure 4 and Figure 5 As shown, the collision risk area can be clearly seen, so that the assemblers can know the safe operation.
[0062] 103. Real-time position and posture tracking is performed on the assembler and the tracked object respectively to determine the real-time position and posture of the assembler and the tracked object.
[0063] Motion capture equipment can be used to determine the position and posture of a person's limbs in a virtual scene in real time based on human body tracking parameters; object tracking equipment can be used to identify and calculate the position and posture of an object in a virtual scene in real time based on object tracking parameters. Motion capture equipment can be used to identify the position and posture of assembly personnel; object tracking equipment can be used to identify the position and posture of the product to be assembled based on the real-time image recognition of the QR code.
[0064] 104. Synchronize the real-time positions and postures of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene.
[0065] According to the human posture calculated by the motion capture module, synchronize the human model in the virtual scene to move to the same position and pose; according to the posture of the moving object calculated by the object tracking system, synchronize the corresponding object model in the virtual scene to the corresponding posture. Synchronize the posture of the human model in the virtual scene and the tracked object model to be consistent with the actual personnel and products.
[0066] By synchronizing the human body model and the tracking object model into the virtual scene, the virtual scene can accurately feedback the relationship between the relative position changes of the assembly personnel, objects and risk areas.
[0067] 105. The risk envelope model in the virtual scene is traversed to determine the geometric interference data of the synchronized human body model and the tracking object model.
[0068] The risk envelope model in the virtual scene is traversed to confirm whether each risk envelope model has collided with the human model or the tracked object model, or is about to collide. By calculating the geometric interference data between envelopes of different risk levels and the human model and moving object model in the virtual scene, risk warnings can be given.
[0069] Among them, different levels of risk envelope models refer to the generation of different envelope models for the same product at different distances from the product. The closer the distance, the higher the risk level, and the farther the distance, the lower the risk level. Therefore, it is also possible to determine the level of risk or warning based on the interference with the level of the risk envelope model when the geometric interference data occurs.
[0070] Traverse the high / medium / low risk envelope model of obstacle A and the high / medium / low risk envelope of obstacle B to calculate whether there is geometric interference between them and the human body model and the tracking object model of the product to be assembled in the virtual scene. Figure 3 As shown, it is assumed that the product to be assembled has been in contact with the low-risk envelope of obstacle B ( Figure 3 Medium B3), medium risk envelope ( Figure 3 If interference occurs in B2), the augmented reality helmet will be triggered to issue a collision risk prompt, and a collision warning will be generated at this time.
[0071] 106. Based on geometric interference data, adjust the collision risk content, which includes the collision area and collision level.
[0072] According to the interference of the risk envelope model, the risk level of the geometric interference data is determined, including low risk level, medium risk level and high risk level. That is, when geometric interference occurs with the innermost envelope model of the risk envelope model, the risk level is determined to be high; when geometric interference occurs with the middle envelope model of the risk envelope model, the risk level is determined to be medium; when geometric interference occurs with the outermost envelope model of the risk envelope model, the risk level is determined to be low.
[0073] Based on the different risk levels, corresponding risk warnings are issued. As the highest risk level of interference increases, a flashing effect from slow to fast is added to the risk area, and a warning sound from slow to fast is issued. In addition, a medium-risk warning prompt box can be displayed in the helmet, the model of obstacle B flashes at a faster frequency, and the helmet emits a more rapid "beep-beep" warning sound to inform the general assemblers and enable them to understand the products that may collide or have collided in the risk area.
[0074] Further, on the basis of the above-mentioned embodiment, before constructing a virtual scene including a risk envelope model, a human body model and a tracking object model in this embodiment, it includes: determining the possible collision products and areas in the virtual scene to obtain the risk area; generating an equidistant envelope model of a risk level different from the risk area in the virtual scene, and binding the equidistant envelope model to the risk area to obtain the risk envelope model. Generating an equidistant envelope model of a risk level different from the risk area in the virtual scene includes: determining different risk levels based on the risk area; generating different equidistant envelope models based on different risk levels; wherein the distance of the envelope model corresponding to the low risk level is greater than the distance of the envelope model corresponding to the medium risk level, and the distance of the envelope model corresponding to the medium risk level is greater than the distance of the envelope model corresponding to the high risk level.
[0075] Specifically, firstly, according to the risk level results, the products and corresponding areas that may collide are determined as risk areas in the virtual scene, such as Figure 2 Obstacles A and B in the figure are products that may collide, and their corresponding areas are risk areas. Define different distances of isometric surfaces corresponding to different collision risk levels. The distance corresponding to low risk is larger than that corresponding to high risk. Generate isometric envelope models of different collision risk levels in the risk area in the virtual scene. Figure 3 As shown in the figure, the isometric envelope model of the three types of collision risks of obstacles A, B and B is illustrated. The risk envelope model corresponds to high risk, medium risk and low risk from the inside to the outside. That is, the closer the distance to obstacle A or obstacle B, the higher the risk of surface collision. Figure 3 The corresponding risk relationship of medium obstacle A is A1 for high risk, A2 for medium risk, and A3 for low risk. The corresponding risk relationship of obstacle B is B1 for high risk, B2 for medium risk, and B3 for low risk. The risk envelope model needs to be bound to the virtual scene, that is, the two are integrated and their relative positions will not change, so as to ensure the accuracy of the virtual scene's simulation of reality.
[0076] Furthermore, based on the above embodiments, after determining the risk envelope model, it is necessary to enter human body tracking parameters, that is, to simulate human body information in a virtual scene, including determining human body characteristic parameters based on motion capture; and constructing a human body model corresponding to the human body characteristic parameters in the virtual scene.
[0077] Specifically, the human body characteristic parameters include height, arm length, shoulder width and other human body characteristic parameters, which are used to characterize the area occupied by a person in a virtual space, so that a virtual scene can be used to simulate whether a collision occurs in a real scene. The positional relationship between the human body model and the risk area in the virtual scene is consistent with the positional relationship in the actual scene.
[0078] Similarly, after entering the human body feature parameters into the virtual scene, the tracking object parameters also need to be entered into the virtual scene. Based on object tracking, the feature identification parameters of the running object in the assembly process are determined; based on the feature identification parameters, a tracking object model is constructed in the virtual scene.
[0079] Specifically, the tracking object refers to the product to be assembled, and the characteristic identification parameters of the object include: at least one of the number, appearance and QR code of the tracking target, such as Figure 3 3 shows a tracking object. After the parameters of the tracking object are entered into the virtual scene, the relationship between the tracking object, the human body and the risk area is established. After the human body moves, in order to ensure that the tracking object is identified, a QR code 31 is set on the tracking object. By identifying the QR code 31, the tracking object can be better identified.
[0080] Therefore, a complete virtual scene was constructed, including the risk areas corresponding to obstacles, human body models and tracked object models. During the assembly process, the virtual scene and risk areas are fixed, and the human body and tracked objects are moving. Therefore, during the movement, the position and posture of the human body model are adjusted in real time through motion capture to ensure consistency with the real scene. At the same time, the position and posture of the tracked object are updated through QR code scanning, which ensures the consistency of the human body and objects in the assembly process with the reality and effectively avoids the risk of collision.
[0081] The specific application process can be that after determining the product assembly space, a virtual space is constructed for the assembly space, and then the risk area caused by obstacles, the human body model and the tracking object model are synchronized to the virtual scene in the virtual space to obtain a virtual scene that is completely consistent with the actual assembly space. Then, during the assembly process of the general assemblers, the posture information of the personnel is updated in real time through motion capture, and the posture information of the tracking object is updated in real time by identifying the QR code of the tracking object. After the general assemblers or the tracking objects enter the risk area, corresponding prompts are issued, and different alarms are issued for different risk areas to reflect different risk levels. At the same time, the shape of the obstacle can also be displayed on the helmets worn by the general assemblers to remind the general assemblers in a clearer way, thereby better avoiding collisions. Figure 4 and Figure 5 The figure below shows the assembler's field of view, which displays the risk level in a text box and indicates the location and shape of obstacles.
[0082] In the process of augmented reality-guided spacecraft assembly operations, the present invention visualizes the pre-marked risk areas, monitors the positions and postures of assembly personnel and operated products, and performs real-time interference checks on personnel limbs or products and different equidistant envelopes of risk areas. When interference occurs, the operator is warned according to the warning level represented by the envelope to prevent risks such as collisions. Using discrete equidistant envelopes as a collision risk assessment tool has a clear concept, is easy to implement, is highly editable, and has a low computational load. Combined with personnel posture capture, collision risks are monitored to improve the real-time nature of risk warnings. The intuitiveness of risk warnings is improved through a risk warning method that integrates virtual and real elements.
[0083] Based on the same general inventive concept, the present invention also protects a device for preventing collision type errors in spacecraft assembly based on augmented reality. The device for preventing collision type errors in spacecraft assembly based on augmented reality provided by the present invention is described below. The device for preventing collision type errors in spacecraft assembly based on augmented reality described below and the method for preventing collision type errors in spacecraft assembly based on augmented reality described above can be referenced to each other.
[0084] Figure 6 It is a schematic diagram of the structure of the device for preventing collision errors in spacecraft assembly based on augmented reality provided in this embodiment.
[0085] like Figure 6 As shown, the present embodiment provides a spacecraft assembly collision error risk suppression device based on augmented reality, comprising:
[0086] A construction module 601 is used to construct a virtual scene including a risk envelope model, a human body model and a tracking object model;
[0087] A display module 602 is used to display collision risk content to the assembly personnel based on the virtual and real fusion of virtual scenes and augmented reality helmets;
[0088] A determination module 603 is used to respectively track the real-time posture of the assembler and the tracked object, and determine the real-time posture of the assembler and the tracked object;
[0089] A synchronization module 604 is used to synchronize the real-time positions and postures of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene;
[0090] A monitoring module 605 is used to traverse the risk envelope model in the virtual scene and determine the geometric interference data of the synchronized human body model and the tracking object model;
[0091] The prompt module 606 is used to adjust the collision risk content based on the geometric interference data, and the collision risk content includes the collision area and the collision level.
[0092] Furthermore, the construction module 601 in this embodiment is specifically used for:
[0093] Determine the products and areas that may collide in the virtual scene and obtain the risk area;
[0094] An equidistant envelope model of a risk level different from that of the risk area is generated in a virtual scene, and the equidistant envelope model is bound to the risk area to obtain a risk envelope model.
[0095] Furthermore, the construction module 601 in this embodiment is specifically used for:
[0096] Based on the risk areas, different risk levels are determined;
[0097] generating different isometric volume models based on different risk levels;
[0098] Among them, the distance of the envelope model corresponding to the low risk level is greater than that of the envelope model corresponding to the medium risk level, and the distance of the envelope model corresponding to the medium risk level is greater than that of the envelope model corresponding to the high risk level.
[0099] Furthermore, the construction module 601 in this embodiment is specifically used for:
[0100] Determine human body characteristic parameters based on motion capture;
[0101] A human body model corresponding to the human body characteristic parameters is constructed in the virtual scene.
[0102] Furthermore, the construction module 601 in this embodiment is specifically used for:
[0103] Based on object tracking, determine the characteristic identification parameters of the running objects in the assembly process;
[0104] Based on the feature identification parameters, a tracking object model is constructed in the virtual scene.
[0105] Furthermore, the characteristic identification parameter in this embodiment includes at least one of the number, appearance and QR code of the tracking target.
[0106] Furthermore, the prompt module 606 in this embodiment is specifically used for:
[0107] determining a risk level of the geometric interference data;
[0108] Based on the different risk levels, corresponding risk warnings are issued.
[0109] Furthermore, the prompt module 606 in this embodiment is specifically used for:
[0110] When the risk level is low risk or medium risk, different prompts such as light and sound are emitted;
[0111] When the risk level is a high risk, the obstacle model flashes in the helmet prompt box.
[0112] Figure 7 It is a schematic diagram of the structure of the electronic device provided in this embodiment.
[0113] like Figure 7 As shown, the electronic device may include: a processor (processor) 710, a communication interface (Communications Interface) 720, a memory (memory) 730 and a communication bus 740, wherein the processor 710, the communication interface 720, and the memory 730 communicate with each other through the communication bus 740. The processor 710 can call the logic instructions in the memory 730 to execute a method for suppressing spacecraft assembly collision errors based on augmented reality, the method comprising: constructing a virtual scene including a risk envelope model, a human body model and a tracking object model; displaying collision risk content to the assembly personnel based on the virtual-real fusion of the virtual scene and the augmented reality helmet; performing real-time posture tracking on the assembly personnel and the tracking object respectively to determine the real-time posture of the assembly personnel and the tracking object; synchronizing the real-time posture of the assembly personnel and the tracking object to the human body model and the tracking object model in the virtual scene; traversing the risk envelope model in the virtual scene to determine geometric interference data with the synchronized human body model and the tracking object model; and adjusting the collision risk content based on the geometric interference data, the collision risk content including the collision area and the collision level.
[0114] In addition, the logic instructions in the above-mentioned memory 730 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0115] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the augmented reality-based spacecraft assembly collision error risk suppression method provided by the above methods, the method including: constructing a virtual scene including a risk envelope model, a human body model and a tracking object model; based on the virtual-real fusion of the virtual scene and the augmented reality helmet, displaying the collision risk content to the assembly personnel; performing real-time posture tracking on the assembly personnel and the tracking object respectively to determine the real-time posture of the assembly personnel and the tracking object; synchronizing the real-time posture of the assembly personnel and the tracking object to the human body model and the tracking object model in the virtual scene; traversing the risk envelope model in the virtual scene to determine the geometric interference data with the synchronized human body model and the tracking object model; adjusting the collision risk content based on the geometric interference data, the collision risk content including the collision area and the collision level.
[0116] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the augmented reality-based spacecraft assembly collision error risk suppression method provided by the above-mentioned methods, the method comprising: constructing a virtual scene including a risk envelope model, a human body model and a tracking object model; based on the virtual-real fusion of the virtual scene and the augmented reality helmet, displaying the collision risk content to the assembler; performing real-time posture tracking on the assembler and the tracking object respectively to determine the real-time posture of the assembler and the tracking object; synchronizing the real-time posture of the assembler and the tracking object to the human body model and the tracking object model in the virtual scene; traversing the risk envelope model in the virtual scene to determine the geometric interference data with the synchronized human body model and the tracking object model; adjusting the collision risk content based on the geometric interference data, the collision risk content including the collision area and the collision level.
[0117] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0118] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.
[0119] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for preventing collision errors in spacecraft assembly based on augmented reality. It is characterized in that include: Construct a virtual scene including a risk envelope model, a human model, and a tracked object model; Based on the virtual-real fusion of the virtual scene and the augmented reality helmet, the collision risk content is displayed to the general assembly personnel; Performing real-time posture tracking on the assembler and the tracked object respectively to determine the real-time posture of the assembler and the tracked object; Synchronizing the real-time postures of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene; Traversing the risk envelope model in the virtual scene to determine geometric interference data with the synchronized human body model and tracking object model; Based on the geometric interference data, the collision risk content is adjusted, and the collision risk content includes a collision area and a collision level.
2. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 1, It is characterized in that Before constructing the virtual scene including the risk envelope model, the human body model and the tracking object model, the method includes: Determine the products and areas that may collide in the virtual scene and obtain the risk area; An equidistant envelope model of a risk level different from that of the risk area is generated in a virtual scene, and the equidistant envelope model is bound to the risk area to obtain a risk envelope model.
3. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 2, It is characterized in that The step of generating an equidistant envelope model of a risk level different from that of the risk area in a virtual scene comprises: Based on the risk areas, different risk levels are determined; generating different isometric volume models based on different risk levels; Among them, the distance of the envelope model corresponding to the low risk level is greater than that of the envelope model corresponding to the medium risk level, and the distance of the envelope model corresponding to the medium risk level is greater than that of the envelope model corresponding to the high risk level.
4. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 2, It is characterized in that Also includes: Determine human body characteristic parameters based on motion capture; A human body model corresponding to the human body characteristic parameters is constructed in the virtual scene.
5. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 4, It is characterized in that Also includes: Based on object tracking, determine the characteristic identification parameters of the running objects in the assembly process; Based on the feature identification parameters, a tracking object model is constructed in the virtual scene.
6. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 5, It is characterized in that The characteristic identification parameter includes at least one of the number, appearance and QR code of the tracking target.
7. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 1, It is characterized in that The adjusting the collision risk content based on the geometric interference data, wherein the collision risk content includes a collision area and a collision level, comprises: determining a risk level of the geometric interference data; Based on the different risk levels, corresponding risk warnings are issued.
8. The method for preventing collision errors in spacecraft assembly based on augmented reality according to claim 7, It is characterized in that The issuing of corresponding risk warnings based on the different risk levels includes: When the risk level is low risk or medium risk, different prompts such as light and sound are emitted; When the risk level is a high risk, the obstacle model flashes in the helmet prompt box.
9. A spacecraft assembly collision error risk suppression device based on augmented reality. It is characterized in that include: A construction module, used for constructing a virtual scene including a risk envelope model, a human body model and a tracked object model; A display module, used to display collision risk content to the general assembly personnel based on the virtual and real fusion of the virtual scene and the augmented reality helmet; A determination module, used to respectively perform real-time posture tracking on the assembler and the tracked object, and determine the real-time posture of the assembler and the tracked object; A synchronization module, used to synchronize the real-time postures of the assembly personnel and the tracked object to the human body model and the tracked object model in the virtual scene; A monitoring module, configured to traverse the risk envelope model in the virtual scene and determine geometric interference data with the synchronized human body model and the tracking object model; The prompt module is used to adjust the collision risk content based on the geometric interference data, and the collision risk content includes a collision area and a collision level.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the program, the method for suppressing the risk of collision errors in spacecraft assembly based on augmented reality as described in any one of claims 1 to 8 is implemented.
Citation Information
Cited By
Collision risk early warning method and system based on foresight camera of unmanned ship
CN121392517A
