Carrier rocket assembling method and system based on VR panoramic image technology

Abstract

The invention provides a carrier rocket assembly method and system based on a VR panoramic image technology, and the method comprises the steps: S1, obtaining basic data of a carrier rocket, and constructing a VR panoramic image of the carrier rocket; s2, acquiring design data, drawing on the VR panorama to obtain an initial effect picture of the product, and splitting the initial effect picture according to assembly positions and stages to obtain corresponding assembly effect pictures; and S3, obtaining an assembly flow chart according to the assembly effect chart. According to the method, the VR panoramic image technology is utilized, a carrier rocket assembly scheme is planned in advance, the rework and repair problems caused by direct assembly are avoided, and the assembly guidance is enhanced; the VR panoramic sound image data of each assembly stage is collected and is recorded as the process quality data of the corresponding stage, so that the validity and traceability of the process quality data are improved.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a launch vehicle assembly method and system based on VR panoramic imaging technology. Background Art

[0002] In the current launch vehicle assembly field, some launch vehicle assembly methods are to directly carry out assembly operations based on design drawings. However, the internal structure of the launch vehicle itself is extremely complex, and the number of products that need to be assembled is huge. In this case, direct assembly without simulation can easily lead to a messy layout of the products inside the rocket after the assembly is completed. This messy layout may lead to a large amount of unnecessary rework and repair work, seriously affecting assembly efficiency, and greatly increasing the possibility of quality problems, posing a potential threat to the overall performance and safety of the rocket.

[0003] In addition, during the launch vehicle assembly process, the existing method is mostly to record the product status by taking photos. However, two-dimensional photos have obvious limitations. They can only present image information from a single angle and contain limited elements. Moreover, these photos are poorly correlated and cannot show the spatial characteristics of the product status, making it difficult for staff to fully understand the true status of the product inside the rocket. More importantly, these unrelated photos face huge difficulties in subsequent inquiries, tracing and summarization. This not only makes the product's image data package incomplete and unable to provide sufficient data support for subsequent analysis and improvement, but also leads to low data utilization and a large amount of valuable information resources being wasted, which is not conducive to the continuous improvement and perfection of the launch vehicle assembly technology.

[0004] Through searching patent documents, it was found that the invention patent with publication number CN110717964A discloses a scene modeling method, terminal and readable storage medium. The scene modeling method includes digitally modeling the scene, obtaining vertex data of the scene model; obtaining a panoramic library of the scene; obtaining the UV coordinates of the vertex according to the panoramic image and vertex data in the panoramic library; obtaining the texture for rendering according to the panoramic library and UV coordinates; using the texture to render the scene model, and outputting the scene model with material. This patent requires a large amount of image or video data, and the whole process is relatively complicated, involving a large amount of data processing and calculation, and the cost is high.

[0005] In summary, the existing launch vehicle assembly method has serious deficiencies in the assembly process and status recording. Researching a launch vehicle assembly method and system based on VR panoramic imaging technology has become a key task that needs to be solved urgently. Summary of the invention

[0006] In view of the defects in the prior art, the purpose of the present invention is to provide a launch vehicle assembly method and system based on VR panoramic imaging technology.

[0007] A launch vehicle assembly method based on VR panoramic imaging technology provided by the present invention comprises the following steps: Step S1, obtaining basic data of the launch vehicle and constructing a VR panoramic image of the launch vehicle; Step S2, obtaining design data and drawing it on the VR panoramic view to obtain the initial rendering of the product, and splitting the initial rendering according to assembly position and stage to obtain the corresponding assembly rendering; Step S3, obtaining an assembly flow chart according to the assembly effect diagram.

[0008] Preferably, step S1 includes the following sub-steps: Step S1.1, obtaining basic data of the launch vehicle by physical photography or scanning; Step S1.2, rendering and fitting the basic data to generate a VR panoramic image of the launch vehicle.

[0009] Preferably, step S2 includes the following sub-steps: Step S2.1, based on the design data, manually draw the product shape and place the length, width and height of the product at the specified position of the VR panorama, or select the product from the model library and insert it into the specified position of the VR panorama, so as to obtain the initial rendering of the product; Step S2.2, splitting the initial rendering of the product to obtain assembly renderings at different positions and stages.

[0010] Preferably, in step S2.2, the splitting process is: splitting the initial rendering of the product by position according to the structural characteristics of the launch vehicle to obtain the assembly rendering of a specific position, and then splitting the initial rendering of the product by stage according to the different assembly stages of the product to arrange and display the assembly renderings of each stage according to the timeline.

[0011] Preferably, step S3 includes the following sub-steps: Step S3.1, generating two-dimensional and three-dimensional assembly schematic diagrams based on the assembly renderings; Step S3.2, based on the assembly schematic diagram, analyze the connection relationship and assembly sequence of the parts, select the assembly schematic diagrams corresponding to the assembly steps, and combine them into an assembly flow chart according to the assembly sequence.

[0012] Preferably, the launch vehicle assembly method also includes step S4, during the launch vehicle assembly process, real-time collection of panoramic audio and video data of the launch vehicle, and construction of VR panoramic audio and video records of different assembly stages; the VR panoramic audio and video records of different assembly stages are used as process quality records under current working conditions; and then a VR acquisition record structure tree model is constructed to store the VR panoramic audio and video records in a storage medium to achieve structured management.

[0013] The present invention also provides a launch vehicle assembly system based on VR panoramic imaging technology, comprising: Module A, obtains the basic data of the launch vehicle and constructs a VR panoramic view of the launch vehicle; Module B, obtains design data and draws it on the VR panorama to obtain the initial rendering of the product, and then splits the initial rendering according to assembly position and stage to obtain the corresponding assembly rendering; Module C, obtains the assembly flow chart based on the assembly effect diagram.

[0014] Preferably, the launch vehicle assembly system further comprises: a user interaction module and a detection and evaluation module; The user interaction module is used to support users to obtain assembly process data in real time to guide assembly operations; The detection and evaluation module conducts intelligent comparison and analysis between the VR panoramic image of the completed assembly and the assembly rendering, detects the correctness of the assembly and returns the evaluation conclusion.

[0015] Preferably, the user interaction module uses a VR head display device to obtain assembly process data in real time, and the assembly process data includes assembly renderings and assembly process routes.

[0016] Preferably, when the product is assembled in stages, the detection and evaluation module collects a VR panoramic image of the product at the current stage, and detects the installation position, direction and number of standard parts based on the assembly results; the collected VR panoramic image of the product at the current stage is intelligently detected and compared with the pre-set assembly rendering of the product, and the difference analysis results are obtained through image analysis and data processing technology, and the difference analysis results are marked and displayed on the VR panoramic image.

[0017] Compared with the prior art, the present invention has the following beneficial effects: 1. The present invention uses VR panoramic imaging technology to plan the launch vehicle assembly plan in advance, avoid rework and repair problems caused by direct assembly, and enhance the guidance of the assembly process; 2. The present invention collects VR panoramic audio and video data at each stage and records it as process quality data at each stage, thereby improving the validity and traceability of launch vehicle assembly image data.

[0018] 3. The present invention also has the function of object size measurement and value transmission. By capturing the pixel points of the image, the size information of the object can be accurately measured, and the information can be transmitted to terminal devices such as servers and VR glasses. This function avoids the inefficiency and tediousness of manual measurement, improves measurement efficiency, and optimizes the display effect of the terminal device. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings: Figure 1 It is a flowchart of a launch vehicle assembly method based on VR panoramic imaging technology in an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several changes and improvements can also be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0021] Embodiment 1: Figure 1 It is a flowchart of a launch vehicle assembly method based on VR panoramic imaging technology in an embodiment of the present invention.

[0022] like Figure 1 As shown, this embodiment provides a launch vehicle assembly method based on VR panoramic imaging technology, comprising the following steps: Step S1, obtaining basic data of the launch vehicle and constructing a VR panoramic image of the launch vehicle.

[0023] Specifically, step S1 includes the following sub-steps: Step S1.1, obtaining basic data of the launch vehicle by physical photography or scanning.

[0024] In this embodiment, a panoramic camera or a three-dimensional laser scanner is used to perform three-dimensional photography or scanning of the entire or partial compartment of the launch vehicle. By scanning the object, the size information can be obtained synchronously through the pixel points, realizing the object size measurement and value transmission function.

[0025] Step S1.2, rendering and fitting the basic data to generate a VR panoramic image of the launch vehicle.

[0026] In this embodiment, the basic data is imported into the VR processing system for rendering and fitting to obtain a VR panoramic view of the entire launch vehicle or a partial compartment.

[0027] Step S2, obtaining design data, and drawing it on the VR panoramic view to obtain the initial rendering of the product, and splitting the initial rendering according to assembly position and stage to obtain the corresponding assembly rendering.

[0028] Specifically, step S2 includes the following sub-steps: Step S2.1, based on the design data, manually draw the product shape and place the length, width, and height of the product at the specified position of the VR panorama, or select the product from the model library and insert it into the specified position of the VR panorama, so as to obtain the initial rendering of the product.

[0029] Specifically, when drawing manually, the product's length, width, height and other dimensions are drawn in the VR panorama according to the design data, and the product is placed at a specific position in the VR panorama to obtain the product's rendering. When selecting a product to insert from the model library, the design data is used to determine which model to select from the library, and the designated position of the model in the VR panorama is determined to ensure that it meets the overall assembly requirements of the rocket, so that the final product rendering can accurately reflect the actual situation of the product in the assembly scene, and it is more convenient to add through the model library.

[0030] Step S2.2, splitting the initial rendering of the product to obtain assembly renderings at different positions and stages.

[0031] In this embodiment, the splitting process is as follows: the initial rendering of the product is split by position according to the structural characteristics of the launch vehicle to obtain assembly renderings of specific positions such as the fuel tank, oxidizer tank, inter-tank section, tail section, engine compartment, etc., and then the initial rendering of the product is split by stage according to the different assembly stages of the product to display the assembly renderings of each stage according to the timeline.

[0032] In this embodiment, the assembly effect diagram at a specific position is a VR assembly effect diagram.

[0033] In this way, on the one hand, the assembly rendering can be focused on a specific structural compartment; on the other hand, the product assembly sequence can be better displayed according to the timeline. The existing two-dimensional and three-dimensional assembly drawings put all the assembly products in the drawings, which has poor guidance for the actual assembly process of the product.

[0034] In this embodiment, the assembly effect diagram explains the assembly position and assembly method of the product by inserting text, pictures, videos and audio, where the assembly position is the exact coordinate information of the product installation, and the assembly method is the assembly method when the product is assembled. For example, in sensor assembly, it includes the type and amount of glue, the specifications and quantity of standard parts, and the style of fuses. When inserting a picture, the text information in the picture and the VR panorama is recognized by OCR, and the picture is automatically added to the position of the same mark in the VR panorama after matching.

[0035] Step S3, obtaining an assembly flow chart according to the assembly effect diagram.

[0036] Specifically, step S3 includes the following sub-steps: Step S3.1, generating two-dimensional and three-dimensional assembly schematic diagrams based on the assembly renderings.

[0037] In this embodiment, based on the assembly rendering, key assembly information is extracted, a two-dimensional assembly schematic diagram is generated according to standard engineering drawing specifications, and a three-dimensional assembly model is constructed based on the spatial data in the assembly rendering to generate a three-dimensional assembly schematic diagram.

[0038] Step S3.2, based on the assembly schematic diagram, analyze the connection relationship and assembly sequence of the parts, select the assembly schematic diagrams corresponding to the assembly steps, and combine them into an assembly flow chart according to the assembly sequence.

[0039] Furthermore, by identifying the product in the assembly diagram, a detailed assembly method description of the product is obtained. The assembly diagram has two-dimensional and three-dimensional modes to guide assembly, the assembly flow chart clarifies the assembly sequence, and the assembly method description can pop up when the product is selected to ensure assembly quality.

[0040] Step S4, during the launch vehicle assembly process, the panoramic audio and video data of the launch vehicle is collected in real time to construct VR panoramic audio and video records of different assembly stages; the VR panoramic audio and video records of different assembly stages are used as process quality records under the current working conditions; then, by constructing a VR acquisition record structure tree model, the VR panoramic audio and video records are stored in a storage medium to achieve structured management.

[0041] Embodiment 2: The present embodiment provides a launch vehicle assembly system based on VR panoramic imaging technology. The launch vehicle assembly system based on VR panoramic imaging technology can be implemented by executing the process steps of the launch vehicle assembly method based on VR panoramic imaging technology. That is, those skilled in the art can understand the launch vehicle assembly method based on VR panoramic imaging technology as a preferred implementation mode of the launch vehicle assembly system based on VR panoramic imaging technology.

[0042] The launch vehicle assembly system includes: Module A, obtains the basic data of the launch vehicle and constructs a VR panoramic view of the launch vehicle; Module B, obtains design data and draws it on the VR panorama to obtain the initial rendering of the product, and then splits the initial rendering according to assembly position and stage to obtain the corresponding assembly rendering; Module C, obtains the assembly flow chart based on the assembly effect diagram.

[0043] The user interaction module is used to support users to obtain assembly process data in real time to guide assembly operations.

[0044] Specifically, the user interaction module uses the VR head display device to obtain assembly process data in real time, and the assembly process data includes assembly renderings and assembly process routes.

[0045] In this embodiment, the user uses a VR headset to view the assembly rendering of the product and enter a virtual assembly space, in which the user can see through the product assembly structure and freely enlarge, rotate, and decompose the product through gestures or voice control, breaking through the limitations of time and space and intuitively viewing information such as assembly requirements of related products. In addition, the user can select any assembly process route from the assembly resource library as needed, and then carry out assembly operations according to the process requirements, thereby improving the convenience and accuracy of assembly operations.

[0046] The detection and evaluation module conducts intelligent comparison and analysis between the VR panoramic image of the completed assembly and the assembly rendering, detects the correctness of the assembly and returns the evaluation conclusion.

[0047] In this embodiment, the detection and evaluation module begins to intervene during the staged assembly of the product. When the product is assembled in stages, the detection and evaluation module collects the VR panoramic image of the product at the current stage, and detects key elements such as the installation position, direction, and number of standard parts based on the assembly results. Then, the collected VR panoramic image of the product at the current stage is intelligently detected and compared with the pre-set assembly effect diagram of the product, and the difference analysis results are obtained through image analysis and data processing technology, and the difference analysis results are marked and displayed on the VR panoramic image. Users can conduct further in-depth inspections and verifications based on these annotation information to confirm that the assembly results are accurate, effectively ensuring the quality and accuracy of the entire launch vehicle assembly, and ensuring that the assembly process meets design requirements and safety standards.

[0048] This embodiment uses VR panoramic imaging technology to provide an integrated VR intelligent assembly system of "assembly process design - assembly guidance implementation - assembly detection and evaluation". It realizes the organic integration of product design models and real panoramic images, and transforms traditional design drawings, process specifications, etc. presented in the form of text and pictures into three-dimensional panoramic assembly renderings, which improves the visualization level of assembly schemes and thus improves assembly efficiency. Human-computer interaction is achieved through VR head displays and other devices, and the assembly scheme of the product is presented in a virtual space, and the real assembly scene is restored in a 1:1 ratio, breaking through the dual limitations of time and space. Not only that, the detection and evaluation module equipped in the system can carry out intelligent detection and accurate interpretation of assembly results, and improve the quality assurance level of assembly. The launch vehicle assembly system of this VR panoramic imaging technology includes the entire process and cycle of launch vehicle assembly from scheme design, scheme execution to result detection, providing a comprehensive system solution for launch vehicle assembly work, and comprehensively improving the assembly level, efficiency and quality of launch vehicles from all dimensions.

[0049] Those skilled in the art know that, in addition to realizing the system and its various devices, modules, and units provided by the present invention in a purely computer-readable program code, it is entirely possible to realize the same functions in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, the system and its various devices, modules, and units provided by the present invention can be considered as a hardware component, and the devices, modules, and units included therein for realizing various functions can also be regarded as structures within the hardware component; the devices, modules, and units for realizing various functions can also be regarded as both software modules for realizing the method and structures within the hardware component.

[0050] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. In the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.

Claims

1. A launch vehicle assembly method based on VR panoramic imaging technology, characterized in that: The steps include: Step S1, obtaining basic data of a launch vehicle and constructing a VR panoramic image of the launch vehicle; Step S2, obtaining design data, and drawing on the VR panoramic view to obtain an initial rendering of the product, and splitting the initial rendering according to assembly position and stage to obtain a corresponding assembly rendering; The step S2 includes the following sub-steps: Step S2.1, based on the design data, manually draw the product shape and place the length, width and height of the product at the specified position of the VR panoramic image, or select a product from a model library and insert it into the specified position of the VR panoramic image, so as to obtain an initial rendering of the product; Step S2.2, splitting the initial rendering of the product to obtain assembly renderings at different positions and stages; Step S3, obtaining an assembly flow chart according to the assembly effect diagram; The step S3 includes the following sub-steps: Step S3.1, generating two-dimensional and three-dimensional assembly schematic diagrams based on the assembly rendering; Step S3.2, based on the assembly schematic diagram, analyze the connection relationship and assembly sequence of the parts, select the assembly schematic diagrams corresponding to the assembly steps, and combine them into an assembly flow chart according to the assembly sequence.

2. A launch vehicle assembly method based on VR panoramic imaging technology according to claim 1, characterized in that: The step S1 includes the following sub-steps: Step S1.1, obtaining basic data of the launch vehicle by physical photography or scanning; Step S1.2, rendering and fitting the basic data to generate a VR panoramic image of the launch vehicle.

3. The launch vehicle assembly method based on VR panoramic imaging technology according to claim 1 is characterized in that: In step S2.2, the splitting process is: according to the structural characteristics of the launch vehicle, the initial rendering of the product is split by position to obtain the assembly rendering of a specific position, and then the initial rendering of the product is split by stage according to the different assembly stages of the product to arrange and display the assembly renderings of each stage according to the timeline.

4. The launch vehicle assembly method based on VR panoramic imaging technology according to claim 1 is characterized in that: The launch vehicle assembly method also includes step S4, during the launch vehicle assembly process, real-time acquisition of panoramic audio and video data of the launch vehicle, and construction of VR panoramic audio and video records of different assembly stages; using the VR panoramic audio and video records of different assembly stages as process quality records under current working conditions; and then storing the VR panoramic audio and video records in a storage medium by constructing a VR acquisition record structure tree model to achieve structured management.

5. A launch vehicle assembly system based on VR panoramic imaging technology, characterized in that: include: Module A, obtaining basic data of the launch vehicle and constructing a VR panoramic view of the launch vehicle; Module B, obtains design data and draws it on the VR panoramic view to obtain an initial rendering of the product, and splits the initial rendering according to assembly positions and stages to obtain corresponding assembly renderings; Module C obtains an assembly flow chart according to the assembly effect diagram.

6. The launch vehicle assembly system based on VR panoramic imaging technology according to claim 5, characterized in that: The launch vehicle assembly system also includes: a user interaction module and a detection and evaluation module; The user interaction module is used to support users to obtain assembly process data in real time to guide assembly operations; The detection and evaluation module performs intelligent comparison and analysis on the assembled VR panoramic image and the assembly rendering, detects the correctness of the assembly and returns the evaluation conclusion.

7. The launch vehicle assembly system based on VR panoramic imaging technology according to claim 6 is characterized in that: The user interaction module uses a VR head display device to obtain assembly process data in real time, and the assembly process data includes an assembly effect diagram and an assembly process route.

8. The launch vehicle assembly system based on VR panoramic imaging technology according to claim 6 is characterized in that: When the product is assembled in stages, the detection and evaluation module collects a VR panoramic image of the product at the current stage, and detects the installation position, direction and number of standard parts based on the assembly results; the collected VR panoramic image of the product at the current stage is intelligently detected and compared with the pre-set assembly effect diagram of the product, and the difference analysis results are obtained through image analysis and data processing technology, and the difference analysis results are marked and displayed on the VR panoramic image.

Images