Multi-person cooperation method for gas turbine assembly guidance based on mixed reality technology

Abstract

The invention aims to provide a gas turbine assembly guidance multi-person cooperation method based on a mixed reality technology. The method comprises the following steps: establishing a typical part assembly process database of a system; modeling is carried out on the typical part technology, and a system three-dimensional model database is established; building a system virtual environment for the three-dimensional simulation model; generating a three-dimensional model preform; manufacturing typical parts of the gas turbine system suitable for the mixed reality environment; generating a gas turbine assembly guidance multi-person cooperation environment; performing system integration on the three-dimensional model prefabricated body and a multi-person collaborative environment, and designing and developing multi-person collaborative assembly guidance training; designing and developing a man-machine interaction function, and integrating the man-machine interaction function with a training system; students use the system to perform function testing and guide the students to complete core component assembly. According to the invention, a highly immersive and portable discussion, review, training and operation environment of virtual-real combination and multi-person collaborative interaction can be provided for personnel in links of design, process, production, assembly and the like.

Description

Technical Field

[0001] The present invention relates to a gas turbine assembly method, specifically a multi-person collaborative method for gas turbine assembly. Background Art

[0002] The overall assembly of a gas turbine needs to be carried out in an orderly manner according to a series of steps such as parts, components, sub-assemblies, and finally general assembly docking. During the assembly process, workers need to constantly refer to drawings and technical documents to ensure the accurate and efficient assembly of tens of thousands of parts in accordance with the operation steps, operation methods, and assembly standards. In the actual process, workers refer to drawings and processes while assembling, with cumbersome operations and great difficulty in reading drawings. Since the gas turbine assembly takes a long time, the accumulation of workers' work experience is different, their technical levels are uneven, and there are differences in the understanding level of processes, which increases the difficulty of the assembly work. Situations of incorrect assembly and missing assembly often occur, and repeated inspections and confirmations are required, so the accuracy and efficiency of the assembly cannot be guaranteed. Combining mixed reality technology with the gas turbine production and assembly process requires finding the problems and pain points in the gas turbine production and assembly process, with the goal of solving problems, improving quality, and increasing efficiency. Through the retrieval of existing technical literature, it is found that there is currently no application in the professional field of using mixed reality to assemble gas turbines, including multi-person collaborative gas turbine assembly guidance, and there is also a lack of a holographic three-dimensional assembly process guidance method for gas turbines synchronized through multi-person anchor point technology. Summary of the Invention

[0003] The purpose of the present invention is to provide a multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology, which can provide a highly immersive and lightweight virtual-real combination and multi-person collaborative interaction environment for personnel in various links such as design, process, production, and assembly, and provide accurate, efficient, and convenient assembly guidance and quality inspection for assembly personnel.

[0004] The purpose of the present invention is achieved as follows:

[0005] A multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology of the present invention is characterized by including the following steps:

[0006] (1) Conduct an analysis and quantification of the assembly processes of typical components of the gas turbine system, and establish an assembly process database for typical components of the system;

[0007] (2) Model the typical components of the gas turbine system in the assembly process database in step (1) using 3d Max technology, prefabricate and render three-dimensional models based on the geometric dimension parameters and material property parameters of the gas turbine, and establish a three-dimensional model database for the system;

[0008] (3) Build the system hardware environment using a mixed reality head-mounted display device, build the system virtual environment with the 3D simulation model prefabricated in step (2), and further lightweight the 3D simulation model;

[0009] (4) Based on the lightweight 3D model in step (3), produce prefabricated bodies of 3D models of typical components of the gas turbine system, and generate prefabricated bodies of 3D models with human-computer interaction functions;

[0010] (5) Based on the prefabricated body of the 3D model with human-computer interaction functions in step (4), perform packaging and compression processing to produce typical components of the gas turbine system suitable for the mixed reality environment and support dynamic loading;

[0011] (6) Design and develop a client and server user management module based on mixed reality to generate a multi-person collaborative environment for gas turbine assembly guidance;

[0012] (7) Integrate the prefabricated body of the 3D model generated in the steps with the generated multi-person collaborative environment, and design and develop multi-person collaborative assembly guidance training;

[0013] (8) Design and develop human-computer interaction functions and integrate them with the training system developed in step (7);

[0014] (9) Trainees use the system integrated in step (8) for functional testing to guide trainees to complete the assembly of core components.

[0015] The present invention may further include:

[0016] 1. Step (1) includes the following steps:

[0017] Export the gas turbine assembly process in the PLM design system and sort out the assembly processes of typical parts;

[0018] Analyze the assembly process data of typical components, and clean, sort out and classify the collected data;

[0019] Establish a disassembly and assembly method module for the assembly process of typical components;

[0020] Establish a general description language standard for the disassembly and assembly of typical components;

[0021] Integrate the assembly process data, assembly methods and general description language of the assembly process of typical components in the system assembly process database.

[0022] 2. The steps for establishing the 3D model database of the gas turbine system in step (2) include:

[0023] Count, sort out and classify the 3D models that need to be modeled;

[0024] Create a 3D model using 3ds Max technology and render the materials of the 3D model;

[0025] Perform parametric curve, surface, and triangulation processing on the 3D model and represent the 3D model with a triangular network;

[0026] Design the framework of the system's 3D model database and establish the system's 3D model database.

[0027] 3. The generation of the multi-person collaborative environment for gas turbine assembly guidance in step (6) includes the following steps:

[0028] Develop a data communication framework based on mixed reality hardware devices and develop a user data synchronization function using the network data transfer protocol;

[0029] Develop the function of uploading multi-user spatial anchor data to the server;

[0030] The server calculates the spatial anchor data of each user and develops the function of distributing and synchronizing the data;

[0031] Develop a user data management module.

[0032] 4. The design and development of the human-computer interaction function in step (8) includes the following steps:

[0033] Design a human-computer interaction interface, develop a gesture recognition algorithm, and design a technical framework to develop interaction logic;

[0034] Based on the gas turbine system assembly process database, design and develop a gesture interaction function module;

[0035] Write the elements of the assembly process and develop a disassembly and assembly guidance function module;

[0036] Integrate the 3D holographic image and the assembly guidance function module to generate an assembly model.

[0037] The advantages of the present invention are as follows:

[0038] 1. The present invention can be used by multiple trainees in the gas turbine assembly guidance scenario;

[0039] 2. Trainees can perform gas turbine assembly operations under the immersive effect of the mixed reality holographic image;

[0040] 3. The system also supports online detection of gas turbine assembly compliance and anti-fooling and anti-leakage reminders;

[0041] 4. Compared with the traditional virtual operation using gloves and handles, directly using both hands for human-computer interaction is more in line with daily operation habits and improves assembly efficiency. Brief Description of the Drawings

[0042] Figure 1Schematic diagram of the architecture of the present invention;

[0043] Figure 2 Flowchart of the present invention. Detailed implementation manners

[0044] The present invention will be described in more detail with reference to the accompanying drawings as follows:

[0045] Combined with Figure 1-2 , a multi-person collaboration method for gas turbine assembly guidance based on mixed reality technology of the present invention includes the following steps:

[0046] Step 1: Analyze and quantify the assembly processes of typical components of the gas turbine system, and establish an assembly process database for typical components of the system; (1) Export the gas turbine assembly process in the PLM design system, and sort out the assembly processes of typical parts; (2) Analyze the assembly process data of typical components, and clean, sort out and classify the collected data; (3) Establish a disassembly and assembly method module for the assembly processes of typical components; (4) Establish a standard for the general description language for the disassembly and assembly of typical components; (5) Integrate the assembly process data, assembly methods and general description language of the assembly process of typical components into the system assembly process database.

[0047] Step 2: Classify and model the typical components, tooling and workshops of the gas turbine system in the failure analysis database of Step 1 by using 3D Max technology. According to the accurate geometric dimension parameters and material property parameters of the gas turbine, tooling and workshops, prefabricate and render the three-dimensional models, and establish a three-dimensional model database for the system. (1) Statistically sort out and classify the three-dimensional models to be modeled; (2) Use 3D Max technology to create three-dimensional models and render the materials of the three-dimensional models; (3) Perform parametric curve and surface triangulation processing on a large number of three-dimensional models, and approximately represent the accurate three-dimensional models with triangular meshes; (4) Design the functional structure of the system three-dimensional model database and establish the system three-dimensional model database.

[0048] Step 3: Use a mixed reality head-mounted display device to build the system hardware environment, build the system virtual environment with the three-dimensional simulation models prefabricated in step (2), and further lightweight the three-dimensional simulation models;

[0049] (1) Integrate the three-dimensional models into the system virtual environment; (2) Simplify the internal structure of the three-dimensional models, and hide or delete unnecessary structure models; (3) Reduce the rendering effects such as lighting and materials of the components in the internal structure of the three-dimensional models to generate lightweight three-dimensional models.

[0050] Step 4: Based on the lightweight 3D model in step (3), fabricate the prefabricated bodies of typical components of the gas turbine system 3D model, and generate the prefabricated bodies of the 3D model with human-computer interaction function; (1) Sort out the 3D model with human-computer interaction function; (2) Classify the 3D model according to different functions, and mount different functional components according to functional requirements; (3) Generate prefabricated bodies of different functions from the 3D model with mounted functional components.

[0051] Step 5: Based on the prefabricated bodies of the 3D model with human-computer interaction function in step (4), perform packing and compression processing to fabricate typical components of the gas turbine system applicable to the mixed reality environment and support dynamic loading; (1) Pack the model into prefabricated body models for UWP and PC respectively in the window environment; (2) Deploy the packed prefabricated body models to the FTP server; (3) Configure the xml file according to the client, server and model information. (4) Develop the model dynamic loading function.

[0052] Step 6: Design and develop the user management modules for the client and server based on mixed reality to generate a multi-person collaborative environment for gas turbine assembly guidance; (1) Develop a data communication framework based on mixed reality hardware devices, and develop a user data synchronization function using the network data transfer protocol; (2) Develop the function of uploading spatial anchor point data of multiple users to the server; (3) The server calculates the spatial anchor point data of each user and develops the function of distributing and synchronizing the data; (4) Develop the user data management module.

[0053] Step 7: Integrate the system with the prefabricated bodies of the 3D model generated in step 5 and the multi-person collaborative environment generated in step 6, and design and develop multi-person collaborative assembly guidance training; (1) Develop the model library data loading and UI interface display functions for the PC server and the user's mixed reality client; (2) Gesture interaction function of the UI interface in the mixed reality environment (3) Develop the model data synchronization and model display functions for dynamic loading of multiple users; (4) Develop the synchronization function of the steps of the 3D assembly guidance animation.

[0054] Step 8: Design and develop the human-computer interaction function, and integrate it with the training system developed in step 7 to obtain a multi-person collaborative method for gas turbine assembly guidance based on mixed reality; (1) Design the human-computer interaction interface, develop the gesture recognition algorithm, and design the technical framework to develop the interaction logic; (2) Based on the gas turbine system assembly process database, design and develop the gesture interaction function module; (3) Compile the assembly process elements and develop the disassembly and assembly guidance function module; (4) Integrate the 3D holographic image and the assembly guidance function module to generate the assembly model.

[0055] Step 9: The trainee uses the system integrated in Step 8 to conduct functional tests, and the system guides the trainee to complete the assembly of key components. (1) The user connects to the server through the mixed reality glasses; (2) The user uploads their own spatial anchor data and synchronizes the anchors; (3) Load the assembly guidance model from the model library; (4) Complete the assembly of key components according to the assembly guidance of the holographic image.

Claims

1. A multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology, characterized by: The steps include: (1) Analyze and quantify the assembly process of typical gas turbine parts and components, and establish a database of assembly processes of typical gas turbine parts and components; (2) Modeling typical parts of the gas turbine system in the assembly process database of step (1) using 3D Max technology, prefabricating and rendering three-dimensional models based on gas turbine geometric size parameters and material performance parameters, and establishing a system three-dimensional model database; (3) Using a mixed reality head mounted display device to build a system hardware environment, using the three-dimensional simulation model prefabricated in step (2) to build a system virtual environment, and further lightweighting the three-dimensional simulation model; (4) Based on the lightweight three-dimensional model obtained in step (3), a three-dimensional model preform of typical parts of the gas turbine system is manufactured to generate a three-dimensional model preform with a human-computer interaction function; (5) Based on the three-dimensional model preform with human-computer interaction function in step (4), packaging and compression processing are performed to produce typical parts of the gas turbine system suitable for the mixed reality environment, and dynamic loading is supported; (6) Design and develop mixed reality-based client and server user management modules to generate a multi-person collaborative environment for gas turbine assembly guidance; (7) Integrate the three-dimensional model prefabricated body generated in the steps with the generated multi-person collaborative environment, and design and develop multi-person collaborative assembly guidance training; (8) Design and develop human-computer interaction functions and integrate them with the training system developed in step (7); (9) Trainees use the system integrated in step (8) to perform functional testing and guide trainees to complete the assembly of core components.

2. The multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology according to claim 1 is characterized by: Step (1) comprises the following steps: Export the gas turbine assembly process in the PLM design system and organize the assembly process of typical parts; Analyze typical parts assembly process data, clean, organize and classify the collected data; Establish a typical parts assembly process and disassembly method module; Establish a common description language standard for the disassembly and assembly of typical parts; The typical parts assembly process data, assembly methods and assembly process general description language are integrated into the system assembly process database.

3. The multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology according to claim 1 is characterized by: Step (2) of establishing a three-dimensional model database of a gas turbine system comprises the following steps: Count, sort and classify the three-dimensional models that need to be modeled; Use 3d Max technology to create three-dimensional models and render the materials of the three-dimensional models; Perform parametric curve and surface triangulation on the 3D model and express the 3D model with a triangle network; Design the framework of the system 3D model database and establish the system 3D model database.

4. The multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology according to claim 1 is characterized by: Step (6) The generation of a multi-person collaborative environment for gas turbine assembly guidance includes the following steps: Develop a data communication framework based on mixed reality hardware devices and develop user data synchronization functions using network data transmission protocols; Develop the function of uploading multiple users' spatial anchor data to the server; The server calculates the spatial anchor point data of each user and develops the function of distributing and synchronizing the data; Develop user data management module.

5. The multi-person collaborative method for gas turbine assembly guidance based on mixed reality technology according to claim 1 is characterized by: Step (8) Designing and developing the human-computer interaction function includes the following steps: Design human-computer interaction interface, develop gesture recognition algorithm, design technical framework and develop interaction logic; Based on the gas turbine system assembly process database, a gesture interaction function module is designed; Write assembly process elements and develop disassembly and assembly guidance function modules; Integrate 3D holographic images and assembly guidance function modules to generate assembly models.

Images