Combustion gas turbine assembly training system

Abstract

The invention discloses a gas turbine assembly training system, and the system comprises a virtual reality host which is internally provided with assembly teaching videos of all parts of a gas turbine and a gas turbine assembly training three-dimensional model. The virtual reality wearable device is in two-way communication with the virtual reality host and is used for playing assembly teaching videos of all components of the gas turbine built in the virtual reality host to students, and the process is a teaching mode; the gas turbine assembly training three-dimensional model is used for gas turbine assembly training through the virtual reality wearable device, and the process is a training mode. The virtual reality technology and the gas turbine assembly process are combined, the real assembly scene of equipment in the real environment is simulated, multiple users can cooperatively assemble the same gas turbine in the same virtual scene, high immersive experience is achieved, meanwhile, the portable virtual reality interactive operation environment is achieved, and the user experience is improved. Accurate, safe and efficient assembly guidance and training are provided for users.

Description

Technical Field

[0001] The invention belongs to the technical field of simulation training, and in particular relates to a gas turbine assembly training system. Background Art

[0002] With the continuous improvement of digital technology in recent years, the field of simulation training has become more intelligent relying on the continuous development of digital technology. In the process of gas turbine development, operators face difficulties such as low assembly efficiency, high experimental costs, and many unsafe factors in actual operation when performing assembly operations.

[0003] Therefore, there is an urgent need for a gas turbine assembly training system suitable for operators. Summary of the invention

[0004] In order to solve the above technical problems, the present invention provides a gas turbine assembly training system, which effectively overcomes the problems existing in real environment training and improves the training effect.

[0005] The objective of the present invention is achieved through the following technical solutions: a gas turbine assembly training system, comprising:

[0006] Virtual reality host with built-in gas turbine assembly instructional videos and gas turbine assembly training 3D models.

[0007] The virtual reality wearable device communicates with the virtual reality host in a two-way manner and is used to play the assembly teaching videos of the various components of the gas turbine built into the virtual reality host to the trainees. This process is the teaching mode. The gas turbine assembly training three-dimensional model is used to conduct gas turbine assembly training through the virtual reality wearable device. This process is the training mode.

[0008] Preferably, the virtual reality host can select one or more server hosts.

[0009] Preferably, the virtual reality wearable device includes a head display and a handle, wherein the head display is used to display a gas turbine teaching video and an assembly three-dimensional model, and the handle is used to select a training mode and a teaching mode, and to perform assembly operations in the training mode.

[0010] Preferably, the Socket communication between the virtual reality host and the virtual reality wearable device is based on the TCP / IP protocol, and supports multiple interactions.

[0011] Preferably, the virtual reality wearable device also includes a locator, which is used to capture the position information of the head display and the handle, and send it to other users in real time through the Socket TCP / IP communication protocol.

[0012] Preferably, the virtual reality host also has a built-in training assessment program for scoring and recording the operator's assembly training process and displaying it on the head display of the virtual reality wearable device.

[0013] Preferably, the virtual reality wearable device includes at least a virtual reality head-mounted display HTC VIVE Pro.

[0014] Preferably, the gas turbine assembly training three-dimensional model includes at least: a whole machine model, a low-pressure compressor model, a high-pressure compressor model, a combustion chamber model, an external piping model and a character animation model.

[0015] Compared with the prior art, the present invention has the following advantages:

[0016] A gas turbine assembly training system provided by the present invention combines virtual reality technology with gas turbine assembly technology to simulate the actual assembly scene of equipment in a real environment, allowing multiple users to collaboratively assemble the same gas turbine in the same virtual scene. It has a highly immersive experience while also having a lightweight virtual reality interactive operation environment, providing users with accurate, safe, and efficient assembly guidance and training, and can guide and assess the user's assembly process.

[0017] The virtual reality gas turbine assembly simulation training system provided by the present invention can allow trainees to fully train in a virtual and real environment. Each trainee can get the opportunity to train without being restricted by the type and quantity of equipment. An unlimited scene system can be obtained in a virtual environment, and different operation scenes can be selected. The maintenance cost is low, so that the training and teaching can achieve twice the result with half the effort. Using a virtual training system for gas turbine assembly operation training can effectively overcome the problems existing in real environment training, and it is economical, intelligent and convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A schematic diagram of the HTC VIVE Pro hardware device in an embodiment of the present invention;

[0019] Figure 2 This is a functional schematic diagram of a virtual reality gas turbine assembly simulation training system according to an embodiment of the present invention;

[0020] Figure 3 This is a schematic diagram of the architecture of a virtual reality gas turbine assembly simulation training system according to an embodiment of the present invention;

[0021] Figure 4 This is a diagram showing the operating effect of the virtual reality gas turbine assembly simulation training system in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0023] The technical solution of the present invention provides a gas turbine assembly training system, comprising:

[0024] Virtual reality host with built-in gas turbine assembly instructional videos and gas turbine assembly training 3D models.

[0025] The virtual reality wearable device communicates with the virtual reality host in a two-way manner and is used to play the assembly teaching videos of the various components of the gas turbine built into the virtual reality host to the trainees. This process is the teaching mode. The gas turbine assembly training three-dimensional model is used to conduct gas turbine assembly training through the virtual reality wearable device. This process is the training mode.

[0026] In one embodiment of the present invention, the virtual reality host can select one or more server hosts.

[0027] In one embodiment of the present invention, the virtual reality wearable device includes a head display and a handle, wherein the head display is used to display a gas turbine teaching video and an assembly three-dimensional model, and the handle is used to select a training mode and a teaching mode, and perform assembly operations in the training mode.

[0028] In one embodiment of the present invention, the Socket communication between the virtual reality host and the virtual reality wearable device based on the TCP / IP protocol supports multiple interactions.

[0029] In one embodiment of the present invention, the virtual reality wearable device also includes a locator, which is used to capture the position information of the head display and the handle, and send it to other users in real time through the Socket TCP / IP communication protocol.

[0030] In one embodiment of the present invention, a training assessment program is also built into the virtual reality host for scoring and recording the assembly training process of the operator and displaying it in the head display of the virtual reality wearable device.

[0031] like Figure 1As shown, in one embodiment of the present invention, the virtual reality wearable device at least includes a virtual reality head-mounted display HTC VIVE Pro. The gas turbine virtual assembly training system uses the virtual reality hardware device HTC VIVE Pro to build an experimental platform. The user holds the HTC VIVE Pro joystick to grab the gas turbine assembly parts or tools in the virtual environment for motion control. The optical positioning system in the virtual reality hardware device can capture the position and motion trajectory information of the joystick and the head-mounted display in real time. At this time, the handle and the head-mounted display motion trajectory in the real environment will be mapped to the virtual environment in real time, and the virtual image information will be displayed on the HTC VIVE Pro head-mounted display. The system realizes the multi-person collaborative human-computer interaction function through the Socket TCP / IP communication protocol. The optical locator sends the captured position information of the joystick and the head-mounted display to other users in real time through the Socket TCP / IP communication protocol. The user can see the relative position between other users and the training operations performed by other users in the virtual scene, which enhances the user's immersive experience.

[0032] In one embodiment of the present invention, the function of the gas turbine assembly simulation training system is shown as follows: Figure 2As shown, the system includes: a virtual reality host, a virtual reality head-mounted device, a virtual reality handle and a virtual reality locator, etc. Among them, the virtual reality host includes: a demonstration module, a training module and an evaluation module. The demonstration module is used to correctly demonstrate the operation steps of the target device in the VR head display by combining voice and animation. After the demonstration is completed, training or repeated viewing of the demonstration can be performed; the training module is used to display the operation information of the target device in the VR head display through text and voice, so that the user can complete the operation training of the target device according to the operation information, automatically start the next step training after the current step training is completed, and display the evaluation score after all the steps in the current scene are trained; the evaluation module is used to detect the user's operation process of the target device during the evaluation process, so as to score the operation process and record the evaluation time, and obtain the user's operation proficiency of the target device according to the score and evaluation time. In this embodiment, the demonstration module specifically uses audio and video to prompt the current operation step and the name and location of the target device, broadcast the process of each operation step, and use animation to present the operation sequence and predetermined device position of the target device, as well as the operation process; the audio and video are divided into multiple segments and stored in the system, and the voice playback is completed with the animation playback process. The training module is specifically used to prompt the user for the next operation after each operation of the target device is completed. The evaluation module is used to detect in real time whether the operator's operation is correct. When it is detected that the operator's operation sequence or position is wrong, the operator is prompted to adjust the operation process until the operator operates correctly before entering the next device and operation. The virtual reality host also includes a management module, which is used to provide a system login interface and a training scene selection interface in the VR headset. VR selection components include: VR handles, VR data gloves. VR positioning components include: VR handles, trackers.

[0033] The gas turbine assembly training system provided in the above-mentioned embodiment is based on virtual reality technology and the characteristics of a certain type of gas turbine maintenance and repair assembly process. It extracts the actions of the assembly process and the physical motion characteristics of the components, and simulates the operations of the real environment in a virtual environment. The virtual reality head-mounted display HTC VIVE Pro is developed in conjunction with the virtual reality physics engine, and the gas turbine model is lightweighted using 3D modeling software. The technical difficulties involved in virtual reality, human-computer interaction, multi-person collaboration, collision detection, and 3D model lightweighting are studied, and functions such as collision detection, process verification, and multi-person collaboration are realized. The gas turbine virtual reality multi-person collaborative assembly training system is technically verified. During use, the user needs to wear the HTC VIVE Pro head-mounted display device and hold the matching control handle to realize gas turbine virtual assembly training with the virtual scene. The gas turbine virtual assembly training system has functions such as Figure 2 shown.

[0034] In this embodiment, the process verification is based on the gas turbine disassembly and maintenance technology, which is the logical control part of the virtual assembly training. The installation and disassembly steps of the key components of the gas turbine are controlled through the process verification. Collision detection means that when the models in the virtual scene collide with each other, they can be detected in real time, and the collision effects similar to those in real life can be simulated to enhance the user's immersive experience.

[0035] like Figure 3 As shown, when the gas turbine assembly training system provided in the technical solution of the present invention is established, it is first necessary to establish a client and a server. The role of the client is to connect with the user. The client will send the information about the position and posture changes of the three-dimensional model of the gas turbine in the current user's virtual environment to the server in real time. The role of the server is to receive the information sent by the client and forward it to other clients in real time. Since the system is developed based on the Unity 3D engine environment, it is necessary to use C# language to write the client and server, and use the Socket TCP / IP communication protocol to build a data transmission framework to confirm that the data transmission is reliable and real-time. Secondly, when the user operates the gas turbine model in the virtual scene, the Unity 3D engine can obtain the position or posture changes of the model in real time, record the position and posture information of the model in real time, and transmit it to the server. The server forwards the received data to other users in real time. Finally, other users will receive the position and posture information, which will be parsed in real time and passed to the Unity 3D engine. The Unity 3D engine will receive the position and posture information and respond to the gas turbine 3D model identical to the model in the virtual scene. At this time, other users will see the same gas turbine 3D model in the virtual scene of the same user follow the motion trajectory of the model in real time, thus realizing real-time synchronization of virtual scene information between users.

[0036] After the gas turbine virtual assembly system is built, the system is operated and debugged. HTC VIVE Pro is used as the client for debugging. First, the server service is started to wait for the client to connect. The client enters the IP and port number of the server to connect. Then the user randomly selects the training scene mode and jumps to the selected virtual scene. In the scene, the user can see the virtual model of the gas turbine as a whole or its components, and the user can perform virtual assembly training in the virtual scene.

[0037] When users move around in the real environment, the virtual character models in the virtual environment also move with them. When one user grabs a virtual 3D model, the other user can also see the other user grabbing the model in his or her sight. The installation process is guided by video, audio, arrows, and the color of the outlines of key virtual assembly components. The user completes the gas turbine virtual assembly training. At this time, the system will record the time when the user completes the training. At this time, the user can choose to retrain in the interface or return to the previous list to reselect the task scene. The system runs smoothly throughout the training process and the picture in the user's sight is smooth and clear, such as Figure 4 shown.

[0038] When the user selects the assessment task scenario, based on the memory of virtual assembly training, the two people cooperate with each other to complete the assessment task without video, audio, arrows, and the color of the outline of the key components of the virtual assembly. At the end of the assessment, the system scores the user's assembly task completion during the assessment process and gives the time spent. So far, the operation and debugging of the gas turbine virtual assembly system has been completed. From the actual effect, the system's multi-person collaborative assembly, process verification function, human-computer interaction experience and immersive effect have met the expected design requirements, and the system also has a certain stability and fluency during operation.

[0039] The above are preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. A gas turbine assembly training system, characterized in that: The training equipment comprises: Virtual reality host with built-in gas turbine assembly instructional videos and gas turbine assembly training 3D models. The virtual reality wearable device communicates with the virtual reality host in a two-way manner and is used to play the assembly teaching videos of the various components of the gas turbine built into the virtual reality host to the trainees. This process is the teaching mode. The gas turbine assembly training three-dimensional model is used to conduct gas turbine assembly training through the virtual reality wearable device. This process is the training mode.

2. A gas turbine assembly training system according to claim 1, characterized in that: The virtual reality host can select one or more server hosts.

3. A gas turbine assembly training system as claimed in claim 2, characterized in that: The virtual reality wearable device includes a head display and a handle, wherein the head display is used to display a gas turbine teaching video and an assembly three-dimensional model, and the handle is used to select a training mode and a teaching mode, and to perform assembly operations in the training mode.

4. A gas turbine assembly training system as claimed in claim 3, characterized in that: The Socket communication between the virtual reality host and the virtual reality wearable device is based on the TCP / IP protocol and supports multiple interactions.

5. A gas turbine assembly training system as claimed in claim 4, characterized in that: The virtual reality wearable device also includes a locator, which is used to capture the position information of the head display and the handle, and send it to other users in real time through the Socket TCP / IP communication protocol.

6. A gas turbine assembly training system as claimed in claim 5, characterized in that: The virtual reality host also has a built-in training and evaluation program for scoring and recording the operator's assembly training process and displaying it on the head display of the virtual reality wearable device.

7. A gas turbine assembly training system as claimed in claim 6, characterized in that: The virtual reality wearable device at least includes a virtual reality head-mounted display HTC VIVE Pro.

8. A gas turbine assembly training system as claimed in claim 7, characterized in that: The gas turbine assembly training three-dimensional model at least includes: a whole machine model, a low-pressure compressor model, a high-pressure compressor model, a combustion chamber model, an external pipeline model and a character animation model.

Images