Interactive design method for virtual maintenance system of water turbine

Abstract

The invention discloses an interactive design method for a virtual maintenance system of a water turbine. The method comprises the following steps: S1, designing a man-machine interaction strategy; s2, designing a human-computer interaction interface; s3, interactive design of the three-dimensional model; s4, designing an observation angle; and S5, building a local area network architecture and a photo server, and realizing simulation of the desktop type multi-person collaborative maintenance training system. According to the interactive design method for the water turbine virtual maintenance system, the participation degree, the training quality and the maintenance efficiency of maintenance training are effectively improved through the virtual simulation technology, and the interactive design method has important reference value for water turbine equipment maintenance training.

Description

Technical Field

[0001] The invention relates to a water turbine, and in particular to an interactive design method for a water turbine virtual maintenance system. Background Art

[0002] Maintenance plays a vital role in the life cycle management of power equipment. Given that power equipment often suffers from loss or wear of parts during continuous operation, which can lead to equipment failures, routine maintenance and periodic overhaul are essential to ensure its efficient performance and extend its service life. With the continuous change and development of the equipment maintenance model of hydropower stations, digital technology has gradually been applied to the intelligent and information construction of hydropower stations. Traditional equipment maintenance methods are limited by factors such as limited visual expression, insufficient opportunities for active participation of personnel, poor safety, and high learning costs, making it difficult for maintenance personnel to fully understand the characteristics and maintenance process of the equipment in terms of time, space, and visibility. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide an interactive design method for a virtual maintenance system of a hydraulic turbine. Through virtual simulation technology, the participation, quality and efficiency of maintenance training are effectively improved, which has important reference value for maintenance training of hydraulic turbine equipment.

[0004] In order to solve the above technical problems, the technical solution adopted by the present invention is:

[0005] An interactive design method for a hydraulic turbine virtual maintenance system includes the following steps:

[0006] S1: Human-computer interaction strategy design;

[0007] S2: Human-computer interaction interface design;

[0008] S3: 3D model interaction design;

[0009] S4: observation perspective design;

[0010] S5: Build a local area network architecture and photon server to realize the simulation of a desktop multi-person collaborative maintenance training system.

[0011] The S1 comprises the following steps:

[0012] S1.1: Build a digital training system to realize textual storage of maintenance knowledge;

[0013] S1.2: Virtualize the entire maintenance process;

[0014] S1.3: Select maintenance equipment based on the required maintenance components and operating procedures;

[0015] Then, perform maintenance work on the maintenance components according to the process regulations;

[0016] Finally, operational feedback is obtained through the training system constructed by S1.1 to build a complete maintenance operation model.

[0017] The S2 comprises the following steps:

[0018] S2.1: Drive the entire operation process based on the user interface and obtain the UI logic framework;

[0019] S2.2: Adjust the characteristic parameters on the user interface to achieve compatibility and adaptive design of display devices;

[0020] S2.3: Mount the written event script on the control itself or the parent object of the control, and design a special event response script to adapt to complex logical relationships.

[0021] The S3 comprises the following steps:

[0022] S3.1: Construct an effective interaction mechanism between humans and 3D models through coordinate system transformation;

[0023] S3.2: Construct an affine transformation through linear and nonlinear transformations, and its mathematical representation is described by a 4x4 matrix. The vector is lifted to a four-dimensional homogeneous coordinate frame, in which the coordinates of the point are set to (a, b, c, 1), and the coordinates of the vector are set to (x, y, z, 0) accordingly.

[0024] In the S4, a character navigation function integrating the first-person perspective is constructed.

[0025] In S5, the multi-person collaborative maintenance system based on the photon network support engine realizes information interaction between the server and the client. The multi-person collaborative maintenance system connects the server with multiple clients. The user sends a request from the client to the server. The database processes the client request and returns a processing response. The server updates the data in the virtual scene and transmits it back to the client to achieve the unification of scene information during multi-person collaborative maintenance.

[0026] The present invention provides an interactive design method for a hydraulic turbine virtual maintenance system, which has the following technical effects:

[0027] 1) By designing a human-computer interaction strategy, the corresponding maintenance tools are accurately selected based on the preset maintenance components and operation processes, thereby virtualizing the entire maintenance process; then, the components are operated according to the established process; finally, a standardized maintenance operation mode is established through the implementation of a training system, and operation feedback is obtained. This allows maintenance knowledge to be systematized and stored in the training system in the form of electronic files, promoting the digitalization of maintenance knowledge, and at the same time, maintenance practices can be reproduced in a virtual environment.

[0028] 2) By designing the human-computer interaction interface, the turbine virtual maintenance system adopts the user interface to drive the operation process, aiming to improve the interaction efficiency and build an efficient UI control structure. By finely configuring the property settings on the user interface (Inspector panel), the user interface is ensured to have a wide range of device compatibility at the preset development resolution and achieve adaptive display. In order to handle complex logical associations, the event handling script is bound to the control and its parent object to implement a sophisticated event response mechanism.

[0029] 3) By designing 3D model interaction, the coordinate system transformation of the 3D model enables the three-dimensional model of the virtual space to be intuitively presented in the trainee's field of vision through the user interface; with the help of external devices, the trainees can perform precise displacement and rotation operations on the 3D model, thereby achieving effective interaction with the virtual object.

[0030] 4) The mathematical principle of realizing the interaction between maintenance personnel and 3D models through coordinate system transformation. The concept of linear and nonlinear transformation is combined to form affine transformation, which is expressed in the form of 4x4 matrix in mathematics. The vector is promoted to four dimensions and the homogeneous coordinate space is introduced. In this homogeneous coordinate framework, the 3D model can be presented to the trainees in a virtual form on the display for their observation. Participants perform 3D operations on the model, such as translation and rotation, through external devices, thus realizing the interaction between people and virtual objects.

[0031] 5) By designing the observation perspective, during the equipment failure repair and maintenance simulation, maintenance personnel can personally touch the parts to be repaired and obtain accurate maintenance feedback.

[0032] 6) By building a LAN architecture and photon server, information interaction between the server and the client is achieved, and the connection will not be interrupted due to the disconnection of the host, thus achieving the unification of scene information during collaborative maintenance by multiple people. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The present invention will be further described below in conjunction with the accompanying drawings and embodiments:

[0034] Figure 1 A process diagram for digitizing maintenance knowledge in the present invention.

[0035] Figure 2 This is a virtual display diagram of the maintenance process in the present invention.

[0036] Figure 3 This is a diagram of the maintenance operation model in the present invention.

[0037] Figure 4 This is a diagram of the script in the present invention mounted on the parent object.

[0038] FIG. 5( a ) is a coordinate diagram of the turbine components (assembled state) in the present invention.

[0039] FIG5( b ) is a coordinate diagram of the turbine components (parts status) in the present invention.

[0040] Figure 6 This is a diagram of the virtual maintenance scene of the turbine in this embodiment. DETAILED DESCRIPTION

[0041] like Figure 1-4 As shown, an interactive design method for a hydraulic turbine virtual maintenance system includes the following steps:

[0042] Step 1: Human-computer interaction strategy design;

[0043] Step 1.1: Build a digital training system to realize textual storage of maintenance knowledge;

[0044] In the virtual teaching environment, the use of picture display, video playback and 3D model animation and other forms to encourage students to actively participate, so as to effectively impart maintenance knowledge. In the process of promoting the digitization of maintenance knowledge, it is necessary to design a diversified file management system to ensure the accurate matching of equipment information and related knowledge, such as Figure 1 shown.

[0045] Step 1.2: Virtualize the entire maintenance process to reproduce the maintenance practice in a virtual environment;

[0046] On the basis of strengthening the trainees' theoretical understanding of maintenance, actual maintenance internships are used to enhance the practical application of professional skills. The so-called virtualization of the maintenance process refers specifically to the technical means of reproducing real maintenance situations in a virtual environment. This virtualization process relies on the precise response of interface interactions, the careful design of operation simulations, and the effective guidance of step instructions to jointly build a practical teaching environment. Among them, the user interface needs to sensitively respond to the trainees' operation requests and provide instant feedback on the operation results; the operation simulation covers the simulation of equipment movement, the flexibility of perspective conversion, and the situational simulation of multi-participant collaborative maintenance, such as Figure 2 shown.

[0047] Step 1.3: According to the required maintenance components and operation procedures, appropriate maintenance equipment should be selected accordingly; then, the maintenance work on the components should be carried out strictly in accordance with the process regulations; finally, operation feedback is obtained through the training system to build a complete maintenance operation model, referring to Figure 3 .

[0048] Step 2: Human-computer interaction interface design;

[0049] Step 2.1: Drive the entire operation process based on the user interface, achieve rapid response of the operation process, and obtain a good UI logic framework;

[0050] In the user interface interaction design of the turbine virtual maintenance training system, UGUI technology is used as the driving mechanism. Trainees can trigger corresponding event responses by clicking preset controls, thereby executing corresponding operation functions.

[0051] In the training system, the entire operation process is driven by trainees through the user interface, which requires efficient design of the UI logic architecture to support smooth interactive responses. The logical execution core of the entire system is a single program root node, which can call the service layer to implement key functions such as resource loading and audio playback, and can also connect to the business layer and go deep into various specific functional modules. The business layer is embedded with the main user interface, through which trainees can select and activate different controls to dynamically access the corresponding user interface. Regarding the UI logic architecture of the turbine virtual maintenance training system, Figure 4 A detailed description is provided.

[0052] Step 2.2: Fine-tune the characteristic parameters of the user interface to ensure that the user interface is compatible and adaptive to a wide range of display devices at the preset development resolution;

[0053] Participants built various interactive elements in the Canvas user interface, such as buttons, images, and drop-down menus. By accurately configuring the control anchor points, they achieved layout maintenance that adapts to different screen sizes and ensured the consistency of the relative positions of the controls when scaling. See Table 1 for detailed parameter settings.

[0054] Table 1 Canvas Inspector property settings

[0055]

[0056] Step 2.3: Mount the written event script on the control itself or the parent object of the control. This requires the design of a special event response event script to adapt to complex logical relationships;

[0057] The binding of the event script should be associated with the control and its parent object. In the event management interface of the control, select the corresponding execution function to implement event registration, as shown in Figure 5.

[0058] Step 3: 3D model interaction design;

[0059] Step 3.1: Construct an effective interaction mechanism between humans and 3D models through coordinate system transformation;

[0060] In the construction of human-computer interaction for 3D modeling and virtual overhaul training systems for turbines, it is crucial to manage the conversion between the global coordinate system (Global Coordinate System, a left-handed coordinate frame that represents the absolute positioning of the model in the scene) and the local coordinate system (Local Coordinate System, with a specific object as a reference, a custom origin, suitable for describing other objects, and also using a left-handed coordinate system). In addition, the use of the camera coordinate system (Camera Coordinate System, based on the observation space, with the center of the camera as the reference, the right-handed coordinate system is characterized by the Z axis pointing away from the camera, and the distance of the object from the camera is negatively correlated with the Z coordinate, thereby creating a depth perception vision) is also indispensable. The adaptation of the screen coordinate system (Screen Coordinate System, a two-dimensional pixel system, with the lower left corner set as the origin (0,0), and the pixels extending along the upper right corner) is also a core link in the technical process.

[0061] Step 3.2: Construct affine transformation through linear transformation and nonlinear transformation. This is a form of geometric transformation widely used in mathematical analysis. Its mathematical representation is explained by a 4x4 matrix. The vector is lifted to a four-dimensional homogeneous coordinate framework. In this framework, the coordinates of the point are set to (a, b, c, 1), and the vector coordinates are defined accordingly as (x, y, z, 0);

[0062] Step 3.2.1: Scaling

[0063] When any scaling operation is performed on the virtual object along the x, y, and z axes, it is represented by a dot product operation with the scaling matrix, as shown in formula (1).

[0064]

[0065] Step 3.2.2: Rotation

[0066] In the modeling of three-dimensional space, the visual fidelity standard requires sophisticated mathematical support for the axial rotation of virtual objects. By applying the rotation matrix technology, it is ensured that the coordinate transformation of the model remains accurate when the rotation operation of angles α, β, γ is performed around the x, y, and z coordinate axes, specifically following formulas (2), (3) and (4), see the above mathematical description.

[0067]

[0068] Step 3.2.3: Pan

[0069] When a virtual object is translated in a coordinate system, its coordinate transformation is achieved by performing a vector inner product operation with the translation matrix. This core principle is precisely expressed by formula (5), which fully explains the mathematical relationship between the matrix and the vector dot product.

[0070]

[0071] Step 3.2.4: Shear

[0072] The shear effect is essentially defined as an inherent property of a virtual object in a non-uniform extension state. Its uniqueness is that it only causes the adjustment of the angular displacement during the deformation process without affecting the volume and area conservation of the object. Specifically, this characteristic appears when the object is confined to the xy Cartesian coordinate system and is subjected to linear scaling along the x-axis at a ratio of m and the y-axis at a ratio of n, while the direction of the z-axis remains constant. The shear matrix is ​​shown in (6).

[0073]

[0074] The coordinate transformation technology of the 3D model enables the three-dimensional model of the virtual space to be presented intuitively through the display in the trainee's field of vision. With the help of external devices, the trainee can perform precise displacement and rotation operations on the 3D model, thereby achieving effective interaction with the virtual object;

[0075] The spatial mapping of local coordinates to global coordinates is a key process in the Unity3D environment. For virtual entities without parent associations, the coordinate data carried by their Transform components directly reflects the absolute positioning of the global space. However, when a virtual object belongs to a parent, the Transform component records the relative position data relative to the parent reference system. As shown in Figure 5(a), the control ring is a child object of the turbine, and the model center coordinates are (-5, 8, 14). It needs to be scaled by (10, 10, 10), rotated by -180 degrees around the y axis, and translated by (70, -35.5, 20). From this, the transformation matrix shown in formula (7) can be obtained:

[0076]

[0077] The control loop is transformed into a model, as shown in formula (8):

[0078]

[0079] Therefore, it can be concluded that the coordinates of the control loop center in the world coordinate system are (-70, 44.5, -30), as shown in Figure 5(b).

[0080] Step 4: Observation perspective design;

[0081] Integrate the script into the camera system. Use the mouse to precisely control the horizontal and vertical movement of the camera to achieve a virtual transformation of the character's line of sight; use the keyboard shortcuts W, S, A, and D to perform camera panning operations to reproduce the on-site positioning process of maintenance personnel in fault situations.

[0082] Step 5: Build a local area network architecture and photon server to realize the simulation of a desktop multi-person collaborative maintenance training system.

[0083] Enter the multi-person maintenance training simulation page. At this time, the photon engine will automatically create a room and generate a virtual maintenance person to load into the scene. At this time, the computer is the server. When another computer opens the same maintenance training system program, it will automatically search and join the scene room of the server and create another virtual maintenance person, so as to realize multi-person maintenance training simulation. Figure 6 As shown in the figure, two virtual maintenance personnel have been loaded into the maintenance scene. The upper left corner of the screen contains the home page, prompt, toolbox and backpack buttons. The toolbox contains various disassembly tools, and the backpack is used to store disassembled parts or installation parts. The operation instructions in the lower right corner will prompt the trainee which step is currently being carried out and make corresponding prompts. The control operation is that the WASD on the keyboard can control the forward, backward, left and right movement of the character respectively. Pressing and dragging the right button of the keyboard can control the rotation of the virtual character's perspective in the scene. The left mouse button performs various click operations.

[0084] This application realizes the virtualization and augmented reality effect of the equipment by designing human-computer interaction strategies, human-computer interaction interfaces, three-dimensional model interactions and observation perspectives. The system digitizes maintenance knowledge and reshapes real maintenance practices in a virtual environment. Combined with determined maintenance components and operating procedures, the correct maintenance tools are selected for operation, operation feedback is obtained, and a maintenance operation model is formed. The user interface design ensures rapid response and adaptive display of the operation process, and the three-dimensional model interaction design realizes human-computer interaction through coordinate system conversion and homogeneous coordinate space. The observation perspective design simulates the transformation and movement of the character's perspective through mouse and keyboard control, simulating the maintenance effect of the fault site. By building a local area network architecture and a Photon server, the simulation of a desktop multi-person collaborative maintenance training system is realized. The present invention effectively improves the participation, training quality and maintenance efficiency of maintenance training through virtual simulation technology, and has important reference value for the maintenance training of turbine equipment.

Claims

1. An interactive design method for a hydraulic turbine virtual maintenance system, characterized in that: The following steps are involved: S1: Human-computer interaction strategy design; S2: Human-computer interaction interface design; S3: 3D model interaction design; S4: observation perspective design; S5: Build a local area network architecture and photon server to realize the simulation of a desktop multi-person collaborative maintenance training system.

2. The interactive design method for a hydraulic turbine virtual maintenance system according to claim 1, characterized in that: The S1 comprises the following steps: S1.1: Build a digital training system to realize textual storage of maintenance knowledge; S1.2: Virtualize the entire maintenance process; S1.3: Select maintenance equipment based on the required maintenance components and operating procedures; Then, perform maintenance work on the maintenance components according to the process regulations; Finally, operational feedback is obtained through the training system constructed by S1.1 to build a complete maintenance operation model.

3. The interactive design method for a hydraulic turbine virtual maintenance system according to claim 1, characterized in that: The S2 comprises the following steps: S2.1: Drive the entire operation process based on the user interface and obtain the UI logic framework; S2.2: Adjust the characteristic parameters on the user interface to achieve compatibility and adaptive design of display devices; S2.3: Mount the written event script on the control itself or the parent object of the control, and design a special event response script to adapt to complex logical relationships.

4. The interactive design method for a hydraulic turbine virtual maintenance system according to claim 1, characterized in that: The S3 comprises the following steps: S3.1: Construct an effective interaction mechanism between humans and 3D models through coordinate system transformation; S3.2: Construct an affine transformation through linear transformation and nonlinear transformation. Its mathematical representation is described by a 4x4 matrix; the vector is promoted to a four-dimensional homogeneous coordinate frame, in which the coordinates of the point are set to (a, b, c, 1) and the coordinates of the vector are set to (x, y, z, 0) accordingly.

5. The interactive design method for a hydraulic turbine virtual maintenance system according to claim 1, characterized in that: In the S4, a character navigation function integrating the first-person perspective is constructed.

6. The interactive design method for a hydraulic turbine virtual maintenance system according to claim 1, characterized in that: In S5, the multi-person collaborative maintenance system based on the photon network support engine realizes information interaction between the server and the client. The multi-person collaborative maintenance system connects the server with multiple clients. The user sends a request from the client to the server. The database processes the client request and returns a processing response. The server updates the data in the virtual scene and transmits it back to the client to achieve the unification of scene information during multi-person collaborative maintenance.

Images