Fan maintenance virtual simulation training platform and use method

Abstract

The invention provides a fan maintenance virtual simulation training platform and a use method. The fan maintenance virtual simulation training platform comprises a main control module, an interaction equipment module, a network module and a training management module, the network module is in communication connection with the main control module, the interaction equipment module and the training management module; according to the training platform, through cooperation of the interaction equipment module and the main control module, a user can truly feel material characteristics and operation resistance of different parts, the sense of reality and immersion of training are effectively improved, by means of real-time evaluation of the training management module, the system can accurately recognize non-standard operation of the user and conduct correction guidance, and the training efficiency is improved. And the training efficiency is obviously improved.

Description

Technical Field

[0001] The invention belongs to the technical field of wind power generation, and in particular to a wind turbine maintenance virtual simulation training platform and a use method thereof. Background Art

[0002] A wind turbine is a power generation device that converts wind energy into mechanical energy and then converts mechanical energy into electrical energy. The structure of a wind turbine is complex, including multiple subsystems such as blade system, pitch system, transmission system, power generation system, and yaw system. Due to its harsh working environment and high maintenance difficulty, it requires high professional skills of maintenance personnel. Therefore, the training of maintenance personnel is of great significance to the safe and stable operation of wind farms.

[0003] At present, there are three main methods for training on wind turbine maintenance: first, imparting knowledge through theoretical teaching and video teaching, which makes it difficult for trainees to master practical operation skills; second, practical training through physical models, which has the disadvantages of high training costs, single training scenarios, and high safety risks; third, training using simple computer simulation systems, but existing simulation systems generally have problems such as single human-computer interaction, inaccurate simulation of physical characteristics, and inability to conduct multi-person collaborative training. In addition, the existing training methods lack intelligent evaluation and real-time guidance functions, making it difficult to accurately evaluate and promptly correct trainees' operations. Summary of the invention

[0004] In order to solve the problems of single scene, insufficient feedback and delayed evaluation in traditional training, the present invention provides a wind turbine maintenance virtual simulation training platform and a use method, which realizes a high degree of simulation of wind turbine maintenance training through the combination of virtual reality technology and artificial intelligence technology.

[0005] To achieve the above object, the present invention provides the following technical solutions: The present invention proposes a wind turbine maintenance virtual simulation training platform, comprising a main control module, an interactive device module, a network module and a training management module; the network module is communicatively connected to the main control module, the interactive device module and the training management module; The interactive device module is used for the user to interact with the virtual simulation environment, that is, to collect the user operation data of the user in the virtual simulation training environment and to provide simulation feedback; The network module is used for data transmission between the interactive device module and the training management module, and between the training management module and the main control module; The main control module is used to render the virtual simulation initial environment to obtain the virtual simulation environment and obtain the real-time physical simulation result by processing the user operation data; The training management module is used to build a virtual simulation initial environment based on user demand data, and to evaluate and guide the user's operation in the virtual simulation initial environment based on the real-time physical simulation results.

[0006] Preferably, the main control module includes a real-time rendering processing unit, an input unit, an output unit and a physical simulation calculation unit; The input unit is used to obtain data input into the network module by the interactive device module and the training management module, and transmit the input data to the real-time rendering processing unit and the physical simulation calculation unit for processing; The real-time rendering unit is used to render the virtual simulation initial environment input by the training management module to construct a virtual simulation environment, and to render the scene change result processed by the physical simulation calculation unit to obtain a virtual simulation update environment during the simulation training process; The physical simulation calculation unit is used to obtain the physical state changes of objects in the virtual simulation environment during the user training process, and calculate the scene change results in the virtual simulation environment in combination with the user operation data and the physical properties of the objects; The output unit is used to input the virtual simulation update environment and the virtual simulation environment into the interactive device module through the network module, and input the scene change result into the training management module for processing through the network module.

[0007] Preferably, the interactive device module includes a VR head display unit, a force feedback unit, a motion capture unit, a tactile feedback unit and a control unit; The VR head display unit is used to obtain the virtual simulation update environment and the virtual simulation environment, display the virtual simulation environment to the user, and update the virtual simulation environment based on the virtual simulation update environment; The force feedback unit is used to provide force feedback to the user during the training simulation process based on the training feedback data; The motion capture unit is used to capture the motion data of the user during the training simulation process; The tactile feedback unit is used to provide the user with tactile feedback during the training simulation process; The control unit is used to control data input and data output of the VR head display unit, the force feedback unit, the motion capture unit and the tactile feedback unit.

[0008] Preferably, the training management module includes a scene management submodule, a data transmission submodule, a physical simulation submodule, an interactive control submodule, an AI training submodule and a collaborative training submodule; The data transmission submodule is used to obtain the scene change result processed by the main control module and the user operation data collected by the interactive device unit; The scene management submodule is used to configure the virtual simulation initial environment; the scene management module includes a three-dimensional scene rendering unit, a resource loading management unit and a scene editing unit; The physical simulation submodule is used to calculate the physical characteristics using an adaptive calculation method based on the scene change results to obtain the physical characteristics results; The interactive control submodule is used to obtain simulation training feedback data and user operation data, and determine simulation feedback data through the simulation training feedback data and user operation data; The AI ​​training submodule is used to evaluate and analyze the simulation feedback data and user operation data to obtain evaluation data and guidance data; The collaborative training submodule is used for multi-user collaborative simulation training, guidance and recording.

[0009] Preferably, the scene management submodule includes a three-dimensional scene rendering unit, a resource loading management unit and a scene editing unit; The resource loading management unit is used to load basic scene resource data from the database therein according to the training task data; The scene editing unit is used to analyze the training task data, obtain user demand data, dynamically adjust the scene structure according to the user demand data, and obtain the virtual simulation initial environment; The three-dimensional scene rendering unit is used to render the virtual simulation initial environment.

[0010] Preferably, the physical simulation submodule includes an adaptive physical unit, a component deformation calculation unit and a collision detection unit; The collision detection unit is used to process the scene change result, determine whether the user collides with the object in the virtual simulation environment, and generate collision result data; The component deformation calculation unit is used to calculate the stress distribution and deformation of the object through the collision result data and the user operation data; The adaptive physical unit is used to calculate the object importance score through the collision result data and the stress distribution and deformation of the object, determine the dynamic adjustment calculation accuracy according to the object importance score, and calculate the simulation training feedback data based on the determined dynamic adjustment calculation accuracy.

[0011] Preferably, the interactive control submodule includes a gesture recognition unit, a voice control unit and a tactile feedback control unit; The gesture recognition unit is used to extract user gesture data from the user operation data, analyze the gesture trajectory, position and dynamic changes, and process it in combination with the simulation training feedback data to obtain gesture simulation feedback data; The voice control unit is used to extract voice operation data from the user operation data, analyze the voice operation data, and process the data in combination with the simulation training feedback data to obtain voice simulation feedback data; The tactile feedback control unit is used to process the gesture simulation feedback data through a force feedback calculation model to obtain tactile simulation feedback data.

[0012] Preferably, the AI ​​training submodule includes an intelligent teaching unit, an operation evaluation unit and an adaptive difficulty adjustment unit; The intelligent teaching unit is used to correct the user operation data through the evaluation data and the operation analysis data stored therein to obtain the guidance data; The operation evaluation unit is electrically connected via a data conductor and is used to score the speech simulation feedback data, the gesture simulation feedback data and the tactile simulation feedback data respectively through a scoring model to obtain evaluation data; The adaptive difficulty adjustment unit is used to generate difficulty adjustment data through evaluation data.

[0013] Preferably, the collaborative training module includes a multi-user synchronization unit, a remote expert guidance unit and a training record management unit; The multi-user synchronization unit is used to perform timestamp calibration and interaction state synchronization on multi-user operation data, and integrate the operation data of multiple users; The remote expert guidance unit is used to display the multi-user collaboration data to the guidance personnel and input the guidance personnel's operation data on multiple users for guidance; The training record management unit is used to record the guidance data of the remote expert guidance unit and the data of the multi-user collaborative simulation training.

[0014] The present invention proposes a method for using a virtual simulation training platform for wind turbine maintenance, which is applied to the above-mentioned virtual simulation training platform for wind turbine maintenance, and comprises the following steps: The training management module obtains the virtual simulation initial environment based on the training task configuration, transmits the virtual simulation initial environment to the main controller through the network module for rendering, obtains the virtual simulation environment, transmits the virtual simulation environment to the interactive device module through the network module, and the interactive device module interacts with the user for simulation training and collects user operation data; User operation data is transmitted to the training management module and the main control module respectively through the network module. The main control module calculates the scene change results and the virtual simulation update environment based on the user operation data. The virtual simulation update environment is transmitted to the interactive device module through the network module to update the virtual simulation environment. The scene change results are transmitted to the training management module through the network module for processing. The training management module generates feedback data, evaluation data, and guidance data based on the scene change results and user operation data, and transmits the feedback data, evaluation data, and guidance data to the interactive device module through the network module for feedback and guidance.

[0015] Compared with the prior art, the present invention has the following beneficial technical effects: The present invention proposes a wind turbine maintenance virtual simulation training platform. The training platform realizes efficient communication and data transmission between various components through a network module, ensuring the real-time and accuracy of information. The interactive device module can accurately capture the user's operation data in the virtual simulation environment, as well as the real-time interaction between the user and the virtual environment, thereby providing the user with an immersive training experience, enhancing the interest of the training, and greatly improving the training effect; the main control module can construct a realistic virtual simulation initial environment according to the user's demand data, process the user's operation data in real time, and generate accurate real-time physical simulation results, so that the training environment can dynamically respond to the user's operation, further enhancing the realism and effectiveness of the training; the training management module flexibly adjusts the settings of the virtual simulation environment according to the user's personalized needs to meet the training needs of different users, and can also objectively and comprehensively evaluate and guide the user's operation in the virtual simulation environment based on the real-time physical simulation results, which helps the user to correct errors in time, improve the skill level, and improve the user's training efficiency, so that the user can quickly master the standard operating procedures and improve the maintenance skills, providing a strong guarantee for the safe and stable operation of the wind farm.

[0016] Furthermore, the main control module of the training platform accurately and timely captures information from the interactive device module and the training management module through the input unit, and quickly transmits it to the subsequent processing unit, ensuring the real-time and accuracy of the training data. The real-time rendering processing unit uses advanced graphics processing technology to finely render the virtual simulation initial environment and construct a realistic virtual simulation environment. It can update the virtual simulation environment in real time according to the scene change results provided by the physical simulation calculation unit, so that users can experience the various changes in the training process immersively; the physical simulation calculation unit accurately calculates the scene change results in the virtual simulation environment according to the user operation data and the physical properties of the object, which improves the accuracy of the simulation training and makes the training process closer to actual operations, which helps to improve the user's practical ability.

[0017] Furthermore, the interactive device module of the training platform is connected to the VR head display device, force feedback gloves, motion capture sensors and tactile feedback devices through the controller respectively. The VR head display device allows users to enter the virtual simulation scene for simulation, and the force feedback gloves allow users to experience real feedback during the virtual simulation training process, thereby improving the realism of the simulation, making the user feel as if they are in the on-site operation during the virtual simulation training process, thereby improving the effect of the virtual simulation training; the motion capture sensor collects the user's training operation movements for later evaluation and correction; the tactile feedback device can improve the user's perception and improve the effect of the virtual simulation training.

[0018] Furthermore, the training management module in this training platform ensures seamless data connection between the main control module and the training management module through the data transmission submodule, so that the scene change results and user operation data can be transmitted in real time and accurately, providing a solid data foundation for subsequent simulation training; the scene management submodule can flexibly configure the virtual simulation initial environment through the collaborative work of the three-dimensional scene rendering unit, the resource loading management unit and the scene editing unit to meet the needs of different training scenarios, enhance the pertinence of training, and greatly improve the flexibility of training; the physical simulation submodule adopts an adaptive calculation method to calculate physical properties, which can accurately simulate physical phenomena in the real environment, making the simulation training closer to actual operations, improving the accuracy of training, and helping users to better understand and master relevant skills; the interactive control submodule can generate comprehensive simulation feedback data by integrating simulation training feedback data and user operation data, provide users with instant operation guidance and feedback, enhance the interactivity of training, and help users adjust operation strategies in time to improve training effects; the AI ​​training submodule uses advanced algorithms to evaluate and analyze simulation feedback data and user operation data, and can generate instructive evaluation data and guidance data, which helps users understand their training status and provide them with targeted improvement suggestions to promote the rapid improvement of skill levels; the collaborative training submodule supports multi-user collaborative simulation training, allowing team members to participate in the training process together, improve team collaboration capabilities and overall training effects, and can also record the training process to provide valuable information for subsequent analysis and summary. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a general architecture diagram of a wind turbine maintenance virtual simulation training platform proposed by the present invention; Figure 2 This is a structural schematic diagram of a main control module in a wind turbine maintenance virtual simulation training platform proposed by the present invention; Figure 3 This is a structural schematic diagram of an interactive device module in a wind turbine maintenance virtual simulation training platform proposed by the present invention; Figure 4 This is a structural schematic diagram of a network module in a wind turbine maintenance virtual simulation training platform proposed by the present invention; Figure 5 The present invention provides a structural diagram of a training management module in a virtual simulation training platform for wind turbine maintenance. DETAILED DESCRIPTION

[0020] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0021] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0022] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0023] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, or a communication; it can be a direct connection, or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0024] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may include that the first and second features are in direct contact, or may include that the first and second features are not in direct contact but are in contact through another feature between them. Moreover, a first feature being "above", "above" and "above" a second feature includes that the first feature is directly above and obliquely above the second feature, or simply indicates that the first feature is higher in level than the second feature. A first feature being "below", "below" and "below" a second feature includes that the first feature is directly above and obliquely above the second feature, or simply indicates that the first feature is lower in level than the second feature.

[0025] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0026] The present invention provides a virtual simulation training platform for fan maintenance, which realizes the digitization, intelligence and standardization of fan maintenance training through the deep integration of virtual reality technology and artificial intelligence technology.

[0027] like Figure 1 As shown, the present invention proposes a fan maintenance virtual simulation training platform adopting a distributed architecture, including a main control module, an interactive device module, a network module and a training management module; the main control module, the interactive device module and the training management module are electrically connected to the network module through data wires respectively, and the network module is used to realize the transmission and exchange of data between the main control module and the interactive device module, the main control module and the training management module, and the interactive device module and the training management module; the interactive device module is used for the user to interact with the virtual simulation environment, that is, to collect the user operation data of the user in the virtual simulation environment and to provide simulation feedback; the main control module is used to render the virtual simulation initial environment to obtain the virtual simulation environment and obtain the real-time physical simulation result by processing the user operation data; the training management module is used to construct the virtual simulation initial environment based on the user demand data, and evaluate and guide the user's operation in the virtual simulation initial environment based on the real-time physical simulation result. Through this system, this system can integrate the main control module, the interactive device module, the network module and the training management module through the distributed architecture, realize efficient, flexible and comprehensive fan maintenance skills training, improve the user's training effect, and reduce the training cost.

[0028] The main control module includes a real-time rendering processing unit, an input unit, an output unit and a physical simulation calculation unit. Figure 2 As shown, the input unit is electrically connected to the real-time rendering processing unit, the physical simulation calculation unit and the network module through a data conductor, and is used to obtain the data input to the network module by the interactive device module and the training management module, and transmit the input data to the real-time rendering processing unit and the physical simulation calculation unit for processing; The real-time rendering unit is electrically connected to the physical simulation calculation unit, the input unit and the output unit through data conductors, and is used to render the virtual simulation initial environment input by the training management module to construct a virtual simulation environment, and to render the scene change result obtained by the physical simulation calculation unit to obtain a virtual simulation update environment during the simulation training process, so that the system updates the virtual simulation environment through the virtual simulation update environment to provide users with real visual performance, and transmits the virtual simulation update environment and the virtual simulation environment to the output unit, and transmits them to the interactive device module and the training management module through the transmission unit for processing; The physical simulation calculation unit is electrically connected to the real-time rendering unit, the input unit and the output unit through data wires, and is used to obtain the physical state changes of objects in the virtual simulation environment during user training, and combine the user operation data provided by the input unit, such as the applied force, displacement and speed during the user simulation training. At the same time, the physical properties of the objects in the virtual simulation environment in the training management module are obtained, such as the mass, stiffness and constraint conditions of the training objects, and the dynamic behavior of the simulated objects, including the force state, displacement changes and deformation effects, and the scene change results in the virtual simulation environment are obtained by calculating the user operation data, physical state changes and physical properties of the objects, and the scene change results are transmitted to the output unit, and the scene change results are transmitted to the real-time rendering unit for rendering.

[0029] The output unit is electrically connected to the network module through a data conductor, and is used to input the virtual simulation update environment and the virtual simulation environment obtained by the real-time rendering processing unit into the interactive device module through the network module, and to input the scene change results obtained by the physical simulation calculation unit into the training management module for processing through the network module.

[0030] In this embodiment, the main control module adopts a high-performance workstation architecture, equipped with an Intel i9-13900K central processor, an NVIDIA RTX 4090 graphics processor, 128GB DDR5 memory and 4TB NVMe SSD storage to ensure that the system has sufficient computing and processing capabilities.

[0031] The interactive device module includes a VR head display unit, a force feedback unit, a motion capture unit, a tactile feedback unit and a control unit; Figure 3 As shown, the control unit is electrically connected to the VR head display unit, the force feedback unit, the motion capture unit, the tactile feedback unit and the network module through data wires, and is used to obtain the virtual simulation update environment and the virtual simulation environment in the network module input by the output unit, and the training feedback data and evaluation guidance data input by the training management module.

[0032] Among them, the VR head display unit is used to obtain the virtual simulation update environment and the virtual simulation environment, display the virtual simulation environment to the user, and update the virtual simulation environment based on the virtual simulation update environment; the force feedback unit is used to provide the user with force feedback during the training simulation process based on the training feedback data; the motion capture unit is used to capture the user's motion data during the training simulation process; the tactile feedback unit is used to provide the user with tactile feedback during the training simulation process; the control unit is used to control the data input and data output of the interactive device module through the VR head display unit, the force feedback unit, the motion capture unit and the tactile feedback unit, ensuring that the unit's data can be aggregated to the control unit for processing in real time, and receiving the data transmission of the control unit, so as to achieve a smooth human-computer interaction experience; in this embodiment, the VR head display unit is a VR head display device with dual 4K resolution display screens, a refresh rate of 120Hz, a field of view of 120 degrees, and a system delay controlled within 10 milliseconds. The force feedback unit is a force feedback glove, which is equipped with a high-precision mechanical sensor with a sensing accuracy of 0.1 mm. Each finger is equipped with 5 degrees of freedom and 3 tactile feedback points, realizing accurate simulation of the operating force. The motion capture unit is a motion capture sensor that uses infrared optical tracking technology, with a sampling frequency of 240Hz and a positioning accuracy better than 1 mm.

[0033] The network module includes 5G private network equipment, edge computing servers and low-latency network adapters, such as Figure 4 As shown, the 5G private network device is communicatively connected to the edge computing server, the main control module, the interactive device module and the training management module, and the edge computing server is communicatively connected to the low-latency network adapter, the main control module, the interactive device module and the training management module; the 5G private network device transmits the data transmitted by the main control module, the interactive device module and the training management module to the edge computing server for optimization processing, and transmits the optimized data to the low-latency network adapter, which is quickly distributed to the corresponding main control module, the interactive device module and the training management module through the low-latency network adapter. Through the collaboration of the 5G private network device, the edge computing server and the low-latency network adapter, high-speed data exchange is achieved between the main control module, the interactive device module and the training management module, ensuring the smooth progress of real-time interaction, collaborative training and operation guidance in the virtual simulation environment, and improving data transmission efficiency.

[0034] The training management module includes a scene management submodule, a data transmission submodule, a physical simulation submodule, an interactive control submodule, an AI training submodule, and a collaborative training submodule. Figure 5 As shown; The data transmission submodule is connected to the scene management submodule, physical simulation submodule, interactive control submodule, AI training submodule and collaborative training submodule through data wires; it is used to obtain the scene change results processed by the main control module and the user operation data collected by the interactive device unit.

[0035] The scene management submodule is connected to the physical simulation submodule, the collaborative training submodule and the data transmission submodule through data wires to configure the initial environment of the virtual simulation; the scene management module includes a three-dimensional scene rendering unit, a resource loading management unit and a scene editing unit; The resource loading management unit is connected to the scene editing unit through a data conductor, and is used to load basic scene resource data (such as initial position data, material properties and geometric shape data of the object) from the database therein according to the training task data, and transmit the training task data and basic scene resource data to the scene editing unit for processing; The scene editing unit is connected to the three-dimensional scene rendering unit through a data conductor to parse the training task data, obtain the user demand data, dynamically adjust the scene structure (such as adding or modifying objects) according to the user demand data, and obtain the virtual simulation initial environment; The three-dimensional scene rendering unit is connected to the data transmission module through a data conductor, and is used to render the virtual simulation initial environment, transmit the rendered virtual simulation initial environment to the data transmission submodule, transmit it to the network module through the data transmission submodule, transmit it to the main control module through the network module, and transmit it to the interactive device unit through the network module after processing by the main control module; The physical simulation submodule is electrically connected to the data transmission submodule and the interactive control submodule through a data conductor, and is used to calculate the physical characteristics of the scene change results using an adaptive calculation method, and the obtained physical characteristics results are transmitted to the interactive control submodule for processing. The workflow of the physical simulation module constitutes a closed-loop control system. First, the scene change results are obtained, and the importance score data of the object is calculated according to the object state information in the scene change results. The calculation accuracy level is dynamically adjusted based on the importance score data, and the physical characteristics of the object are calculated based on the score data. The physical characteristics of the object are transmitted to the interactive control submodule, and the interactive response of the virtual simulation scene is updated in real time. The object state is updated. The physical simulation submodule uses ultra-high precision calculation for objects with importance scores greater than 0.8, high precision calculation for objects with importance scores between 0.5 and 0.8, and standard precision calculation for objects with importance scores less than 0.5, thereby realizing the reasonable allocation of computing resources and ensuring the continuity and accuracy of physical simulation.

[0036] The physical simulation submodule includes an adaptive physical unit, a component deformation calculation unit and a collision detection unit; wherein the collision detection unit is electrically connected to the component deformation calculation unit and the data transmission submodule through a data wire, and is used to obtain scene change results, process the scene change results, determine whether a user collides with an object in the virtual simulation environment, and generate collision result data, the collision result data including the collision contact point, the normal force of the collision point and the collision time.

[0037] The component deformation calculation unit is electrically connected to the adaptive physical unit through a data conductor, and is used to calculate the stress distribution and deformation of the object through the collision result data and the user operation data, and transmit the stress distribution and deformation of the object to the adaptive physical unit for processing. The adaptive physical unit is electrically connected to the interactive control submodule through a data conductor, and is used to obtain the stress distribution and deformation amount and collision result data of the object, calculate the object importance score through the collision result data and the stress distribution and deformation amount of the object, determine the dynamic adjustment calculation accuracy according to the object importance score, calculate the simulation training feedback data based on the determined dynamic adjustment calculation accuracy, and transmit the simulation training feedback data to the interactive control submodule; wherein, when the object importance score is greater than 0.8, ultra-high precision calculation is adopted, when the object importance score is between 0.5 and 0.8, high precision calculation is adopted, and when the object importance score is less than 0.5, standard precision calculation is adopted; The calculation process of the object importance score is:

[0038] Among them, I represents the object importance score, ranging from 0 to 1; D represents the distance factor to the operation point; C represents the collision risk factor; R represents the relevance factor; , , is the weight coefficient and satisfies .

[0039] The interactive control submodule is electrically connected to the AI ​​training submodule and the data transmission submodule through a data conductor, and is used to obtain simulation training feedback data and user operation data, and determine simulation feedback data through the simulation training feedback data and user operation data; wherein the interactive control submodule includes a gesture recognition unit, a voice control unit, and a tactile feedback control unit; The gesture recognition unit is electrically connected to the tactile feedback control unit, the AI ​​training submodule and the data transmission submodule through a data conductor, and is used to extract the user gesture data from the user operation data, analyze the gesture trajectory, position and dynamic change, and process it in combination with the simulation training feedback data to obtain gesture simulation feedback data, and transmit the gesture simulation feedback data to the tactile feedback control unit, the AI ​​training submodule and the data transmission submodule for processing; The voice control unit is electrically connected to the AI ​​training submodule through a data conductor, and is used to extract voice operation data from the user operation data, analyze the voice operation data, process it in combination with the simulation training feedback data, obtain voice simulation feedback data, and transmit the voice simulation feedback data to the AI ​​training submodule for processing; The tactile feedback control unit is electrically connected to the AI ​​training submodule and the data transmission submodule through a data conductor, and is used to process the gesture simulation feedback data through a force feedback calculation model to obtain tactile simulation feedback data.

[0040] Among them, the force feedback calculation model is as follows:

[0041] In this formula, F represents the output force feedback value, in Newtons; It represents the stiffness coefficient, reflecting the hardness characteristics of the material; Indicates displacement in meters; Represents the damping coefficient, simulating the damping characteristics of the material; Indicates relative speed in meters per second; represents the quality coefficient; Represents acceleration in meters per square second. Through this model, the system can accurately calculate the physical feedback characteristics of different materials.

[0042] The AI ​​training submodule is electrically connected to the data transmission submodule through a data conductor, and is used to evaluate and analyze the simulation feedback data and user operation data, obtain evaluation data and guidance data, and transmit them to the data transmission submodule for processing; wherein the AI ​​training module includes an intelligent teaching unit, an operation evaluation unit, and an adaptive difficulty adjustment unit; The operation evaluation unit is electrically connected to the gesture recognition unit, the data transmission submodule, the voice control unit and the tactile feedback control unit through a data conductor, and is used to obtain voice simulation feedback data, gesture simulation feedback data and tactile simulation feedback data, and to score the voice simulation feedback data, the gesture simulation feedback data and the tactile simulation feedback data respectively through a scoring model to obtain evaluation data; The scoring model is as follows:

[0043] Among them, S represents the comprehensive score of the students; Indicates the total number of evaluation indicators; Represents the weight coefficient of the i-th indicator; represents the completion score of the i-th indicator; Represents the time coefficient of the ith indicator, which is used to evaluate the operation efficiency.

[0044] The adaptive difficulty adjustment unit is electrically connected to the operation evaluation unit and the scene editing unit through a data conductor, and is used to generate difficulty adjustment data through evaluation data, that is, to obtain evaluation data, and compare the evaluation data with a preset threshold. When the evaluation data is greater than the preset threshold, simulation training difficulty upgrade data is generated and transmitted to the scene editing unit, the virtual simulation initial environment is reconstructed, and the difficulty of the virtual simulation initial environment is upgraded. When the evaluation data is less than the preset threshold, simulation training difficulty downgrade data is generated and transmitted to the scene editing unit, the virtual simulation initial environment is reconstructed, and the difficulty of the virtual simulation initial environment is downgraded.

[0045] The intelligent teaching unit is electrically connected to the operation evaluation unit and the data transmission submodule through a data conductor, and is used to obtain user operation data and evaluation data, and correct the user operation data through the evaluation data and the operation analysis data stored therein to obtain guidance data.

[0046] The collaborative training submodule is electrically connected to the scene management submodule and the data transmission submodule through a data conductor, and is used for multi-user collaborative simulation training, guidance and recording; wherein the collaborative training module includes a multi-user synchronization unit, a remote expert guidance unit and a training record management unit; The multi-user synchronization unit is electrically connected to the scene management submodule and the data transmission submodule through a data conductor, and is used to perform timestamp calibration and interaction state synchronization on multi-user operation data, and integrate the operation data of multiple users; The remote expert guidance unit is electrically connected to the multi-user synchronization unit through a data conductor, and is used to display the multi-user collaboration data to the guidance personnel, and input the guidance personnel's operation data on multiple users for guidance; The training record management unit is electrically connected to the remote expert guidance unit and the multi-user synchronization unit through a data conductor, and is used to record the guidance data of the remote expert guidance unit and the data of the multi-user collaborative simulation training.

[0047] This training platform has achieved significant application results: training time has been shortened by 50%, the assessment pass rate has increased by 30%, and the operation proficiency has increased by 40%. At the same time, it has also achieved significant advantages in terms of cost, with equipment loss reduced by 80%, site costs reduced by 90%, and labor costs reduced by 60%. The implementation of this platform is of great significance to improving the effect of wind turbine maintenance training and reducing training costs.

[0048] The system proposed in the present invention is further explained below in conjunction with a specific application example: This embodiment is used for new employee training in a wind farm. In this embodiment, the installed capacity of the power farm is 100MW, with a total of 25 4MW wind turbines. The training targets are 20 new maintenance personnel, and the training content covers three aspects: daily maintenance of wind turbines, fault diagnosis and emergency response.

[0049] In the daily maintenance training session, the system loads the daily maintenance scenarios of wind turbines, including typical work contents such as blade inspection, hub maintenance, and gearbox maintenance. The trainees enter the virtual simulation environment through the VR head display device, and perform maintenance operations with the cooperation of force feedback gloves and tactile feedback devices. The system collects the trainees' operation data in real time, and the motion capture sensor records their standard action essentials. Taking the gearbox maintenance as an example, the trainees need to complete operations such as oil level inspection, oil sample collection, and lubricating oil filling. In this process, the force feedback gloves provide a real tool operation feeling, the tactile feedback device simulates the material characteristics of different components, and the motion capture sensor records the standardization of the operation posture in real time.

[0050] In the fault diagnosis training phase, the system simulates a variety of typical fault scenarios. Taking bearing fault diagnosis as an example, the system generates vibration characteristics of bearings with different degrees of damage through the physical simulation module. The trainees collect data through the virtual vibration meter, and the system conducts real-time evaluation based on its measurement point selection and data analysis process. When the trainees make deviations in the measurement point selection, the AI ​​training module immediately gives a correction prompt; when the vibration data analysis results are misjudged, the system automatically displays the standard analysis process to guide the trainees to master the correct diagnostic methods.

[0051] In the emergency response training session, the system randomly generates complex fault conditions. Taking the variable pitch system failure as an example, the system simulates the variable pitch motor overload protection action scenario and requires trainees to complete fault diagnosis and emergency response within 5 minutes. During this process, the physical simulation module accurately calculates the stress state of each component, and the AI ​​training module evaluates the operational risks in real time. When an illegal operation occurs, the system immediately alarms and interrupts the current operation. Through the collaborative training module, on-site experts can remotely observe the training process and give guidance when appropriate.

[0052] During the training process, the system conducts a comprehensive evaluation of the performance of each trainee. The evaluation indicators include operational standardization, fault diagnosis accuracy, and emergency response timeliness. Taking a trainee as an example, the operation score calculation process is as follows: First, the actual scores of each indicator were obtained: P1 (operation standardization) = 92 points; P2 (fault diagnosis accuracy) = 88 points; P3 (emergency response timeliness) = 85 points; The corresponding time coefficients are: T1 = 0.95 (completed within the standard time); T2 = 0.90 (slightly exceeded the standard time); T3 = 0.85 (exceeded the standard time by 20%); The weights of each indicator are set as: w1 = 0.4 (weight of operational norms); w2 = 0.35 (weight of fault diagnosis); w3 = 0.25 (weight of emergency response) According to the scoring model: the comprehensive score of the trainer was calculated to be 87.3 points; after two weeks of training, the assessment results of 20 trainers showed that 18 people passed the assessment in one go, with a pass rate of 90% The average score for operational standardization was 92.5 points, a 35% increase over traditional training; the fault diagnosis accuracy reached 88%, a 40% increase over traditional training; the average time for emergency response was reduced by 45%; and the work efficiency and quality of this group of personnel were also significantly improved in actual maintenance work after the training: daily maintenance work efficiency increased by 50%; fault diagnosis accuracy increased by 45%; equipment maintenance quality improved by 38%; and the incidence of safety accidents decreased by 85%.

[0053] The present invention proposes a method for using a wind turbine maintenance virtual simulation training platform, which is applied to the above-mentioned wind turbine maintenance virtual simulation training platform and includes the following steps: The training management module obtains the virtual simulation initial environment based on the training task configuration, transmits the virtual simulation initial environment to the main controller through the network module for rendering, obtains the virtual simulation environment, transmits the virtual simulation environment to the interactive device module through the network module, and the interactive device module interacts with the user for simulation training and collects user operation data; User operation data is transmitted to the training management module and the main control module respectively through the network module. The main control module calculates the scene change results and the virtual simulation update environment based on the user operation data. The virtual simulation update environment is transmitted to the interactive device module through the network module to update the virtual simulation environment. The scene change results are transmitted to the training management module through the network module for processing. The training management module generates feedback data, evaluation data, and guidance data based on the scene change results and user operation data, and transmits the feedback data, evaluation data, and guidance data to the interactive device module through the network module for feedback and guidance.

[0054] At the same time, the examples verify the practical value of the present invention in the field of wind turbine maintenance training, which not only improves the training effect, but also significantly reduces the training cost and safety risks. Through virtual simulation technology, trainees can repeatedly practice various operations in a realistic virtual environment, deepen their understanding and mastery of standard operating procedures, and lay a solid foundation for subsequent practical work.

[0055] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic features of the present invention. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive. The scope of the present invention is defined by the attached claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any figure mark in the claims should not be regarded as limiting the claims involved.

[0056] In addition, it should be understood that although this specification is described in accordance with the implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other implementation modes that can be understood by those skilled in the art. The above content is only to illustrate the technical idea of ​​the present invention, and cannot be used to limit the protection scope of the present invention. Any changes made on the basis of the technical solution according to the technical idea proposed by the present invention shall fall within the protection scope of the claims of the present invention.

Claims

1. A virtual simulation training platform for wind turbine maintenance, characterized in that: It includes a main control module, an interactive device module, a network module and a training management module; the network module is communicatively connected to the main control module, the interactive device module and the training management module; The interactive device module is used for the user to interact with the virtual simulation environment, that is, to collect the user operation data of the user in the virtual simulation training environment and to provide simulation feedback; The network module is used for data transmission between the interactive device module and the training management module, and between the training management module and the main control module; The main control module is used to render the virtual simulation initial environment to obtain the virtual simulation environment and obtain the real-time physical simulation result by processing the user operation data; The training management module is used to build a virtual simulation initial environment based on user demand data, and to evaluate and guide the user's operation in the virtual simulation initial environment based on the real-time physical simulation results.

2. A wind turbine maintenance virtual simulation training platform according to claim 1, characterized in that: The main control module includes a real-time rendering processing unit, an input unit, an output unit and a physical simulation calculation unit; The input unit is used to obtain data input into the network module by the interactive device module and the training management module, and transmit the input data to the real-time rendering processing unit and the physical simulation calculation unit for processing; The real-time rendering unit is used to render the virtual simulation initial environment input by the training management module to construct a virtual simulation environment, and to render the scene change result processed by the physical simulation calculation unit to obtain a virtual simulation update environment during the simulation training process; The physical simulation calculation unit is used to obtain the physical state changes of objects in the virtual simulation environment during the user training process, and calculate the scene change results in the virtual simulation environment in combination with the user operation data and the physical properties of the objects; The output unit is used to input the virtual simulation update environment and the virtual simulation environment into the interactive device module through the network module, and input the scene change result into the training management module for processing through the network module.

3. A wind turbine maintenance virtual simulation training platform according to claim 1, characterized in that: The interactive device module includes a VR head display unit, a force feedback unit, a motion capture unit, a tactile feedback unit and a control unit; The VR head display unit is used to obtain the virtual simulation update environment and the virtual simulation environment, display the virtual simulation environment to the user, and update the virtual simulation environment based on the virtual simulation update environment; The force feedback unit is used to provide force feedback to the user during the training simulation process based on the training feedback data; The motion capture unit is used to capture the motion data of the user during the training simulation process; The tactile feedback unit is used to provide the user with tactile feedback during the training simulation process; The control unit is used to control data input and data output of the VR head display unit, the force feedback unit, the motion capture unit and the tactile feedback unit.

4. A wind turbine maintenance virtual simulation training platform according to claim 1, characterized in that: The training management module includes a scene management submodule, a data transmission submodule, a physical simulation submodule, an interactive control submodule, an AI training submodule and a collaborative training submodule; The data transmission submodule is used to obtain the scene change result processed by the main control module and the user operation data collected by the interactive device unit; The scene management submodule is used to configure the virtual simulation initial environment; The scene management module includes a 3D scene rendering unit, a resource loading management unit and a scene editing unit; The physical simulation submodule is used to calculate the physical characteristics using an adaptive calculation method based on the scene change results to obtain the physical characteristics results; The interactive control submodule is used to obtain simulation training feedback data and user operation data, and determine simulation feedback data through the simulation training feedback data and user operation data; The AI ​​training submodule is used to evaluate and analyze the simulation feedback data and user operation data to obtain evaluation data and guidance data; The collaborative training submodule is used for multi-user collaborative simulation training, guidance and recording.

5. A wind turbine maintenance virtual simulation training platform according to claim 4, characterized in that: The scene management submodule includes a three-dimensional scene rendering unit, a resource loading management unit and a scene editing unit; The resource loading management unit is used to load basic scene resource data from the database therein according to the training task data; The scene editing unit is used to analyze the training task data, obtain user demand data, dynamically adjust the scene structure according to the user demand data, and obtain the virtual simulation initial environment; The three-dimensional scene rendering unit is used to render the virtual simulation initial environment.

6. A wind turbine maintenance virtual simulation training platform according to claim 5, characterized in that: The physical simulation submodule includes an adaptive physical unit, a component deformation calculation unit and a collision detection unit; The collision detection unit is used to process the scene change result, determine whether the user collides with the object in the virtual simulation environment, and generate collision result data; The component deformation calculation unit is used to calculate the stress distribution and deformation of the object through the collision result data and the user operation data; The adaptive physical unit is used to calculate the object importance score through the collision result data and the stress distribution and deformation of the object, determine the dynamic adjustment calculation accuracy according to the object importance score, and calculate the simulation training feedback data based on the determined dynamic adjustment calculation accuracy.

7. A wind turbine maintenance virtual simulation training platform according to claim 6, characterized in that: The interactive control submodule includes a gesture recognition unit, a voice control unit and a tactile feedback control unit; The gesture recognition unit is used to extract user gesture data from the user operation data, analyze the gesture trajectory, position and dynamic changes, and process it in combination with the simulation training feedback data to obtain gesture simulation feedback data; The voice control unit is used to extract voice operation data from the user operation data, analyze the voice operation data, and process the data in combination with the simulation training feedback data to obtain voice simulation feedback data; The tactile feedback control unit is used to process the gesture simulation feedback data through a force feedback calculation model to obtain tactile simulation feedback data.

8. A wind turbine maintenance virtual simulation training platform according to claim 7, characterized in that: The AI ​​training submodule includes an intelligent teaching unit, an operation evaluation unit, and an adaptive difficulty adjustment unit; The intelligent teaching unit is used to correct the user operation data through the evaluation data and the operation analysis data stored therein to obtain the guidance data; The operation evaluation unit is electrically connected via a data conductor and is used to score the speech simulation feedback data, the gesture simulation feedback data and the tactile simulation feedback data respectively through a scoring model to obtain evaluation data; The adaptive difficulty adjustment unit is used to generate difficulty adjustment data through evaluation data.

9. A wind turbine maintenance virtual simulation training platform according to claim 6, characterized in that: The collaborative training module includes a multi-user synchronization unit, a remote expert guidance unit, and a training record management unit; The multi-user synchronization unit is used to perform timestamp calibration and interaction state synchronization on multi-user operation data, and integrate the operation data of multiple users; The remote expert guidance unit is used to display the multi-user collaboration data to the guidance personnel and input the guidance personnel's operation data on multiple users for guidance; The training record management unit is used to record the guidance data of the remote expert guidance unit and the data of the multi-user collaborative simulation training.

10. A method for using a wind turbine maintenance virtual simulation training platform, applied to a wind turbine maintenance virtual simulation training platform according to any one of claims 1 to 9, characterized in that: The following steps are involved: The training management module obtains the virtual simulation initial environment based on the training task configuration, transmits the virtual simulation initial environment to the main controller through the network module for rendering, obtains the virtual simulation environment, transmits the virtual simulation environment to the interactive device module through the network module, and the interactive device module interacts with the user for simulation training and collects user operation data; User operation data is transmitted to the training management module and the main control module respectively through the network module. The main control module calculates the scene change results and the virtual simulation update environment based on the user operation data. The virtual simulation update environment is transmitted to the interactive device module through the network module to update the virtual simulation environment. The scene change results are transmitted to the training management module through the network module for processing. The training management module generates feedback data, evaluation data, and guidance data based on the scene change results and user operation data, and transmits the feedback data, evaluation data, and guidance data to the interactive device module through the network module for feedback and guidance.

Images