Electric power training system based on virtual reality technology

Abstract

The invention relates to the technical field of electric power training, and discloses an electric power training system based on a virtual reality technology, which comprises a hardware interaction module, a data and model module, a core simulation module, an intelligent evaluation module and an application presentation module, the hardware interaction module comprises a VR head-mounted display device, a VR handle controller, a selectable force feedback glove and a selectable universal action platform, and is used for providing immersive experience and natural interaction means for a user; the data and model module comprises a high-precision three-dimensional model library, a physical attribute database, an operation instruction and knowledge graph library, a case library and a fault library, absolute safety and cost reduction and efficiency improvement are achieved, students perform all operations in a highly realistic virtual environment, risks such as personal electric shock, high-altitude falling, equipment damage and the like are completely avoided, and the safety of the students is improved. And one set of system can be repeatedly used without consuming real materials, so that the training cost is greatly reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent scrap steel grading processing, in particular to an electric power training system based on virtual reality technology. BACKGROUND

[0002] The electric power industry is a basic industry of the national economy, and its safe and stable operation is crucial. Substation operation and maintenance, line maintenance, high voltage test, fault handling and other operations have the characteristics of high risk, high professionalism and high complexity. The traditional electric power operation training mainly has the following limitations: High risk and high cost of practical training: Many training contents involve extreme dangerous scenes such as high voltage and high altitude operation. It is extremely risky to directly operate on real equipment for demonstration, which is easy to cause personal injury and equipment damage. At the same time, the cost of training on real power equipment is high, and it is strictly limited by site, time and equipment availability.

[0003] Single training mode and poor immersion: The existing training mainly adopts classroom teaching, two-dimensional animation demonstration, plane simulation software or physical simulation table, etc. These methods cannot provide real-time and immersive experience for students, and students are difficult to integrate theoretical knowledge with actual operation space, process and touch depth, so the training effect is not twice the result with half the effort.

[0004] Lack of intelligent evaluation and personalized guidance: The examination of traditional training mainly depends on the subjective observation of the instructor and the written test, which cannot accurately and quantitatively record and evaluate each subtle step of the student's operation (such as tool selection order, safety distance maintenance, operation force and angle), and it is difficult to realize automatic and standardized skill evaluation and targeted weakness analysis.

[0005] Cannot cover rare and extreme fault conditions: Real power systems need to run stably, and it is difficult to artificially set a variety of, especially rare or destructive faults for students to practice. This makes students lack experience in dealing with real sudden faults.

[0006] With the maturity of virtual reality technology, its immersion, interactivity and imagination provide a possibility to solve the above problems. However, some VR electric power training systems on the market are mostly simple scene roaming and preset process operation, which have the problems of lack of physical feedback, rigid behavior logic, low compatibility with real operation process, lack of intelligent kernel, etc. The depth and effectiveness of training still have a lot of room for improvement. SUMMARY

[0007] In view of the deficiencies of the prior art, the present application provides an electric power training system based on virtual reality technology.

[0008] In order to achieve the above object, the application provides the following technical scheme: a power training system based on virtual reality technology, comprising a hardware interaction module, a data and model module, a core simulation module, an intelligent evaluation module and an application performance module, the hardware interaction module comprises a VR head-mounted display device, a VR handle controller, an optional force feedback glove and an optional universal action platform, the hardware interaction module is used for providing immersive experience and natural interaction means for users, the data and model module comprises a high-precision three-dimensional model library, a physical property database, an operation procedure and knowledge graph library and a case library and fault library, the data and model module is used for storing high-precision three-dimensional models, physical properties, operation procedures and fault cases required for system operation, the core simulation module comprises a physical engine module, a VR rendering engine module, a behavior logic and state machine module and an AI scene generation module, the core simulation module is used for building and driving a virtual training environment, the intelligent evaluation module comprises a multi-modal data acquisition module, an operation specification evaluation module and an AI intelligent analysis report module, the intelligent evaluation module is used for acquiring and analyzing student operation data and generating an evaluation report, and the application performance module comprises a skill training module, an emergency disposal drill module, a multi-person collaborative operation module and an examination and certification module, the application performance module is used for providing specific training application scene interfaces to users.

[0009] Preferably, the VR head-mounted display device is used for outputting three-dimensional stereoscopic vision and hearing information for users, completely isolating real world interference, the VR handle controller is used for capturing movement, rotation and basic action of the user's hand, realizing primary interaction with virtual objects, the optional force feedback glove is used for high-precision capturing of hand skeleton action and finger fine posture, and providing force feedback such as vibration and resistance, simulating real touch feeling of operating tools, screwing, feeling device vibration, and the optional universal action platform is used for allowing users to realize unlimited movement in the virtual world in a limited physical space, enhancing the sense of immersion.

[0010] Preferably, the high-precision three-dimensional model library is based on laser scanning and fine modeling of real power equipment, the model not only contains appearance, but also contains complete disassembly structure of movable parts, the physical property database gives each object in the model library mass, density, friction coefficient, electrical conductivity, elasticity and other physical properties, the operation procedure and knowledge graph library is used for storing standardized operation process, safety regulations, operation points, common fault phenomena and treatment scheme, and constructing them into an associated knowledge graph, and the case library and fault library are used for storing historical training data, typical operation cases and a plurality of preset fault scenes.

[0011] Preferably, the physical engine module calculates the motion, collision, gravity, friction, etc. of all objects in the virtual environment in real time based on the physical property database, the VR rendering engine module is responsible for rendering the picture and sound calculated by the three-dimensional model library and the physical engine in real time and outputting to the VR headset, ensuring high refresh rate and low delay of the picture, avoiding user dizziness, the behavior logic and state machine module is used to define the operation logic of all devices and tools, and the AI scene generation module can dynamically generate training tasks and random faults based on the case library and fault library.

[0012] Preferably, the multi-modal data acquisition module is used to acquire and record all behavior data of the trainee in the VR environment in real time, including but not limited to eye tracking data, hand movement trajectory, operation step sequence, operation time, tool selection and virtual object interaction history, the operation specification evaluation module is used to compare the acquired behavior data with the standard process in the operation procedure and knowledge graph library, and perform quantitative scoring, and the AI intelligent analysis report module automatically generates a picture and text evaluation report based on the evaluation result, accurately points out the error points and deduction items in the operation, and gives learning suggestions and correct operation instructions based on the knowledge graph.

[0013] Preferably, the skill training module is used to provide step-by-step training from cognition to proficiency, the emergency disposal simulation module is used to simulate lightning strike, fire, short circuit, personal electric shock and other emergency situations, and train the rapid response and cooperative disposal ability of the trainee, the multi-person cooperative operation module allows multiple trainees to enter the same virtual scene at the same time and play the roles of operators, guardians, work responsible persons, etc., and rehearses the communication, voting, recitation, and cooperative operation process in real work, and the examination and certification module is used to provide a standardized examination mode, and the system automatically generates questions, automatically monitors the examination, and automatically scores, realizing objective and fair certification of the training result.

[0014] Preferably, the evaluation dimensions of the operation specification evaluation module include process specification, operation accuracy, safety compliance and work efficiency.

[0015] Compared with the prior art, the present application has the following beneficial effects: 1. Absolutely safe and zero risk training The system enables the trainee to perform various high-risk operation rehearsals such as high-voltage operation and high-altitude operation in a highly realistic virtual environment without real power equipment, completely avoiding the risks of electric shock, falling, equipment damage, etc. and realizing the absolute safety of the training process.

[0016] 2. Greatly reduce training cost and resource consumption The system relies on virtual simulation technology, does not need to occupy real power equipment, site and materials, one set of system can be repeatedly used, supports multiple training, significantly reduces equipment loss, power consumption and material cost, realizes intensive and sustainable use of training resources.

[0017] 3. High immersion and real operation experience: Through VR headsets, force feedback gloves, universal action platforms and other hardware devices, the system provides visual, auditory and tactile multi-dimensional sensory feedback, simulates real operation feel and environmental interaction, greatly enhances the students' sense of presence and operation reality, and improves the training immersion and effect.

[0018] 4. Intelligent evaluation and personalized guidance: The system collects student operation data in real time, performs AI quantitative evaluation from multiple dimensions such as process standardization, operation accuracy, safety compliance, automatically generates text and picture reports and points out error points, provides targeted learning suggestions combined with knowledge graph, realizes accurate review and efficient improvement.

[0019] Support complex scenarios and collaborative training: 5. The system can simulate various common and rare faults (such as lightning, short circuit, fire, etc.), support multiple people to enter the same virtual scene, play different roles to demonstrate the process, cover the whole scene demand from daily operation to emergency drill, and improve the comprehensive disposal and team cooperation ability of students. BRIEF DESCRIPTION OF DRAWINGS

[0020] Figure 1 is the system block diagram of the whole invention; Figure 2 is the workflow block diagram of the invention; Figure 3 is the system block diagram of the hardware interaction module of the invention; Figure 4 is the system block diagram of the data and model module of the invention; Figure 5 is the system block diagram of the core simulation module of the invention; Figure 6 is the system block diagram of the intelligent evaluation module of the invention; Figure 7 is the system block diagram of the application performance module of the invention. DETAILED DESCRIPTION

[0021] The embodiments of the present disclosure will be further described in detail below in combination with the drawings and examples. The detailed description of the following examples and the drawings are used to exemplarily illustrate the principles of the present disclosure, but cannot be used to limit the scope of the present disclosure, and the present disclosure can be implemented in many different forms, not limited to the specific examples disclosed herein, but includes all technical solutions falling within the scope of the claims.

[0022] Please refer to Figures 1-7 , the power training system based on virtual reality technology includes a hardware interaction module, a data and model module, a core simulation module, an intelligent evaluation module and an application performance module, the hardware interaction module includes a VR head-mounted display device, a VR handle controller, an optional force feedback glove and an optional universal action platform, the hardware interaction module is used for providing immersive experience and natural interaction means for users, the data and model module includes a high-precision three-dimensional model library, a physical property database, an operation procedure and knowledge graph library and a case library and fault library, the data and model module is used for storing high-precision three-dimensional models, physical properties, operation procedures and fault cases required for system operation, the core simulation module includes a physical engine module, a VR rendering engine module, a behavior logic and state machine module and an AI scenario generation module, the core simulation module is used for building and driving a virtual training environment, the intelligent evaluation module includes a multi-modal data acquisition module, an operation specification evaluation module and an AI intelligent analysis report module, the intelligent evaluation module is used for collecting, analyzing student operation data and generating evaluation reports, the application performance module includes a skill training module, an emergency disposal drill module, a multi-person collaborative work module and an examination and certification module, the application performance module is used to provide specific training application scene interfaces to users.

[0023] As a further technical solution of the application, the VR head-mounted display device is used to output three-dimensional visual and auditory information to the user, completely isolating the real world interference, the VR handle controller is used to capture the movement, rotation (such as grabbing and buttons, etc.) and basic actions of the user's hands, to realize primary interaction with virtual objects, the optional force feedback glove is used to capture high-precision hand skeleton actions and finger fine gestures, and provide force feedback such as vibration and resistance, to simulate the real touch of operating tools, screwing, and feeling device vibration, the optional universal action platform is used to allow the user to realize unlimited movement in the virtual world within a limited physical space, to enhance the sense of immersion.

[0024] As a further technical solution of the application, the high-precision three-dimensional model library is based on real power equipment (such as circuit breakers, disconnectors, transformers and transformers, etc.) for laser scanning and fine modeling, the model not only contains the appearance, but also contains the complete movable component disassembly structure (such as screws, valves, connecting rods, and contacts, etc.), the physical property database gives each object in the model library mass, density, friction coefficient, electrical conductivity, elasticity and other physical properties, the operation procedure and knowledge graph library is used to store standardized operation procedures, safety procedures, operation points, common fault phenomena and treatment schemes, and to build them into an associated knowledge graph, the case library and fault library are used to store historical training data, typical operation cases and a variety of preset fault scenarios (such as insulator breakage, connection point overheating, protection misoperation and short circuit, etc.).

[0025] As a further technical solution of the present application, the physical engine module calculates the motion, collision, gravity, friction and other effects of objects in the virtual environment in real time based on the physical attribute database, for example: simulating the engagement of the thread when the wrench is screwed, the weight when the heavy object is disassembled, and the falling trajectory caused by the tool falling due to misoperation, the VR rendering engine module is responsible for rendering the picture and sound calculated by the three-dimensional model library and the physical engine in real time, and outputting to the VR headset, ensuring high refresh rate and low delay of the picture, avoiding user dizziness, the behavior logic and state machine module is used to define the operation logic of the device and tool, for example, the operation logic of an "isolating switch" is defined as: first, use the "megger" to test the electricity, then use the "operating rod" and apply the correct torque and angle to close or open the switch, any operation out of logical order will be prevented or trigger an error state, the AI scenario generation module can dynamically generate training tasks and random faults based on the case library and fault library, for example, in a normal inspection task, a random event of "finding abnormal discharge sound somewhere" is dynamically injected to test the observation ability and emergency disposal process of the student.

[0026] As a further technical solution of the present application, the multi-modal data acquisition module is used to collect and record the behavior data of the student in the VR environment in real time, including but not limited to eye tracking data, hand movement trajectory, operation step sequence, operation time, tool selection and virtual object interaction history, the operation specification evaluation module is used to compare the collected behavior data with the standard process in the operation procedure and knowledge graph library, and perform quantitative scoring, the evaluation dimensions include: process specification (whether the steps are correct and complete), operation accuracy (whether the tool usage angle and force meet the standards), safety compliance (whether to maintain a safe distance and operate after testing the electricity), work efficiency (completion time), the AI intelligent analysis report module automatically generates a report with pictures and texts based on the evaluation results, accurately points out the error points and deduction items in the operation, and gives learning suggestions and correct operation instructions based on the knowledge graph.

[0027] As a further technical solution of the present application, the skill training module is used to provide step-by-step training from cognition to proficiency, such as device disassembly, switching operation, line inspection and grounding line suspension, the emergency disposal simulation module is used to simulate lightning, fire, short circuit, electric shock and other emergency situations, to train the rapid response and cooperative disposal ability of the students, the multi-person cooperative operation module allows multiple students to enter the same virtual scene at the same time, and respectively plays the roles of operator, guardian, work responsible person and other roles, to simulate the communication, voting, recitation and cooperative operation process in real work, and the examination and certification module is used to provide a standardized examination mode, the system automatically generates questions, automatically monitors the examination, and automatically scores, to realize objective and fair certification of the training results.

[0028] The power training method based on the above system comprises the following steps: S1: Training initialization: the trainee selects a training or assessment scenario through the application presentation layer, and the system loads the corresponding three-dimensional scene, device model, physical properties, and operation rules from the case library.

[0029] S2: Immersive operation: the trainee wears VR equipment and performs operations in the virtual environment constructed by the core simulation layer. The physical engine and behavior logic module respond to the interaction in real time.

[0030] S3: Full-process data collection: the multi-modal data collection module of the intelligent evaluation layer records all the operation behavior data of the trainee throughout the process.

[0031] S4: Intelligent evaluation: after the operation is completed, the operation specification evaluation module compares and analyzes the collected data with the standard process, and the AI intelligent analysis report module generates a detailed evaluation report.

[0032] S5: Feedback and review: the trainee can view the evaluation report and choose the operation playback function to watch the entire operation process from a third-person perspective or a free perspective, combined with the system's annotations to deepen understanding and achieve efficient review.

[0033] Taking the "1kV distribution line disconnecting switch power-off maintenance operation" as an example, the implementation process of the system is described, Preparation stage: the trainee wears a VR headset and force feedback gloves and selects the "disconnecting switch operation" training module. The system loads the substation environment, related disconnecting switches, voltage detector, operating lever, safety warning signs, and other models.

[0034] Operation stage: the trainee's virtual avatar enters the substation scene, and the system AI voice prompts the task: "complete the power-off operation of switch 101"; The trainee needs to first walk to the simulation panel and check the device number and state (behavior logic verification); The trainee needs to select the "voltage detector" from the tool cart, walk to the bottom of switch 101, and gradually approach the conductive part with the voltage detector contact. The system will simulate a "beep" alarm to prove that there is electricity (physical engine and sound effect simulation); The trainee needs to return and select the "insulation operating lever", walk to the operating mechanism, and the force feedback gloves will simulate the weight of the operating lever and the resistance when the lever is inserted into the operating hole. The trainee needs to use the correct force and angle to operate the switch, and if the force and angle are incorrect, the operation will fail; After the switch is opened, the trainee needs to verify the voltage again and hang the safety warning sign "no closing, someone working" after confirming that there is no electricity.

[0035] Evaluation stage: after the operation is completed, the system evaluation report is immediately generated: Process specification: deduction item: "did not check the simulation panel before operation", deduct 5 points; Operational accuracy: Deductions: "The voltage detector was not kept at a safe distance of 0.7m from the live conductor", deduct 10 points; "The operating lever's opening angle was 5 degrees too small", deduct 3 points; Safety compliance: Deduction item: "Not wearing a safety helmet", 15 points deducted (determined by the system through head tracking data); Overall score: 67 points, unsatisfactory. The report recommends focusing on strengthening the study of safety procedures and practicing operational precision.

[0036] In the debriefing phase, trainees use the "operation replay" function to watch their entire operation process from an outsider's perspective. The system highlights their mistakes in the form of highlights, slow motion, and text annotations, thus leaving a deep impression.

[0037] In summary, this invention provides a power training solution that, through the deep integration of VR, AI, and physical simulation, creates a safe, efficient, accurate, and in-depth new training model with good application prospects and promotional value.

[0038] The technical principles of the present invention have been described above with reference to specific embodiments. These descriptions are merely for explaining the principles of the invention and should not be construed as limiting the scope of protection of the invention in any way. Based on this explanation, those skilled in the art can readily conceive of other specific embodiments of the invention without inventive effort, and these embodiments will all fall within the scope of protection of the claims of the present invention.

Claims

1. A power training system based on virtual reality technology, characterized by, The system comprises a hardware interaction module, a data and model module, a core simulation module, an intelligent evaluation module, and an application performance module. The hardware interaction module includes a VR head-mounted display, VR controllers, optional force feedback gloves, and an optional omnidirectional motion platform, providing users with an immersive experience and natural interaction methods. The data and model module includes a high-precision 3D model library, a physical attribute database, an operating procedure and knowledge graph library, and a case and fault library, storing the high-precision 3D models, physical attributes, operating procedures, and fault cases required for system operation. The core simulation module includes a physics engine module, a VR rendering engine module, a behavioral logic and state machine module, and an AI scenario generation module, constructing and driving the virtual training environment. The intelligent evaluation module includes a multimodal data acquisition module, an operational compliance evaluation module, and an AI intelligent analysis report module, collecting and analyzing student operation data and generating evaluation reports. The application performance module includes a skills training module, an emergency response drill module, a multi-person collaborative operation module, and an assessment and certification module, providing users with specific training application scenario interfaces.

2. The virtual reality technology-based power training system according to claim 1, characterized by, The VR head-mounted display device is used to output three-dimensional visual and auditory information to the user, completely isolating interference from the real world. The VR hand controller is used to capture the movement, rotation, and basic movements of the user's hands, enabling basic interaction with virtual objects. The optional force feedback gloves are used to accurately capture hand skeletal movements and subtle finger postures, and provide force feedback such as vibration and resistance, simulating the realistic tactile sensation of operating tools, tightening screws, and feeling the vibration of equipment. The optional omnidirectional motion platform allows users to achieve unlimited movement in the virtual world within a limited physical space, enhancing immersion.

3. The virtual reality technology-based power training system according to claim 2, characterized by, The high-precision 3D model library is based on laser scanning and detailed modeling of real power equipment. The model includes not only the appearance but also the complete disassembled structure of movable parts. The physical attribute database assigns physical attributes such as mass, density, coefficient of friction, conductivity, and elasticity to each object in the model library. The operation procedure and knowledge graph library is used to store standardized operating procedures, safety procedures, key points of operation, common fault phenomena and handling solutions, and construct them into an associated knowledge graph. The case library and fault library are used to store historical training data, typical operation cases, and a variety of preset fault scenarios.

4. The virtual reality technology-based power training system according to claim 3, characterized by, The physics engine module, based on the physical attribute database, calculates the motion, collision, gravity, friction, and other effects of all objects in the virtual environment in real time. The VR rendering engine module is responsible for rendering the images and sounds calculated by the 3D model library and the physics engine in real time and outputting them to the VR headset, ensuring a high refresh rate and low latency to avoid user dizziness. The behavior logic and state machine module is used to define the operation logic of all devices and tools. The AI ​​scenario generation module, based on the case library and fault library, can dynamically generate training tasks and random faults.

5. The virtual reality technology based power training system as claimed in claim 4, wherein, The multimodal data acquisition module is used to collect and record all behavioral data of trainees in the VR environment in real time, including but not limited to eye-tracking data, hand movement trajectories, operation step sequence, operation time, tool selection, and interaction history with virtual objects. The operation standardization assessment module is used to compare the collected behavioral data and operation procedures with the standard processes in the knowledge graph library and to perform quantitative scoring. Based on the assessment results, the AI ​​intelligent analysis report module automatically generates a graphic assessment report, accurately pointing out the errors and deductions in the operation, and providing learning suggestions and correct operation guidance based on the knowledge graph.

6. The power training system based on virtual reality technology according to claim 1, characterized in that, The skills training module provides tiered training from basic knowledge to advanced proficiency. The emergency response drill module simulates emergencies such as lightning strikes, fires, short circuits, and electric shocks to train trainees' rapid response and collaborative handling abilities. The multi-person collaborative operation module allows multiple trainees to simultaneously enter the same virtual scenario, taking on roles such as operator, supervisor, and work leader, practicing communication, voting, repetition, and collaborative operation processes in real-world work. The assessment and certification module provides a standardized assessment model, with the system automatically generating questions, monitoring, and scoring to achieve objective and fair certification of training results.

7. The power training system based on virtual reality technology according to claim 6, characterized in that, The evaluation dimensions of the operational standardization assessment module include process standardization, operational accuracy, safety compliance, and work efficiency.

Images