Virtual reality safety training method and device, electronic equipment and storage medium
By constructing a virtual reality scene model based on the three-dimensional parameters of thermal power plant equipment and the specifications of operating procedures, designing interactive logic and configuring accident triggering conditions, the problems of insufficient scene fidelity and logical distortion in existing VR training are solved, achieving highly realistic and targeted safety training results.
Patent Information
- Application Number
- CN202511092114.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-05
- Publication Date
- 2025-11-21
AI Technical Summary
Existing VR safety training methods suffer from insufficient scene reproduction and distorted operational logic in thermal power plants. Accident simulations are detached from actual working conditions, affecting the authenticity and relevance of training effectiveness.
Based on the target equipment's 3D parameter data and operational procedures, a virtual reality scene model is constructed, interactive logic is designed, and accident triggering conditions are configured to achieve immersive safety training.
This enhances the realism and relevance of safety training, improves training effectiveness, and enables trainees to realistically experience various accident scenarios in a virtual environment, become familiar with operational procedures and standards, understand the dangers of violations, and enhance their safety awareness and risk response capabilities.
Smart Images

Figure CN120997003A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of artificial intelligence technology, and in particular to a virtual reality safety training method and apparatus, electronic device and storage medium. Background Technology
[0002] Virtual Reality (VR) technology, as an important means of industrial safety training, has been widely used in industries such as power, coal, and chemicals in recent years. Specifically, this technology constructs a highly immersive work scenario simulation platform through the collaborative operation of 3D modeling, interactive logic design, and physical simulation systems. It covers the entire process from equipment modeling and work process restoration to accident chain simulation, including key aspects such as user interaction, scene switching, and multi-view playback.
[0003] Existing VR safety training methods directly use general software platforms to build scenarios without fully considering the unique equipment layout, operation process and risk characteristics of thermal power plants. This may result in insufficient scenario fidelity, distorted operation logic, or accident simulations that deviate from actual working conditions, thus affecting the authenticity and relevance of the training. Summary of the Invention
[0004] This disclosure provides a virtual reality safety training method, apparatus, electronic device, and storage medium. Its main purpose is to address the problems of insufficient scene fidelity, distorted operational logic, or accident simulations that deviate from actual working conditions, thereby affecting the authenticity and relevance of training effectiveness.
[0005] According to a first aspect of this disclosure, a virtual reality safety training method is provided, comprising:
[0006] A simulated work scenario is determined, and a virtual reality scenario model is constructed based on the three-dimensional parameter data of the target equipment and the work process specifications; wherein, the target equipment is the equipment included in the simulated work scenario;
[0007] Based on the actual work process specifications of the simulated work scenario, design the interaction logic in the virtual reality scene model;
[0008] The constructed virtual reality scene model is obtained by configuring the accident triggering conditions based on the simulated work scenario;
[0009] Safety training is conducted based on the constructed virtual reality scene model.
[0010] Optionally, determining the simulated work scenario, and constructing a virtual reality scene model based on the three-dimensional parameter data of the target equipment and the work process specifications, includes:
[0011] Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device;
[0012] An interactive task guidance path is generated based on the task flow of the simulated task scenario.
[0013] Optionally, the design of the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario includes:
[0014] In response to the operator's instructions, subsequent processes are triggered based on the interaction logic.
[0015] Optionally, obtaining the constructed virtual reality scene model by configuring accident triggering conditions based on the simulated work scenario includes:
[0016] Based on the parameters of the target equipment described in historical accident data, simulate the effects of imbalance and fall caused by sudden equipment startup during improper operation;
[0017] By combining the electrical system parameters of the power plant, the current path, arc effect, and human reaction during an electric shock accident are simulated.
[0018] Optionally, the method further includes:
[0019] A training evaluation report is generated based on the trainees' operational behavior in the virtual reality scene model. The report includes operational compliance scores, number of incidents triggered, emergency response time, and training improvement suggestions.
[0020] According to a second aspect of this disclosure, a virtual reality safety training device is provided, comprising:
[0021] A determining unit is used to determine the simulated work scenario and construct a virtual reality scene model based on the three-dimensional parameter data of the target device and the work process specifications; wherein, the target device is the equipment included in the simulated work scenario;
[0022] The design unit is used to design the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario.
[0023] The construction unit is used to obtain the constructed virtual reality scene model by configuring accident triggering conditions based on the simulated operation scenario;
[0024] The training unit is used to conduct safety training based on the constructed virtual reality scene model.
[0025] Optionally, the determining unit is further configured to:
[0026] Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device;
[0027] An interactive task guidance path is generated based on the task flow of the simulated task scenario.
[0028] Optionally, the design unit is further configured to:
[0029] In response to the operator's instructions, subsequent processes are triggered based on the interaction logic.
[0030] Optionally, the building unit is further configured to:
[0031] Based on the parameters of the target equipment described in historical accident data, simulate the effects of imbalance and fall caused by sudden equipment startup during improper operation;
[0032] By combining the electrical system parameters of the power plant, the current path, arc effect, and human reaction during an electric shock accident are simulated.
[0033] Optionally, the device further includes:
[0034] The generation unit is used to generate a training evaluation report based on the trainees' operational behavior in the virtual reality scene model. The report includes an operational compliance score, the number of incidents triggered, the emergency response time, and training improvement suggestions.
[0035] According to a third aspect of this disclosure, an electronic device is provided, comprising:
[0036] At least one processor; and
[0037] A memory communicatively connected to the at least one processor; wherein,
[0038] The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect above.
[0039] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are configured to cause the computer to perform the method described in the first aspect above.
[0040] According to a fifth aspect of this disclosure, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the method described in the first aspect above.
[0041] The virtual reality safety training method, device, electronic device, and storage medium disclosed herein mainly include the following technical solutions: determining a simulated work scenario; constructing a virtual reality scene model based on the three-dimensional parameter data of the target device and the work process specifications; wherein the target device is the equipment included in the simulated work scenario; designing the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario; obtaining the constructed virtual reality scene model by configuring accident triggering conditions based on the simulated work scenario; and performing safety training based on the constructed virtual reality scene model. Compared with related technologies, this application, by determining a simulated work scenario, constructing a virtual reality scene model based on the three-dimensional parameter data of the target device and the work process specifications, designing interaction logic in conjunction with the actual work process specifications, and configuring accident triggering conditions that conform to the simulated work scenario, fully considers the unique equipment layout, work process, and risk characteristics of specific work scenarios. Therefore, it can solve the technical problems of insufficient scene fidelity, distorted operation logic, and accident simulation deviating from actual working conditions in existing VR safety training methods, thereby improving the authenticity and relevance of safety training and enhancing the training effect.
[0042] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description
[0043] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:
[0044] Figure 1 A flowchart illustrating a virtual reality safety training method provided in an embodiment of this disclosure;
[0045] Figure 2 This is a schematic diagram of the structure of a virtual reality safety training device provided in an embodiment of the present disclosure;
[0046] Figure 3 A schematic diagram of another virtual reality safety training device provided in an embodiment of this disclosure;
[0047] Figure 4 A schematic block diagram of an example electronic device provided for embodiments of this disclosure. Detailed Implementation
[0048] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.
[0049] The following description, with reference to the accompanying drawings, outlines a virtual reality safety training method, apparatus, electronic device, and storage medium according to embodiments of the present disclosure.
[0050] Figure 1 This is a flowchart illustrating a virtual reality safety training method provided in an embodiment of the present disclosure.
[0051] like Figure 1 As shown, the method includes the following steps:
[0052] Step 101: Determine the simulated work scenario and construct a virtual reality scenario model based on the three-dimensional parameter data of the target equipment and the work process specifications; wherein, the target equipment is the equipment included in the simulated work scenario;
[0053] Determining simulated work scenarios requires considering common high-risk work types and accident-prone scenarios in the actual working environment of thermal power plants. For example, corresponding work scenarios should be constructed for accident types such as mechanical injuries, electric shock injuries, falls from heights, and scaffolding collapses. Specific scenarios include boiler decoking area inspection scenarios, substation operation scenarios, confined space operation scenarios, and machinery operation scenarios, ensuring that the simulated scenarios cover typical thermal power plant work scenarios. The target equipment refers to various actual thermal power plant equipment included in the simulated work scenarios. Based on the system application scenario, target equipment may specifically include belt conveyors, welding machines, secondary distribution boxes, substation live equipment, scaffolding, etc. These devices are core components of the work scenarios and directly affect the realism of the simulation scenarios and the effectiveness of the drills.
[0054] When constructing a virtual reality scene model, it is necessary to base it on the three-dimensional parameter data of the target equipment. This three-dimensional parameter data covers precise data such as the size, structural features, appearance details, and component connection relationships of the target equipment. By importing this data into the modeling system, the virtual form of the target equipment can be accurately restored, ensuring that the virtual equipment is highly consistent with the actual equipment in terms of structure and appearance. At the same time, the construction process must strictly follow the operating procedures and specifications of thermal power plants. The operating procedures and specifications include the operating steps, operating standards, and safety precautions for each scenario. For example, in the inspection scenario of the fifth-floor coke removal area of the boiler, the distribution of inspection points, inspection routes, and operating requirements must be set according to the actual inspection process to ensure that the operating procedures in the virtual scene are consistent with the actual operating procedures. By combining the three-dimensional parameter data of the target equipment and the operating procedures and specifications, the final virtual reality scene model can realistically simulate the equipment layout, operating procedures, and potential risk scenarios in the working environment of a thermal power plant, providing a realistic and standardized virtual environment foundation for subsequent VR experiences.
[0055] Step 102: Based on the actual work process specifications of the simulated work scenario, design the interaction logic in the virtual reality scene model;
[0056] The actual operation process specifications cover the entire process standard in various simulated operation scenarios, from task initiation and operation execution to risk response and process closure. For example, in the mechanical injury VR experience scenario, the actual operation process specifications include the complete process of "receiving task instructions - inspecting along the route - checking the designated area - discovering abnormalities - performing operations - responding to sudden risks - selecting subsequent operations after the experience ends". These specifications provide a clear framework and basis for the design of interaction logic.
[0057] When designing interaction logic, a basic interaction framework must first be built based on the step sequence of the actual work process. Taking the mechanical injury experience as an example, following the process specification of "receiving a task," the design involves "triggering a task prompt interaction after the user selects the controller to enter the scene." When the user places the walkie-talkie in front of the user's eyes at a highlighted position, the voice task information is automatically played, realizing the interactive response of the task receiving stage. For the process of "inspecting according to specifications," a "controller ray interaction mechanism" is designed. When the user uses the end of the controller's ray to align with the prompt point, a circular progress bar is triggered as interactive feedback. When the progress bar is completed, the prompt point disappears, thus simulating the "inspection and confirmation" operation process in actual inspection, ensuring that the interaction steps are consistent with the actual inspection operation sequence.
[0058] Meanwhile, the interaction logic needs to be meticulously designed in accordance with the operational standards and safety constraints in the actual work process. The specifications clearly state that "inspections must check designated areas one by one," therefore the interaction logic is set so that "the next inspection prompt cannot be triggered until the previous inspection is completed," guiding users to follow the workflow sequence. Regarding the specification for "handling anomalies," an "abnormal scenario trigger interaction" is designed. When a user inspects the fifth area and finds a plastic bag entangled in the conveyor, the system automatically activates the "illegally board the conveyor belt to clean it" operation option. If this operation is selected, a dynamic interaction of "the conveyor belt suddenly starts" is triggered, simulating the risk consequences of improper operation in actual work, ensuring that the interaction logic matches the risk warning requirements in the safety operation specifications.
[0059] Furthermore, the interaction logic in the process completion phase is designed based on the actual post-operation handling specifications. After the experience ends, it automatically redirects to the UI interface, providing interactive options such as "accident replay, cause analysis, re-experience, and return to the main interface." This corresponds to the debriefing and summary process after an accident in actual operations, ensuring that the interactive loop of the virtual scenario is consistent with the completion specifications of the actual operation process. Through this interaction logic design based on actual operation process specifications, the virtual reality scene model can achieve precise response to user operations, process guidance, and risk feedback, enabling participants to naturally follow the operation specifications during the interaction process, thereby improving the standardization and effectiveness of the exercise.
[0060] Step 103: Based on the accident triggering conditions configured according to the simulated work scenario, the constructed virtual reality scene model is obtained;
[0061] When configuring accident triggering conditions, it is necessary to combine the actual risk characteristics, types of violations, and equipment operation patterns of each simulated operation scenario, and transform key nodes that may cause accidents in actual operations into triggerable virtual conditions. Taking the mechanical injury VR experience scenario as an example, in the boiler decoking area inspection scenario, based on the actual high-risk operation of "workers illegally climbing onto a conveyor belt that has not been fully confirmed to be stopped for cleaning", the corresponding accident triggering conditions are configured: when the experiencer operates the virtual character through the controller to "climb onto an unlocked conveyor belt", and the system detects that the action meets the preset violation operation judgment criteria (such as not performing the conveyor belt shutdown and locking confirmation process, directly entering the conveyor belt operation area), the dynamic response of "the conveyor belt suddenly starts" is automatically triggered, which in turn causes the accident scenario of "the character falling and being caught between the belt and the drum". At the same time, the screen tilts, and feedback such as effects and sound effects are provided to completely reproduce the accident process.
[0062] For simulated electric shock scenarios, such as welding machine leakage electric shock scenarios and temporary power failure electric shock scenarios, the accident triggering conditions are set around the core risk of "contact with a live part": In the welding machine leakage electric shock scenario, when the user operates the virtual character to touch the preset "welding machine leakage part" (such as a damaged cable joint) with their hand, the system detects the interaction signal between the virtual limb and the leakage part and immediately triggers the electric shock accident effect, including screen shaking, current effects and character feedback; In the level 2 distribution box personal electric shock scenario, when the system detects that the virtual character does not wear insulated tools as required and directly touches the exposed live parts inside the distribution box, the electric shock accident triggering mechanism is triggered simultaneously.
[0063] By specifically configuring accident triggering conditions that closely match actual risks in various simulated work scenarios, the virtual reality scenario model can automatically activate the accident process based on the user's actions or the scenario's state during the experience, realizing a realistic simulation chain of "operation triggering risk, risk leading to accident." Ultimately, the virtual reality scenario model configured with accident triggering conditions can fully simulate the entire process from normal operation to risk emergence and then to accident occurrence, providing users with an immersive risk awareness and safety training environment, ensuring that the training effect highly matches the actual operational risk prevention and control needs.
[0064] Step 104: Based on the constructed virtual reality scene model, perform safety training.
[0065] The constructed virtual reality scene model is a complete virtual environment after step 101 scene construction, step 102 interaction logic design, and step 103 accident triggering condition configuration. It covers the work scenarios corresponding to common accident types in thermal power plants, such as mechanical injury, electric shock injury, fall from height, and scaffolding collapse. Examples include boiler fifth-floor coke removal area inspection scenario, substation live-line work scenario, and confined space work scenario. These scenarios provide a realistic virtual carrier for safety training.
[0066] During safety training, participants first enter a pre-set virtual reality scene model by wearing VR glasses and holding interactive controllers. They participate in simulated work processes from a first-person perspective, achieving an immersive experience of the actual work environment. During the training, the system guides participants to complete various operations based on the scene's interactive logic. For example, in the mechanical injury VR experience scenario, participants need to use the controller to operate a virtual character to pick up a walkie-talkie to receive inspection tasks, and then inspect various areas along a designated route—by aligning the controller's ray with a prompt point to trigger the inspection progress bar. After completing one inspection, the prompt point disappears, and the next inspection stage begins, thus simulating the standard operating procedures in actual inspections.
[0067] When participants perform operations in the virtual scenario, the system monitors their behavior in real time to ensure it complies with safety regulations. If the accident triggering conditions configured in step 103 are triggered, such as unauthorized climbing onto an unlocked conveyor belt for cleaning in a mechanical injury scenario, the system will immediately activate the accident scenario. The system will visually depict the character falling, accompanied by effects, sound effects, and voice-over narration simulating an emergency response scenario, allowing participants to intuitively experience the risks and consequences of unauthorized operations. After the training experience ends, the system automatically redirects to the UI interface, providing options such as accident replay (reproducing the accident process from a third-person perspective) and accident cause analysis (analyzing the points of violation and safety regulations). Participants can review and learn to deepen their understanding of safety risks, or choose to experience the training again to reinforce the training effect, or return to the main interface to switch to other scenarios for continued training.
[0068] This training method, based on virtual reality scenario models, breaks through the limitations of traditional teaching. Participants can experience various accident scenarios in a virtual environment without actual risks, become familiar with work procedures and standards, and understand the dangers of violations. This effectively enhances their safety awareness and risk response capabilities, ensuring that the training results are highly compatible with the actual safety operation needs of thermal power plants.
[0069] In some embodiments, determining the simulated work scenario, based on the three-dimensional parameter data of the target equipment and the work process specifications, and constructing a virtual reality scene model includes:
[0070] Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device;
[0071] An interactive task guidance path is generated based on the task flow of the simulated task scenario.
[0072] Acquiring 3D point cloud data of the simulated work scenario is the fundamental data support for constructing an accurate virtual scene. This 3D point cloud data encompasses the geometric structure and spatial location data of the target equipment in the simulated work scenario. Specifically, for the boiler fifth-floor coke removal area inspection scenario in the mechanical injury VR experience, the 3D point cloud data includes geometric structural parameters such as the length, width, and drum diameter of the conveyor belt, as well as spatial location data such as the installation position of the conveyor belt within the boiler area and its spatial distance from surrounding equipment (such as supports and inspection channels). In the scenario of accidental electric shock in a live compartment at a substation, the 3D point cloud data covers the geometric features of the cabinet structure and component layout of the substation's live equipment, as well as data such as the spacing between each live device and its spatial distribution relationship with the operating area. By collecting this 3D point cloud data and importing it into the modeling system, the physical form of the target equipment and the spatial layout of the scene can be accurately reconstructed in point cloud form, providing data basis for the subsequent structural restoration and spatial positioning of the virtual model, ensuring that the size proportions and positional relationships of the equipment in the virtual scene are highly consistent with the actual work scenario.
[0073] Meanwhile, generating interactive work guidance paths based on the simulated work scenarios is the core design for transforming actual work specifications into virtual scene operation guidance. The work process specifications clearly define the operational steps and route requirements for each scenario. For example, in the inspection process of the mechanical injury VR experience, the actual work specifications require "inspecting each area sequentially along the designated route." The generated interactive work guidance path will be presented in the virtual scene as a distribution of prompts and route markers. Users must follow the guidance path from their initial position, moving along the set route to each inspection area. At the operational level, the guidance path is linked to the user's actions through interactive logic. For instance, when the user aligns the ray of the controller with a prompt on the path, the inspection progress bar interaction is triggered. After completing the current inspection point, the path automatically updates to the next prompt, thus guiding the user to follow the standardized process of "receiving the task—inspecting along the route—inspecting each area one by one." For scenarios involving falls from heights, the work guidance path will be based on the safety walking route specifications for high-altitude operations. Interactive guidance elements such as safety passage signs and operation position prompts will be set in the virtual scene to ensure that the testers follow the path requirements of the actual operation in the virtual operation, thereby improving the standardization and guidance effect of the virtual reality scene model.
[0074] In some embodiments, designing the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario includes:
[0075] In response to the operator's instructions, subsequent processes are triggered based on the interaction logic.
[0076] The operator's instructions refer to the various operations performed by the trainer in the virtual scene through VR interactive devices (such as controllers, motion controllers, etc.), including scene selection, device operation, and action execution. These instructions are the key inputs that trigger the progress of the virtual scene process.
[0077] When designing interaction logic, it is necessary to strictly follow the actual work process specifications of the simulated work scenario to ensure that the triggering relationship between operation instructions and subsequent processes conforms to the actual work steps. Taking the VR experience scenario of mechanical injury as an example, when the trainee selects to enter the scenario using the controller, this operation command triggers the initial interaction, and the system immediately responds and displays task prompts. According to the actual inspection process specifications, when the trainee moves the walkie-talkie to the highlighted position in front of them with the controller, this operation command is recognized by the system, and the interaction logic immediately triggers the playback of voice task information, completing the "receiving task instructions" process. In the inspection phase, the actual operation process requires "checking the designated areas one by one according to the specifications." Therefore, when the trainee aligns the end of the controller with the indicator point, this operation command triggers the interactive feedback of the circular progress bar display. After the progress bar is completed, the indicator point disappears, thus responding to the operation and triggering the subsequent "inspection completed" process. When the trainee discovers an anomaly in the fifth area and executes the operation command of "climbing onto the conveyor belt for cleaning," the interaction logic, based on the specification of "risk caused by violation of operation" in the actual operation, immediately triggers the dynamic scenario of "the conveyor belt suddenly starts," advancing to the subsequent process of the accident. After the experience, the trainee selects options such as "accident replay" and "cause analysis" in the UI interface using the controller. These operation commands will trigger the corresponding content display process, completing the debriefing phase after the experience.
[0078] Through this logical design of "operation command - interactive response - process trigger", the virtual reality scene model can respond to user operations in real time, so that the virtual process strictly follows the actual operation specifications and proceeds in an orderly manner. This ensures that trainees can intuitively feel the continuity and standardization of the operation process in the interaction, and enhance the immersion and effectiveness of safety drills.
[0079] In some embodiments, obtaining the constructed virtual reality scene model by configuring accident triggering conditions based on the simulated work scenario includes:
[0080] Based on the parameters of the target equipment described in historical accident data, simulate the effects of imbalance and fall caused by sudden equipment startup during improper operation;
[0081] By combining the electrical system parameters of the power plant, the current path, arc effect, and human reaction during an electric shock accident are simulated.
[0082] The phrase "simulating the imbalance and fall effect caused by sudden equipment startup during improper operation based on historical accident data and target equipment parameters" refers to the historical accident data covering the triggering scenarios, startup parameters, and personnel injury characteristics of sudden equipment startup in past mechanical injury accidents in thermal power plants. The target equipment parameters include core data such as the startup acceleration, running speed, and drum spacing of belt conveyors. Taking the VR experience scenario of mechanical injury as an example, in the inspection scenario of the decoking area of the boiler on the fifth floor, based on the typical case data of "accidental start of belt conveyor in the unlocked state" in historical accidents, combined with the actual start response time and instantaneous running speed of the belt conveyor in this scenario, the accident triggering conditions are configured: when the experiencer executes the operation command of "illegally boarding the unlocked belt conveyor" through the controller, the system simulates the dynamic process of the belt conveyor suddenly starting according to the start parameters of the target equipment. By setting the start acceleration parameters consistent with the actual equipment, the virtual belt conveyor generates a motion state that conforms to the laws of physics at the moment of triggering. At the same time, based on the principles of human kinematics and combined with the posture data of personnel losing balance and falling in historical accidents, a first-person perspective animation of "unsteady standing - body tilting" is generated, presenting the perspective shaking and center of gravity shift effect during the fall process, and recreating the scene of imbalance and fall caused by the sudden start of the equipment, allowing the experiencer to intuitively feel the risk consequences of illegal operation.
[0083] The phrase "simulating the current path, arc effect, and human reaction during an electric shock accident by combining power plant electrical system parameters" refers to power plant electrical system parameters including voltage levels, current intensity, and equipment insulation parameters under different scenarios, such as the rated voltage of live equipment in the booster station, the operating current of the welding machine, and the leakage current value of the level 2 distribution box. In VR electric shock experience scenarios, such as accidentally entering a live section at a substation, the system configures electric shock triggering conditions based on the actual voltage level and current parameters of the electrical equipment in that scenario. When the user operates a virtual character to touch the live equipment, the system calculates the path of the current from the contact point (e.g., the hand), through the human body, to the grounding point based on electrical parameters, and presents the current flow trajectory through virtual effects. Simultaneously, it simulates an electric arc effect based on current intensity parameters—a strong white electric arc and sparks appear in high-current scenarios, while a weak blue arc appears in low-current scenarios, matching the arc effect to actual electrical parameters. In terms of human reaction simulation, it combines the principle of current stimulation of muscles, generating corresponding virtual reactions based on current intensity, such as the instantaneous twitching of limbs during a minor electric shock, and the stiffness of the body and screen shaking under a strong current, recreating the physiological reactions during an electric shock. This allows users to perceive the risk of electric shock through visual and tactile feedback, strengthening their understanding of electrical safety regulations. Through this configuration of accident triggering conditions combining equipment and electrical parameters, the virtual reality scenario model can realistically reproduce the physical process and sensory experience of an accident, enhancing the realism and warning effect of safety drills.
[0084] In some embodiments, the method further includes:
[0085] A training evaluation report is generated based on the trainees' operational behavior in the virtual reality scene model. The report includes operational compliance scores, number of incidents triggered, emergency response time, and training improvement suggestions.
[0086] Operational compliance scores are generated based on the trainees' adherence to operational procedures in a virtual environment. The system compares the trainees' actual operations with preset safety operation standards. For example, in a VR experience scenario involving mechanical injuries, it checks whether the trainees complete inspection point checks in the prompted order, whether they illegally board the equipment without confirming that the conveyor belt is locked, and whether they correctly execute task reception and equipment operation steps. Scores are assigned based on the degree of conformity between the operation and the standards. Higher scores are given for strict adherence to procedures, while points are deducted for violations, directly reflecting the trainees' mastery of operational standards.
[0087] The accident trigger count is generated by statistically analyzing the frequency of accidents triggered by trainees in different simulated scenarios. The system records the number of times trainees trigger the accident triggering conditions described in step 103 due to improper operation in 17 scenarios, including mechanical injury, electric shock, and falls from heights. For example, the number of times the belt conveyor starts and causes an accident in the mechanical injury scenario, and the number of times electric shock accidents are triggered due to contact with live parts in the electric shock scenario. The number of times directly reflects the trainees' awareness and ability to avoid risks in different scenarios.
[0088] Emergency response time is recorded for emergency procedures set up in the scenario, referring to the time interval from when an accident is triggered to when the trainee begins to perform emergency operations. For example, in a mechanical injury scenario, if the system has emergency response prompts set up after an accident, the system records the trainee's response time from when the accident screen appears to when they choose to review the incident or take virtual emergency measures; in an electric shock scenario, the system records the reaction time from when the electric shock accident is triggered to when the trainee stops the dangerous operation. This indicator reflects the trainee's emergency response speed and risk management awareness.
[0089] The training improvement suggestions are generated based on the analysis results of the aforementioned quantitative indicators. The system combines indicators with low operational compliance scores, scenarios with concentrated accident triggering, and types of emergency response times to accurately pinpoint the weaknesses of trainees. For example, if mechanical injury scenarios have a high accident triggering rate, it is recommended to strengthen training on belt conveyor operation safety regulations; if the inspection process score is low in the operational compliance assessment, it is recommended to increase specific drills on standardized inspection procedures; if the emergency response time for a certain type of scenario is too long, it is recommended to supplement training on the emergency response procedures for that scenario. This provides a clear direction for personalized training optimization and improves the overall relevance and effectiveness of safety training.
[0090] Corresponding to the aforementioned virtual reality safety training method, this invention also proposes a virtual reality safety training device. Since the device embodiments of this invention correspond to the aforementioned method embodiments, details not disclosed in the device embodiments can be referred to the aforementioned method embodiments, and will not be repeated here.
[0091] Figure 2 This is a schematic diagram of the structure of a virtual reality safety training device provided in an embodiment of this disclosure, as shown below. Figure 2 As shown, it includes:
[0092] The determining unit 21 is used to determine the simulated work scenario and construct a virtual reality scene model based on the three-dimensional parameter data of the target device and the work process specifications; wherein, the target device is the device included in the simulated work scenario;
[0093] Design unit 22 is used to design the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario.
[0094] Construction unit 23 is used to obtain the constructed virtual reality scene model according to the accident triggering conditions configured based on the simulated operation scenario;
[0095] Training unit 24 is used to perform safety training based on the constructed virtual reality scene model.
[0096] Furthermore, in one possible implementation of this disclosure, the determining unit 21 is further configured to:
[0097] Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device;
[0098] An interactive task guidance path is generated based on the task flow of the simulated task scenario.
[0099] Furthermore, in one possible implementation of this disclosure, the design unit 22 is further configured to:
[0100] In response to the operator's instructions, subsequent processes are triggered based on the interaction logic.
[0101] Furthermore, in one possible implementation of this disclosure, the construction unit 23 is further configured to:
[0102] Based on the parameters of the target equipment described in historical accident data, simulate the effects of imbalance and fall caused by sudden equipment startup during improper operation;
[0103] By combining the electrical system parameters of the power plant, the current path, arc effect, and human reaction during an electric shock accident are simulated.
[0104] Furthermore, in one possible implementation of the embodiments of this disclosure, such as Figure 3 As shown, the device further includes:
[0105] The generation unit 25 is used to generate a training evaluation report based on the trainees' operational behavior in the virtual reality scene model. The report includes an operational compliance score, the number of accident triggers, the emergency response time, and training improvement suggestions.
[0106] It should be noted that the foregoing explanation of the method embodiments also applies to the apparatus of the embodiments of this disclosure, and the principle is the same. Therefore, the embodiments of this disclosure are not limited thereto.
[0107] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.
[0108] Figure 4 A schematic block diagram of an example electronic device 300 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.
[0109] like Figure 4 As shown, device 300 includes a computing unit 301, which can perform various appropriate actions and processes based on a computer program stored in ROM (Read-Only Memory) 302 or a computer program loaded from storage unit 308 into RAM (Random Access Memory) 303. RAM 303 can also store various programs and data required for the operation of device 300. The computing unit 301, ROM 302, and RAM 303 are interconnected via bus 304. I / O (Input / Output) interface 305 is also connected to bus 304.
[0110] Multiple components in device 300 are connected to I / O interface 305, including: input unit 306, such as keyboard, mouse, etc.; output unit 307, such as various types of monitors, speakers, etc.; storage unit 308, such as disk, optical disk, etc.; and communication unit 309, such as network card, modem, wireless transceiver, etc. Communication unit 309 allows device 300 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0111] The computing unit 301 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, CPUs (Central Processing Units), GPUs (Graphics Processing Units), various special-purpose AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, DSPs (Digital Signal Processors), and any suitable processor, controller, microcontroller, etc. The computing unit 301 performs the various methods and processes described above, such as virtual reality safety training methods. For example, in some embodiments, the virtual reality safety training method can be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 308. In some embodiments, part or all of the computer program can be loaded and / or installed on device 300 via ROM 302 and / or communication unit 309. When the computer program is loaded into RAM 303 and executed by the computing unit 301, one or more steps of the methods described above can be performed. Alternatively, in other embodiments, computing unit 301 may be configured to perform the aforementioned virtual reality security training method by any other suitable means (e.g., by means of firmware).
[0112] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application-Specific Standard Products), SOCs (System-on-Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0113] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0114] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only Memory) or flash memory, optical fiber, CD-ROM (Compact Disc Read-Only Memory), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0115] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0116] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include LANs (Local Area Networks), WANs (Wide Area Networks), the Internet, and blockchain networks.
[0117] Computer systems can include clients and servers. Clients and servers are generally geographically separated and typically interact via communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. A server can be a cloud server, also known as a cloud computing server or cloud host, a hosting product within the cloud computing service ecosystem, addressing the shortcomings of traditional physical hosts and VPS (Virtual Private Server, or simply "VPS") services, such as high management difficulty and weak business scalability. Servers can also be servers for distributed systems or servers incorporating blockchain technology.
[0118] It's important to note that artificial intelligence (AI) is the study of enabling computers to simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, and planning). It encompasses both hardware and software technologies. AI hardware technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, and big data processing. AI software technologies primarily include computer vision, speech recognition, natural language processing, machine learning / deep learning, big data processing, and knowledge graph technologies.
[0119] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.
[0120] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.
Claims
1. A virtual reality safety training method, characterized in that, include: A simulated work scenario is determined, and a virtual reality scenario model is constructed based on the three-dimensional parameter data of the target equipment and the work process specifications; wherein, the target equipment is the equipment included in the simulated work scenario; Based on the actual work process specifications of the simulated work scenario, design the interaction logic in the virtual reality scene model; The constructed virtual reality scene model is obtained by configuring the accident triggering conditions based on the simulated work scenario; Safety training is conducted based on the constructed virtual reality scene model.
2. The method according to claim 1, characterized in that, The process of determining the simulated work scenario, based on the three-dimensional parameter data of the target equipment and the work process specifications, and constructing a virtual reality scene model includes: Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device; An interactive task guidance path is generated based on the task flow of the simulated task scenario.
3. The method according to claim 1, characterized in that, The design of the interaction logic in the virtual reality scene model, based on the actual work process specifications of the simulated work scenario, includes: In response to the operator's instructions, subsequent processes are triggered based on the interaction logic.
4. The method according to claim 1, characterized in that, The step of configuring accident triggering conditions based on the simulated work scenario to obtain the constructed virtual reality scene model includes: Based on the parameters of the target equipment described in historical accident data, simulate the effects of imbalance and fall caused by sudden equipment startup during improper operation; By combining the electrical system parameters of the power plant, the current path, arc effect, and human reaction during an electric shock accident are simulated.
5. The method according to any one of claims 1-4, characterized in that, The method further includes: A training evaluation report is generated based on the trainees' operational behavior in the virtual reality scene model. The report includes operational compliance scores, number of incidents triggered, emergency response time, and training improvement suggestions.
6. A virtual reality safety training device, characterized in that, include: A determining unit is used to determine the simulated work scenario and construct a virtual reality scene model based on the three-dimensional parameter data of the target device and the work process specifications; wherein, the target device is the equipment included in the simulated work scenario; The design unit is used to design the interaction logic in the virtual reality scene model based on the actual work process specifications of the simulated work scenario. The construction unit is used to obtain the constructed virtual reality scene model by configuring accident triggering conditions based on the simulated operation scenario; The training unit is used to conduct safety training based on the constructed virtual reality scene model.
7. The apparatus according to claim 6, characterized in that, The determining unit is further configured to: Acquire three-dimensional point cloud data of the simulated work scenario; wherein, the three-dimensional point cloud data includes the geometric structure and spatial position data of the target device; An interactive task guidance path is generated based on the task flow of the simulated task scenario.
8. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-5.
10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method according to any one of claims 1-5.