Implementation method of immersive dangerous working condition emergency drilling platform based on Web and VR equipment and drilling platform

By combining a Web front-end system based on Vue.js and Babylon.js with VR equipment, an immersive emergency drill platform was built, which solved the high cost and risk issues of traditional emergency drills, achieved efficient and flexible multi-terminal adaptation and immersive interaction, and improved training effects.

CN120669980APending Publication Date: 2025-09-19DAQING ANRUIDA TECH DEV CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510768712.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-06-10
Publication Date
2025-09-19

AI Technical Summary

Technical Problem

Traditional emergency drills are costly, risky, lack immersion, and lack flexibility. They cannot support the immersive interaction of VR devices and are difficult to achieve high-frequency training and multi-terminal adaptation.

Method used

The Web front-end system is built based on the Vue.js framework, integrating the Babylon.js engine to achieve 3D scene rendering, combined with VR devices for interaction, and the rehearsal process is defined through JSON/JS scripts. It supports multi-person collaborative rehearsals and records and evaluates user operation data in real time.

Benefits of technology

It provides an immersive training experience, reduces actual operational risks, improves training effectiveness and flexibility, supports multiple terminal devices, and enables high-frequency and remote access emergency drills.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120669980A_ABST
    Figure CN120669980A_ABST
Patent Text Reader

Abstract

The invention discloses an implementation method of an immersive dangerous working condition emergency drilling platform based on Web and VR equipment and the drilling platform, and belongs to the field of Web visualization and emergency management. And the common problems of high cost, high risk, poor immersion and insufficient flexibility of the traditional means are solved. The method comprises the following steps: constructing a Web front-end system, and integrating a Babylon.js engine to realize 3D scene rendering; loading and analyzing the industrial equipment model in the GLTF / OBJ format; a WebXR API (Application Program Interface) of Babylon.js is utilized to be in butt joint with the VR head-mounted display equipment; defining a drilling process through a configurable JSON / JS script; recording a user operation path, reaction time and operation sequence data, and generating a quantitative evaluation report; multi-person collaborative drilling is realized based on WebSocket, and an administrator is supported to monitor behaviors of participants through a background interface and perform remote intervention. The method is used in the emergency response drilling field.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of Web visualization and emergency management, and in particular relates to a method for realizing an immersive dangerous working condition emergency drill platform based on Web and VR equipment. Background Art

[0002] In high-risk industries like petrochemicals, power generation, and rail transit, emergency response drills and safety training for hazardous work conditions are crucial for ensuring the safety of workers and minimizing property losses. The traditional drill methods currently used by the industry suffer from three major limitations: First, on-site, on-site drills require the deployment of a large number of personnel and equipment, occupying physical plant resources. This is not only costly but also carries the risk of secondary accidents. Furthermore, due to space and time constraints, frequent training is difficult to implement. Second, passive training methods such as video tutorials and flowchart learning (e.g., PowerPoint presentations and video tutorials) lack immersion and interactivity, failing to simulate the psychological pressure and dynamic environmental changes experienced in real-world accidents, resulting in superficial training effectiveness. Third, while localized 3D simulation software systems can create virtual scenes, they rely on dedicated client installations and struggle to adapt to multiple devices. In particular, they lack support for immersive interaction with VR devices, creating significant bottlenecks in collaborative drills, remote access, and rapid deployment. Summary of the Invention

[0003] In view of this, the present invention aims to propose an implementation method and a drill platform for an immersive hazardous working condition emergency drill based on the Web and VR devices, in order to address the common problems of traditional methods, such as high cost, high risk, poor immersion, and insufficient flexibility. To achieve the above objectives, the present invention adopts the following technical solutions: A method for implementing an immersive hazardous working condition emergency drill platform based on the Web and VR devices, the method comprising: Build a web front-end system based on the Vue.js framework and integrate the Babylon.js engine to achieve 3D scene rendering; Use Babylon.js to load and parse industrial equipment models in GLTF / OBJ format to build a 3D virtual scene that includes terrain, ambient light, and interactive equipment. Use Babylon.js's WebXR API to connect to VR headsets, allowing users to control the viewing angle by rotating their head and trigger device interactions through handle rays or gestures. Define the drill process through configurable JSON / JS scripts, including trigger conditions, feedback animations, and voice guidance for fire, gas leaks, and equipment failure events; Record user operation paths, response times, and operation sequence data in real time, and automatically generate quantitative evaluation reports including response timeliness and process compliance; Multi-person collaborative drills are implemented based on WebSocket, allowing administrators to monitor participant behavior and intervene remotely through the background interface.

[0004] Furthermore, a preferred embodiment is proposed, in which the 3D virtual scene integrates the Cannon.js physics engine and adds gravity simulation and collision detection logic to the interactive device model.

[0005] Furthermore, a preferred method is proposed, in which the event script sets a multi-modal trigger mechanism, including time node drive and user behavior trigger, and supports parallel loading of multiple working condition processes.

[0006] Furthermore, a preferred method is proposed, in which the evaluation report is exported in CSV / JSON format and associated with improvement suggestions for use in training review and data archiving.

[0007] Based on the same inventive concept, the present invention further proposes an immersive hazardous working condition emergency drill platform for implementing any of the above methods, the platform comprising: Front-end module: used for 3D scene rendering and interactive interface built based on Vue.js and Babylon.js, adapted to PC, mobile terminals and VR headsets; Event engine module: used to parse JSON / JS scripts to dynamically drive the dangerous working condition event process; Behavior analysis module: used to capture user operation data in real time and generate evaluation reports; Collaborative management module: used to achieve multi-user status synchronization and administrator background monitoring based on WebSocket.

[0008] Furthermore, a preferred embodiment is proposed, in which the front-end module integrates particle system rendering capabilities to simulate visual effects of fire, smoke, and gas leakage.

[0009] Furthermore, a preferred method is proposed, in which the collaborative management module sets role authority levels, including exercise administrators, ordinary employees, and observers, and allows administrators to interrupt the exercise process in real time.

[0010] Based on the same inventive concept, the present invention also proposes a computer device, including a memory and a processor, wherein a computer program is stored in the memory. When the processor runs the computer program stored in the memory, the processor executes a method for implementing an immersive hazardous working condition emergency drill platform based on a Web and VR device as described in any one of the above items.

[0011] Based on the same inventive concept, the present invention also proposes a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the implementation method of an immersive hazardous working condition emergency drill platform based on Web and VR devices as described above are executed.

[0012] Compared with the prior art, the present invention has the following beneficial effects: The proposed method leverages Web and VR technologies, eliminating the need for a real-world plant resource management platform. This avoids the high costs and secondary risks associated with equipment and personnel scheduling during offline drills. All operations can be performed in a virtual environment, significantly reducing the risks of actual operations. Simulating hazardous conditions without involving actual equipment or workers reduces the risk of equipment damage or personal injury caused by mistakes during the drill.

[0013] VR devices, through hardware like headsets and controllers, provide a truly immersive experience, allowing users to operate and respond to crises as if they were in a real environment, significantly improving training effectiveness. Compared to traditional video or PowerPoint training methods, trainees can better understand complex operational procedures and emergency response. Using controller ray or gesture control, users can directly interact with virtual devices to trigger emergency events or operations, enhancing active and interactive learning.

[0014] The platform uses the Vue.js framework to build a web front-end. Users only need a browser to access the drill platform, eliminating the need to download and install complex client software. It offers excellent compatibility and supports a wide range of devices. Students can participate in drills anytime, anywhere, greatly enhancing flexibility. The platform supports collaboration between the web and VR devices, and is compatible with PC, mobile, and VR devices simultaneously, adapting to the needs of diverse scenarios. Remote access is also supported, allowing administrators and students to participate in drills regardless of their location.

[0015] Using JSON / JS scripts, administrators can customize drill processes based on different hazardous conditions (such as fire, gas leak, and equipment failure), including event trigger conditions, feedback animations, and voice guidance. This not only improves the relevance and practicality of drills but also adapts to the needs of different businesses or industries. The platform records user operation paths, response times, and operation sequences in real time, automatically generating quantitative evaluation reports. This data can help analyze student performance, identify problems promptly, and implement targeted training and improvements.

[0016] Using WebSocket technology, the platform supports multiple participants in simultaneous drills, enabling collaborative team training. Administrators can monitor participants' actions in real time through the backend interface to ensure the drill proceeds as expected. During the collaborative drill, administrators can intervene at any time to adjust the process or provide guidance to ensure participants' actions adhere to safety regulations. The platform generates quantitative assessment reports on response timeliness and process compliance, helping companies implement targeted improvements and optimizations based on participant performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which constitute part of the present invention, are provided to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are provided to explain the present invention and do not constitute an undue limitation of the present invention. In the accompanying drawings: Figure 1 This is a flow chart of the implementation method of an immersive hazardous working condition emergency drill platform based on Web and VR devices described in the present invention. DETAILED DESCRIPTION

[0018] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely explain the technical solutions in the embodiments of the present invention. It should be noted that the embodiments of the present invention and the features therein can be combined with each other in the absence of conflict, and the embodiments described are only part of the embodiments of the present invention, not all of the embodiments.

[0019] Implementation method 1, see Figure 1 This embodiment describes a method for implementing an immersive hazardous working condition emergency drill platform based on a Web and VR device, the method comprising: Build a web front-end system based on the Vue.js framework and integrate the Babylon.js engine to achieve 3D scene rendering; Use Babylon.js to load and parse industrial equipment models in GLTF / OBJ format to build a 3D virtual scene that includes terrain, ambient light, and interactive equipment. Use Babylon.js's WebXR API to connect to VR headsets, allowing users to control the viewing angle by rotating their head and trigger device interactions through handle rays or gestures. Define the drill process through configurable JSON / JS scripts, including trigger conditions, feedback animations, and voice guidance for fire, gas leaks, and equipment failure events; Record user operation paths, response times, and operation sequence data in real time, and automatically generate quantitative evaluation reports including response timeliness and process compliance; Multi-person collaborative drills are implemented based on WebSocket, allowing administrators to monitor participant behavior and intervene remotely through the background interface.

[0020] The method proposed in this implementation utilizes web and VR technologies, eliminating the need for a real-world plant resource management platform. This avoids the high costs and secondary risks associated with equipment and personnel scheduling during offline drills. All operations can be performed in a virtual environment, significantly reducing the risks of actual operations. Simulating hazardous working conditions without involving actual equipment or workers reduces the risk of equipment damage or personal injury caused by mistakes during the drill.

[0021] VR devices, through hardware like headsets and controllers, provide a truly immersive experience, allowing users to operate and respond to crises as if they were in a real environment, significantly improving training effectiveness. Compared to traditional video or PowerPoint training methods, trainees can better understand complex operational procedures and emergency response. Using controller ray or gesture control, users can directly interact with virtual devices to trigger emergency events or operations, enhancing active and interactive learning.

[0022] The platform uses the Vue.js framework to build a web front-end. Users only need a browser to access the drill platform, eliminating the need to download and install complex client software. It offers excellent compatibility and supports a wide range of devices. Students can participate in drills anytime, anywhere, greatly enhancing flexibility. The platform supports collaboration between the web and VR devices, and is compatible with PC, mobile, and VR devices simultaneously, adapting to the needs of diverse scenarios. Remote access is also supported, allowing administrators and students to participate in drills regardless of their location.

[0023] Using JSON / JS scripts, administrators can customize drill processes based on different hazardous conditions (such as fire, gas leak, and equipment failure), including event trigger conditions, feedback animations, and voice guidance. This not only improves the relevance and practicality of drills but also adapts to the needs of different businesses or industries. The platform records user operation paths, response times, and operation sequences in real time, automatically generating quantitative evaluation reports. This data can help analyze student performance, identify problems promptly, and implement targeted training and improvements.

[0024] Using WebSocket technology, the platform supports multiple participants in simultaneous drills, enabling collaborative team training. Administrators can monitor participants' actions in real time through the backend interface to ensure the drill proceeds as expected. During the collaborative drill, administrators can intervene at any time to adjust the process or provide guidance to ensure participants' actions adhere to safety regulations. The platform generates quantitative assessment reports on response timeliness and process compliance, helping companies implement targeted improvements and optimizations based on participant performance.

[0025] Implementation method 2. This implementation method further limits the implementation method of an immersive hazardous working condition emergency drill platform based on Web and VR devices described in implementation method 1. The 3D virtual scene integrates the Cannon.js physics engine and adds gravity simulation and collision detection logic to the interactive device model.

[0026] By integrating the Cannon.js physics engine into 3D virtual scenes, we can more realistically simulate the reactions of the physical environment, such as gravity and collisions. This allows users to better experience realistic operation and environmental feedback when conducting emergency drills for hazardous conditions using web and VR devices, thereby improving the effectiveness of emergency drills.

[0027] After integrating the physics engine, various objects and devices in the 3D scene can interact with users more naturally, avoiding unnatural operations in traditional virtual environments, improving the user's immersive experience, and enhancing the effectiveness of training.

[0028] Because the platform is web-based and VR-enabled, it can be easily accessed and operated across different devices and platforms, enhancing its universality and flexibility. Users can conduct high-quality emergency drills without requiring high-end hardware.

[0029] Implementation method three. This implementation method further limits the implementation method of an immersive hazardous working condition emergency drill platform based on Web and VR devices described in implementation method one. The event script sets a multimodal trigger mechanism, including time node drive and user behavior trigger, and supports parallel loading of multiple working condition processes.

[0030] A multimodal triggering mechanism makes the platform more flexible and intelligent. Driven by time nodes, it can simulate the passage of time and the sequence of events in real-world situations, ensuring that users experience various emergency situations at the precise moment. Triggered by user behavior, the system can dynamically adjust the drill progress based on the user's actual actions or reactions, enhancing user engagement and realism, and improving training effectiveness.

[0031] For example, when users take certain actions in a virtual environment, the platform can judge the users' decisions and reactions in real time, dynamically trigger the next emergency measures or adjust the working conditions, making the drills more in line with the complexity and changes of real emergency situations.

[0032] This configuration allows the platform to load multiple different hazardous working conditions at the same time, which means that multiple emergency situations can be handled simultaneously in one drill. This parallel loading method greatly improves the efficiency and diversity of training, enabling a variety of emergency drills to be conducted in a shorter period of time, reducing the waste of time and resources. For example, during a drill, users can not only simulate emergency response to fire accidents, but also deal with other risks such as power failures and chemical leaks at the same time, thereby exercising their comprehensive ability to deal with multiple emergency situations. This efficient multi-tasking method can increase the complexity and actual combat effectiveness of training.

[0033] The platform's web-based implementation provides cross-platform accessibility, allowing users to access it from any internet-connected device, enhancing the system's usability and flexibility. Furthermore, the web-based design facilitates subsequent system expansion, enabling rapid updates and optimization of exercise content to adapt to changing needs and environmental changes.

[0034] For example, administrators can quickly update hazardous situation scripts or drill processes based on the latest safety standards or technological advances, ensuring that the drill content always matches real-world emergency situations.

[0035] Implementation method 4. This implementation method further limits the implementation method of an immersive hazardous working condition emergency drill platform based on Web and VR devices described in implementation method 1. The evaluation report is exported in CSV / JSON format and associated with improvement suggestions for training review and data archiving.

[0036] Embodiment 5: This embodiment provides an immersive hazardous working condition emergency drill platform for implementing any one of the methods of Embodiments 1 to 4, the platform comprising: Front-end module: used for 3D scene rendering and interactive interface built based on Vue.js and Babylon.js, adapted to PC, mobile terminals and VR headsets; Event engine module: used to parse JSON / JS scripts to dynamically drive the dangerous working condition event process; Behavior analysis module: used to capture user operation data in real time and generate evaluation reports; Collaborative management module: used to achieve multi-user status synchronization and administrator background monitoring based on WebSocket.

[0037] Implementation method six: This implementation method further limits the immersive hazardous working condition emergency drill platform described in implementation method five. The front-end module integrates particle system rendering capabilities to simulate the visual effects of fire, smoke, and gas leakage.

[0038] This embodiment is explained in conjunction with the fifth embodiment. The platform front-end module described in this embodiment is built based on Vue.js and Babylon.js, and can support adaptation to PC, mobile terminals, and VR headsets, greatly improving the platform's accessibility and flexibility. Users can choose different devices to conduct drills according to their needs, enhancing the platform's applicability and user experience. The event engine module dynamically drives the dangerous working condition event process by parsing JSON / JS scripts, allowing the platform to flexibly generate emergency drill content based on different scenario changes. The behavior analysis module captures user operation data in real time and generates evaluation reports. It can perform real-time analysis of user performance during the drill and provide valuable feedback. This helps improve the effectiveness of the drill, helping users and administrators quickly identify problems and make effective improvements and enhancements. The collaborative management module uses WebSocket to achieve multi-user status synchronization and administrator background monitoring, allowing multiple users to collaborate on emergency drills in real time, and administrators can also monitor the status and progress of each user in real time. This collaborative approach facilitates cooperation between teams and improves the overall effectiveness and efficiency of the drill.

[0039] The front-end module also integrates particle system rendering capabilities, simulating the visual effects of dangerous working conditions such as fire, smoke, and gas leaks, enhancing the immersive experience. Through realistic visual effects, users can more realistically perceive the urgency of dangerous working conditions, thereby more effectively responding to similar situations in real work and improving emergency response capabilities.

[0040] The design of this platform provides a more immersive emergency drill experience by combining 3D rendering, particle effects and multi-device support. It can simulate various dangerous scenarios in the real environment, making participants feel as if they are in the situation, which helps to improve the effectiveness and participation of emergency drills.

[0041] Implementation method seven. This implementation method further limits the immersive hazardous working condition emergency drill platform described in implementation method five. The collaborative management module sets role authority levels, including drill administrators, ordinary employees, and observers, and allows administrators to interrupt the drill process in real time.

[0042] Implementation method 8. A computer device described in this implementation method includes a memory and a processor, wherein a computer program is stored in the memory. When the processor runs the computer program stored in the memory, the processor executes the implementation method of an immersive hazardous working condition emergency drill platform based on a Web and VR device according to any one of implementation methods 1 to 4.

[0043] Implementation method nine: A computer-readable storage medium described in this implementation method stores a computer program, and when the computer program is executed by a processor, the steps of a method for implementing an immersive hazardous working condition emergency drill platform based on the Web and VR devices as described in any one of implementation methods one to four are executed.

[0044] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Thus, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROMs, optical storage, etc.) containing computer-usable program code. The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including the instruction device, which implements the function specified in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes. These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes. Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure and are not intended to limit its scope of protection. Although the present disclosure has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that after reading the present disclosure, those skilled in the art can still make various changes, modifications or equivalent substitutions to the specific implementation methods of the invention, but these changes, modifications or equivalent substitutions are all within the scope of protection of the disclosed claims.

Claims

1. A method for implementing an immersive dangerous working condition emergency drill platform based on Web and VR devices, characterized in that: The method comprises: Build a web front-end system based on the Vue.js framework and integrate the Babylon.js engine to achieve 3D scene rendering; Use Babylon.js to load and parse industrial equipment models in GLTF / OBJ format to build a 3D virtual scene that includes terrain, ambient light, and interactive equipment. Use Babylon.js's WebXR API to connect to VR headsets, allowing users to control the viewing angle by rotating their head and trigger device interactions through handle rays or gestures. Define the drill process through configurable JSON / JS scripts, including trigger conditions, feedback animations, and voice guidance for fire, gas leaks, and equipment failure events; Record user operation paths, response times, and operation sequence data in real time, and automatically generate quantitative evaluation reports including response timeliness and process compliance; Multi-person collaborative drills are implemented based on WebSocket, allowing administrators to monitor participant behavior and intervene remotely through the background interface.

2. The method for implementing an immersive dangerous working condition emergency drill platform based on Web and VR devices according to claim 1, characterized in that: The 3D virtual scene integrates the Cannon.js physics engine and adds gravity simulation and collision detection logic to the interactive device model.

3. The method for implementing an immersive dangerous working condition emergency drill platform based on Web and VR devices according to claim 1, characterized in that: The event script sets a multi-modal trigger mechanism, including time node drive and user behavior trigger, and supports parallel loading of multiple working conditions.

4. The method for implementing an immersive dangerous working condition emergency drill platform based on Web and VR devices according to claim 1, characterized in that: The evaluation report is exported in CSV / JSON format and associated with improvement suggestions for training review and data archiving.

5. An immersive dangerous working condition emergency drill platform for implementing any one of the methods of claims 1-4, characterized in that: The platform includes: Front-end module: used for 3D scene rendering and interactive interface built based on Vue.js and Babylon.js, adapted to PC, mobile terminals and VR headsets; Event engine module: used to parse JSON / JS scripts to dynamically drive the dangerous working condition event process; Behavior analysis module: used to capture user operation data in real time and generate evaluation reports; Collaborative management module: used to achieve multi-user status synchronization and administrator background monitoring based on WebSocket.

6. The immersive dangerous working condition emergency drill platform according to claim 5 is characterized in that: The front-end module integrates particle system rendering capabilities to simulate the visual effects of fire, smoke, and gas leakage.

7. The immersive dangerous working condition emergency drill platform according to claim 5 is characterized in that: The collaborative management module sets role authority levels, including exercise administrators, ordinary employees, and observers, and allows administrators to interrupt the exercise process in real time.

8. A computer device, characterized in that: The invention comprises a memory and a processor, wherein a computer program is stored in the memory. When the processor runs the computer program stored in the memory, the processor executes the implementation method of an immersive hazardous working condition emergency drill platform based on a Web and a VR device according to any one of claims 1 to 4.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the steps of a method for implementing an immersive hazardous working condition emergency drill platform based on a Web and VR device as described in any one of claims 1 to 4.