A wearable laboratory safety emergency drill system and drill method

Abstract

This invention relates to the field of virtual reality and laboratory safety technology, and discloses a wearable laboratory safety emergency drill system and method, comprising: a multimodal sensor module, including a hazardous gas detector, a biosafety monitoring unit, an equipment high-temperature anomaly detector, an inertial measurement unit, and an ultra-wideband positioning chip, for real-time detection of laboratory hazards and tracking of user position and posture; and a mixed reality display module, including binocular see-through MR glasses and a projection laser pointer, for optical overlay of virtual and real scenes and projection of hazard signs; this wearable laboratory safety emergency drill system, through the virtual-real fusion linkage of the multimodal sensor module and the MR display module, can dynamically overlay virtual accident scenarios and emergency response guidelines in a real laboratory environment, solving the problems of high cost and limited scenarios of traditional physical simulation devices, and realizing the organic combination of multi-dimensional risk perception and immersive drills.

Description

Technical Field

[0001] This invention relates to the fields of virtual reality and laboratory safety technology, specifically to a wearable laboratory safety emergency drill system and drill method. Background Technology

[0002] As laboratory research activities become increasingly in-depth and diversified, the safety risks lurking in the laboratory environment are becoming more complex, including but not limited to high-risk events such as chemical leaks, volatilization of highly toxic gases, burns from high-temperature equipment, contamination by biological pathogens, and violent explosions. To improve the safety awareness and emergency response capabilities of researchers, emergency drills, as an important part of laboratory safety management, are widely deployed in various research institutions and university laboratories.

[0003] Traditional emergency drills primarily rely on a combination of physical simulations and training exercises. Common formats include setting up simulated leak points, installing alarms, and using props to simulate fires or poisoning incidents. While these drills offer a degree of immersion and operability, they also have several limitations: Firstly, building physical simulation environments requires significant human and material resources, resulting in high costs. Secondly, the simulated scenarios are limited by space and equipment conditions, failing to cover a wide range of complex and dynamic risk events and lacking scalability. Furthermore, traditional drills struggle to provide real-time feedback on participants' operational errors; the effectiveness of the drills depends mainly on manual observation and post-event evaluation, hindering immediate correction and precise assessment.

[0004] In recent years, immersive technologies such as virtual reality (VR) and augmented reality (AR) have been increasingly applied to safety training, with some laboratories introducing wearable VR systems to assist in drills. However, most VR solutions currently on the market are general-purpose platforms, only suitable for basic scene display and path guidance, lacking the ability to identify laboratory-specific hazards (such as volatile chemicals, biological reagents, and precision high-temperature instruments). Furthermore, the sensor configurations in existing systems are relatively limited, often failing to accurately perceive key physical variables (such as temperature, concentration, evaporation rate, and human posture), thus restricting the accuracy and professionalism of training feedback.

[0005] More importantly, most existing virtual drill systems lack a linkage mechanism with physical safety equipment in laboratories (such as fume hoods, toxic gas detectors, emergency sprinklers, and fire extinguishing systems). This results in drills failing to trigger or synchronize the responses of these real devices, leading to a significant disconnect between the drill's effectiveness and actual emergency response. When emergency operations are triggered during virtual drills, the system cannot assess their feasibility and effectiveness in a real environment in real time, thus failing to comprehensively evaluate the emergency response capabilities and operational proficiency of the drill participants.

[0006] Therefore, there is an urgent need for a laboratory emergency drill system that integrates high-precision sensing technology, intelligent judgment mechanisms, and the ability to link physical equipment, so as to replace traditional drill methods in a more realistic, comprehensive, and cost-effective way, thereby improving the efficiency of responding to laboratory emergencies and the quality of training. Summary of the Invention

[0007] (a) Technical problems to be solved

[0008] To address the shortcomings of existing technologies, this invention provides a wearable laboratory safety emergency drill system and method, which has the advantage of being able to dynamically overlay virtual accident scenarios in a real laboratory environment to conduct immersive emergency drills.

[0009] (II) Technical Solution

[0010] To achieve the aforementioned goal of dynamically overlaying virtual accident scenarios in a real laboratory environment to conduct immersive emergency drills, this invention provides the following technical solution: a wearable laboratory safety emergency drill system, comprising: The multimodal sensor module includes a hazardous gas detector, a biosafety monitoring unit, an equipment high-temperature anomaly detector, an inertial measurement unit, and an ultra-wideband positioning chip, which are used to detect laboratory hazards in real time and track user position and action posture. The mixed reality display module includes binocular see-through MR glasses and a projection laser pointer, used for optical overlay of virtual and real scenes and projection of hazard signs; The biofeedback module, including haptic feedback gloves, a monitoring wristband, and directional bone conduction headphones, is used to track hand movements, simulate accidental tactile sensations, monitor physiological indicators, and provide spatial voice guidance. The edge computing unit, with its built-in lightweight AI processor, laboratory map engine, and communication module, is used for real-time data processing, virtual-real scene linkage, and communication with cloud servers and laboratory IoT terminals.

[0011] As a preferred embodiment of the present invention, the hazardous gas detector is used to detect CO, H2, CH4, Cl2 and volatile organic compounds (VOCs). The biosafety monitoring unit integrates a microbial aerosol concentration sensor and an ultraviolet intensity sensor; The high-temperature anomaly detector of the device uses a thermal imaging camera to capture high-temperature areas; The positioning chip is used to detect user actions and postures and perform spatial positioning.

[0012] As a preferred embodiment of the present invention, the projection laser pointer of the mixed reality display module is used to project dynamic hazard signs onto the surface of real objects, and can dynamically adjust the transparency of the virtual warning frame according to the hazard level.

[0013] As a preferred embodiment of the present invention, the force feedback mode of the haptic feedback glove includes: High-frequency vibrations simulate the tactile sensation of liquid splashing; Local resistance heating simulates high-temperature burning; Multi-point pressure feedback simulates mechanical damage resistance.

[0014] As a preferred technical solution of the present invention, the laboratory map engine built into the edge computing unit supports three-dimensional point cloud spatial mapping and updates the equipment location and emergency exits in real time; the AI ​​processor infers the accident evolution path through a localized model and collaborates with the cloud server to generate virtual scenarios. (III) Beneficial Effects

[0015] Compared with existing technologies, the present invention provides a wearable laboratory safety emergency drill system, which has the following beneficial effects: 1. This wearable laboratory safety emergency drill system, through the virtual-real fusion linkage of multimodal sensor modules and MR display modules, can dynamically overlay virtual accident scenarios and emergency response guidelines in a real laboratory environment, solving the problems of high cost and single scenario of traditional physical simulation devices, and realizing the organic combination of multi-dimensional risk perception and immersive drills.

[0016] 2. This wearable laboratory safety emergency drill system adopts a collaborative mechanism of biofeedback module and edge computing unit. It simulates the physical touch of real accidents through tactile feedback gloves and constructs a closed-loop training system by combining physiological indicator monitoring, which significantly improves the operator's emergency response muscle memory and stress response capabilities.

[0017] 3. This wearable laboratory safety emergency drill system, based on UWB positioning and laboratory map engine spatial registration technology, achieves precise spatial mapping between virtual accident scenarios and physical emergency equipment. By triggering real ventilation and sprinkler systems, it forms a virtual-real linkage effect, making the drill process fully consistent with the actual emergency response process.

[0018] 4. This wearable laboratory safety emergency drill system has established a laboratory accident evolution model library, which supports the activation of differentiated virtual accident scenarios through multi-dimensional triggering mechanisms such as physical operation actions and abnormal biological indicators, greatly improving the coverage of drill scenarios and the systematic nature of training.

[0019] 5. This wearable laboratory safety emergency drill system achieves localized real-time data processing and collaborative computing with cloud models through edge computing units. While ensuring a low-latency interactive experience, it combines three-dimensional trajectory playback and physiological stress level assessment to provide multimodal quantitative analysis basis for optimizing emergency plans.

[0020] 6. This wearable laboratory safety emergency drill system uses a spatial warning system with a projection laser pointer and bone conduction headphones to provide multi-channel safety guidance while maintaining the integrity of the real scene, effectively avoiding the environmental isolation risks caused by traditional VR devices. Attached Figure Description

[0021] Figure 1 This is an actual demonstration diagram of the present invention; Figure 2 This is a schematic diagram of the system architecture of the exercise system of the present invention; Figure 3 This is a flowchart of the demonstration method of the present invention; Figure 4 This is a schematic diagram of the actual multimodal sensor module of the present invention. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. Example

[0023] Please see Figures 1-4 A wearable laboratory safety emergency drill system, specifically including: The multimodal sensor module includes a hazardous gas detector, a biosafety monitoring unit, an equipment high-temperature anomaly detector, an inertial measurement unit (IMU), and an ultra-wideband positioning chip (UWB) for real-time detection of laboratory hazards and tracking of user position and posture. The hazardous gas detector detects CO, Cl2, H2, CH4, and volatile organic compounds (VOCs). The biosafety monitoring unit integrates a microbial aerosol concentration sensor and an ultraviolet intensity sensor. The equipment high-temperature anomaly detector uses a thermal imaging camera to capture high-temperature areas. The positioning chip enables centimeter-level spatial positioning of user posture and movements.

[0024] In this embodiment, the hazardous gas detector, biosafety monitoring unit, and high-temperature equipment detector are all integrated into the same portable instrument (e.g., Figure 1This device can be worn on the user's chest. The hazardous gas detector uses a high-sensitivity electrochemical sensor array to monitor the concentration of gases such as CO, H2, and CH4 in the laboratory environment in real time (detection threshold set at 10 ppm); the biosafety monitoring unit includes a microbial aerosol sensor (sensitivity for 0.1 μm particles) and an ultraviolet intensity sensor (range 200-400 nm); the high-temperature detector uses a thermal imaging array (resolution 640×480) to monitor abnormal surface temperatures of experimental equipment (threshold set at 60℃).

[0025] The mixed reality display module includes binocular see-through MR glasses and a projection laser pointer, which are used for optical overlay of virtual and real scenes and projection of hazard signs; the projection laser pointer of the mixed reality display module is used to project dynamic hazard signs onto the surface of real objects, and the transparency of the virtual warning frame can be dynamically adjusted according to the hazard level.

[0026] In this embodiment, binocular see-through MR glasses are used, and a depth camera-based SLAM algorithm is used to overlay the virtual scene onto the real laboratory scene, with a virtual-real fusion error of less than 2cm. A laser projection indicator (wavelength 650nm) is integrated into the MR glasses, which can project different indicator icons in a coordinated manner in the laboratory.

[0027] The biofeedback module includes a haptic feedback glove, a heart rate / blood oxygen monitoring wristband, and a directional bone conduction headset, used to track hand movements, simulate accidental tactile sensations, monitor physiological indicators, and provide spatial voice guidance. The force feedback modes of the haptic feedback glove may include: high-frequency vibration to simulate the tactile sensation of liquid splashing; localized resistance heating to simulate high-temperature burning; and multi-point pressure feedback to simulate mechanical injury resistance.

[0028] In this embodiment, the haptic feedback glove contains a haptic actuator. When the user accidentally touches the virtual leakage area, the palm of the glove applies 5N pressure and simulates a burning sensation (vibration at a frequency of 50Hz). The physiological monitoring bracelet integrates a PPG sensor to monitor the user's heart rate in real time (accuracy ±3bpm). If it exceeds 100bpm, the system will trigger a downgrade exercise to increase the difficulty.

[0029] The edge computing unit integrates a lightweight AI processor, a laboratory map engine, and a 5G / Wi-Fi 6 communication module for real-time data processing, virtual-real scene linkage, and communication with cloud servers and laboratory IoT terminals. The laboratory map engine built into the edge computing unit supports 3D point cloud spatial mapping and updates equipment location and emergency exits in real time. The AI ​​processor infers the evolution path of accidents through localized models and collaborates with the cloud server to generate virtual scenarios.

[0030] The linkage steps for the above modules are as follows: 1. The multimodal sensor module works in conjunction with the edge computing unit and MR display module. In a simulated safety accident scenario within a physical laboratory, the multimodal sensor module uploads detection data to the edge computing unit. The edge computing unit processes and analyzes the real-time data. When a specific risk is identified, such as a hazardous gas leak, the edge computing unit calls upon the cloud server to overlay the virtual scene onto the physical laboratory through MR glasses. For example, the MR glasses automatically overlay a virtual warning frame and diffusion simulation effects at the leak source location, while a projection-type laser pointer projects virtual hazard signs into the real scene. By merging the virtual scene with the physical laboratory scene through binocular see-through MR glasses, the human body can intuitively perceive the process of a laboratory safety accident.

[0031] 2. The biofeedback module is linked with the edge computing unit and the MR display module. The haptic feedback glove is linked with binocular see-through MR glasses. The MR glasses capture hand movements and touched objects, feeding this information back to the edge computing unit. Based on the accident type and hand movements, the edge computing unit infers the risk evolution process and outputs differentiated force feedback through the haptic feedback glove, such as simulating limb burns from chemical leaks or hand scalds from high-temperature equipment. The human body interacts with laboratory safety accident scenarios through vision and touch; the heart rate / blood oxygen monitoring bracelet can capture the body's physiological responses in high-risk scenarios.

[0032] 3. The edge computing unit has a built-in laboratory map engine. Combined with UWB positioning data, it dynamically marks the corresponding emergency response measures and rescue methods in the MR glasses interface, and provides navigation routes to the nearest emergency equipment and emergency exits to guide personnel in emergency response.

[0033] like Figure 1 As shown, the multimodal sensor module is worn on the chest, the mixed reality display module is worn on the face, the biofeedback module is worn on the hand, and the edge computing module is worn on the waist belt; Figure 1 In the image, the upper left is the actual scene, and the lower left is the virtual scene (simulated explosion).

[0034] This embodiment also provides a laboratory safety emergency drill method, which specifically includes the following steps: S1. Virtual and Real Scene Construction: A 3D point cloud model of the laboratory is generated by laser scanning, and the spatial coordinates of the physical entity are registered with the virtual scene. A library of pre-set laboratory accident evolution models is provided in the virtual scene, including accident types such as explosion, fire, leakage, mechanical injury, and poisoning and asphyxiation. S2, Dynamic Drills: Accident Triggering Phase: The virtual accident scenario is activated by user violations and erroneous actions, abnormal laboratory physical monitoring indicators, and abnormal human physiological monitoring indicators. Emergency response phase: The laboratory map engine of the edge computing unit matches the positioning data of the positioning chip with the laboratory map, and the virtual scene is overlaid on the physical laboratory through MR glasses to provide an emergency guidance layer. The projection laser pointer is controlled to project the mark on the real scene to guide the user to carry out emergency response actions. The positioning chip captures the user's behavior trajectory, the haptic feedback gloves record the user's operation actions and provide tactile feedback, and the edge computing unit provides feedback on the accident response effect based on the user's operation and links with physical emergency equipment. Evaluation and feedback phase: Record operation time, path selection and equipment usage sequence, and generate exercise scores and playback videos by combining physiological stress data.

[0035] The activation conditions for the accident triggering phase specifically include: Physical action triggering: IMU and UWB capture user behavior trajectory, haptic feedback gloves record user operation actions, and activate the virtual scene of laboratory accident when violation behavior and erroneous action are detected; Abnormal monitoring indicators trigger: When the multimodal sensor module detects abnormal laboratory physical indicators (such as toxic gas concentration, equipment temperature, etc.), or when the heart rate / blood oxygen monitoring wristband detects abnormal user physiological indicators, a virtual scenario of a laboratory accident is activated.

[0036] During the emergency response phase, if the user does not operate according to the specifications, the tactile glove will continue to apply force feedback, and the edge computing unit will trigger the activation of emergency equipment and facilities in the physical laboratory (such as ventilation system, emergency sprinkler system, etc.).

[0037] The playback video during the evaluation and feedback phase is used to mark key error points in user operations and to provide virtual correction solutions and comparisons of optimal handling paths.

[0038] In this invention, the laboratory accident evolution model library specifically includes: Explosion accident scenario models, such as explosion accidents caused by chemical mixing reactions; Fire accident scenario models, such as a fire caused by high temperature in a tubular furnace igniting surrounding combustibles; Leakage accident scenario models, such as a biosafety cabinet failure leading to aerosol contamination; Mechanical injury accident scenario model, such as a person's limb crush injury accident caused by improper operation of a materials mechanics testing machine; A model of a poisoning and asphyxiation accident scenario, such as an asphyxiation accident caused by nitrogen leakage in a confined space due to lack of oxygen; Other accident scenario models, such as accidents caused by the shock wave and debris from an explosion of an autoclave, resulting in personal injury.

[0039] In this invention, an emergency drill for methane gas leakage in a gas cylinder room is used as an example: Step 1: Building a Virtual and Real Scene 1. Use a 3D laser scanner to create a 3D model of the gas cylinder room, generate point cloud data (1mm accuracy), and map the entity coordinates to the virtual scene database.

[0040] 2. A virtual scene of the gas cylinder room is constructed using Unity 3D, and a methane gas leakage and diffusion model is constructed using a particle system. If the user does not choose to wear a virtual gas mask and does not choose the correct escape route, a poisoning scenario will be displayed. If the user chooses to wear a virtual gas mask but does not correctly start the ventilation system and does not deal with the leak source in time, an explosion scenario will be displayed.

[0041] Step Two: Dynamic Incident Trigger When the user simulates opening the gas cylinder valve, the IMU detects an error in the opening sequence of the pressure reducing valves on the gas cylinder and gas circuit. The edge computing unit immediately initiates a virtual methane gas leak program, and the MR glasses display a gas diffusion effect. If the user's heart rate remains above 100 bpm for 10 seconds, the system automatically pauses the exercise and initiates voice guidance: "Stress response detected, please adjust your breathing."

[0042] Step 3: Emergency Response Phase In a realistic laboratory setting, the MR glasses display a floating instruction above the gas cylinder cabinet: "Wear a gas mask → Close the gas valve → Start ventilation." Simultaneously, a laser projection marks a danger zone around the leak point. The user must complete the following virtual steps within 5 minutes: ① Locate and wear a gas mask in the gas cylinder room; ② Start the ventilation system; ③ Close the gas cylinder pressure relief valve; ④ Choose the correct escape route; ⑤ Set up a warning zone and report the incident from the safe area. If the user fails to complete these steps correctly and in a timely manner, the edge computing unit triggers the activation of the laboratory's real ventilation system and emergency broadcast system via IoT protocol. In case of user error, such as reversed gas cylinder pressure relief valve operation, the haptic gloves apply pressure and trigger a level three vibration warning.

[0043] Step 4: Evaluation and Feedback The system records key indicators (such as response time, operation sequence, path deviation, etc.) and deducts points accordingly; for example, 15 points are deducted if a user does not use the virtual gas mask correctly. If the rate of decrease in blood oxygen saturation is >2% / min or the heart rate remains >100 bpm for more than 60 seconds, it is judged as a high-risk stress level, and psychological training is recommended. The system generates timestamped training videos using the Unity engine, marks error nodes, and generates a PDF improvement report.

[0044] Thirty sets of controlled experiments showed that, compared with the traditional drill group, the training group using this invention had a 67% higher rate of standardized emergency response operations and a 42% shorter physiological stress recovery time.

[0045] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A wearable laboratory safety emergency drill system, characterized in that, include: The multimodal sensor module, including a hazardous gas detector, a biosafety monitoring unit, an equipment high-temperature anomaly detector, an inertial measurement unit, and an ultra-wideband positioning chip, is used to detect laboratory hazards in real time and track the user's position and posture. It can be worn on the chest. The mixed reality display module, including binocular see-through MR glasses and a projection laser pointer, is used for optical overlay of virtual and real scenes and projection of hazard signs, and can be worn on the face; The biofeedback module, including haptic feedback gloves, a monitoring wristband, and directional bone conduction headphones, is used to track hand movements, simulate accidental tactile sensations, monitor physiological indicators, and provide spatial voice guidance. It can be worn on the hand. The edge computing unit, which integrates a lightweight AI processor, a laboratory map engine, and a communication module, is used for real-time data processing, virtual-real scene linkage, and communication with cloud servers and laboratory IoT terminals. It can be located at the waist. The drill method for a wearable laboratory safety emergency drill system includes the following steps: S1. Virtual and Real Scene Construction: A 3D point cloud model of the laboratory is generated by laser scanning, and the spatial coordinates of the physical entity are registered with the virtual scene. A library of pre-set laboratory accident evolution models is provided in the virtual scene, including accident types such as explosion, fire, leakage, mechanical injury, and poisoning / asphyxiation; S2, Dynamic Drills: Accident Triggering Phase: The virtual accident scenario is activated by user violations and erroneous actions, abnormal laboratory physical monitoring indicators, and abnormal human physiological monitoring indicators. Emergency response phase: The laboratory map engine of the edge computing unit matches the positioning data of the positioning chip with the laboratory map, and the virtual scene is overlaid on the physical laboratory through MR glasses to provide an emergency guidance layer. The projection laser pointer is controlled to project the mark on the real scene to guide the user to carry out emergency response actions. The positioning chip captures the user's behavior trajectory, the haptic feedback gloves record the user's operation actions and provide tactile feedback, and the edge computing unit provides feedback on the accident response effect based on the user's operation and links with physical emergency equipment. Assessment and feedback phase: Record operation time, path selection and equipment usage sequence, and generate exercise scores and playback videos by combining physiological stress data; The activation conditions for the accident triggering phase include: Physical action trigger: The positioning chip captures the user's behavior trajectory, and the haptic feedback glove records the user's operation actions. When a violation or incorrect action is detected, a virtual scenario of a laboratory accident is activated. Abnormal monitoring indicator trigger: When the multimodal sensor module detects abnormal laboratory physical indicators, or the monitoring wristband detects abnormal user physiological indicators, a virtual scenario of a laboratory accident is activated. During the emergency response phase, if the user does not operate according to the specifications, the haptic feedback glove will continue to apply force feedback, and the edge computing unit will trigger the activation of the emergency equipment and facilities in the physical laboratory.

2. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The hazardous gas detector is used to detect CO, H2, CH4, Cl2, and volatile organic compounds (VOCs). The biosafety monitoring unit integrates a microbial aerosol concentration sensor and an ultraviolet intensity sensor; The high-temperature anomaly detector of the device uses a thermal imaging camera to capture high-temperature areas; The positioning chip is used to detect user actions and postures and perform spatial positioning.

3. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The mixed reality display module's projection laser pointer is used to project dynamic hazard signs onto the surface of real objects, and can dynamically adjust the transparency of the virtual warning frame according to the hazard level.

4. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The force feedback modes of the haptic feedback glove include: High-frequency vibrations simulate the tactile sensation of liquid splashing; Local resistance heating simulates high-temperature burning; Multi-point pressure feedback simulates mechanical damage resistance.

5. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The edge computing unit's built-in laboratory map engine supports 3D point cloud spatial mapping and updates equipment location and emergency exits in real time; the AI ​​processor infers the accident evolution path through a localized model and collaborates with the cloud server to generate virtual scenarios.

6. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The playback video in the evaluation and feedback phase marks key error nodes in the user's operation and provides virtual correction schemes and comparisons of optimal handling paths.

7. The wearable laboratory safety emergency drill system according to claim 1, characterized in that: The laboratory accident evolution model library includes: Explosion accident scenario model; Fire accident scenario model; Leakage accident scenario model; Mechanical injury accident scenario model; A scenario model of a poisoning and suffocation accident.

Images