Wearable laboratory safety emergency drilling system and drilling method

Abstract

The invention relates to the technical field of virtual reality and laboratory safety, and discloses a wearable laboratory safety emergency drilling system and method, and the system comprises a multi-mode sensor module which comprises a hazardous gas detector, a biological safety monitoring unit, an equipment high-temperature abnormity detector, an inertial measurement unit and an ultra-wideband positioning chip, the system is used for detecting laboratory hazard sources in real time and tracking user positions and action postures. The mixed reality display module comprises binocular perspective MR glasses and a projection type laser indicator and is used for optical superposition of virtual and real scenes and dangerous mark projection; according to the wearable laboratory safety emergency drilling system, through virtual-real fusion linkage of the multi-mode sensor module and the MR display module, a virtual accident scene and emergency disposal guidance can be dynamically superposed in a real laboratory environment, and the problems that a traditional physical simulation device is high in cost and single in scene are solved; and organic combination of multi-dimensional risk perception and immersive drilling is realized.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality and laboratory safety technology, and in particular to a wearable laboratory safety emergency drill system and a drill method. Background Art

[0002] As laboratory research continues to deepen and diversify, potential safety risks in laboratory environments are becoming increasingly complex, including but not limited to chemical leaks, volatile toxic gases, burns from high-temperature equipment, contamination from biological pathogens, and violent reactions and explosions. To enhance researchers' safety awareness and emergency response capabilities, emergency drills, as a crucial component of laboratory safety management, are widely deployed in laboratories at various research institutions and universities.

[0003] Traditional emergency drills primarily rely on a combination of physical simulations and lesson plan training. Common methods include setting up simulated leak points, setting alarms, and using props to simulate fires or poisoning accidents. While these drills offer a certain level of immersion and practicality, they also have numerous limitations. On the one hand, the human and material resources required to build a physical simulation environment are substantial and costly. On the other hand, simulation scenarios are limited by space and equipment, making them unable to cover a variety of complex and dynamic risk events and lacking scalability. Furthermore, traditional drills struggle to provide real-time feedback on operational errors made by participants. Drill effectiveness relies primarily on manual observation and post-event evaluation, making immediate corrections and accurate assessments impossible.

[0004] In recent years, immersive technologies such as virtual reality (VR) and augmented reality (AR) have gradually been applied to safety training, and some laboratories have introduced wearable VR systems to assist in drills. However, most VR solutions currently available on the market are general-purpose platforms, suitable only for basic scene display and path guidance, and lack the ability to identify laboratory-specific hazardous sources (such as volatile chemicals, biological reagents, precision high-temperature instruments, etc.). At the same time, the sensor configuration in existing systems is relatively simple, and often cannot achieve accurate perception of key physical variables (such as temperature, concentration, evaporation rate, human posture, etc.), limiting the accuracy and professionalism of training feedback.

[0005] More importantly, most existing virtual drill systems lack linkage mechanisms with physical laboratory safety equipment (such as fume hoods, toxic gas alarms, emergency sprinklers, and fire extinguishing systems). This results in drill actions being unable to trigger or synchronize responses from these real devices, resulting in a significant disconnect between the drill results and actual emergency response. When emergency actions are triggered during virtual drills, the system cannot determine their feasibility and effectiveness in real-world environments in real time, making it impossible to fully assess the drill participants' emergency response capabilities and operational proficiency.

[0006] Therefore, there is an urgent need for a laboratory emergency drill system that integrates high-precision sensing technology, intelligent judgment mechanism and physical equipment linkage capabilities, to replace traditional drill methods in a more realistic, comprehensive and low-cost way, and to improve the response efficiency and training quality of laboratory emergencies. Summary of the Invention

[0007] (1) Technical problems solved

[0008] In response to the shortcomings of the existing technology, the present invention provides a wearable laboratory safety emergency drill system and drill method, which have the advantage of being able to dynamically superimpose virtual accident scenarios in a real laboratory environment to conduct immersive emergency drills.

[0009] (2) Technical solution

[0010] To achieve the above-mentioned purpose of dynamically superimposing virtual accident scenarios in a real laboratory environment and thus conducting immersive emergency drills, the present invention provides the following technical solutions: a wearable laboratory safety emergency drill system, comprising:

[0011] Multimodal sensor modules, including hazardous gas detectors, biosafety monitoring units, equipment high-temperature anomaly detectors, inertial measurement units, and ultra-wideband positioning chips, are used to detect laboratory hazards in real time and track user location and gestures.

[0012] Mixed reality display module, including binocular see-through MR glasses and projected laser pointers, used for optical overlay of virtual and real scenes and projection of hazard signs;

[0013] Biofeedback modules, including tactile feedback gloves, a monitoring bracelet, and directional bone conduction headphones, are used to track hand movements, simulate accident tactile sensations, monitor physiological indicators, and provide spatialized voice guidance;

[0014] The edge computing unit has a built-in lightweight AI processor, laboratory map engine and communication module, which is used for real-time data processing, virtual and real scene linkage, and communication with cloud servers and laboratory IoT terminals.

[0015] As a preferred technical solution of the present invention, the hazardous gas detector is used to detect CO, H2, CH4, CL2 and volatile organic compounds (VOCs);

[0016] The biosafety monitoring unit integrates a microbial aerosol concentration sensor and an ultraviolet intensity sensor;

[0017] The device's high temperature anomaly detector uses a thermal imaging camera to capture high temperature areas;

[0018] The positioning chip is used to realize user action posture detection and spatial positioning.

[0019] As a preferred technical solution of the present invention, the projection laser pointer of the mixed reality display module is used to project dynamic hazard signs on the surface of real objects, and can dynamically adjust the transparency of the virtual warning box according to the hazard level.

[0020] As a preferred technical solution of the present invention, the force feedback mode of the tactile feedback glove includes:

[0021] High-frequency vibration simulates the touch of liquid splashing;

[0022] Local resistance heating simulates high temperature burning;

[0023] Multi-point pressure feedback simulates mechanical injury resistance.

[0024] As a preferred technical solution of the present invention, the laboratory map engine built into the edge computing unit supports three-dimensional point cloud space mapping and updates the equipment location and emergency exits in real time; the AI ​​processor infers the accident evolution path through a localized model and collaborates with the cloud server to generate virtual scenarios.

[0025] (3) Beneficial effects

[0026] Compared with the existing technology, the present invention provides a wearable laboratory safety emergency drill system with the following beneficial effects:

[0027] 1. This wearable laboratory safety emergency drill system, through the virtual-real fusion linkage of multimodal sensor modules and MR display modules, can dynamically superimpose virtual accident scenarios and emergency response guidelines in a real laboratory environment. This solves the problems of high cost and single scenario of traditional physical simulation devices, and realizes the organic combination of multi-dimensional risk perception and immersive drills.

[0028] 2. This wearable laboratory safety emergency drill system uses a collaborative mechanism between a biofeedback module and an edge computing unit. It simulates the physical touch of a real accident through tactile feedback gloves and combines physiological indicator monitoring to build a closed-loop training system, significantly improving operators' emergency response muscle memory and stress response capabilities.

[0029] 3. This wearable laboratory safety emergency drill system, based on UWB positioning and the spatial registration technology of the laboratory map engine, achieves accurate spatial mapping of virtual accident scenes and physical emergency equipment. By triggering real ventilation and sprinkler systems, it forms a virtual-real linkage effect, making the drill process completely consistent with the actual emergency response process.

[0030] 4. The wearable laboratory safety emergency drill system has established a laboratory accident evolution model library, which supports the activation of differentiated virtual accident scenarios through multi-dimensional trigger mechanisms such as physical operation actions and abnormal biological indicators, greatly improving the coverage of drill scenarios and the systematic nature of training.

[0031] 5. This wearable laboratory safety emergency drill system uses edge computing units to achieve collaborative computing of local real-time data processing and cloud models. While ensuring a low-latency interactive experience, it combines three-dimensional trajectory playback with physiological stress level assessment to provide a multimodal quantitative analysis basis for optimizing emergency plans.

[0032] 6. This wearable laboratory safety emergency drill system uses a spatial warning system of projected laser pointers and bone conduction headphones to provide multi-channel safety guidance while maintaining the integrity of the real scene, effectively avoiding the environmental isolation risks caused by traditional VR equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a practical demonstration diagram of the present invention;

[0034] Figure 2 Schematic diagram of the system architecture of the training system of the present invention;

[0035] Figure 3 is a flow chart of the practice method of the present invention;

[0036] Figure 4 Schematic diagram of the multimodal sensor module of the present invention. DETAILED DESCRIPTION

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0038] Example:

[0039] See also Figure 1-Figure 4 , a wearable laboratory safety emergency drill system, specifically including:

[0040] The multimodal sensor module, including hazardous gas detectors, biosafety monitoring units, equipment high-temperature anomaly detectors, inertial measurement units (IMUs) and ultra-wideband positioning chips (UWB), is used to detect laboratory hazardous sources in real time and track user location and posture. The hazardous gas detectors are used to detect CO, H2, CH4, CL2 and volatile organic compounds (VOCs). The biosafety monitoring unit integrates microbial aerosol concentration sensors and ultraviolet intensity sensors. The equipment high-temperature anomaly detector uses a thermal imaging camera to capture high-temperature areas. The positioning chip is used to achieve user posture and centimeter-level spatial positioning.

[0041] In this embodiment, the hazardous gas detector, biosafety monitoring unit, equipment high temperature detector, etc. are all integrated into the same portable instrument (such as Figure 1 The device is designed to be worn on the user's chest. The hazardous gas detector uses a highly sensitive electrochemical sensor array to monitor the concentrations of gases such as CO, H2, and CH4 in the laboratory environment in real time (with a detection threshold set at 10 ppm). The biosafety monitoring unit includes a microbial aerosol sensor (sensitivity to 0.1 μm particles) and an ultraviolet intensity sensor (range 200-400 nm). The high-temperature detector uses a thermal imaging array (resolution 640×480) to monitor abnormal surface temperatures of experimental equipment (with a threshold set at 60°C).

[0042] The mixed reality display module includes binocular perspective MR glasses and a projection laser pointer, which are used for optical superposition of virtual and real scenes and projection of hazard signs. The projection laser pointer of the mixed reality display module is used to project dynamic hazard signs on the surface of real objects, and the transparency of the virtual warning box can be dynamically adjusted according to the hazard level.

[0043] In this example, binocular perspective MR glasses are used to overlay a virtual scene onto a real laboratory scene using a depth camera-based SLAM algorithm, achieving a virtual-reality fusion error of less than 2 cm. A laser projection indicator (wavelength 650 nm) is integrated into the MR glasses, enabling the projection of various indicator icons in the laboratory.

[0044] The biofeedback module includes tactile feedback gloves, a heart rate / blood oxygen monitoring bracelet and directional bone conduction headphones, which are used to track hand movements, simulate accident touch, monitor physiological indicators and provide spatial voice guidance; the force feedback modes of the tactile feedback gloves can include: high-frequency vibration to simulate the touch of liquid splashing; local resistance heating to simulate high-temperature burns; multi-point pressure feedback to simulate mechanical injury resistance.

[0045] In this embodiment, the tactile feedback glove contains a tactile actuator. When the user accidentally touches the virtual leak area, the palm of the glove applies 5N of pressure and simulates a burning sensation (vibration frequency 50Hz). The physiological monitoring bracelet integrates a PPG sensor to monitor the user's heart rate in real time (accuracy ±3bpm). If it exceeds 100bpm, the system triggers a downgrade of the drill difficulty.

[0046] The edge computing unit has a built-in lightweight AI processor, laboratory map engine and 5G / Wi-Fi6 communication module, which is used for real-time data processing, virtual and real scene linkage, and communication with cloud servers and laboratory IoT terminals; the laboratory map engine built into the edge computing unit supports three-dimensional point cloud space mapping and updates equipment locations and emergency exits in real time; the AI ​​processor infers the accident evolution path through a localized model, and collaborates with the cloud server to generate virtual scenarios.

[0047] The linkage steps of the above modules are:

[0048] 1. The multimodal sensor module is linked with the edge computing unit and MR display module. A safety accident scenario is simulated in a physical laboratory. The multimodal sensor module uploads detection data to the edge computing unit, which processes and analyzes the real-time data. When a specific risk is identified, such as a hazardous gas leak, the edge computing unit calls the cloud server and overlays the virtual scene onto the physical laboratory through the MR glasses. For example, the MR glasses automatically overlay a virtual warning box and diffusion simulation effects at the leak source, while a projected laser pointer projects a virtual hazard sign onto the real scene. By integrating the virtual scene with the physical laboratory scene through binocular perspective MR glasses, the human body can intuitively perceive the process of a laboratory safety accident.

[0049] 2. The biofeedback module is linked to the edge computing unit and MR display module. The tactile feedback glove is linked to binocular see-through MR glasses, which capture hand movements and touched objects and provide feedback to the edge computing unit. Based on the accident type and hand movements, the edge computing unit infers the risk evolution process and outputs differentiated force feedback through the tactile feedback glove, such as simulating limb burns from a chemical leak or hand burns from high-temperature equipment. The human body interacts with laboratory safety accident scenarios through vision and touch, and the heart rate / blood oxygen monitoring bracelet can capture the human body's physiological responses in high-risk scenarios.

[0050] 3. The edge computing unit has a built-in laboratory map engine, which combines UWB positioning data to dynamically mark the emergency response measures and rescue methods of the corresponding dangers in the MR glasses interface, and provides navigation paths to the nearest emergency equipment and emergency exits to guide personnel in emergency response.

[0051] like Figure 1As shown in the figure, the multimodal sensor module is attached to the chest of the personnel, the mixed reality display module is worn on the face, the biofeedback module is worn on the hand, and the edge computing module is attached to the belt; Figure 1 In the figure, the upper left side is the actual scene, and the lower left side is the virtual scene (simulated explosion).

[0052] This embodiment also provides a laboratory safety emergency drill method, which specifically includes the following steps:

[0053] S1. Construction of virtual and real scenes:

[0054] Generate a 3D point cloud model of the laboratory through laser scanning and align the physical space coordinates with the virtual scene;

[0055] Preset the laboratory accident evolution model library in the virtual scene, including accident types such as explosion, fire, leakage, mechanical injury, poisoning and suffocation;

[0056] S2. Dynamic drill:

[0057] Accident triggering stage: Activate virtual accident scenarios through user violations and erroneous actions, abnormal laboratory physical monitoring indicators, and abnormal human physiological monitoring indicators;

[0058] Emergency response phase: The edge computing unit's laboratory map engine matches the positioning chip's positioning data with the laboratory map. MR glasses overlay a virtual scene on the physical laboratory, providing an emergency guidance layer. They also control a projected laser pointer to project signs on the real scene, guiding users to take emergency response actions. The positioning chip captures user behavior trajectories, and the tactile feedback gloves record user actions and provide feedback on tactile sensations. The edge computing unit then provides feedback on the accident response results based on user actions and links to physical emergency equipment.

[0059] Evaluation and feedback phase: record operation time, path selection and equipment usage sequence, and combine physiological stress data to generate exercise scores and playback videos.

[0060] The activation conditions of the accident triggering stage include:

[0061] Physical action triggering: IMU and UWB capture user behavior trajectories, and tactile feedback gloves record user operation actions. When violations and incorrect actions are detected, virtual scenes of laboratory accidents are activated;

[0062] Monitoring indicator abnormality trigger: When the multimodal sensor module detects abnormal laboratory physical indicators (such as toxic gas concentration, equipment temperature, etc.), or the heart rate / blood oxygen monitoring bracelet detects abnormal user physiological indicators, the virtual scene of the laboratory accident is activated.

[0063] During the emergency response phase, if the user does not follow the specifications, the tactile gloves will continue to apply force feedback, and the edge computing unit will trigger the emergency equipment and facilities of the physical laboratory (such as ventilation system, emergency sprinkler system, etc.) to start.

[0064] The playback video during the evaluation and feedback phase marks the key error nodes of user operations and provides virtual correction solutions and optimal disposal path comparisons.

[0065] In the present invention, the virtual accident evolution model library specifically includes:

[0066] Explosion accident scenario model, such as an explosion caused by a chemical mixture reaction;

[0067] Fire accident scenario model, such as a high temperature in a tube furnace causing surrounding combustibles to catch fire;

[0068] Leakage accident scenario model, such as aerosol contamination accident caused by failure of a biosafety cabinet;

[0069] Mechanical injury accident scenario model, such as an accident in which a person's limbs are crushed and injured due to improper operation of a material mechanics testing machine;

[0070] Poisoning and suffocation accident scenario model, such as nitrogen leakage in a confined space leading to oxygen deficiency and suffocation accidents;

[0071] Other accident scenario models, such as accidents involving personal injury caused by shock waves and fragments from an autoclave explosion.

[0072] In the present invention, taking the emergency drill of methane gas leakage in the gas cylinder room as an example:

[0073] Step 1: Construction of virtual and real scenes

[0074] 1. Use a 3D laser scanner to perform 3D modeling of the gas cylinder room, generate point cloud data (accuracy 1mm), and map the entity coordinates to the virtual scene database.

[0075] 2. Use Unity 3D to build a virtual scene of the gas cylinder room, and use a particle system to build a methane gas leakage and diffusion model. If the user does not choose to wear a virtual gas mask and does not choose the correct escape route, a poisoning scenario will be displayed. If the user chooses to wear a virtual gas mask but does not correctly start the exhaust system and does not promptly address the leakage source, an explosion scenario will be displayed.

[0076] Step 2: Dynamic accident triggering

[0077] When a user simulates opening a gas cylinder valve, the IMU detects that the cylinder and the pressure reducing valves in the gas line are opened in the wrong order. The edge computing unit immediately initiates a simulated methane leak, and the MR glasses display a gas diffusion effect. If the user's heart rate remains above 100 bpm for 10 seconds, the system automatically pauses the drill and initiates voice guidance: "Stress response detected, please adjust your breathing."

[0078] Step 3: Emergency Response Phase

[0079] In a real-world laboratory scenario, MR glasses display a floating instructional guide above the gas cylinder cabinet: "Put on a gas mask → Close the gas valve → Start ventilation." Laser projection simultaneously marks the danger zone around the leak point. Users are given five minutes to complete the following virtual steps: ① Locate and put on a gas mask in the gas cylinder room; ② Start the ventilation system; ③ Close the gas cylinder pressure relief valve; ④ Choose the correct escape route; ⑤ Set up a warning zone and trigger an alarm from a safe area. If the user fails to complete these steps correctly and promptly, the edge computing unit triggers the activation of the laboratory's real ventilation system and emergency broadcast system via the IoT protocol. In the event of a user error, such as reversing the gas cylinder pressure relief valve, the tactile glove applies pressure and triggers a three-level vibration warning.

[0080] Step 4: Evaluation and Feedback

[0081] The system records key metrics (such as response time, operation sequence, and path deviation) and deducts points accordingly. For example, if a user fails to use a virtual gas mask correctly, 15 points will be deducted. If the rate of decrease in blood oxygen saturation exceeds 2% / min or the heart rate exceeds 100 bpm for more than 60 seconds, it is considered a high-risk stress level and recommended to strengthen psychological training. The Unity engine generates a time-stamped drill video, annotates error nodes, and generates a PDF improvement report.

[0082] Thirty groups of control experiments showed that the emergency response operation standardization rate of the training group using the present invention increased by 67% and the physiological stress recovery time was shortened by 42% compared with the traditional drill group.

[0083] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. A wearable laboratory safety emergency drill system, characterized in that: include: A multimodal sensor module, including a hazardous gas detector, a biosafety monitoring unit, an equipment high-temperature anomaly detector, an inertial measurement unit, and an ultra-wideband positioning chip, is used to detect laboratory hazards in real time and track the user's position and posture. It can be placed on the chest. Mixed reality display module, including binocular see-through MR glasses and projected laser pointer, used for optical superposition of virtual and real scenes and projection of hazard signs, can be worn on the face; Biofeedback module, including tactile feedback gloves, monitoring bracelets and directional bone conduction headphones, is wearable on the hand and is used to track hand movements, simulate accident tactile sensations, monitor physiological indicators and provide spatial voice guidance; The edge computing unit has a built-in lightweight AI processor, laboratory map engine and communication module, which is used for real-time data processing, virtual and real scene linkage, and communication with cloud servers and laboratory IoT terminals. It can be attached to the belt.

2. A wearable laboratory safety emergency drill system according to claim 1, characterized in that: The hazardous gas detector is used to detect CO, H2, CH4, CL2 and volatile organic compounds (VOCs); The biosafety monitoring unit integrates a microbial aerosol concentration sensor and an ultraviolet intensity sensor; The device's high temperature anomaly detector uses a thermal imaging camera to capture high temperature areas; The positioning chip is used to realize user action posture detection and spatial positioning.

3. A wearable laboratory safety emergency drill system according to claim 1, characterized in that: The projection laser pointer of the mixed reality display module is used to project dynamic hazard signs on the surface of real objects, and can dynamically adjust the transparency of the virtual warning frame according to the hazard level.

4. A wearable laboratory safety emergency drill system according to claim 1, characterized in that: The force feedback modes of the tactile feedback gloves include: High-frequency vibration simulates the touch of liquid splashing; Local resistance heating simulates high temperature burning; Multi-point pressure feedback simulates mechanical injury resistance.

5. A wearable laboratory safety emergency drill system according to claim 1, characterized in that: The laboratory map engine built into the edge computing unit supports three-dimensional point cloud spatial mapping and updates equipment locations and emergency exits in real time; the AI ​​processor infers the accident evolution path through a localized model and collaborates with the cloud server to generate virtual scenarios.

6. A laboratory safety emergency drill method, used in a wearable laboratory safety emergency drill system according to any one of claims 1 to 5, characterized in that: The following steps are involved: S1. Construction of virtual and real scenes: Generate a 3D point cloud model of the laboratory through laser scanning and align the physical space coordinates with the virtual scene; Preset the laboratory accident evolution model library in the virtual scene, and the accident types include explosion, fire, leakage, mechanical injury and poisoning and suffocation; S2. Dynamic drill: Accident triggering stage: Activate virtual accident scenarios through user violations and erroneous actions, abnormal laboratory physical monitoring indicators, and abnormal human physiological monitoring indicators; Emergency response phase: The edge computing unit's laboratory map engine matches the positioning chip's positioning data with the laboratory map. MR glasses overlay a virtual scene on the physical laboratory, providing an emergency guidance layer. They also control a projected laser pointer to project signs on the real scene, guiding users to take emergency response actions. The positioning chip captures user behavior trajectories, and the tactile feedback gloves record user actions and provide feedback on tactile sensations. The edge computing unit then provides feedback on the accident response results based on user actions and links to physical emergency equipment. Evaluation and feedback phase: record operation time, path selection and equipment usage sequence, and combine physiological stress data to generate exercise scores and playback videos.

7. A laboratory safety emergency drill method according to claim 6, characterized in that: The activation conditions of the accident triggering stage include: Physical action triggering: The positioning chip captures the user's behavior trajectory, and the tactile feedback gloves record the user's operation actions. When violations and incorrect actions are detected, a virtual scene of a laboratory accident is activated; Monitoring indicator abnormality trigger: When the multimodal sensor module detects abnormal laboratory physical indicators, or the monitoring bracelet detects abnormal user physiological indicators, the virtual scene of the laboratory accident is activated.

8. A laboratory safety emergency drill method according to claim 6, characterized in that: During the emergency response phase, if the user does not follow the specifications, the tactile gloves will continue to apply force feedback, and the edge computing unit will trigger the activation of emergency equipment and facilities in the physical laboratory.

9. A laboratory safety emergency drill method according to claim 6, characterized in that: The playback video in the evaluation feedback phase marks the key error nodes of the user's operation and provides a virtual correction plan and an optimal disposal path comparison.

10. A laboratory safety emergency drill method according to claim 6, characterized in that: The virtual accident evolution model library includes: Explosion accident scenario model; Fire accident scenario model; Leakage accident scenario model; Mechanical injury accident scenario model; Poisoning and suffocation accident scenario model.

Images