Mixed reality fire extinguishing drill device and method
By combining mixed reality headsets and fire extinguisher housing pressure sensors, virtual flames and fire extinguishing special effects are generated, which solves the problems of high cost and lack of immersion in traditional fire extinguishing drills, and achieves efficient and safe fire extinguishing drills in mixed reality scenarios.
Patent Information
- Application Number
- CN202411477650.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2024-12-27
AI Technical Summary
Traditional fire extinguishing drills are costly, risky and difficult to carry out frequently. Virtual reality fire extinguishing drills lack immersion, and mixed reality fire extinguishing drills lack complete operational means and fire extinguishing implementation methods.
Provide a mixed reality fire extinguishing drill device, including a mixed reality headset to scan the real environment to generate a three-dimensional environment and superimpose virtual flame special effects. The fire extinguisher shell is equipped with a pressure sensor to collect handle pressure data, generate fire extinguishing special effects, and simulate it in the virtual environment. Fire extinguishing process.
It realizes a highly immersive fire extinguishing drill in mixed reality scenarios, reduces the cost of fire drills, improves the efficiency and safety of drills, and is suitable for a variety of scenarios such as industry, schools and families.
Smart Images
Figure CN119185879A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of virtual reality technology, and in particular to a mixed reality fire extinguishing drill device and method. Background Art
[0002] Traditional fire-fighting drills usually rely on actual fire-fighting equipment and fire sources. Not only do they have problems such as high costs and risks, but they are also difficult to conduct frequently.
[0003] With the development of virtual reality (VR) technology, fire drills using VR technology have become a popular training method. However, fire drills using VR helmets are completely virtual scenes, which are quite different from real scenes in terms of personnel firefighting operations and firefighting scenes, making it difficult to form effective training results.
[0004] With the development of mixed reality technology, firefighting drills can superimpose flame scenes on real scenes to achieve a more immersive firefighting scene. However, there is currently no complete operating method or implementation method for using fire extinguishers to extinguish fires in mixed reality scenes. Summary of the invention
[0005] In view of this, it is necessary to provide a mixed reality fire-fighting drill device and method to achieve the purpose of conducting fire-fighting drills in a mixed reality scene.
[0006] In order to solve the above problems, on the one hand, the present invention provides a mixed reality fire extinguishing drill device, comprising: A mixed reality head-mounted device is used to scan the real environment during the fire-fighting drill, and generate a three-dimensional environment Mesh network based on the real environment, and superimpose virtual flame special effects on the three-dimensional environment Mesh network, and generate fire-fighting special effects based on handle pressure data; A fire extinguisher shell, wherein a pressure sensor is provided at the handle of the fire extinguisher shell, and the pressure sensor is used to collect handle pressure data and transmit the collected handle pressure data to the mixed reality head mounted device.
[0007] In one possible implementation, the mixed reality head mounted device is used to determine the pressure duration and pressure value based on the handle pressure data, and determine the pressure usage of the fire extinguisher based on the pressure duration and pressure value, and generate a fire extinguishing special effect based on the fire extinguisher pressure usage.
[0008] In a possible implementation, the mixed reality head mounted device is further configured to issue a reminder to replace the fire extinguisher when the pressure value is less than a preset pressure threshold.
[0009] In a possible implementation, the fire extinguishing special effect includes a special effect of spraying powder, foam or dry ice.
[0010] In a possible implementation, the fire extinguishing special effect further includes a special effect of a flame becoming smaller after the powder, foam or dry ice is sprayed out, and a special effect of displaying residual powder, foam or dry ice after it is determined that the virtual flame is extinguished.
[0011] In a possible implementation, the pressure sensor is also used to transmit the collected handle pressure data to a plurality of different mixed reality head mounted devices for data sharing.
[0012] In a possible implementation, the mixed reality head mounted device is further used to adjust the flame size of the virtual flame special effect based on the input flame size adjustment instruction.
[0013] In a possible implementation, the mixed reality head mounted device is further configured to issue a prompt indicating that the fire is successfully extinguished after determining that the virtual flame is extinguished.
[0014] In one possible implementation, the mixed reality head-mounted device is also used to count the fire extinguishing time, handle pressure data collected by the pressure sensor, and the rate at which the flame is reduced during the fire extinguishing drill, and generate a training report for the fire extinguishing drill based on the fire extinguishing time, handle pressure data collected by the pressure sensor, and the rate at which the flame is reduced.
[0015] On the other hand, the present invention further provides a mixed reality fire extinguishing drill method, which is applied to any of the above-mentioned devices, and comprises: Scanning the real environment during the fire-fighting drill based on the mixed reality head-mounted device, generating a three-dimensional environment Mesh network based on the real environment, and superimposing virtual flame special effects on the three-dimensional environment Mesh network; Collecting handle pressure data based on a pressure sensor, and transmitting the collected handle pressure data to the mixed reality head mounted device; A fire extinguishing special effect is generated based on the mixed reality head mounted device and in combination with the handle pressure data.
[0016] The beneficial effects of adopting the above implementation method are: the mixed reality fire extinguishing drill device provided by the present invention collects handle pressure data through the pressure sensor set at the handle of the fire extinguisher shell, and transmits the collected handle pressure data to the mixed reality head-mounted device, scans the real environment during the fire extinguishing drill through the mixed reality head-mounted device, and generates a three-dimensional environment Mesh network based on the real environment, and superimposes virtual flame special effects on the three-dimensional environment Mesh network, and generates fire extinguishing special effects based on the handle pressure data. The device provided by the present invention can simulate flame special effects and fire extinguishing special effects through a mixed reality head-mounted device, and fire extinguishing drill personnel can conduct fire extinguishing drills by actually operating the fire extinguishing sensor on the handle of the fire extinguisher shell, realize mixed reality fire extinguishing drill operations, superimpose the flame scene required for the fire extinguishing drill on the real scene, realize a more immersive fire extinguishing scene, and achieve the purpose of conducting fire extinguishing drills in a mixed reality scene. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0018] Figure 1 A functional block diagram of an embodiment of a mixed reality fire extinguishing drill device provided by the present invention; Figure 2 A flow chart of an embodiment of the mixed reality fire extinguishing drill method provided by the present invention; Figure 3 A flow chart of another embodiment of the mixed reality fire extinguishing drill method provided by the present invention. DETAILED DESCRIPTION
[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0020] In the description of the embodiments of the present application, unless otherwise specified, “plurality” means two or more than two.
[0021] The terms "including" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product or equipment comprising a series of steps or modules is not necessarily limited to those steps or modules clearly listed, but may include other steps or modules not clearly listed or inherent to these processes, methods, products or equipment.
[0022] The naming or numbering of the steps in the embodiments of the present invention does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The execution order of the named or numbered process steps can be changed according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.
[0023] Reference to an "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0024] The present invention provides a mixed reality fire extinguishing drill device and method, which are respectively described below.
[0025] like Figure 1 As shown, the present invention provides a mixed reality fire extinguishing drill device, comprising: A mixed reality head mounted device 101 is used to scan the real environment during the fire fighting drill, and generate a three-dimensional environment Mesh network based on the real environment, and superimpose virtual flame special effects on the three-dimensional environment Mesh network, and generate fire fighting special effects based on handle pressure data; The fire extinguisher housing 103 has a pressure sensor 102 disposed at the handle of the fire extinguisher housing 103 . The pressure sensor 102 is used to collect handle pressure data and transmit the collected handle pressure data to the mixed reality head mounted device 101 .
[0026] It is understandable that the Mesh network, also known as a wireless mesh network, is a multi-hop network. The mixed reality head-mounted device 101 can be a mixed reality glasses or a mixed reality helmet. Using the mixed reality head-mounted device 101, scan the real environment, generate a detailed three-dimensional environment Mesh grid based on the real environment, and the system superimposes virtual flame effects on the scanned environment Mesh grid, so that the user can feel the realistic effect of fire on real objects. The size of the flame can be adjusted by a preset value (1-100) to simulate different degrees of fire.
[0027] The pressure sensor 102 installed on the handle of the fire extinguisher is equipped with a Bluetooth communication function, which can transmit the handle pressure data to the mixed reality headset 101 in real time, ensuring convenient data transmission and rapid response, and modifying the triggering and adjustment of subsequent special effects in combination with different pressure values.
[0028] The present invention realizes the process of simulating real firefighting by running on the mixed reality head mounted device 101 and other compatible devices. The present invention not only effectively reduces the cost of fire drills and the venues required for drills, but also allows anyone to perform simulated drills anytime and anywhere through the device provided by the present invention, which greatly improves the efficiency of drills.
[0029] Through environmental perception technology, accurate scanning and three-dimensional reconstruction of complex environments can be achieved. That is, fire drill simulations can be arranged in completely different real-life scenarios, allowing drill personnel to experience the simulation drills in real-life scenarios firsthand. It can also allow employees to be more familiar and more adept at handling problems when real danger occurs.
[0030] The device and method provided by the present invention are not only suitable for professional training of firefighters, but can also be widely used in the following scenarios: 1. Industrial field Specialized fire-fighting drills are conducted in high-risk industries such as chemical plants and oil platforms to simulate the types of fires and response strategies that may occur in these places, and to enhance the emergency response capabilities of professional rescue personnel.
[0031] 2. Schools and public institutions Provide customized firefighting training courses for public institutions such as schools and hospitals to enhance the firefighting awareness and self-rescue ability of teachers, students and staff. Conducting regular drills in these places will help improve public safety.
[0032] 3. Family and community Through a simplified version of the mixed reality firefighting drill system, firefighting knowledge and skills are promoted to families and communities. Community residents can conduct firefighting training through portable devices to enhance the overall fire prevention capabilities of families and communities.
[0033] 4. Emergency response agencies Fire departments, first aid teams and other emergency response agencies can use this system to conduct high-frequency, low-cost drills to improve the team's overall emergency response capabilities and practical level.
[0034] The present invention also supports multi-person collaborative drills to train and cultivate the team's cooperation ability in emergency situations.
[0035] In some embodiments, the mixed reality head mounted device 101 is used to determine the pressure duration and pressure value based on the handle pressure data, and determine the pressure usage of the fire extinguisher based on the pressure duration and pressure value, and generate a fire extinguishing special effect based on the pressure usage of the fire extinguisher.
[0036] In some embodiments, the mixed reality head mounted device 101 is further configured to issue a reminder to replace the fire extinguisher when the pressure value is less than a preset pressure threshold.
[0037] In some embodiments, the fire extinguishing special effects include spraying powder, foam or dry ice.
[0038] Furthermore, the fire extinguishing special effects also include a special effect in which the flame becomes smaller after the powder, foam or dry ice is sprayed out, and a special effect in which the residual powder, foam or dry ice is displayed after it is determined that the virtual flame is extinguished.
[0039] It is understandable that the shell of a conventional fire extinguisher is used, a pressure sensor 102 is added to the handle, and the sensor pressure is transmitted in real time to the mixed reality headset 101 through network transmission. The mixed reality headset 101 generally has a hand tracking function, which can determine the position of the fire extinguisher nozzle according to the hand position, and form special effects of spraying fire extinguishing materials such as powder, foam, and dry ice according to the pressure signal transmitted by the network. And according to the duration of use and the pressure, the pressure usage of the fire extinguisher is calculated, and the drill personnel are reminded to replace the fire extinguisher when the pressure is too low.
[0040] In some embodiments, the pressure sensor 102 is also used to transmit the collected handle pressure data to a plurality of different mixed reality head mounted devices 101 for data sharing.
[0041] It can be understood that by implementing a multi-person fire-fighting drill in a mixed reality scenario, the helmet end logs into the same network room, shares the hand operation position and the fire extinguisher pressure sensor 102 data, and then collaborative fire-fighting operations can be achieved.
[0042] In some embodiments, the mixed reality head mounted device 101 is further used to adjust the flame size of the virtual flame special effect based on the input flame size adjustment instruction.
[0043] In some embodiments, the mixed reality head mounted device 101 is further used to issue a prompt indicating that the fire is extinguished successfully after determining that the virtual flame is extinguished.
[0044] In some embodiments, the mixed reality head mounted device 101 is also used to count the fire extinguishing time, the handle pressure data collected by the pressure sensor 102 and the rate at which the flame is reduced during the fire extinguishing drill, and generate a training report for the fire extinguishing drill based on the fire extinguishing time, the handle pressure data collected by the pressure sensor 102 and the rate at which the flame is reduced.
[0045] The present invention also provides a mixed reality fire extinguishing drill method, which is applied to the mixed reality fire extinguishing drill device mentioned above. Figure 2 As shown, the method comprises: S201, scanning the real environment during the fire-fighting drill based on the mixed reality head mounted device 101, generating a three-dimensional environment Mesh network based on the real environment, and superimposing a virtual flame special effect on the three-dimensional environment Mesh network; S202, collecting handle pressure data based on the pressure sensor 102, and transmitting the collected handle pressure data to the mixed reality head mounted device 101; S203: Generate a fire extinguishing special effect based on the mixed reality head mounted device 101 and in combination with the handle pressure data.
[0046] In some embodiments, Figure 3 As shown, the mixed reality fire-fighting drill method provided by the present invention includes: Open the Mixed Reality Walkthrough app: The user launches a specially designed mixed reality application that can be run on mixed reality glasses or other compatible devices (such as a virtual reality helmet), providing the core platform for the entire exercise process.
[0047] Use mixed reality glasses to scan the real environment and obtain the environment Mesh: Users wear mixed reality glasses and generate a detailed 3D environment mesh by scanning the surrounding real environment. This step ensures that the system can accurately identify and map the position and shape of objects in the real world, thereby achieving more accurate flame effect addition.
[0048] Attach the flame effect to the Mesh to achieve the effect of fire on real objects. The size of the flame can be freely changed according to the set value 1-100: The system superimposes virtual flame effects on the scanned environment mesh, allowing users to experience the realistic effect of fire on real objects. The size of the flame can be adjusted through a preset value (1-100) to simulate different degrees of fire.
[0049] To modify a used fire extinguisher, install a pressure sensor 102 on the handle of the fire extinguisher: The used fire extinguisher is modified and a pressure sensor 102 is installed on its handle, which can detect the pressure applied by the user when using the fire extinguisher. This allows the fire extinguisher to be used for training multiple times without wasting resources.
[0050] Pressure sensor 102 on fire extinguisher with Bluetooth communication function: The pressure sensor 102 installed on the fire extinguisher handle is equipped with a Bluetooth communication function, which can transmit the handle pressure data to the mixed reality glasses in real time, ensuring convenient data transmission and rapid response.
[0051] When the user squeezes the handle of the fire extinguisher, the value of the pressure sensor 102 is sent to the mixed reality glasses via Bluetooth communication.
[0052] When the user squeezes the handle of the fire extinguisher, the pressure value measured by the pressure sensor 102 is sent to the mixed reality glasses via Bluetooth communication. After the glasses receive this data, it will be used to trigger and adjust subsequent special effects.
[0053] Based on the pressure value, the mixed reality glasses play powder and foam spraying effects at the fire extinguisher nozzle in front of the hand position: Based on the received pressure value, the mixed reality glasses play the corresponding virtual special effects of spraying powder or foam at the front of the user's hand position and the nozzle of the fire extinguisher. The intensity and style of the special effects depend on the amount of pressure applied by the user, simulating a real fire extinguishing experience.
[0054] According to the duration and strength of the fire extinguisher, the flame value and the size of the flame display are reduced through the weight formula: The system dynamically adjusts the value and display size of the flame based on the duration and intensity of the fire extinguisher use, using a specific weight formula. This mechanism ensures that the flame gradually decreases and eventually extinguishes, providing a realistic fire extinguishing effect.
[0055] After the fire is extinguished, add the effect of residual powder or foam to the environment Mesh: When the fire is successfully extinguished, the system adds residual powder or foam effects to the environment Mesh to simulate the residue left after real fire extinguishing. This special effect enhances the realism of training and helps evaluate the cleanup work after fire extinguishing.
[0056] After the fire is extinguished, it will be displayed as successful: During the drill, when the fire is completely extinguished, the system will immediately display a prompt message "Fire extinguishing successful", informing the user that the fire extinguishing operation has been successfully completed. This feedback helps to enhance the user's training confidence and sense of achievement.
[0057] Dynamic fire simulation: Adding dynamic fire simulation function enables flames to change dynamically according to environmental factors such as wind direction and temperature. This not only increases the complexity and challenge of training, but also better simulates real fire scenes. For example, simulating the spread of flames caused by changes in wind direction, or simulating the rapid spread of flames caused by high temperature.
[0058] Multiplayer collaborative drill: It supports multiple people to conduct collaborative drills at the same time, and enhances teamwork training by sharing the same virtual fire scene. Each user's mixed reality glasses and fire extinguishers can communicate with each other to achieve collaborative firefighting operations and cultivate the team's ability to cooperate in emergency situations.
[0059] Hazard warning and feedback system: During the drill, a hazard warning system is introduced, such as simulated smoke and heat sensing effects, to remind users of potential dangers in fire. In addition, the user's operation is evaluated in real time through the feedback system to provide improvement suggestions. For example, if the user approaches the fire source too close, the system will issue a warning and guide them to evacuate safely or adjust the fire-fighting strategy.
[0060] Training data recording and analysis: Record detailed data of each user's drill, including fire extinguishing time, pressure applied, rate of flame reduction, etc. Provide personalized training reports and improvement suggestions through data analysis. Users can understand their progress and areas for improvement by analyzing past drill data.
[0061] Augmented Reality Navigation: Adding augmented reality navigation to mixed reality glasses helps users find the most effective fire-fighting path in complex environments. For example, when simulating a fire in a building, the glasses can display escape routes, fire extinguisher locations, and safe areas.
[0062] Simulate fire extinguishing failure and emergency evacuation: Simulate the scenario of fire extinguishing failure and guide users to evacuate in an emergency. By rehearsing the evacuation process after failure, users can improve their ability to escape when facing uncontrollable fires and ensure that they can quickly make correct escape decisions in real fires.
[0063] The mixed reality fire-fighting drill device and method provided by the present invention are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A mixed reality fire-fighting drill device, characterized in that: include: A mixed reality head-mounted device is used to scan the real environment during the fire-fighting drill, and generate a three-dimensional environment Mesh network based on the real environment, and superimpose virtual flame special effects on the three-dimensional environment Mesh network, and generate fire-fighting special effects based on handle pressure data; A fire extinguisher shell, wherein a pressure sensor is provided at the handle of the fire extinguisher shell, and the pressure sensor is used to collect handle pressure data and transmit the collected handle pressure data to the mixed reality head mounted device.
2. The mixed reality fire-fighting drill device according to claim 1, characterized in that: The mixed reality head mounted device is used to determine the pressure duration and pressure value based on the handle pressure data, and determine the pressure usage of the fire extinguisher based on the pressure duration and pressure value, and generate a fire extinguishing special effect based on the pressure usage of the fire extinguisher.
3. The mixed reality fire-fighting drill device according to claim 2, characterized in that: The mixed reality head mounted device is also used to issue a reminder to replace the fire extinguisher when the pressure value is less than a preset pressure threshold.
4. The mixed reality fire-fighting drill device according to claim 1, characterized in that: The fire extinguishing special effects include the special effects of spraying powder, foam or dry ice.
5. The mixed reality fire extinguishing drill device according to claim 4, characterized in that: The fire extinguishing special effects also include a special effect in which the flame becomes smaller after the powder, foam or dry ice is sprayed out, and a special effect in which the residual powder, foam or dry ice is displayed after it is determined that the virtual flame is extinguished.
6. The mixed reality fire extinguishing drill device according to claim 1, characterized in that: The pressure sensor is also used to transmit the collected handle pressure data to multiple different mixed reality head-mounted devices for data sharing.
7. The mixed reality fire-fighting drill device according to claim 1, characterized in that: The mixed reality head mounted device is also used to adjust the flame size of the virtual flame special effect based on the input flame size adjustment instruction.
8. The mixed reality fire-fighting drill device according to claim 1, characterized in that: The mixed reality head mounted device is also used to issue a prompt indicating that the fire is extinguished successfully after determining that the virtual flame is extinguished.
9. The mixed reality fire-fighting drill device according to any one of claims 1 to 8, characterized in that: The mixed reality head mounted device is also used to count the fire extinguishing time, the handle pressure data collected by the pressure sensor and the rate at which the flame decreases during the fire extinguishing drill, and to generate a training report for the fire extinguishing drill based on the fire extinguishing time, the handle pressure data collected by the pressure sensor and the rate at which the flame decreases.
10. A mixed reality fire-fighting drill method, characterized in that: The method is applied to the device according to any one of claims 1 to 9, and the method comprises: Scanning the real environment during the fire-fighting drill based on the mixed reality head-mounted device, generating a three-dimensional environment Mesh network based on the real environment, and superimposing virtual flame special effects on the three-dimensional environment Mesh network; Collecting handle pressure data based on a pressure sensor, and transmitting the collected handle pressure data to the mixed reality head mounted device; A fire extinguishing special effect is generated based on the mixed reality head mounted device and combined with the handle pressure data.