Limited space safety management system and method based on multi-sensor fusion

Abstract

The invention relates to a limited space safety management system and method based on multi-sensor fusion. The system comprises an unmanned aerial vehicle active patrol video terminal, a vital sign monitoring device and a terminal host. Wherein the unmanned aerial vehicle is provided with a high-definition camera and an environment sensing sensor and is used for capturing on-site videos and monitoring oxygen content and toxic and harmful gas. The vital sign monitoring device integrates a heart rate sensor, a body temperature sensor and a gyroscope and is used for monitoring the heart rate, the body temperature and the motion state of the operator. All the devices carry out data transmission through a communication module with an ad hoc network function, such as a star flash communication module, and the terminal host carries out comprehensive analysis and processing. The terminal host is also equipped with a 4G / 5G communication module to realize remote alarm notification. The system can automatically detect abnormal conditions and trigger an alarm, and meanwhile, the unmanned aerial vehicle can autonomously navigate to an abnormal position for further inspection and evaluation, so that the safety of operators is ensured.

Description

Technical Field

[0001] The present invention belongs to the technical field of confined space operations, and in particular, to a confined space safety management system and method based on multi-sensor fusion. Background Art

[0002] With the acceleration of the urbanization process and the rapid development of industrial production, the application scenarios of confined space operations are increasing day by day, such as cable galleries in the power system, tunnel construction, etc. These environments are often special and complex, and operators face serious safety risks such as poisoning and asphyxiation. Although there are relatively complete systems and regulations for confined space operations at present, due to the uneven technical levels of the operators involved, coupled with the possible blind rescue behaviors in emergency situations, accidents resulting in casualties occur from time to time. Summary of the Invention

[0003] The purpose of the present invention is to overcome the deficiencies of the prior art and propose a confined space safety management system and method based on multi-sensor fusion. By integrating a variety of sensors and advanced communication technologies, it realizes the real-time monitoring and comprehensive analysis of environmental parameters and the vital signs of operators in confined spaces, significantly improving the safety guarantee of operators. The system can automatically detect environmental abnormalities and abnormal vital signs, and when detecting emergencies such as falls or immobility, the unmanned aerial vehicle will automatically navigate to that position for further inspection and evaluation, thus achieving rapid response and timely rescue. In addition, the self-organizing network function of the system ensures stable data transmission in complex environments, effectively reducing the monitoring blind spots caused by poor signals, greatly reducing the accident risk in confined space operations, and improving the overall safety and efficiency of operations.

[0004] The technical problems of the present invention are solved by adopting the following technical solutions:

[0005] A confined space safety management system based on multi-sensor fusion includes an unmanned aerial vehicle active inspection video terminal, a vital sign monitoring device, and a terminal host. The unmanned aerial vehicle active inspection video terminal and the vital sign monitoring device are respectively connected to the terminal host. The unmanned aerial vehicle active inspection video terminal is used to collect on-site videos and environmental perception data, and the vital sign monitoring device is used to obtain vital sign data, motion data, and environmental perception data. The data collected by the unmanned aerial vehicle active inspection video terminal and the vital sign monitoring device are transmitted to the terminal host through a communication module with a self-organizing network function of the SparkLink communication module.

[0006] Moreover, the UAV active patrol video terminal includes a high-definition camera, an environmental perception sensor, and a communication module with self-organizing network function of the SparkLink communication module. The high-definition camera and the environmental perception sensor are connected to the SparkLink communication module. The high-definition camera is used to collect on-site videos, and the environmental perception sensor is used to collect environmental perception data. The SparkLink communication module is used to send the on-site videos and environmental perception data to the terminal host.

[0007] Moreover, the environmental perception sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

[0008] Moreover, the vital sign monitoring device includes a heart rate sensor, a body temperature sensor, a gyroscope, an environmental perception sensor, and a communication module with self-organizing network function of the SparkLink communication module. The heart rate sensor, the body temperature sensor, the gyroscope, and the environmental perception sensor are respectively connected to the SparkLink communication module.

[0009] Moreover, the environmental perception sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

[0010] Moreover, the terminal host includes a communication module with self-organizing network function of the SparkLink communication module and a 4G / 5G communication module, which is used to combine the environmental safety monitoring results obtained from the analysis of the on-site video and the environmental safety monitoring results obtained based on the environmental perception data and vital sign data for the judgment of the on-site safety status.

[0011] A management method for a confined space safety management system based on multi-sensor fusion includes the following steps:

[0012] Step 1: The UAV active patrol video terminal is used to collect on-site videos and environmental perception data, and the vital sign monitoring device is used to obtain vital sign data, motion data, and environmental perception data;

[0013] Step 2: The data collected by the UAV active patrol video terminal and the vital sign monitoring device are both transmitted to the terminal host through the communication module with self-organizing network function of the SparkLink communication module;

[0014] Step 3: The environmental safety monitoring results obtained from the analysis of the on-site video by the terminal host and the environmental safety monitoring results obtained based on the environmental perception data and vital sign data are combined for the judgment of the on-site safety status.

[0015] Moreover, in step 1, when the UAV's active patrol video terminal determines that there are safety issues at the scene based on any environmental safety monitoring result, it judges that there are problems with the on-site safety status. At the same time, the UAV's active patrol video terminal has an autonomous patrol function, conducts patrols according to a preset path or dynamically adjusted path, and makes quantity adjustments according to the number of on-site operators and network conditions to ensure coverage of all key areas. The videos captured by the UAV are used for personnel status inspection, especially personnel posture inspection, to determine whether the personnel are currently working or fainted, serving as an auxiliary means for personnel status monitoring. When abnormal vital signs or abnormal movement conditions of on-site personnel are detected, the vital sign monitoring device also outputs an environmental safety monitoring result indicating that there are safety issues at the scene.

[0016] Moreover, the specific implementation method of step 2 is as follows: Communication modules with self-organizing network functions such as the SparkLink communication module are deployed at the scene for short-distance and low-power communication between on-site devices.

[0017] Moreover, the specific implementation method of step 3 is as follows: When abnormal environmental or vital signs are detected, the terminal host will automatically issue an alarm and notify relevant personnel through the 4G / 5G network.

[0018] The advantages and positive effects of the present invention are:

[0019] The present invention includes a UAV's active patrol video terminal, a vital sign monitoring device, and a terminal host. The UAV is equipped with a high-definition camera and an environmental perception sensor for capturing on-site videos and monitoring oxygen content and toxic and harmful gases. The vital sign monitoring device integrates a heart rate sensor, a body temperature sensor, and a gyroscope for monitoring the heart rate, body temperature, and movement status of the operators. All devices transmit data through communication modules with self-organizing network functions such as the SparkLink communication module, and the terminal host conducts comprehensive analysis and processing. The terminal host is also equipped with a 4G / 5G communication module to achieve remote alarm notification. The present invention can automatically detect abnormal situations and trigger alarms. At the same time, the UAV can autonomously navigate to the abnormal location for further patrol and assessment to ensure the safety of the operators. By integrating multiple sensors and advanced communication technologies, the present invention realizes real-time monitoring and comprehensive analysis of environmental parameters and the vital signs of operators in confined spaces, significantly improving the safety guarantee for operators. The system can automatically detect environmental abnormalities and abnormal vital signs, and when emergency situations such as falling or remaining stationary are detected, the UAV will automatically navigate to that location for further patrol and assessment, thus achieving rapid response and timely rescue. In addition, the self-organizing network function of the system ensures stable data transmission in complex environments, effectively reducing monitoring blind spots caused by poor signals, greatly reducing the accident risk in confined space operations, and improving the overall safety and efficiency of operations. Detailed Implementation Manner

[0020] The present invention will be further described in detail below.

[0021] A limited space safety management system based on multi-sensor fusion includes an unmanned aerial vehicle (UAV) active patrol video terminal, a vital sign monitoring device, and a terminal host. The UAV active patrol video terminal and the vital sign monitoring device are respectively connected to the terminal host. The UAV active patrol video terminal is used to collect on-site videos and environmental perception data, and the vital sign monitoring device is used to obtain vital sign data, motion data, and environmental perception data. The data collected by the UAV active patrol video terminal and the vital sign monitoring device are transmitted to the terminal host through a communication module with self-organizing network function of the SparkLink communication module.

[0022] The UAV active patrol video terminal includes a high-definition camera, an environmental perception sensor, and a communication module with self-organizing network function of the SparkLink communication module. The high-definition camera and the environmental perception sensor are connected to the SparkLink communication module. The high-definition camera is used to collect on-site videos, and the environmental perception sensor is used to collect environmental perception data. The SparkLink communication module is used to send the on-site videos and environmental perception data to the terminal host. The environmental perception sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

[0023] The vital sign monitoring device includes a heart rate sensor, a body temperature sensor, a gyroscope, an environmental perception sensor, and a communication module with self-organizing network function of the SparkLink communication module. The heart rate sensor, the body temperature sensor, the gyroscope, and the environmental perception sensor are respectively connected to the SparkLink communication module. The environmental perception sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

[0024] The terminal host includes a communication module with self-organizing network function of the SparkLink communication module and a 4G / 5G communication module, which are used to combine the environmental safety monitoring results obtained from the analysis of on-site videos and the environmental safety monitoring results obtained according to environmental perception data and vital sign data for judging the on-site safety status.

[0025] A management method for a limited space safety management system based on multi-sensor fusion includes the following steps:

[0026] Step 1: The UAV active patrol video terminal is used to collect on-site videos and environmental perception data, and the vital sign monitoring device is used to obtain vital sign data, motion data, and environmental perception data.

[0027] If any environmental safety monitoring result of the UAV active patrol video terminal deems that there are safety problems on-site, it is judged that there are problems with the on-site safety status.

[0028] The UAV active inspection video terminal has an autonomous inspection function, conducts inspections according to a preset path or a dynamically adjusted path, and adjusts the quantity according to the number of operators in a confined space and the network situation to ensure coverage of all key areas.

[0029] The videos taken by the UAV are used for personnel status inspection, especially personnel posture inspection, to determine whether the personnel are currently working or fainted, as an auxiliary means for personnel status monitoring.

[0030] When abnormal vital signs or abnormal movement conditions of on-site personnel are detected, the vital sign monitoring device also outputs the environmental safety monitoring results indicating the existence of safety problems at the scene.

[0031] Step 2: The data collected by the UAV active inspection video terminal and the vital sign monitoring device are both transmitted to the terminal host through a communication module with a self-organizing network function in the SparkLink communication module.

[0032] Communication modules with self-organizing network functions such as the SparkLink communication module are deployed at the scene for short-distance and low-power communication between on-site devices; the terminal host accesses the Internet through a 4G / 5G communication module.

[0033] When the operators are widely distributed, the space is large, or there are obstacles resulting in poor communication signals, the UAV active inspection video terminal can serve as a communication relay node, receive data from the vital sign monitoring device through a communication module with a self-organizing network function such as the SparkLink communication module, and transmit the data to the terminal host through a communication module with a self-organizing network function such as the SparkLink communication module to ensure a stable communication connection in a complex environment.

[0034] Step 3: The environmental safety monitoring results obtained from the analysis of the on-site videos by the terminal host and the environmental safety monitoring results obtained based on the environmental perception data and vital sign data are combined for use in judging the on-site safety status.

[0035] The gyroscope data in the vital sign monitoring device is transmitted to the terminal host through a communication module with a self-organizing network function such as the SparkLink communication module, used to judge the general position and current state of the personnel (such as standing, walking, falling, etc.), and combined with other vital sign data and environmental perception data for comprehensive analysis to further improve the accuracy of judging the on-site safety status.

[0036] When the terminal host determines that a person has fallen or a person has remained stationary for more than a preset time, the UAV active inspection video terminal will automatically navigate to the location of the person for inspection, and further judge the status of the person through video and environmental perception data, and trigger an alarm and notify relevant personnel to take emergency measures if necessary.

[0037] Through the integration of multiple sensors and advanced communication technologies, the present invention realizes the real-time monitoring and comprehensive analysis of environmental parameters and the vital signs of operators in confined spaces, significantly improving the safety guarantee of operators. The system can automatically detect environmental abnormalities and abnormal vital signs. When detecting emergencies such as falls or immobility, the drone will automatically navigate to that location for further inspection and assessment, thus achieving rapid response and timely rescue. In addition, the self-organizing network function of the system ensures stable data transmission in complex environments, effectively reducing the monitoring blind spots caused by poor signals, greatly reducing the accident risk in confined space operations, and enhancing the overall safety and efficiency of operations.

[0038] It should be emphasized that the embodiments described in the present invention are illustrative rather than restrictive. Therefore, the present invention includes but is not limited to the embodiments described in the specific implementation manners. Any other implementation manners obtained by those skilled in the art based on the technical solutions of the present invention also fall within the scope of protection of the present invention.

Claims

1. A limited space safety management system based on multi-sensor fusion, characterized by: It includes a drone active patrol video terminal, a vital signs monitoring device and a terminal host, wherein the drone active patrol video terminal and the vital signs monitoring device are connected to the terminal host respectively, wherein the drone active patrol video terminal is used to collect on-site video and environmental perception data, and the vital signs monitoring device is used to obtain vital signs data, motion data and environmental perception data, and the data collected by the drone active patrol video terminal and the vital signs monitoring device are transmitted to the terminal host through the Star Flash communication module with a self-organizing network function.

2. According to claim 1, a limited space safety management system based on multi-sensor fusion is characterized by: The UAV active patrol video terminal includes a high-definition camera, an environmental perception sensor and a Star Flash communication module, which is a communication module with a self-organizing network function, wherein the high-definition camera and the environmental perception sensor are connected to the Star Flash communication module, the high-definition camera is used to collect on-site video, the environmental perception sensor is used to collect environmental perception data, and the Star Flash communication module is used to send on-site video and environmental perception data to the terminal host.

3. The limited space safety management system based on multi-sensor fusion according to claim 2 is characterized by: The environmental sensing sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

4. The limited space safety management system based on multi-sensor fusion according to claim 1 is characterized by: The vital signs monitoring device includes a heart rate sensor, a body temperature sensor, a gyroscope, an environmental perception sensor and a star flash communication module, which is a communication module with a self-organizing network function, wherein the heart rate sensor, the body temperature sensor, the gyroscope and the environmental perception sensor are respectively connected to the star flash communication module.

5. The limited space safety management system based on multi-sensor fusion according to claim 4 is characterized by: The environmental sensing sensor includes an oxygen content sensor and a toxic and harmful gas sensor.

6. The limited space safety management system based on multi-sensor fusion according to claim 1 is characterized by: The terminal host includes a Xingshan communication module, a communication module with self-organizing network function and a 4G / 5G communication module, which is used to combine the environmental safety monitoring results obtained by analyzing the on-site video with the environmental safety monitoring results obtained based on the environmental perception data and vital signs data for use in judging the on-site safety status.

7. A management method for a limited space safety management system based on multi-sensor fusion, characterized in that: The following steps are involved: Step 1: The drone's active patrol video terminal is used to collect on-site video and environmental perception data, and the vital signs monitoring equipment is used to obtain vital signs data, motion data, and environmental perception data; Step 2: The data collected by the drone's active patrol video terminal and the vital signs monitoring equipment are transmitted to the terminal host through the Xingshan communication module with self-organizing network function; Step 3: The terminal host obtains environmental safety monitoring results from the analysis of the on-site video and the environmental safety monitoring results obtained based on the environmental perception data and vital signs data to determine the on-site safety status.

8. The management method of a limited space safety management system based on multi-sensor fusion according to claim 7 is characterized by: In the step 1, if the unmanned aerial vehicle active patrol video terminal finds that there is a safety problem at the scene in any environmental safety monitoring result, it is determined that there is a problem with the safety status of the scene; at the same time, the unmanned aerial vehicle active patrol video terminal has an autonomous patrol function, patrols according to a preset path or a dynamically adjusted path, and adjusts the number according to the number of workers in a limited space and the network situation to ensure that all key areas are covered; the video taken by the unmanned aerial vehicle is used for personnel status inspection, especially personnel posture inspection, to determine whether the personnel is currently working or fainted, as an auxiliary means of personnel status monitoring; When abnormal vital signs or abnormal movement of on-site personnel are detected, the vital signs monitoring equipment also outputs environmental safety monitoring results indicating that there are safety issues on site.

9. The management method of a limited space safety management system based on multi-sensor fusion according to claim 7 is characterized in that: The specific implementation method of step 2 is: communication modules with self-organizing network functions such as Xingshan communication modules are deployed on site for short-distance, low-power communication between on-site devices.

10. The management method of a limited space safety management system based on multi-sensor fusion according to claim 7, characterized in that: The specific implementation method of step 3 is: when an abnormal environment or vital signs is detected, the terminal host will automatically issue an alarm and notify relevant personnel through the 4G / 5G network.