Mountain fire monitoring system, method and equipment based on multi-sensor information fusion

Through the multi-sensor information fusion system, combined with temperature, light intensity, video, infrared and smoke detection data, accurate identification and positioning of wildfires is achieved, solving the problems of inaccurate and insufficient monitoring in the existing technology, and improving the Fire monitoring effectiveness and alarm accuracy.

CN118918675APending Publication Date: 2024-11-08YUNNAN POWER GRID CO LTD ELECTRIC POWER RES INST
View PDF 0 Cites 3 Cited by

Patent Information

Application Number
CN202410969077.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing wildfire monitoring methods are difficult to accurately determine the occurrence and risk level of fires in complex environments, and the specific geographical location of the wildfires cannot be accurately positioned in a timely and precise manner, resulting in insufficient timeliness and accuracy of fire monitoring and cannot meet the needs of large-scale monitoring. .

Method used

The multi-sensor information fusion system is adopted, including temperature detection module, light intensity detection module, video surveillance module, infrared imaging module and smoke detection module. The data processing module comprehensively process these data to obtain the final wildfire identification results of the target area, including existence Wildfires, suspected wildfires and no wildfires exist.

Benefits of technology

It improves the effectiveness of wildfire monitoring and the timeliness and accuracy of alarms, can finely locate the location of wildfires, reduce late, misreported and misreported fires, and ensure the safe and stable operation of transmission lines and equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918675A_ABST
    Figure CN118918675A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a forest fire monitoring system, method and device based on multi-sensor information fusion. The forest fire monitoring system comprises a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module, a smoke detection module and a data processing module. The temperature detection module obtains a temperature value of a target area, the light intensity detection module obtains a light intensity value of the target area, the video monitoring module obtains a real-time dynamic image of the target area, the infrared imaging module obtains an infrared image of the target area, and the smoke detection module obtains smoke sensing data of the target area. And the data processing module obtains a final forest fire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensing data. The forest fire recognition result of the target area is obtained based on a multi-sensor information fusion method, more comprehensive forest fire information can be obtained, the fine geographic position of the forest fire can be positioned, the effectiveness of forest fire monitoring is improved, and the timeliness and accuracy of alarming are ensured.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the technical field of Internet of Things online monitoring, and in particular to a multi-sensor information fusion mountain fire monitoring system, method and equipment. [Background technology]

[0002] In recent years, my country's economy has developed rapidly, people's living standards have been continuously improved, and higher requirements have been put forward for the safety and reliability of power supply. Wildfires are characterized by suddenness, randomness, and rapidity, and are often difficult to control. In the hot summer weather and dry autumn and winter weather, the probability of sudden wildfires is very high, which brings great hidden dangers to transmission lines and power equipment. Therefore, the fire must be controlled in a timely and effective manner, and the best time to extinguish the fire is in the early stage of the fire. Therefore, realizing online monitoring of wildfires and timely and effective alarms is of great significance to improving the disaster prevention and mitigation and operation and maintenance decision-making level of the power grid.

[0003] Existing wildfire monitoring methods generally use manual inspections or drone inspections, which have limitations such as small monitoring range, high labor costs, and high experience requirements, and cannot meet large-scale monitoring needs. At present, other monitoring methods that are widely used include thermal imaging technology, video surveillance technology, and light intensity detection technology. However, there may be defects in complex environments (nighttime, background obstruction), and it is impossible to accurately determine whether a fire has occurred and the risk level of the fire. It is also impossible to accurately locate the specific geographical location of the wildfire in a timely manner, which can easily cause late reporting, missed reporting, and false reporting of wildfires, which greatly endangers the safe and stable operation of power transmission lines and nearby equipment. Therefore, how to improve the effectiveness of wildfire monitoring and ensure the timeliness and accuracy of alarms. [Summary of the invention]

[0004] In view of this, the present invention provides a forest fire monitoring system, method and equipment with multi-sensor information fusion.

[0005] The specific technical solution of the first embodiment of the present invention is: a multi-sensor information fusion forest fire monitoring system, the system includes: a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module, a smoke detection module and a data processing module; the output end of the temperature detection module, the output end of the light intensity detection module, the output end of the video monitoring module, the output end of the infrared imaging module and the output end of the smoke detection module are all connected to the input end of the data processing module; the temperature detection module is used to obtain the temperature value of the target area and send the temperature value to the data processing module; the light intensity detection module is used to obtain the light intensity value of the target area and send the light intensity value to the data processing module; the video monitoring module is used to obtain the real-time dynamic image of the target area, and send the real-time dynamic image to the data processing module; the infrared imaging module is used to obtain the infrared image of the target area, and send the infrared image to the data processing module; the smoke detection module is used to obtain the smoke sensor data of the target area, and send the smoke sensor data to the data processing module; the data processing module is used to obtain the final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data; the final wildfire identification result includes the existence of wildfire, suspected existence of wildfire and non-existence of wildfire.

[0006] The specific technical solution of the second embodiment of the present invention is: a multi-sensor information fusion wildfire monitoring method, the method comprising: a temperature detection module obtains the temperature value of the target area, and sends the temperature value to the data processing module; the light intensity detection module obtains the light intensity value of the target area, and sends the light intensity value to the data processing module; the video monitoring module obtains the real-time dynamic image of the target area, and sends the real-time dynamic image to the data processing module; the infrared imaging module obtains the infrared image of the target area, and sends the infrared image to the data processing module; the smoke detection module obtains the smoke sensor data of the target area, and sends the smoke sensor data to the data processing module; the data processing module obtains the final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data; the final wildfire identification result includes the existence of wildfire, suspected existence of wildfire and non-existence of wildfire.

[0007] Preferably, the data processing module obtains the final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data, including: performing feature recognition on the real-time dynamic image to obtain a first wildfire identification result of the target area; the first wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; performing infrared recognition on the infrared image to obtain a second wildfire identification result of the target area; the second wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; performing smoke recognition on the smoke sensor data to obtain a third wildfire identification result of the target area; the third wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; obtaining a fourth wildfire identification result of the target area by using an information fusion algorithm, the temperature value and the light intensity value; the fourth wildfire identification result includes different probabilities of the existence of wildfire; and obtaining the final wildfire identification result according to the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result.

[0008] Preferably, performing feature recognition on the real-time dynamic image to obtain the first wildfire identification result of the target area includes: performing feature recognition on the real-time dynamic image; the feature recognition includes flame feature recognition and smoke feature recognition; if the real-time dynamic image has a flame feature, the first wildfire identification result is the existence of a wildfire; if the real-time dynamic image does not have a flame feature but has a smoke feature, the first wildfire identification result is suspected existence of a wildfire; if the real-time dynamic image does not have a flame feature and does not have a smoke feature, the first wildfire identification result is the absence of a wildfire.

[0009] Preferably, performing infrared recognition on the infrared image to obtain a second wildfire recognition result for the target area includes: obtaining a thermal radiation flux in the infrared image; comparing the thermal radiation flux with a first threshold and a second threshold; the second threshold is greater than the first threshold; if the thermal radiation flux is greater than the second threshold, the second wildfire recognition result is that a wildfire exists; if the thermal radiation flux is less than or equal to the second threshold and greater than the first threshold, the second wildfire recognition result is that a wildfire is suspected to exist; if the thermal radiation flux is less than or equal to the first threshold, the second wildfire recognition result is that a wildfire does not exist.

[0010] Preferably, performing smoke identification on the smoke sensor data to obtain the third wildfire identification result of the target area includes: comparing the smoke sensor data with a third threshold and a fourth threshold; the fourth threshold is greater than the third threshold; if the smoke sensor data is greater than the fourth threshold, the third wildfire identification result is the existence of a wildfire; if the smoke sensor data is less than or equal to the fourth threshold and greater than the third threshold, the third wildfire identification result is suspected existence of a wildfire; if the smoke sensor data is less than or equal to the third threshold, the third wildfire identification result is the absence of a wildfire.

[0011] Preferably, obtaining the final wildfire identification result based on the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result includes: performing statistics on the first wildfire identification result, the second wildfire identification result and the third wildfire identification result to obtain wildfire identification result statistical information; the wildfire identification result statistical information includes the number of wildfire identification results that are existing wildfires; and obtaining the final wildfire identification result based on the number of existing wildfires and the fourth wildfire identification result.

[0012] Preferably, obtaining the final wildfire identification result based on the number of existing wildfires and the fourth wildfire identification result includes: if the number of existing wildfires is a first value, and the probability of a wildfire existing in the fourth wildfire identification result is greater than a fifth threshold, then the final wildfire identification result is that a wildfire exists; if the number of existing wildfires is a second value or a third value, and the probability of a wildfire existing in the fourth wildfire identification result is greater than the fifth threshold, then the final wildfire identification result is that a wildfire is suspected to exist; if the number of existing wildfires is a fourth value, and the probability of a wildfire existing in the fourth wildfire identification result is less than or equal to the fifth threshold, then the final wildfire identification result is that a wildfire does not exist; the first value is greater than the second value, the second value is greater than the third value, and the third value is greater than the fourth value.

[0013] Preferably, the method also includes: when the final wildfire identification result is that a wildfire exists or is suspected to exist, the data processing module sends a prompt signal to the host computer; if the host computer receives a feedback signal of the prompt signal within a preset time, the data processing module issues an alarm.

[0014] The specific technical solution of the third embodiment of the present invention is: a forest fire monitoring device with multi-sensor information fusion, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the method described in any one of the second embodiments of the present application.

[0015] Implementing the embodiments of the present invention will have the following beneficial effects:

[0016] The present invention includes a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module, a smoke detection module and a data processing module; the temperature detection module obtains the temperature value of the target area, the light intensity detection module obtains the light intensity value of the target area, the video monitoring module obtains the real-time dynamic image of the target area, the infrared imaging module obtains the infrared image of the target area, the smoke detection module obtains the smoke sensor data of the target area, and the data processing module obtains the final wildfire identification result of the target area according to the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data. The wildfire identification result of the target area is obtained based on the method of multi-sensor information fusion, which can obtain more comprehensive wildfire information, locate the precise geographical location of the wildfire, improve the effectiveness of wildfire monitoring, and ensure the timeliness and accuracy of the alarm.

Brief Description of the Drawings

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a structural diagram of a wildfire monitoring system with multi-sensor information fusion;

[0019] Figure 2 A flowchart of the steps of a wildfire monitoring method using multi-sensor information fusion;

[0020] Among them, 101 is a temperature detection module; 102 is a light intensity detection module; 103 is a video monitoring module; 104 is an infrared imaging module; 105 is a smoke detection module; and 106 is a data processing module. [Specific implementation method]

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0022] The terms "first", "second", etc. in the specification, claims and drawings of this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not limited to the listed steps or modules, but optionally includes steps or modules that are not listed, or optionally includes other steps or modules that are inherent to these processes, methods, products or devices.

[0023] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0024] See also Figure 1 , which is a structural diagram of a multi-sensor information fusion forest fire monitoring system in the first embodiment of the present application, which can ensure the timeliness and accuracy of the alarm. The forest fire monitoring system includes: a temperature detection module 101, a light intensity detection module 102, a video monitoring module 103, an infrared imaging module 104, a smoke detection module 105 and a data processing module 106; the output end of the temperature detection module 101, the output end of the light intensity detection module 102, the output end of the video monitoring module 103, the output end of the infrared imaging module 104 and the output end of the smoke detection module 105 are all connected to the input end of the data processing module 106; the temperature detection module 101 is used to obtain the temperature value of the target area and send the temperature value to the data processing module 106; the light intensity detection module 102 is used to obtain the light intensity value of the target area and send the light intensity value to the data processing module 106; the video monitoring module 103 is used to obtain the real-time dynamic image of the target area and send the real-time dynamic image to the data processing module 106; the infrared imaging module 104 is used to obtain the infrared image of the target area and send the infrared image to the data processing module 106; the smoke detection module 105 is used to obtain the smoke sensor data of the target area and send the smoke sensor data to the data processing module 106; the data processing module 106 is used to obtain the final wildfire identification result of the target area according to the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data; the final wildfire identification result includes the existence of wildfire, suspected existence of wildfire and non-existence of wildfire.

[0025] Specifically, the real-time dynamic image obtained from the area to be detected is subjected to image segmentation operation, and each area after image segmentation is an independent area, namely, the target area; sensors are set in each target area, including a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module and a smoke detection module; the data processing module can process the data of all sensors and obtain the final wildfire identification result of each target area.

[0026] This embodiment includes a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module, a smoke detection module and a data processing module; the temperature detection module obtains the temperature value of the target area, the light intensity detection module obtains the light intensity value of the target area, the video monitoring module obtains the real-time dynamic image of the target area, the infrared imaging module obtains the infrared image of the target area, the smoke detection module obtains the smoke sensor data of the target area, and the data processing module obtains the final wildfire identification result of the target area according to the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data. The wildfire identification result of the target area is obtained based on the multi-sensor information fusion method, which can obtain more comprehensive wildfire information, locate the precise geographical location of the wildfire, improve the effectiveness of wildfire monitoring, and ensure the timeliness and accuracy of the alarm.

[0027] In the specific embodiments, see Figure 2 , is a flowchart of the steps of a mountain fire monitoring method using multi-sensor information fusion in the second embodiment of the present application, the method comprising:

[0028] Step 201: The temperature detection module obtains the temperature value of the target area and sends the temperature value to the data processing module;

[0029] Step 202: The light intensity detection module obtains the light intensity value of the target area and sends the light intensity value to the data processing module;

[0030] Step 203: The video monitoring module obtains a real-time dynamic image of the target area and sends the real-time dynamic image to the data processing module;

[0031] Step 204: The infrared imaging module acquires an infrared image of the target area and sends the infrared image to the data processing module;

[0032] Step 205: The smoke detection module obtains smoke sensor data of the target area and sends the smoke sensor data to the data processing module;

[0033] Step 206, the data processing module obtains the final wildfire identification result of the target area according to the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data; the final wildfire identification result includes the existence of wildfire, suspected existence of wildfire and non-existence of wildfire.

[0034] Specifically, the real-time dynamic image obtained from the area to be detected is subjected to image segmentation operation, and each area after image segmentation is an independent area, namely, the target area; sensors are set in each target area, including a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module and a smoke detection module; the data processing module can process the data of all sensors and obtain the final wildfire identification result of each target area.

[0035] Specifically, a Unet model is constructed, and the backbone features of the input real-time dynamic image are extracted through the Unet model to obtain a preliminary effective feature layer; enhanced feature extraction is performed on the preliminary effective feature layer to restore the accuracy of the original image; the two acquired feature layers are fused to obtain the wildfire feature image after image segmentation, that is, the real-time dynamic image of the target area.

[0036] In this embodiment, the temperature detection module obtains the temperature value of the target area, the light intensity detection module obtains the light intensity value of the target area, the video monitoring module obtains the real-time dynamic image of the target area, the infrared imaging module obtains the infrared image of the target area, the smoke detection module obtains the smoke sensor data of the target area, and the data processing module obtains the final wildfire identification result of the target area based on the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data. The wildfire identification result of the target area is obtained based on the multi-sensor information fusion method, which can obtain more comprehensive wildfire information, locate the precise geographical location of the wildfire, improve the effectiveness of wildfire monitoring, and ensure the timeliness and accuracy of the alarm.

[0037] In a specific embodiment, in step 206, the data processing module obtains the final wildfire identification result of the target area according to the temperature value, light intensity value, real-time dynamic image, infrared image and smoke sensor data, including: performing feature recognition on the real-time dynamic image to obtain the first wildfire identification result of the target area; the first wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; performing infrared recognition on the infrared image to obtain the second wildfire identification result of the target area; the second wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; performing smoke recognition on the smoke sensor data to obtain the third wildfire identification result of the target area; the third wildfire identification result includes the absence of wildfire, suspected existence of wildfire and existence of wildfire; using the information fusion algorithm, temperature value and light intensity value to obtain the fourth wildfire identification result of the target area; the fourth wildfire identification result includes different probabilities of the existence of wildfire; and obtaining the final wildfire identification result according to the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result.

[0038] Specifically, a multi-sensor information fusion algorithm based on rough sets, BP neural network and D-S evidence theory is used to fuse the temperature values ​​and light intensity values ​​to determine the probability of fire occurrence and the credible probability, that is, the probability of the existence of a wildfire.

[0039] Specifically, real-time dynamic images can accurately obtain the flame characteristics and smoke characteristics of the target area, infrared images can accurately obtain the thermal radiation of the target area, smoke sensor data can accurately obtain the smoke value of the target area, and the temperature value and light intensity of the target area can effectively reflect the temperature and brightness of the target area. Therefore, even if the night image is not clear or the image is incomplete due to leaves blocking the monitoring, accurate wildfire identification results can be obtained through the comprehensive temperature value, light intensity value, real-time dynamic images, infrared images and smoke sensor data.

[0040] In a specific embodiment, feature recognition is performed on the real-time dynamic image to obtain a first wildfire identification result in the target area, including: feature recognition is performed on the real-time dynamic image; the feature recognition includes flame feature recognition and smoke feature recognition; if the real-time dynamic image has a flame feature, the first wildfire identification result is that a wildfire exists; if the real-time dynamic image does not have a flame feature but has a smoke feature, the first wildfire identification result is that a wildfire is suspected to exist; if the real-time dynamic image does not have a flame feature and does not have a smoke feature, the first wildfire identification result is that a wildfire does not exist.

[0041] Specifically, the real-time dynamic image captured by the video monitoring module is subjected to an image segmentation operation by the data processing module. If the image segmentation result has a flame feature, it is determined that there is a wildfire in the target area. If the image segmentation result has a smoke feature, it is determined that there is a suspected wildfire in the target area. If the image segmentation result does not have a flame or smoke feature, it is determined that there is no wildfire in the target area.

[0042] In a specific embodiment, infrared recognition is performed on an infrared image to obtain a second wildfire recognition result for the target area, including: obtaining a thermal radiation flux in the infrared image; comparing the thermal radiation flux with a first threshold and a second threshold; the second threshold is greater than the first threshold; if the thermal radiation flux is greater than the second threshold, the second wildfire recognition result is that a wildfire exists; if the thermal radiation flux is less than or equal to the second threshold and greater than the first threshold, the second wildfire recognition result is that a wildfire is suspected to exist; if the thermal radiation flux is less than or equal to the first threshold, the second wildfire recognition result is that a wildfire does not exist.

[0043] Specifically, the thermal radiation flux of the infrared image is calculated through the data processing module, and the first threshold and the second threshold of the thermal radiation flux are set in advance. If the thermal radiation flux of the infrared image is greater than the second threshold, it is determined that there is a wildfire in the target area. If the thermal radiation flux of the infrared image is between the second threshold and the first threshold, it is determined that there is a suspected wildfire in the target area. If the thermal radiation flux of the infrared image is less than the first threshold, it is determined that there is no wildfire in the target area.

[0044] In a specific embodiment, smoke identification is performed on smoke sensor data to obtain a third wildfire identification result for the target area, including: comparing the smoke sensor data with a third threshold and a fourth threshold; the fourth threshold is greater than the third threshold; if the smoke sensor data is greater than the fourth threshold, the third wildfire identification result is that a wildfire exists; if the smoke sensor data is less than or equal to the fourth threshold and greater than the third threshold, the third wildfire identification result is that a wildfire is suspected to exist; if the smoke sensor data is less than or equal to the third threshold, the third wildfire identification result is that a wildfire does not exist.

[0045] Specifically, the smoke sensor data value is analyzed by the data processing and analysis module, and the third threshold and the fourth threshold of the smoke sensor data value are set in advance. If the smoke sensor data value is greater than the fourth threshold, it is determined that there is a wildfire in the target area. If the smoke sensor data value is between the fourth threshold and the third threshold, it is determined that there is a suspected wildfire in the target area. If the smoke sensor data value is less than the third threshold, it is determined that there is no wildfire in the target area.

[0046] In a specific implementation, a final wildfire identification result is obtained based on the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result, including: performing statistics on the first wildfire identification result, the second wildfire identification result and the third wildfire identification result to obtain wildfire identification result statistical information; the wildfire identification result statistical information includes the number of wildfire identification results that are existing wildfires; and obtaining the final wildfire identification result based on the number of existing wildfires and the fourth wildfire identification result.

[0047] Specifically, since data obtained by different sensors may produce different wildfire identification results, comprehensively considering different wildfire identification results to obtain the final wildfire identification result can improve the accuracy of identification.

[0048] In a specific embodiment, a final wildfire identification result is obtained based on the number of existing wildfires and the fourth wildfire identification result, including: if the number of existing wildfires is a first value, and the probability of the existence of a wildfire in the fourth wildfire identification result is greater than a fifth threshold, then the final wildfire identification result is the existence of a wildfire; if the number of existing wildfires is a second value or a third value, and the probability of the existence of a wildfire in the fourth wildfire identification result is greater than the fifth threshold, then the final wildfire identification result is suspected existence of a wildfire; if the number of existing wildfires is a fourth value, and the probability of the existence of a wildfire in the fourth wildfire identification result is less than or equal to the fifth threshold, then the final wildfire identification result is the absence of a wildfire; the first value is greater than the second value, the second value is greater than the third value, and the third value is greater than the fourth value.

[0049] Specifically, if the number of wildfires is 3, that is, the data obtained by the video surveillance module, the infrared imaging module and the smoke detection module are all identified as the existence of wildfires, and the data obtained by the temperature detection module and the light intensity detection module show that the probability of the existence of wildfires is greater than 50%, then the final wildfire identification result is the existence of wildfires; if the number of wildfires is 2 or 1, and the data obtained by the temperature detection module and the light intensity detection module show that the probability of the existence of wildfires is greater than 50%, then the final wildfire identification result is suspected existence of wildfires; if the number of wildfires is 0, and the data obtained by the temperature detection module and the light intensity detection module show that the probability of the existence of wildfires is less than 50%, then the final wildfire identification result is that there is no wildfire.

[0050] Specifically, a comprehensive judgment can be made based on the existence of a wildfire and the suspected existence of a wildfire. For example, when there are two suspected wildfires and one suspected wildfire, the final wildfire identification result is that a wildfire exists, because the flames of the wildfire are smaller and the smoke concentration is lower at this time.

[0051] In a specific embodiment, the method also includes: when the final wildfire identification result is that a wildfire exists or is suspected to exist, the data processing module sends a prompt signal to the host computer; if the host computer receives a feedback signal of the prompt signal within a preset time, the data processing module issues an alarm.

[0052] Specifically, in actual operation, manual judgment may be limited by time and human resources. In order to ensure that a response can be made as soon as possible in an emergency, the system sets a time threshold. If no manual judgment is made within the set time, the data processing module 106 will identify the default target area as a wildfire. The purpose of this is to prevent the spread of fire due to delays in manual judgment and to take countermeasures as soon as possible. Of course, in actual applications, the specific value of the threshold needs to be adjusted according to actual conditions and needs.

[0053] In a specific embodiment, the third embodiment of the present application provides a forest fire monitoring device with multi-sensor information fusion, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the method as described in any one of the second embodiments of the present application.

[0054] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0055] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

[0056] The above description is only a preferred embodiment of the present invention and does not limit the present invention in other forms. Any technician familiar with the profession may use the technical content disclosed above to change or modify it into an equivalent embodiment with equivalent changes and apply it to other fields. However, any simple modification, equivalent change and modification made to the above embodiment based on the technical essence of the present invention without departing from the content of the technical solution of the present invention still falls within the protection scope of the technical solution of the present invention.

Claims

1. A multi-sensor information fusion forest fire monitoring system, characterized in that: The system includes: a temperature detection module, a light intensity detection module, a video monitoring module, an infrared imaging module, a smoke detection module and a data processing module; The output end of the temperature detection module, the output end of the light intensity detection module, the output end of the video monitoring module, the output end of the infrared imaging module and the output end of the smoke detection module are all connected to the input end of the data processing module; The temperature detection module is used to obtain the temperature value of the target area and send the temperature value to the data processing module; The light intensity detection module is used to obtain the light intensity value of the target area and send the light intensity value to the data processing module; The video monitoring module is used to obtain the real-time dynamic image of the target area and send the real-time dynamic image to the data processing module; The infrared imaging module is used to obtain an infrared image of the target area and send the infrared image to the data processing module; The smoke detection module is used to obtain the smoke sensing data of the target area and send the smoke sensing data to the data processing module; The data processing module is used to obtain the final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data; the final wildfire identification result includes the existence of wildfire, suspected existence of wildfire and non-existence of wildfire.

2. A multi-sensor information fusion forest fire monitoring method, characterized in that: The method comprises: The temperature detection module obtains the temperature value of the target area and sends the temperature value to the data processing module; The light intensity detection module obtains the light intensity value of the target area and sends the light intensity value to the data processing module; The video monitoring module obtains the real-time dynamic image of the target area and sends the real-time dynamic image to the data processing module; The infrared imaging module acquires the infrared image of the target area and sends the infrared image to the data processing module; The smoke detection module obtains the smoke sensing data of the target area and sends the smoke sensing data to the data processing module; The data processing module obtains a final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data; the final wildfire identification result includes the existence of a wildfire, the suspected existence of a wildfire and the non-existence of a wildfire.

3. The mountain fire monitoring method of multi-sensor information fusion as claimed in claim 2, characterized in that: The data processing module obtains the final wildfire identification result of the target area according to the temperature value, the light intensity value, the real-time dynamic image, the infrared image and the smoke sensor data, including: Performing feature recognition on the real-time dynamic image to obtain a first wildfire recognition result of the target area; the first wildfire recognition result includes no wildfire, suspected wildfire, and wildfire; Performing infrared recognition on the infrared image to obtain a second wildfire recognition result of the target area; the second wildfire recognition result includes no wildfire, suspected wildfire, and wildfire; Performing smoke recognition on the smoke sensing data to obtain a third wildfire recognition result of the target area; the third wildfire recognition result includes no wildfire, suspected wildfire, and wildfire; Obtaining a fourth wildfire identification result of the target area by using an information fusion algorithm, the temperature value, and the light intensity value; the fourth wildfire identification result includes different probabilities of the existence of a wildfire; The final wildfire identification result is obtained according to the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result.

4. The multi-sensor information fusion forest fire monitoring method according to claim 3, characterized in that: The performing feature recognition on the real-time dynamic image to obtain a first wildfire recognition result of the target area includes: Performing feature recognition on the real-time dynamic image; the feature recognition includes flame feature recognition and smoke feature recognition; If the real-time dynamic image has a flame feature, the first wildfire identification result is that a wildfire exists; If the real-time dynamic image does not have a flame feature but has a smoke feature, the first wildfire identification result is that a wildfire is suspected to exist; If the real-time dynamic image does not have a flame feature and does not have a smoke feature, the first wildfire identification result is that there is no wildfire.

5. The multi-sensor information fusion forest fire monitoring method according to claim 3, characterized in that: The performing infrared recognition on the infrared image to obtain a second wildfire recognition result of the target area includes: Acquiring thermal radiation flux in the infrared image; comparing the thermal radiation flux with a first threshold and a second threshold; the second threshold being greater than the first threshold; If the thermal radiation flux is greater than the second threshold, the second wildfire identification result is that a wildfire exists; If the thermal radiation flux is less than or equal to the second threshold value and greater than the first threshold value, the second wildfire identification result is suspected wildfire; If the thermal radiation flux is less than or equal to the first threshold, the second wildfire identification result is that no wildfire exists.

6. The multi-sensor information fusion forest fire monitoring method according to claim 3, characterized in that: The performing smoke recognition on the smoke sensor data to obtain a third wildfire recognition result of the target area includes: Comparing the smoke sensor data with a third threshold and a fourth threshold; the fourth threshold is greater than the third threshold; If the smoke sensor data is greater than the fourth threshold, the third wildfire identification result is that a wildfire exists; If the smoke sensor data is less than or equal to the fourth threshold value and greater than the third threshold value, the third wildfire identification result is suspected wildfire; If the smoke sensor data is less than or equal to the third threshold, the third wildfire identification result is that there is no wildfire.

7. The multi-sensor information fusion forest fire monitoring method according to claim 3, characterized in that: The obtaining the final wildfire identification result according to the first wildfire identification result, the second wildfire identification result, the third wildfire identification result and the fourth wildfire identification result includes: The first wildfire identification result, the second wildfire identification result and the third wildfire identification result are counted to obtain wildfire identification result statistical information; the wildfire identification result statistical information includes the number of wildfire identification results indicating that wildfires exist; The final wildfire identification result is obtained according to the number of existing wildfires and the fourth wildfire identification result.

8. The multi-sensor information fusion forest fire monitoring method according to claim 7, characterized in that: The obtaining the final wildfire identification result according to the number of existing wildfires and the fourth wildfire identification result includes: If the number of existing wildfires is a first value, and the probability of a wildfire existing in the fourth wildfire identification result is greater than a fifth threshold, then the final wildfire identification result is that a wildfire exists; If the number of existing wildfires is the second value or the third value, and the probability of the existence of a wildfire in the fourth wildfire identification result is greater than the fifth threshold, then the final wildfire identification result is suspected existence of a wildfire; If the number of existing wildfires is a fourth value, and the probability of the existence of a wildfire in the fourth wildfire identification result is less than or equal to a fifth threshold, then the final wildfire identification result is that there is no wildfire; the first value is greater than the second value, the second value is greater than the third value, and the third value is greater than the fourth value.

9. The multi-sensor information fusion forest fire monitoring method according to claim 2, characterized in that: The method further comprises: When the final wildfire identification result is that a wildfire exists or is suspected to exist, the data processing module sends a prompt signal to the host computer; If the host computer receives a feedback signal of the prompt signal within a preset time, the data processing module will issue an alarm.

10. A multi-sensor information fusion forest fire monitoring device, comprising a memory and a processor, characterized in that: The memory stores a computer program, and when the computer program is executed by the processor, the processor is caused to perform the steps of the method according to any one of claims 2 to 9.

Citation Information

Cited By

  • Fire point video real-time monitoring method and system for forest fire detection

    CN119316569A

  • A fire point video real-time monitoring method and system for mountain fire detection

    CN119316569B

  • High-altitude area forest fire hot spot identification and positioning system

    CN119649530A