Fire-fighting auxiliary decision method and system based on real-time environment monitoring

Abstract

The application relates to a fire-fighting auxiliary decision-making method and system based on real-time environment monitoring. A plurality of monitoring points are arranged in a hazardous chemical storage area, and a plurality of positions in the hazardous chemical storage area are monitored in real time. When the environmental parameters of any one monitoring point are abnormal, or smoke features appear in the video data, trend identification is performed on the environmental parameters of the monitoring point. If the environmental parameters have a one-way change trend and the change amount is large, it indicates that there is a diffusion risk. When there is a diffusion risk, diffusion analysis is performed to determine the diffusion direction and diffusion speed. Finally, auxiliary decision-making is performed based on the diffusion direction and diffusion speed. The application monitors the dynamic change of abnormal parameters, can accurately identify the situation without diffusion risk, and can reduce a lot of false alarm situations. The application has the advantages of accurate monitoring and auxiliary fire-fighting decision-making.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data processing, in particular to a fire auxiliary decision-making method and system based on real-time environment monitoring. BACKGROUND

[0002] At present, most of the chemical industry parks still have imperfect emergency management mechanism, unreasonable allocation of various emergency resources, weak emergency rescue ability, lack of safety technology supervision platform, and lack of professional fire fighting ability. Due to the large number of flammable, explosive and toxic major hazards in the park, once an accident occurs, the consequences will be very serious.

[0003] In the prior art, a monitoring system is set up to monitor fire, toxic gas and the like, but for such a special environment as a chemical industry park, fog and high temperature conditions at a single point often occur, resulting in frequent misjudgment of the system. In addition, a simple sensor can only monitor whether high temperature, humidity and toxic gas leakage exist in an area, and cannot analyze the spreading trend of high temperature, humidity and toxic gas, resulting in the inability to assist the fire fighting system in making evacuation and rescue decisions. SUMMARY

[0004] Therefore, the purpose of the present application is to provide a fire auxiliary decision-making method and system based on real-time environment monitoring to solve the problems in the background art.

[0005] In order to achieve the above-mentioned purpose, the present application adopts the following technical solutions:

[0006] The fire auxiliary decision-making method based on real-time environment monitoring of the present application comprises the following steps:

[0007] Obtain the environment monitoring data and monitoring video of the hazardous chemical storage area in the park, and obtain the plan view of the park, wherein the environment monitoring data comprises the values of the environmental factors of a plurality of monitoring points at a plurality of continuous time points before the current time point, and the environmental factors include temperature value, humidity value, dust concentration value and harmful gas concentration value;

[0008] Determine whether there is a preliminary risk in the hazardous chemical storage area based on the environment monitoring data and monitoring video of each monitoring point;

[0009] When there is a preliminary risk in the hazardous chemical storage area, perform trend analysis on the values of the environmental factors of each monitoring point in the hazardous chemical storage area at a plurality of continuous time points to obtain the change characteristics of the environmental factors; when the change characteristics of any target environmental factor meet the condition of unidirectional change at a plurality of continuous time points and the change rate is greater than a preset change rate threshold, it is determined that the monitoring point has a risk spreading trend;

[0010] The type of the target environmental factor is determined. When the target environmental factor is a target type, the monitoring point with a risk diffusion trend is used as the base point. The diffusion direction and diffusion rate are analyzed based on the values ​​of the target environmental factor at multiple consecutive time points of the base point and other monitoring points. When the target environmental factor is not a target type, the diffusion direction and diffusion rate are analyzed based on the infrared thermal video or RGB video of the hazardous chemical storage area collected by the UAV, and the diffusion analysis results are obtained.

[0011] Firefighting auxiliary decision-making is based on the diffusion analysis results and the park layout plan.

[0012] In one embodiment of this application, determining whether there is a preliminary risk in a hazardous chemical storage area based on environmental monitoring data and surveillance video from each monitoring point includes:

[0013] The values ​​of environmental factors at multiple consecutive time points are compared with corresponding preset thresholds, and smoke is identified based on the monitoring video using a pre-built smoke recognition model.

[0014] If the value of any environmental factor at any point in time is greater than the corresponding preset threshold, or if smoke features are present in the monitoring video, it is determined that there is an initial risk in the hazardous chemical storage area.

[0015] In one embodiment of this application, trend analysis is performed on the values ​​of environmental factors at each monitoring point in the hazardous chemical storage area at multiple consecutive time points to obtain the changing characteristics of the environmental factors, including:

[0016] The values ​​of each environmental factor at each monitoring point at multiple consecutive time points are mapped to a two-dimensional coordinate system to obtain multiple data points located in the two-dimensional coordinate system, wherein the horizontal axis of the two-dimensional coordinate system is the time axis and the vertical axis of the two-dimensional coordinate system is the data axis.

[0017] A pre-built sliding window slides along the time axis, and at each slide, the average value of all data points within the sliding window is calculated to obtain the average value for each slide. ;

[0018] The average value after multiple sliding satisfyes or At that time, it was determined that the values ​​of environmental factors exhibited unidirectional changes at multiple consecutive time points; the average value of the last sliding was calculated. and the average value of the initial position of the sliding window The difference This allows us to obtain the changing characteristics of environmental factors.

[0019] In an embodiment of the present application, the diffusion direction and diffusion speed are analyzed based on the values of the target environmental factor of the base point and other monitoring points at multiple continuous time points, and a diffusion analysis result is obtained, including:

[0020] trend analysis is performed on the values of the target environmental factor of the other monitoring points at multiple continuous time points;

[0021] when the target environmental factor of the other monitoring points does not contain a unidirectional change segment, waiting for a waiting time length , and returning to the trend analysis on the values of the target environmental factor of the other monitoring points at multiple continuous time points, until a unidirectional change segment appears in the target environmental factor of the other monitoring points, or the waiting time length accumulates to a target time length;

[0022] when the target environmental factor of the other monitoring points does not contain a unidirectional change segment after the waiting time length accumulates to the target time length, it is determined that the hazardous chemical storage area does not have a diffusion risk; when the values of the target environmental factor of the other monitoring points at multiple continuous time points contain a unidirectional change segment, it is determined that the hazardous chemical storage area has a diffusion risk, and the monitoring point containing the unidirectional change segment is taken as a target monitoring point;

[0023] the diffusion direction is determined based on the position of the base point and the position of the target monitoring point, and the diffusion speed is determined based on the distance between the base point and the target monitoring point, and the time of the unidirectional change segment of the target monitoring point.

[0024] In an embodiment of the present application, the trend analysis on the values of the target environmental factor of the other monitoring points at multiple continuous time points includes:

[0025] the values of the target environmental factor of the other monitoring points at multiple continuous time points are mapped into a two-dimensional coordinate system to obtain multiple data points in the two-dimensional coordinate system, wherein the horizontal axis of the two-dimensional coordinate system is a time axis, and the vertical axis of the two-dimensional coordinate system is a data axis;

[0026] a first sliding window is slid along the time axis based on a pre-constructed first sliding window, and at each sliding time, the average value of the multiple data points in the first sliding window is calculated ;

[0027] a second sliding window is slid along the time axis based on a pre-constructed second sliding window, and at each sliding time, it is judged whether the multiple average values in the second sliding window satisfy or , and , and the segment satisfying or is taken as a unidirectional change segment.

[0028] In one embodiment of this application, diffusion direction and diffusion velocity are analyzed based on infrared thermal video or RGB video of a hazardous chemical storage area collected by a drone, and diffusion analysis results are obtained, including:

[0029] Frames are extracted from the infrared thermal video or the RGB video to obtain multiple image frames on the timeline. ;

[0030] For the multiple image frames Preprocessing is performed to obtain multiple preprocessed images. The preprocessing methods include high-pass filtering, contrast enhancement, and grayscale conversion.

[0031] The multiple preprocessed images are processed based on a preset grayscale threshold range. Binarize each image separately to obtain multiple binary images. The binarized image The region that meets the preset grayscale threshold range is an abnormal region;

[0032] Extract the binarized image Outline of the abnormal region The time-series contour sequence is obtained;

[0033] The difference between any two adjacent contours in the time-series contour sequence is calculated to obtain the diffusion region sequence;

[0034] Initial contour from time-series contour sequence Extract the centroid and construct multiple sector-shaped directional regions using the centroid;

[0035] Align multiple directional regions with each diffusion region in the diffusion region sequence, and extract the centroid of the diffusion portion that falls within the multiple directional regions. ;

[0036] Calculate the diffusion velocity within each directional region, where the diffusion velocity is the ratio of the change in centroid displacement within each directional region to the duration.

[0037] The diffusion direction and diffusion velocity in each directional region are determined based on the diffusion velocity within that region.

[0038] In one embodiment of this application, fire-fighting auxiliary decision-making based on the diffusion analysis results and the park layout includes:

[0039] The diffusion direction where the diffusion rate exceeds a preset threshold is taken as the evacuation direction, and the risk area and emergency operation area are determined based on the evacuation direction; and the type of emergency supplies is determined based on the type of the target environmental factor and the type of hazardous chemicals stored in the hazardous chemical storage area.

[0040] annotating the evacuation direction, the risk area, the rescue operation area and the rescue material type in the park plan, and sending the park plan with the evacuation direction, the risk area, the rescue operation area and the rescue material type to the target object.

[0041] In an embodiment of the present application, the method further comprises:

[0042] When the risk diffusion trend exists in the monitoring point, the alarm information and the monitoring video are sent to the target object.

[0043] In an embodiment of the present application, the target type is an environmental factor type that does not cause air temperature change and color change.

[0044] The present application also provides a fire-fighting auxiliary decision system based on real-time environmental monitoring, characterized in that it comprises:

[0045] The acquisition module is configured to acquire environmental monitoring data of a hazardous chemical storage area in a park and monitoring video, and acquire a park plan, wherein the environmental monitoring data comprises values of environmental factors of a plurality of monitoring points at a plurality of continuous time points before a current time point, and the environmental factors comprise temperature value, humidity value, dust concentration value and harmful gas concentration value.

[0046] The risk determination module is configured to determine whether the hazardous chemical storage area has a preliminary risk based on the environmental monitoring data of each monitoring point and the monitoring video.

[0047] The diffusion risk determination module is configured to, when the hazardous chemical storage area has a preliminary risk, perform trend analysis on the values of the environmental factors of each monitoring point in the hazardous chemical storage area at a plurality of continuous time points to obtain change characteristics of the environmental factors, and determine that the monitoring point has a risk diffusion trend when the change characteristics of any target environmental factor meet the condition that the target environmental factor changes unidirectionally at the plurality of continuous time points and the change rate is greater than a preset change rate threshold.

[0048] The diffusion analysis module is configured to determine the type of the target environmental factor, and when the target environmental factor is a target type, take the monitoring point with the risk diffusion trend as a base point, and perform diffusion direction and diffusion speed analysis based on the values of the target environmental factor of the base point and other monitoring points at a plurality of continuous time points; and when the target environmental factor is not the target type, perform diffusion direction and diffusion speed analysis based on the infrared thermal video or the RGB video of the hazardous chemical storage area collected by the unmanned aerial vehicle to obtain a diffusion analysis result.

[0049] The auxiliary decision module is configured to perform fire-fighting auxiliary decision based on the diffusion analysis result and the park plan.

[0050] The beneficial effects of the present application are: the fire auxiliary decision-making method and system based on real-time environment monitoring of the present application set multiple monitoring points in the dangerous chemical storage area, and respectively monitor multiple positions of the dangerous chemical storage area in real time. When the environmental parameters of any one monitoring point are abnormal, or smoke features appear in the video data, trend identification is performed on the environmental parameters of the monitoring point. If the environmental parameters show a one-way change trend and the change amount is large, it means that there is a diffusion risk. When there is a diffusion risk, diffusion analysis is performed to determine the diffusion direction and diffusion speed. Finally, auxiliary decision-making is performed based on the diffusion direction and diffusion speed. The present application monitors the dynamic changes of abnormal parameters, can accurately identify the situation without diffusion risk, and can reduce a lot of false alarm situations. The present application has the advantages of accurate monitoring and auxiliary fire decision-making. BRIEF DESCRIPTION OF DRAWINGS

[0051] The present application will be further described below in combination with the drawings and embodiments:

[0052] Figure 1 is a use scene diagram of the fire auxiliary decision-making method based on real-time environment monitoring in an embodiment of the present application;

[0053] Figure 2 is a structural diagram of the monitoring unit in an embodiment of the present application;

[0054] Figure 3 is a multi-sensor fusion decision-making structural diagram used in the present application;

[0055] Figure 4 is a flowchart of the fire auxiliary decision-making method based on real-time environment monitoring in an embodiment of the present application;

[0056] Figure 5 is a diffusion direction determination principle diagram in an embodiment of the present application;

[0057] Figure 6 is a structural diagram of the fire auxiliary decision-making system based on real-time environment monitoring in an embodiment of the present application;

[0058] Figure 7 shows a structural diagram of a computer system of an electronic device suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION

[0059] Following make the specific concrete example explain the embodiment of the present application, the person skilled in the art can be easily understood from the disclosure of the present application other advantages and efficacy.The present application can also be implemented or applied by another different specific embodiment, the details in the present application can be based on different views and applications, without departing from the spirit of the present application, various modifications or changes.The need to explain that, in the following examples and the features in the examples can be combined with each other without conflict.

[0060] Need to explain, the drawings provided in the following examples only illustrate the basic concept of the present application in a schematic way, and the drawings only show the layers related to the present application, not according to the actual implementation of the number of layers, shape and size drawing, the actual implementation of each layer of the type, quantity and proportion can be a kind of arbitrary change, and its layer layout type may be more complex.

[0061] In the following description, a large number of details are discussed to provide a more thorough explanation of the embodiments of the present application, however, it is obvious to the person skilled in the art that the embodiments of the present application can be implemented without these specific details.

[0062] Figure 1 It is an embodiment of the present application for real-time fire auxiliary decision-making method based on real-time environmental monitoring of the use scene diagram, as shown in Figure 1 As shown, the present application mainly relies on the setting of a plurality of monitoring units in the area where the hazardous chemicals exist to realize the real-time acquisition of environmental parameters.Each monitoring unit is set at different positions in the area where hazardous chemicals exist, and a variety of sensors are used to acquire basic data.In addition, considering that the key points of the hazardous chemicals enterprise have a poor environment and great danger, there are a large number of flammable gas and dust, therefore, the design of the industrial television monitoring system can be considered.The on-site monitoring system is responsible for completing the collection, caching, coding, storage and sending of audio and video information and alarm information, and can accept control instructions from the network, which usually includes the following devices: embedded DVR, NVR, camera, alarm input and output device, voice intercom device, etc.Once an accident occurs, the hazardous chemicals properties and surrounding environment information can be quickly reviewed to find the best solution, develop a processing plan, and minimize the loss caused by the accident.

[0063] Figure 2 It is a structural schematic diagram of the monitoring unit in an embodiment of the present application, as shown in Figure 2As shown, the application uses a remote intelligent control method for multi-point data acquisition, processing and management, and uses a multi-level computer processing system to realize the functions. In the application, the data acquisition device converts the signals obtained by the sensor into digital signals to realize preprocessing. First, the data in each data acquisition device is read, and then the corresponding information and commands are transmitted to the corresponding data collection device; second, the data processing is realized to generate the corresponding file; third, the processing information is transmitted to the workstation, so that the workstation can connect to the computer network, thereby forming the integration of production management.

[0064] Figure 3 The multi-sensor fusion decision structure used in the application is shown in the schematic diagram as Figure 3 As shown, in the application, a plurality of sensors are used to perform basic data acquisition. After transmission through the network, signal processing and sensor fusion are performed in the analysis host to assist the staff in making fire fighting decisions. Finally, the scheme deployment and specific scheme execution are completed.

[0065] Figure 4 The flowchart of the fire fighting auxiliary decision method based on real-time environmental monitoring in an embodiment of the application is shown in the schematic diagram as Figure 4 As shown, the fire fighting auxiliary decision method based on real-time environmental monitoring in the embodiment can include steps S410 to S450:

[0066] S410, obtaining environmental monitoring data and monitoring video of a hazardous chemical storage area in a park, and obtaining a park plan, wherein the environmental monitoring data includes values of environmental factors of a plurality of monitoring points at a plurality of continuous time points before a current time point, and the environmental factors include temperature values, humidity values, dust concentration values, and harmful gas concentration values;

[0067] In the application, the acquisition of environmental monitoring data and monitoring video is as described above, and depends on the constructed information collection system. The application mainly faces scenarios such as chemical industry parks and hazardous chemical production enterprises, so the main environmental parameters to be collected are temperature values, humidity values, dust concentration values, and harmful gas concentration values. In addition, if water leakage and electric leakage need to be collected, current sensors and water immersion sensors can also be added.

[0068] S420, judging whether there is a preliminary risk in the hazardous chemical storage area based on the environmental monitoring data and monitoring video of each monitoring point;

[0069] The preliminary risk determination is relatively simple, that is, it is determined according to the threshold comparison and the feature recognition result, which specifically includes:

[0070] S421, compare the values of the environmental factors at multiple continuous time points with corresponding preset threshold values respectively, and perform smoke identification on the monitoring video based on a pre-constructed smoke identification model;

[0071] S422, when the value of any one environmental factor at any one time point is greater than the corresponding preset threshold value, or when there is a smoke feature in the monitoring video, it is determined that there is a preliminary risk in the hazardous chemical storage area.

[0072] In this application, the monitoring identification is performed by the neural network recognition model prepared in advance to extract the smoke features. For a chemical industry park, during the exothermic reaction, operation and maintenance of equipment, and steam discharge during the process, local high temperature or water mist often occurs. Therefore, only by using the existing neural network recognition technology, it is determined that there is a fire risk. A large number of false alarms are prone to occur, so the application further analyzes the above data by using the following analysis process.

[0073] S430, when there is a preliminary risk in the hazardous chemical storage area, trend analysis is performed on the values of the environmental factors of each monitoring point in the hazardous chemical storage area at multiple continuous time points to obtain the change characteristics of the environmental factors; when the change characteristics of any one target environmental factor meet the conditions of unidirectional change at multiple continuous time points and the change rate is greater than a preset change rate threshold, it is determined that there is a risk diffusion trend in the monitoring point;

[0074] In order to exclude some false alarm situations caused by local high temperature, humidity change, and harmful gas discharge due to normal work. The application also performs trend analysis on the values of the environmental factors of each monitoring point at multiple continuous time points. From the change trend, it is determined whether the abnormal value of a single point is long-term sustained. If it is long-term sustained and the situation is deteriorating, it means that the environmental parameter abnormality is not caused by normal work. For example, when harmful gas leaks, the harmful gas sensor first detects the concentration rise, at this time, trend analysis is performed, if the concentration continues to rise within a certain time, and the rising amplitude is large, it means that it is an abnormal leakage. Because if it is normal work, the discharge speed will be controlled, and the concentration will not continue to rise. When the environmental parameter is abnormal, for example, the high temperature continues, the harmful gas continues to leak, and the risk diffusion is inevitable, so it is determined that there is a risk diffusion trend. Once the risk diffusion trend appears, the alarm information and the monitoring video are sent to the target object. Risk prompt and alarm are performed in time.

[0075] Specifically, the trend analysis process in the application is as follows:

[0076] S431, map the value of each environmental factor at each monitoring point at multiple consecutive time points to a two-dimensional coordinate system to obtain multiple data points located in the two-dimensional coordinate system, wherein the horizontal axis of the two-dimensional coordinate system is the time axis and the vertical axis of the two-dimensional coordinate system is the data axis;

[0077] S432, slide the sliding window along the time axis based on the pre-built sliding window, and calculate the average value of all data points within the sliding window at each slide to obtain the average value for each slide. ;

[0078] S433, the average value after multiple sliding satisfyes or At that time, it was determined that the values ​​of environmental factors exhibited unidirectional changes at multiple consecutive time points; the average value of the last sliding was calculated. and the average value of the initial position of the sliding window The difference This allows us to obtain the changing characteristics of environmental factors.

[0079] This application employs a sliding window approach to filter out the influence of sudden changes in the value of a single data point on trend analysis. Multiple time points are typically sampled over a period of 3-10 minutes. The window width is set at approximately 30 seconds, and the step size is approximately 10 seconds, meaning that the average value of data points within a 30-second period is calculated each time. If the environmental parameter value continuously rises or falls, it will cause the average value of this sliding window to meet certain conditions. or In addition, it is necessary to extract the amount of change in this process. If the amount of change is too small, it is not considered to satisfy the unidirectional change.

[0080] S440, determine the type of the target environmental factor. When the target environmental factor is a target type, take the monitoring point with a risk diffusion trend as the base point, and perform diffusion direction and diffusion rate analysis based on the values ​​of the target environmental factor at multiple consecutive time points of the base point and other monitoring points. When the target environmental factor is not a target type, perform diffusion direction and diffusion rate analysis based on the infrared thermal video or RGB video of the hazardous chemical storage area collected by the UAV, and obtain the diffusion analysis results.

[0081] In addition to issuing an alarm when a risk spread trend is met, this application further extracts the spread trend to assist relevant personnel in making fire rescue decisions.

[0082] The risk diffusion trend in the foregoing is caused by a point continuously generating abnormal environmental data. For example, continuous temperature rise caused by fire; continuous concentration rise caused by toxic gas leakage, continuous humidity drop, etc. In these scenarios, there will be diffusion phenomena, such as high-temperature air diffusion and toxic gas diffusion. These diffusion data play a very important role in subsequent personnel evacuation, disaster relief scheme formulation, etc.

[0083] Since some changes in environmental parameters cannot be reflected in temperature or visual changes, such as humidity, some colorless toxic gases that do not cause air temperature changes. For this type of environmental parameter, the present application still analyzes based on multiple monitoring points. For harmful gas leakage or fire that can cause air temperature changes and color changes, the present application uses infrared thermal sensing or visual images to perform analysis.

[0084] Specifically, based on the values of the target environmental factor of the base point and other monitoring points at multiple consecutive time points, diffusion direction and diffusion speed analysis is performed to obtain diffusion analysis results, including:

[0085] S4401, trend analysis is performed on the values of the target environmental factor of the other monitoring points at multiple consecutive time points;

[0086] Under the condition of continuous change of the target environmental factor, due to air flow and heat conduction effect, it will also cause the values of the target environmental factor of other monitoring points to change unidirectionally. Therefore, trend analysis needs to be performed on the values of the target environmental factor of other monitoring points at multiple consecutive time points.

[0087] Unlike the trend analysis in the foregoing, the trend analysis of other monitoring points only needs to find a section after the initial time point of multiple consecutive time points that has a unidirectional change. Specifically, including:

[0088] S44011, mapping the values of the target environmental factor of the other monitoring points at multiple consecutive time points to a two-dimensional coordinate system to obtain multiple data points located in the two-dimensional coordinate system, wherein the horizontal axis of the two-dimensional coordinate system is a time axis, and the vertical axis of the two-dimensional coordinate system is a data axis;

[0089] S44012, sliding the first sliding window along the time axis based on a pre-constructed first sliding window, and calculating the average value of the multiple data points in the first sliding window at each sliding time ;

[0090] S44013, sliding the second sliding window along the time axis based on a pre-constructed second sliding window, and at each sliding time, judging whether the multiple average values in the second sliding window satisfy or , and if the multiple average values satisfy or The section is considered as a unidirectional change section.

[0091] In the above process, the sliding window average analysis method is still used. To identify segments with unidirectional trends, a second sliding window is also set. Trend judgment is performed within the second sliding window to find segments with unidirectional trends. This segment is then used as the time period from the base point to the current monitoring point.

[0092] S4402, when the target environmental factors at other monitoring points do not contain unidirectional change zones, waiting time And return to the trend analysis of the target environmental factors at other monitoring points at multiple consecutive time points until the target environmental factors at other monitoring points show a unidirectional change segment, or wait for the time to accumulate to the target time.

[0093] S4403, when the target environmental factors at other monitoring points do not contain unidirectional change segments after the waiting time has accumulated to the target time, it is determined that there is no risk of diffusion in the hazardous chemical storage area; when the values ​​of the target environmental factors at other monitoring points contain unidirectional change segments at multiple consecutive time points, it is determined that there is a risk of diffusion in the hazardous chemical storage area, and the monitoring point containing the unidirectional change segment is taken as the target monitoring point.

[0094] If none of the target environmental factors at other monitoring points contain unidirectional change zones, it indicates a slow propagation speed. In this case, analysis should be conducted again after several cycles. If no unidirectional change zones are found, the diffusion risk inferred earlier should be revised, and it should be determined that there is no diffusion risk at this point.

[0095] If a unidirectional change zone is found at another monitoring point, that monitoring point will be marked.

[0096] S4404, determine the diffusion direction based on the position of the base point and the position of the target monitoring point, and determine the diffusion speed based on the distance between the base point and the target monitoring point and the time of the unidirectional change segment of the target monitoring point.

[0097] Specifically, there may be multiple diffusion directions, and the speed of each diffusion direction is different.

[0098] diffusion rate ,in, For the direction of diffusion speed, Indicates the base point and the target monitoring point The distance between them The time difference between the start time of a unidirectional change segment of the target monitoring point and the initial time of multiple consecutive time points.

[0099] based on the infrared thermal video or the RGB video collected by the unmanned aerial vehicle, a diffusion direction and a diffusion speed are analyzed to obtain a diffusion analysis result, including:

[0100] S4411, the infrared thermal video or the RGB video is frame extracted to obtain a plurality of image frames on a time axis ;

[0101] In order to reduce the amount of data for subsequent processing, the infrared thermal video or the RGB video is frame extracted in the application. The frame extraction method adopts uniform frame extraction.

[0102] S4412, the plurality of image frames are preprocessed to obtain a plurality of preprocessed images , wherein the preprocessing method includes high-pass filtering, contrast enhancement and gray scale conversion;

[0103] High-pass filtering can retain more high-frequency information, which is convenient for subsequent contour extraction. Contrast enhancement can also enhance the difference between high-temperature areas or color different areas and other areas, which is convenient for subsequent contour extraction.

[0104] S4413, the plurality of preprocessed images are respectively binarized based on a preset gray scale threshold range to obtain a plurality of binarized images , wherein the area in the binarized image that meets the preset gray scale threshold range is an abnormal area;

[0105] In the application, different gray scale threshold ranges will be set according to different abnormal parameter types. For example, if it is an infrared thermal video, the red part will be converted to gray scale and will fall into a general gray scale range. If it is a white gas leakage, there will be a color lighter area in the RGB image, which will also fall into a general gray scale range. This range can effectively extract the abnormal area.

[0106] S4414, the contour of the abnormal area in the binarized image is extracted to obtain a time sequence contour sequence;

[0107] S4415, any two adjacent contours in the time sequence contour sequence are subtracted to obtain a diffusion area sequence;

[0108] Each diffusion area in the diffusion area sequence represents the diffusion range of the gas or temperature, and the diffusion direction and diffusion speed can be analyzed based on the diffusion range.

[0109] S4416, the initial contour in the time sequence contour sequence extracting a centroid of the center, constructing a plurality of fan-shaped direction regions with the centroid;

[0110] initial contour The centroid of the center is the midpoint at the beginning of the diffusion, which is needed as a base point when judging the diffusion direction and diffusion speed. The plurality of fan-shaped direction regions are reference regions describing a plurality of diffusion directions.

[0111] S4417, aligning the plurality of direction regions with each diffusion region in the diffusion region sequence, and extracting diffusion part centroids of the diffusion regions falling within the plurality of direction regions ;

[0112] Figure 5 The diffusion direction determination principle diagram in an embodiment of the present application is shown in FIG. 4, wherein the plurality of fan-shaped direction regions divide the diffusion range into a plurality of directions, and the main diffusion direction can be determined. Figure 5

[0113] S4418, calculating the diffusion speed in each direction region, wherein the diffusion speed is the ratio of the centroid displacement change amount of each direction region to the time length;

[0114] diffusion speed The centroid displacement change amount is the sum of the displacement amounts of all adjacent centroids in each direction region, and the time length is the time difference between the time corresponding to the current frame and the initial time.

[0115] S4419, determining the diffusion direction and the diffusion speed of the diffusion direction based on the diffusion speed in each direction region.

[0116] Finally, the direction with a diffusion speed greater than a preset threshold is taken as the diffusion direction.

[0117] S450, making a fire-fighting auxiliary decision based on the diffusion analysis result and the park plan.

[0118] Specifically, it includes:

[0119] S451, taking the diffusion direction with a diffusion speed exceeding a preset threshold as the evacuation direction, determining the risk area and the rescue operation area based on the evacuation direction, and determining the rescue material type based on the type of the target environmental factor and the dangerous chemical storage type of the dangerous chemical storage area.

[0120] S452, marking the evacuation direction, the risk area, the rescue operation area and the rescue material type on the park plan, and sending the park plan marked with the evacuation direction, the risk area, the rescue operation area and the rescue material type to the target object.

[0121] ​The harmful gas diffusion direction is one of the key factors for formulating evacuation plans, determining risk areas, and planning rescue operation areas. The evacuation direction should be opposite or perpendicular to the harmful gas diffusion direction as much as possible to reduce the risk of exposure to high concentration of harmful gas. The risk area can also be determined by the diffusion path in the foregoing, so as to evacuate the people in the risk area. The rescue operation area is usually located on the upwind side or the crosswind direction, away from the main diffusion path, to ensure the safety of the rescue personnel. For harmful gases with high density, the rescue operation point may be selected at a higher position to avoid the high concentration area near the ground.

[0122] In addition, the present application prepares different rescue materials for different target environment parameter types in advance, which helps firefighters to complete the rescue work more efficiently.

[0123] The fire-fighting auxiliary decision-making method based on real-time environment monitoring of the present application sets multiple monitoring points in the hazardous chemical storage area, and respectively monitors multiple positions of the hazardous chemical storage area in real time. When the environment parameters of any monitoring point are abnormal, or smoke features appear in the video data, trend identification is performed on the environment parameters of the monitoring point. If the environment parameters have a one-way change trend and a large change amount, it means that there is a diffusion risk. When there is a diffusion risk, diffusion analysis is performed to determine the diffusion direction and diffusion speed. Finally, auxiliary decision-making is performed based on the diffusion direction and diffusion speed. The present application monitors the dynamic changes of abnormal parameters, can accurately identify situations without diffusion risk, and can reduce a lot of false alarm situations. The present application has the advantages of accurate monitoring and assisting fire-fighting decision-making.

[0124] As shown in Figure 6 The present application also provides a fire-fighting auxiliary decision-making system based on real-time environment monitoring, characterized in that it comprises:

[0125] An acquisition module is configured to acquire environment monitoring data of a hazardous chemical storage area in a park and monitoring video, and acquire a park plan, wherein the environment monitoring data comprises values of environment factors of multiple monitoring points at multiple continuous time points before a current time point, and the environment factors include temperature values, humidity values, dust concentration values, and harmful gas concentration values.

[0126] A risk determination module is configured to determine whether the hazardous chemical storage area has a preliminary risk based on the environment monitoring data of each monitoring point and the monitoring video.

[0127] The diffusion risk determination module is configured to perform trend analysis on values of the environmental factors of each monitoring point in the hazardous chemical storage area at a plurality of continuous time points when there is a preliminary risk in the hazardous chemical storage area, to obtain a change characteristic of the environmental factors; and determine that the monitoring point has a risk diffusion trend when the change characteristic of any target environmental factor satisfies: unidirectional change at the plurality of continuous time points, and a change rate greater than a preset change rate threshold.

[0128] The diffusion analysis module is configured to determine a type of the target environmental factor, and when the target environmental factor is of a target type, take the monitoring point having the risk diffusion trend as a base point, and perform diffusion direction and diffusion speed analysis based on values of the target environmental factor of the base point and other monitoring points at the plurality of continuous time points; and when the target environmental factor is not of the target type, perform diffusion direction and diffusion speed analysis based on the infrared thermal video or the RGB video of the hazardous chemical storage area collected by the unmanned aerial vehicle, to obtain a diffusion analysis result.

[0129] The auxiliary decision-making module is configured to perform fire-fighting auxiliary decision-making based on the diffusion analysis result and the park plan.

[0130] The fire-fighting auxiliary decision-making system based on real-time environmental monitoring provided by the application sets a plurality of monitoring points in the hazardous chemical storage area, and respectively monitors a plurality of positions of the hazardous chemical storage area in real time. When an environmental parameter of any monitoring point is abnormal, or a smoke feature appears in the video data, trend identification is performed on the environmental parameter of the monitoring point. If the environmental parameter has a unidirectional change trend and a large change amount, it indicates that there is a diffusion risk. When there is a diffusion risk, diffusion analysis is performed to determine the diffusion direction and the diffusion speed. Finally, auxiliary decision-making is performed based on the diffusion direction and the diffusion speed. The application monitors the dynamic change of the abnormal parameter, can accurately identify the situation without diffusion risk, and can reduce a lot of false alarm situations. The application has the advantages of accurate monitoring and auxiliary fire-fighting decision-making.

[0131] Figure 7 The structure schematic diagram of the computer system of the electronic device suitable for implementing the embodiments of the application is shown. It should be noted that, Figure 7 The computer system 700 of the electronic device shown is only an example, and should not bring any limitation to the functions and use range of the embodiments of the application.

[0132] As Figure 7As shown, the computer system 700 includes a central processing unit (CPU) 701 which can perform various suitable actions and processes in accordance with programs stored in a read-only memory (ROM) 702 or loaded into a random access memory (RAM) 703 from the storage section 708, such as performing the methods in the above-described embodiments. Various programs and data required for the operation of the system are also stored in the RAM 703. The CPU 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0133] Connected to the I / O interface 705 are an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as necessary. A removable recording medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is attached to the drive 710 as necessary, so that a computer program read therefrom is installed into the storage section 708 as necessary.

[0134] In particular, in accordance with embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present application include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing computer programs for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication section 709, and / or installed from the removable recording medium 711. When the computer program is executed by the central processing unit (CPU) 701, various functions defined in the system of the present application are performed.

[0135] It should be noted that the computer-readable medium in the embodiments shown in the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may, for example, be an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the computer-readable signal medium can include a data signal propagating in a baseband or as a carrier wave in a propagated data signal, in which the computer-readable computer program is carried. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit programs for use by or in connection with an instruction execution system, device or component. The computer program contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, or the like, or any suitable combination of the above.

[0136] The flowcharts and block diagrams in the drawings illustrate the possible implementation architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In the flowcharts or block diagrams, each block can represent a module, a program segment or a part of code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different order than that shown in the drawings. For example, two blocks represented in succession can actually be executed substantially in parallel, and sometimes they can be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0137] The units described in the embodiments of the present application can be implemented by software, or by hardware, or by a combination of software and hardware. The units described can also be located in a single processor. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0138] Another aspect of the present application provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor of a computer, and causes the computer to perform the method described above. The computer readable storage medium can be included in the electronic device described in the embodiments above, or can exist separately from the electronic device.

[0139] Another aspect of the present application provides a computer program product or a computer program. The computer program product or the computer program includes computer instructions. The computer instructions are stored in a computer readable storage medium. A processor of a computer reads the computer instructions from the computer readable storage medium. The processor executes the computer instructions, and causes the computer to perform the method described in the embodiments above.

[0140] The above embodiments are merely preferred embodiments of the present application, and the protection scope of the present application is not limited to this. Any modification, equivalent replacement or transformation made by those skilled in the art based on the present application shall fall within the protection scope of the present application.

Claims

1. A fire-fighting auxiliary decision-making method based on real-time environmental monitoring, characterized in that, Including the following steps: The system acquires environmental monitoring data and surveillance videos of the hazardous chemical storage area within the park, and obtains a park floor plan. The environmental monitoring data includes the values ​​of environmental factors at multiple monitoring points at multiple consecutive time points prior to the current time point. The environmental factors include temperature, humidity, dust concentration, and harmful gas concentration. Determining whether there is an initial risk in the hazardous chemical storage area based on environmental monitoring data and surveillance video from each monitoring point; determining whether there is an initial risk in the hazardous chemical storage area based on environmental monitoring data and surveillance video from each monitoring point includes: comparing the values ​​of environmental factors at multiple consecutive time points with corresponding preset thresholds, and performing smoke recognition on the surveillance video based on a pre-built smoke recognition model; determining that there is an initial risk in the hazardous chemical storage area when the value of any environmental factor at any time point is greater than the corresponding preset threshold, or when smoke features are present in the surveillance video; When an initial risk is identified in the hazardous chemical storage area, trend analysis is performed on the values ​​of environmental factors at each monitoring point in the hazardous chemical storage area at multiple consecutive time points to obtain the change characteristics of the environmental factors. If the change characteristics of any target environmental factor satisfy the following: unidirectional change at multiple consecutive time points, and the rate of change is greater than a preset rate of change threshold, it is determined that the monitoring point has a risk diffusion trend. The trend analysis of the values ​​of environmental factors at each monitoring point in the hazardous chemical storage area at multiple consecutive time points to obtain the change characteristics of the environmental factors includes: mapping the values ​​of each environmental factor at each monitoring point at multiple consecutive time points to a two-dimensional coordinate system to obtain multiple data points located in the two-dimensional coordinate system, where the horizontal axis of the two-dimensional coordinate system is the time axis and the vertical axis is the data axis; sliding along the time axis based on a pre-constructed sliding window, and calculating the average value of all data points within the sliding window at each slide to obtain the average value for each slide. The average value after multiple sliding operations satisfies or At that time, it was determined that the values ​​of environmental factors exhibited unidirectional changes at multiple consecutive time points; the average value of the last sliding was calculated. and the average value of the initial position of the sliding window The difference This allows us to obtain the changing characteristics of environmental factors; The type of the target environmental factor is determined. When the target environmental factor is a target type, monitoring points with a risk diffusion trend are used as base points. Based on the values ​​of the target environmental factor at multiple consecutive time points of the base points and other monitoring points, diffusion direction and diffusion rate are analyzed. When the target environmental factor is not a target type, diffusion direction and diffusion rate are analyzed based on infrared thermal video or RGB video of the hazardous chemical storage area collected by UAVs, and diffusion analysis results are obtained. The diffusion direction and diffusion rate analysis based on infrared thermal video or RGB video of the hazardous chemical storage area collected by UAVs includes: extracting frames from the infrared thermal video or RGB video to obtain multiple image frames on the time axis. For the multiple image frames Preprocessing is performed to obtain multiple preprocessed images. The preprocessing methods include high-pass filtering and contrast enhancement; the multiple preprocessed images are processed based on a preset grayscale threshold range. Binarize each image separately to obtain multiple binary images. The binarized image Regions within a preset grayscale threshold range are considered abnormal regions; the binarized image is then extracted. Outline of the abnormal region A temporal contour sequence is obtained; the difference between any two adjacent contours in the temporal contour sequence is calculated to obtain a diffusion region sequence; from the initial contours in the temporal contour sequence... Extract the centroid, and construct multiple fan-shaped directional regions using the centroid; align the multiple directional regions with each diffusion region in the diffusion region sequence, and extract the centroid of the diffusion portion of the diffusion region falling into the multiple directional regions. ; Calculate the diffusion velocity within each directional region, where the diffusion velocity is the ratio of the change in centroid displacement to the duration within each directional region; Determine the diffusion direction and the diffusion velocity within each directional region based on the diffusion velocity within that direction; Firefighting auxiliary decision-making is based on the diffusion analysis results and the park layout plan.

2. The fire-fighting auxiliary decision-making method based on real-time environmental monitoring according to claim 1, characterized in that, Based on the values ​​of target environmental factors at multiple consecutive time points from the aforementioned baseline and other monitoring points, diffusion direction and diffusion rate are analyzed to obtain diffusion analysis results, including: Trend analysis was performed on the values ​​of target environmental factors at other monitoring sites at multiple consecutive time points. Waiting time when the target environmental factors at other monitoring points do not contain unidirectional change zones And return to the trend analysis of the target environmental factors at other monitoring points at multiple consecutive time points until the target environmental factors at other monitoring points show a unidirectional change segment, or wait for the time to accumulate to the target time; When the waiting time accumulates to the target time, and the target environmental factors at other monitoring points do not contain unidirectional change segments, it is determined that there is no risk of diffusion in the hazardous chemical storage area; when the target environmental factors at other monitoring points contain unidirectional change segments at multiple consecutive time points, it is determined that there is a risk of diffusion in the hazardous chemical storage area, and the monitoring point containing the unidirectional change segment is taken as the target monitoring point. The diffusion direction is determined based on the location of the base point and the location of the target monitoring point, and the diffusion speed is determined based on the distance between the base point and the target monitoring point and the time of the unidirectional change segment of the target monitoring point.

3. The fire-fighting auxiliary decision-making method based on real-time environmental monitoring according to claim 2, characterized in that, Trend analysis was performed on the values ​​of target environmental factors at other monitoring sites over multiple consecutive time points, including: The values ​​of target environmental factors at other monitoring points at multiple consecutive time points are mapped to a two-dimensional coordinate system to obtain multiple data points located in the two-dimensional coordinate system, wherein the horizontal axis of the two-dimensional coordinate system is the time axis and the vertical axis of the two-dimensional coordinate system is the data axis. A first sliding window, pre-built, slides along the time axis, and at each slide, the average value of multiple data points within the first sliding window is calculated. ; The second sliding window, pre-constructed, slides along the time axis, and at each slide, multiple average values ​​within the second sliding window are determined. Does it meet the requirements? or and will satisfy or The section is considered as a unidirectional change section.

4. The fire-fighting auxiliary decision-making method based on real-time environmental monitoring according to claim 1, characterized in that, Firefighting-assisted decision-making based on the diffusion analysis results and the park layout plan includes: The diffusion direction where the diffusion rate exceeds a preset threshold is taken as the evacuation direction, and the risk area and emergency operation area are determined based on the evacuation direction; and the type of emergency supplies is determined based on the type of the target environmental factor and the type of hazardous chemicals stored in the hazardous chemical storage area. The evacuation direction, the risk area, the emergency rescue operation area, and the type of emergency rescue materials are marked on the park's floor plan, and the park floor plan marked with the evacuation direction, the risk area, the emergency rescue operation area, and the type of emergency rescue materials is sent to the target object.

5. The fire-fighting auxiliary decision-making method based on real-time environmental monitoring according to claim 1, characterized in that, Also includes: When a risk spreads at the monitoring point, an alarm message and surveillance video are sent to the target object.

6. The fire-fighting auxiliary decision-making method based on real-time environmental monitoring according to claim 1, characterized in that, The target type is an environmental factor that does not cause changes in air temperature or color.

7. A fire-fighting auxiliary decision-making system based on real-time environmental monitoring, applied to the fire-fighting auxiliary decision-making method based on real-time environmental monitoring as described in claim 1, characterized in that, include: The acquisition module is used to acquire environmental monitoring data and surveillance videos of the hazardous chemical storage area in the park, and to acquire a park plan. The environmental monitoring data includes the values ​​of environmental factors at multiple monitoring points at multiple consecutive time points before the current time point. The environmental factors include temperature, humidity, dust concentration, and harmful gas concentration. The risk assessment module is used to determine whether there is a preliminary risk in the hazardous chemical storage area based on environmental monitoring data and surveillance video from each monitoring point. The diffusion risk determination module is used to perform trend analysis on the values ​​of environmental factors at multiple consecutive time points of each monitoring point in the hazardous chemical storage area when there is an initial risk in the hazardous chemical storage area, and to obtain the change characteristics of the environmental factors; when the change characteristics of any target environmental factor meet the following conditions: unidirectional change at multiple consecutive time points, and the rate of change is greater than a preset rate of change threshold, it is determined that there is a risk diffusion trend at the monitoring point. The diffusion analysis module is used to determine the type of the target environmental factor. When the target environmental factor is the target type, the monitoring point with a risk diffusion trend is used as the base point. The diffusion direction and diffusion rate are analyzed based on the values ​​of the target environmental factor at multiple consecutive time points of the base point and other monitoring points. When the target environmental factor is not the target type, the diffusion direction and diffusion rate are analyzed based on the infrared thermal video or RGB video of the hazardous chemical storage area collected by the UAV, and the diffusion analysis results are obtained. The auxiliary decision-making module is used to make fire-fighting auxiliary decisions based on the diffusion analysis results and the park layout.

Images