Fire safety monitoring method and system based on Internet of Things

Abstract

The invention discloses a fire safety monitoring method based on the Internet of Things, and the method comprises the steps: collecting and analyzing a real-time video or image of a monitored target region, determining whether a fire hazard occurs, determining the position of the fire hazard when the fire hazard occurs, and starting an automatic fire prevention measure; determining a plurality of fire monitoring devices distributed in a preset first range around the fire position, calling field data collected by each fire monitoring device, and judging a fire state according to the field data; fire-fighting power existing in a preset second range around the fire position is determined, fire-fighting power lacking in the fire position is determined according to the fire state, and a fire station is requested to call the fire-fighting power. According to the invention, the fire information can be accurately judged, the fire condition of the fire scene can be judged in real time, automatic fire prevention measures can be quickly taken according to the fire condition of the fire scene, and a fire-fighting equipment carrying suggestion can be provided for firefighters.

Description

Technical Field

[0001] The present invention belongs to the technical field of fire safety monitoring, and in particular relates to a fire safety monitoring method and system based on the Internet of Things. Background Art

[0002] "Firefighting" means eliminating hidden dangers and preventing disasters (i.e. preventing and solving man-made, natural and accidental disasters that people encounter in their lives, work and studies). Of course, the narrow meaning in the early stage of people's understanding is: (extinguishing) fire. It mainly includes the rescue of personnel at the fire scene, the rescue of important facilities and equipment, cultural relics, the security and rescue of important property, and the extinguishing of fires. The purpose is to reduce the degree of damage caused by fire, reduce casualties and property losses. The urban fire remote monitoring system is a device that combines the most advanced fire alarm technology, information communication and network technology, computer control technology and multimedia display technology of the contemporary era, and collects various alarm signals, fault signals, and image information at the monitoring site in real time through public (unit) telephone networks, local / wide area networks, wireless GPRS / CDMA networks and other transmission methods, and transmits the above information to the remote alarm detection center in a timely and reliable manner.

[0003] The following questions are now raised regarding the fire safety monitoring system of the prior art:

[0004] The fire safety monitoring system of the prior art cannot accurately determine the fire information, cannot determine the fire situation at the fire scene in real time, cannot quickly make automatic fire prevention measures according to the fire situation at the fire scene, and cannot provide firefighters with suggestions on carrying fire equipment. Summary of the invention

[0005] The technical problem to be solved by the present invention is to overcome the existing defects and provide a fire safety monitoring method based on the Internet of Things to solve the problems raised in the above background technology.

[0006] To achieve the above object, the present invention provides a fire safety monitoring method based on the Internet of Things, comprising:

[0007] Collect and analyze real-time video or images of the target area to determine whether a fire has occurred. If a fire has occurred, locate the fire and initiate automatic fire prevention measures.

[0008] Determine a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieve the on-site data collected by each fire monitoring device, and determine the fire status according to the on-site data;

[0009] The firefighting forces existing within a preset second range around the fire location are determined, and the firefighting forces lacking at the fire location are determined according to the fire status and requested to be called by the fire station.

[0010] Preferably, the collecting and analyzing real-time video or images of the target area to determine whether a fire occurs and determining the location of the fire when a fire occurs includes:

[0011] Acquire real-time video or image of the target monitoring area, and convert the real-time video or image from RGB color space to HSV color space to obtain HSV image; wherein the real-time video or image includes ordinary video or image and thermal imaging video or image;

[0012] The HSV image is subjected to image segmentation using a regional feature clustering algorithm, and the pixel set to which each pixel point in the HSV image belongs is determined based on the color features in the HSV image and a corresponding table of a plurality of preset color feature clustering ranges and pixel sets;

[0013] Calculating the sample entropy value of each pixel set based on the K-Means clustering algorithm, and judging the sample entropy value according to a preset entropy value threshold;

[0014] When a sample entropy value corresponding to a certain pixel set is greater than the entropy value threshold, it is determined that there is a fire situation in the HSV image, and the positions of all pixel points in the pixel set whose corresponding sample entropy values ​​are greater than the entropy value threshold in the HSV image are determined as flame spread positions;

[0015] After determining that there is a fire situation in the HSV image, determine the acquisition device of the real-time video or image corresponding to the HSV image, and determine that the location of the acquisition device is the fire location.

[0016] Preferably, the automatic fire prevention measures include:

[0017] When the fire area in the real-time video or image reaches a preset area threshold, all partition doors or fire curtains within a preset third range around the fire location are closed;

[0018] All automatic fire-fighting water monitors within the preset fourth range around the fire location are called to spray water in the direction of the fire location.

[0019] Preferably, the step of determining a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieving on-site data collected by each fire monitoring device, and judging the fire status according to the on-site data comprises:

[0020] After determining the fire location, determining to enable multiple fire monitoring devices that are distributed and arranged within a first range preset around the fire location as the sphere center according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor;

[0021] Retrieving on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or images, on-site temperature, on-site humidity, on-site smoke density, and the straight-line distance between the fire location and each fire monitoring device;

[0022] Determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene;

[0023] When a monitoring device is inside a fire scene, a fan-shaped area with a preset angle and a preset radius extending outward from the fire location toward the monitoring device is used as the activation area, and multiple fire monitoring devices in the activation area are activated for fire monitoring;

[0024] The area surrounded by all the outermost fire monitoring devices enabled around the current fire location is determined as the fire area, and the fire status is determined based on the fire area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices.

[0025] Preferably, the straight-line distance between the fire location and each fire monitoring device is obtained by:

[0026] Determine the fire area in the image based on the on-site video or image collected by a fire monitoring device, divide the fire area into blocks, and take the geometric center point of each block as the fire point;

[0027] Determine the distance measurement direction of the distance measurement sensor according to the position of the fire point in the image, and use the distance measurement sensor to align and measure the straight-line distance between each fire point and the fire monitoring device;

[0028] The straight-line distances between the positions of the multiple fire points and the fire monitoring device obtained according to the measurement results are averaged and calculated to obtain the straight-line distance between the fire position and the fire monitoring device.

[0029] Preferably, the determining of the firefighting forces existing within a preset second range around the fire location, and determining the firefighting forces lacking at the fire location according to the fire status and requesting the fire station to call includes:

[0030] Determine the firefighting force existing within a preset second range with the fire location as the center, wherein the firefighting force includes the number of available fire hydrants, the amount of water stored in multiple water storage points connected to multiple existing firefighting pipelines, and the type and number of firefighting equipment;

[0031] Determine the fire affected area, fire height, fire temperature, fire humidity and smoke density according to the fire status;

[0032] Determine the amount of water needed to extinguish the fire based on the fire-affected area and fire height. When the amount of water stored in the preset second range around the fire location is lower than the amount of water needed to extinguish the fire, carry the corresponding volume of firefighting water from the fire station based on the amount of water missing.

[0033] When the water shortage is greater than the preset water volume threshold, the locations of all water intake points of civil water pipes within the preset second range with the fire location as the center are sent to the fire truck terminal for display;

[0034] Based on the fire location, fire temperature, fire humidity and smoke concentration, the special fire-fighting equipment required by firefighters is determined and sent to the mobile terminal carried by the firefighters for display.

[0035] Preferably, it also includes:

[0036] Obtain real-time thermal imaging video around the fire location, identify and track the human features in the video, determine the escape route of the human body around the fire scene, and count the locations of the people who have not been evacuated within the fire scene;

[0037] Obtain the location information of firefighters at the fire scene, and share the locations of non-evacuated personnel and firefighters through the transparent display glasses installed in the fire suits;

[0038] The vital sign data of the firefighters are obtained through sensors installed in the firefighter suits, the vital sign data including the internal temperature of each part of the firefighter suits, the body temperature, heart rate, respiratory rate, and oxygen content in the oxygen cylinder of the firefighters, and a vital sign monitoring table for each firefighter is established through the vital sign data;

[0039] According to the location information of the firefighters in the fire scene, determine the first time it takes for the firefighters to evacuate from the fire scene;

[0040] Predicting the predicted value of the firefighter's vital sign data after the first time according to the change rule of each vital sign data in the vital sign monitoring table;

[0041] The predicted values ​​are respectively compared with the data in the preset dangerous critical signs table, and whether the firefighter is in a dangerous state is determined according to the comparison results;

[0042] When it is determined that the firefighters are in a dangerous state, an alarm message is sent out through the alarm device installed in the fire suit.

[0043] Preferably, it also includes:

[0044] After confirming that a fire has occurred, obtaining location information of all vehicles around the fire location;

[0045] According to the location information of each vehicle, determine whether the vehicle is in the fire passage;

[0046] If the vehicle is in the fire lane, a warning to move the vehicle will be sent to the owner of the vehicle according to the phone number bound to the vehicle;

[0047] The vehicle authentication command sent by the vehicle owner at the terminal is obtained, and the vehicle moving authentication command is sent to the main control computer of the fire truck for display; wherein the vehicle authentication command is a voice command.

[0048] To achieve the above object, the present invention also provides a fire safety monitoring system based on the Internet of Things, comprising:

[0049] The acquisition and analysis module is used to collect and analyze real-time video or images of the target area to determine whether a fire has occurred. If a fire has occurred, the fire location is determined and automatic fire prevention measures are initiated;

[0050] A data judgment module is used to determine a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieve the on-site data collected by each fire monitoring device, and judge the fire status according to the on-site data;

[0051] The calling module is used to determine the fire fighting forces existing within a preset second range around the fire location, and determine the fire fighting forces lacking at the fire location according to the fire status and request the fire station to call them.

[0052] Preferably, the data judgment module includes:

[0053] a monitoring device determining unit, configured to determine, after determining the fire location, to enable a plurality of fire monitoring devices that are distributed and arranged within a first range preset around the fire location as the sphere center according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor;

[0054] A data retrieval unit, used to retrieve the on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or image, on-site temperature, on-site humidity, on-site smoke concentration, and the straight-line distance between the fire location and each fire monitoring device;

[0055] A distance judgment unit is used to determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene;

[0056] The device activation unit is used to activate fire monitoring for multiple fire monitoring devices in the activation area, using a fan-shaped area with a preset angle and a preset radius extending outward from the fire position to the monitoring device as the activation area when a monitoring device is inside the fire scene;

[0057] The fire situation judgment unit is used to determine that the area surrounded by all the outermost fire monitoring devices enabled around the current fire location is the fire scene area, and to determine the fire situation based on the fire scene area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0059] Figure 1 A flowchart of the steps of a fire safety monitoring method based on the Internet of Things proposed by the present invention;

[0060] Figure 2 A flowchart of the steps of analyzing real-time video or image in a fire safety monitoring method based on the Internet of Things proposed by the present invention;

[0061] Figure 3 This is a structural schematic diagram of a fire safety monitoring system based on the Internet of Things proposed by the present invention. DETAILED DESCRIPTION

[0062] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0063] The present invention provides the following technical solutions: a fire safety monitoring method based on the Internet of Things, such as Figure 1 ,include:

[0064] Step S1, collecting real-time video or images of the monitoring target area and analyzing them to determine whether a fire situation occurs, and if a fire situation occurs, determining the fire location and initiating automatic fire prevention measures;

[0065] Step S2, determining a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieving the on-site data collected by each fire monitoring device, and determining the fire status according to the on-site data;

[0066] Step S3: determine the firefighting forces existing within a preset second range around the fire location, and determine the firefighting forces lacking at the fire location according to the fire status and request the fire station to call them.

[0067] The working principle and beneficial effects of the above technical solution are as follows: by collecting and analyzing real-time video or images of the target area for monitoring, determining whether a fire situation occurs in the image, wherein the collected video or image can be an ordinary video or image or a thermal imaging image, determining the fire location and starting automatic fire prevention measures when a fire situation occurs, and the automatic fire prevention measures include isolating the fire scene by controlling partition equipment such as fire curtains, and extinguishing the fire location by controlling fire-fighting water cannons, etc. By determining multiple fire monitoring devices distributedly arranged within a preset first range around the fire location, retrieving the on-site data collected by each fire monitoring device, and judging the fire status according to the on-site data, the fire situation at the fire scene can be quickly judged, the fire area, fire height, on-site temperature and humidity, smoke concentration and composition, etc. at the fire scene can be determined, and firefighters can be conveniently equipped according to the fire status to quickly deploy equipment, and by determining the firefighting forces existing within a preset second range around the fire location, and determining the firefighting forces lacking at the fire location according to the fire status and requesting the fire station to call, the accuracy of the equipment deployment of firefighters can be improved, so that firefighters can quickly determine the type and quantity of equipment to be carried, and improve rescue efficiency. The combination of the above solutions realizes automatic identification and control of the fire scene, rapid determination of the fire situation, and provides reference opinions for the deployment of fire equipment, thereby improving the efficiency of fire fighting.

[0068] In a preferred embodiment, Figure 2 , collect real-time video or images of the target area for monitoring and analyze to determine whether a fire has occurred. If a fire has occurred, determine the location of the fire, including:

[0069] Step S11, obtaining a real-time video or image of the monitored target area, and converting the real-time video or image from the RGB color space to the HSV color space to obtain an HSV image; wherein the real-time video or image includes a common video or image and a thermal imaging video or image;

[0070] Step S12, performing image segmentation on the HSV image using a regional feature clustering algorithm, and determining the pixel set to which each pixel point in the HSV image belongs based on the color features in the HSV image and a corresponding table of multiple preset color feature clustering ranges and pixel sets;

[0071] Step S13, calculating the sample entropy value of each pixel set based on the K-Means clustering algorithm, and judging the sample entropy value according to a preset entropy threshold;

[0072] Step S14: when there is a sample entropy value corresponding to a certain pixel set that is greater than the entropy value threshold, it is determined that there is a fire situation in the HSV image, and the positions of all pixel points in the pixel set whose corresponding sample entropy values ​​are greater than the entropy value threshold in the HSV image are determined as flame spread positions;

[0073] Step S15: After determining that there is a fire situation in the HSV image, determine the acquisition device of the real-time video or image corresponding to the HSV image, and determine that the location of the acquisition device is the fire location.

[0074] The working principle and beneficial effects of the above technical solution are as follows: by converting the collected real-time video or image from the RGB color space to the HSV color space, it is convenient to effectively preserve the hue, brightness and other features in the image, and by using the HSV image, it is convenient to quickly identify specific colors, thereby improving the accuracy and efficiency of image recognition. When recognizing an image, the HSV image is subjected to image segmentation by using a regional feature clustering algorithm, and the pixel set to which each pixel in the HSV image belongs is determined based on the color features in the HSV image based on a corresponding table of multiple preset color feature clustering ranges and pixel sets, thereby achieving color classification of each pixel, which is convenient for subsequent calculations. The sample entropy value of each pixel set is calculated based on the K-Means clustering algorithm to realize cluster analysis of the color features of multiple pixels in the same pixel set, so as to determine the overall state of the pixel color in the pixel set, and judge the sample entropy value according to the preset entropy value threshold; when the sample entropy value corresponding to a certain pixel set is greater than the entropy value threshold, it is determined that there is a fire in the HSV image, and the positions of all pixels in the pixel set whose corresponding sample entropy value is greater than the entropy value threshold in the HSV image are determined as the flame distribution position; after determining that there is a fire in the HSV image, the real-time video or image acquisition device corresponding to the HSV image is determined, and the position of the acquisition device is determined as the fire position, so as to realize the rapid judgment and positioning of the fire through the video image, and determine the specific location of the fire. Further, in order to improve the accuracy of the recognition result, it can be determined whether the sample entropy value corresponding to a certain pixel set belongs to the asymptotically approaching entropy value threshold according to the continuous recognition results of the video image. If so, it means that the flame distribution range is rapidly expanding and the fire scene is in an expanding state, and it is determined that a fire has indeed occurred, thereby preventing the occurrence of false alarms.

[0075] In a preferred embodiment, the automatic fire protection measures include:

[0076] When the fire area in the real-time video or image reaches a preset area threshold, all partition doors or fire curtains within a preset third range around the fire location are closed;

[0077] All automatic fire-fighting water monitors within the preset fourth range around the fire location are called to spray water in the direction of the fire location.

[0078] The working principle and beneficial effects of the above technical solution are as follows: when automatic fire prevention is performed, by judging the fire area, when the fire area reaches the preset area threshold, it indicates that there is a risk of fire expansion, then all partition doors or fire curtains within the preset third range around the fire location are closed, wherein all existing partition doors or fire curtains are provided with a manual mode, even if the trapped personnel are locked inside the fire scene, they can easily lift the partition door or fire curtain to escape; at the same time, all automatic fire-fighting water cannons within the preset fourth range around the fire location are called to spray water in the direction of the fire location. Thus, automatic and rapid control of the fire scene is achieved, which is more responsive than the manually controlled fire prevention and control method.

[0079] In a preferred embodiment, determining a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieving the field data collected by each fire monitoring device, and judging the fire status according to the field data includes:

[0080] After the fire location is determined, based on the position coordinates of each fire monitoring device in a preset spatial coordinate system, determining to enable multiple fire monitoring devices that are distributed and arranged within a first range preset around the fire location as the sphere center, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor;

[0081] Retrieving the on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or images, on-site temperature, on-site humidity, on-site smoke density, and the straight-line distance between the fire location and each fire monitoring device;

[0082] Determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene;

[0083] When a monitoring device is inside a fire scene, a fan-shaped area with a preset angle and a preset radius extending outward from the fire location toward the monitoring device is used as the activation area, and multiple fire monitoring devices in the activation area are activated for fire monitoring;

[0084] The area surrounded by all the outermost fire monitoring devices enabled around the current fire location is determined as the fire area, and the fire status is determined based on the fire area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices.

[0085] The working principle and beneficial effects of the above technical solution are as follows: when judging the fire situation at the fire scene, by determining to enable multiple fire monitoring devices distributedly arranged within a first range preset around the fire location as the sphere center according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, wherein the fire monitoring device includes a thermal imaging camera or an ordinary camera, a temperature sensor, a humidity sensor, a smoke alarm and a ranging sensor, so as to detect various important data at the fire scene and facilitate the fire situation judgment; retrieve the field data collected by each fire monitoring device, wherein the field data includes field video or image, field temperature, field humidity, field smoke concentration and the straight-line distance between the fire location and each fire monitoring device; determine whether the straight-line distance between the fire location and each fire monitoring device is greater than the preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene. After determining that the fire monitoring device is inside the fire scene, When a fire monitoring device is lost inside the fire scene or after a fire occurs, it indicates that the scope of the fire scene has expanded and the scope of the fire needs to be re-identified. When a monitoring device is inside the fire scene or loses connection, a fan-shaped area with a preset angle and a preset radius extending outward from the fire location toward the monitoring device is used as the starting area, and fire monitoring is enabled for multiple fire monitoring devices within the starting area. This enables rapid activation of peripheral fire monitoring devices and tracking and judgment of the fire status at the fire scene (avoiding the problem that the existing monitoring equipment cannot flexibly and automatically call peripheral equipment to further track and judge the internal fire situation after the fire situation expands and the equipment is damaged, and the response is not fast enough). The area surrounded by all the outermost fire monitoring devices enabled around the current fire location is determined as the fire scene area, and the fire status is determined based on the fire scene area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring equipment. This enables flexible calculation and judgment of the fire area, flexible switching of the position of fire monitoring equipment, and ensures the accuracy of the data collected by the fire monitoring equipment. (Because the data collected by fire monitoring equipment at different distances from the fire scene is different, the data collected by fire monitoring equipment 3 meters away and 20 meters away from the fire scene cannot be judged together, so it is necessary to migrate the selected position of the fire monitoring equipment to obtain the on-site data of the fire monitoring equipment at the same distance for judgment).

[0086] In a preferred embodiment, the fire situation can be scored and calculated based on the on-site data of the fire scene. When performing the scoring calculation, a weighted calculation can be performed by determining a preset weight coefficient for each data. The calculation formula is as follows:

[0087]

[0088] In the formula, P represents the scoring result, n represents the number of field data types involved in the scoring, and Q i Indicates the preset weight corresponding to the i-th field data, K i shows the data parameters of the i-th field data, K i，0 Represents the standard data parameters of the i-th field data.

[0089] The working principle and beneficial effects of the above technical solution are: scoring the fire situation through weighted evaluation, so that firefighters can intuitively and quickly determine the emergency status of the fire.

[0090] In a preferred embodiment, the straight-line distance between the fire location and each fire monitoring device is obtained by:

[0091] Determine the fire area in the image based on the on-site video or image collected by a fire monitoring device, divide the fire area into blocks, and take the geometric center point of each block as the fire point;

[0092] Determine the distance measurement direction of the distance measurement sensor according to the position of the fire point in the image, and use the distance measurement sensor to align and measure the straight-line distance between each fire point and the fire monitoring device;

[0093] The straight-line distances between the positions of the multiple fire points and the fire monitoring device obtained according to the measurement results are averaged and calculated to obtain the straight-line distance between the fire position and the fire monitoring device.

[0094] The working principle and beneficial effects of the above technical solution are as follows: when determining the straight-line distance between the fire position and each fire monitoring device, it is necessary to determine the fire area in the image based on the on-site video or image collected by a certain fire monitoring device, divide the fire area into blocks, and take the geometric center point of each block as the fire point; determine the distance measurement direction of the distance measurement sensor according to the position of the fire point in the image, and use the distance measurement sensor to align and measure the straight-line distance between each fire point position and the fire monitoring device; according to the straight-line distances between the multiple fire point positions and the fire monitoring device obtained by the measurement results, the straight-line distance between the fire position and the fire monitoring device is obtained by averaging. In this way, the distance measurement of multiple fire points in the image is realized, so as to determine the distribution state of the fire points relative to the fire monitoring device, and determine the straight-line distance between the overall fire position and the fire monitoring device by averaging.

[0095] In a preferred embodiment, determining the fire fighting forces existing within a preset second range around the fire location, and determining the fire fighting forces lacking at the fire location according to the fire status and requesting the fire station to call includes:

[0096] Determine the firefighting force existing within a preset second range with the fire location as the center, wherein the firefighting force includes the number of available fire hydrants, the amount of water stored in multiple water storage points connected to multiple existing firefighting pipelines, and the type and number of firefighting equipment;

[0097] Determine the fire-affected area, fire height, fire temperature, fire humidity and smoke density according to the fire status;

[0098] Determine the amount of water required for firefighting based on the fire-affected area and fire height. When the amount of water stored in the preset second range around the fire location is lower than the amount of water required for firefighting, carry the corresponding volume of firefighting water from the fire station based on the amount of water shortage.

[0099] When the water shortage is greater than the preset water volume threshold, the locations of all water intake points of civil water pipes within the preset second range with the fire location as the center are sent to the fire truck terminal for display;

[0100] Based on the fire location, fire temperature, fire humidity and smoke concentration, the special fire-fighting equipment required by firefighters is determined and sent to the mobile terminal carried by the firefighters for display.

[0101] The working principle and beneficial effects of the above technical solution are as follows: by determining the firefighting force existing within a preset second range with the fire location as the center, wherein the firefighting force includes the number of available fire hydrants, the amount of water stored in multiple water storage points connected to the existing multiple fire-fighting pipes, and the type and number of fire-fighting equipment, the statistics of the firefighting force that can be quickly mobilized around the fire scene are realized; according to the fire status, the fire-affected area, the fire height, the fire temperature, the fire humidity and the smoke concentration are determined to realize the judgment and intuitive display of the situation at the fire scene; according to the fire-affected area and the fire height, the flame volume is roughly determined by using a calculation formula similar to the cone volume (flame volume = fire-affected area × fire height × 1 / 3), so as to determine the amount of water required for fire extinguishing according to the flame volume. When the amount of water stored in the preset second range around the fire location is lower than the amount of water required for fire extinguishing, the fire station will carry the corresponding volume of fire water according to the amount of water shortage; when the amount of water shortage is greater than the preset water threshold, all the locations of civil water pipe water intake points within the preset second range with the fire location as the center will be sent to the fire truck terminal for display; according to the fire location, fire scene temperature, fire scene humidity and smoke concentration, the special fire extinguishing equipment required by the firefighters will be determined and sent to the mobile terminal carried by the firefighters for display, such as when the fire location is in a high-rise building, it is necessary to select a high-rise fire extinguishing fire truck, when the temperature reaches a certain height, it is necessary to equip a fire mask to prevent the firefighters from getting facial burns when spraying water from a distance, and when there is a lot of smoke at the fire scene, it is necessary to carry a gas mask, etc. In this way, the calculation of the missing firefighting force is realized, which facilitates the firefighters to determine which equipment to carry, thereby improving the efficiency of firefighting.

[0102] In a preferred embodiment, it also includes:

[0103] Obtain real-time thermal imaging video around the fire location, identify and track the human features in the video, determine the escape route of the human body around the fire scene, and count the locations of the people who have not been evacuated within the fire scene;

[0104] Obtain the location information of firefighters at the fire scene, and share the locations of non-evacuated personnel and firefighters through the transparent display glasses installed in the fire suits;

[0105] The sensors installed in the fire suits are used to obtain the firefighters' vital signs data, including the internal temperature of each part of the fire suit, the firefighters' body temperature, heart rate, respiratory rate, and oxygen content in the oxygen cylinder. A vital signs monitoring table for each firefighter is established based on the vital signs data.

[0106] According to the location information of the firefighters in the fire scene, determine the first time it takes for the firefighters to evacuate from the fire scene;

[0107] According to the changing rules of each vital sign data in the vital sign monitoring table, the predicted value of the vital sign data of the firefighters after the first time has passed is predicted;

[0108] The predicted values ​​are compared with the data in the preset dangerous critical signs table, and whether the firefighters are in a dangerous state is determined according to the comparison results;

[0109] When it is determined that the firefighters are in a dangerous state, an alarm message is sent out through the alarm device installed in the fire suit.

[0110] The working principle and beneficial effects of the above technical solution are as follows: by acquiring real-time thermal imaging video around the fire location, determining and tracking the human features in the video, determining the escape route of the human body around the fire scene, and counting the locations of the unevacuated people within the fire scene; obtaining the location information of the firefighters in the fire scene, and sharing the locations of the unevacuated people and the firefighters through the transparent display glasses set in the fire suits, so that the firefighters can determine the specific locations of the unevacuated people within the fire scene, which is convenient for the search and rescue work to be completed quickly, and the location identification between the firefighters is facilitated by sharing the locations between the firefighters; obtaining the vital signs data of the firefighters through the sensors set in the fire suits, the vital signs data include the internal temperature of each part of the fire suit, the body temperature, heart rate, respiratory rate, and oxygen content in the oxygen cylinder of the firefighters, and establishing a vital signs monitoring table for each firefighter through the vital signs data; According to the position information of the firefighters in the fire scene, the first time required for the firefighters to evacuate from the fire scene is determined; according to the change law of each vital sign data in the vital sign monitoring table, the predicted value of the firefighters' vital sign data after the first time is predicted, so as to realize the prediction and judgment of the firefighters' vital sign data; the predicted values ​​are respectively compared with the data in the preset dangerous critical vital sign table, and whether the firefighters are in a dangerous state is judged according to the comparison results, so as to realize the judgment of the firefighters' current state. When the internal temperature of the firefighters' fire suits rises sharply and the firefighters are deep in the fire scene, it is predicted whether the internal temperature of the fire suits reaches a dangerous temperature before the firefighters leave the fire scene; when it is determined that the firefighters are in a dangerous state, an alarm message is sent through the alarm device installed in the fire suits to remind the firefighters not to continue to go deeper into the fire scene, so as to further ensure the life safety of the firefighters.

[0111] In a preferred embodiment, it also includes:

[0112] After confirming that a fire has occurred, obtaining location information of all vehicles around the fire location;

[0113] According to the location information of each vehicle, determine whether the vehicle is in the fire passage;

[0114] If the vehicle is in the fire lane, a warning to move the vehicle will be sent to the owner of the vehicle according to the phone number bound to the vehicle;

[0115] The vehicle authentication command sent by the vehicle owner at the terminal is obtained, and the vehicle moving authentication command is sent to the main control computer of the fire truck for display; wherein the vehicle authentication command is a voice command.

[0116] The working principle and beneficial effects of the above technical solution are as follows: after determining that a fire has occurred, the location information of all vehicles around the location of the fire is obtained; based on the location information of each vehicle, it is determined whether the vehicle is in a fire passage; if the vehicle is in a fire passage, a vehicle-moving warning is issued to the owner of the vehicle based on the telephone number bound to the vehicle, so that the owner in the fire passage can quickly move the vehicle out of the way before the fire truck arrives; the vehicle authentication instruction sent by the owner at the terminal is obtained, and the vehicle-moving authentication instruction is sent to the main control computer of the fire truck for display; wherein the vehicle authentication instruction is a voice command, and when the owner is unable to return in time due to being in a different place, a vehicle authentication instruction acquisition request is sent to the owner, allowing the owner to send the authentication instruction set on the vehicle, such as a voice command, and control the vehicle to open by voice, so that the firefighters can drive the vehicle away.

[0117] To achieve the above object, the present invention also provides a fire safety monitoring system based on the Internet of Things, such as Figure 3 ,include:

[0118] Collection and analysis module 1, used to collect real-time video or images of the monitoring target area and analyze them to determine whether a fire situation occurs. If a fire situation occurs, determine the fire location and initiate automatic fire prevention measures;

[0119] The data judgment module 2 is used to determine a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieve the field data collected by each fire monitoring device, and judge the fire status according to the field data;

[0120] The calling module 3 is used to determine the fire fighting forces existing in a preset second range around the fire location, and determine the fire fighting forces lacking at the fire location according to the fire status and request the fire station to call them.

[0121] The working principle and beneficial effects of the above technical solution are as follows: the real-time video or image of the monitored target area is collected and analyzed by the collection and analysis module 1 to determine whether a fire occurs in the image, wherein the collected video or image can be an ordinary video or image or a thermal imaging image. When a fire occurs, the fire location is determined and automatic fire prevention measures are initiated. The automatic fire prevention measures include isolating the fire scene by controlling partition equipment such as fire curtains, and extinguishing the fire location by controlling fire-fighting water cannons. The data judgment module 2 determines the multiple fire monitoring devices distributed within the preset first range around the fire location, retrieves the field data collected by each fire monitoring device, and judges the fire status based on the field data, so as to quickly judge the fire situation at the fire scene, determine the fire area, fire height, field temperature and humidity, smoke concentration and composition, etc. at the fire scene, and facilitate firefighters to quickly deploy equipment according to the fire status. The request calling module 3 determines the firefighting forces within the preset second range around the fire location, and determines the firefighting forces lacking at the fire location according to the fire status and requests the fire station to call, thereby improving the accuracy of the firefighting personnel's equipment deployment, enabling firefighters to quickly determine the type and quantity of equipment they need to carry, and improving the rescue efficiency. The combination of the above schemes realizes automatic identification and control processing of the fire scene, realizes rapid determination of the fire situation, and provides reference opinions for the deployment of firefighting equipment, thereby improving the efficiency of fire fighting.

[0122] In a preferred embodiment, the data judgment module includes:

[0123] a monitoring device determining unit, configured to determine, after determining the fire location, to enable, according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, a plurality of fire monitoring devices that are distributedly arranged within a first range preset around the fire location as the sphere center, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor;

[0124] A data retrieval unit, used to retrieve the on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or image, on-site temperature, on-site humidity, on-site smoke concentration, and the straight-line distance between the fire location and each fire monitoring device;

[0125] A distance judgment unit is used to determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene;

[0126] The device activation unit is used to activate fire monitoring for multiple fire monitoring devices in the activation area, using a fan-shaped area with a preset angle and a preset radius extending outward from the fire position to the monitoring device as the activation area when a monitoring device is inside the fire scene;

[0127] The fire situation judgment unit is used to determine that the area surrounded by all the outermost fire monitoring devices enabled around the current fire location is the fire scene area, and to determine the fire situation based on the fire scene area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices.

[0128] The working principle and beneficial effects of the above technical solution are as follows: a monitoring device determination unit is used to determine, based on the position coordinates of each fire monitoring device in a preset spatial coordinate system, to enable multiple fire monitoring devices that are distributedly arranged within a preset first range around the fire location as the sphere center, wherein the fire monitoring devices include thermal imaging cameras or ordinary cameras, temperature sensors, humidity sensors, smoke alarms, and ranging sensors, so as to detect various important data at the fire scene and facilitate fire status judgment; a data retrieval unit is used to retrieve the on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or images, on-site temperature, on-site humidity, on-site smoke concentration, and the straight-line distance between the fire location and each fire monitoring device; a distance judgment unit is used to determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene. After determining that the fire monitoring device is inside the fire scene When a fire monitoring device is disconnected or after a fire occurs, it indicates that the scope of the fire scene has expanded and the scope of the fire needs to be re-identified; the device activation unit determines that when a monitoring device is inside the fire scene or loses connection, a fan-shaped area with a preset angle and a preset radius extending outward from the fire location to the monitoring device is used as the activation area, and fire monitoring is activated for multiple fire monitoring devices in the activation area; thereby, the peripheral fire monitoring devices are quickly activated, and the fire status of the fire scene is tracked and judged (avoiding the problem that the existing monitoring equipment cannot flexibly and automatically call the peripheral equipment to further track and judge the internal fire situation after the fire situation expands and the equipment is damaged, and the response is not fast enough), the fire situation judgment unit determines that the area surrounded by all the outermost fire monitoring devices activated around the current fire location is the fire scene area, and the fire status is determined according to the fire scene area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring equipment. This enables flexible calculation and judgment of the fire area, flexible switching of the position of fire monitoring equipment, and ensures the accuracy of the data collected by the fire monitoring equipment. (Because the data collected by fire monitoring equipment at different distances from the fire scene is different, the data collected by fire monitoring equipment 3 meters away and 20 meters away from the fire scene cannot be judged together, so it is necessary to migrate the selected position of the fire monitoring equipment to obtain the on-site data of the fire monitoring equipment at the same distance for judgment).

[0129] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A fire safety monitoring method based on the Internet of Things, characterized in that: include: Collect and analyze real-time video or images of the target area to determine whether a fire has occurred. If a fire has occurred, locate the fire and initiate automatic fire prevention measures. Determine a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieve the on-site data collected by each fire monitoring device, and determine the fire status according to the on-site data; The firefighting forces existing within a preset second range around the fire location are determined, and the firefighting forces lacking at the fire location are determined according to the fire status and requested to be called by the fire station.

2. A fire safety monitoring method based on the Internet of Things according to claim 1, characterized in that: The collecting and analyzing of real-time video or images of the target area to determine whether a fire occurs and determining the location of the fire when a fire occurs includes: Acquire real-time video or image of the target monitoring area, and convert the real-time video or image from RGB color space to HSV color space to obtain HSV image; wherein the real-time video or image includes ordinary video or image and thermal imaging video or image; The HSV image is subjected to image segmentation using a regional feature clustering algorithm, and the pixel set to which each pixel point in the HSV image belongs is determined based on the color features in the HSV image and a corresponding table of a plurality of preset color feature clustering ranges and pixel sets; Calculating the sample entropy value of each pixel set based on the K-Means clustering algorithm, and judging the sample entropy value according to a preset entropy value threshold; When a sample entropy value corresponding to a certain pixel set is greater than the entropy value threshold, it is determined that there is a fire situation in the HSV image, and the positions of all pixel points in the pixel set whose corresponding sample entropy values ​​are greater than the entropy value threshold in the HSV image are determined as flame spread positions; After determining that there is a fire situation in the HSV image, determine the acquisition device of the real-time video or image corresponding to the HSV image, and determine that the location of the acquisition device is the fire location.

3. The method for fire safety monitoring based on the Internet of Things according to claim 1, characterized in that: The automatic fire protection measures include: When the fire area in the real-time video or image reaches a preset area threshold, all partition doors or fire curtains within a preset third range around the fire location are closed; All automatic fire-fighting water monitors within the preset fourth range around the fire location are called to spray water in the direction of the fire location.

4. The method for fire safety monitoring based on the Internet of Things according to claim 1, characterized in that: The step of determining a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieving on-site data collected by each fire monitoring device, and judging the fire status according to the on-site data comprises: After determining the fire location, determining to enable multiple fire monitoring devices that are distributed and arranged within a first range preset around the fire location as the sphere center according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor; Retrieving on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or images, on-site temperature, on-site humidity, on-site smoke density, and the straight-line distance between the fire location and each fire monitoring device; Determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene; When a monitoring device is inside a fire scene, a fan-shaped area with a preset angle and a preset radius extending outward from the fire location toward the monitoring device is used as the activation area, and multiple fire monitoring devices in the activation area are activated for fire monitoring; The area surrounded by all the outermost fire monitoring devices enabled around the current fire location is determined as the fire area, and the fire status is determined based on the fire area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices.

5. A fire safety monitoring method based on the Internet of Things according to claim 4, characterized in that: The straight-line distance between the fire location and each fire monitoring device is obtained in the following way: Determine the fire area in the image based on the on-site video or image collected by a fire monitoring device, divide the fire area into blocks, and take the geometric center point of each block as the fire point; Determine the distance measurement direction of the distance measurement sensor according to the position of the fire point in the image, and use the distance measurement sensor to align and measure the straight-line distance between each fire point and the fire monitoring device; The straight-line distances between the positions of the multiple fire points and the fire monitoring device obtained according to the measurement results are averaged and calculated to obtain the straight-line distance between the fire position and the fire monitoring device.

6. The method for fire safety monitoring based on the Internet of Things according to claim 1, characterized in that: The determining of the fire fighting forces existing within a preset second range around the fire location, and determining the fire fighting forces lacking at the fire location according to the fire status and requesting the fire station to call the fire fighting forces comprises: Determine the firefighting force existing within a preset second range with the fire location as the center, wherein the firefighting force includes the number of available fire hydrants, the amount of water stored in multiple water storage points connected to multiple existing firefighting pipelines, and the type and number of firefighting equipment; Determine the fire affected area, fire height, fire temperature, fire humidity and smoke density according to the fire status; Determine the amount of water required for firefighting based on the fire-affected area and fire height. When the amount of water stored in the preset second range around the fire location is lower than the amount of water required for firefighting, carry the corresponding volume of firefighting water from the fire station based on the amount of water shortage. When the water shortage is greater than the preset water volume threshold, the locations of all water intake points of civil water pipes within the preset second range with the fire location as the center are sent to the fire truck terminal for display; Based on the fire location, fire temperature, fire humidity and smoke concentration, the special fire-fighting equipment required by firefighters is determined and sent to the mobile terminal carried by the firefighters for display.

7. The method for fire safety monitoring based on the Internet of Things according to claim 1, characterized in that: Also includes: Obtain real-time thermal imaging video around the fire location, identify and track the human features in the video, determine the escape route of the human body around the fire scene, and count the locations of the people who have not been evacuated within the fire scene; Obtain the location information of firefighters at the fire scene, and share the locations of non-evacuated personnel and firefighters through the transparent display glasses installed in the fire suits; The vital sign data of the firefighters are obtained through sensors installed in the fire suits, the vital sign data including the internal temperature of each part of the fire suits, the body temperature, heart rate, respiratory rate, and oxygen content in the oxygen cylinder of the firefighters, and a vital sign monitoring table for each firefighter is established through the vital sign data; According to the location information of the firefighters in the fire scene, determine the first time it takes for the firefighters to evacuate from the fire scene; Predicting the predicted value of the firefighter's vital sign data after the first time according to the change rule of each vital sign data in the vital sign monitoring table; The predicted values ​​are respectively compared with the data in the preset dangerous critical signs table, and whether the firefighter is in a dangerous state is determined according to the comparison results; When it is determined that the firefighters are in a dangerous state, an alarm message is sent out through the alarm device installed in the fire suit.

8. The method for fire safety monitoring based on the Internet of Things according to claim 1, characterized in that: Also includes: After confirming that a fire has occurred, obtaining location information of all vehicles around the fire location; According to the location information of each vehicle, determine whether the vehicle is in the fire passage; If the vehicle is in the fire lane, a warning to move the vehicle will be sent to the owner of the vehicle according to the phone number bound to the vehicle; The vehicle authentication command sent by the vehicle owner at the terminal is obtained, and the vehicle moving authentication command is sent to the main control computer of the fire truck for display; wherein the vehicle authentication command is a voice command.

9. A fire safety monitoring system based on the Internet of Things, characterized in that: include: The acquisition and analysis module is used to collect and analyze real-time video or images of the target area to determine whether a fire has occurred. If a fire has occurred, the fire location is determined and automatic fire prevention measures are initiated; A data judgment module is used to determine a plurality of fire monitoring devices that are distributed and arranged within a preset first range around the fire location, retrieve the on-site data collected by each fire monitoring device, and judge the fire status according to the on-site data; The calling module is used to determine the fire fighting forces existing within a preset second range around the fire location, and determine the fire fighting forces lacking at the fire location according to the fire status and request the fire station to call them.

10. The fire safety monitoring system based on the Internet of Things according to claim 9, characterized in that: The data judgment module comprises: a monitoring device determining unit, configured to determine, after determining the fire location, to enable a plurality of fire monitoring devices that are distributed and arranged within a first range preset around the fire location as the sphere center according to the position coordinates of each fire monitoring device in a preset spatial coordinate system, wherein the fire monitoring devices include a thermal imaging camera or a common camera, a temperature sensor, a humidity sensor, a smoke alarm, and a distance measuring sensor; A data retrieval unit, used to retrieve the on-site data collected by each fire monitoring device, wherein the on-site data includes on-site video or image, on-site temperature, on-site humidity, on-site smoke concentration, and the straight-line distance between the fire location and each fire monitoring device; A distance judgment unit is used to determine whether the straight-line distance between the fire location and each fire monitoring device is greater than a preset safety distance. If it is not greater than the preset safety distance, it is determined that the fire monitoring device is inside the fire scene; The device activation unit is used to activate fire monitoring for multiple fire monitoring devices in the activation area, using a fan-shaped area with a preset angle and a preset radius extending outward from the fire position to the monitoring device as the activation area when a monitoring device is inside the fire scene; The fire situation judgment unit is used to determine that the area surrounded by all the outermost fire monitoring devices enabled around the current fire location is the fire scene area, and to determine the fire situation based on the fire scene area, the on-site temperature, on-site humidity and on-site smoke concentration collected by the outermost fire monitoring devices.

Images