Fire Detection Systems

The fire detection system uses a surveillance camera and neural network to estimate fire probability in high-ceilinged spaces, addressing delayed detection by traditional methods and enabling early fire recognition.

JP7580939B2Active Publication Date: 2024-11-12NIPPON DRY CHEM CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2020077122
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-04-24
Publication Date
2024-11-12
Estimated Expiration
2040-04-24

AI Technical Summary

Technical Problem

Fire detectors installed on ceilings or walls in high-ceilinged spaces, such as buildings with atriums, take longer to detect fires near the floor surface due to their distance from the fire, leading to delayed detection.

Method used

A fire detection system utilizing a surveillance camera and a neural network to estimate the probability of combustion flames based on image recognition, outputting a fire estimation signal when the probability exceeds a threshold, and a fire transfer signal when either the fire detector or estimation signal indicates a fire.

Benefits of technology

Enables early detection of fires in high-ceilinged spaces by recognizing combustion flame fluctuations through image analysis, even when traditional fire detectors are delayed, thereby reducing response time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580939000001
    Figure 0007580939000001
  • Figure 0007580939000002
    Figure 0007580939000002
  • Figure 0007580939000003
    Figure 0007580939000003
Patent Text Reader

Abstract

To provide a fire detection system that enables early fire detection in high ceiling spaces through a configuration that uses neural networks to improve fire detection accuracy.SOLUTION: In a fire detection system 1, a monitoring device 19 compares a fire probability value estimated by image recognition of a video image from a monitoring camera 13 with a fire threshold value, which is the criteria for determining the occurrence of a fire in a space 7 of a high ceiling section 3 and a low ceiling section 5. If the fire probability value is greater than or equal to the fire threshold value, the monitoring device outputs a fire estimation signal to a receiver 15, assuming that there is a high possibility that a fire is occurring, even if a fire detector 11 has not output a fire detection signal. When receiving the fire estimation signal, the receiver outputs a fire transfer signal to a transfer destination even before receiving the fire detection signal from the fire detector in the same space. This enables early fire detection in high ceiling spaces, even when fire detectors installed in space of high ceilings or high locations take a long time to detect infrared rays of a specific wavelength caused by a fire.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a fire detection system. [Background technology]

[0002] High-ceiling spaces are often found in buildings, exhibition halls, arenas, etc. that have spaces spanning multiple floors. Examples of spaces spanning multiple floors include atriums (internal public open spaces) and stairwells. Regarding fire detectors that detect fires in high-ceiling spaces, Patent Document 1 describes that they are installed on the ceiling or walls. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-194826 A Summary of the Invention [Problem to be solved by the invention]

[0004] In high-ceiling spaces, fire detectors installed on the ceiling or walls may be placed farther away from the floor than in normal buildings. Therefore, when a fire occurs near the floor, it may take longer for the fire detector to detect the fire using heat, smoke, brightness temperature, infrared rays, etc. than it does for fire detectors in normal buildings.

[0005] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to enable early fire detection in a high-ceiling space. [Means for solving the problem]

[0006] In order to achieve the above object, a fire detection system according to one aspect of the present invention comprises: an estimation unit that estimates the probability that a combustion flame exists in an indoor space based on an image recognition result of a neural network for an image of the indoor space in a high ceiling area where the ceiling height is higher than that of a low ceiling area; a notification unit that outputs a fire prediction signal when the probability becomes equal to or exceeds a fire threshold that is a criterion for determining whether a fire has occurred; Equipped with. Effect of the Invention

[0007] According to the present invention, early fire detection in a high ceiling space is possible. [Brief description of the drawings]

[0008] [Figure 1] 1 is an explanatory diagram showing a schematic configuration of a fire detection system according to an embodiment; [Diagram 2] 2 is a block diagram showing the electrical configuration of the monitoring device of FIG. 1. [Diagram 3] 3 is a flowchart showing a procedure of processing performed by a pre-processing unit in FIG. 2; [Figure 4] 2. (a) is an explanatory diagram showing the RGB color space of the image signals output by each surveillance camera in FIG. 1, and (b) is an explanatory diagram showing the HSV color space of each image signal converted by the pre-processing unit in FIG. [Diagram 5] 2A is an explanatory diagram showing an original image of a monitoring area based on an image signal output by the monitoring camera of FIG. 1, and FIG. 2B is an explanatory diagram showing a mask image obtained by binarizing the original image. [Figure 6] FIG. 5(a) is an explanatory diagram showing the maximum and minimum values ​​of the XY coordinates identified for the portion corresponding to the combustion flame in the mask image of FIG. 5(b), and FIG. 5(b) is an explanatory diagram showing a rectangular region circumscribing the combustion flame portion set from the XY coordinate values ​​of FIG. [Figure 7] 3 is a flowchart showing a procedure of a process performed by a fire estimation unit virtually constructed on the monitoring device of FIG. 2. [Figure 8] 3 is an explanatory diagram illustrating a schematic procedure of a process for extracting characteristics of a combustion flame performed by a fire estimation unit in FIG. 2. [Figure 9]3 is an explanatory diagram showing a neural network used by the fire estimation unit in FIG. 2 to estimate the probability of the existence of a combustion flame. FIG. [Figure 10] 5(a) and (b) are explanatory diagrams showing the fluctuating combustion flames present in the original image of FIG. 5(a), and (c) is an explanatory diagram showing the shape change due to the fluctuating combustion flames of (a) and (b). [Figure 11] FIG. 10 is an explanatory diagram showing the configuration of a long-short-term memory unit network used in the rear stage of the intermediate layer of the neural network of FIG. [Figure 12] 3 is a flowchart showing a procedure of a process performed by a learning processing unit in FIG. 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The same or equivalent parts and components are designated by the same or equivalent reference numerals throughout the drawings. However, it should be noted that the drawings are schematic and may differ from the actual ones. In addition, the drawings may of course include parts with different dimensional relationships and ratios.

[0010] The embodiments described below are merely examples of devices for embodying the technical idea of ​​the present invention, and the technical idea of ​​the present invention does not limit the materials, shapes, structures, arrangements, etc. of each component to those described below. The technical idea of ​​the present invention can be modified in various ways within the scope of the claims.

[0011] The fire detection system 1 of this embodiment shown in FIG. 1 detects the outbreak of a fire caused by a combustion flame in an indoor space 7 of a building having a high ceiling section 3 and a low ceiling section 5.

[0012] The high ceiling section 3 can be installed, for example, in the entrance section of a building. The space 7 of the high ceiling section 3 spans multiple floors of the building, and the ceiling height of the high ceiling section 3 is higher than the ceiling height of the low ceiling section 5 in which the space 7 is divided for each floor.

[0013] The fire detection system 1 detects the occurrence of a fire in each of the alert zones, each of which is a space with a certain area or less. In the fire detection system 1 of this embodiment, in order to detect a fire in each of the spaces 7 in the high ceiling section 3 and the low ceiling section 5, each of which corresponds to a single alert zone, a fire detector 11 and a surveillance camera 13 are disposed in each of the spaces 7.

[0014] Furthermore, the fire detection system 1 has a receiver 15, a monitor panel 17, a monitoring device 19, and a display panel 21 disposed in the management office 9 in the building, in addition to the fire detectors 11 and surveillance cameras 13 in each space 7. The display panel 21 has a message display section (not shown). The message display section can display, for example, the status of fire detection by the fire detection system 1.

[0015] In this embodiment, the automatic fire alarm system can be configured by a known automatic fire alarm system consisting of at least the fire detector 11, the receiver 15, transmitters of other devices, indicator lights, and local sound devices (none of which are shown), the surveillance camera 13, the monitor panel 17, and the display panel 21. The receiver 15, the monitor panel 17, the monitoring device 19, and the display panel 21 can each be configured as an independent device. Alternatively, some or all of the receiver 15, the monitor panel 17, the monitoring device 19, and the display panel 21 can be configured as a single device.

[0016] Each fire detector 11 detects a fire in each space 7 of the high ceiling section 3 and the low ceiling section 5. According to the installation standards for automatic fire alarm systems, if the fire detector 11 is a flame detector, it is required to be installed so that it can monitor each part of the warning area at a height of 1.2 m from the floor. If the fire detector 11 is a spot-type heat detector or smoke detector, it is required to be installed so that it can monitor the floor. Therefore, each fire detector 11 can be installed on the ceiling or a wall near the ceiling of each space 7 that meets the above-mentioned installation standards. Also, the fire detector 11 can be of a type that detects a fire by detecting infrared rays of a specific wavelength emitted by a combustion flame through carbon dioxide resonance radiation, and outputs a fire detection signal.

[0017] The wavelength of infrared rays detected by the fire detector 11 may be, for example, on the order of 4 μm. Infrared rays with wavelengths on the order of 4 μm are generally known as infrared rays emitted by combustion flames through carbon dioxide resonance radiation. The fire detection signals output by the fire detectors 11 in each space 7, i.e., each security zone, are individually transmitted via communication line 23 to a receiver 15 in the management office 9 within the building.

[0018] Each of the surveillance cameras 13 captures a full-color image of the shooting range including each space 7 in the corresponding high ceiling section 3 and low ceiling section 5 .

[0019] The surveillance cameras 13 in the low ceiling section 5, which has a low ceiling height, are installed on the ceiling of the low ceiling section 5 or on a wall surface near the ceiling, like the fire detectors 11. The surveillance cameras 13 in the high ceiling section 3, which has a higher ceiling height than the low ceiling section 5, are installed on a wall surface at a predetermined height closer to the floor than the ceiling of the high ceiling section 3.

[0020] When the surveillance camera 13 in the high ceiling section 3 is installed on the ceiling or on a wall near the ceiling, it captures an image of the space 7 at an angle looking down from above onto the floor of the space 7 in the high ceiling section 3. With an image taken at this angle, for example, if a fire breaks out near the floor, it is difficult to recognize changes in shape due to the flickering of the burning flames of the fire in the image.

[0021] For this reason, the surveillance camera 13 in the high ceiling section 3 is installed on the wall surface at a predetermined height that is lower than the height of the ceiling or near the ceiling of the high ceiling section 3. By installing the surveillance camera 13 at this height, for example, if a fire breaks out near the floor surface, the surveillance camera 13 can capture an image of the space 7 in the high ceiling section 3 from an angle that makes it easy to recognize the shape and fluctuation of the burning flame that has occurred in the space 7 in the high ceiling section 3 on the image. The installation position of the surveillance camera 13 in the high ceiling section 3 corresponds to an imaging point at a predetermined height for capturing an image of the space 7 in the high ceiling section 3.

[0022] The image signals output by each of the surveillance cameras 13 in the high ceiling section 3 and the low ceiling section 5 are individually transmitted via monitor lines 25 to a monitor panel 17 in the management office 9 within the building.

[0023] It should be noted that the fire detector 11 is not necessarily installed at a higher position than the surveillance camera 13. Some types of fire detectors 11 are installed close to the floor. When using this type of fire detector 11, the fire detector 11 may be installed on a wall surface at a lower position than the surveillance cameras 13 in the high ceiling section 3 and the low ceiling section 5.

[0024] In addition, if each space 7 in the high ceiling section 3 and the low ceiling section 5 is larger than the area permitted to be treated as a single alert area, each space 7 can be divided into multiple alert areas and fire detectors 11 and surveillance cameras 13 can be installed in each alert area.

[0025] When the receiver 15 receives a fire detection signal from each fire detector 11, it can display the occurrence of a fire with an indicator (not shown) or the like. For example, this indicator can be provided for each space 7 corresponding to each fire detector 11, i.e., for each alert area.

[0026] When an indicator is provided for each space 7, the receiver 15 can display the occurrence of a fire in each space 7 on an indicator corresponding to the fire detector 11 that has output the received fire detection signal. That is, the receiver 15 can notify the occurrence of a fire and the space 7 in which the fire has occurred by displaying the occurrence of a fire on an indicator.

[0027] Furthermore, when the receiver 15 receives a fire detection signal from each fire detector 11 or a fire presumption signal from the monitoring device 19 described below, it outputs a fire report signal. The fire report signal is a signal that conveys to other equipment that a fire has occurred and the space 7 in which the fire has occurred. The fire report signal output by the receiver 15 can generally be output to a report destination. The report destination can be, for example, a central monitoring facility that supervises and manages all building facilities, a smoke control and exhaust system for a building having a high ceiling section 3 and a low ceiling section 5, an air conditioning system, a fire extinguishing system that protects each space 7, etc.

[0028] The monitor panel 17 receives image signals from each surveillance camera 13 and can display images of each space 7 on a monitor (not shown) or the like based on the received image signals. The monitor screen can be divided, for example, into a plurality of areas corresponding to each surveillance camera 13. When the monitor screen is divided into a plurality of areas corresponding to each surveillance camera 13, the monitor panel 17 can display, for example, in each area of ​​the monitor, an image of each space 7 captured by the corresponding surveillance camera 13 in real time.

[0029] Furthermore, the monitor board 17 can distribute the image signals received from each surveillance camera 13 to multiple signals by a distributor (not shown). When distributing the image signals to multiple signals, the monitor board 17 can, for example, supply one of the distributed image signals to a monitor and output the other to the surveillance device 19.

[0030] Image signals from each monitoring camera 13 are input to the monitoring device 19 via a monitor panel 17. The monitoring device 19 estimates the probability that a burning flame is present in the captured image of the space 7, separately from the detection of a fire outbreak in the space 7 by the fire detector 11.

[0031] 2, the monitoring device 19 can be configured by a personal computer having a CPU 27, a ROM 29, a RAM 31, and an external storage device 33. The CPU 27 can virtually implement a pre-processing unit 35, a fire estimation unit 37, a post-processing unit 39, and a learning processing unit 41 on the monitoring device 19 by executing a program stored in the external storage device 33, for example.

[0032] Depending on the results of the processing performed by the fire estimation unit 37 for each image signal received from each surveillance camera 13, the monitoring device 19 can output a fire estimation signal for each space 7 corresponding to each surveillance camera 13 from the post-processing unit 39 to the receiver 15.

[0033] The pre-processing unit 35 executes the processes shown in Fig. 3 on the image signals from the respective surveillance cameras 13 input via the monitor board 17 in Fig. 1. First, the pre-processing unit 35 converts the color space of the input image signals from the surveillance cameras 13 from RGB shown in Fig. 4(a) to HSV shown in Fig. 4(b) (step S11).

[0034] HSV is a color space represented by three components: hue, saturation (saturation / chroma), and value (value / brightness). The color space of the image signal to be handled in the subsequent processes does not necessarily have to be HSV. However, in this embodiment, taking advantage of the ability to expand the hue in a circular manner, the image signal in the HSV color space is handled in the subsequent processes.

[0035] When converting the color space, noise components may be removed from the converted image signal. The noise components are, for example, prominent components that occur in each pixel value of the image signal as the color space is converted. The noise components can be removed, for example, by filtering the image signal using a Gaussian filter to suppress prominent pixel value changes between adjacent pixels.

[0036] Next, as shown in Fig. 3, the pre-processing unit 35 generates a mask image in Fig. 5(b) for extracting the combustion flame portion from the original image in Fig. 5(a) captured by the monitoring camera 13 in Fig. 1 (step S13). The mask image can be generated by binarizing the image signal using threshold values ​​set for each of the values ​​of H, S, and V. The threshold values ​​for each of the values ​​of H, S, and V can be set to values ​​suitable for extracting the combustion flame obtained by experiment, for example.

[0037] Next, the pre-processing unit 35 extracts a portion corresponding to the combustion flame in the mask image in Fig. 5(b) as shown in Fig. 3 (step S15). At that time, the pre-processing unit 35 specifies the maximum and minimum values ​​in the XY coordinates of the combustion flame portion in the mask image as shown in Fig. 6(a), for example. Then, the pre-processing unit 35 sets a rectangular area circumscribing the combustion flame portion by two straight lines in the X-axis direction and two straight lines in the Y-axis direction that pass through each of the set coordinate values ​​as shown in Fig. 6(b).

[0038] In addition, when multiple rectangular regions can be set for the mask image, the pre-processing unit 35 may automatically select the rectangular region with the largest area, for example. Alternatively, one rectangular region may be selected from the multiple rectangular regions by a user's confirmation operation. In addition, when there is no combustion flame portion that can be extracted from the mask image, the pre-processing unit 35 may omit each step after step S15 and end the process shown in FIG. 3.

[0039] 3, the preprocessing unit 35 enlarges or reduces the image portion of the rectangular area in Fig. 6(b) in the original image in Fig. 5(a) captured by the monitoring camera 13 in Fig. 1, to generate an estimation image with a size and aspect ratio suitable for processing by the fire estimation unit 37 (step S17). Then, the series of processes ends.

[0040] If the size and aspect ratio of the rectangular image do not match those of the estimation image even after enlargement or reduction, pre-processing unit 35 enlarges or reduces the rectangular image portion to a size that fits within the size of the estimation image. In this case, pre-processing unit 35 can add dummy pixel values ​​by zero padding to portions of the enlarged or reduced image where there are no pixels corresponding to pixels of the estimation image due to a mismatch in aspect ratio.

[0041] The preprocessing unit 35 executes the process according to the above-mentioned flowchart of Fig. 3 for each frame of the image signal input from each surveillance camera 13 in Fig. 1, and generates a video of the estimation images of each space 7 to be input to the fire estimation unit 37. The video of the estimation images may have a number of frames that spans a length equal to or longer than the period of fluctuations specific to a combustion flame, for example.

[0042] The fire estimation unit 37 executes the process shown in Fig. 7 for the moving image of the estimation image of each space 7 generated by the pre-processing unit 35. First, the fire estimation unit 37 converts the color space of each frame of the moving image of the estimation image generated by the pre-processing unit 35 from RGB shown in Fig. 4(a) to HSV shown in Fig. 4(b) (step S31).

[0043] Next, the fire estimation unit 37 uses a neural network to generate feature maps of the shape and color of each combustion flame from each frame of the estimation image for each H, S, and V component, that is, from the estimation image, for the video of the estimation image converted into the HSV color space (step S33).

[0044] The processes performed by the fire estimation unit 37 in the above steps S31 and S33 can be performed in the procedure shown in Fig. 8. In particular, the fire estimation unit 37 can execute the process of generating a feature map in step S33 in Fig. 7 for each of the H, S, and V components by, for example, a combination of a convolution process using a filter and a compression process by pooling.

[0045] Next, the fire estimation unit 37 estimates the probability that a burning flame exists in the video of the estimation image using a neural network based on the feature maps for each of the H, S, and V components generated in step S33 (step S35). Then, the series of processes ends.

[0046] For example, the neural network in Fig. 9 can be used for the process performed by the fire estimation unit 37 in step S35. This neural network has multiple intermediate layers between the input layer and the output layer. The first part of the intermediate layers is a layer for recognizing the shape, color, etc. of objects present in the estimation image from a feature map. The second part of the intermediate layers is a layer for recognizing the movement corresponding to the fluctuation of a burning flame from the change between frames of the shape and color of the object recognized in the first part.

[0047] In other words, fluctuations occur in a combustion flame. Fluctuations are changes in the strength of a combustion flame over time. For example, if the fluctuations that occur in a combustion flame are "1 / f fluctuations," when the strength changes of a combustion flame are decomposed into a frequency spectrum, the strength (amplitude) P of the strength change at each frequency changes with respect to the change in frequency f in the relationship P=a / f (a is a positive constant).

[0048] Therefore, when a fire breaks out in the space 7, the probability that a fluctuating burning flame exists in the space 7 can be estimated based on the image recognition results of video images of the space 7 taken by the surveillance camera 13 over a predetermined period of time. Therefore, the neural network of the fire estimation unit 37 estimates the probability that a fluctuating burning flame exists in the space 7 by using the images taken by the surveillance camera 13.

[0049] The input layer in Fig. 9 receives input of the values ​​of each square in a column of the feature map generated by the fire estimation unit 37 for each of the H, S, and V components in step S33 in Fig. 7. In the front part of the middle layer in Fig. 9, the fire estimation unit 37 can recognize the shape, color, and the like of objects present in the estimation image by a neural network formed by repeating a fully connected layer. Note that a non-fully connected layer or a dropout layer may be present in the front part of the middle layer.

[0050] In the latter part of the intermediate layer in Fig. 9, for example, when a combustion flame F shown in Fig. 10(a) is present in each frame of an estimation image, the fire estimation unit 37 can recognize whether the combustion flame F is a fluctuating combustion flame F. In the output layer in Fig. 9, values ​​indicating the probability that a fluctuating combustion flame F exists and the probability that it does not exist in the moving image of the estimation image are output as real numbers ranging from 0 to 1. Note that in this embodiment, the sum of the two values ​​output to the output layer is always 1.

[0051] For example, a long short-term memory (LSTM) network can be used in the latter part of the intermediate layer in Fig. 9. The long short-term memory unit can perform processing to recognize the fluctuating combustion flame F by using the value of the feature map generated by the fire estimation unit 37 from each estimation image from several frames ago to the present. The long short-term memory unit can be configured as shown in the explanatory diagram of Fig. 11, for example.

[0052] In Fig. 11, for ease of explanation, the long-short-term memory unit that transmits information for the input xt of the current frame t is shown by a solid line, and the long-short-term memory unit that obtains the output ht-1 of the previous frame t-1 is shown by a dashed line. The long-short-term memory unit shown by the dashed line has the same configuration as the long-short-term memory unit shown by the solid line.

[0053] First, in the long-short-term memory unit shown by the solid line, the input xt for the current frame t and the short-term output ht-1 for the previous frame t-1 are summed and distributed to three gates for forgetting, input, and output, as well as the hyperbolic tangent tanh.

[0054] In the forget gate, a value ft is set as a bias for the long-term output ct-1 of the previous frame t-1 from the sum of the short-term output ht-1 of the previous frame t-1 and the input xt for the current frame t, using a sigmoid function σ. The value ft is a real value between 0 and 1. The value ft is multiplied by the long-term output ct-1 of the previous frame t-1.

[0055] In the input gate, a value it is set using a sigmoid function σ to determine whether to update the short-term output ht-1 or the input xt of the previous frame t-1. The value it is either the short-term output ht-1 or the input xt, or the sum of them. In addition, a vector for the value it, i.e., a value zt including a positive or negative sign, is set using the hyperbolic tangent tanh. The value zt is a real value between -1 and 1. The value zt is multiplied by the value it, and then added to the product ft×(ct-1) of the value ft and the long-term output ct-1 of the previous frame t-1.

[0056] The value ft×(ct-1)+it×zt, which is the product of the value ft and the long-term output ct-1 of the previous frame t-1, plus the product of the value it and the value zt, is the long-term output ct of the current frame t. The value ft×(ct-1)+it×zt is the input to the hyperbolic tangent tanh for the output gate, which is provided separately from the input gate. The hyperbolic tangent tanh for the output frame is used to set a vector for the short-term output ht of the current frame t, i.e., a numerical value including positive and negative signs.

[0057] In the output gate, a value ot is set using a sigmoid function σ as a bias for defining the portion to be output from the sum of the short-term output ht-1 and the input xt of the previous frame t-1. The value ot is a real value whose maximum value is the sum of the short-term output ht-1 and the input xt of the previous frame t-1. The value ot is multiplied by the value set by the hyperbolic tangent tanh for the output frame. This multiplied value becomes the short-term output ht of the current frame t.

[0058] In the long-short-term memory unit described above, the sigmoid functions σ of the three gates for forgetting, input, and output, and the hyperbolic tangent tanh for the input gate are the targets of learning.

[0059] By using the long-term and short-term memory units described above, the fire estimation unit 37 in Fig. 2 can estimate the probability that a combustion flame F with long-term dependency fluctuation exists in a video of an estimation image while preventing the number of solutions found by information processing from increasing and making it impossible to find an optimal solution. For example, when a combustion flame F shown in the hatched part of Fig. 10(a) changes over time to the shape shown in the hatched part of Fig. 10(b), the fire estimation unit 37 can estimate the probability that the combustion flame F is accompanied by fluctuations. At this time, the fire estimation unit 37 estimates the probability that a combustion flame F with fluctuations exists by estimating the probability that the change in the external shape of the combustion flame F shown by the arrow in Fig. 10(c), which shows the combustion flame F before and after the shape change, corresponds to fluctuations.

[0060] Then, in step S35 of Fig. 7, the fire estimation unit 37 acquires the value indicating the probability that a burning flame F exists from the two real values ​​output from the output layer of the neural network in Fig. 9 as a fire probability value P. The acquired fire probability value P becomes a value indicating the estimation result by the fire estimation unit 37 of the probability that a burning flame F exists in the video of the estimation image.

[0061] When the fire probability value P for each space 7 acquired by the fire estimation unit 37 is equal to or greater than the fire threshold, which is the criterion for determining whether a fire has occurred in the space 7, the post-processing unit 39 outputs a fire estimation signal for the space 7 in which the fire probability value P is equal to or greater than the fire threshold to the receiver 15.

[0062] The receiver 15 that has received the estimated fire signal from the post-processing unit 39 can display on an indicator the occurrence of a fire and the location of the fire, etc., based on which space 7 the received estimated fire signal corresponds to. In addition, the receiver 15 that has received the estimated fire signal outputs a fire report signal to the report destination, in the same way as when it receives a fire detection signal from the fire detector 11.

[0063] The learning processing unit 41 executes the process shown in Fig. 12 for the neural network executing the procedure shown in Fig. 8 and the neural network in Fig. 9 of the fire estimation unit 37 corresponding to the fire detector 11 and the surveillance camera 13 in each space 7. First, the learning processing unit 41 checks whether or not a learning request for the neural network has been input (step S51).

[0064] The learning request may be input by a user operation, or may be automatically input when the consistency between the fire occurrence state in the space 7 or the output state of the fire detection signal from the fire detector 11 and the fire probability value P estimated by the fire estimation unit 37 drops to a level below a reference level.

[0065] Here, the fire detector 11 is manufactured so as not to fail to output a fire detection signal when a fire has occurred, even if it may erroneously issue a non-fire alarm when no fire has occurred. Therefore, when the fire detector 11 does not output a fire detection signal, it means that no fire has occurred in the space 7. Therefore, if the fire detector 11 does not output a fire detection signal even after a certain amount of time has passed after the fire probability value P estimated by the fire estimation unit 37 becomes equal to or greater than the fire threshold, it is considered that the estimation result of the fire probability value P by the fire estimation unit 37 is not appropriate.

[0066] Conversely, if the fire estimation unit 37 continues to estimate a fire probability value P that is below the fire threshold even though the fire detector 11 is outputting a fire detection signal, the estimation result of the fire probability value P by the fire estimation unit 37 is considered to be inappropriate.

[0067] When such a situation occurs, it is necessary to execute a learning process of the neural network of the fire estimation unit 37. Therefore, for example, when the frequency of occurrence of the above-mentioned situation reaches a certain level or more, a learning request generated by logic may be input to the learning processing unit 41, or the learning request may be input to the learning processing unit 41 by a user's operation.

[0068] The learning data used for training the neural network can be, for example, video footage taken by the monitoring camera 13 in each space 7 of the high ceiling section 3 and the low ceiling section 5 when normal heptane (n-heptane) or alcohol in the pan starts to burn. The combustible material burned in the pan may be a flammable material other than normal heptane (n-heptane) or alcohol.

[0069] Furthermore, the learning data used for training the neural network may be, in addition to the above images, a video of a combustion test in a space (not shown) of a fire test facility that simulates each space 7 of the high ceiling section 3 and the low ceiling section 5. In this video, the time when the combustion of the combustible material in the fire pan is started in the location that resembles each space 7 of the fire test facility is captured by a camera in the fire test facility that resembles the surveillance camera 13 in each space 7 of the high ceiling section 3 and the low ceiling section 5.

[0070] By using the above-mentioned video as learning data, the neural network of the fire estimation unit 37 can efficiently learn the characteristics of the shape change due to the fluctuation of the burning flame F at the early stage of the outbreak of a fire in each space 7 of the high ceiling section 3 and the low ceiling section 5. Therefore, the accuracy with which the fire estimation unit 37 after learning estimates a fire probability value P equal to or higher than the fire threshold at the early stage of the outbreak of a fire can be increased by the learning of the neural network.

[0071] The above-mentioned learning data can be stored in a learning data storage section (not shown) of the external storage device 33, for example, in association with a target value of the fire probability value P at the time of fire outbreak.

[0072] If a learning request has not been input to the learning processing unit 41 (NO in step S51), the series of processes is terminated. If a learning request has been input to the learning processing unit 41, the learning process of the neural network of the fire estimation unit 37 is executed using the learning data stored in the learning data storage unit of the external storage device 33 (step S53).

[0073] This learning process can be performed using, for example, the backpropagation method. In this case, the learning processing unit 41 reads each piece of learning data from the external storage device 33. Then, the learning processing unit 41 calculates the difference between the fire probability value P of each piece of learning data and an ideal value, and inputs this as a teacher signal to the output layer of the neural network.

[0074] Then, when the learning processing unit 41 has executed the learning process in step S53 using all the learning data in the external storage device 33 (YES in step S55), the series of processes ends.

[0075] The learning data in the external storage device 33 can be used for follow-up learning of the neural network after the operation of the fire detection system 1. The learning data in the external storage device 33 may also be used for initial learning of the neural network before the operation of the fire detection system 1.

[0076] As is clear from the above description, in this embodiment, an estimation unit that estimates the probability that a burning flame F exists in the space 7 is realized by the fire estimation unit 37 of the monitoring device 19. Also, a notification unit that outputs a fire estimation signal to the receiver 15 when the fire probability value P becomes equal to or greater than a fire threshold, which is a criterion for determining whether a fire has occurred, is realized by the post-processing unit 39 of the monitoring device 19. Note that the fire threshold can be a real number between 0 and 1.

[0077] Furthermore, in this embodiment, the receiver 15 realizes a fire notification unit that outputs a fire notification signal when at least one of a fire detection signal from the fire detector 11 and a fire estimation signal from the post-processing unit 39 of the monitoring device 19 is input.

[0078] In the fire detection system 1 of the present embodiment described above, the fire estimation unit 37 of the monitoring device 19 estimates a fire probability value P by performing image recognition on video images of the space 7 in the high ceiling section 3 and low ceiling section 5 captured by the monitoring camera 13. If the fire probability value P is equal to or greater than the fire threshold, the monitoring device 19 outputs a fire estimation signal to the receiver 15, assuming that a fire has occurred in the space 7 in the high ceiling section 3 or low ceiling section 5 corresponding to the monitoring camera 13. The receiver 15 that receives the fire estimation signal outputs a fire notification signal to the notification destination, even if it does not receive a fire detection signal from the fire sensor 11 in the space 7 where the fire probability value P is equal to or greater than the fire threshold.

[0079] Therefore, even if the fire detector 11 in the high ceiling section 3 takes a long time to detect infrared rays of a specific wavelength caused by a fire, if there is a high possibility of a fire breaking out, the receiver 15 can output a fire notification signal to the notification destination before receiving a fire detection signal from the fire detector 11. This makes it possible to detect a fire early, especially in the space 7 of the high ceiling section 3 where the ceiling height is high.

[0080] Even in a low ceiling area 5, when it takes a long time for the fire detector 11 to detect infrared rays of a specific wavelength, if there is a high possibility of a fire breaking out, the receiver 15 can output a fire notification signal to the monitoring device 19 as the notification destination before receiving a fire detection signal from the fire detector 11.

[0081] Note that, as the image of the space 7 in the high ceiling section 3 and the low ceiling section 5, a thermal distribution image obtained by thermography may be used instead of an image captured by the surveillance camera 13. In this case, since the thermal distribution image is a monochrome image and has only a single gradation component, it is possible to binarize the pixel signal using a threshold value without converting the color space. Therefore, the preprocessing performed by the preprocessing unit 35 on the thermal distribution image can be one that omits the processing in step S11 in FIG. 3.

[0082] In the fire detection system 1 of the present embodiment, the detector that outputs the fire detection signal is the infrared fire detector 11. However, the detector is not limited to one that detects fires using only infrared rays, and may be one that detects fires using, for example, ultraviolet rays, both ultraviolet rays and infrared rays, heat, smoke, brightness temperature, or the like.

[0083] Furthermore, in the fire detection system 1 of the present embodiment, the neural network of the fire estimation unit 37 uses a network of long-term and short-term memory units suitable for processing to recognize the combustion flame F accompanied by fluctuations.

[0084] However, the neural network of the fire estimation unit 37 does not have to be capable of recognizing the fluctuation of the combustion flame F, so long as it can recognize the combustion flame F from the image captured by the surveillance camera 13. For example, the neural network of the fire estimation unit 37 may be configured only with a network such as a Convolutional Neural Network (CNN) or a Recurrent Neural Network (RNN). In that case, the learning data for the neural network may be still images instead of moving images.

[0085] In addition, in the fire detection system 1 of this embodiment, surveillance cameras 13 are installed in both the high ceiling area 3 and the low ceiling area 5, and images of each space 7 are taken and used by the fire estimation unit 37 to estimate the fire probability value P.

[0086] However, in the low ceiling section 5, where the ceiling height is lower than that of the high ceiling section 3, it is considered that it will not take as long for the fire detector 11 on or near the ceiling to detect infrared rays of a specific wavelength and output a fire detection signal as for the fire detector 11 in the high ceiling section 3. Therefore, in the low ceiling section 5, it is possible to omit installing the surveillance camera 13 for the purpose of early detection of a fire outbreak.

[0087] Furthermore, in the fire detection system 1 of this embodiment, the fire detector 11 is placed in the high ceiling section 3 and used in combination with the monitoring camera 13. When either the fire detection signal from the fire detector 11 or the fire estimation signal from the post-processing section 39 of the monitoring device 19 is input to the receiver 15, the receiver 15 outputs a fire notification signal to the notification destination.

[0088] However, the fire detector 11 and receiver 15 may be omitted, and when the post-processing unit 39 of the monitoring device 19 outputs a fire estimation signal, that output may trigger the start of response to a fire in the space 7 of the high ceiling section 3.

[0089] As a countermeasure to be initiated in response to the output of a fire presumed signal, for example, a display similar to the display of a fire occurrence by receiver 15 using an indicator (not shown) for each alert area when a fire detection signal is received from fire detector 11 can be used.

[0090] Also, the fire detector 11 and the receiver 15 may not be omitted, and a fire detection system with a different configuration may be used. In this case, for example, when a fire presumed signal from the post-processing unit 39 of the monitoring device 19 is input to the receiver 15, an alarm indicating a fire occurrence in the high ceiling section 3 may be output on the indicator of the receiver 15 or on the message display unit of the display panel 21 prior to the fire notification signal. The fire notification signal from the receiver 15 to the notification destination may be output when a fire detection signal from the fire detector 11 is input to the receiver 15 after the alarm is output.

[0091] [Invention and its effects disclosed by the embodiments] The above-described embodiment discloses the invention in the following aspects.

[0092] First, as the first aspect of the invention, a fire detector that outputs a fire detection signal when detecting a fire in an indoor space having a high ceiling, the ceiling of which is higher than that of a low ceiling; an estimation unit that estimates a probability that a combustion flame exists in the indoor space based on an image recognition result of a neural network for the image of the indoor space; a notification unit that outputs a fire prediction signal when the probability becomes equal to or exceeds a fire threshold that is a criterion for determining whether a fire has occurred; a fire notification unit that outputs a fire notification signal to a notification destination of a fire in the indoor space when at least one of the fire detection signal and the fire estimation signal is output; A fire detection system is disclosed comprising:

[0093] According to the first aspect of the invention, a combustion flame generated during a fire radiates infrared rays of a specific wavelength due to carbon dioxide resonance radiation. Therefore, when a fire occurs in an indoor space with a high ceiling, a fire detector can detect the infrared rays of a specific wavelength radiated from the combustion flame, for example, and detect the occurrence of the fire.

[0094] Furthermore, a combustion flame not only changes the state of infrared rays, but may also change the state of elements such as ultraviolet rays, both ultraviolet rays and infrared rays, heat, smoke, brightness temperature, etc. Therefore, when a fire breaks out in an indoor space with a high ceiling, a fire detector can detect the occurrence of a fire by detecting, for example, changes in ultraviolet rays, both ultraviolet rays and infrared rays, heat, smoke, brightness temperature, etc., whose states change due to the occurrence of a combustion flame, or the existence of these elements themselves.

[0095] In addition, when a fire breaks out in an indoor space with a high ceiling, a burning flame is captured in an image of the indoor space with a high ceiling captured by a surveillance camera. Therefore, the estimation unit can estimate the probability that a burning flame exists in the indoor space with a high ceiling based on, for example, the image recognition result of the neural network for images of the indoor space with a high ceiling taken over a predetermined period of time.

[0096] In high-ceiling areas where the ceiling height is higher than in low-ceiling areas, fire detectors installed on the ceiling or walls may be placed at a position farther away from the floor than in normal buildings. Therefore, when a fire breaks out near the floor, it may take longer for the fire detector to detect the fire using infrared rays, ultraviolet rays, both ultraviolet and infrared rays, heat, smoke, brightness temperature, etc. than it would for a fire detector in a low-ceiling area.

[0097] On the other hand, in an image of an indoor space with a high ceiling, even if the flame is near the floor, the presence of the flame will be captured regardless of the height difference between the ceiling or the vicinity of the ceiling. Therefore, if a fire has occurred in an indoor space with a high ceiling, the probability of the presence of the flame estimated by the estimation unit will be high.

[0098] Therefore, even if the fire detector does not output a fire detection signal, if the estimation unit estimates the probability that a combustion flame exists in the indoor space of a high ceiling area, it can be inferred that there is a high possibility that a fire has occurred in the high ceiling area.

[0099] Therefore, the value of the probability of the existence of a burning flame estimated by the estimation unit is defined as a standard value for fire occurrence by a fire threshold. If the probability estimated by the estimation unit is equal to or greater than the fire threshold, the notification unit outputs a fire estimation signal. When the notification unit outputs the fire estimation signal, even if the fire detector does not output a fire detection signal, it is assumed that a fire has occurred in the indoor space with a high ceiling, and the signal can be used as a trigger to start dealing with the fire in the indoor space with a high ceiling. This enables early fire detection in indoor spaces with high ceilings.

[0100] In addition, as an invention according to a second aspect, a fire detection system is disclosed which further includes a fire detector which outputs a fire detection signal when it detects a fire in the indoor space, and a fire reporting unit which outputs a fire reporting signal to a reporting destination of a fire in the indoor space when at least one of the fire detection signal and the fire estimation signal is output.

[0101] According to the second aspect of the invention, when at least one of the following occurs: the fire detector in the high ceiling outputs a fire detection signal, and the notification unit outputs a fire estimation signal based on the estimation result of the estimation unit, the fire transfer unit outputs a fire transfer signal to the destination of the fire. Therefore, the occurrence of a fire in an indoor space in a high ceiling can be more reliably detected by detecting the element itself or a change in the state of an element caused by a burning flame, and detecting the burning flame by an image.

[0102] Furthermore, as an invention according to a third aspect, a fire detection system is disclosed in which the image is an image of the indoor space taken from a shooting point at a predetermined height lower than the ceiling height of the high ceiling section, and the fire detector is installed on the ceiling of the high ceiling section.

[0103] According to the third aspect of the invention, when an image of an indoor space is captured from the ceiling of a high ceiling or near the ceiling, the image of the indoor space is captured at an angle looking down on the floor of the high ceiling from above. With an image captured at this angle, for example, if a fire breaks out near the floor of the high ceiling, it is difficult to recognize changes in shape due to the flickering of the burning flames of the fire in the image.

[0104] Therefore, an image of the indoor space in a high ceiling is taken from a shooting point at a predetermined height that is lower than the height of the ceiling or near the ceiling of the high ceiling. By taking an image of the indoor space in a high ceiling from this height, even if a fire breaks out near the floor surface of the high ceiling, for example, the image of the indoor space in a high ceiling can be taken from an angle that makes it easy to recognize the shape and flicker of the burning flame of the fire on the image.

[0105] In addition, as a fourth aspect of the invention, the neural network is disclosed as having a long short-term memory (LSTM) network in an intermediate layer that performs image recognition of fluctuations in a combustion flame over a predetermined period of time.

[0106] According to the fourth aspect of the invention, a combustion flame with fluctuations existing in an indoor space with a high ceiling is extracted in a long-term / short-term memory unit in an intermediate layer of a neural network using the most recent images from a predetermined period in the past. Therefore, a combustion flame with fluctuations, which is a time-varying element, can be extracted with high accuracy by image recognition and used for estimating the probability of the existence of a combustion flame by an estimation unit.

[0107] In addition, as a fifth aspect of the invention, a fire detection system is disclosed in which the neural network has a network that uses as learning data images taken of the indoor space or a space simulating the indoor space at the time when combustion of the flammable material in the fire pan begins.

[0108] According to the fifth aspect of the invention, the neural network of the fire estimation unit can efficiently learn the characteristics of the shape change caused by the fluctuation of the burning flame at the early stage of the outbreak of a fire in an indoor space with a high ceiling. Therefore, the accuracy with which the learned fire estimation unit estimates the probability of a fire exceeding the fire threshold at the early stage of the outbreak of a fire in an indoor space with a high ceiling can be increased by learning the neural network.

[0109] Here, the combustible substance may be normal heptane or alcohol. [Explanation of symbols]

[0110] 1. Fire detection system 3 High ceiling 5 Low ceiling area 7 space 9 Management office 11 Fire detector (detector) 13. Surveillance Cameras 15 Receiver (fire alarm unit) 17 Monitor board 19 Monitoring equipment 21 Display panel 23 Communication lines 25 Monitor Line 27 CPU 29 ROM 31 RAM 33 External storage device 35 Pretreatment section 37 Fire Estimation Department 39 Post-processing section 41 Learning processing unit F Combustion flame P Fire probability value

Claims

1. a pre-processing unit that converts a color space of an image signal of an indoor space in a high-ceilinged area, which has a higher ceiling height than a low-ceilinged area, from RGB to HSV, binarizes the image signal using image signal thresholds set for each of the H, S, and V values, thereby generating a mask image, and enlarges or reduces an image portion of a rectangular area circumscribing a burning flame portion in the mask image, thereby generating an estimation image of a size and aspect ratio suitable for image recognition processing using a neural network of the fire estimation unit; an estimation unit that estimates a probability that a combustion flame exists in the indoor space based on an image recognition result of the neural network for the estimation image; a notification unit that outputs a fire prediction signal when the probability becomes equal to or exceeds a fire threshold that is a criterion for determining whether a fire has occurred; A fire detection system comprising:

2. The fire detection system of claim 1, further comprising a fire detector that outputs a fire detection signal when it detects a fire in the indoor space, and a fire notification unit that outputs a fire notification signal to a notification destination of a fire in the indoor space when at least one of the fire detection signal and the fire estimation signal is output.

3. 3. The fire detection system of claim 2, wherein the estimation image is an image of the indoor space photographed from a shooting point at a predetermined height lower than the ceiling height of the high ceiling section, and the fire detector is installed on a ceiling of the high ceiling section.

4. The fire detection system according to any one of claims 1 to 3, wherein the neural network has a long short-term memory (LSTM) network in an intermediate layer that performs image recognition of fluctuations of a combustion flame over a predetermined period of time.

Citation Information

Patent Citations

  • Device for extinguishing fire while avoiding fire-fighting cover

    JP1999276632A

  • Fire detecting device

    JP2000137877A

  • Processor and monitoring system

    JP2014241062A

  • Fire monitoring system

    JP2018101416A

  • Fire monitoring system

    JP2019079446A