Image generation device, operation confirmation system, image generation method, and program

Abstract

To generate an image in which it appears as if a fire occurred at a site, even without using a high-specification device.SOLUTION: An image generation apparatus comprises: an acquisition unit which acquires an object image obtained by imaging an object area; and a generation unit which generates a superimposed image obtained by superimposing a smoke image on the object image acquired by the acquisition unit. The superimposed image is used to determine whether a smoke detection device operates correctly, the smoke detection device being provided in the object area to determine whether smoke occurs or not in the object area, based on the image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image generation device, an operation checking system, an image generation method, and a program. [Background technology]

[0002] There are fire detection systems that use images to detect fires. Such fire detection systems are installed at various sites. When a fire detection system is installed, it is desirable to be able to confirm whether the fire detection system is operating correctly at the site. However, it is difficult to actually cause a fire at the site and confirm its operation using images captured of the fire. For this reason, Patent Document 1, for example, discloses a method for recreating a fire in real space, in which a non-fire image and a three-dimensional smoke model are placed in a virtual space, and the orientation of the smoke model is changed to generate a composite image in which the smoke image is arranged in an orientation that does not appear unnatural. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2021-149378 Summary of the Invention [Problem to be solved by the invention]

[0004] However, because Patent Document 1 uses a three-dimensional shape model, it places a heavy processing load on the system, making it difficult to generate a composite image without a high-spec device. In addition, there is a problem in that the tester is required to have knowledge about fires in order to reproduce an appropriate fire situation depending on the location.

[0005] The present invention has been made in consideration of the above circumstances, and its purpose is to provide an image generation device, an operation confirmation system, an image generation method, and a program that can generate a composite image that makes it appear as if a fire has broken out at the scene without using high-spec equipment. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, one embodiment of the present invention is Located on a roadway or in a tunnel an acquisition unit that acquires a target image in which a target region is captured; an input unit into which a user operation is input; The target image acquired by the acquisition unit The smoke image can be expressed as white smoke or black smoke, and the smoke can be specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit. a generation unit for generating a composite image by combining the smoke images; a display unit that displays a guide; Equipped with The guide indicates the color of the smoke according to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or a cable fire, The synthetic image is an image generating device used to determine whether a smoke detection device installed in the target area, which determines whether smoke is occurring in the target area based on an image, is operating correctly.

[0007] In order to solve the above-mentioned problems, one embodiment of the present invention is Located on a roadway or in a tunnel an acquisition unit that acquires a target image in which a target region is captured; an input unit into which a user operation is input; The target image acquired by the acquisition unit The smoke image can be expressed as white smoke or black smoke, and the smoke can be specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit. a generation unit for generating a composite image by combining the smoke images; a display unit that displays a guide; and a determination unit that determines whether a smoke detection device provided in the target area, which determines whether smoke is occurring in the target area based on the image, operates correctly using the composite image. The guide indicates the color of the smoke corresponding to the object that is the source of the fire, and indicates that the color of black smoke corresponds to one or more of a gasoline or vehicle fire, and indicates that the color of white smoke corresponds to one or more of an electrical device or cable fire. It is an operation confirmation system.

[0008] Further, one embodiment of the present invention is an image generation method performed by an image generation device that is a computer, the acquisition unit comprising: Located on a roadway or in a tunnel Acquire a target image in which the target region is captured; A user operation is input to the input unit, A generation unit generates a target image acquired by the acquisition unit. The smoke image can be expressed as white smoke or black smoke, and the smoke can be specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit. A composite image is generated by combining the smoke image. a display unit displays a guide, the guide indicating the color of smoke corresponding to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or cable fire; The synthetic image is an image generation method used to determine whether a smoke detection device installed in the target area, which determines whether smoke is occurring in the target area based on an image, is operating correctly.

[0009] Furthermore, one embodiment of the present invention is a computer-based image generating device, Located on a roadway or in a tunnel Acquire a target image in which the target region is captured; The user inputs an operation, The acquired target image , a smoke image that can be expressed as white smoke or black smoke, and the input operation specifies whether the smoke is white smoke or black smoke depending on the source of the fire. A composite image is generated by combining the smoke image. a guide is displayed, the guide indicating the color of the smoke corresponding to the object that is the source of the fire, and for black smoke, a guide is given indicating that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, a guide is given indicating that the color corresponds to one or more of an electrical equipment or cable fire; The synthetic image is a program that is an image used to determine whether a smoke detection device installed in the target area, which determines whether smoke is occurring in the target area based on the image, is operating correctly. [Effects of the Invention]

[0010] As described above, according to the present invention, it is possible to easily generate a composite image that makes it appear as if a fire has broken out at the scene, without using a high-spec device. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram showing an example of the configuration of a fire detection system 1 to which an image generating device 10 according to an embodiment is applied. [Figure 2] 1 is a block diagram showing an example of the configuration of an image generating device 10 according to an embodiment. [Figure 3] 1 is a block diagram showing an example of the configuration of an operation control device 20 according to an embodiment. [Figure 4] 1 is a diagram showing an example of a target image TG displayed by the image generating device 10 according to the embodiment. [Figure 5] FIG. 2 is a diagram showing an example of a composite image GG displayed by the image generating device 10 according to the embodiment. [Figure 6] 1 is a flowchart showing the flow of processing performed by an image generating device 10 according to an embodiment. [Figure 7] 10A and 10B are diagrams illustrating a marker M according to a first modified example of the embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a target image TG displayed by an image generating device 10 according to a first modification of the embodiment. [Figure 9A] FIG. 10 is a diagram showing an example of a composite image GG displayed by an image generating device 10 according to a first modified example of the embodiment. [Figure 9B]FIG. 10 is a diagram showing an example of a composite image GG displayed by an image generating device 10 according to a first modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] (Configuration of Fire Detection System 1) 1 is a diagram showing an example of the configuration of a fire detection system 1 to which an image generation device 10 according to an embodiment is applied. The fire detection system 1 includes, for example, a camera CA, the image generation device 10, an operation control device 20, and a smoke detection device 30.

[0014] The camera CA, the image generation device 10, and the smoke detection device 30 are communicatively connected via SW1. The operation control device 20 and the smoke detection device 30 are communicatively connected via SW2. The camera CA, the image generating device 10, the operation control device 20, and the smoke detection device 30 communicate with each other via, for example, a communication network, short-range communication using a wireless LAN (Local Area Network), or a USB (Universal Serial Bus) cable. The camera CA and the smoke detection device 30 may also be provided integrally. That is, the camera CA may be built into the smoke detection device 30.

[0015] The fire detection system 1 has a fire detection mode and an operation confirmation mode. The fire detection mode is a mode for detecting a fire based on an image, and is realized using the camera CA and the smoke detection device 30. In this case, the camera CA and the smoke detection device 30 are connected by the switch SW1. The operation check mode is a mode for checking whether the smoke detection device 30 is operating correctly, and is realized using the camera CA, the image generation device 10, the operation control device 20, and the smoke detection device 30. In this case, the camera CA and the image generation device 10 are connected by the switch SW1, and the smoke detection device 30 and the operation control device 20 are connected by the switch SW2.

[0016] The target area T is an area or object that is the target of monitoring by the fire detection system 1. The target area T may be set arbitrarily. For example, the target area T is a roadway, a tunnel premises, a building, a building premises, etc.

[0017] The camera CA captures an image of the target area T. The camera CA may capture video or still images. The camera CA outputs the captured image to the image generation device 10 or the smoke detection device 30 in accordance with the control of the switch SW1 by the operation control device 20. Specifically, in the fire detection mode, the camera CA outputs the captured image to the smoke detection device 30. On the other hand, in the operation confirmation function mode, the camera CA outputs the captured image to the image generation device 10.

[0018] The image generation device 10 is a computer, and is realized by, for example, a PC (Personal Computer), a server device, or the like. In an operation check mode, the image generation device 10 acquires a target image TG in which a target area T is captured from a camera CA, and generates a composite image GG by combining the acquired image with a smoke image (an image showing smoke). The image generation device 10 outputs the generated composite image GG to the operation control device 20. The generated composite image GG by the image generation device 10 is used to determine whether the smoke detection device 30 is operating correctly. A method by which the image generation device 10 generates the composite image GG will be described in detail later.

[0019] The operation control device 20 is a computer, and is realized by, for example, a PC (Personal Computer), a server device, etc. The operation control device 20 controls the switches SW1 and SW2 to operate the fire detection system 1 in a fire detection mode or an operation confirmation mode.

[0020] In the operation check mode, the operation control device 20 outputs the composite image GG generated by the image generation device 10 to the smoke detection device 30. Then, the operation control device 20 obtains a determination result KK indicating whether or not a fire has occurred from the smoke detection device 30. The operation control device 20 performs an operation check to determine whether or not the smoke detection device 30 is operating correctly, based on the composite image GG and the determination result KK.

[0021] The smoke detection device 30 is a computer, and is realized by, for example, a PC (Personal Computer), a server device, etc. The smoke detection device 30 is provided in a target area T. In a fire detection mode, the smoke detection device 30 acquires a target image TG from a camera CA and determines whether or not smoke is shown in the acquired image. In an operation check mode, the smoke detection device 30 acquires a composite image GG from the operation control device 20 and determines whether or not smoke is shown in the acquired image. Any method may be adopted as a method for the smoke detection device 30 to detect smoke based on an image, and a detailed description thereof will be omitted in this embodiment.

[0022] (Configuration of image generation device 10) 2 is a block diagram showing an example of the configuration of an image generating device 10 according to an embodiment. The image generating device 10 includes, for example, an image acquiring unit 100, a generating unit 101, an input unit 102, a display unit 103, an output unit 104, and an image information storage unit 105. The functional units (image acquisition unit 100 and generation unit 101) of image generation device 10 are realized by causing a CPU (Central Processing Unit) provided as hardware in image generation device 10 to execute a program.

[0023] The image acquisition unit 100 acquires image information of the target image TG captured by the camera CA. The image acquisition unit 100 outputs the acquired image information to the generation unit 101.

[0024] The input unit 102 includes input devices such as a mouse, a keyboard, a touch panel, a trackball, a game controller, etc. The input unit 102 acquires information input by a user's operation input, etc. The input unit 16 outputs the acquired information to the generation unit 101.

[0025] The display unit 103 includes a display device such as a liquid crystal display, and displays images under the control of a display control unit (not shown). For example, the display unit 103 displays a target image TG and a composite image GG. The display unit 103 also displays tools to assist the user in generating the composite image GG, such as a guide GD (see FIG. 4) described below.

[0026] The output unit 104 outputs image information of the composite image GG generated by the generation unit 101 to the movement control device 20. When the image generation device 10 and the movement control device 20 are connected to each other so that they can communicate with each other via a cable or the like, the output unit 104 is an output port of the cable. When the image generation device 10 and the movement control device 20 are connected to each other so that they can communicate with each other via a communication network or the like, the output unit 104 is a communication module that communicates with the movement control device 20 via the communication network.

[0027] The image information storage unit 105 stores image information. The image information is image information of a target image. The image information includes image information of the target image TG, the smoke image, and the composite image GG. The image information may also include information indicating parameters applied when generating the composite image GG, such as a coefficient A, which will be described later. The image information storage unit 105 is configured by a storage medium, such as a hard disk drive (HDD), flash memory, electrically erasable programmable read-only memory (EEPROM), random access read / write memory (RAM), read-only memory (ROM), or any combination of these storage media.

[0028] The generation unit 101 generates a composite image GG by combining a smoke image with the target image TG. In this way, the generation unit 101 can generate a composite image GG that looks as if a fire has broken out at the site where the smoke detection device 30 is installed, from the target image TG that has been captured using the site as the target area T. A method for generating the composite image GG will be described in detail below.

[0029] The generating unit 101 generates a composite image GG by combining a smoke image with a target image TG. The generating unit 101 calculates pixel values ​​of the composite image GG using the following equation (1).

[0030] I GG =I BG +A×I smoke …(1) However, I BG : pixel value of target image TG I smoke : pixel value of smoke image A: Coefficient I GG : Pixel value of the composite image GG

[0031] In equation (1), the coefficient A may be set arbitrarily. For example, the coefficient A is a real number between −1 and +1. The color of the smoke can be set by the sign of coefficient A. For example, if coefficient A is set to a positive value, white smoke (white smoke) will be synthesized. If coefficient A is set to a negative value, black smoke (black smoke) will be synthesized. The absolute value of coefficient A can be used to set the density of the smoke color. For example, if coefficient A is set to a value close to 0 (zero), thin smoke will be synthesized. If the absolute value of coefficient A is set to a value close to the maximum value (for example, 1), thick smoke will be synthesized.

[0032] Here, we will explain alpha blending. Alpha blending is a technique for combining two images using a coefficient (alpha value). Alpha blending is used, for example, to combine images in which characters or the like are arranged so that they appear to be transparent to the background. When generating a composite image by combining a background image and an object image, alpha blending calculates the pixel values ​​of the composite image using the following equation (2). A background image is an image that shows a background. An object image is an image that shows an object such as a character.

[0033] I GG =(1-α)×I G1 +α×I G2 …(2) However, I G1 : pixel value of background image I G2 : pixel value of object image α: coefficient I GG : Pixel value of the composite image GG

[0034] In equation (2), the coefficient α is a real number ranging from 0 (zero) to +1, for example. When synthesizing a pale, nearly transparent object image, a small value is set for the coefficient α. When synthesizing a dark, clearly visible object image, a large value is set for the coefficient α. Furthermore, the pixel values ​​of the background image are adjusted according to the set value of the coefficient α.

[0035] As shown in equation (2), alpha blending adjusts the pixel values ​​of the background image according to the coefficient alpha. This is expected to have the effect of making characters and other objects appear to blend in with the background.

[0036] In contrast, in this embodiment, the generation unit 101 does not adjust the pixel values ​​of the target image TG serving as the background image according to the coefficient A, as shown in equation (1). Unlike objects such as characters, smoke is usually semi-transparent. Therefore, in this embodiment, by not multiplying the pixel values ​​of the background image by (1-A), it is expected that a natural composite image GG can be generated that looks as if smoke is rising in the target region T without any sense of incongruity.

[0037] (Application example 1) As an application example 1, the generating unit 101 may generate the composite image GG using a uniform coefficient A for each pixel.

[0038] (Application example 2) As an application example 2, the generation unit 101 may perform clipping processing. The clipping processing is processing in which, if the value calculated using equation (1) exceeds the upper limit value (e.g., 255) that a pixel can take, the value calculated using equation (1) is fixed to the upper limit value. The generation unit 101 may also perform clipping processing on the lower limit. That is, if the value calculated using equation (1) exceeds the lower limit value (e.g., 0) that a pixel can take, the generation unit 101 may fix the value calculated using equation (1) to the lower limit value.

[0039] For example, the generating unit 101 performs clipping processing on the pixel values ​​of the composite image GG using the following equation (4) or (5).

[0040] I GG =I MAX (I GGC >I MAX ) I GG =I GGS (I GGC ≦I MAX ) …(4) However, I MAX : The upper limit of the pixel value (e.g., 255) I GGC :Pixel value before clipping I GG : Pixel value of the composite image GG

[0041] I GG =I MIN (I GGC MAX ) I GG =I GGC (I GGC ≧I MIN ) …(5) However, I MIN : The lowest possible value for a pixel (e.g., 0)​ I GGC :Pixel value before clipping I GG : Pixel value of the composite image GG

[0042] (Application example 3) As an application example 3, the generation unit 101 may adjust the pixel values ​​of the background image according to the density of the smoke image, that is, the absolute value of the coefficient A. This allows the smoke to be synthesized so that it appears to blend in with the background, even when thick smoke is synthesized.

[0043] For example, the generating unit 101 calculates the pixel values ​​of the composite image GG using the following equation (7).

[0044] I GG =B×I BG +A×I smoke …(7) However, I BG : pixel value of target image TG I smoke : pixel value of smoke image A, B: Coefficients |A| ≥ threshold TH B≦(1-A) I GG : Pixel value of the composite image GG

[0045] (Configuration of the operation control device 20) 3 is a block diagram showing an example of the configuration of the operation control device 20 according to the embodiment. The operation control device 20 includes, for example, a composite image acquisition unit 200, a fire determination result acquisition unit 201, an operation determination unit 202, and an image information storage unit 203. The functional units (synthetic image acquisition unit 200, fire judgment result acquisition unit 201, and operation judgment unit 202) of the operation control device 20 are realized by causing a CPU (Central Processing Unit) provided as hardware in the image generation device 10 to execute a program.

[0046] The composite image acquisition unit 200 acquires image information of the composite image GG generated by the image generation device 10. The composite image acquisition unit 200 outputs the acquired image information to the movement determination unit 202.

[0047] The fire determination result acquisition unit 201 acquires the determination result KK made by the smoke detection device 30. The fire determination result acquisition unit 201 outputs the acquired determination result KK to the operation determination unit 202.

[0048] The operation determination unit 202 determines whether or not the smoke detection device 30 has operated correctly based on the composite image GG and the determination result KK. For example, if the smoke detection device 30 determines that a fire has occurred based on the composite image GG in which smoke is shown, the operation determination unit 202 determines that the smoke detection device 30 has operated correctly. On the other hand, if the operation determination unit 202 outputs the composite image GG in which smoke is shown to the smoke detection device 30 and the smoke detection device 30 determines that no fire has occurred, the operation determination unit 202 determines that the smoke detection device 30 has not operated correctly. The operation determination unit 202 may display the result of determining whether or not the smoke detection device 30 has operated correctly as an operation confirmation result on a display unit (not shown) of the operation control device 20.

[0049] The image information storage unit 203 stores image information. The image information is image information of a target image. The image information includes image information of a composite image GG. The image information may also include information indicating parameters applied when generating the composite image GG, such as a coefficient A. The image information storage unit 105 is configured by a storage medium, such as a HDD, a flash memory, an EEPROM, a RAM, a ROM, or any combination of these storage media.

[0050] (About the target image TG and the composite image GG) Here, the target image TG and the composite image GG will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a diagram showing an example of the target image TG. Fig. 5 is a diagram showing an example of the composite image GG.

[0051] 4, for example, when the image generating device 10 acquires image information of a target image TG from a camera CA, the image generating device 10 displays the target image TG on the display unit 103 using the acquired image information. In this case, the image generating device 10 may display an assistance tool together with the target image TG. The assistance tool is a tool that assists the user in the operation of generating a desired composite image GG.

[0052] The image generating device 10 displays, as the support tools, for example, a slide switch SW, a check box CB, and a guide GD. The slide switch SW is used to set the density of the smoke. The amount of sliding of the slide switch SW is linked to coefficient A, and the value of coefficient A is set according to the amount of sliding. Checkbox CB is a checkbox that sets the color of the smoke, that is, whether to synthesize black smoke or white smoke. The item checked in checkbox CB is linked to the sign of coefficient A, and sets whether coefficient A is a positive value or a negative value.

[0053] The guide GD is a display that shows the color of smoke depending on the object that is the source of the fire. For example, black smoke is often produced when gasoline is burned, and white smoke can be produced when the temperature of electrical equipment rises abnormally. However, it is conceivable that the worker who installed the smoke detection device 30 or the person in charge at the site where the smoke detection device 30 is installed may not have knowledge that smoke of different colors is generated depending on the source of a fire. For this reason, such a guide GD is displayed to the user who generates the composite image GG to assist them in setting the smoke color according to the object. This makes it possible to generate a natural composite image GG that does not look unnatural, in which smoke of the color that would be observed if an actual fire had occurred is generated.

[0054] For example, the user visually recognizes the target image TG displayed on the display unit 103 and selects an object that generates smoke from a group of objects captured in the target image TG. In the example shown in the figure, vehicles, traffic lights, etc. are captured in the target image TG. For example, the user selects a vehicle as the object that generates smoke by clicking the vehicle with a mouse or the like. Next, the user checks the checkbox CB to select whether to display black smoke or white smoke. At this time, the user visually checks the message displayed on the guide GD and selects a color according to the object. For example, if the user selects a vehicle, the user selects black smoke. The user then sets the thickness of the smoke to be synthesized by sliding the slide switch SW. The image generating device 10, for example, synthesizes smoke of a thickness linked to the slide operation with the target image TG and displays it.

[0055] By performing such an operation, a composite image GG as shown in FIG.

[0056] (Flow of processing performed by image generating device 10) Here, the flow of processing performed by the image generating device 10 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of processing performed by the image generating device 10 according to the embodiment.

[0057] The image generating device 10 acquires image information of the target image TG (step S10). The image generating device 10 displays the acquired target image TG together with a support tool such as a guide GD (step S11). The image generating device 10 sets a coefficient A based on the amount of sliding of the slide switch SW (step S12). The image generating device 10 calculates pixel values ​​of the composite image GG using the set coefficient A, for example, using equation (1) (step S13). If the calculated pixel value exceeds the upper limit value that the pixel can take, the image generating device 10 may correct the pixel value by performing clipping processing (step S14). The image generating device 10 displays the generated composite image GG (step S15).

[0058] As described above, the image generation device 10 of the embodiment includes the image acquisition unit 100 and the generation unit 101. The generation unit 101 acquires a target image TG in which a target area T is captured when there is no fire. The generation unit 101 generates a composite image GG by combining a smoke image with the target image TG. The composite image GG is used to determine whether the smoke detection device 30 is operating correctly.

[0059] As a result, the image generating device 10 of the embodiment can perform an operation check using an image of the site where the smoke detection device 30 is installed. A smoke image can be composited into an image captured of the site where the smoke detection device 30 is installed as the target area T. Operation check can be performed using such a realistic composite image GG, making it possible to confirm with higher accuracy whether the smoke detection device 30 is operating correctly. Furthermore, since there is no need to use a three-dimensional shape model or form a virtual space, the composite image GG can be generated using the target image TG captured at the actual site, and it is possible to generate an image that makes it appear as if a fire has broken out at the site without using a high-spec device.

[0060] In the image generating device 10 according to the embodiment, the generating unit 101 generates pixel values ​​(I BG ) and smoke image (I smoke ) multiplied by a predetermined magnification (coefficient A), and then generates a composite image GG whose pixel values ​​are the sum of these values. In this way, the image generating device 10 of the embodiment can generate a more natural composite image GG that takes advantage of the characteristic that smoke is normally translucent.

[0061] Furthermore, in the image generating device 10 of the embodiment, the generating unit 101 sets a predetermined magnification (coefficient A) to a positive value when expressing a smoke image as white smoke, and sets the predetermined magnification (coefficient A) to a negative value when expressing a smoke image as black smoke. As a result, in the image generating device 10 of the embodiment, the color of the smoke can be controlled by simply setting the sign of the coefficient A to a positive value or a negative value.

[0062] For example, when pixel values ​​are expressed using RGB from 0 to 255, white is (255, 255, 255) and black is (0, 0, 0). Utilizing this property, in this embodiment, for example, in equation (1), by setting coefficient A to a positive value, the pixel values ​​of the composite image GG become larger and approach white. Also, by setting coefficient A to a negative value, the pixel values ​​of the composite image GG become smaller and approach black.

[0063] The image generating device 10 of the embodiment further includes an input unit 102 and a display unit 103. The display unit 103 displays a guide GD together with the target image TG. The guide GD is a display that guides the user to the color of smoke corresponding to the object that is the source of the fire. A user operation is input to the input unit 102. The generating unit 101 generates a composite image GG by combining a smoke image of a color specified by the operation input to the input unit 102 with the target image TG. In this way, the image generating device 10 of the embodiment can support the user's operation so that a more natural composite image GG is generated.

[0064] The fire detection system 1 of the embodiment also includes an image acquisition unit 100, a generation unit 101, and an operation determination unit 202. The fire detection system 1 is an example of an "operation confirmation system." The operation determination unit is an example of a "determination unit." The operation determination unit 202 uses the composite image GG to determine whether the smoke detection device 30, which is provided in the target area T and determines whether smoke is occurring in the target area T based on the image, is operating correctly. As a result, in the fire detection system 1 of the embodiment, it is possible to confirm that the smoke detection device 30 is operating correctly at the scene using an image of the scene, thereby improving the reliability of the smoke detection device 30.

[0065] (Modification 1 of the embodiment) A first modification of the embodiment will be described below. This modification differs from the above-described embodiment in that a smoke image having a size according to the depth of the captured space is synthesized with the target image TG.

[0066] In this modification, a landmark object, for example, a marker M (see FIG. 7), is placed in the target area T to detect the depth of the space captured in the target image TG.

[0067] 7 is a diagram illustrating the marker M. The marker M is, for example, an object having a specified length as shown in FIG. For example, the marker M is an object shaped like a pole with spheres attached to both ends. Such a marker M is placed along the imaging direction, and the space in which the marker M is placed is imaged by the camera CA. Alternatively, a test image with a marker M placed thereon may be captured in advance, and multiple spaces OY (see Figure 9A) according to depth may be formed based on the captured test image, and the parameters to be used when generating the composite image GG may be set in advance so that a smoke image of a size according to the formed spaces OY can be synthesized. Furthermore, the marker M is not limited to the example in Fig. 7. The marker M may have any shape as long as it is at least a marker and the size of the marker can be confirmed in the target image TG. For example, the marker M may be formed of a two-dimensional code or the like, and the position and size of the marker may be automatically detected by a program or the like.

[0068] Here, a method for synthesizing a smoke image of a size according to depth in this modification will be described with reference to Fig. 8 and Fig. 9 (Figs. 9A and 9B). Fig. 8 is a diagram showing an example of a target image TG according to the modification 1 of the embodiment. Fig. 9 is a diagram showing an example of a synthesized image GG according to the modification 1 of the embodiment.

[0069] As shown in FIG. 8, in this modification, a target image TG (or a test image) including one or more markers M (in this figure, multiple markers M1 to M5) is captured and displayed on the display unit 103. 9A, the image generating device 10 detects the depth of the space based on the positions of the markers M, and forms a plurality of spaces OY (spaces OY1 to OY5) according to the detected depth. The spaces OY appear to be of different sizes in the target image TG, but are spaces of approximately the same size in real space. As shown in FIG. 9B, the image generation device 10 determines the size of the smoke image to be synthesized depending on which space OY the object selected by the user is located in. For example, when synthesizing a smoke image for a vehicle located in space OY5, which is located closer to the camera CA in the imaging direction and appears relatively large, the image generation device 10 synthesizes a relatively large smoke image. On the other hand, when synthesizing a smoke image for a vehicle located in space OY2, which is located further back in the imaging direction and appears relatively small, the image generation device 10 synthesizes a relatively small smoke image. This makes it possible to more realistically reproduce a situation in which the size of the smoke captured in the target image TG varies depending on the location of the fire, even when fires of similar scale are assumed.

[0070] As described above, in the image generating device 10 according to the first modification of the embodiment, the target image TG includes depth information indicating the depth of the target region T, for example, image information of a marker M indicating a known length. The generating unit 101 generates a composite image GG by combining a smoke image of a size corresponding to the depth information with the target image TG. This makes it possible in the first modification of the embodiment to identify the depth of the space captured in the target image TG, and to resize the size of the smoke image to be combined with an object existing in the space corresponding to that depth according to the identified depth. Therefore, regardless of where smoke is intended to be generated in the target region T, a composite image GG that approximates the size of the smoke that is actually generated can be generated.

[0071] (Modification 2 of the embodiment) A second modification of the embodiment will be described below. This modification differs from the above-described embodiment in that the composite image GG is used for evacuation drills. In evacuation drills, it is important to create a situation similar to a real fire, allowing participants to experience what would happen if a real fire broke out and how to evacuate. In normal evacuation drills, a situation similar to a real fire is created by sending a false signal to a fire alarm or the like, causing it to issue a fire warning. In this modification, a composite image GG is displayed during the evacuation drill. This allows participants to visually see the space around them engulfed in flames. This allows participants to more realistically experience what would happen if a real fire broke out.

[0072] The fire detection system 1, image generation device 10, and operation control device 20 in the above-described embodiment may be implemented in whole or in part by a computer. In this case, a program for implementing the functions may be recorded on a computer-readable recording medium and loaded and executed by a computer system. Note that the term "computer system" as used herein includes hardware such as an operating system and peripheral devices. Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into a computer system. Furthermore, the term "computer-readable recording medium" may also include devices that dynamically store programs for a short period of time, such as communication lines used when transmitting programs over a network such as the Internet or a telephone line, or devices that store programs for a fixed period of time, such as volatile memory within a computer system serving as a server or client. The program may also be designed to implement some of the functions described above, or may be capable of implementing the functions in combination with a program already stored in the computer system, or may be implemented using a programmable logic device such as an FPGA.

[0073] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of the present invention. [Explanation of symbols]

[0074] 1...Fire detection system (operation confirmation system) 10...Image generating device 100...Image acquisition unit 101...Generation section 102...input section 103…Display section 20...Motion control device 202...Operation judgment section (judgment section) 30...Smoke detection device

Claims

1. An acquisition unit that acquires a target image in which a target area, which is a roadway or a tunnel premises, is captured; an input unit into which a user operation is input; a generating unit that generates a composite image by combining the target image acquired by the acquiring unit with a smoke image that can be expressed as white smoke or black smoke, and that is specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit; a display unit that displays a guide; Equipped with The guide indicates the color of the smoke according to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or a cable fire, The composite image is used to determine whether a smoke detection device provided in the target area, which determines whether smoke is occurring in the target area based on the image, is operating correctly. Image generating device.

2. The generation unit generates the composite image having pixel values ​​that are sums of pixel values ​​of the target image and values ​​obtained by multiplying pixel values ​​of the smoke image by a predetermined magnification. The image generating device of claim 1 .

3. The generation unit sets the predetermined magnification to a positive value when the smoke image is represented as white smoke, and sets the predetermined magnification to a negative value when the smoke image is represented as black smoke. The image generating device of claim 2 .

4. the target image includes depth information indicating the depth of the target region; The generation unit generates the composite image by combining a smoke image having a size according to the depth information with the target image. The image generating device of claim 1 .

5. An acquisition unit that acquires a target image in which a target area, which is a roadway or a tunnel premises, is captured; an input unit into which a user operation is input; a generating unit that generates a composite image by combining the target image acquired by the acquiring unit with a smoke image that can be expressed as white smoke or black smoke, and that is specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit; a display unit that displays a guide; a determination unit that determines whether a smoke detection device provided in the target area, which determines whether smoke is occurring in the target area based on the image, operates correctly using the composite image; and Equipped with The guide indicates the color of the smoke according to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or a cable fire. Operation check system.

6. An image generation method performed by an image generation device that is a computer, comprising: an acquisition unit acquires a target image in which a target area, which is a roadway or a tunnel premises, is captured; A user operation is input to the input unit, a generation unit generates a composite image by combining the target image acquired by the acquisition unit with a smoke image that can be expressed as white smoke or black smoke, and the smoke image is specified as either white smoke or black smoke depending on the source of the fire by an operation input to the input unit; The display unit displays a guide, The guide indicates the color of the smoke according to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or a cable fire, The composite image is used to determine whether a smoke detection device provided in the target area, which determines whether smoke is occurring in the target area based on the image, is operating correctly. Image generation method.

7. The image generating device is a computer. acquiring a target image in which a target area, which is a roadway or a tunnel premises, is captured; The user inputs an operation, generating a composite image by combining the acquired target image with a smoke image that can be expressed as white smoke or black smoke, and that has been designated as either white smoke or black smoke depending on the source of the fire by the input operation; Display the guide, The guide indicates the color of the smoke according to the object that is the source of the fire, and for black smoke, the guide indicates that the color corresponds to one or more of a gasoline or vehicle fire, and for white smoke, the guide indicates that the color corresponds to one or more of an electrical device or a cable fire, The composite image is an image used to determine whether a smoke detection device provided in the target area, which determines whether smoke is occurring in the target area based on the image, is operating correctly. program.

Images