Disaster prevention equipment installation confirmation system

Abstract

To obtain a disaster prevention device installation confirmation system that makes it possible to confirm the installation of a disaster prevention device by a user with less knowledge on the disaster prevention device and its installation.SOLUTION: The system of the present invention includes: a photographing section for photographing a room where a disaster prevention device for monitoring a fire is installed; a photographed image determination section for determining a recommended installation position and a non-recommended installation position of the disaster prevention device in the room on an image photographed by the photographing section; and a display section for displaying an augmented reality image where the image photographed by the photographing section is superimposed on one of or both of the recommended installation position and the non-recommended installation position based on a determination result of the photographed image determination section.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a disaster prevention equipment installation confirmation system. [Background technology]

[0002] There are various types of disaster prevention equipment or facilities for protecting oneself by alerting people to disasters such as fires or earthquakes, evacuating, or taking initial action, such as fire extinguishing equipment such as fire hydrants, and alarm equipment such as automatic fire alarm systems or residential fire alarms.Even after disaster prevention equipment has been installed, it is desirable to regularly inspect the appropriateness of the installation status and the condition of the disaster prevention equipment so that it can be used appropriately in the event of a disaster.

[0003] Among various disaster prevention equipment, some are required to undergo regular inspections under the Fire Service Act, and for example, fire extinguishing equipment is required to undergo regular inspections twice a year. For example, Patent Document 1 discloses a system that is equipped with a smart meter that can communicate with devices on the Internet, and determines the state of the equipment, such as the degree of deterioration, from the status of the equipment operation during regular inspections, etc. A management system for fire extinguishing equipment has been proposed that can determine and report a fire. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2022-144879 Summary of the Invention [Problem to be solved by the invention]

[0005] The fire extinguishing equipment described in Patent Document 1 is installed in a location dedicated to disaster prevention equipment, such as a pump room in the basement of a building. In such a location dedicated to disaster prevention equipment, the environment is generally maintained so that the installed disaster prevention equipment can fully perform its intended functions. In addition, since a location dedicated to disaster prevention equipment is not a place where ordinary people stay for long periods of time to live or work, there is little change in the environment caused by people.

[0006] However, some disaster prevention devices, such as fire detectors or residential fire alarms, are installed indoors in homes, apartment buildings, office buildings, commercial buildings, hotels, and other buildings. In these places where people spend relatively long periods of time living or working, the installation environment of indoor furniture or home appliances may be changed for purposes other than disaster prevention, such as improving people's comfort. This change in the environment surrounding the existing disaster prevention devices can render them inappropriate for performing their intended functions. Furthermore, users with little knowledge about disaster prevention devices and their installation can have difficulty installing them in the appropriate indoor locations.

[0007] The present invention has been made against the backdrop of the above-mentioned problems, and provides a disaster prevention equipment installation confirmation system that can assist users with little knowledge about disaster prevention equipment and its installation in installing disaster prevention equipment, and can confirm the installation status and suitability of the installation location. [Means for solving the problem]

[0008] The disaster prevention equipment installation confirmation system of the present invention comprises an imaging unit that photographs a room or building in which disaster prevention equipment is installed, an image capture judgment unit that determines recommended and non-recommended installation positions for the disaster prevention equipment within the room in the image captured by the imaging unit, and a display unit that displays an augmented reality image in which the image captured by the imaging unit and either or both of the recommended installation position and the non-recommended installation position are superimposed based on the judgment result of the image capture judgment unit.

[0009] Another disaster prevention equipment installation confirmation system according to the present invention includes a floor plan acquisition unit that acquires a three-dimensional floor plan of a room in which disaster prevention equipment that performs fire monitoring is installed, a floor plan determination unit that determines recommended installation positions and non-recommended installation positions of the disaster prevention equipment within the room on the acquired three-dimensional floor plan, and a display unit that displays an image in which the three-dimensional floor plan acquired by the floor plan acquisition unit is superimposed on either or both of the recommended installation positions and the non-recommended installation positions based on the determination result of the floor plan determination unit. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a user with an augmented reality image in which recommended and non-recommended installation positions for disaster prevention equipment are superimposed on a captured image of a room in which disaster prevention equipment for fire monitoring is installed, thereby enabling even users with little knowledge about disaster prevention equipment and its installation to more appropriately install the disaster prevention equipment.

[0011] Furthermore, according to another disaster prevention equipment installation confirmation system of the present invention, it is possible to provide a user with an image in which recommended and non-recommended installation positions of the disaster prevention equipment are superimposed on a three-dimensional floor plan of the room in which the disaster prevention equipment for fire monitoring will be installed, thereby enabling even users with little knowledge about disaster prevention equipment and its installation to install the disaster prevention equipment more appropriately. [Brief explanation of the drawings]

[0012] [Figure 1] 1A and 1B are a functional block diagram and a display example of a disaster prevention equipment installation confirmation system according to a first embodiment; [Figure 2] 10 is a functional block diagram and a display example of a disaster prevention equipment installation confirmation system according to a second embodiment. [Figure 3] FIG. 11 is a functional block diagram of a disaster prevention equipment installation confirmation system according to a third embodiment. [Figure 4] 10A and 10B are diagrams illustrating examples of displays on a display unit according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments, and various modifications are possible without departing from the spirit of the present invention. Furthermore, the present invention includes all possible combinations of the configurations shown in the following embodiments. Furthermore, the devices shown in the drawings are examples of the system of the present invention, and the system of the present invention is not limited to the devices shown in the drawings. Furthermore, in each drawing, parts with the same reference numerals are the same or equivalent, and this is common throughout the entire specification.

[0014] Embodiment 1 1 is a functional block diagram and a display example of a disaster prevention equipment installation confirmation system 100 according to the first embodiment. The disaster prevention equipment installation confirmation system 100 (hereinafter referred to as the installation confirmation system 100) displays, as an augmented reality image, an image of a room in which a disaster prevention equipment for fire monitoring is installed, with either or both of a recommended installation position and a non-recommended installation position of the disaster prevention equipment superimposed thereon. Here, in the examples, the disaster prevention equipment will be described using a fire detector for fire monitoring or a residential fire alarm (hereinafter referred to as a residential alarm), but other disaster prevention equipment may also be a sprinkler head installed on the ceiling or the like in a room, a fire extinguisher installed in a room or in a building, etc.

[0015] The installation confirmation system 100 includes a photographing unit 1, an image recognition unit 2, a photographed image determination unit 3, a disaster prevention equipment recognition unit 4, an installation condition determination unit 5, an indoor recognition unit 6, a recommended equipment determination unit 7, a memory unit 8, and a display unit 10.

[0016] The photographing unit 1 is a camera device that photographs the interior of a room where disaster prevention equipment is installed and creates video data. The photographing unit 1 may be a camera device built into a mobile terminal such as a smartphone, tablet, or portable game console, or may be a camera module connected to a mobile terminal or a personal computer. A user adjusts the photographing direction of the photographing unit 1 to photograph the interior of the room from multiple directions, thereby creating video data of a wide range of the interior of the room.

[0017] The image recognition unit 2 extracts the indoor structure such as the ceiling and walls, as well as indoor objects such as disaster prevention equipment, lighting, furniture, and air conditioners, by performing image recognition on the images that make up the video data captured by the capture unit 1. The image recognition unit 2 extracts the indoor structure and objects by using a known extraction technique that identifies the outlines of objects included in the images that make up the video data.

[0018] Furthermore, the image recognition unit 2 may extract indoor structures and objects using machine learning. For example, the image recognition unit 2 extracts indoor structures and objects using an image recognition model that uses training data stored in the storage unit 8. The image recognition unit 2 has a trained image recognition model, and when an image of video data captured by the image capture unit 1 is input, the image recognition unit 2 recognizes indoor structures and objects contained in the image using the image recognition model. The image recognition unit 2 also stores the image captured by the image capture unit 1 as training data in the storage unit 8 as new training data and updates the image recognition model. Furthermore, if the image recognition unit 2 makes an incorrect extraction, that is, if indoor structures and objects are not correctly extracted or if existing structures and objects are not extracted, the user can select the relevant structures and objects on the display unit 10 and input the correct results. This result can also be stored in the storage unit 8 as training data and used as new training data.

[0019] 1 illustrates an image of a real space A1 captured by a capturing unit 1. The real space A1 includes a ceiling A2, a wall A3, a disaster prevention device A4 that is a home alarm, an air conditioner A5, and a chest of drawers A6. The image recognition unit 2 extracts each of the indoor structures and objects included in the image of the real space A1.

[0020] The captured image determination unit 3 determines recommended and non-recommended installation locations for disaster prevention equipment within a room based on the indoor structure and objects in the image recognized by the image recognition unit 2. The installation locations and positions of disaster prevention equipment installed within a room are regulated by the Fire Service Act or municipal ordinances. For example, home alarms are required to be installed on the ceiling or wall. When a home alarm is installed on a ceiling, the distance from the wall or beam to the alarm, the distance from heat sources such as lighting equipment or cooking appliances, and the distance from air outlets such as air conditioners are also regulated. When a home alarm is installed on a wall, the distance from the ceiling to the alarm is also regulated. Furthermore, it is necessary to avoid installing home alarms in places where a lot of smoke not caused by fire, such as dust in a garage, where a lot of water or steam is generated, such as in a bathroom, or directly above furniture such as a dresser. Similarly, various regulations regarding installation apply to fire detectors.

[0021] The captured image determination unit 3 determines a portion of the indoor area that satisfies the installation conditions as a recommended installation location, and a portion that does not satisfy the installation conditions as a non-recommended installation location, based on the indoor structure and objects in the image recognized by the image recognition unit 2 and the installation conditions for the disaster prevention equipment pre-stored in the storage unit 8. The captured image determination unit 3 may determine the degree of recommendation for the installation location of the disaster prevention equipment in multiple stages. The captured image determination unit 3 may determine a recommended installation location or a non-recommended installation location for each type of disaster prevention equipment, such as a smoke detector or a heat detector, based on the installation conditions stored in the storage unit 8 for each type of disaster prevention equipment.

[0022] The disaster prevention equipment recognition unit 4 extracts the disaster prevention equipment in the room from the image recognized by the image recognition unit 2. Furthermore, the disaster prevention equipment recognition unit 4 recognizes the type of the extracted disaster prevention equipment based on information such as the outline and color of the disaster prevention equipment extracted by the image recognition unit 2 and the correspondence between the information and the type of disaster prevention equipment stored in advance in the storage unit 8. For example, the disaster prevention equipment recognition unit 4 recognizes whether the disaster prevention equipment included in the image is a smoke detector, a heat detector, or the like.

[0023] The installation condition determination unit 5 determines whether the disaster prevention equipment recognized by the disaster prevention equipment recognition unit 4 satisfies the recommended installation conditions for that disaster prevention equipment. The memory unit 8 pre-stores the size of the disaster prevention equipment, such as a detector or home alarm, to be installed, as well as the recommended installation conditions for each disaster prevention equipment. The installation condition determination unit 5 has a function for calculating the distance from the disaster prevention equipment to its installation location, such as a ceiling or wall, based on the size of the disaster prevention equipment stored in the memory unit 8, and determines whether the recognized disaster prevention equipment matches the recommended installation conditions for the room in the image. For example, if the recognized disaster prevention equipment is a home alarm, the installation condition determination unit 5 determines whether the distance from the ceiling, the distance from the wall, the distance from the air conditioner, and the distance from the dresser are each within the range of the recommended installation conditions. The installation condition determination unit 5 retains the determination results for each recommended installation condition determined for the target disaster prevention equipment, and these determination results are used for display on the display unit 10, described below.

[0024] The indoor recognition unit 6 recognizes the indoor use in the image recognized by the image recognition unit 2. Examples of indoor uses include kitchen, living room, bedroom, office, and store. Specifically, the storage unit 8 stores, as an indoor recognition table, the degree of association between each object that can be installed in a room, such as furniture and home appliances, and the indoor use, such as kitchen, living room, or bedroom. For example, for a microwave oven, the presence or absence of association between the object and the indoor use, along with the degree of association, is stored, such as a high degree of association with the kitchen, a medium degree of association with the living room, and no degree of association with the bedroom. The indoor recognition unit 6 recognizes the indoor use by adding up the degrees of association between each indoor object recognized by the image recognition unit 2 and each indoor use.

[0025] The recommended equipment determination unit 7 determines the type of disaster prevention equipment recommended for installation in a room based on the indoor use recognized by the indoor use recognition unit 6. The storage unit 8 stores an application equipment table that associates indoor uses with recommended types of disaster prevention equipment, and the recommended equipment determination unit 7 extracts recommended disaster prevention equipment based on the application equipment table. For example, if the indoor use is a kitchen, a heat-type home alarm is extracted as the recommended disaster prevention equipment to prevent false alarms due to cooking steam, etc.

[0026] The display unit 10 displays to the user the results of the determination made by the captured image determination unit 3, the installation condition determination unit 5, and the recommended device determination unit 7. The display unit 10 includes a display such as a liquid crystal display or an organic EL display. The display unit 10 may be provided in a mobile terminal such as a smartphone, tablet, or portable game console, or may be a display of a personal computer or a head-mounted display.

[0027] The storage unit 8 stores the various types of information described above. The storage unit 8 is a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM. Data is written to and read from the storage unit 8 by the image recognition unit 2, the captured image determination unit 3, the disaster prevention equipment recognition unit 4, the installation condition determination unit 5, the indoor recognition unit 6, and the recommended equipment determination unit 7. The storage areas of the storage unit 8 used by each functional unit may be independent hardware.

[0028] The image recognition unit 2, captured image determination unit 3, disaster prevention equipment recognition unit 4, installation condition determination unit 5, indoor recognition unit 6, and recommended equipment determination unit 7 are realized by one or more processing circuits. The processing circuit includes a memory and a processor such as a central processing unit (CPU), MPU (micro processing unit), or GPU (graphics processing unit) that executes programs stored in the memory. The functions of the image recognition unit 2, captured image determination unit 3, disaster prevention equipment recognition unit 4, installation condition determination unit 5, indoor recognition unit 6, and recommended equipment determination unit 7 are realized by software, firmware, or a combination of software and firmware. When the image recognition unit 2, captured image determination unit 3, disaster prevention equipment recognition unit 4, installation condition determination unit 5, indoor recognition unit 6, and recommended equipment determination unit 7 are realized by multiple processing circuits, the respective processing circuits may be physically distributed in different locations or may be implemented in a single device such as a server. A device communicatively connected to a mobile terminal equipped with an image capturing unit 1 and a display unit 10 may be equipped with a processing circuit that realizes an image recognition unit 2, a captured image determination unit 3, a disaster prevention equipment recognition unit 4, an installation condition determination unit 5, an indoor recognition unit 6, and a recommended equipment determination unit 7.

[0029] FIG. 1 shows an augmented reality image B1 as an example of display on the display unit 10. The augmented reality image B1 is an image in which a recommended installation position B2 is superimposed on a real space image B3 captured by the image capture unit 1. The real space image B3 is updated and displayed in real time according to the subject captured by the image capture unit 1. The recommended installation position B2 is a recommended installation position for the disaster prevention equipment determined by the captured image determination unit 3. In the example of FIG. 1, an area that is a collection of positions where the disaster prevention equipment is recommended to be installed is displayed as a shaded area as the recommended installation position B2. Areas of the real space image B3 where the recommended installation position B2 is not displayed display the captured real space as is, and these areas are non-recommended installation positions. Note that the display unit 10 may superimpose a non-recommended installation position on the real space image B3 instead of displaying the recommended installation position B2, or may superimpose both the recommended installation position and the non-recommended installation position on the real space image B3. Furthermore, when the captured image determination unit 3 determines the degree of recommendation for the installation position of the disaster prevention equipment in multiple stages, the display of the recommended installation position B2 may be changed depending on the degree of recommendation. Furthermore, when the captured image determination unit 3 determines the recommended installation position and the non-recommended installation position for each type of disaster prevention equipment, information on the disaster prevention equipment selected by the user from multiple types may be displayed. The recommended installation position and the non-recommended installation position are displayed using one or more of the following that can be visually distinguished from the real space, such as figures, images, characters, and colors.

[0030] Additionally, in the augmented reality image B1 of FIG. 1, a determination result display B4 is displayed superimposed on the real space image B3. The determination result display B4 is the determination result of whether or not the disaster prevention equipment satisfies the recommended installation conditions, as determined by the installation condition determination unit 5. In the example of FIG. 1, the determination result display B4 displays the determination result that the home alarm does not satisfy the recommended installation conditions. If the disaster prevention equipment satisfies the recommended installation conditions, this is displayed by the determination result display B4. In the example of FIG. 1, the determination result display B4 is a combination of text and an image, but any display mode using any one of figures, images, text, and colors, or a combination of these, can be adopted.

[0031] Additionally, in the augmented reality image B1 of FIG. 1, a determination cause display B5 is displayed superimposed on the real-space image B3. The determination cause display B5 is information regarding the reason why the installation condition determination unit 5 determined that the disaster prevention equipment does not meet the recommended installation conditions. In the example of FIG. 1, the determination cause display B5 is a graphic superimposed on the disaster prevention equipment A4, the ceiling A2, the wall A3, and the dresser A6. In this example, the disaster prevention equipment A4 installed on the ceiling A2 is not located a predetermined distance from the wall A3 and is installed directly above the dresser A6, which does not meet the recommended installation conditions in these two points. Therefore, the determination cause display B5 is displayed superimposed on these causative structures or objects. Note that while the determination cause display B5 is a graphic in the example of FIG. 1, any display mode, such as a graphic, image, text, color, or a combination thereof, may be adopted. Also, while FIG. 1 shows an example in which the determination result display B4 and the determination cause display B5 are displayed as separate display items, they may also be displayed as a single display item. For example, the text in the judgment result display B4 in Figure 1 may be displayed to indicate both the judgment result and the cause, such as "The ceiling-mounted home alarm is too close to the wall and directly above the dresser, so it does not meet the installation conditions."

[0032] Although not shown in FIG. 1, the augmented reality image B1 may display the type of disaster prevention equipment that is recommended for installation in the room, as determined by the recommended equipment determination unit 7. Alternatively, the type of disaster prevention equipment that is recommended for installation may be displayed on the display unit 10 separately from the augmented reality image B1. For example, the display unit 10 displays text such as "It is recommended that a smoke-type residential fire alarm be installed in the bedroom."

[0033] As described above, the installation confirmation system 100 of this embodiment includes the photographing unit 1 that photographs a room or a building in which disaster prevention equipment is installed, and the photographed image determination unit 3 that determines recommended and non-recommended installation positions for the disaster prevention equipment within the room in the image photographed by the photographing unit 1. Based on the determination result of the photographed image determination unit 3, the display unit 10 of the installation confirmation system 100 displays an augmented reality image B1 in which the image photographed by the photographing unit 1 is superimposed on either or both of the recommended and non-recommended installation positions.

[0034] In this way, the real-space image and either or both of the recommended and non-recommended installation locations for disaster prevention equipment are superimposed on each other, so that a user can take a photo of the location where they want to install the disaster prevention equipment and input it into the system of the present invention, thereby knowing where in the actual room the disaster prevention equipment should be installed, or where installation is not recommended. Therefore, even users with little knowledge about disaster prevention equipment and its installation can install the disaster prevention equipment more appropriately.

[0035] The installation confirmation system 100 of this embodiment also includes a disaster prevention equipment recognition unit 4 that recognizes disaster prevention equipment from the image captured by the imaging unit 1, and an installation condition determination unit 5 that determines whether the recognized disaster prevention equipment satisfies the recommended installation conditions for the disaster prevention equipment in the room. The display unit 10 displays an image in which the image captured by the imaging unit 1 and the determination result of the installation condition determination unit 5 are superimposed.

[0036] In this way, whether or not the disaster prevention equipment installed indoors meets the recommended installation conditions can be confirmed on the display unit 10, so even users with little knowledge about disaster prevention equipment and its installation can install the disaster prevention equipment more appropriately. Furthermore, even if the disaster prevention equipment no longer meets the recommended installation conditions after being installed by a professional due to rearrangement or the like, the user can recognize by checking the display unit 10 that the disaster prevention equipment no longer meets the recommended installation conditions. This allows users to install and maintain the disaster prevention equipment themselves.

[0037] Furthermore, the display unit 10 of the installation confirmation system 100 of this embodiment displays, in addition to the judgment result of the installation condition judgment unit 5, information regarding the reason why the installation condition judgment unit 5 judged that the recommended installation conditions were not met.

[0038] In this way, the reason why the disaster prevention equipment does not meet the recommended installation conditions is shown on the display unit 10, so that the user can easily rearrange the disaster prevention equipment or objects in the room such as dressers so that the disaster prevention equipment meets the recommended installation conditions.

[0039] In addition, the installation confirmation system 100 of this embodiment is equipped with an indoor recognition unit 6 that recognizes the indoor use in the image captured by the photographing unit 1, and a display unit 10 that outputs the type of disaster prevention equipment that is recommended to be installed in the room, determined based on the indoor use recognized by the indoor recognition unit 6.

[0040] In this way, the display unit 10 indicates disaster prevention equipment that is recommended for installation indoors, making it easier for the user to select and install appropriate disaster prevention equipment, thereby promoting the installation of disaster prevention equipment. Note that, although an example has been shown in which the determination result of the recommended equipment determination unit 7 is visually output by the display unit 10 serving as an output unit, instead of or in addition to the display by the display unit 10, the type of disaster prevention equipment that is recommended for installation may be output by a speaker that outputs audio.

[0041] Embodiment 2 In the embodiment, an example was shown in which various information was displayed superimposed on an actual photographed image, but in this embodiment, an example is described in which various information regarding the installation of disaster prevention equipment is displayed superimposed on a floor plan. In this embodiment, the differences from embodiment 1 are mainly described.

[0042] 2 is a functional block diagram and a display example of a disaster prevention equipment installation confirmation system 101 according to embodiment 2. The installation confirmation system 101 includes a floor plan acquisition unit 11, a floor plan determination unit 12, a storage unit 8, and a display unit 10. The hardware configurations of the storage unit 8 and the display unit 10 are the same as those exemplified in embodiment 1.

[0043] The floor plan acquisition unit 11 acquires a three-dimensional floor plan of a room in which disaster prevention equipment for fire monitoring is installed. FIG. 2 illustrates a three-dimensional floor plan C1. The floor plan acquisition unit 11 extracts the contours of the interior structure and objects from the image of the room captured by the image capture unit 1 described in the first embodiment, and generates a three-dimensional floor plan by modeling the extracted contours. In this case, the floor plan acquisition unit 11 is realized by one or more processing circuits. The processing circuit includes a memory and a processor such as a central processing unit, MPU, or GPU that executes a program stored in the memory.

[0044] Furthermore, the floor plan acquisition unit 11 may acquire, for example, a three-dimensional floor plan generated outside the installation confirmation system 101 by data transfer. In this case, the floor plan acquisition unit 11 is configured with a receiving circuit that acquires data from the device that generated the three-dimensional floor plan.

[0045] The floor plan determination unit 12 determines recommended and non-recommended installation positions of disaster prevention equipment within a room in the three-dimensional floor plan acquired by the floor plan acquisition unit 11. As described in the first embodiment, the disaster prevention equipment that monitors for fires within a room is a fire detector or a home alarm, and installation conditions regarding the installation location and position are defined for these. Based on the three-dimensional floor plan and the installation conditions for the disaster prevention equipment stored in advance in the storage unit 8, the floor plan determination unit 12 determines parts of the room in the three-dimensional floor plan that satisfy the installation conditions as recommended installation positions, and determines parts that do not satisfy the installation conditions as non-recommended installation positions.

[0046] The display unit 10 displays an image in which the three-dimensional floor plan acquired by the floor plan acquisition unit 11 is superimposed on one or both of the recommended installation positions and non-recommended installation positions of disaster prevention equipment.

[0047] In FIG. 2, recommended installation positions C2 are displayed superimposed on the three-dimensional floor plan C1 acquired by the floor plan acquisition unit 11. The recommended installation positions C2 are an area that is a collection of positions where disaster prevention equipment installation is recommended, and are displayed with a shaded area in the example of FIG. 2. Areas of the three-dimensional floor plan C1 where the recommended installation positions C2 are not displayed display the three-dimensional floor plan C1 as is, and these areas are non-recommended installation positions. Note that the display unit 10 may display non-recommended installation positions superimposed on the three-dimensional floor plan C1 instead of displaying the recommended installation positions C2, or may display both the recommended installation positions and the non-recommended installation positions superimposed on the three-dimensional floor plan C1. Furthermore, when the floor plan determination unit 12 determines the degree of recommendation of the installation positions of disaster prevention equipment in multiple stages, the display of the recommended installation positions C2 may be different depending on the degree of recommendation. The recommended installation positions and non-recommended installation positions are displayed by one or more of the following means that can be visually distinguished from the real space, such as figures, images, characters, and colors.

[0048] As described above, the installation confirmation system 101 of this embodiment includes the floor plan acquisition unit 11 that acquires a three-dimensional floor plan of a room in which disaster prevention equipment that performs fire monitoring is installed, and the floor plan determination unit 12 that determines recommended installation positions and non-recommended installation positions of the disaster prevention equipment within the room shown in the acquired three-dimensional floor plan. Based on the determination result of the floor plan determination unit 12, the display unit 10 of the installation confirmation system 101 displays an image in which the three-dimensional floor plan acquired by the floor plan acquisition unit 11 is superimposed on either or both of the recommended installation positions and the non-recommended installation positions.

[0049] In this way, the three-dimensional floor plan and either or both of the recommended and non-recommended installation locations for disaster prevention equipment are superimposed on each other, making it easier for users to understand where to install the disaster prevention equipment in the actual room. Therefore, even users with little knowledge about disaster prevention equipment and its installation can install the equipment more appropriately.

[0050] Embodiment 3 In this embodiment, a system for confirming the installation of disaster prevention equipment by a user using both an augmented reality image and a three-dimensional floor plan will be described. In this embodiment, differences from the first and second embodiments will be mainly described.

[0051] 3 is a functional block diagram of a disaster prevention equipment installation confirmation system 102 according to embodiment 3. The installation confirmation system 102 includes a photographing unit 1, an image recognition unit 2, a photographed image determination unit 3, a disaster prevention equipment recognition unit 4, an installation condition determination unit 5, an indoor recognition unit 6, a recommended equipment determination unit 7, a storage unit 8, a display unit 10, a floor plan acquisition unit 11, and a floor plan determination unit 12, which have the functions and structures described in embodiment 1 or embodiment 2.

[0052] 3 extracts the structure of the room and the contours of objects from the image of the room captured by the imaging unit 1, and generates a three-dimensional floor plan by modeling the extracted contours. As described in the second embodiment, the floor plan acquisition unit 11 may acquire a three-dimensional floor plan generated outside the installation confirmation system 101 by data transfer.

[0053] Fig. 4 is a diagram illustrating a display example of the display unit 10 according to the third embodiment. Fig. 4 illustrates a case where the display unit 10 is a display of a smartphone 20. The display unit 10 according to the present embodiment simultaneously displays an augmented reality image B1 in which a recommended installation position B2 is superimposed on a real space image B3, and a model image C3 in which the recommended installation position C2 is superimposed on a three-dimensional floor plan C1.

[0054] Therefore, according to this embodiment, the user can check and consider the installation location of the disaster prevention equipment based on both the augmented reality image B1 and the model image C3, which have different appearances. Therefore, even a user with little knowledge about disaster prevention equipment and its installation can install the disaster prevention equipment more appropriately.

[0055] The model image C3 can also be used for simulations of disaster prevention equipment installation. For example, the display unit 10 displays the disaster prevention equipment in a simulated manner overlaid on a three-dimensional floor plan C1. The simulated disaster prevention equipment can be moved on the three-dimensional floor plan C1 in response to user input. This allows the user to easily consider installing the disaster prevention equipment in a recommended installation location that is convenient or suitable for the user's preferences, while comparing the augmented reality image B1 in which the disaster prevention equipment is installed with the model image C3 in which the disaster prevention equipment is simulated. In this case, the installation condition determination unit 5 may determine whether the disaster prevention equipment virtually placed on the model image C3 satisfies the recommended installation conditions, and the display unit 10 may display the determination result.

[0056] The augmented reality image B1 can also be used for simulations. For example, the display unit 10 displays a simulated disaster prevention device overlaid on the real space image B3. The simulated disaster prevention device can be moved in the real space image B3 in response to user input. This allows the user to easily consider installing the disaster prevention device in a recommended installation location that is convenient or suitable for the user's preferences, while comparing the model image C3 with the augmented reality image B1 in which the disaster prevention device is installed. In this case, the installation condition determination unit 5 may determine whether the disaster prevention device installed in the augmented reality image B1 satisfies the recommended installation conditions, and the display unit 10 may display the determination result. [Explanation of symbols]

[0057] 1 photography unit, 2 image recognition unit, 3 photographed image judgment unit, 4 disaster prevention equipment recognition unit, 5 installation condition judgment unit, 6 indoor recognition unit, 7 recommended equipment judgment unit, 8 memory unit, 10 display unit, 11 floor plan acquisition unit, 12 floor plan judgment unit, 20 smartphone, 100 installation confirmation system, 101 installation confirmation system, 102 installation confirmation system, A1 real space, A2 ceiling, A3 wall, A4 disaster prevention equipment, A5 air conditioner, A6 chest of drawers, B1 augmented reality image, B2 recommended installation position, B3 real space image, B4 judgment result display, B5 judgment cause display, C1 three-dimensional floor plan, C2 recommended installation position, C3 model image.

Claims

1. an imaging unit that images a room or a building in which the disaster prevention equipment is installed; a captured image determination unit that determines recommended installation positions and non-recommended installation positions of disaster prevention equipment in the room in the image captured by the imaging unit; a display unit that displays an augmented reality image in which the image captured by the image capturing unit and either or both of the recommended installation position and the non-recommended installation position are superimposed based on the determination result of the captured image determination unit. A system for verifying the installation of disaster prevention equipment.

2. a disaster prevention equipment recognition unit that recognizes disaster prevention equipment from the image captured by the imaging unit; an installation condition determination unit that determines whether the recognized disaster prevention equipment satisfies the recommended installation conditions for the disaster prevention equipment in the room; The display unit displays an image in which the image captured by the image capturing unit and the determination result of the installation condition determination unit are superimposed. The disaster prevention equipment installation confirmation system according to claim 1.

3. The display unit displays information about the reason why the installation condition determination unit determined that the recommended installation conditions are not satisfied, in addition to the determination result of the installation condition determination unit. The disaster prevention equipment installation confirmation system according to claim 2.

4. a floor plan acquisition unit that acquires a three-dimensional floor plan of the room; a floor plan determination unit that determines recommended installation positions and non-recommended installation positions of the disaster prevention equipment in the room of the acquired three-dimensional floor plan; The display unit displays an image in which the three-dimensional floor plan acquired by the floor plan acquisition unit is superimposed on one or both of the recommended installation position and the non-recommended installation position based on a determination result of the floor plan determination unit. A disaster prevention equipment installation confirmation system according to any one of claims 1 to 3.

5. an indoor recognition unit that recognizes the purpose of the room in the image captured by the imaging unit; an output unit that outputs a type of disaster prevention equipment that is recommended to be installed in the room, the type being determined based on the use of the room recognized by the room recognition unit; A disaster prevention equipment installation confirmation system according to any one of claims 1 to 3.

6. a floor plan acquisition unit that acquires a three-dimensional floor plan of a room in which a disaster prevention device that performs fire monitoring is installed; a floor plan determination unit that determines recommended installation positions and non-recommended installation positions of disaster prevention equipment within the room on the acquired three-dimensional floor plan; a display unit that displays an image in which the three-dimensional floor plan acquired by the floor plan acquisition unit and either or both of the recommended installation position and the non-recommended installation position are superimposed based on the determination result of the floor plan determination unit. A system for verifying the installation of disaster prevention equipment.

Images