Disaster information processing device, disaster information processing system, disaster information processing method and program

Abstract

Provided are a disaster damage information processing device, a disaster damage information processing system, a disaster damage information processing method, and a program that extract and provide information of a building damaged by a specific cause of damage from an image including buildings. The present invention comprises: obtaining an image including buildings; extracting a first damaged building damaged by a first cause of damage from the obtained image; calculating the number of the extracted first damaged buildings; and providing at least a part of first disaster damage information related to the extracted first damaged buildings including the calculated number of the first damaged buildings, to a first terminal associated with the first cause of damage.

Description

[Technical Field]

[0001] The present invention relates to a disaster information processing device, a disaster information processing system, a disaster information processing method and a program, and more particularly to a technology for providing desired disaster information on the cause of a disaster. [Background technology]

[0002] When a large-scale disaster such as a major earthquake occurs, local governments and other organizations need to grasp the extent of the damage quickly and accurately.

[0003] Patent Document 1 discloses a method for detecting damaged houses using images of a disaster-hit area taken from the sky and house polygons acquired before the disaster occurs. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-220175 Summary of the Invention [Problem to be solved by the invention]

[0005] Organizations with jurisdiction over specific damage causes need to distinguish between information on buildings damaged by causes within their jurisdiction and information on buildings damaged by causes outside their jurisdiction. For example, in residential damage surveys following a disaster, collapsed houses are under the jurisdiction of the local government. On the other hand, houses destroyed by fire are generally under the jurisdiction of the fire department, and damage surveys and disaster certificates are issued under the supervision of the fire department. For this reason, when local governments formulate damage survey plans, they need to exclude burned-down houses from their scope. However, in large-scale disasters, houses destroyed by earthquakes and houses destroyed by fires are mixed together, making manual detection and compilation difficult.

[0006] The present invention has been made in consideration of these circumstances, and aims to provide a disaster information processing device, a disaster information processing system, a disaster information processing method, and a program that extract and provide information on buildings that have been damaged due to a specific cause of damage from images that include the buildings. [Means for solving the problem]

[0007] One aspect of a damage information processing device for achieving the above object is a damage information processing device that includes at least one processor and at least one memory that stores instructions to be executed by the at least one processor, wherein the at least one processor acquires an image including buildings, extracts first damaged buildings that have been damaged by a first damage cause from the acquired image, calculates the number of the extracted first damaged buildings, and provides at least a portion of the first damage information related to the extracted first damaged buildings, the first damage information including the calculated number of first damaged buildings, to a first terminal associated with the first damage cause. According to this aspect, information on buildings that have been damaged by a specific damage cause can be extracted from an image including the buildings and provided.

[0008] Preferably, the at least one processor calculates the number of the extracted first damaged buildings for each region and provides at least a portion of the first damage information for each region, including the calculated number of the first damaged buildings for each region, to the first terminal, thereby making it possible to provide the damage information for each region.

[0009] Preferably, the at least one processor acquires information on first terminals for each region associated with the first cause of damage, and provides at least a portion of the first damage information for each region to each of the first terminals associated with each region, thereby enabling the damage information for each region to be provided to the first terminals associated with each region.

[0010] Preferably, the at least one processor displays a region on the display so that the region can be selected by the user, and provides at least a portion of the first damage information for the region selected by the user to the first terminal associated with the region selected by the user, thereby making it possible to provide the damage information for a desired region to the first terminal associated with the desired region.

[0011] Preferably, the at least one processor acquires regional area information corresponding to the acquired image and acquires first damage information for each region using the acquired regional area information, thereby making it possible to appropriately acquire damage information for each region.

[0012] Preferably, the at least one processor causes at least a part of the first damage information to be displayed on a display, thereby allowing a user to visually recognize the damage information.

[0013] Preferably, the at least one processor acquires building region information corresponding to the acquired image and extracts buildings from the acquired image using the acquired building region information, thereby enabling appropriate extraction of buildings from the image.

[0014] Preferably, at least one processor cuts out an image of a building area from the image, inputs the cut-out image of the building area into a first trained model, and determines whether the building in the cut-out image is the first damaged building, and when the first trained model receives the building image as input, it outputs whether the cause of damage to the building in the input image is the first damaged building. This makes it possible to appropriately determine whether the building is the first damaged building.

[0015] It is preferable to extract second damaged buildings damaged by a second cause different from the first damage cause from the acquired image, calculate the number of the extracted second damaged buildings, and provide at least a portion of the second damage information related to the extracted second damaged buildings, which includes the calculated number of second damaged buildings, to a second terminal associated with the second damage cause. This makes it possible to extract and provide information on buildings damaged by the second damage cause different from the first damage cause.

[0016] Preferably, the at least one processor extracts damaged buildings damaged by each of the multiple damage causes from the acquired image, calculates the number of the extracted damaged buildings for each damage cause, and provides at least a portion of the damage information for each damage cause related to the extracted damaged buildings, including the calculated number of damaged buildings for each damage cause, to a third terminal different from the first terminal and associated with each of the damage causes. This makes it possible to extract information on buildings damaged by each of the multiple damage causes from the image including the buildings and provide it to the third terminal.

[0017] Preferably, at least one processor identifies whether buildings included in the image have been damaged or not, and extracts buildings damaged by each cause of damage from the buildings identified as damaged, thereby enabling information on damaged buildings to be extracted without omission.

[0018] Preferably, at least one processor cuts out an image of a building area from the image, inputs the image of the cut-out building area into the second trained model to obtain whether the building in the cut-out image has been damaged, and the second trained model outputs whether the building in the input image has been damaged when the building image is given as input. This makes it possible to appropriately extract damaged buildings.

[0019] Preferably, the first cause of damage is a fire, and the first terminal is associated with a fire station, so that information about the building damaged by the fire can be provided to the fire station that has jurisdiction over the fire.

[0020] The images are preferably aerial images taken from an aircraft or satellite images taken from an artificial satellite, which makes it possible to obtain damage information for multiple buildings from a single image.

[0021] One aspect of a disaster information processing system for achieving the above object is a disaster information processing system including: a first terminal having at least one first processor and at least one first memory that stores instructions to be executed by the at least one first processor; a server having at least one second processor and at least one second memory that stores instructions to be executed by the at least one second processor; and a fourth terminal having at least one third processor and at least one third memory that stores instructions to be executed by the at least one third processor, wherein the at least one third processor acquires an image including a building, and and extracting an image of a building area from an image of the building and providing the extracted image of the building area to a server, at least one second processor acquiring an image of the building area provided from a fourth terminal, extracting first damaged buildings that have been damaged by a first damage cause from the acquired image of the building area, calculating the number of the extracted first damaged buildings, and providing at least a portion of the first damage information related to the extracted first damaged buildings, the first damage information including the calculated number of first damaged buildings, to the first terminal, and at least one first processor acquiring at least a portion of the first damage information provided from the server and displaying at least a portion of the first damage information on a first display. According to this aspect, information on buildings that have been damaged by a specific damage cause can be extracted from an image including the buildings and provided.

[0022] One aspect of a damage information processing method for achieving the above object is a damage information processing method including: an image acquisition step of acquiring an image including buildings; a first damaged-building extraction step of extracting first damaged buildings damaged by a first damage cause from the acquired image; a calculation step of calculating the number of the extracted first damaged buildings; and a provision step of providing first damage information related to the extracted first damaged buildings, the first damage information including the calculated number of first damaged buildings, to a first terminal associated with the first damage cause. According to this aspect, information on buildings damaged by a specific damage cause can be extracted from an image including the buildings and provided.

[0023] One aspect of a program for achieving the above object is a program for causing a computer to execute the above-mentioned disaster information processing method. Record A medium may also be included in this embodiment. [Effects of the Invention]

[0024] According to the present invention, it is possible to extract and provide information on buildings that have been damaged by a specific cause of damage from an image that includes the buildings. [Brief explanation of the drawings]

[0025] [Figure 1] FIG. 1 is a schematic diagram of a disaster information processing system. [Figure 2] FIG. 2 is a block diagram of the disaster information processing system. [Figure 3] FIG. 3 is a functional block diagram of the disaster information processing system. [Figure 4] FIG. 4 is a flowchart showing the steps of the disaster information processing method. [Figure 5] FIG. 5 is a process diagram of each step of the disaster information processing method. [Figure 6] Figure 6 shows the process of processing disaster information for each region. [Figure 7] FIG. 7 is a process diagram of the process of notifying the fire department in charge. [Figure 8] FIG. 8 is a process diagram of the process for sorting collapsed houses, burned houses, and flooded houses. [Figure 9] FIG. 9 is a process diagram of the process for sorting collapsed houses and flooded houses. DETAILED DESCRIPTION OF THE INVENTION

[0026] Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0027] [Overall configuration of the disaster information processing system] 1 is a schematic diagram of a disaster information processing system 10 according to this embodiment. As shown in FIG. 1, the disaster information processing system 10 includes a drone 12, a local government server 14, a fire department terminal 16, and a local government terminal 18.

[0028] The drone 12 (an example of a "fourth terminal") is an unmanned aerial vehicle (UAV, an example of an "aircraft") remotely controlled by the local government server 14 or a controller (not shown). The drone 12 may have an autopilot function that flies according to a predetermined program. For example, when a large-scale disaster occurs, the drone 12 photographs the ground from the sky and acquires aerial images (high-altitude images) including buildings. A building refers to a dwelling such as a "detached house" or "apartment building," but may also include buildings in general such as a "store," "office," and "factory." In the following, buildings will be referred to as "houses" without distinguishing between types.

[0029] The local government server 14 is installed in a department in charge of residential damage certification surveys within a local government building. The local government server 14 is realized by at least one computer and constitutes a disaster information processing device. The local government server 14 may also be a cloud server provided by a cloud system.

[0030] Fire station terminal 16 is a fire station that is an organization that has jurisdiction over fires (an example of a "first cause of disaster"), and is installed in a fire station associated with the local government where local government server 14 is installed. Fire station terminal 16 (an example of a "first terminal") is realized by at least one computer, and constitutes a disaster information processing device.

[0031] The local government terminal 18 is installed in a department within a local government building that is different from the department in which the local government server 14 is installed. The local government terminal 18 is realized by at least one computer and is connected to the communication network 20. The local government terminal 18 may also be installed in a local government branch office.

[0032] The drone 12, the local government server 14, the fire department terminal 16, and the local government terminal 18 are each connected to each other via a communication network 20 such as a 2.4 GHz wireless LAN (Local Area Network) so as to be able to send and receive data.

[0033] It should be noted that the drone 12, the local government server 14, the fire department terminal 16, and the local government terminal 18 need not be directly connected to each other so as to be able to exchange data. For example, data may be exchanged via a data server (not shown).

[0034] [Electrical configuration of disaster information processing system] Fig. 2 is a block diagram showing the electrical configuration of the disaster information processing system 10. As shown in Fig. 2, the drone 12 includes a processor 12A, a memory 12B, a camera 12C, and a communication interface 12D.

[0035] Processor 12A (an example of a "third processor") executes instructions stored in memory 12B. The hardware structure of processor 12A is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various functional units, a GPU (Graphics Processing Unit), which is a processor specialized for image processing, a PLD (Programmable Logic Device), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration designed specifically for executing specific processing.

[0036] A single processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (e.g., multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Also, multiple functional units may be configured with a single processor. Examples of multiple functional units configured with a single processor include, first, a configuration in which a single processor is configured with a combination of one or more CPUs and software, as typified by a client or server computer, and this processor operates as multiple functional units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple functional units on a single IC (Integrated Circuit) chip, as typified by an SoC (System On Chip). In this way, the various functional units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0037] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0038] The memory 12B (an example of a "third memory") stores instructions to be executed by the processor 12A. The memory 12B includes a random access memory (RAM) and a read-only memory (ROM), both of which are not shown. The processor 12A uses the RAM as a working area, executes software using various programs and parameters stored in the ROM, and performs various processes of the drone 12 by using parameters stored in the ROM, etc.

[0039] The camera 12C includes a lens (not shown) and an imaging element (not shown). The camera 12C is supported by the drone 12 via a gimbal (not shown). The lens of the camera 12C forms an image of the received subject light on the imaging surface of the imaging element. The imaging element of the camera 12C receives the subject light imaged on the imaging surface and outputs an image signal of the subject.

[0040] The camera 12C may acquire angles of the roll axis, pitch axis, and yaw axis of the optical axis of the lens using a gyro sensor (not shown).

[0041] The communication interface 12D controls communication over the communication network 20.

[0042] The drone 12 may include a GPS (Global Positioning System) receiver, a barometric pressure sensor, a direction sensor, a gyro sensor, and the like, all of which are not shown.

[0043] 2, the municipal server 14 includes a processor 14A, a memory 14B, a display 14C, and a communication interface 14D. The fire department terminal 16 includes a processor 16A, a memory 16B, a display 16C, and a communication interface 16D.

[0044] The configurations of processor 14A (an example of a "second processor") and processor 16A (an example of a "first processor") are similar to the configuration of processor 12A. Furthermore, the configurations of memory 14B (an example of a "second memory") and memory 16B (an example of a "first memory") are similar to the configuration of memory 12B.

[0045] The display 14C is a display device that allows local government officials (users) to visually confirm information processed in the disaster information processing system 10. The display 14C may be a large-screen plasma display, a multi-screen display formed by connecting multiple displays, or the like. The display 14C may also include a projector that projects an image onto a screen.

[0046] Display 16C (an example of a "first display") is a display device that allows fire department staff to visually recognize information processed in disaster information processing system 10. Display 16C has the same configuration as display 14C.

[0047] The configurations of the communication interface 14D and the communication interface 16D are similar to that of the communication interface 12D.

[0048] Although not shown in FIG. 2, the configuration of the local government terminal 18 is similar to that of the fire station terminal 16.

[0049] [Functional configuration of disaster information processing system] Fig. 3 is a functional block diagram of the disaster information processing system 10. As shown in Fig. 3, the disaster information processing system 10 includes a house detection unit 30, a damage determination unit 32, a damage type sorting unit 34, a burned house counting unit 36, a burned house information display unit 38, and a burned house information notification unit 40.

[0050] The functions of the house detection unit 30 are realized by processor 12A. Furthermore, the functions of the damage determination unit 32, damage type sorting unit 34, burned house counting unit 36, burned house information display unit 38, and burned house information notification unit 40 are realized by processor 14A. All of these functions may be realized by either processor 12A or processor 14A. Furthermore, the damage information processing system 10 may be interpreted as a "disaster information processing device" realized by multiple processors.

[0051] The house detection unit 30 detects house areas included in the high-altitude image acquired from the camera 12C, and cuts out each of the detected house areas to generate a house cut-out image. The house detection unit 30 detects house areas from the high-altitude image and house area information (an example of "building area information") of the area captured by the high-altitude image. The house area information is information including at least one of house boundary information, house position information, and house address information. The house boundary information may be polygon information. The house polygon information is generated from house perimeter shape data, house height data, and land elevation data. The house position information includes latitude and longitude information. The house address information includes prefecture, ward, city, town, village, block, and address information. The house area information is stored in memory 12B.

[0052] The damage determination unit 32 determines (identifies) whether or not a house included in the house cut-out image has been damaged. A house being damaged means that the house has been damaged by a disaster. The damage determination unit 32 includes a damage determination AI (Artificial Intelligence) 32A.

[0053] The damage determination AI32A (an example of a "second trained model") is a trained model that, when a house cutout image is given as input, outputs whether or not a house included in the house cutout image has been damaged. The damage determination AI32A is machine-learned using a learning dataset that is a set of a house cutout image in which a house area has been cut out and whether or not the house included in the house cutout image has been damaged. A convolutional neural network (CNN) can be applied to the damage determination AI32A.

[0054] The damage type sorting unit 34 sorts the damage type of houses in house cut-out images that have been determined to be damaged, extracts burned-down houses (an example of a "first damaged building") that have been damaged by fire (an example of a "first cause of damage") from the house cut-out images, and extracts collapsed houses (an example of a "second damaged building") that have been damaged by collapse (an example of a "second cause of damage") from the house cut-out images.

[0055] The damage type sorting unit 34 includes a burnt detection AI 34A and a collapse detection AI 34B. The burnt detection AI 34A (an example of a "first trained model") is a trained model that, when a cut-out image of a house is given as input, outputs whether or not a house included in the cut-out image of a house has been burnt. A burnt house refers to damage to a house caused by a fire, and is not limited to "completely burned," but also includes "partially burned," "partially burned," and "slightly damaged." The burnt detection AI 34A is trained by machine learning using a training dataset that includes a cut-out image of a house from which a house area has been cut out and whether or not the house included in the cut-out image has been burnt.

[0056] The collapse detection AI34B is a trained model that, when given a cut-out image of a house as input, outputs whether or not the house included in the cut-out image has collapsed. A collapsed house refers to the destruction of the house, and is not limited to "total destruction," but also includes "large-scale partial destruction" and "partial destruction." The collapse detection AI34B is machine-learned using a training dataset that includes a cut-out image of a house from which the area of ​​the house has been cut out and whether or not the house included in the cut-out image has collapsed. A convolutional neural network can be applied to the burnt detection AI34A and the collapse detection AI34B.

[0057] The burnt-down house counting unit 36 ​​counts (an example of "calculating") the number of houses that have been determined by the damage type sorting unit 34 to have been burnt down (burnt-down houses).

[0058] The burned house information display unit 38 displays on the display 14C at least a portion of the damage information regarding the burned houses sorted by the damage type sorting unit 34, including the number of burned houses tallied by the burned house counting unit 36. The damage information includes at least one of an image of the burned house, location information, and address information.

[0059] The burned house information notification unit 40 notifies (an example of "provision") the fire station terminal 16 associated with the fire of at least a portion of the damage information (an example of "first damage information") regarding burned houses that has been assigned by the damage type assignment unit 34 and that includes the number of burned houses tallied by the burned house counting unit 36.

[0060] In the disaster information processing system 10, it is sufficient if the local government server 14 can provide the disaster information to the fire department terminal 16, and the local government server 14 does not necessarily notify the fire department terminal 16 of the disaster information directly. For example, the local government server 14 may upload the disaster information to a server (not shown), and the fire department terminal 16 may download the disaster information from the server (not shown).

[0061] [Disaster information processing method] FIG. 4 is a flowchart showing each step of the disaster information processing method by the disaster information processing system 10. FIG. 5 is a process diagram of each step of the disaster information processing method. The disaster information processing method is realized by the processor 14A executing a disaster information processing program stored in the memory 14B. The disaster information processing program is stored in a computer-readable non-transitory storage medium. Record In this case, the local government server 14 may store the information in a non-transitory storage medium. Record The disaster information processing program may be read from the medium and stored in the memory 14B.

[0062] In step S1 (an example of an "image acquisition process"), the drone 12 flies over the city immediately after a large-scale disaster in accordance with instructions from the local government server 14, and captures high-altitude images including houses using the camera 12C.

[0063] In step S2 (an example of a "first damaged building extraction process"), the damage information processing system 10 extracts a burned house (an example of a "first damaged house") from the high-altitude image. First, the house detection unit 30 of the processor 12A of the drone 12 detects the area of ​​the house from the high-altitude image taken in step S1 based on the house area information acquired from the memory 12B.

[0064] 5 shows a high-altitude image 100 and house area information 102 taken from the same angle as the high-altitude image 100. The house area information 102 is information created from a high-altitude image taken before the occurrence of a large-scale disaster, and in this case, is information that shows the perimeter shape of a house with lines.

[0065] 5 shows a composite image 104 obtained by combining the high altitude image 100 and the house area information 102. By generating such a composite image 104, the house detection unit 30 can recognize that the area in the composite image 104 that is surrounded by the lines of the house area information 102 is a house.

[0066] The house detection unit 30 generates house cutout images by cutting out the areas of the houses detected by the composite image 104 from the elevated altitude image 100. Fig. 5 shows house cutout images 106A, 106B, .... The same number of house cutout images as the number of detected houses are generated.

[0067] The drone 12 transmits (an example of "providing") the house cutout images 106A, 106B, ... via the communication interface 12D to the municipality server 14 over the communication network 20. The municipality server 14 receives (an example of "obtaining") the house cutout images 106A, 106B, ... via the communication interface 14D.

[0068] Next, the damage determination unit 32 of the processor 14A of the local government server 14 sequentially inputs the multiple house cutout images to the damage determination AI 32A, and determines whether or not the house included in each house cutout image has been damaged. That is, the damage determination unit 32 selects, from the multiple house cutout images, house cutout images in which the house has been damaged and house cutout images in which the house has not been damaged. Figure 5 shows an example in which house cutout images 106A, 106B, ... are input to the damage determination AI 32A.

[0069] Next, the damage type sorting unit 34 inputs the house cutout images determined by the damage determination unit 32 to the burnt down detection AI 34A in order from among the plurality of house cutout images, and determines whether the house included in each house cutout image is burnt down or not. That is, the burnt down detection AI 34A sorts out the house cutout images in which the house is burnt down and the house cutout images in which the house is not burnt down.

[0070] Furthermore, the damage type sorting unit 34 sequentially inputs, among the plurality of house cutout images, those house cutout images for which the damage determination unit 32 has determined that the house is damaged but for which the burnt detection AI 34A has determined that the house is not burnt, to the collapse detection AI 34B, and determines whether or not the house included in each house cutout image has collapsed. That is, the collapse detection AI 34B sorts out house cutout images for which the house is collapsed and those for which the house is not collapsed.

[0071] In this way, the damage type sorting unit 34 sorts out, from among a plurality of cutout images of damaged houses, cutout images of burned houses, cutout images of collapsed houses, and cutout images of houses damaged in ways other than burned or collapsed. Therefore, the damage information processing system 10 can extract burned houses from high-altitude images. Figure 5 shows an example in which cutout house images are input to the burned house detection AI 34A and the collapsed house detection AI 34B.

[0072] Here, the damage type sorting unit 34 determines whether a house has been burned down and then whether it has collapsed, but the order of sorting burned houses and collapsed houses may be reversed. That is, the damage type sorting unit 34 may determine whether a house has collapsed and then whether it has been burned down.

[0073] Furthermore, the damage determination unit 32 determines whether or not a house included in a house cutout image has been damaged, and for house cutout images for which it has been determined that the house has been damaged, the damage type sorting unit 34 selects the type of damage, but the processes of the damage determination unit 32 and the damage type sorting unit 34 may be reversed. That is, the damage type sorting unit 34 may select the type of damage of a house included in a house cutout image, and for house cutout images that have not been selected as either, the damage determination unit 32 may determine whether or not the house has been damaged.

[0074] Next, in step S3 (an example of a "calculation process"), the burnt house counting unit 36 ​​counts the number of burnt houses included in the high-altitude image. The number of burnt houses corresponds to the number of house cut-out images in which houses are determined to be burnt in the processing of the burnt house detection AI 34A in step S2. In addition to counting the number of burnt houses, the burnt house counting unit 36 ​​may also count the number of collapsed houses (an example of "second damaged houses") included in the high-altitude image.

[0075] Finally, in step S4 (an example of a "provision process"), the burned house information notification unit 40 notifies the fire department terminal 16 of the damage information about the burned houses extracted in step S2 (an example of "first damage information") via the communication interface 14D. The damage information includes the number of burned houses tallied in step S3. The burned house information notification unit 40 may notify the fire department terminal 16 of at least a portion of the damage information.

[0076] The burned house information display unit 38 may display at least a part of the damage information on the display 14C. The burned house information notification unit 40 may notify the local government terminal 18 (an example of a "second terminal") of at least a part of the damage information (an example of "second damage information") relating to the collapsed houses determined in step S2 and including the number of collapsed houses tallied in step S3. The burned house information display unit 38 may display at least a part of this damage information on the display 14C.

[0077] Processor 16A of fire station terminal 16 receives the damage information transmitted from burned-down house information notification unit 40 via communication interface 16D and displays it on display 16C, allowing fire station personnel to visually recognize information about burned-down houses included in the high-altitude image.

[0078] Processor 14A of municipal server 14 may also cause display 14C to display at least a portion of the damage information regarding collapsed houses determined in step S2, including the number of collapsed houses tallied in step S3. Processor 14A of municipal server 14 may also cause display 14C to display at least a portion of the damage information regarding houses damaged by causes other than burning and collapse, or may provide this information to municipal terminal 18.

[0079] As described above, the disaster damage information processing system 10 can extract information about houses damaged by fire from high-altitude images that include houses and provide the information to a fire department that has jurisdiction over the fire. The disaster damage information processing system 10 can also extract information about houses damaged by collapse from high-altitude images that include houses and provide the information to a local government department that has jurisdiction over the collapse. Furthermore, information about houses damaged by causes other than fire and collapse can be extracted from high-altitude images that include houses and provide the information to a local government department that has jurisdiction over causes of damage other than fire and collapse, so that all information about damaged houses can be provided.

[0080] [Disaster information processing methods for each region] The damage information processing method may be performed for each region. For example, the burned house counting unit 36 ​​may count the number of burned houses for each region, the burned house information display unit 38 may display information about the burned houses for each region, and the burned house information notification unit 40 may notify the fire station terminal 16 for each region of the damage information. "For each region" may be for each ward, city, town, or village, for each neighborhood, or for each block.

[0081] Figure 6 is a process diagram for processing damage information for each region. Figure 6 shows burned-down house information 110 and chome area information 112 for a certain region. Burned-down house information 110 includes at least one of an image of the burned-down house, location information, and address information. Furthermore, chome area information 112 is an example of area area information corresponding to an elevated image that includes the burned-down house in the burned-down house information 110, and in this case, it is chome area information in which the boundary lines that make up each chome are represented by white lines.

[0082] The burned-down house counting unit 36 ​​performs counting for each block using the block area information 112. If the burned-down house information 110 does not include address information, boundary information is used to determine which block the burned-down house is in and count the blocks.

[0083] Figure 6 shows examples of situation assessment information displayed on display 14C by burned house information display unit 38, including aggregated results 114 and 116 for each block, a list of addresses 118 of burned houses, a cut-out image of the house 120, and an estimate 122 of the amount of work required for the residential damage assessment survey.

[0084] The tally result 114 is a map of the area, and the area of ​​each block is displayed in a different color depending on the number of burned houses in that block. For example, the burned house information display unit 38 displays blocks with a relatively large number of burned houses in red, and blocks with a relatively small number of burned houses in blue. The burned house information display unit 38 may further display each color area with a higher density the greater the number of burned houses in that area.

[0085] The count result 116 is a map in which a part of the count result 114 is enlarged. The count result 116 displays the names of the blocks and the number of houses burned down in each block.

[0086] The address list 118 is a list of addresses of burned-down houses included in the block selected by the user from the displayed map.

[0087] The house cutout image 120 is, for example, an image of a burned-down house included in a block selected by the user from the elevated image. The house cutout image 120 may also be an image of a burned-down house selected by the user from the address list 118.

[0088] The estimate 122 includes the aggregated results of the number of burned-down houses included in the chome selected by the user from the displayed map and the number of houses surveyed by the local government. In the example shown in Figure 6, the number of houses surveyed is 91,535 (449,269 blocks), of which 12,782 were burned-down houses, accounting for 14% of the total number of houses surveyed. The estimate 122 displays these numbers of houses and also includes a pie chart in which the 14% corresponding to the burned-down houses are colored red and the remaining 86% are colored other than red.

[0089] This situational awareness information may be displayed on the display 16C.

[0090] [Notify the fire department in your jurisdiction] The burned house information notification unit 40 may notify at least a part of the damage information for each chome to the fire station that has jurisdiction over each chome.

[0091] 7 is a process diagram of the process of notifying the fire station in charge. Figure 7 shows the counting results 130 and 132 for each chome, and fire station information 134 that has jurisdiction over each chome.

[0092] The counting results 130 and 132 are similar to the counting results 114 and 116 shown in Fig. 6. Furthermore, the fire station information 134 associates the names of blocks with the fire stations that have jurisdiction over those blocks.

[0093] 7 shows an address list 136 of a chome selected on the map. Address list 136 is similar to address list 118 shown in FIG. 6. Burned house information display unit 38 displays a chome (an example of an "area") desired by the user on display 14C so that the user can select it, and displays address list 136 of the chome selected by the user on display 14C.

[0094] In addition, the burned house information display unit 38 acquires information about the fire station that has jurisdiction over each block from the fire station information 134, automatically assigns a fire station to each block, and displays the fire station in charge. In the example shown in Fig. 7, the name 137 of the fire station that has jurisdiction over the block in the address list 136 and a button 138 for notifying that fire station of damage information are displayed above the address list 136. When the user clicks on the button 138 using a pointing device or the like (not shown), the burned house information notification unit 40 notifies the fire station terminal 16 of the fire station with the name 137 of the damage information included in that block.

[0095] [Distinguishing causes of damage other than fire and collapse] Up to this point, an example of categorizing damage types into three types, fire, collapse, and others, has been explained, but it is also possible to categorize damage types other than these.

[0096] 8 is a process diagram for processing when an earthquake disaster occurs and there is a mixture of houses burned down due to fire, houses collapsed due to shaking, and houses flooded due to inland flooding. Here, the damage type sorting unit 34 is equipped with a burned down detection AI 34A, a collapsed down detection AI 34B, and a flooded down detection AI 34C, and sorts houses into burned down, collapsed down, flooded down, and other damaged houses.

[0097] The flood detection AI34C is a trained model that, when given a cut-out image of a house as input, outputs whether the house included in the cut-out image is flooded. A house being flooded is not limited to "flooded above floor level," where water reaches above the floor of the house, but also includes "flooded below floor level," where water reaches below the floor of the house. The flood detection AI34C has undergone machine learning using a training dataset that includes a cut-out image of a house from which the area of ​​the house has been cut out and whether the house included in the cut-out image is flooded or not.

[0098] 8 shows an example in which house cutout images 140A, 140B, ... are input to the damage determination AI 32A. The damage determination AI 32A determines whether or not each house included in each house cutout image has been damaged.

[0099] A house cutout image in which a house included in the house cutout image is determined to be damaged in the damage determination AI 32A is input to the damage type sorting unit 34. The damage type sorting unit 34 inputs the house cutout image in which a house is determined to be damaged in the damage determination unit 32 to the burnt down detection AI 34A, and determines whether or not the house included in each house cutout image is burnt down.

[0100] In addition, the damage type sorting unit 34 inputs, from among the multiple house cut-out images, house cut-out images that have been determined by the damage determination unit 32 to be damaged houses and that have been determined by the burnt-down detection AI 34A to be not burnt houses into the collapse detection AI 34B, and determines whether the houses included in the house cut-out images have collapsed.

[0101] Furthermore, the damage type sorting unit 34 inputs, into the flood detection AI 34C, house cut-out images from among the multiple house cut-out images that have been determined by the damage determination unit 32 to be damaged houses, and that have been determined not to be damaged houses by the burnt detection AI 34A and not to be destroyed houses by the collapse detection AI 34B, and determines whether the houses included in the house cut-out images are flooded or not.

[0102] In other words, the damage type sorting unit 34 can sort out, from multiple house cut-out images of houses that have been damaged, cut-out images of houses that have been burned down, cut-out images of houses that have collapsed, cut-out images of houses that have been flooded, and cut-out images of houses that have been damaged in ways other than being burned down, collapsed, or flooded.

[0103] In the example shown in Figure 8, information about burned houses is notified to a fire department terminal 16, information about collapsed houses and information about flooded houses is notified to a local government terminal 18, and information about other damaged houses is notified to other terminals 19. The local government terminal 18 and other terminals 19 are examples of "third terminals each associated with a specific cause of damage."

[0104] 9 is a process diagram for processing when a wind and flood disaster occurs and there is a mixture of houses collapsed by strong winds and houses flooded by external or internal flooding. Here, the damage type sorting unit 34 includes a collapse detection AI 34B and a flood detection AI 34C, and sorts collapsed houses from flooded houses.

[0105] In this way, the disaster information processing system 10 can classify disaster types according to the disaster situation and provide disaster information to terminals of organizations that have jurisdiction over each disaster type.

[0106] 〔others〕 Here, an example has been described in which an aerial image of the disaster situation taken from above the city by the camera 12C mounted on the drone 12 is used as the high-altitude image, but the high-altitude image may also be an image taken by a fixed camera or a surveillance camera installed in the city. The high-altitude image may also be a satellite image taken by a geostationary satellite (an example of an "artificial satellite").

[0107] The technical scope of the present invention is not limited to the scope described in the above embodiments. The configurations and the like in each embodiment can be appropriately combined with each other within the scope that does not deviate from the spirit of the present invention. [Explanation of symbols]

[0108] 10. Disaster Information Processing System 12. Drone 12A...Processor 12B...Memory 12C...camera 12D...Communication interface 14...Municipal government server 14A...Processor 14B...Memory 14C…Display 14D...Communication interface 16...Fire department terminal 16A...Processor 16B...Memory 16C...Display 16D...Communication interface 18...Municipal terminal 19...Other devices 20...Communication Network 30...House detection unit 32...Damage Assessment Department 32A…Damage assessment AI 34…Disaster Type Sort Section 34A… Burn detection AI 34B…Collapse detection AI 34C...Water intrusion detection AI 36… Burned Houses Counting Section 38...Burnt house information display section 40...Burnt House Information Notification Department 100...High altitude images 102…House area information 104...Composite image 106A...House cutting image 106B...House cutting image 110...Information on burned houses 112...Chome Area Information 114... Counting results 116... Counting results 118…Address List 120... House cutout image 134…Fire department information 136...Address list 137…Name 138...Button 140A...House cutting image 140B...House cutting image S1 to S4: Each step in the disaster information processing method

Claims

1. at least one processor; at least one memory storing instructions for execution by said at least one processor; Equipped with The at least one processor Acquire an image containing a building, extracting a first damaged building that has been damaged by a first damage cause from the acquired image; Calculating the number of the extracted first damaged buildings; providing at least a portion of the first damage information relating to the extracted first damaged buildings, the first damage information including the calculated number of first damaged buildings, to a first terminal associated with the first damage cause; Disaster information processing device.

2. The at least one processor Calculating the number of the extracted first damaged buildings for each region; providing at least a portion of the first damage information for each region, including the number of first damaged buildings calculated for each region, to the first terminal; The disaster information processing device according to claim 1 .

3. The at least one processor acquiring information on a first terminal for each of the areas associated with the first cause of damage; providing at least a part of the first disaster information for each region to a first terminal associated with each region; The disaster information processing device according to claim 2 .

4. The at least one processor displaying the region on a display so that the user can select it; providing at least a part of the first disaster information of the area selected by the user to a first terminal associated with the area selected by the user; The disaster information processing device according to claim 2 .

5. The at least one processor acquiring regional area information corresponding to the acquired image; acquiring first damage information for each of the regions using the acquired regional area information; The disaster information processing device according to claim 2 .

6. The at least one processor displaying at least a part of the first disaster information on a display; The disaster information processing device according to claim 1 .

7. The at least one processor acquiring building area information corresponding to the acquired image; extracting the building from the acquired image using the acquired building region information; The disaster information processing device according to claim 1 .

8. The at least one processor an image of the building region is cut out from the image; inputting an image of the region of the cut-out building into a first trained model and determining whether the building in the cut-out image is the first damaged building; When an image of a building is given as an input, the first trained model outputs whether the cause of damage to the building in the input image is the first cause of damage. The disaster information processing device according to claim 1 .

9. extracting a second damaged building that has been damaged by a second damage cause different from the first damage cause from the acquired image; Calculating the number of the extracted second damaged buildings; providing at least a portion of second damage information relating to the extracted second damaged buildings, the second damage information including the calculated number of second damaged buildings, to a second terminal associated with the second damage cause; The disaster information processing device according to claim 1 .

10. The at least one processor extracting damaged buildings damaged by each of the plurality of damage causes from the acquired images; Calculate the number of the extracted damaged buildings for each cause of damage; providing at least a portion of the extracted damage information for each damage cause related to the damaged buildings, including the calculated number of damaged buildings for each damage cause, to a third terminal different from the first terminal, the third terminal being associated with each of the damage causes; The disaster information processing device according to claim 1 .

11. The at least one processor Identifying whether a building included in the image is damaged or not; extracting damaged buildings that have been damaged by each of the causes of damage from the buildings identified as damaged; The disaster information processing device according to claim 10 .

12. The at least one processor an image of the building region is cut out from the image; Inputting the image of the region of the cut-out building into a second trained model to obtain whether the building in the cut-out image has been damaged; The second trained model outputs whether or not the building in the input image has been damaged when an image of the building is given as an input. The disaster information processing device according to claim 11 .

13. The first cause of damage was fire, the first terminal is associated with a fire department; The disaster information processing device according to claim 1 .

14. The disaster information processing device according to claim 1 , wherein the image is an aerial image taken from an aircraft or a satellite image taken from an artificial satellite.

15. a first terminal comprising at least one first processor and at least one first memory storing instructions for execution by the at least one first processor; a server comprising at least one second processor and at least one second memory storing instructions for execution by the at least one second processor; a fourth terminal comprising at least one third processor and at least one third memory storing instructions for execution by said at least one third processor; A disaster information processing system including: The at least one third processor: Acquire an image containing a building, extracting an image of the building area from the acquired image; providing an image of the extracted building area to the server; The at least one second processor: obtaining an image of an area of ​​a building provided by the fourth terminal; extracting a first damaged building that has been damaged by a first cause of damage from the acquired image of the building area; Calculating the number of the extracted first damaged buildings; providing at least a portion of first damage information relating to the extracted first damaged buildings, the first damage information including the calculated number of first damaged buildings, to the first terminal; The at least one first processor acquiring at least a portion of the first disaster information provided by the server; displaying at least a part of the first disaster information on a first display; Disaster information processing system.

16. an image acquisition step of acquiring an image including a building; a first damaged building extraction step of extracting a first damaged building that has been damaged by a first cause of damage from the acquired image; a calculation step of calculating the number of the extracted first damaged buildings; a providing step of providing at least a portion of the extracted first damage information related to the first damaged buildings, the first damage information including the calculated number of first damaged buildings, to a first terminal associated with the first damage cause; A disaster information processing method comprising:

17. A program for causing a computer to execute the disaster information processing method according to claim 16.

18. A non-transitory computer-readable recording medium having the program according to claim 17 recorded thereon.

Images