Disaster information processing device, operation method of disaster information processing device, operation program of disaster information processing device, and disaster information processing system

Abstract

Provided are a disaster information processing device, a method for operating a disaster information processing device, a program for operating a disaster information processing device, and a disaster information processing system with which it is possible to know the damage status of a disaster site efficiently in a short time. An RW control unit accepts a first aerial photography image obtained with a first camera on board a first drone capturing a first capture range including an area. A first damage status analysis unit, on the basis of the first aerial photography image, analyzes a first damage status of the disaster in the first capture range. A second capture range determination unit, on the basis of a first analysis result, determines a second capture range of a second camera on board a second drone, the second capture range being relatively narrower than the first capture range.

Description

[Technical field]

[0001] The technology disclosed herein relates to a disaster information processing device, an operation method for a disaster information processing device, an operation program for a disaster information processing device, and a disaster information processing system. [Background technology]

[0002] Various disasters such as earthquakes, tsunamis, volcanic eruptions, floods and / or landslides due to heavy rain, and large-scale fires occur in various places. Various measures have been proposed in the past to grasp the damage situation of such disasters. For example, Patent Document 1 describes a disaster information processing device that directs a drone to a disaster site, photographs the disaster site with a camera mounted on the drone, and grasps the damage situation of the disaster site based on the aerial images obtained thereby. Note that the disaster site is, for example, a major building in a disaster area where a fire is occurring, a major building in a disaster area that is inundated by flooding, etc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-134663 A Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, the discussion proceeds on the premise that the disaster site is known to some extent. However, immediately after a disaster, although the general location of the disaster-affected area, including the disaster site, is known, in many cases it is unclear which part of the disaster-affected area is the disaster site due to the confusion specific to disasters, such as the destruction of information transmission infrastructure such as mobile phone base stations.

[0005] Consider, for example, using a single drone to grasp the extent of damage in a disaster area in a situation where it is unclear exactly where the disaster site is. In this case, it is easy to imagine that it would take a very long time, since a single drone would need to thoroughly explore the disaster area.

[0006] On the other hand, consider using multiple drones to grasp the damage situation at the disaster site. In this case, if multiple drones share the search area, the time required will be reduced compared to using only one drone. However, simply flying multiple drones without any goal is wasteful.

[0007] One embodiment of the technology disclosed herein provides a disaster information processing device, an operating method for the disaster information processing device, an operating program for the disaster information processing device, and a disaster information processing system that are capable of grasping the damage situation at a disaster site efficiently and in a short amount of time. [Means for solving the problem]

[0008] The disaster information processing device of the present disclosure includes a processor and a memory connected to or built into the processor, and the processor accepts a first aerial image obtained by photographing a first shooting range including the disaster-stricken area by a first camera mounted on a first drone, analyzes a first damage situation of the disaster in the first shooting range based on the first aerial image, and determines a second shooting range of a second camera mounted on a second drone, which is relatively narrower than the first shooting range, based on the analysis result of the first damage situation.

[0009] It is preferable that the processor determines, as the second imaging range, an imaging range including an area in the disaster area that is determined to have suffered relatively large damage based on the analysis of the first damage situation.

[0010] It is preferable that the processor accepts a second aerial image obtained by photographing the second capturing range by the second camera, and analyzes a second damage situation of the disaster in the second capturing range based on the second aerial image.

[0011] The processor preferably analyzes the second damage situation based on the first aerial image in addition to the second aerial image.

[0012] Preferably, the processor sets the flight altitude of the second drone lower than that of the first drone.

[0013] The processor preferably analyzes the first damage situation for each block including a plurality of adjacent buildings.

[0014] It is preferable that a flight range is set in advance for the second drone, and when analysis of the first damage situation determines that the damage in an area within the flight range of the target second drone is relatively small and there is an area in a flight range other than the flight range of the target second drone where the damage is relatively large, the processor determines the shooting range including the area where the damage is relatively large as the second shooting range of the target second drone.

[0015] It is preferable that there are multiple second drones, and the processor determines a second shooting range for each of the multiple second drones.

[0016] A method of operating a disaster information processing device disclosed herein includes accepting a first aerial image obtained by photographing a first filming range including the disaster-stricken area with a first camera mounted on a first drone, analyzing a first damage situation of the disaster in the first filming range based on the first aerial image, and determining a second filming range of a second camera mounted on a second drone, the second filming range being relatively narrower than the first filming range, based on the analysis results of the first damage situation.

[0017] The operating program of the disaster information processing device disclosed herein causes a computer to execute processes including accepting a first aerial image obtained by photographing a first filming range including the disaster-stricken area with a first camera mounted on a first drone, analyzing a first damage situation of the disaster in the first filming range based on the first aerial image, and determining a second filming range of a second camera mounted on a second drone, which is relatively narrower than the first filming range, based on the analysis results of the first damage situation.

[0018] The disaster information processing system of the present disclosure includes a first drone equipped with a first camera that captures a first shooting range including a disaster-stricken area and outputs a first aerial image, a second drone equipped with a second camera that captures a second shooting range relatively narrower than the first shooting range and outputs a second aerial image, a processor, and a memory connected to or built into the processor, wherein the processor: A first aerial image is received, a first damage situation of the disaster in the first imaging range is analyzed based on the first aerial image, and a second imaging range is determined based on the analysis result of the first damage situation. Effect of the Invention

[0019] According to the technology disclosed herein, it is possible to provide a disaster information processing device, an operating method for a disaster information processing device, an operating program for a disaster information processing device, and a disaster information processing system that are capable of grasping the damage situation at a disaster site efficiently and in a short amount of time. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram illustrating a disaster information processing system. [Diagram 2] FIG. 1 is a diagram showing the relationship between regions and flight ranges. [Diagram 3] A diagram showing the flight altitudes of the first drone and the second drone. [Figure 4] FIG. 2 is a diagram showing a first drone or a second drone. [Diagram 5] FIG. 2 is a block diagram of the first drone or the second drone. [Figure 6] FIG. 11 is a diagram showing first shooting range information. [Figure 7] FIG. 4 is a diagram showing the relationship between a flight range and a first imaging range. [Figure 8] FIG. 2 is a block diagram showing a computer that constitutes the disaster information processing server. [Figure 9] 2 is a block diagram showing a processing unit of a CPU of the disaster information processing server. [Figure 10] 4 is a block diagram showing details of a first damage situation analysis unit. FIG. [Figure 11] FIG. 13 is a diagram showing an overview of processing in the learning phase of the first damage situation analysis model. [Figure 12] FIG. 11 is a diagram illustrating a process performed by a second shooting area determination unit. [Figure 13] FIG. 11 is a diagram showing the relationship between a section and a second shooting range. [Figure 14] 11 is a block diagram showing details of a second damage situation analysis unit. FIG. [Figure 15] FIG. 13 is a diagram showing an overview of processing in the learning phase of the second damage situation analysis model. [Figure 16] FIG. 13 is a diagram showing a damage status display screen. [Figure 17] FIG. 11 is a diagram showing a processing procedure of a disaster information processing server. [Figure 18] FIG. 11 is a diagram showing a processing procedure of a disaster information processing server. [Figure 19] FIG. 11 is a block diagram showing details of a second damage situation analysis unit of the second embodiment. [Figure 20] FIG. 11 is a diagram showing an overview of processing in a learning phase of a second damage situation analysis model in the second embodiment. [Figure 21] A figure showing a third embodiment in which a second drone is sent to provide support to an area in another flight range where damage is deemed to be relatively greater. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] [First embodiment] As an example, as shown in FIG. 1, a disaster information processing system 2 for grasping the damage situation of a disaster includes first drones 10_1, 10_2, and 10_3, second drones 11A_1, 11B_1, 11A_2, 11B_2, 11A_3, and 11B_3, and a disaster information processing server 12. The first drones 10_1, 10_2, and 10_3 and the second drones 11A_1, 11B_1, 11A_2, 11B_2, 11A_3, and 11B_3 are the same model and have the same performance. Hereinafter, unless there is a need to distinguish them, the first drones 10_1, 10_2, and 10_3 will be collectively referred to as the first drone 10. Similarly, the second drones 11A_1, 11B_1, 11A_2, 11B_2, 11A_3, and 11B_3 will be collectively referred to as the second drone 11. Other symbols having an underscore (such as FR_1, FR_2, and FR_3, FB_1, FB_2, and FB_3, 80_N, 80_E, 80_S, and 80_W) may also be written with the part after the underscore omitted.

[0022] The first drone 10_1 and the second drones 11A_1 and 11B_1 are responsible for the first flight range FR_1. The first drone 10_2 and the second drones 11A_2 and 11B_2 are responsible for the second flight range FR_2. The first drone 10_3 and the second drones 11A_3 and 11B_3 are responsible for the third flight range FR_3. In this way, the flight ranges FR are preset for the first drone 10 and the second drone 11.

[0023] The first drone 10, the second drone 11, and the disaster information processing server 12 are connected to each other so as to be able to communicate with each other via a network 13. The first drone 10 and the second drone 11 are wirelessly connected to the network 13. The disaster information processing server 12 is connected to the network 13 by wire or wirelessly. The network 13 is, for example, a wide area network (WAN) such as the Internet or a public communication network. When using a WAN, it is preferable to build a virtual private network (VPN) or use a communication protocol with a high security level such as hypertext transfer protocol secure (HTTPS) in consideration of information security.

[0024] The disaster information processing server 12 is installed in a disaster countermeasure headquarters (government office, government office, etc.) of a local government such as a prefecture, city, town, or village. The disaster information processing server 12 is an example of a "disaster information processing device" according to the technology of the present disclosure.

[0025] A client terminal 14 is also connected to the network 13 by wired or wireless connection. The client terminal 14 is, for example, a desktop personal computer provided to staff at the disaster countermeasure headquarters, and has a display 15 and an input device 16. Various screens are displayed on the display 15. The input device 16 is a keyboard, a mouse, a touch panel, a microphone, etc. Note that although only one client terminal 14 is illustrated in FIG. 1, there may of course be a plurality of client terminals 14.

[0026] As shown in FIG. 2, which shows a region 20 such as a prefecture, city, town, or village from above, the flight range FR is, for example, a circle with a radius of 5 km to 10 km, and is set in advance to cover the entire region 20. The flight ranges FR may overlap in part as shown in the figure. The flight range FR has a takeoff and landing base FB for the first drone 10 and the second drone 11 at its center. More specifically, the first flight range FR_1 has a first takeoff and landing base FB_1, the second flight range FR_2 has a second takeoff and landing base FB_2, and the third flight range FR_3 has a third takeoff and landing base FB_3. The region 20 is a region where a disaster has occurred and a disaster countermeasure headquarters is located, and is an example of a "disaster-hit region" according to the technology of the present disclosure.

[0027] As an example, as shown in FIG. 3, the first drone 10 takes off from the departure and arrival base FB before the second drone 11 and captures the first aerial image 25 from a flight altitude of, for example, 500 m. After capturing the first aerial image 25, the first drone 10 returns to the departure and arrival base FB. On the other hand, the second drone 11 takes off from the departure and arrival base FB after the first drone 10 and captures the second aerial image 26 from a flight altitude of, for example, 100 m. After capturing the second aerial image 26, the second drone 11 returns to the departure and arrival base FB. The first drone 10 and the second drone 11 capture the first aerial image 25 and the second aerial image 26 by setting the zoom magnification to the same value, for example, 1x. For this reason, the first aerial image 25 captures a relatively large number of buildings relatively small. On the other hand, the second aerial image 26 captures a relatively small number of buildings relatively large.

[0028] As an example, as shown in Fig. 4, the first drone 10 or the second drone 11 has an airframe 30, an arm 31, a propeller 32, a motor 33, a skid 34, a gimbal 35, and a first camera 36 or a second camera 37. The first camera 36 is mounted on the first drone 10, and the second camera 37 is mounted on the second drone 11. The propeller 32 is also called a blade or a rotor. The motor 33 is also called a rotor.

[0029] The arms 31 are four rod-shaped bodies extending from the aircraft 30 in four symmetrical directions in the horizontal direction. A total of four propellers 32 are provided, one at each end of the arms 31. A motor 33 is attached to the propellers 32. The motor 33 rotates the propellers 32 to fly the first drone 10 or the second drone 11. The motor 33 also changes the flight direction of the first drone 10 or the second drone 11 by changing its rotation direction and rotation speed.

[0030] The skids 34 are four rod-shaped bodies extending downward from the airframe 30 in four symmetrical directions. The skids 34 are provided to allow the first drone 10 or the second drone 11 to land stably on the ground. The gimbal 35 holds the first camera 36 or the second camera 37 at the bottom of the airframe 30 so that the camera can tilt. The gimbal 35 reduces shaking that occurs in the airframe 30 during flight so that it is not transmitted to the first camera 36 or the second camera 37.

[0031] As an example, as shown in FIG. 5, the first drone 10 or the second drone 11 has a storage 40, a memory 41, a CPU (Central Processing Unit) 42, a communication unit 43, a power supply unit 44, etc.

[0032] The memory 41 is a work memory for the CPU 42 to execute processing. The CPU 42 loads the operating program 45 stored in the storage 40 into the memory 41 and executes processing according to the operating program 45. In this way, the CPU 42 comprehensively controls the operation of each part of the first drone 10 or the second drone 11.

[0033] The communication unit 43 is responsible for wireless communication with the disaster information processing server 12 and the pilot 50. The pilot 50 is operated by the pilot of the first drone 10 or the second drone 11. The first drone 10 or the second drone 11 basically flies autonomously, but can be manually controlled by the pilot 50 in order to respond to emergencies. The pilot 50 is also called a proportional system, or "propo" for short.

[0034] A rechargeable battery 53 such as a secondary battery is connected to the power supply unit 44. The power supply unit 44 supplies power from the battery 53 to each unit.

[0035] To the CPU 42, a GPS (Global Positioning System) module 55, a gyro sensor 56, an acceleration sensor 57, a direction sensor 58, an altitude sensor 59, and the like are connected.

[0036] The GPS module 55 receives signals from GPS satellites and, based on the received signals, determines the longitude and latitude of the position of the first drone 10 or the second drone 11. The GPS module 55 outputs the determined longitude and latitude to the CPU 42.

[0037] The gyro sensor 56 detects a tilt angle that represents the attitude of the first drone 10 or the second drone 11. The gyro sensor 56 outputs the detected tilt angle to the CPU 42. The acceleration sensor 57 detects the acceleration of the first drone 10 or the second drone 11. The acceleration sensor 57 outputs the detected acceleration to the CPU 42. Note that the speed of the first drone 10 or the second drone 11 may be calculated by integrating the acceleration detected by the acceleration sensor 57.

[0038] The orientation sensor 58 detects the angle indicating the direction in which the front of the first drone 10 or the second drone 11 faces, that is, the azimuth angle, based on geomagnetism. The orientation sensor 58 outputs the detected azimuth angle to the CPU 42. Note that the front of the first drone 10 or the second drone 11 is the side to which the lens optical axis of the first camera 36 or the second camera 37 faces.

[0039] The altitude sensor 59 detects the flight altitude of the first drone 10 or the second drone 11. The altitude sensor 59 is, for example, a sensor that measures air pressure and converts it into a flight altitude. The altitude sensor 59 may also be a sensor that irradiates the ground surface with infrared laser light, receives the reflected light, and measures the distance from the ground surface based on the received reflected light. Alternatively, the altitude sensor 59 may be an ultrasonic sensor that irradiates the ground surface with ultrasonic waves, receives the echoes, and measures the distance from the ground surface based on the received echoes. The altitude sensor 59 outputs the detected flight altitude to the CPU 42.

[0040] When the first drone 10 or the second drone 11 is powered on and the operating program 45 is started, the CPU 42 functions as a flight controller 65 and a camera controller 66. The flight controller 65 controls the operation of the motor 33 via the motor driver 67. The camera controller 66 controls the operation of the first camera 36 or the second camera 37, and causes the first camera 36 to take the first aerial image 25 and the second camera 37 to take the second aerial image 26. The camera controller 66 also receives the first aerial image 25 or the second aerial image 26 from the first camera 36 or the second camera 37, performs image processing on the first aerial image 25 or the second aerial image 26, and then transmits the first aerial image 25 or the second aerial image 26 to the disaster information processing server 12 via the communication unit 43.

[0041] The storage 40 stores the first shooting range information 70 or the second shooting range information 71. More specifically, the storage 40 of the first drone 10 stores the first shooting range information 70, and the storage 40 of the second drone 11 stores the second shooting range information 71. The first shooting range information 70 is stored in the storage 40 of the first drone 10 before a disaster occurs. On the other hand, the second shooting range information 71 is transmitted from the disaster information processing server 12 to the second drone 11 after a disaster occurs and stored in the storage 40 of the second drone 11. The flight controller 65 performs control according to the first shooting range information 70 or the second shooting range information 71 while referring to various input data from the GPS module 55, the gyro sensor 56, the acceleration sensor 57, the orientation sensor 58, and the altitude sensor 59.

[0042] As an example, as shown in FIG. 6, the first shooting range information 70 is information about a first shooting range 80 (see FIG. 7) which is the shooting range of the first aerial image 25 of the first camera 36. Specifically, the first shooting range information 70 has items of longitude and latitude, direction, and altitude. In the longitude and latitude item, for example, the longitude and latitude of the sky above the departure and arrival base FB are registered. In the direction item, for example, four azimuth angles of 0° (north), 90° (east), 180° (south), and 270° (west) are registered. In the altitude item, for example, 500 m shown in FIG. 3 is registered.

[0043] As an example, as shown in FIG. 7, the first shooting range 80 defined by the first shooting range information 70 is rectangular, and there are four first shooting ranges 80_N, 80_E, 80_S, and 80_W. The entire flight range FR is covered by these first shooting ranges 80_N, 80_E, 80_S, and 80_W. The first shooting range 80_N is the shooting range when the azimuth angle of the first drone 10 is 0°. Similarly, the first shooting range 80_E is the shooting range when the azimuth angle of the first drone 10 is 90°, the first shooting range 80_S is the shooting range when the azimuth angle of the first drone 10 is 180°, and the first shooting range 80_W is the shooting range when the azimuth angle of the first drone 10 is 270°. Moreover, all of these first imaging ranges 80_N, 80_E, 80_S, and 80_W are imaging ranges when the departure and arrival base FB is viewed directly below by the first camera 36.

[0044] The flight controller 65 of the first drone 10 first flies the first drone 10 to a position 500 m above the takeoff and landing base FB according to the first shooting range information 70. Then, while hovering the first drone 10 at a position 500 m above the takeoff and landing base FB, the azimuth angle is changed to 0°, 90°, 180°, and 270° in sequence. The camera controller 66 of the first drone 10 captures the first shooting ranges 80_N, 80_E, 80_S, and 80_W at the azimuth angles of 0°, 90°, 180°, and 270°, respectively, to capture a total of four first aerial images 25.

[0045] The first shooting range 80 is set as a range in which the damage status of buildings captured in the first aerial photographed image 25 can be analyzed. The first shooting range 80 varies depending on the flight altitude of the first drone 10, the resolution of the first camera 36, ​​the angle of view of the first camera 36, ​​and the like. For this reason, as in the example of FIG. 7, the entire flight range FR may be covered by multiple first shooting ranges 80, or the entire flight range FR may be covered by one first shooting range 80.

[0046] 8, the computer constituting the disaster information processing server 12 includes a storage 85, a memory 86, a CPU (Central Processing Unit) 87, and a communication unit 88. These are interconnected via a bus line 89. The CPU 87 is an example of a "processor" according to the technology of the present disclosure.

[0047] The storage 85 is a hard disk drive built into the computer constituting the disaster information processing server 12 or connected via a cable or the network 13. Alternatively, the storage 85 is a disk array in which a plurality of hard disk drives are connected in series. The storage 85 stores control programs such as an operating system, various application programs, and various data associated with these programs. Note that a solid state drive may be used instead of a hard disk drive.

[0048] The memory 86 is a work memory for the CPU 87 to execute processing. The CPU 87 loads a program stored in the storage 85 into the memory 86 and executes processing according to the program. In this way, the CPU 87 comprehensively controls the operation of each part of the computer. The communication unit 88 controls the transmission of various information to and from external devices such as the first drone 10 and the second drone 11. The memory 86 may be built into the CPU 87.

[0049] 9, an operating program 95 is stored in the storage 85 of the disaster information processing server 12. The operating program 95 is an application program for causing a computer to function as the disaster information processing server 12. In other words, the operating program 95 is an example of an "operating program of a disaster information processing device" according to the technology of the present disclosure.

[0050] When the operating program 95 is launched, the CPU 87 of the computer constituting the disaster information processing server 12, in cooperation with the memory 86, etc., functions as a read / write (hereinafter abbreviated as RW (Read Write)) control unit 100, a first damage situation analysis unit 101, a second shooting range determination unit 102, a transmission control unit 103, a second damage situation analysis unit 104, and a screen distribution control unit 105.

[0051] The RW control unit 100 controls the storage of various data in the storage 85 and the reading of various data in the storage 85. For example, the RW control unit 100 accepts a first aerial image 25 from the first drone 10, and stores the accepted first aerial image 25 in the storage 85. The RW control unit 100 also accepts a second aerial image 26 from the second drone 11, and stores the accepted second aerial image 26 in the storage 85.

[0052] The RW control unit 100 reads out the first aerial image 25 from the storage 85, and outputs the read out first aerial image 25 to the first damage situation analysis unit 101. The RW control unit 100 also reads out the second aerial image 26 from the storage 85, and outputs the read out second aerial image 26 to the second damage situation analysis unit 104.

[0053] The first damage situation analysis unit 101 analyzes a first damage situation 127 (see FIG. 10) of the disaster in the first shooting range 80 based on the first aerial photographed image 25. The first damage situation analysis unit 101 outputs an analysis result 110 of the first damage situation 127 (hereinafter, abbreviated as a first analysis result) to the second shooting range determination unit 102.

[0054] The second shooting range determination unit 102 determines the second shooting range 136 (see FIG. 13 ) of the second camera 37 of the second drone 11 based on the first analysis result 110. The second shooting range determination unit 102 outputs second shooting range information 71, which is information on the determined second shooting range 136, to the transmission control unit 103. The transmission control unit 103 controls the transmission of the second shooting range information 71 to the second drone 11.

[0055] The second damage situation analysis unit 104 analyzes a second damage situation 148 (see FIG. 14 ) of the disaster in the second shooting range 136 based on the second aerial image 26. The second damage situation analysis unit 104 outputs an analysis result 111 of the second damage situation 148 (hereinafter, abbreviated as the second analysis result) to the RW control unit 100. The RW control unit 100 stores the second analysis result 111 in the storage 85.

[0056] When a distribution request (not shown) is received from the client terminal 14, the RW control unit 100 reads out the second analysis result 111 from the storage 85, and outputs the read out second analysis result 111 to the screen distribution control unit 105. The screen distribution control unit 105 generates a damage situation display screen 112 based on the second analysis result 111. The screen distribution control unit 105 controls the distribution of screen data of the generated damage situation display screen 112 to the client terminal 14 that has made the distribution request. The screen data is, for example, screen data for web distribution created by a markup language such as XML (Extensible Markup Language). The client terminal 14 reproduces and displays the damage situation display screen 112 on a web browser based on the screen data. Note that, instead of XML, other data description languages ​​such as JSON (Javascript (registered trademark) Object Notation) may be used.

[0057] As an example, as shown in FIG. 10, the first damage situation analysis unit 101 has a section image cutting unit 120 and a first processing unit 121. The section image cutting unit 120 cuts out a section image 123 for each section 135 (see FIG. 13) from the first aerial photograph image 25 with reference to the landmark building information 122. The section 135 is a plurality of areas into which the area 20 is divided, and is an area including a plurality of adjacent buildings. In this example, the section 135 is a block such as "Fuji 1-chome" and "Watabu Kitsuneana 2-chome." The section image cutting unit 120 outputs a section image group 125 including a plurality of pairs of a section image 123 and section information 124 representing the section 135 of the section image 123 to the first processing unit 121.

[0058] The landmark building information 122 is stored in storage 85, and is read out from storage 85 by the RW control unit 100 and output to the section image clipping unit 120. The landmark building information 122 includes an aerial image of a landmark building, which is a building located at the corner of each section 135, and section information 124 of the section 135 to which the landmark building belongs. The section image clipping unit 120 uses a well-known image recognition technique to find the landmark building from the first aerial image 25 using the aerial image of the landmark building as a reference. Then, the area surrounded by lines connecting the found landmark buildings is clipped from the first aerial image 25 as the section image 123.

[0059] The first processing unit 121 inputs the block image 123 to the first damage situation analysis model 126. Then, the first damage situation analysis model 126 outputs the first damage situation 127. The first damage situation 127 is either "heavy damage" or "minor damage". The first processing unit 121 outputs the first damage situation 127 from the first damage situation analysis model 126 for all block images 123 included in the block image group 125. The first processing unit 121 outputs the first analysis result 110 that summarizes the first damage situation 127 for each block 135. FIG. 10 illustrates an example in which the first damage situation 127 of blocks 135 such as "Fuji 1-chome" and "Watabu Kitsuneana 2-chome" is "heavy damage".

[0060] The first damage situation analysis model 126 is a machine learning model constructed by a method such as a neural network, a support vector machine, boosting, etc. The first damage situation analysis model 126 is stored in the storage 85, and is read out from the storage 85 by the RW control unit 100 and output to the first processing unit 121.

[0061] As an example, as shown in FIG. 11, in the learning phase, the first damage situation analysis model 126 is given learning data 130 and learns. The learning data 130 is a set of a learning section image 123L and a correct first damage situation 127CA corresponding to the learning section image 123L. The learning section image 123L is obtained by inputting a first aerial photographed image 25 of a certain area 20 to the section image cropping unit 120. The correct first damage situation 127CA is the result of a qualified person, such as a residential damage appraiser, actually determining the first damage situation 127 of a section 135 shown in the learning section image 123L.

[0062] In the learning phase, the learning section image 123L is input to the first damage situation analysis model 126. The first damage situation analysis model 126 outputs a learning first damage situation 127L for the learning section image 123L. A loss calculation is performed for the first damage situation analysis model 126 using a loss function based on this learning first damage situation 127L and the correct first damage situation 127CA. Then, various coefficients of the first damage situation analysis model 126 are updated according to the result of the loss calculation, and the first damage situation analysis model 126 is updated according to the update setting.

[0063] In the learning phase of the first damage situation analysis model 126, the above series of processes, including input of the learning section image 123L to the first damage situation analysis model 126, output of the learning first damage situation 127L from the first damage situation analysis model 126, loss calculation, update setting, and update of the first damage situation analysis model 126, are repeatedly performed while exchanging the learning data 130. The repetition of the above series of processes is terminated when the discrimination accuracy of the learning first damage situation 127L against the correct first damage situation 127CA reaches a predetermined set level. The first damage situation analysis model 126 whose discrimination accuracy has thus reached the set level is stored in the storage 85 and used by the first processing unit 121.

[0064] 12 as an example, the second shooting range determination unit 102 determines a shooting range including an area determined to have relatively large damage by the analysis of the first damage situation 127 as the second shooting range 136. In this example, the area determined to have relatively large damage is a block 135 such as "Fuji 1-chome" and "Menpu Kitsuneana 2-chome" for which the first damage situation 127 is determined to be "largely damaged" by the first damage situation analysis model 126.

[0065] Here, the section 135_F1 of "Fuji 1-chome" and the section 135_W2 of "Watabu Kitsuneana 2-chome" are included in the flight range FR_1 managed by the second drones 11A_1 and 11B_1 (see FIG. 13). In this case, the second shooting range determination unit 102 prepares second shooting range information 71A_1 in which the latitude and longitude and azimuth angles of a plurality of shooting points corresponding to a plurality of second shooting ranges 136_F1 covering the section 135_F1 of "Fuji 1-chome" are registered. In addition, the second shooting range determination unit 102 prepares second shooting range information 71B_1 in which the latitude and longitude and azimuth angles of a plurality of shooting points corresponding to a plurality of second shooting ranges 136_W2 covering the section 135_W2 of "Watabu Kitsuneana 2-chome" are registered. In addition, for example, 100 m shown in FIG. 3 is registered in the altitude item of the second shooting range information 71A_1 and 71B_1.

[0066] The transmission control unit 103 transmits the second shooting range information 71A_1, which is information on the second shooting range 136_F1 covering the section 135_F1 of "Fuji 1-chome", to the second drone 11A_1. The transmission control unit 103 also transmits the second shooting range information 71B_1, which is information on the second shooting range 136_W2 covering the section 135_W2 of "Menpu Kitsuneana 2-chome", to the second drone 11B_1. In this way, the second shooting range determination unit 102 determines the second shooting range 136 for each of the two second drones 11A_1 and 11B_1.

[0067] In FIG. 13 showing an example of the relationship between the section 135 and the second shooting range 136, the flight controller 65 of the second drone 11A_1 flies the second drone 11A_1 to each shooting point of the section 135_F1 of "Fuji 1-chome" in order according to the second shooting range information 71A_1. The camera controller 66 of the second drone 11A_1 shoots the second shooting range 136_F1 at each shooting point and shoots a plurality of second aerial images 26. Similarly, the flight controller 65 of the second drone 11B_1 flies the second drone 11B_1 to each shooting point of the section 135_W2 of "Watabu Kitsuneana 2-chome" in order according to the second shooting range information 71B_1. The camera controller 66 of the second drone 11B_1 shoots the second shooting range 136_W2 at each shooting point and shoots a plurality of second aerial images 26.

[0068] 7, the second shooting range 136 is a range relatively narrower than the first shooting range 80. The second shooting range 136 is a range that is, for example, 1 / 5 to 1 / 10 the size of the first shooting range 80.

[0069] 14 as an example, the second damage situation analysis unit 104 has a building information assignment unit 140, a building image clipping unit 141, and a second processing unit 142. The building information assignment unit 140 refers to a map with building information 143, and assigns building information 144 to each building appearing in the second aerial photograph image 26, and turns the second aerial photograph image 26 into a second aerial photograph image 26I with building information. The building information assignment unit 140 outputs the second aerial photograph image 26I with building information to the building image clipping unit 141.

[0070] The map with building information 143 is stored in the storage 85, and is read out from the storage 85 by the RW control unit 100 and output to the building information adding unit 140. The map with building information 143 is a three-dimensional map of the area 20, in which characteristic points such as rooftop corners and building information 144 are associated with each building. The building information 144 is specifically the name of the owner of the building (residence), such as "Fuji Kazuo," or the name of the building, such as "Fuji No. 1 Building." The building information 144 also includes the address of the building.

[0071] The building information adding unit 140 aligns the orientation of the building on the building information-added map 143 to the orientation of the building in the second aerial photographed image 26 based on the longitude and latitude, orientation, and altitude of the second drone 11 when the second aerial photographed image 26 was captured, the tilt angle of the second camera 37, and the like. The building information adding unit 140 also extracts feature points such as corners of the rooftops of the buildings in the second aerial photographed image 26. The building information adding unit 140 matches the building information-added map 143 aligned with the orientation of the building in the second aerial photographed image 26 with the second aerial photographed image 26, and searches for a position where the correlation between the feature points of the building information-added map 143 and the feature points of the second aerial photographed image 26 is highest. Then, at the position where the correlation is highest, the building information 144 of the building information-added map 143 is added to each building in the second aerial photographed image 26.

[0072] The building image cutout unit 141 cuts out a building image 145 from the second aerial image 26I with building information by using a machine learning model (not shown) in which, for example, an aerial image is used as an input image and an image of each building shown in the aerial image is used as an output image. The building image cutout unit 141 outputs a building image group 146 including a plurality of pairs of the building image 145 and the building information 144 to the second processing unit 142.

[0073] The second processing unit 142 inputs the building image 145 into the second damage situation analysis model 147. Then, the second damage situation 148 is output from the second damage situation analysis model 147. The second damage situation 148 is one of "completely destroyed", "partially destroyed", and "safe", assuming an earthquake or the like as a disaster. The second processing unit 142 outputs the second damage situation 148 from the second damage situation analysis model 147 for all the building images 145 included in the building image group 146. The second processing unit 142 outputs the second analysis result 111 that summarizes the second damage situation 148 for each building. In FIG. 14, a case is illustrated in which the second damage situation 148 of buildings such as "Fuji Kazuo" and "Fuji Jiro" is "completely destroyed", the second damage situation 148 of buildings such as "Fuji Santa" is "partially destroyed", and the second damage situation 148 of buildings such as "Fuji No. 1 Building" is "safe".

[0074] The second damage situation analysis model 147 is a machine learning model constructed by a method such as a neural network, a support vector machine, boosting, etc., similar to the first damage situation analysis model 126. The second damage situation analysis model 147 is stored in the storage 85, and is read out from the storage 85 by the RW control unit 100 and output to the second processing unit 142.

[0075] As an example, as shown in FIG. 15, in the learning phase, second damage situation analysis model 147 is given learning data 150 and learns. Learning data 150 is a set of learning building image 145L and correct second damage situation 148CA corresponding to learning building image 145L. Learning building image 145L is obtained by inputting second aerial photograph image 26 of a certain area 20 to building image cropping unit 141. Correct second damage situation 148CA is a result of a qualified person such as a residential damage appraiser actually determining second damage situation 148 of the building shown in learning building image 145L.

[0076] In the learning phase, the learning building image 145L is input to the second damage situation analysis model 147. The second damage situation analysis model 147 outputs a learning second damage situation 148L for the learning building image 145L. A loss calculation is performed for the second damage situation analysis model 147 using a loss function based on this learning second damage situation 148L and the correct second damage situation 148CA. Then, various coefficients of the second damage situation analysis model 147 are updated according to the result of the loss calculation, and the second damage situation analysis model 147 is updated according to the update setting.

[0077] In the learning phase of the second damage situation analysis model 147, the series of processes of inputting the learning building image 145L to the second damage situation analysis model 147, outputting the learning second damage situation 148L from the second damage situation analysis model 147, loss calculation, update setting, and updating the second damage situation analysis model 147 are repeatedly performed while exchanging the learning data 150. The repetition of the series of processes is terminated when the discrimination accuracy of the learning second damage situation 148L against the correct second damage situation 148CA reaches a predetermined set level. The second damage situation analysis model 147 whose discrimination accuracy has thus reached the set level is stored in the storage 85 and used by the second processing unit 142.

[0078] As an example, as shown in FIG. 16, the damage status display screen 112 displayed on the display 15 of the client terminal 14 has a building-specific damage status display area 155 and a statistical damage status display area 156. The building-specific damage status display area 155 displays building information 144, building images 145, and a second damage status 148 for each building. The statistical damage status display area 156 displays the total number of buildings in the region 20 that are completely destroyed, partially destroyed, and intact. When a confirmation button 157 is selected, the display of the damage status display screen 112 is erased. The building-specific damage status display area 155 and / or the statistical damage status display area 156 may be displayed separately for each flight range FR or for each section 135.

[0079] Next, the operation of the above configuration will be described with reference to the flowcharts of Fig. 17 and Fig. 18. First, when the operating program 95 is started in the disaster information processing server 12, the CPU 87 of the disaster information processing server 12 functions as a RW control unit 100, a first damage situation analysis unit 101, a second shooting range determination unit 102, a transmission control unit 103, a second damage situation analysis unit 104, and a screen delivery control unit 105, as shown in Fig. 9. As shown in Fig. 10, the first damage situation analysis unit 101 includes a block image clipping unit 120 and a first processing unit 121. Also, as shown in Fig. 14, the second damage situation analysis unit 104 includes a building information attachment unit 140, a building image clipping unit 141, and a second processing unit 142.

[0080] When a disaster occurs in the region 20, the first shooting range 80 is photographed by the first camera 36 mounted on the first drone 10 as shown in Fig. 7 according to the first shooting range information 70 shown in Fig. 6, thereby obtaining a first aerial image 25. The first aerial image 25 is transmitted from the first drone 10 to the disaster information processing server 12.

[0081] 17, in the disaster information processing server 12, the RW control unit 100 receives the first aerial image 25 from the first drone 10 (step ST100). The first aerial image 25 is stored in the storage 85 by the RW control unit 100.

[0082] The first aerial photographed image 25 is read out from the storage 85 by the RW control unit 100 and output to the first damage situation analysis unit 101. Then, as shown in FIG. 10, the first damage situation analysis unit 101 analyzes a first damage situation 127 of the disaster in the first shooting range 80 based on the first aerial photographed image 25 (step ST110). At this time, the first damage situation analysis unit 101 analyzes the first damage situation 127 for each block 135 including a plurality of adjacent buildings. The analysis result of the first damage situation 127, i.e., the first analysis result 110, is output from the first damage situation analysis unit 101 to the second shooting range determination unit 102.

[0083] As shown in FIG. 12, the second shooting range determination unit 102 determines the second shooting range 136 of the second camera 37 of the second drone 11 based on the first analysis result 110 (step ST120). At this time, the second shooting range determination unit 102 determines the shooting range including the area determined to be relatively damaged by the analysis of the first damage situation 127 as the second shooting range 136. In addition, the second shooting range determination unit 102 sets the flight altitude of the second drone 11 lower than that of the first drone 10. Furthermore, the second shooting range determination unit 102 determines the second shooting range 136 for each of the two second drones 11.

[0084] Second shooting range information 71, which is information on the second shooting range 136, is output from the second shooting range determination unit 102 to the transmission control unit 103. Then, the second shooting range information 71 is transmitted to the second drone 11 by the transmission control unit 103 (step ST130).

[0085] 13, the second camera 37 mounted on the second drone 11 captures an image of the second imaging range 136 in accordance with the second imaging range information 71, thereby obtaining a second aerial image 26. The second aerial image 26 is transmitted from the second drone 11 to the disaster information processing server 12.

[0086] 18, in the disaster information processing server 12, the RW control unit 100 receives the second aerial image 26 from the second drone 11 (step ST200). The second aerial image 26 is stored in the storage 85 by the RW control unit 100.

[0087] The second aerial photographed image 26 is read out from the storage 85 by the RW control unit 100 and output to the second damage situation analysis unit 104. Then, as shown in Fig. 14, the second damage situation analysis unit 104 analyzes a second damage situation 148 of the disaster in the second shooting range 136 based on the second aerial photographed image 26 (step ST210). The analysis result of the second damage situation 148, i.e., the second analysis result 111, is output from the second damage situation analysis unit 104 to the RW control unit 100 and stored in the storage 85 by the RW control unit 100.

[0088] When a delivery request from the client terminal 14 is accepted, the second analysis result 111 is read from the storage 85 by the RW control unit 100 and output to the screen delivery control unit 105. Then, the damage situation display screen 112 shown in Fig. 16 is generated by the screen delivery control unit 105 based on the second analysis result 111. Screen data of the damage situation display screen 112 is delivered by the screen delivery control unit 105 to the client terminal 14 that issued the delivery request (step ST220). The damage situation display screen 112 is displayed on the display 15 of the client terminal 14 that issued the delivery request, and is made available for viewing by staff at the disaster countermeasure headquarters.

[0089] As described above, the CPU 87 of the disaster information processing server 12 includes the RW control unit 100, the first damage situation analysis unit 101, and the second shooting range determination unit 102. The RW control unit 100 receives the first aerial image 25 obtained by photographing the first shooting range 80 including the area 20 by the first camera 36 mounted on the first drone 10. The first damage situation analysis unit 101 analyzes the first damage situation 127 of the disaster in the first shooting range 80 based on the first aerial image 25. The second shooting range determination unit 102 determines the second shooting range 136 of the second camera 37 mounted on the second drone 11, which is relatively narrower than the first shooting range 80, based on the first analysis result 110.

[0090] In this manner, in the technology of the present disclosure, first, a first damage situation 127, which is a rough damage situation of the disaster, is grasped by a first aerial photographed image 25 capturing a relatively wide first photographing range 80. Then, based on the first damage situation 127, a second photographing range 136 is determined for grasping a second damage situation 148, which is a detailed damage situation of the disaster. Therefore, it is possible to grasp the damage situation of the disaster site efficiently and in a short time, compared to the case where multiple drones are simply flown without any target.

[0091] The second shooting range determination unit 102 determines, as the second shooting range 136, a shooting range including an area of ​​the region 20 that is determined to have relatively large damage by the analysis of the first damage situation 127. The area that is determined to have relatively large damage is likely to include the disaster site. Therefore, the damage situation at the disaster site can be grasped more efficiently.

[0092] The RW control unit 100 receives the second aerial image 26 obtained by photographing the second shooting range 136 with the second camera 37 of the second drone 11. The second damage situation analysis unit 104 analyzes a second damage situation 148 of the disaster in the second shooting range 136 based on the second aerial image 26. Therefore, the second damage situation 148, which is more detailed than the first damage situation 127, can be easily grasped without performing a cumbersome investigation of actually walking around the disaster site.

[0093] The second shooting range determination unit 102 sets the flight altitude of the second drone 11 lower than that of the first drone 10. Therefore, without increasing the performance of the second camera 37 compared to the first camera 36 or setting the zoom magnification of the second camera 37 to a telephoto side compared to the first camera 36, ​​the second aerial photographed image 26, which has a higher resolution of buildings than the first aerial photographed image 25 and contributes to the analysis of the second damage situation 148, can be easily obtained.

[0094] The first damage situation analysis unit 101 analyzes the first damage situation 127 for each block 135 including multiple adjacent buildings. Therefore, the analysis of the first damage situation 127 can be completed in a shorter time than when the first damage situation 127 is analyzed for each building. As a result, the timing of dispatching the second drone 11 can be accelerated.

[0095] There are multiple second drones 11, and the second shooting range determination unit 102 determines the second shooting range 136 for each of the multiple second drones 11. For this reason, it is possible to grasp the damage situation at the disaster site in a shorter time than when there is only one second drone 11.

[0096] Instead of or in addition to setting the flight altitude of the second drone 11 lower than that of the first drone 10, the zoom magnification of the second camera 37 may be set to a telephoto side compared to that of the first camera 36, ​​thereby narrowing the second shooting range 136 relatively. Similarly to the second damage situation 148, the first damage situation 127 may be analyzed for each building. The number of second drones 11 responsible for one flight range FR may be one, or three or more.

[0097] Although either "heavy damage" or "little damage" has been given as an example of the first damage status 127, the present invention is not limited to this. Three or more levels of the first damage status 127, such as either "severe damage", "moderate damage", or "little damage", may be output. The degree of damage may also be output as a numerical value from 1 to 10, for example.

[0098] [Second embodiment] In the first embodiment, the second damage situation 148 is analyzed based only on the second aerial photographed image 26, but this is not limiting. As in a second embodiment shown in Figures 19 and 20, the second damage situation may be analyzed based on the first aerial photographed image 25 in addition to the second aerial photographed image 26.

[0099] 19 as an example, a building information adding section 161 of a second damage situation analyzing section 160 of the second embodiment refers to a map with building information 143, and adds building information 144 to each building appearing in the first aerial photograph image 25 in addition to the second aerial photograph image 26, to make the first aerial photograph image 25 a first aerial photograph image with building information 25I. A building image cutting section 162 cuts out a first building image 145A from the first aerial photograph image with building information 25I, and cuts out a second building image 145B from the second aerial photograph image with building information 26I. The second building image 145B is the same as the building image 145 of the first embodiment described above. The building image cropping unit 162 outputs a first building image group 146A including multiple pairs of a first building image 145A and building information 144, and a second building image group 146B including multiple pairs of a second building image 145B and building information 144 to the second processing unit 163.

[0100] The second processing unit 163 inputs the first building image 145A and the second building image 145B associated with the same building information 144 to the second damage situation analysis model 164. Then, the second damage situation analysis model 164 outputs the second damage situation 165. The second damage situation 165 is one of "completely destroyed", "partially destroyed", and "undamaged", like the second damage situation 148 of the first embodiment. The second processing unit 163 outputs the second damage situation 165 from the second damage situation analysis model 164 for all the first building images 145A and the second building images 145B associated with the same building information 144 included in the first building image group 146A and the second building image group 146B. Note that the first building images 145A and the second building images 145B that are not associated with the same building information 144 are input to the second damage situation analysis model 147 of the first embodiment, and the second damage situation 148 is output.

[0101] As an example, as shown in FIG. 20, in the learning phase, the second damage situation analysis model 164 is given learning data 170 and is trained. The learning data 170 is a set of the first learning building image 145AL and the second learning building image 145BL, and the correct second damage situation 165CA corresponding to the first learning building image 145AL and the second learning building image 145BL. The first learning building image 145AL is obtained by inputting the first aerial photographed image 25 of a certain area 20 to the building image cutout unit 162. The second learning building image 145BL is obtained by inputting the second aerial photographed image 26 of a certain area 20 to the building image cutout unit 162. The correct second damage situation 165CA is a result of a qualified person such as a residential damage appraiser actually determining the second damage situation 165 of the building shown in the first learning building image 145AL and the second learning building image 145BL.

[0102] In the learning phase, the first learning building image 145AL and the second learning building image 145BL are input to the second damage situation analysis model 164. The second damage situation analysis model 164 outputs a second learning damage situation 165L for the first learning building image 145AL and the second learning building image 145BL. Based on the second learning damage situation 165L and the correct second damage situation 165CA, a loss calculation is performed for the second damage situation analysis model 164 using a loss function. Then, various coefficients of the second damage situation analysis model 164 are updated according to the result of the loss calculation, and the second damage situation analysis model 164 is updated according to the update setting.

[0103] In the learning phase of the second damage situation analysis model 164, the above-mentioned series of processes, including input of the learning first building image 145AL and the learning second building image 145BL to the second damage situation analysis model 164, output of the learning second damage situation 165L from the second damage situation analysis model 164, loss calculation, update setting, and update of the second damage situation analysis model 164, are repeatedly performed while exchanging the learning data 170. The repetition of the above-mentioned series of processes is terminated when the discrimination accuracy of the learning second damage situation 165L against the correct second damage situation 165CA reaches a predetermined set level. The second damage situation analysis model 164 whose discrimination accuracy has thus reached the set level is stored in the storage 85 and used by the second processing unit 163.

[0104] As described above, in the second embodiment, the second damage situation analysis unit 160 analyzes the second damage situation 165 based on the first aerial photographed image 25 in addition to the second aerial photographed image 26. The first aerial photographed image 25 shows buildings relatively smaller than the second aerial photographed image 26, and therefore the resolution of the buildings is inferior to that of the second aerial photographed image 26. However, the first aerial photographed image 25 shows buildings at a different angle than the second aerial photographed image 26, and it may be easier to grasp the second damage situation 165 than the second aerial photographed image 26. This increases the possibility of grasping the second damage situation 165 of buildings that is not clear from the second aerial photographed image 26 alone, and as a result, the reliability of the second analysis result 111 can be improved.

[0105] [Third embodiment] In the third embodiment shown in FIG. 21, a second drone 11 is sent to provide support to an area in another flight range FR where the damage is deemed to be relatively greater.

[0106] As an example, as shown in FIG. 21, the first damage situation 127 of the sections 135_1, 135_2, 135_3, and 135_4 in the first flight range FR_1 is analyzed by the first damage situation analysis unit 101 to be "heavily damaged", while there is no section 135 in the second flight range FR_2 in which the first damage situation 127 is "heavily damaged". In this case, the second shooting range determination unit 102 first determines a plurality of shooting ranges 136_1 covering the section 135_1 as the second shooting range 136 of the second drone 11A_1. In addition, the second shooting range determination unit 102 determines a plurality of shooting ranges 136_2 covering the section 135_2 as the second shooting range 136 of the second drone 11B_1.

[0107] Furthermore, the second shooting range determination unit 102 determines a plurality of shooting ranges 136_3 covering the section 135_3 as the second shooting range 136 of the second drone 11A_2 in charge of the second flight range FR_2. Also, the second shooting range determination unit 102 determines a plurality of shooting ranges 136_4 covering the section 135_4 as the second shooting range 136 of the second drone 11B_2 in charge of the second flight range FR_2. The second drones 11A_2 and 11B_2 are examples of the "target second drone" according to the technology of the present disclosure. Also, the first flight range FR_1 is an example of a "flight range different from the flight range of the target second drone" according to the technology of the present disclosure, and the second flight range FR_2 is an example of the "flight range of the target second drone" according to the technology of the present disclosure. Furthermore, the sections 135_3 and 135_4 are examples of the "area where the damage is considered to be relatively large" according to the technology of the present disclosure.

[0108] Thus, in the third embodiment, when the damage in the area within the flight range FR of the target second drone 11 is determined to be relatively small by the analysis of the first damage situation 127, and there is an area in a flight range FR other than the flight range FR of the target second drone 11 where the damage is determined to be relatively large, the second shooting range determination unit 102 determines the shooting range including the area where the damage is determined to be relatively large as the second shooting range 136 of the target second drone 11. Therefore, the second drone 11 in the flight range FR where the damage is determined to be relatively small can be effectively utilized. As a result, the damage situation of the area where the damage is determined to be relatively large can be grasped in a shorter time. In addition to the second drone 11, the first drone 10 may be sent to support.

[0109] It is preferable to use a camera with high performance such as resolution as the first camera 36 so that each building can be clearly captured in the first aerial image 25. On the other hand, the second camera 37 does not need to have the same performance as the first camera 36.

[0110] The first aerial image 25 and the second aerial image 26 may be transmitted to the disaster information processing server 12 via cable after the first drone 10 and the second drone 11 land at the takeoff and landing base FB.

[0111] The flight range FR is not limited to three locations as shown in the example. It may be one or two locations, or four or more locations. Furthermore, the shape of the flight range FR is not limited to a circle. It may be an ellipse or a rectangle.

[0112] The block 135 including a plurality of adjacent buildings is not limited to the example block. A rectangular area of ​​a predetermined size with roads as boundaries may be the block 135.

[0113] In the above embodiments, the first camera 36 and the second camera 37 are assumed to be visible light cameras, but this is not limited thereto. The first camera 36 and the second camera 37 may be infrared cameras for capturing images in the evening or at night.

[0114] In the above embodiments, examples of the second damage status are either "total destruction", "partial destruction", or "safe", assuming that the disaster is mainly an earthquake, but are not limited thereto. Assuming that the disaster is a flood, any of "flooding above floor level", "flooding below floor level", or "safe" may be output as the second damage status. Assuming that the disaster is a large-scale fire, any of "total destruction", "partial destruction", or "safe" may be output as the second damage status. Second damage status analysis models according to the type of disaster may be prepared, and different second damage status analysis models may be used depending on the type of disaster.

[0115] In each of the above embodiments, for example, the hardware structure of the processing units that execute various processes, such as the RW control unit 100, the first damage situation analysis unit 101, the second shooting range determination unit 102, the transmission control unit 103, the second damage situation analysis units 104 and 160, the screen distribution control unit 105, the partition image extraction unit 120, the first processing unit 121, the building information attachment units 140 and 161, the building image extraction units 141 and 162, and the second processing units 142 and 163, may be the various processors shown below. As described above, the various processors include the CPU 87, which is a general-purpose processor that executes software (operation program 95) and functions as various processing units, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processes, such as an ASIC (Application Specific Integrated Circuit), etc.

[0116] A single processing unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs and / or a combination of a CPU and an FPGA). Also, multiple processing units may be composed of a single processor.

[0117] As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as client and server, and this processor functions as multiple processing units. Second, there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip, as typified by System On Chip (SoC), etc. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0118] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0119] The technology of the present disclosure can be appropriately combined with the above-mentioned various embodiments and / or various modified examples. In addition, it is not limited to the above-mentioned embodiments, and various configurations can be adopted without departing from the gist of the present disclosure. For example, although the present application has described the embodiments using a multicopter-type drone, the drone may be in the form of an airplane, rotorcraft, glider, airship, etc., as long as it is an unmanned aerial vehicle.

[0120] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replaced with respect to the description and illustrations shown above, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the description and illustrations shown above omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0121] In this specification, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0122] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, and standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0123] 2. Disaster Information Processing System 10. First Drone 11 Second drone 12 Disaster information processing server 13 Network 14 Client terminal 15 Display 16 Input Devices 20 Regions 25 First aerial image 26 Second aerial image 30 Aircraft 31 Arm 32 Propeller 33 Motor 34 Skid 35 Gimbal 36 Camera 1 37 Second Camera 40, 85 Storage 41, 86 memory 42, 87 CPU 43, 88 Communications Department 44 Power supply unit 45, 95 Operating Program 50 Pilot 53 Battery 55 GPS Module 56 Gyro sensor 57 Acceleration Sensor 58 Orientation Sensor 59 Altitude Sensor 65 Flight Controller 66 Camera Controller 67 Motor Driver 70 First shooting range information 71 Second shooting range information 80 First Shooting Range 89 Bus Line 100 Read / write control unit (RW control unit) 101 1st Damage Analysis Department 102 Second shooting range determination unit 103 Transmission control section 104, 160 2nd Damage Analysis Department 105 Screen distribution control unit 110 First Damage Analysis Results (First Analysis Results) 111 Second Damage Analysis Results (Second Analysis Results) 112 Damage status display screen 120 Section image cutout 121 First Processing Section 122 Landmark Building Information 123 Plot Image 123L Study Area Image 124 Plot Information 125 Section Images 126 First Damage Analysis Model 127 First Damage Situation 127CA Correct Answer: First Damage Situation 127L Study Guide No. 1 Damage Situation 130, 150, 170 training data 135 plots 136 Second Shooting Range 140, 161 Building Information Section 141, 162 Building image extraction section 142, 163 Second Processing Section 143 Map with building information 144 Building Information 145 Building Images 145A First Building Image 145AL Learning Image of the First Building 145B 2nd building image 145BL Study image of the second building 145L Learning building images 146 Building Images 146A First Building Image Group 146B Second Building Image Group 147, 164 Second Damage Analysis Model 148, 165 Second damage situation 148CA, 165CA Correct Answer: Second Damage Situation 148L, 165L Second damage situation for learning 155 Damage status display area by building 156 Statistical damage status display area 157 Confirm button FB Departure and Arrival Base FR Flight Range ST100, ST110, ST120, ST130, ST200, ST210, ST220 Step

Claims

1. A processor; A memory connected to or embedded in the processor, The processor, A first aerial image obtained by photographing a first photographing range including the disaster area by a first camera mounted on a first drone is received, Analyzing a first damage situation of the disaster in the first photographing range based on the first aerial photographed image; determining a second shooting range of a second camera mounted on a second drone based on an analysis result of the first damage situation, the second shooting range being relatively narrower than the first shooting range; Disaster information processing device.

2. The processor, The disaster information processing apparatus according to claim 1 , wherein an imaging range including an area determined to have suffered relatively large damage in the disaster area by the analysis of the first damage situation is determined as the second imaging range.

3. The processor, A second aerial image obtained by photographing the second photographing range by the second camera is received, The disaster information processing device according to claim 1 or 2, further comprising: a second damage situation of the disaster in the second imaging range being analyzed based on the second aerial photographed image.

4. The processor, The disaster information processing device according to claim 3 , wherein the second damage situation is analyzed based on the first aerial image in addition to the second aerial image.

5. The processor, The disaster information processing device according to claim 1 , wherein the flight altitude of the second drone is set lower than that of the first drone.

6. The processor, The disaster information processing device according to claim 1 , wherein the first damage situation is analyzed for each block including a plurality of adjacent buildings.

7. A flight range is preset for the second drone, The processor, A disaster information processing device as described in any one of claims 1 to 6, wherein when analysis of the first damage situation determines that damage in an area within the flight range of the target second drone is relatively small, and there is an area in a flight range other than the flight range of the target second drone where damage is relatively large, a shooting range including the area where damage is relatively large is determined as the second shooting range of the target second drone.

8. There are multiple second drones, The processor, The disaster information processing device according to claim 1 , wherein the second shooting range is determined for each of a plurality of the second drones.

9. Accepting a first aerial image obtained by photographing a first photographing range including the disaster area by a first camera mounted on a first drone; Analyzing a first damage situation of the disaster in the first shooting range based on the first aerial image; and A method for operating a disaster information processing device includes determining a second shooting range of a second camera mounted on a second drone based on the analysis results of the first damage situation, the second shooting range being relatively narrower than the first shooting range.

10. Accepting a first aerial image obtained by photographing a first photographing range including the disaster area by a first camera mounted on a first drone; Analyzing a first damage situation of the disaster in the first shooting range based on the first aerial image; and An operating program for a disaster information processing device for causing a computer to execute processing including determining a second shooting range of a second camera mounted on a second drone based on the analysis results of the first damage situation, the second shooting range being relatively narrower than the first shooting range.

11. a first drone equipped with a first camera that captures a first shooting range including the disaster area and outputs a first aerial image; A second drone equipped with a second camera that captures a second shooting range that is relatively narrower than the first shooting range and outputs a second aerial image; A processor; A memory connected to or embedded in the processor, The processor, Accepting the first aerial image; Analyzing a first damage situation of the disaster in the first photographing range based on the first aerial photographed image; determining the second photographing range based on the analysis result of the first damage situation; Disaster information processing system.

Images