UAV surveying system and UAV surveying program

A coordinated UAV system with multiple surveying UAVs and a control device enables rapid and accurate disaster assessment by optimizing flight routes and integrating data for efficient surveying and prediction.

JP7588450B1Active Publication Date: 2024-11-22GK PUB TECH LAB
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024151834
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-11-22
Estimated Expiration
2044-09-03

AI Technical Summary

Technical Problem

Existing UAV surveying methods are inefficient and time-consuming when using a single UAV, and there is a lack of systems utilizing multiple UAVs for rapid disaster assessment.

Method used

A system comprising a transportation UAV carrying multiple surveying UAVs, a control device for coordinated flight and data integration, and a management server for data processing and route adjustment, enabling simultaneous and efficient surveying by multiple UAVs with data combination and prediction capabilities.

Benefits of technology

The system allows for faster surveying of disaster areas, provides interim results, adjusts routes for improved accuracy, predicts future conditions, and integrates past data for enhanced disaster assessment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007588450000001_ABST
    Figure 0007588450000001_ABST
Patent Text Reader

Abstract

The present invention aims to provide a UAV surveying system that can conduct surveying in a short period of time. [Solution] The UAV surveying system of the present invention comprises a plurality of surveying UAVs each having one or more types of measuring devices, a transport UAV for transporting the plurality of surveying UAVs, and a control device for controlling the plurality of surveying UAVs and the transport UAVs, wherein the control device (1) flies the transport UAV on which the plurality of surveying UAVs are mounted from a takeoff position to a target position, (2) launches the plurality of surveying UAVs from the transport UAV located at the target position, (3) has each of the plurality of surveying UAVs flying along different routes survey the ground corresponding to each of the different routes using at least one or more types of measuring devices while transmitting survey data of each of the different routes to the control device, and (4) combines the survey data of each of the different routes received by the control device.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a UAV surveying system and a UAV surveying program. [Background technology]

[0002] A method of remotely surveying (remote sensing) using surveying equipment mounted on an unmanned aerial vehicle (hereinafter referred to as a UAV (Unmanned Aerial Vehicle) in this specification) is known as a method for quickly and efficiently grasping the situation on the ground. Here, surveying methods include laser ranging (including electromagnetic waves and infrared rays), thermal image analysis, camera image analysis, ultrasonic data analysis, etc. Detailed and highly accurate surveying results can be quickly obtained by combining multiple pieces of surveying data transmitted from the UAV to an external computer via a communication network and relating them to satellite positioning information (GPS information) for each surveying position. Moreover, as an example of a scenario in which remote surveying can be utilized, grasping the situation when a disaster occurs is being considered (see Non-Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Non-Patent Document 1] Use of UAVs (Unmanned Aerial Vehicles) in Disasters, Masami Omashi, New Technology and New Construction Methods Division: No. 16 [online], [Retrieved August 23, 2024], Internet<URL:https: / / www.kkr.mlit.go.jp / plan / happyou / thesises / 2017 / pdf05 / shingijutsu-16.pdf> Summary of the Invention [Problem to be solved by the invention]

[0004] Non-Patent Document 1 discloses an example of a method of utilizing UAVs when a disaster occurs, such as taking photographs using one (single) UAV, but does not disclose the use of multiple UAVs.

[0005] The present invention aims to provide a surveying system using multiple surveying UAVs. More specifically, it aims to provide a UAV surveying system that can complete a survey in a shorter time than when a single surveying UAV is used. [Means for solving the problem]

[0006] The UAV survey system of the first embodiment includes: A plurality of survey UAVs, each having at least one type of measurement device; A transport UAV that carries the plurality of survey UAVs and transports the plurality of survey UAVs; A control device that is communicatively connected to the plurality of survey UAVs and the transport UAV and controls the plurality of survey UAVs and the transport UAV; Equipped with The control device (1) flies the transport UAV, on which the multiple survey UAVs are mounted in advance, from a takeoff position to each target position, (2) launches the multiple survey UAVs from the transport UAV located at each target position so that each of the multiple survey UAVs flies a predetermined route that is different from each other, (3) has each of the multiple survey UAVs flying the different routes survey the ground corresponding to each different route using at least one type of measuring device while transmitting survey data of each different route to the control device, and (4) combines the survey data of each different route received by the control device to calculate the survey results of the entire route. The UAV surveying system of the second aspect includes: moreover, In (3), the control device causes each of the multiple surveying UAVs to transmit survey data for each of the different routes multiple times at a predetermined timing, and in (4), receives the survey data for each of the different routes multiple times at the predetermined timing, and combines the survey data for each of the different routes received in the past to calculate the survey results up to that point. The UAV surveying system of the third aspect includes: moreover, At least a portion of the preset route in one of the plurality of surveying UAVs is set to correspond to at least a portion of the preset route in another surveying UAV, In (4), the control device calculates survey results for the entire route and calculates observation results for the entire route. The UAV surveying system of the fourth aspect is moreover, When there is a difference between the survey results of one route and the survey results of all the remaining routes in the previous survey results that is greater than or equal to a preset survey difference, the control device changes the preset routes of at least one or more survey UAVs among the multiple survey UAVs that fly on a route other than the one route so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all the remaining routes. The UAV surveying system of the fifth aspect is moreover, When there is a difference between the survey results of one route and the survey results of all the remaining routes in the previous survey results that is greater than or equal to a preset survey difference, the control device changes the preset routes of at least one or more survey UAVs among the multiple survey UAVs that fly on a route other than the one route so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all the remaining routes. The UAV surveying system of the sixth aspect is moreover, The control device is communicatively connected to a weather information storage device that stores weather information, The control device combines the observation results for the entire route with meteorological information received from the meteorological information storage device to predict future observation results for an area corresponding to the entire route. The seventh aspect of the UAV surveying system is moreover, The control device is communicatively connected to a survey information storage device that stores survey information of the entire route; The control device further combines the survey information of the entire route received from the survey information storage device to predict future observation results for an area corresponding to the entire route. The UAV survey program of the first aspect includes: Using the UAV surveying system of the first or second aspect, The control device includes: A function of flying the transport UAV on which the plurality of survey UAVs are mounted from a takeoff position to each of the target positions; A function of launching the plurality of survey UAVs from the transport UAV located at each of the target positions so that each of the plurality of survey UAVs flies a different route that is a preset route; A function of having each of the plurality of survey UAVs flying different routes carry out ground surveys corresponding to the different routes using at least one type of measuring device and transmitting survey data of the different routes to the survey UAV; a function of calculating a survey result of the entire route by synthesizing the survey data of each different route received by the device and calculating an observation result of the entire route; Execute the command. The UAV survey program of the second aspect is Using the UAV surveying system of the first or second aspect, The control device includes: A function of flying the transport UAV on which the plurality of survey UAVs are mounted from a takeoff position to each of the target positions; A function of launching the plurality of survey UAVs from the transport UAV located at each of the target positions so that each of the plurality of survey UAVs flies a different route that is a preset route; A function of having each of the plurality of survey UAVs flying different routes carry out ground surveys corresponding to the different routes using at least one type of measuring device and transmitting survey data of the different routes to the survey UAV; a function of calculating a survey result of the entire route by synthesizing the survey data of each different route received by the device and calculating an observation result of the entire route; a function of predicting future survey results for the entire route from the observation results of the entire route and the weather information for the entire route at the time of calculation of the observation results of the entire route, using a prediction model machine-learned using correlations between multiple observation results observed in the past on routes different from the entire route and the weather information at the time of each of the multiple observation results as training data; Execute the command. The UAV survey program of the third aspect is Using the UAV surveying system of the fourth aspect, The control device includes: A function of flying the transport UAV on which the plurality of survey UAVs are mounted from a takeoff position to each of the target positions; A function of launching the plurality of survey UAVs from the transport UAV located at each of the target positions so that each of the plurality of survey UAVs flies a different route that is a preset route; A function of having each of the multiple survey UAVs flying different routes carry out ground surveys corresponding to each different route using at least one type of measurement device at a predetermined timing while transmitting survey data of each different route to the UAV multiple times; a function of calculating a survey result of an entire route by synthesizing the survey data of each of the different routes received by the device itself a plurality of times at the predetermined timing, and calculating a survey result up to that point by synthesizing the survey data of each of the different routes received in the past a plurality of times; a function of changing the preset route of at least one or more survey UAVs among the plurality of survey UAVs flying a route other than the one route, when there is a difference between the survey result of one route and the survey results of all remaining routes that is equal to or greater than a preset survey difference in the survey results up to that point, so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all remaining routes; Execute the command. Effect of the Invention

[0007] According to the UAV surveying system of the first aspect, surveying can be completed in a shorter time than when a single survey UAV is used. According to the UAV survey system of the second aspect, the survey results up to that point can be calculated before the survey results for the entire route are calculated. According to the UAV surveying system of the third aspect, observation results can be obtained by calculating multiple survey results. According to the UAV surveying system of the fourth and fifth aspects, a preset route (surveying area) can be changed to obtain more appropriate surveying results. According to the UAV surveying systems of the sixth and seventh aspects, by combining current observation results with meteorological information, it is possible to more appropriately predict the observation results immediately thereafter. According to the UAV survey program of the first aspect, the UAV survey system can be caused to carry out a survey in a shorter time than when a survey is carried out using a single survey UAV. According to the UAV survey program of the second aspect, it is possible to cause the UAV survey system to predict future survey results. Also, according to the UAV survey program of the second aspect, it is possible to provide the UAV survey system with observation results from the past to the future. According to the UAV survey program of the third aspect, a preset route (survey area) can be changed to allow the UAV survey system to obtain appropriate survey results. [Brief description of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of a UAV survey system according to a first embodiment. FIG. [Diagram 2] 1 is a schematic diagram of a management server provided in the UAV surveying system of the first embodiment. FIG. [Figure 3A] FIG. 1 is a diagram for explaining the operation of the UAV surveying system of the first embodiment, and is a schematic diagram of the takeoff position and target position of a large UAV and their surroundings. [Figure 3B] This is a schematic diagram showing the state when a large UAV is set at the takeoff position in the schematic diagram of Figure 3A. [Figure 3C] In the schematic diagram of Figure 3A, this is a schematic diagram showing a situation when a large UAV arrives at a target position and multiple small UAVs are launched from the large UAV. [Figure 3D] FIG. 3D is a schematic diagram of the survey area in the schematic diagram of FIG. 3C viewed from above in the vertical direction. [Figure 3E] FIG. 2 is a flow diagram of the operation of the UAV surveying system of the first embodiment. [Figure 4A] This is a schematic diagram of the UAV surveying system of the second embodiment, showing the survey area viewed from above in the vertical direction immediately after the large UAV arrives at the first target position. [Figure 4B] This is a schematic diagram of the UAV surveying system of the second embodiment, showing the survey area from above in the vertical direction immediately after the large UAV arrives at the second target position. [Diagram 5] FIG. 11 is a flow diagram of the operation of the UAV surveying system of the third embodiment. [Figure 6A] FIG. 11 is a flow diagram of the operation of the UAV surveying system of the fourth embodiment. [Figure 6B] FIG. 7 is a partial flow diagram of the modification consideration (S70B) in the flow diagram of FIG. 6A. [Figure 6C]13 is a schematic diagram for explaining the route before and after a change when the route is changed as a result of revision consideration in the UAV surveying system of the fourth embodiment. FIG. [Figure 7] FIG. 13 is a flow diagram of the operation of the UAV surveying system of the fifth embodiment. [Figure 8] FIG. 13 is a flow diagram of the operation of the UAV surveying system of the sixth embodiment. [Figure 9] FIG. 11 is a flow diagram of the operation of the UAV surveying system of the first modified example. [Figure 10] This is a schematic diagram of a UAV surveying system of a second modified example, showing the survey area from above in the vertical direction immediately after a large UAV has arrived at the target position. [Figure 11] FIG. 11 is a flow diagram of the operation of the UAV surveying system of the third modified example. [Figure 12] FIG. 13 is a partial flow diagram of a modification examination (S70F) in the flow diagram of the fourth modified example. [Figure 13] This is a schematic diagram of a UAV surveying system of the fifth modified example, showing the survey area from above in the vertical direction immediately after a large UAV has arrived at the target position. [Figure 14] FIG. 13 is a flow diagram showing the operation of the UAV surveying system of the sixth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] <Overview> Hereinafter, the first to sixth embodiments, several modified examples, and reference examples will be described. Please note that in this specification, components having similar functions are denoted by the same or similar reference numerals in each drawing referred to in different embodiments.

[0010] First Embodiment First, the UAV survey system MS1 (see FIG. 1 etc.) of the first embodiment will be described in terms of its functions, configuration, operation and effects with reference to FIG. 1 to FIG. 3E.

[0011] <Functions and configuration of the first embodiment> The UAV surveying system MS1 of this embodiment has the functions of (1) transporting multiple small UAVs 20 (an example of multiple surveying UAVs) from a takeoff position SP to a target position TP using a large UAV 10 (an example of a transport UAV), (2) using each of the multiple small UAVs 20 to survey each of the areas (survey area) surrounding the target position TP, and (3) combining the multiple survey results to calculate the survey result of the survey area. The purpose of use of the UAV surveying system MS1 of this embodiment is, for example, to quickly investigate the disaster situation in a certain area when a disaster such as an earthquake, fire, flood, etc. occurs in the certain area. In this embodiment, the purpose of use of the UAV surveying system MS1 is, as an example, to investigate the disaster situation when a disaster occurs in a certain area, but it should be noted that the purpose of use of the UAV surveying system MS1 may be used for investigations other than the investigation.

[0012] 1, the UAV surveying system MS1 includes a large UAV 10, multiple small UAVs 20, a management server 30 (an example of a control device), an external server 40, and a user terminal 50. These components are communicatively connected to the management server 30 via a communication network NW (the Internet, for example).

[0013] (Large UAV) The large UAV 10 has the function of carrying multiple small UAVs 20 and transporting the multiple small UAVs 20 from a takeoff position SP to a target position TP (see Figs. 3B and 3C). Here, the takeoff position SP refers to a position from which the large UAV 10 can take off, for example, even if a disaster occurs, that is, a position from which the large UAV 10 can take off without being affected by the disaster. Also, the target position TP refers to a position in an area where a disaster occurs, where multiple small UAVs 20 are set to be detached (transmitted) from the large UAV 10. The setting of the target position TP and the setting of the flight route from the takeoff position SP to the target position TP are performed by a user U (operator) using, for example, a user terminal 50 described later. The large UAV 10 is equipped with a GPS receiver (not shown).

[0014] (Multiple small UAVs) Each of the multiple small UAVs 20 has the function of detaching from the large UAV at a target position TP, surveying each of the areas (survey area) that are divided around the target position TP, and transmitting the survey data to the management server 30. In this embodiment, the number of small UAVs 20 is, for example, four, but may be two to three, or five or more. The small UAVs 20 are small UAVs 20A, 20B, 20C, and 20D (see FIG. 1, FIG. 3D, etc.). The aforementioned divided regions refer to, for example, a first region, a second region, a third region, and a fourth region, as shown in FIG. 3D. The aforementioned surveying of each area means collecting geographical information on the ground in each area and accurately measuring the position, shape, height, etc. Each of the multiple small UAVs 20 has at least one type of measuring device (not shown) for surveying each area. For example, the small UAVs 20 are equipped with devices for measuring by laser ranging (including electromagnetic waves and infrared rays), thermal image analysis, camera image analysis, ultrasonic data analysis, etc. Each of the multiple small UAVs 20 is equipped with a GPS receiver (not shown).

[0015] (Management Server) 1, the management server 30 is communicatively connected to a large UAV 10, multiple small UAVs 20, an external server 40, and a user terminal 50 via a communication network NW. As an example, the management server 30 is a so-called cloud server that exists on a cloud CLD. The management server 30 has a function of controlling the large UAV 10 and the multiple small UAVs 20 based on commands (instruction information) received from the user terminal 50. The management server 30 also has a function of transferring information (location information, survey information) transmitted from the large UAV 10 and the multiple small UAVs 20 to the user terminal 50, as well as a function of synthesizing the survey information and further transferring it to the user terminal 50. As shown in FIG. 2, the management server 30 includes a processing unit 32 (CPU (Central Processing Unit)) and a storage unit 34 (Memory). The processing unit 32 reads out data stored in the storage unit 34 and performs arithmetic processing. The data includes, as an example, an application AP. The application AP includes a program PG1, a data file DF, and various libraries LB. The control method of the large UAV 10 and multiple small UAVs 20 by the management server 30 and the program PG1 will be explained in the operation description below.

[0016] (External server) The external server 40 is, for example, a server existing on the cloud CLD, and is a server separate from the management server 30. For example, the external server 40 stores map information, past disaster information (date and time, weather at that time, damage information at that time, and other information), surveying results obtained by executing the programs PG1 to PG6 in the past, information on past and current weather, and the like. When the management server 30 transmits an acquisition request for this information (for example, a request by WebAPI) to the external server 40, the management server 30 is able to receive this information via the communication network NW.

[0017] (User device) The user terminal 50 is a terminal used by a user U (operator) and is capable of transmitting information on surveying conditions input by the user U to the management server 30 via the communication network NW. The user terminal 50 is also capable of receiving information (position information, surveying information) transmitted to the management server 30 from the large UAV 10 and the multiple small UAVs 20, as well as surveying information synthesized by the management server 30.

[0018] The above is a description of the functions and configuration of the UAV survey system MS1 of the first embodiment.

[0019] <Operation of the First Embodiment> Next, the operation of the UAV survey system MS1 of the first embodiment will be described with reference to FIGS. 3A to 3E.

[0020] (S10) When a disaster occurs in a certain area (see FIG. 3A), a user U (operator) assumes the location of the disaster area and specifies a target position TP and a survey area. The information is transmitted from the user terminal 50 to the management server 30 (see FIG. 1). Accordingly, the management server 30 receives map information of the survey area from the external server 40 and divides it into portions equal to the number of small UAVs 20. This division is set by the management server 30 while referring to the map information so that the survey time can be shortened. (S20) Next, an operator (not shown) sets the large UAV 10 carrying multiple (four) small UAVs 20 at the takeoff position SP (see FIG. 3B). The operator then notifies the management server 30 from his / her own information terminal (not shown) via the communication network NW that the setting has been completed. As a result, the management server 30 causes the large UAV 10 to take off. The flight position of the large UAV 10 is grasped by the management server 30 from position information from the GPS device.

[0021] (S30) Next, when the management server 30 determines that the large UAV 10 has reached the target position TP, it detaches the four small UAVs 20 from the large UAV 10 in the air, and further launches each of the four small UAVs 20 toward a predetermined (divided) survey area (first to fourth areas (see Figure 3D)).

[0022] (S40) Next, the management server 30 causes each of the four small UAVs 20 to fly a preset route in each survey area (first to fourth areas (see FIG. 3D)) (see FIG. 3D). The management server 30 also causes the four flying small UAVs 20 to perform surveying at timings determined by their respective measuring devices, and transmits the surveying data to itself together with GPS information (location information). Here, the determined timing is set to, for example, 1 to 3 seconds, but it may be shorter or longer than this example as long as a large amount of data can be acquired during the period of flying the entire route. The surveying data is data such as laser ranging (including electromagnetic waves and infrared rays), thermal image analysis, camera video analysis, and ultrasonic data analysis.

[0023] (S50 and S60) Next, when the management server 30 determines that the four small UAVs 20 have completed flying and surveying the entire route in each survey area (areas 1 to 4 (see Figure 3D)) (S50), it combines the multiple measurement data received from each of the four small UAVs 20 to calculate the measurement results for the entire measurement area (all routes), and the measurement operation program PG1 ends (S60). When the management server 30 completes the calculation of the measurement result, it transmits the result to the user terminal 50 via the communication network NW.

[0024] (Overview of control operations) The operation flow of FIG. 3E (or the algorithm of program PG1) referred to in the above description can be summarized as follows. The management server 30 (1) flies a large UAV 10 equipped with multiple small UAVs 20 from a takeoff position SP to each target position TP, (2) launches multiple small UAVs 20 from the large UAV 10 located at each target position TP so that each of the multiple small UAVs 20 (20A to 20D) flies a different route that is a predetermined route, (3) has each of the multiple small UAVs 20 (20A to 20D) flying different routes in each survey area (1st to 4th areas) perform ground measurements corresponding to each different route using at least one type of measuring device (measurements using laser ranging (including electromagnetic waves and infrared rays), thermal image analysis, camera video analysis, ultrasonic data analysis, etc.) while transmitting the measurement data of each different route to itself, and (4) combines the measurement data of each different route received by itself to calculate the measurement results of the entire route (or the entire survey area).

[0025] This concludes the description of the operation of the UAV survey system MS1 of the first embodiment.

[0026] <Advantages of the First Embodiment> Next, the effects of the first embodiment will be described.

[0027] (First effect) In this embodiment, multiple small UAVs 20 that fly in a survey area and perform surveying are transported by a large UAV 10 from a takeoff position SP to a target position TP (see FIG. 3C). Therefore, while multiple small UAVs 20 are being transported to the large UAV 10, the energy of the batteries and other devices installed in each of them is not consumed by flight operations. Therefore, this embodiment can conduct surveying over a wider area than when multiple small UAVs 20 are launched from the takeoff position SP to conduct the surveying.

[0028] (Second effect) In addition, in this embodiment, the number of small UAVs 20 transported by the large UAV 10 from the takeoff position SP to the target position TP is multiple (four in this embodiment, as an example) (see FIG. 3B). Therefore, if each of the small UAVs 20A, 20B, 20C, and 20D flies and surveys the first to fourth areas divided into areas corresponding to the number of small UAVs 20, the survey of the entire survey area will be completed (see FIG. 3D). Therefore, this embodiment can survey the entire measurement area in a shorter time than when a single survey UAV (small UAV) is used to survey the entire measurement area. Accordingly, the user U (operator) can obtain the survey results of the disaster situation in a certain area (survey area) more quickly by using the user terminal 50 that receives the survey results from the management server 30.

[0029] The above is a description of the effects of the first embodiment. The above is a description of the present embodiment.

[0030] Second Embodiment Next, a UAV survey system MS2 of a second embodiment will be described with reference to Figures 4A and 4B. The following description will focus only on the differences between this embodiment and the first embodiment (see Figures 1 to 3E). In the following description, it is assumed that the entire survey area is the same location and the same range in both the first embodiment and this embodiment.

[0031] In the first embodiment, the target position TP is a single location in the center of the entire survey area (see FIG. 3D). In the first embodiment, measurement by the multiple small UAVs 20 does not begin until the large UAV 10 arrives at the target position TP1 that is set in the center of the entire survey area.

[0032] In contrast, in the present embodiment, the target positions TP1 and TP2 are set at two locations (multiple locations), one on the periphery of the entire survey area (target position TP1) and the other at a target position TP2 slightly offset from the center of the entire survey area. In the present embodiment, (1) when passing through the target position TP1 set in two areas (for example, the second and third areas) on the periphery of the entire survey area, the two small UAVs 20B and 20C are detached from the large UAV 10 and start flying and surveying in each area (the second and third areas) (see FIG. 4A), and (2) when the large UAV 10 reaches the target position TP2, the remaining two small UAVs 20A and 20D are detached from the large UAV 10 and start flying and surveying in each of the remaining areas (the first and fourth areas) (see FIG. 4B). In this embodiment, the management server 30, for example, sets the areas so that (1) the areas of the second and third areas are larger than the areas of the first and fourth areas, and (2) the flight of each small UAV 20A, 20B, 20C, and 20D in all areas (first to fourth areas) ends at the same time.

[0033] Therefore, in this embodiment, calculation of the survey results for the entire survey area can be completed in a shorter time than in the first embodiment described above.

[0034] The above is a description of the second embodiment.

[0035] Third Embodiment Next, a UAV survey system MS3 according to a third embodiment will be described with reference to Fig. 5. The following description will focus only on the differences between this embodiment and the first embodiment (see Figs. 1 to 3E).

[0036] In the first embodiment, the management server 30 (1) causes the four small UAVs 20 to complete flight and survey of the entire route in the survey area (areas 1 to 4 (see Figure 3D)) (see S40 and S50 in Figure 3E), and then (2) combines the multiple measurement data received from each of the four small UAVs 20 to calculate the measurement results for the entire measurement area (entire route) (see S60 in Figure 3E).

[0037] In contrast, in this embodiment, the management server 30 (1) causes the four small UAVs 20 to transmit survey data at predetermined timing while flying the route of each survey area (first to fourth areas (see Figure 3D)) (see S40 in Figure 5), and then (2) combines the survey data from the four small UAVs 20 received at the predetermined timing each time, i.e., combines the survey data of each route up to that point, and calculates the measurement results of the measurement area up to that point (the route up to that point) (see S60A and S50 in Figure 5).

[0038] Therefore, in this embodiment, unlike the first and second embodiments, the survey results up to that point can be calculated before the survey results for the entire route are calculated. Accordingly, the user U (operator) can obtain the survey results of the disaster situation on the way in a certain area (survey area) by using the user terminal 50 that has received the survey results up to that point (on the way) from the management server 30.

[0039] The above is a description of the third embodiment.

[0040] Fourth Embodiment Next, a UAV survey system MS4 according to a fourth embodiment will be described with reference to Figures 6A to 6C. The following description will focus only on the differences between this embodiment and the third embodiment (see Figure 5).

[0041] In the fourth embodiment, the management server 30 continues to perform the operation of synthesizing the surveying data received from the four small UAVs 20 at predetermined timing each time and calculating the surveying results of the measurement area (route up to that point) up to that point (hereinafter referred to as the intermediate surveying calculation operation) until the flight of each route of all (four) small UAVs 20A, 20B, 20C, and 20D has been completed by judgment step S50 (see S60A and S50 in Figure 5).

[0042] In contrast, in the case of this embodiment, if the determination in the determination step S50 is negative, the management server 30 performs S70 (a step for determining whether to correct the route) during the mid-way survey calculation operation (see FIG. 6A). (S71B) Here, in S70, (1) first, in decision step S71B, it is determined whether the route has been changed in the past. If the route has been changed in the past (if the decision is positive), the process proceeds to S40 (FIG. 6A). On the other hand, if the route has not been changed in the past (if the decision is negative), the process proceeds to decision step S72B. (S72B) Next, in decision step S72B, if the results of the survey so far in the divided multiple survey areas (first to fourth areas) show that the value (for example, temperature, luminosity, etc.) obtained from the survey data in one area does not have a preset difference (a difference of a certain value or more) with respect to the value obtained from the survey data in the other (all remaining) areas (if the decision is negative), the process proceeds to S40 (FIG. 6A). On the other hand, if there is a preset difference (a difference of a certain value or more) (if the decision is positive), the process proceeds to S73B. (S73B) In S73B, the survey result for which a positive determination was made in S72B is transmitted to the user terminal 50 via the management server 30. Therefore, the survey result is notified to the user U (operator) who uses the user terminal 50. Here, in the surveying results, for example, the temperature value obtained from the survey data in the second area (an example of one area) is greater than or equal to a predetermined difference (for example, 300°C) with respect to the temperature values ​​obtained from the survey data in the first, third and fourth areas (all remaining areas). (S74B and S75B) Next, when the user U transmits an instruction to change the route from the user terminal 50 to the management server 30, the management server 30 makes a positive decision in decision step S74B and the route is changed (see FIG. 6C). Specifically, the user U who has been notified of the results of the above-mentioned survey will likely think that he or she will be able to obtain more desired disaster information by, for example, changing the survey so that the second area is located more centrally in the entire survey area, rather than continuing the survey with the entire survey area as originally planned (see the diagram immediately before the route correction in FIG. 6C). Therefore, in the program PG4 of this embodiment, in step S70B of examining the modification, the route is modified so that the second area is surrounded by the first, third, and fourth areas (see FIG. 6C). To generalize, in this embodiment, if there is a difference between the survey results of one route and the survey results of all remaining routes that is greater than or equal to a preset survey difference in the survey results up until a negative judgment is made in judgment step S60A, the management server 30 changes the preset routes of at least one or more small UAVs among the multiple small UAVs 20 that fly on a route other than one route so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all remaining routes. If the user U transmits an instruction not to change the route from the user terminal 50 to the management server 30, the management server 30 makes a negative decision in decision step S74B and proceeds to S40 (see FIG. 6C).

[0043] Therefore, according to this embodiment, it is possible to obtain more appropriate survey results by changing the preset route (survey area).

[0044] The above is a description of the fourth embodiment.

[0045] Fifth embodiment Next, a UAV survey system MS5 according to a fifth embodiment will be described with reference to Fig. 7. The following description will focus only on the differences between this embodiment and the third embodiment (see Fig. 5).

[0046] In the third embodiment, the management server 30 ends the process when it makes a positive determination in the determination step S50 after S60A. That is, in the third embodiment, the process ends when it calculates the survey results for the entire survey area. However, after this, the management server 30 transmits the calculated survey results to the user terminal 50 (not shown).

[0047] In contrast to this, in the case of this embodiment, the management server 30 does not end the process by making a positive determination in the determination step S50, but performs S80C and then ends the process. In S80C, the management server 30 receives from the external server 40 (an example of a survey information storage device) survey results (survey information of all routes) of the entire survey area previously obtained and stored in the external server 40, and compares them with the survey results of the same entire survey area calculated this time. Here, the survey results of the entire survey area previously obtained (survey information of all routes) are results obtained in advance using the UAV measurement system MS5 of this embodiment several days before (before the disaster occurs) when it is assumed that the current disaster (e.g., a typhoon) will occur.

[0048] In this embodiment, the management server 30 compares the survey results of the entire survey area obtained at the time of the positive determination in S50 with the survey results of the entire survey area before the disaster (at normal times) obtained from the external server 40 in S80, thereby making it possible to calculate the locations that have specifically suffered damage due to the disaster, the extent of the damage, and the like, as observation results. In addition, the management server 30 transmits the survey results during and before the disaster to the user terminal 50, allowing the user U (operator) to compare the two survey results and use them for observation, etc.

[0049] The above is a description of the fifth embodiment.

[0050] Sixth Embodiment Next, a UAV survey system MS6 according to a sixth embodiment will be described with reference to Fig. 8. The following description will focus only on the differences between this embodiment and the fifth embodiment (see Fig. 7).

[0051] In the fifth embodiment, the management server 30 (1) has each small UAV 20A, 20B, 20C, and 20D fly and survey routes in areas (first to fourth areas) that do not overlap with each other (see S40 in Figure 7 and incorporated Figure 3D), and then (2) combines the measurement data of each route up to the time of transmission to calculate the survey results up to the time of transmission (see S60A in Figure 7).

[0052] In contrast to this, in the case of this embodiment, S40D is performed instead of S40, and S60D is performed instead of S60A. Specifically, in S40D, the management server 30, as an example, has each of the small UAVs 20A, 20B, 20C, and 20D fly and survey across two areas, such as small UAV 20A taking two routes in the first area and the second area, small UAV 20B taking two routes in the second area and the third area, small UAV 20C taking two routes in the third area and the fourth area, and small UAV 20D taking two routes in the fourth area and the first area (see Figure 3D for the first to fourth areas). In addition, in S60D, the measurement data transmitted in S40D is sequentially synthesized to calculate the survey results. Then, the final measurement results (observation results) that change because each route is surveyed twice with a time difference are also calculated. Furthermore, in S80D, the management server 30 receives information (weather information) relating to past and current weather conditions stored in the external server 40 from the external server 40 (an example of a weather information storage device). Then, the management server 30 combines the observation results obtained at the end of S50 with the meteorological information to predict the future disaster situation (future survey results).

[0053] Therefore, according to this embodiment, by combining current observation results with meteorological information, it is possible to more appropriately predict the immediate observation results.

[0054] This concludes the description of the sixth embodiment.

[0055] <<Multiple Modifications>> As described above, the first to sixth embodiments have been described as examples of the present invention, but the present invention is not limited to these embodiments. The following several modified examples are also included in the examples of the present invention. Within the technical scope of the present invention, some of the components of one of the above-described embodiments and the multiple modified examples described later may be replaced with some of the components of another embodiment, or some of the components of the other embodiment may be added to one embodiment.

[0056] <First Modification> In the first embodiment, it has been explained that the division of the entire survey area (first to fourth areas (see FIG. 3D)) is set by the management server 30 with reference to map information so as to complete the survey in the shortest time. However, when dividing the entire survey area into multiple areas, as in the first variant UAV surveying system MS7 (program PG7) of Figure 9, weather information may be obtained from an external server 40, and the shape, etc. of the divided areas may be determined so that the surveying operation is completed more quickly while taking into account air resistance, etc. during the flight of the small UAV 20 based on the weather information (see S5E). In this variation, S10 may be performed after S5E.

[0057] <Second Modification> In the first embodiment, the target position TP is set at the center of the entire survey area (see FIG. 3D). However, as in the UAV surveying system MS8 (program PG8) of the second modified example of Fig. 10, the target position TP may be set on the periphery of the entire measurement area, and all small UAVs 20A, 20B, 20C, and 20D may be launched from the target position TP set on the periphery. In this modified example, depending on the shape of the entire measurement area, the surveying operation may be completed earlier than in the first embodiment.

[0058] <Third Modification> Before the large UAV 10 takes off, the takeoff position SP, the survey area, and the number of small UAVs 20 are determined in advance. In addition, the time required to complete the survey operation varies depending on the shape of the survey area, the division of the entire survey area, and the setting of the target position TP. Therefore, as in the UAV survey system MS9 (program PG9) of the third modified example in Fig. 11, the management server 30 may calculate the position and shape of the survey area, the location of the takeoff position SP, and the number of small UAVs 20 as parameters to set the division of the entire survey area and the target position TP so that the time required to complete the survey operation (the time from takeoff to completion of flight and survey of the entire survey area) is the shortest time (S5G). In S5G, for example, the division is set to any one of the first embodiment (see Fig. 3D), the second embodiment (see Fig. 4A), and the second modified example (see Fig. 10).

[0059] <Fourth Modification> In S70 (modification consideration) in the fourth embodiment, it is set so that the route is changed when an instruction to change the route is received from the user U (operator) (see S74B and S75B in FIG. 6B). However, as in S70F (modification consideration) of the UAV surveying system MS10 (program PG10) of the fourth modified example in Fig. 12, if the judgment in judgment step S72B is affirmative, the route may be automatically changed. Furthermore, in this case, together with the route change, the management server 30 may notify the user terminal 50 that the route has been changed (S75F).

[0060] <Fifth Modification> In the first embodiment and the like, the function of the large UAV 10 has been described as transporting multiple small UAVs 20 from a takeoff position SP to a target position TP. However, as in the UAV surveying system MS11 (program PG11) of the fifth modified example in FIG. 13, the large UAV 10 may be provided with the function of surveying a part of the entire surveying area (the fifth area as an example).

[0061] <Sixth Modification> In the sixth embodiment (see Figure 8), it was explained that the management server 30 receives information (weather information) regarding past and current weather from the external server 40 (S80D), and combines the observation results obtained after completion of the surveying operation (after completion of S50) with the weather information to predict future disaster situations (future surveying results). However, as in the UAV surveying system MS12 (program PG12) of the sixth modified example in FIG. 14, future surveying results (prediction of disasters) may be performed using a generating AI (S80H). Specifically, a prediction model is generated by machine learning using as training data the correlation between (1) information on multiple past disasters (locations, how the disasters spread (changes over time)) and (2) weather information at those locations at the time of the disasters, which are recorded in the external server 40. Then, by inputting the observation results obtained after the end of S50 and the actual weather information at those locations into this prediction model, the situation of future disasters (future survey results) may be predicted (S80H). Here, (1) information on multiple past disasters (location, spread of the disaster (change over time)) refers to multiple observation results observed in the past on routes different from all routes in the survey area that is the subject of this survey.

[0062] The above is a description of several modified examples.

[0063] ≪Reference example≫ The above-described embodiments and modified examples relate to inventions premised on conducting surveying. However, the constituent elements included in these forms may be used for inventions other than surveying. For example, the idea of ​​a large UAV 10 taking off from a takeoff position SP and detaching multiple small UAVs 20 at a target position TP in the air may be used by replacing multiple drones used in so-called drone shows with multiple small UAVs 20. This form eliminates the need for power when multiple drones take off, and also eliminates the need for space to take off multiple drones. Furthermore, for example, when detaching multiple small UAVs 20 from a large UAV 10 at a target position TP, the idea of ​​using weather information to determine the flight area (flight route) of each small UAV 20A, 20B, ... may also be used for spraying pesticides in agriculture, observing buildings, forests, etc.

[0064] The above is a description of the reference example. [Explanation of symbols]

[0065] 10 Large UAV (an example of a transport UAV) 20 Multiple small UAVs (an example of multiple surveying UAVs) 20A Small UAV (Example of a surveying UAV) 20B Small UAV (Example of a surveying UAV) 20C Small UAV (Example of a surveying UAV) 20D Small UAV (Example of a surveying UAV) 30 Management server (an example of a control device) 32 Processing section 34 Storage section 40 External server (an example of a meteorological information storage device, an example of a survey information storage device) 50 user terminals AP Application CLD Cloud DF data file LB Various Libraries MS1~12 UAV Survey System NW Communication network PG1~12 Program SP takeoff position TP target position TP1 target position TP2 target position U User (operator)

Claims

1. A plurality of surveying UAVs, each having at least one type of measuring device; A transport UAV that carries the plurality of survey UAVs and transports the plurality of survey UAVs; a control device that is communicatively connected to the multiple survey UAVs and the transport UAVs and controls the multiple survey UAVs and the transport UAVs, the control device (1) flying the transport UAV on which the multiple survey UAVs are mounted from a takeoff position to each target position, (2) launching the multiple survey UAVs from the transport UAV located at each target position so that each of the multiple survey UAVs flies a route that is a predetermined route and different from each other, (3) having each of the multiple survey UAVs flying the different routes conduct a ground survey corresponding to each different route using at least one type of measurement device, while transmitting survey data of each different route to itself multiple times at a predetermined timing, and (4) receiving the survey data of each different route multiple times at the predetermined timing, and calculating the measurement results of the entire route by combining the survey data of each different route received in the past multiple times. Equipped with When there is a difference between the survey result of one route and the survey results of all the remaining routes that is equal to or greater than a preset survey difference in the survey results up to that point, the control device changes the preset route of at least one or more survey UAVs among the plurality of survey UAVs that fly on a route other than the one route so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all the remaining routes. UAV surveying system.

2. At least a portion of the preset route in one of the plurality of survey UAVs is set to correspond to at least a portion of the preset route in another survey UAV, In the step (4), the control device compares at least two survey results of the entire route calculated by surveying each of the different routes at least twice with a time difference, and calculates an observation result of the entire route showing a change with the time difference. The UAV survey system of claim 1 .

3. The control device is communicatively connected to a weather information storage device that stores weather information, the control device combines the observation results of the entire route with the weather information received from the weather information storage device to predict future observation results of an area corresponding to the entire route; The UAV surveying system according to claim 2 .

4. Using the UAV surveying system according to claim 3, The control device includes: A function of flying the transport UAV on which the plurality of survey UAVs are mounted from a takeoff position to each of the target positions; A function of launching the plurality of survey UAVs from the transport UAV located at the respective target positions so that each of the plurality of survey UAVs flies a different route that is a preset route; A function of having each of the plurality of survey UAVs flying different routes carry out ground surveys corresponding to the different routes using at least one type of measurement device and transmit survey data of the different routes to the survey UAV; a function of calculating a survey result of the entire route by synthesizing the survey data of each different route received by the device and calculating an observation result of the entire route; a function of predicting future survey results for the entire route from the observation results of the entire route and the weather information for the entire route at the time of calculation of the observation results of the entire route, using a prediction model machine-learned using correlations between multiple observation results observed in the past on routes different from the entire route and the weather information at the time of each of the multiple observation results as training data; Execute the UAV survey program.

5. Using the UAV surveying system according to any one of claims 1 to 3, The control device includes: A function of flying the transport UAV on which the plurality of survey UAVs are mounted from a takeoff position to each of the target positions; A function of launching the plurality of survey UAVs from the transport UAV located at the respective target positions so that each of the plurality of survey UAVs flies a different route that is a preset route; A function of having each of the plurality of survey UAVs flying different routes carry out ground surveys corresponding to the different routes using at least one type of measurement device at a predetermined timing while transmitting survey data of the different routes to the survey UAV a plurality of times; a function of calculating a survey result of an entire route by synthesizing the survey data of each of the different routes received by the device itself a plurality of times at the predetermined timing, and calculating a survey result up to that point by synthesizing the survey data of each of the different routes received in the past a plurality of times; a function of changing the preset route of at least one or more survey UAVs among the plurality of survey UAVs flying a route other than the one route, when there is a difference between the survey result of one route and the survey results of all remaining routes that is equal to or greater than a preset survey difference in the survey results up to that point, so that the survey area corresponding to the one route is surrounded by the survey areas corresponding to all remaining routes; Execute the UAV survey program.

Citation Information

Patent Citations

  • Geological disaster hidden danger detection method for multi-unmanned aerial vehicle cooperative photogrammetry

    CN112923904A

  • Aerial photograph imaging method and aerial photograph imaging device

    JP2013108927A

  • Multicopter

    JP2016064768A

  • System and method of capturing large area image in detail including cascaded camera and / or calibration feature

    JP2016180761A

  • Rotary wing aircraft and control method for the same

    JP2020078949A