Control system, aviation data processing system, and control method

Abstract

To provide a system capable of providing information corresponding to a user's request for distribution information that changes with time after a crisis occurs.SOLUTION: A control system includes a processing execution command unit that causes an aviation data processing system to execute first data processing for generating first distribution information from acquired data, second data processing for generating second distribution information from the acquired data or the first distribution information, first distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device, and second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device. The processing execution command unit causes the second distribution information to be provided to the user terminal device by the second distribution processing after the first distribution processing starts providing the first distribution information to the user terminal device.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a control system, an aviation data processing system, and a control method.

Background Art

[0002] In recent years, in abnormal situations (crisis occurrence states) such as natural disasters and disasters caused by attacks by enemy aircraft, it has been required to quickly grasp wide-area information on the affected areas. Therefore, practical application studies have been underway on technologies for quickly grasping the damaged situation during disasters by analyzing image data obtained from the sky using aircraft or the like. When a crisis occurs, it is required to quickly grasp the damaged situation in order to quickly judge the initial actions of crisis response such as evacuation instructions and rescue. Also, immediately after a crisis occurs, it is called the ultra-acute phase or the acute phase, and since the damaged situation changes rapidly in a short time, a rapid update function for grasping the damaged situation that can follow such short-time situation changes is required.

[0003] Patent Document 1 discloses a technique for transmitting an aerial image obtained from the sky from an aircraft to the ground and detecting changes in building shapes on the ground.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In order to analyze the aerial acquisition data obtained by an aircraft or the like, interpret the disaster situation, and provide the interpretation result of the disaster situation to users such as a crisis management headquarters that determines crisis response measures, it is necessary to execute each process such as data acquisition by the aircraft, data transmission from the aircraft to the analysis device, data analysis processing by the analysis device, and data transmission to the user terminal device. A long time has been required for a series of processes from the data acquisition of the aerial data to the provision of information to the user terminal device.

[0006] Also, for example, in the ultra-acute phase immediately after a disaster occurs, it is required to quickly determine the initial action of crisis response measures. Therefore, as the initial distribution information to users such as the crisis management headquarters, it is required to quickly provide the information necessary for the initial action determination. On the other hand, after the initial action determination, as the response measures following the initial action, it is required to determine more effective crisis response measures. Therefore, there is a tendency that more detailed analysis information is required than the previously provided distribution information.

[0007] The technology described in Patent Document 1 mentioned above focuses on quickly providing processing information that requires time for relatively analytical processing such as estimating the damage situation of a building, and has not considered the change in the information required by the user as time elapses after a crisis such as a disaster occurs as described above.

[0008] Therefore, an object of the present invention is to provide a system capable of providing information corresponding to the desires of users for distribution information that changes as time elapses after a crisis such as a disaster occurs.

Means for Solving the Problems

[0009] According to the present invention, there is provided a control system for determining the content of processing work by an aerial data processing system, the aerial data processing system including: a flying object equipped with a sensor for acquiring image or point cloud information of a target area; a data acquisition base system for exchanging control information related to flight or data acquisition with the flying object; and a data processing unit for processing acquired data acquired by the sensor to generate processed data. The control system includes: a first data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; a second data processing for generating second distribution information from the acquired data or the first distribution information; a first distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; and a second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system. The control system is provided with a processing execution command unit for causing the aerial data processing system to execute the above processes. The processing execution command unit causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution information is started to be provided to the user terminal device or the distribution system by the first distribution processing.

Effects of the Invention

[0010] According to the present invention, it is possible to provide information corresponding to the user's desire for distribution information that changes with the passage of time after the occurrence of a crisis such as a disaster.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Embodiments for Carrying Out the Invention

[0012] The contents of embodiments of the present invention will be listed and described. The present invention has the following configuration. [Item 1] A flight vehicle equipped with a sensor for acquiring an image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the flight vehicle, and a data processing unit for processing acquired data acquired by the sensor to generate processed data, a control system for determining the content of processing work by an aerial data processing system, First data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data, Second data processing for generating second distribution information from the acquired data or the first distribution information, First distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device, Second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, A processing execution command unit for causing the aerial data processing system to execute, The processing execution command unit, A control system that causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution process after the first distribution information has been started to be provided to the user terminal device or the distribution system by the first distribution process. [Item 2] The control system according to Item 1, wherein the first distribution information and the second distribution information are generated from the common acquisition data or post - processing data obtained by processing the common acquisition data. [Item 3] The control system according to Item 1 or 2, wherein a distribution pattern including a plurality or a single combination regarding the distribution information content of the first distribution information and the second distribution information is generated. [Item 4] The control system according to any one of Items 1 to 3, wherein a distribution pattern including a plurality or a single combination regarding the distribution information content of the first distribution information and the second distribution information is displayed on a display device. [Item 5] The control system according to any one of Items 1 to 4, wherein the distribution pattern includes at least one of a combination of distribution information in which the processing load of the second data processing for generating the second distribution information is greater than the processing load of the first data processing for generating the first distribution information, and a combination of distribution information in which the time required to generate the second distribution information and provide it to the user terminal device or the distribution system is longer than the time required to generate the first distribution information and provide it to the user terminal device or the distribution system. [Item 6] The control system according to any one of Items 1 to 5, wherein a designated input reception unit for receiving a designated input for the distribution pattern displayed on the display device is provided. [Item 7] The control system according to any one of Items 1 to 6, wherein The control system generates a distribution pattern including a single combination regarding the distribution information content of the first distribution information and the second distribution information, The control system causes the aviation data processing system to execute the first distribution process and the second distribution process based on the generated combination. [Item 8] The control system according to any one of Items 1 to 7, wherein the distribution pattern is generated according to the timing after the occurrence of a disaster. [Item 9] The control system according to any one of Items 1 to 8, comprising a user request reception unit that receives request information regarding at least one of the first distribution information and the second distribution information. [Item 10] The control system according to any one of Items 1 to 9, wherein when the user request reception unit receives information on the desired distribution time regarding at least one of the first distribution information and the second distribution information, the distribution pattern is generated based on the desired distribution time. [Item 11] The control system according to any one of Items 1 to 10, wherein when the user request reception unit receives priority distribution desired information regarding at least one of the contents of the first distribution information and the second distribution information, the distribution pattern is generated based on the priority distribution desired information. [Item 12] The control system according to any one of Items 1 to 11, wherein the first distribution information is an ortho image obtained by orthorectifying an image of the target area acquired by the sensor and integrating a plurality of orthorectified images, and the second distribution information is a map integrated image obtained by integrating the ortho image and geographical information. [Item 13] The control system according to any one of Items 1 to 12, The first distribution information is an ortho-image obtained by ortho-rectifying an image of the target area acquired by the sensor and integrating a plurality of ortho-rectified images. The second distribution information is a second ortho-image having a higher resolution than the first ortho-image, the control system. [Item 14] The control system according to any one of Items 1 to 13, The first distribution information is an ortho-image obtained by ortho-rectifying an image of the target area acquired by the sensor and integrating a plurality of ortho-rectified images. The second distribution information is complemented data obtained by complementing defect data included in the ortho-image with other data, the control system. [Item 15] The control system according to any one of Items 1 to 14, The first distribution information is a map integrated image obtained by integrating an ortho-image obtained by ortho-rectifying an image of the target area acquired by the sensor and integrating a plurality of ortho-rectified images with geographical information. The second distribution information is a difference analysis result between the map integrated image and a map integrated image generated in the past before the map integrated image, the control system. [Item 16] The control system according to any one of Items 1 to 15, The first distribution information is a difference analysis result between a map integrated image generated by integrating an ortho-image obtained by ortho-rectifying an image of the target area acquired by the sensor and integrating a plurality of ortho-rectified images with geographical information and a map integrated image generated in the past before the map integrated image. The second distribution information is a detailed analysis result for an area within the target area determined to have a difference based on the difference analysis result of the first distribution information, the control system. [Item 17] The control system according to any one of Items 1 to 16, The control system is third data processing for generating third distribution information from the acquired data or processed data obtained by processing the acquired data, A third distribution process for causing the user terminal device or a distribution system capable of distributing information to the user terminal device to provide the third distribution information generated by the third data process; further comprising; The processing execution command unit is a control system that causes the user terminal device or the distribution system to provide the third distribution information by the third distribution process after the second distribution information is started to be provided to the user terminal device or the distribution system by the second distribution process. [Item 18] The control system according to any one of Items 1 to 17, The first distribution information is a first ortho image obtained by ortho-rectifying an image of the target area acquired by the sensor and integrating a plurality of ortho-converted images, The second distribution information is a second ortho image having a higher resolution than the first ortho image and corresponding to an area narrower than the first ortho image, The third distribution information is a third ortho image having a higher resolution than the first ortho image and corresponding to an area wider than the second ortho image. [Item 19] The control system according to any one of Items 1 to 18, The second process including the second data process and the second distribution process is executed in parallel with at least a part of the first process including the first data process and the first distribution process. [Item 20] The control system according to any one of Items 1 to 19, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at a plurality of locations within the aviation data processing system, Estimate the processing speed of each of the plurality of data processing units or display it on a display device. [Item 21] The control system according to any one of Items 1 to 20, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays the first processing time of the first data processing and the second processing time of the second data processing in each of the plurality of data processing units. [Item 22] The control system according to any one of Items 1 to 21, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays the data transmission speed in the transmission path between the aircraft, the data acquisition base system, and the data processing base system. [Item 23] The control system according to any one of Items 1 to 22, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays the first transmission time of the data used for the first data processing and the second transmission time of the data used for the second data processing in each of the plurality of transmission paths. [Item 24] The control system according to any one of Items 1 to 23, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that determines or displays on a display device a combination pattern of an installation location of a data processing unit that executes the first data processing for which a first total required time including the time taken for the first data processing and the time taken for the first distribution processing is the shortest, and a transmission path of data related to the first data processing. [Item 25] The control system according to any one of Items 1 to 24, wherein when the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at a plurality of locations within the aviation data processing system, A control system that determines or displays on a display device a combination pattern of an installation location of a data processing unit that executes the second data processing for which a second total required time including the time taken for the second data processing and the time taken for the second distribution processing is the shortest, and a transmission path of data related to the second data processing. [Item 26] An aviation data processing system including an aircraft equipped with a sensor for acquiring an image or point cloud information of a target area, a data acquisition base system that exchanges control information related to flight or data acquisition with the aircraft, and a data processing unit that processes acquired data obtained by the sensor to generate processed data, a first data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data, a second data processing for generating second distribution information from the acquired data or the first distribution information, a first distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device, a second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, and includes a processing execution command unit for executing The processing execution command unit An aviation data processing system that causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution process after the first distribution information is started to be provided to the user terminal device or the distribution system by the first distribution process. [Item 27] A control method using an aviation data processing system having an aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing unit for processing acquired data acquired by the sensor to generate processed data, comprising: The computer: A first data processing step of generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; A first distribution processing step of causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; A second data processing step of generating second distribution information from the acquired data or the first distribution information; A second distribution processing step of causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system after the first distribution information is started to be provided by the first distribution processing step.

[0013] <A. First Embodiment> Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted. Further, the embodiments shown below are merely examples, and other known elements and alternative means can be adopted according to the use, purpose, scale, etc.

[0014] [A-1. Configuration] (A-1-1. Overview) FIG. 1 is an overall configuration diagram of an aviation data processing system 1 (hereinafter also referred to as "this system 1") according to an embodiment of the present invention. As shown in FIG. 1, this system includes an aircraft 1000, a data acquisition base system 2000, a data processing base system 3000, and a distribution system 4000.

[0015] The aircraft 1000 uses sensors such as an optical camera, an infrared camera, and a laser sensor such as LiDAR to acquire information on the disaster area from the sky and obtains the acquired data. The data acquisition base system 2000 is a base equipped with a remote control device for communicating control information with the aircraft when the aircraft is an unmanned aircraft, and is configured as a movable vehicle type or an immovable fixed type base. The data processing base system 3000 is a system that acquires the acquired data acquired by the aircraft, performs data analysis processing, and generates processed data. The distribution system 4000 acquires the processed data and distributes the processed data to user terminal devices including a crisis management headquarters terminal via the Internet line. A crisis management headquarters terminal, which is an example of a user terminal device, is a terminal device used by a user such as a person in charge of the crisis management headquarters. By accessing the distribution system from the crisis management headquarters terminal, the processed data can be viewed.

[0016] The data processing unit that performs data analysis processing on the acquired data can be implemented not only in the data processing base system 3000 but also in the data acquisition base system 2000 and the aircraft 1000. Therefore, the aviation data processing system 1 determines which data processing unit among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 will execute the data analysis processing according to the situation. Note that the data analysis processing executed in each data processing unit may include Web optimization processing for processing the processed data so that the processed data displayed on the user terminal device via the Internet line from the distribution system is displayed in an easy-to-view manner for the user.

[0017] Here, when performing analysis processing in the data processing unit mounted on the aircraft 1000, in the aircraft 1000, sensing processing is performed to generate acquired data, and data analysis processing is performed to generate processed data. The processed data is transmitted directly from the aircraft 1000 to the distribution system, or is transmitted to the distribution system 4000 via the data acquisition base system 2000 or the data processing base system 3000.

[0018] Next, when performing analysis processing in the data processing unit mounted on the data acquisition base system 2000, in the aircraft 1000, sensing processing is performed to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data acquisition base system 2000. The data acquisition base system 2000 performs data analysis processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0019] Finally, when performing analysis processing in the data processing unit mounted on the data processing base system 3000, in the aircraft 1000, sensing processing is performed to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data processing base system 3000. Here, the transmission of the acquired data may be directly transmitted from the aircraft 1000 to the data processing base system 3000, or may be transmitted to the data processing base system 3000 via the data acquisition base system 2000. The data processing base system 3000 performs data analysis processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0020] In the above-described example, an embodiment is shown in which the processed data is distributed to the user terminal device via the distribution system. However, the processed data can also be directly sent from the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 to the user terminal device via an Internet line or the like without going through the distribution system. Note that the user terminal device such as the crisis management headquarters terminal and the data acquisition base system are communicably connected by an Internet line or the like, and the input information from the user terminal device can be transmitted to the data acquisition base system. Further, the aircraft 1000 in the present embodiment may be a flying object including balloons, airships, artificial satellites, etc. other than aircraft.

[0021] (A-1-2. Aircraft 1000) FIG. 2 is a functional configuration diagram of an aircraft according to an embodiment of the present invention. The aircraft 1000 is a system that constitutes an aircraft, and includes a flight unit 1100 having a flight function, a sensing unit 1200 that performs sensing by sensors, a communication unit 1300 that communicates with other subsystems (data acquisition base system, data processing base system, distribution system, etc.) in the aircraft data processing system 1, a state determination unit 1400 that determines each state of flight, sensing, and positioning, a data processing unit 1500 that executes data analysis processing, and a data recording unit 1600 that records acquired data and the like.

[0022] In this specification, the term "aircraft" refers to all flying objects having the function of autonomously controlling their attitude, regardless of the power means (such as electricity, prime mover, etc.), the control method (whether wireless or wired, and whether fully autonomous flight type or partial manual control type, etc.), and whether manned or unmanned. Also, an aircraft may be referred to as an unmanned aerial vehicle (UAV), a flying object, a multi-copter, an RPAS (Remote Piloted Aircraft Systems), or a UAS (Unmanned Aircraft Systems), etc. Further, the aircraft may be of any type, such as a fixed-wing type having a fixed wing, a multi-copter type having a plurality of propellers, or a VTOL type having both a fixed wing and a plurality of propellers.

[0023] (A-1-2―1. Flight Unit 1100) The flight unit 1100 includes a self-position / velocity determination unit 1110, an attitude determination unit 1120, and a flight control unit 1130.

[0024] The self-position / velocity determination unit 1110 has the function of determining the position and velocity of the aircraft 1000. For example, based on satellite signals received from artificial satellites by a satellite signal antenna mounted on the aircraft using GPS (Global Positioning System), GNSS (Global Navigation Satellite System), etc., the position (absolute position) of the aircraft body is measured. Also, for the determination of the self-position and velocity, for example, RTK-GNSS (Real Time Kinematic - Global Navigation Satellite System) can also be used. The position information includes at least two-dimensional coordinate information (such as latitude and longitude) in a plan view, and preferably includes three-dimensional coordinate information including altitude information.

[0025] Next, the attitude determination unit 1120 has the function of determining the attitude (azimuth) of the aircraft 1000. Specifically, the attitude of the aircraft body is determined by a GPS compass composed of a pair of satellite antennas mounted on the aircraft, or a geomagnetic sensor, etc.

[0026] Next, the flight control unit 1130 has a processing unit also called a flight controller. The processing unit can have one or more processors such as a programmable processor (e.g., a central processing unit (CPU), MPU, or DSP). The processing unit is accessible to a memory (storage unit). The memory stores logic, code, and / or program instructions executable by the processing unit to perform one or more steps.

[0027] The processing unit has a function of controlling the flight state of the aircraft by controlling the output of the thrust generating device. Specifically, the propeller, the motor driving the propeller, and the motor control unit for controlling the motor output control the thrust generated from the propeller to adjust the spatial arrangement, attitude angle, angular velocity, angular acceleration, angular jerk velocity, and / or acceleration of an aircraft having six degrees of freedom (translational motions x, y, and z, and rotational motions θx, θy, and θz). That is, the flight control unit 1130 causes the aircraft to perform operations such as takeoff, forward movement, turning, and landing, and controls the attitude angle control and flight operations of the aircraft from takeoff to in-flight and landing to control the flight state of the aircraft.

[0028] (A-1-2-2. Sensing unit 1200) The sensing unit 1200 includes a sensor 1210, a sensor attitude control unit 1220, and a sensor control unit 1230.

[0029] The sensor 1210 is composed of, for example, an optical camera for acquiring an optical image, an infrared camera for acquiring an infrared image, a laser sensor such as LiDAR for acquiring point cloud data, etc. The sensor acquires an optical image, an infrared image, point cloud data, etc. of the ground surface of the disaster area from above the disaster area as acquired data.

[0030] The sensor attitude control unit 1220 controls the relative angle of the sensor with respect to the airframe of the aircraft. For example, at least one of the angles around the three axes of the gimbal provided between the sensor and the airframe and supporting the sensor is controlled to control the relative angle of the sensor with respect to the airframe.

[0031] The sensor control unit 1230 has a function of changing the timing of sensing execution by the sensor 1210 and measurement parameters. For example, when the sensor is an optical camera, it controls the image acquisition timing, shutter speed, resolution, etc.

[0032] (A-1-2―3. Communication unit 1300) The communication unit 1300 includes a control communication unit 1310, a data communication unit 1320, and a status data communication unit 1330. Also, the communication unit 1300 can perform radio communication via the communication network NW, and includes, for example, a radio communication module. By means of the communication network NW, the communication unit 1300 can communicate with a data acquisition base system, a data processing base system, a distribution system, or the like. The communication unit 1300 has a communication function for performing wireless communication with a data acquisition base system, a data processing base system, a distribution system, or the like by wireless communication using, for example, Wi-Fi, a frequency band of 2.4 GHz, or 5.6 - 5.8 GHz. Further, the communication unit 1300 has a wireless communication function that can communicate with a data acquisition base system, a data processing base system, a distribution system, or the like via the communication network NW using a communication standard such as LTE (Long Term Evolution).

[0033] The control communication unit 1310 performs communication related to flight control of the aircraft that is exchanged between the aircraft 1000 and the data acquisition base system 2000. For example, when the aircraft is an unmanned aircraft and is remotely controlled from the data acquisition base system, the control communication unit 1310 receives a flight control command transmitted from the data acquisition base system to the aircraft. Also, the control communication unit 1310 transmits information regarding the flight state of the aircraft, including the position, speed, and attitude of the airframe determined by the flight unit 1100, from the aircraft to the data acquisition base system.

[0034] The data communication unit 1320 transmits the acquired data obtained by the sensing unit 1200 to a data acquisition base system, a data processing base system, a distribution system, or the like. Also, when data analysis is performed by the data processing unit 1500 described later, the data communication unit 1320 transmits the processed data generated by the data processing unit 1500 to a distribution system or the like. That is, the data communication unit 1320 transmits the acquired data obtained by the sensing unit 1200, or the processed data obtained by analyzing the acquired data, to the outside of the aircraft.

[0035] The state data communication unit 1330 transmits the determination results of the flight state, the sensing state, and the communication state determined by the state determination unit 1400 described later to the data acquisition base system. In particular, it transmits the determination result of the communication speed determined by the communication state determination unit 1430 to the data acquisition base system.

[0036] (A-1-2―4. State determination unit 1400) The state determination unit 1400 includes a flight state determination unit 1410, a sensing state determination unit 1420, and a communication state determination unit 1430.

[0037] The flight state determination unit 1410 determines that there is a flight abnormality when the position, speed, or attitude of the aircraft determined by the self-position / speed determination unit 1110 or the attitude of the aircraft determined by the attitude determination unit 1120 deviates from a preset normal range. Also, even when the position, speed, and attitude do not deviate from the normal range, if at least any one of the position, speed, and attitude does not normally follow the control command value by the flight control unit 1130, it is also determined that there is a flight abnormality.

[0038] The sensing state determination unit 1420 determines that there is a sensing abnormality when the acquired data is not acquired by the sensor 1210 of the sensing unit 120 or when an abnormality is found in the acquired data. Also, it may be determined that there is a sensing abnormality when the sensor attitude control unit 1220 does not operate correctly with respect to the control command value.

[0039] The communication status determination unit 1430 determines the communication status between the aircraft and the external (such as the data acquisition base system, the data processing base system, or the distribution system) by the communication unit 1300. Specifically, the communication status to be determined is the communication speed (such as bps), and may include the communication strength (such as dB) in addition to the communication speed. The communication status determination unit 1430 particularly determines the data communication speed of the acquired data or the processed data by the data communication unit 1320.

[0040] (A-1-2―5. Data processing unit 1500) When the data processing unit 1500 is determined by the work determination system 2300 to perform data analysis processing within the aircraft, it analyzes the acquired data acquired by the sensing unit 1200. The data processing unit 1500 is composed of, for example, a workstation so that it can execute data analysis with a relatively large processing load.

[0041] In the data processing unit 1500, various types of analysis processing are executed. As an example of the analysis processing, there is the analysis processing as shown below. · "Orthophoto generation": A process of acquiring a plurality of optical images as acquired data, performing orthoimage conversion on the acquired plurality of optical images, and generating an orthophoto by integrating the plurality of orthophotos. · "Three-dimensional space data generation (image)": A process of acquiring a plurality of optical images as acquired data and generating three-dimensional space data from the plurality of optical images using SfM (Structure from Motion) processing. · "Three-dimensional space data generation (point cloud)": A process of acquiring point cloud data as acquired data and generating three-dimensional space data from the point cloud data. · "Defective data complementation": A process of determining defective data included in the orthophoto, or the optical image or point cloud data used for the generation of three-dimensional space data, and generating stored data in which the location where the defective data is used is complemented with complementary data (such as geographical information, past acquired data, etc.). · "Integration of Ortho Image and Geographic Information": A process of generating an ortho image, acquiring geographic information as processing data, and generating map integration data by integrating the ortho image and the geographic information. · "Difference Analysis of Map Integration Data": A process of generating a map integration image, acquiring a past map integration image as processing data, and performing a difference analysis between the current and past map integration images. · "Detailed Analysis of Difference Detection Area": Incorporate external information related to the area detected by the difference analysis of the map integration data, and perform a detailed analysis in combination with the acquired data obtained from the aircraft. · "Web Optimization Process": Perform any of the above processes, and perform a Web optimization process of processing the processed data so as to optimize the display screen on the display screen of the user terminal device, and generate Web-optimized data.

[0042] Note that the Web optimization process executed in the data processing unit 1500 is a process of processing the processed data so that the processed data displayed on the user terminal device from the distribution system via the Internet line is easily visible to the user on the display screen of the user terminal device.

[0043] (A-1-2-6. Data Recording Unit 1600) The data recording unit 1600 includes an acquired data recording unit 1610, a processed data recording unit 1620, and a communication state recording unit 1630. The data recording unit 1600 is composed of a storage device such as a RAM or a ROM.

[0044] The acquired data recording unit 1610 records the acquired data obtained by the sensing unit 1200. The recorded acquired data is transmitted by the data communication unit 1320 to a data acquisition base system, a data processing base system, a distribution system, or the like.

[0045] The processed data recording unit 1620 records the processed data generated by the data processing unit 1500. The recorded processed data is transmitted by the data communication unit 1320 to a distribution system or the like.

[0046] The communication status recording unit 1630 records information on the communication speed and communication strength determined by the communication status determination unit 1430. The recorded information on the communication speed and communication strength is transmitted to the data acquisition base system by the status data communication unit 1330.

[0047] (A-1-3. Data Acquisition Base System 2000) FIG. 3 is a configuration diagram of a data acquisition base system according to an embodiment of the present invention. The data acquisition base system includes a communication infrastructure management system 2100, an aircraft operation control system 2200, a work determination system 2300, a data processing unit 2400, an operation management system 2500, and an airspace monitoring system 2600.

[0048] When the aircraft is an unmanned aircraft, the data acquisition base system 2000 exchanges control information with the aircraft and enables remote control by an operator (user) who uses the data acquisition base system. Further, the data acquisition base system may be configured as a movable vehicle type or may be configured as an immovable building (fixed type) that does not move.

[0049] The communication infrastructure management system 2100 is a system that manages the communication means for data (acquired data or processed data) and control communication information transmitted and received between the data acquisition base system 2000, the aircraft 1000, the data processing base system 3000, and the distribution system 4000. The communication infrastructure management system 2100 transmits information generated by, for example, the aircraft operation control system 2200 and the work determination system 2300, which will be described later, to the aircraft 1000. Further, the communication infrastructure management system 2100 monitors the communication speed in addition to the communication availability of the existing infrastructure, and executes data transmission and reception according to the processing means determined by the work determination system, which will be described later, and the communication means for data transmission. The transmission process may be, for example, parallel transmission or switched transmission. Also, when the communication infrastructure management system 2100 determines, based on the work determination system 2300, which will be described later, that it is appropriate to transmit data by physically transporting a memory by a person, it may display a message to that effect on an appropriate display unit and request the administrator to physically transport the memory.

[0050] The aircraft operation control system 2200 is a system that generates a mission for the aircraft to be controlled and controls the movement of the aircraft. The mission is, for example, a movement plan including the movement route and movement speed of the aircraft 1000. The movement route is generated, for example, in an airspace below an altitude of 150 m in order to avoid interference with, for example, a passenger aircraft in advance. The aircraft operation control system 2200 transmits a control signal to the aircraft 1000 via the communication infrastructure management system 2100 in order to automatically operate the aircraft.

[0051] The operation management system 2500 is a system that makes decisions and gives instructions for the operation of the aircraft 1000. The operation management system 2500 formulates a plan regarding the operations of the aircraft 1000, including, for example, sensing and flight, and transmits it to the aircraft 1000 via the communication infrastructure management system 2100. Further, the operation management system 2500 may determine the priority of the operations that require processing and transmit it to the aircraft 1000. The operation management system 2500 may formulate plans for a plurality of aircraft 1000 and transmit the information of the respective plans to each aircraft 1000.

[0052] The airspace monitoring system 2600 is a system that monitors the airspace in which the aircraft 1000 to be controlled is flying. The airspace monitoring system 2600 acquires information from an existing air traffic control system. The air traffic control system may be, for example, a drone operation management system (UTM), an operation management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace monitoring system 2600 measures or acquires information on the environment and other aircraft in the airspace in which the aircraft 1000 is flying and transmits the information to the operation management system 2500. Based on the information from the airspace monitoring system 2600, the operation management system 2500 changes the operation plan if there is a problem with the operation plan of the aircraft 1000.

[0053] The operation determination system 2300 determines the processing content for the acquired data obtained by the aircraft 1000. Here, immediately after a disaster occurs, it is necessary to quickly grasp the disaster situation and take initial response measures in a short time. On the other hand, after the initial response, it is required to grasp the disaster allowance in more detail and determine effective next response measures. Therefore, it is desirable to divide the content of the analysis results provided to the user in the initial stage after the disaster and the analysis results provided to the user thereafter into multiple stages. The operation determination system 2300 determines a specific distribution pattern from a plurality of distribution pattern candidates in which the content of the analysis process is divided into multiple stages according to the passage of time, and determines the location of the data processing unit that executes the specific distribution pattern and the transmission path such as the acquired data. The distribution pattern and the like determined by the operation determination system 2300 are transmitted to the aircraft 1000, the data processing base system 3000, and the distribution system 4000 via the communication infrastructure management system 2100. The detailed functions of the operation determination system 2300 will be described later.

[0054] When the operation determination system 2300 determines that data analysis processing is to be performed within the data acquisition base system, the data processing unit 2400 analyzes the acquired data obtained by the aircraft 1000. The data processing unit 2400 is composed of, for example, a workstation so that it can execute data analysis with a relatively large processing load. Specific examples of the analysis processing executed here are the same as the specific examples of the analysis processing described in the description of the data processing unit 1500.

[0055] (A-1-4. Data Processing Base System 3000) FIG. 4 is a configuration diagram of a data processing base system according to an embodiment of the present invention. The data processing base system includes a communication unit 3100 and a data processing unit 3200.

[0056] The communication unit 3100 transmits and receives data (acquired data or processed data) between the data processing base system 3000 and external systems (the aircraft 1000, the data acquisition base system 2000, and the distribution system 4000). For example, the communication unit 3100 receives acquired data from the aircraft 1000 or the data acquisition base system 2000. Also, the communication unit 3100 transmits the processed data generated in the data processing base system 3000 to the distribution system 4000.

[0057] When the work determination system 2300 determines that data analysis processing is to be performed within the data processing base system, the data processing unit 3200 acquires the acquired data obtained by the aircraft 1000 via the communication unit 3100 and executes the analysis processing.

[0058] (A-1-5. Distribution System 4000) FIG. 5 is a configuration diagram of a distribution system according to an embodiment of the present invention. The distribution system 4000 includes a communication unit 4100 and a distribution data management unit 4200.

[0059] The communication unit 4100 receives processed data from any one of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. The received processed data may be data after web optimization processing is performed in the analysis processing performed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Also, the communication unit 4100 distributes the processed data to user terminal devices including the crisis management headquarters terminal via the Internet line.

[0060] The distribution data management unit 4200 records the processed data received via the communication unit 4100, and distributes the latest processed data recorded in the distribution data management unit 4200 to user terminal devices including the crisis management headquarters terminal that accesses via the Internet line.

[0061] (A-1-6. Work Determination System 2300) FIG. 6 is a functional configuration diagram of a work determination system according to an embodiment of the present invention. The work determination system 2300 includes a user demand acquisition unit 2310, an acquired data volume estimation unit 2320, a multi-stage distribution pattern generation unit 2330, a processing time estimation unit 2340, a disaster cycle information acquisition unit 2350, a multi-stage distribution pattern determination unit 2360, a processing means determination unit 2370, and a processing execution command unit 2380.

[0062] (A-1-6―1. User demand acquisition unit 2310) The user demand acquisition unit 2310 acquires user demand information input by a user through an input unit of a user terminal device 5000 including a crisis countermeasure headquarters terminal or the like. FIG. 7 is a table showing an example of user demand information acquired by the work determination system according to an embodiment of the present invention. As shown in T101 of FIG. 7, the user demand information includes, for example, at least one of an acquisition target area, an acquisition information type, a unit information volume, priority distribution information, and a desired distribution time.

[0063] The acquisition target area is area information of the ground surface or airspace acquired by the aircraft 1000. The acquisition information type is the type of acquisition data acquired by the aircraft 1000, and is, for example, an optical camera, point cloud data, spatial information, or the like. The unit information volume is the information volume per unit acquisition data, and is, for example, the resolution of an image. The priority distribution information is distribution information that is preferentially provided to the user from among a plurality of analysis processing candidates, and is, for example, "orthoimage" or the like. The desired distribution time is the time when the user hopes to receive the analysis result. The priority distribution information and the desired distribution time received as the user demand information are not limited to the primary distribution information, and may be demand information regarding the secondary distribution information or the tertiary distribution information.

[0064] (A-1-6―2. Acquired data volume estimation unit 2320) The acquired data volume estimation unit 2320 predicts the total volume of the acquired data (defined, for example, in gigabytes, terabytes, etc.). The total data volume of the acquired data can be predicted based on data sensing conditions such as information regarding the sensing range, the type of sensor, and setting parameters regarding the data volume per unit area. Here, the information regarding the sensing range can be defined, for example, based on the planned flight route of the aircraft, the planned flight time, the sensing target range on the ground surface, or the range of the planned flight airspace. Also, the information regarding the sensing range can be generated based on information such as the information of the acquisition target area acquired by the user requirement acquisition unit 2310 described later.

[0065] Also, the type of sensor is, for example, an optical camera, an infrared camera, a laser sensor including LiDAR, etc. The setting parameters are defined by, for example, the resolution of the acquired image and the point cloud density of the point cloud data. Note that the estimation process of the total data volume of the acquired data by the acquired data volume estimation unit 2320 is performed before the sensing process by the aircraft starts or at least before the sensing process is completed.

[0066] (A-1-6-3. Multi-stage distribution pattern generation unit 2330) The multi-stage distribution pattern generation unit 2330 generates a plurality of pattern candidates for distribution data provided in multiple stages. FIG. 8 is a table showing an example of a multi-stage distribution pattern generated by the multi-stage distribution pattern generation unit according to an embodiment of the present invention. Table T102 in FIG. 8 shows six patterns with pattern identification Nos. 001 to 006 as the multi-stage distribution patterns generated by the multi-stage distribution pattern generation unit. Here, generally, at the time of a crisis such as a disaster, faster distribution is required for primary distribution information, and more detailed information is required for secondary distribution information than for primary distribution information. Therefore, the multi-stage distribution patterns shown in FIG. 8 include patterns in which processing with a higher processing load than the primary data processing for generating primary distribution information is used as a candidate for secondary distribution information. Here, the processing with a higher processing load means processing that takes a longer time to process. Also, not limited to the magnitude of the processing load of data processing, the multi-stage distribution patterns shown in FIG. 8 may include patterns in which the time required for data processing and data transmission until secondary distribution information is transmitted to the distribution system is longer than the time required for data processing and data transmission until primary distribution information is transmitted to the distribution system. Further, the primary distribution information in the multi-stage distribution pattern is distribution information that is distributed to the user terminal device 5000 prior to other distribution information, the secondary distribution information is distribution information that is distributed to the user terminal device 5000 after the primary distribution information, and furthermore, the tertiary distribution information is distribution information that is distributed to the user terminal device 5000 even later than the secondary distribution information. The content of each pattern is as follows.

[0067] [Pattern Identification No. 001] As primary distribution information, the optical image acquired as acquisition data is orthorectified, and a plurality of images after orthorectification are integrated to generate an ortho image. Next, as secondary distribution information, the ortho image and geographical information (map information) are integrated to generate a map integrated image.

[0068] [Pattern Identification No. 002] As primary distribution information, a composite image of a desired area is generated by integrating a plurality of optical images acquired as acquisition data. Next, as secondary distribution information, the optical images of the acquisition data are orthorectified, and an orthoimage is generated by integrating the plurality of images after orthorectification. Here, although the process of directly integrating the acquired images without performing orthorectification is described as an example of the primary distribution information, a form in which an orthoimage with a resolution lower than that of the orthoimage distributed as secondary distribution information is generated as the primary distribution information may also be used.

[0069] [Pattern Identification No. 003] As primary distribution information, an image data volume compression process for reducing the resolution of the optical images of a wide area acquired as acquisition data is performed, the low-resolution images are orthorectified, and a low-resolution wide-area orthoimage is generated by integrating the plurality of images after orthorectification. Next, as secondary distribution information, the optical images (high resolution) of a narrow area acquired as acquisition data are orthorectified, and a high-resolution narrow-area orthoimage is generated by integrating the plurality of images after orthorectification. Finally, as tertiary distribution information, the optical images (high resolution) of a wide area acquired as acquisition data are orthorectified, and a high-resolution wide-area orthoimage is generated by integrating the plurality of images after orthorectification.

[0070] [Pattern Identification No. 004] As primary distribution information, the optical images acquired as acquisition data are orthorectified, and an orthoimage is generated by integrating the plurality of images after orthorectification. Next, as secondary distribution information, defective data included in the optical images of the acquisition data is determined, and completed data is generated by complementing the orthoimage at the position determined to be defective data with complementary data such as geographical information.

[0071] [Pattern Identification No. 005] As primary distribution information, the optical images acquired as acquisition data are orthorectified, and an orthoimage is generated by integrating the plurality of images after orthorectification. Further, the orthoimage and geographical information (map information) are integrated to generate a map composite image. Next, as secondary distribution information, a difference analysis is performed between the generated map composite image (current information) and the map composite image generated in the past.

[0072] [Pattern Identification No. 006] As primary distribution information, the acquired optical image obtained as acquisition data is orthorectified, a plurality of images after orthorectification are integrated to generate an orthoimage, and further, the orthoimage and geographical information (map information) are integrated to generate a map integrated image. Furthermore, differential analysis is performed between the generated map integrated image (current information) and the map integrated image generated in the past. Next, as secondary distribution information, external information related to the area where a difference is detected by the differential analysis is incorporated, and detailed analysis is performed in combination with the acquisition data obtained from the aircraft.

[0073] (A-1-6-4. Processing Time Estimation Unit 2340) The processing time estimation unit 2340 estimates the required analysis time for each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated in each of the distribution patterns (No. 001 to 006) shown in Table T102 as described above. The required analysis time may be calculated based on the information on the total data volume of the acquisition data estimated by the acquisition data volume estimation unit 2320 and the information on the processing load of the analysis process for generating each distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.), or may be generated based on the reference processing time set for each of the plurality of distribution information of each distribution pattern recorded in the work determination system in advance. Note that the required analysis time may be calculated based on a method of a reference speed of at least one of the data transmission speed and the analysis speed in addition to the information on the total data volume and the information on the processing load.

[0074] FIG. 9 is a table showing an example of the processing time estimation results in each multi-stage distribution pattern generated by the processing time estimation unit according to an embodiment of the present invention. As shown in table T103 of FIG. 9, the required analysis time of the distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated in each distribution pattern (No. 001 to 006) shown in table T104 of FIG. 8 is estimated. Also, in the example shown in table T103, in addition to the required analysis time of each distribution information, the required measurement time is also estimated. This required measurement time can be calculated based on, for example, the information on the total amount of acquired data estimated by the acquired data amount estimation unit 2320, or can be calculated based on the information on the total amount of data and the reference speeds of the analysis speed and the data transmission speed. Further, the scheduled distribution time of the analysis information is estimated from the estimated required measurement time, the required analysis time, and the information on the current time. For example, the time obtained by adding the estimated required measurement time and the required analysis time to the current time can be estimated as the scheduled distribution time of the analysis information.

[0075] Table T103 shows the estimation results when the current time is 08:00. Since the required measurement time of the primary distribution information in pattern identification No. 001 is estimated to be 60 minutes and the required analysis time is 60 minutes, 10:00, which is the time when 60 minutes + 60 minutes have elapsed from the current time of 08:00, is estimated as the scheduled distribution time of the primary distribution information. Further, since the required analysis time of the secondary distribution information in pattern identification No. 001 is estimated to be 60 minutes, 11:00, which is the time when an additional 60 minutes have elapsed from the scheduled distribution time of 10:00 of the primary distribution information, is estimated as the scheduled distribution time of the primary distribution information. For the required measurement time, required analysis time, and scheduled distribution time in pattern identification Nos. 002 to 006 of table T103, as shown in table T103, they are calculated by the same estimation method as No. 001.

[0076] Note that the required analysis time calculated by the processing time estimation unit 2340 does not need to be calculated based on the analysis speed information that differs for each analysis device that actually executes the analysis process and the actual data transmission speed information in the data transmission path from the aircraft to the analysis device that actually executes the analysis process, and can be generated as an approximate value such as the required analysis time.

[0077] (A-1-6-5. Disaster Cycle Information Acquisition Unit 2350) The disaster cycle information acquisition unit 2350 acquires the corresponding time period of the current situation information in the medium- and long-term disaster cycle that repeats "disaster occurrence → ultra-acute phase → acute phase → sub-acute phase → chronic phase → stable phase → disaster occurrence" starting from the occurrence of a disaster. The ultra-acute phase, which is the period immediately after the occurrence of a disaster in the disaster cycle, varies depending on the type of disaster. For example, in the case of a disaster such as an earthquake, it corresponds to a period of about 2 to 3 days from the occurrence of the disaster. Generally, in this ultra-acute phase, the situation in the disaster-stricken area changes rapidly in a short period of time.

[0078] FIG. 10 is a diagram showing an example of the current situation information for the disaster cycle acquired by the disaster cycle information acquisition unit according to an embodiment of the present invention. In the example shown in FIG. 10, it is shown that the situation at the current time corresponds to the "ultra-acute phase". Also, within the "ultra-acute phase", the timings of each command determination, namely the primary (initial motion) command determination, secondary command determination, and tertiary command determination, are defined, and it is shown that the situation at the current time corresponds to "after the secondary command determination in the ultra-acute phase". In addition, in the example shown in FIG. 10, in addition to the information of the disaster cycle to which the current time corresponds, an example of displaying the information of the analysis information that has already been provided to the user terminal device (crisis management headquarters terminal) is shown.

[0079] The disaster cycle information as described above may be input from a user terminal device 5000 such as a disaster management headquarters terminal or an input device 100 of the work determination system 2300, or may be acquired by being generated by the disaster cycle information acquisition unit 2350 based on the input information from the user terminal device or the input device (for example, the command situation in the disaster management headquarters).

[0080] (A-1-6-6. Multi-Stage Distribution Pattern Determination Unit 2360) The multi-stage distribution pattern determination unit 2360 includes a distribution pattern selection unit 2361, a user designation reception unit 2362, and a distribution pattern modification necessity determination unit 2363. From among the multi-stage distribution pattern candidates shown in Table T102 of FIG. 8, one or more multi-stage distribution patterns are selected and the selection result is proposed to the user, thereby determining the distribution method for performing distribution in multiple stages. Note that the multi-stage distribution pattern determination unit 2360 may determine the multi-stage distribution pattern selected by the distribution pattern selection unit 2361 as the distribution method without receiving a designation input of the multi-stage distribution pattern from the user by the user designation reception unit 2362.

[0081] (A-1-6―6-1. Distribution pattern selection unit 2361) The distribution pattern selection unit 2361 selects one or more multi-stage distribution patterns from among the multi-stage distribution pattern candidates shown in Table T102 of FIG. 8 described above, displays the selection result on the display device, and causes the processing execution command unit 2380 described later to execute processing based on the selection result. As this selection method, for example, a selection method based on disaster cycle information, a selection method based on priority distribution information, a selection method based on the desired distribution time, any of these selection methods, or a selection method combining these can be adopted. The selection methods will be described below respectively.

[0082] First, the selection method based on disaster cycle information will be described. The disaster cycle information is information on the current period in the disaster cycle acquired by the disaster cycle information acquisition unit 2350 described above. When using this selection method, the distribution pattern selection unit 2361 selects a distribution pattern previously associated with the disaster cycle information according to the content of the acquired disaster cycle information.

[0083] FIG. 11 is a table showing an example of criteria for determining a distribution pattern by a distribution pattern selection unit according to an embodiment of the present invention. As shown in table T104 of FIG. 11, a correspondence table in which disaster cycle information is associated with distribution patterns (No. 001 to 006) is recorded in advance, and the distribution pattern selection unit 2361 can select one or more multi-stage distribution patterns based on the content of the correspondence table T104 and the acquired disaster cycle information. In the example shown in FIG. 11, the multi-stage distribution patterns corresponding to the disaster cycle information "before ultra-acute phase / primary (initial motion) command judgment" are No. 001, 002, 003, the multi-stage distribution patterns corresponding to "before ultra-acute phase / secondary command judgment" are No. 004, and the multi-stage distribution patterns corresponding to the "acute phase" are No. 005, 006.

[0084] Next, a selection method based on priority distribution information will be described. The priority distribution information is the information acquired by the user demand acquisition unit 2310 described above. When using this selection method, the distribution pattern selection unit 2361 selects a distribution pattern in which the content of the post-processed data of the primary distribution information (that is, the distribution information) matches the priority distribution information acquired by the user demand acquisition unit 2310 from among the multi-stage distribution pattern candidates shown in table T102 of FIG. 8 generated by the multi-stage distribution pattern generation unit 2330.

[0085] When the priority distribution information acquired by the user demand acquisition unit 2310 is "ortho image" as shown in table 101 of FIG. 7, the distribution pattern selection unit 2361 selects No. 001, 002, 003, 004 from among the multi-stage distribution pattern candidates shown in table 102 of FIG. 8.

[0086] Next, a selection method based on the desired delivery time will be described. The desired delivery time is the information acquired by the aforementioned user requirement acquisition unit 2310. When using this selection method, the delivery pattern selection unit 2361 compares the scheduled delivery time shown in Table T103 of FIG. 9 estimated by the aforementioned processing time estimation unit with the information on the desired delivery time acquired by the user requirement acquisition unit 2310, and selects a delivery pattern in which the scheduled delivery time is earlier than the desired delivery time input by the user. Note that even if the scheduled delivery time is not necessarily earlier than the desired delivery time, the delivery pattern in which the scheduled delivery time is close to the desired delivery time may be selected.

[0087] When the desired delivery time acquired by the user requirement acquisition unit 2310 is "09:30 on August 30, 2023" as shown in Table 101 of FIG. 7, the delivery pattern selection unit 2361 selects No. 002 and 003 from among the multi-stage delivery pattern candidates shown in Table 102 of FIG. 8.

[0088] Also, when combining the above-described selection method based on priority delivery information and the selection method based on the desired delivery time and performing selection under the AND condition of both selection criteria, the delivery pattern selection unit 2361 selects, from among the multi-stage delivery pattern candidates, a delivery pattern that satisfies both conditions of the priority delivery information "ortho image" shown in Table 101 of FIG. 7 and the desired delivery time "09:30 on August 30, 2023" acquired by the user requirement acquisition unit 2310. In the example shown in Table T103 of FIG. 9, since delivery patterns No. 002 and 003 satisfy both of the above-described conditions, delivery patterns No. 002 and 003 are selected by the delivery pattern selection unit 2361.

[0089] (A-1-6―6-2. User Specified Reception Unit 2362) The user specification reception unit 2362 displays one or more multi-stage distribution patterns selected by the distribution pattern selection unit 2361 on the display that constitutes the output device 200, accepts a user's command input for the displayed one or more multi-stage distribution patterns, and determines the distribution pattern based on the specified input information. Details of the display screen and the specified input method by the user specification reception unit 2362 will be described later.

[0090] As a modification example, regardless of the selection result of the distribution pattern by the distribution pattern selection unit 2361, all multi-stage distribution pattern candidates shown in Table T102 of FIG. 8 generated by the multi-stage distribution pattern generation unit 2330 are displayed on the display that constitutes the output device 200, a user's command input for the displayed all multi-stage distribution pattern candidates is accepted, and the distribution pattern can also be determined based on the specified input information.

[0091] (A-1-6―6-3. Distribution Pattern Modification Necessity Judgment Unit 2363) After determining the multi-stage distribution pattern, the distribution pattern modification necessity judgment unit 2363 determines whether it is necessary to modify the once-determined multi-stage distribution pattern when actually performing data acquisition processing by the aircraft 1000. For example, when it is determined that the total amount of acquired data actually acquired by the aircraft is significantly larger or smaller than the total amount of acquired data estimated by the acquired data amount estimation unit 2320, the once-determined multi-stage distribution pattern may not be an appropriate distribution pattern for the user. Therefore, the distribution pattern modification necessity judgment unit 2363 determines that the distribution pattern needs to be modified, and causes the processing time estimation unit 2340 to re-execute the processing of processing time estimation and the multi-stage distribution pattern judgment unit 2360 to re-judge the multi-stage distribution pattern. The detailed processing flow at this time will be described later.

[0092] (A-1-6―7. Processing Means Judgment Unit 2370) The processing means determination unit 2370 determines, according to the content of the multi-stage distribution pattern determined by the above-described multi-stage distribution pattern determination unit 2360, a data processing unit that executes each analysis process for generating multi-stage distribution information (primary distribution information, secondary distribution information, tertiary distribution information, ···) in the multi-stage distribution pattern, and determines a transmission path for acquisition data and the like necessary for the analysis process from a plurality of candidates. The processing means determination unit 2370 includes a data processing location candidate generation unit 2371, a communication speed determination unit 2372, a data processing speed determination unit 2373, a total time estimation unit 2374, a processing means determination unit 2375, and a processing means determination unit 2376 in order to realize a function including the determination function.

[0093] (A-1-6―7―1. Data processing location candidate generation unit 2371) The data processing location candidate generation unit 2371 identifies a system including a data processing unit capable of performing analysis processing among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, which are each subsystem constituting the aircraft data processing system 1. For example, the data processing location candidate generation unit 2371 may communicate with the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 to acquire information regarding the presence or absence of a data processing unit, or may acquire information regarding the presence or absence of a data processing unit recorded in advance in the acquired data amount estimation unit 2320.

[0094] Furthermore, the data processing location candidate generation unit 2371 may grasp the variations in the transmission paths among the aircraft 1000, the data acquisition base system 2000, the data processing base system 3000, and the distribution system 4000, which are the subsystems constituting the aviation data processing system 1. Specifically, it grasps the variations in the transmission paths through which the acquired data and the processed data are transmitted until the acquired data obtained by the aircraft 1000 is analyzed and processed by any of the subsystems and the processed data is transmitted to the distribution system. This transmission path variation information may be pre-recorded in the acquired data amount estimation unit 2320, or the data processing location candidate generation unit 2371 may generate the transmission path variations based on the information regarding the presence or absence of the data processing unit.

[0095] Here, there may be an embodiment in which the processed data is directly transmitted to the user terminal device without going through the distribution system. In that case, it grasps the variations in the transmission paths through which the acquired data and the processed data are transmitted until the acquired data obtained by the aircraft 1000 is analyzed and processed by any of the subsystems and the processed data is transmitted to the user terminal device.

[0096] FIG. 12 is a table showing an example of the patterns of the data transmission paths and the data processing locations in the aviation data processing system. In the example shown in the table T104 of FIG. 12, when the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 each have a data processing unit, it shows the patterns of the processing methods that combine the variations in the locations where data analysis is executed (described as "data analysis implementation location" in the table) and the variations in the data transmission paths between the systems. The data processing location candidate generation unit 2371 generates the pattern information of the locations where data analysis is executed and the transmission paths as shown in the table T105 of FIG. 12.

[0097] In Table T105, A01, A02-1, A02-2, and A03 represent patterns when the data analysis execution location is inside the aircraft. Also, A01 represents a pattern where the processed data is transmitted directly from the aircraft to the distribution system. Both A02-1 and A02-2 represent patterns where the processed data is transmitted from the aircraft to the distribution system via the data acquisition base system. In particular, for A02-1, the transmission of the processed data from the aircraft to the data acquisition base system is performed via wireless communication, while for A02-2, the transmission of the processed data from the aircraft to the data acquisition base system is by physical movement of the memory device, that is, landing the aircraft and physically bringing the memory installed in the aircraft to the data acquisition base system. A03 represents a pattern where the processed data is transmitted from the aircraft to the distribution system via the data processing base system.

[0098] In Table T105, P01, P02-1, P02-2, and P02-3 represent patterns when the data analysis execution location is inside the data processing base system. P01 represents a pattern where the acquired data is transmitted from the aircraft directly to the data processing base system by communication. P02-1, P02-2, and P02-3 all represent patterns where the acquired data is transmitted to the data processing base system via the data acquisition base system. P02-1 represents a pattern where both the transmission from the aircraft to the data acquisition base system and the transmission from the data acquisition base system to the data processing base system are by communication. P02-2 represents a pattern where the transmission method of the acquired data from the aircraft to the data acquisition base system is by physical movement of the memory device. P02-3 represents a pattern where both the transmission from the aircraft to the data acquisition base system and the transmission from the data acquisition base system to the data processing base system are by physical movement of the memory device.

[0099] In Table T105, C01-1 and C01-2 indicate patterns when the data analysis execution location is within the data acquisition base system. C01-1 is a pattern in which the transmission of acquired data from the aircraft to the data acquisition base system is performed via communication, while C01-2 is a pattern in which the transmission of acquired data from the aircraft to the data acquisition base system is performed by physical movement of the memory device.

[0100] (A-1-6―7―2. Communication speed determination unit 2372) The communication speed determination unit 2372 grasps the communication speed for each of the plurality of communication means in each transmission path grasped by the data processing execution location candidate generation unit 2371. Further, it determines the communication means with the fastest communication speed among the plurality of communication means. The communication speed is grasped, for example, by acquiring information measured by the communication state determination unit 1430 of the aircraft 1000 or the communication infrastructure management system. Note that it is desirable that the communication speed be grasped based on the measured value of the communication speed at the current time, but it may also be grasped based on the measured value of the communication speed measured in the past.

[0101] FIG. 13 is a table showing an example of the communication speed of communication means for each data transmission path in the aircraft data processing system. For example, as shown in the table T106 of FIG. 13, in the transmission path from the aircraft 1000 to the data acquisition base system 2000, three types of communication means are conceivable: direct wireless communication using radio waves in the 2.4 GHz band, etc. (described as "direct 2.4G" in the table), satellite communication using relay by artificial satellites (described as "satellite relay" in the table), and wireless communication using a mobile phone communication line such as LTE (Long Term Evolution) (described as "mobile phone communication line (LTE)" in the table). Therefore, the communication speed determination unit 2372 grasps the communication speed for each of these communication means. The information shown in FIG. 13 may be displayed on the display device of the output device 200.

[0102] In the example shown in Table T106 of FIG. 13, further, the communication speeds of satellite relay and mobile phone communication line (LTE) are grasped as communication means in the transmission path from the aircraft 1000 to the data processing base system 3000, and the communication speeds of satellite relay and mobile phone communication line (LTE) are grasped as communication means in the transmission path from the aircraft 1000 to the distribution system 4000. The communication speed of the mobile phone communication line (LTE) is grasped as the communication means in the transmission path from the data acquisition base system 2000 to the data processing base system 3000, and the communication speed of the mobile phone communication line (LTE) is grasped as the communication means in the transmission path from the data acquisition base system 2000 to the distribution system 4000. The communication speed of the wired line is grasped as the communication means in the transmission path from the data processing base system 3000 to the distribution system 4000.

[0103] In the example shown in Table T106 of FIG. 13, an example in which four types of communication means, namely, direct 2.4G, satellite relay, mobile phone communication line (LTE), and wired line, are used as communication means is shown. However, the communication means is not limited to this, and other mobile phone communication lines such as 4G and 5G, or Wi-Fi lines can also be used.

[0104] When determining the communication speed, when using communication means that passes through multiple devices such as satellite communication, the communication speed between each device is measured, and the slowest communication speed within the communication path is taken as the actual communication speed. For example, when using satellite communication as the communication means in the transmission path from the aircraft to the data acquisition base system, the communication speeds from the aircraft to the artificial satellite and from the artificial satellite to the data acquisition base system are measured, and the slower of the two communication speeds is determined as the actual communication speed of the satellite communication.

[0105] (A-1-6―7―3. Data Processing Speed Determination Unit 2373) The data processing speed determination unit 2373 determines the processing speed of the data analysis process for each subsystem (aircraft 1000, data acquisition base system 2000, data processing base system 3000) capable of performing the analysis process grasped by the data processing execution location candidate generation unit 2371. Here, the processing speed of the data analysis process may be determined by measuring the processing speed when the analysis process is actually performed in each system, or may be determined based on the rated processing speed grasped in advance.

[0106] In addition, in any data processing unit of the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000, if there is an analysis processing task that is currently being executed, the actual processing speed may be calculated based on the progress status or the scheduled end time of the analysis processing task that is currently being executed. Alternatively, if there is an analysis processing task that is scheduled to be executed in the future in the data processing unit, the actual processing speed may be calculated based on the time required until the completion of the analysis processing task or the scheduled end time.

[0107] FIG. 14 is a table showing an example of the data analysis speed in each subsystem constituting the aircraft data processing system. For example, as shown in table T107 of FIG. 14, the analysis speeds of the respective data processing units installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 are determined. In the example shown in T107, the analysis speed of each data processing unit is 4 GHz for the data processing unit of the aircraft, 8 GHz for the data processing unit of the data acquisition base system, and 24 GHz for the data processing unit of the data processing base system.

[0108] (A-1-6―7―4. Total time estimation unit 2374) The total time estimation unit 2374 estimates, for each of the primary distribution information, secondary distribution information (and tertiary distribution information) in the multi-stage distribution pattern determined by the multi-stage distribution pattern determination unit 2360, the data transmission time and analysis processing time required to perform the transmission processing and analysis processing in each pattern of the data analysis execution location and transmission path generated by the data processing execution location candidate generation unit 2371, and estimates the total time considering the data transmission time and analysis processing time for each of the primary distribution information, secondary distribution information (and tertiary distribution information). Note that the total time may include the time for data measurement by the sensors of the aircraft 1000.

[0109] First, a method for estimating the analysis processing time in the pattern of the data analysis execution location will be described. The total time estimation unit 2374 estimates the analysis processing time for generating each distribution information in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, based on at least any one of the information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2320, the information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2373, and the information on the processing content of the primary distribution information, secondary distribution information (and tertiary distribution information) in the determined multi-stage distribution pattern.

[0110] Here, as shown in Table T102 of FIG. 8, since at least the primary distribution information and secondary distribution information (and tertiary distribution information) are defined for each multi-stage distribution pattern, when estimating the analysis processing time, the total time estimation unit 2374 estimates the analysis processing time in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 for each distribution information, based on the information on the analysis processing load for generating each distribution information according to the processing content of each distribution information.

[0111] In the example shown in Table T107 of FIG. 14, since the analysis speed of the data processing unit of the data processing base system is higher than that of the data processing units in other aircraft 1000 and the data acquisition base system, the analysis processing time is the shortest for the data processing base system, followed by the data acquisition base system, and the longest for the aircraft.

[0112] Next, a method for estimating the transmission time in each pattern of the data transmission path will be described. The total time estimation unit 2374 estimates the transmission time of the acquired data in each transmission path for each distribution information based on at least any one of the information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2320, the information on the communication speed for each transmission path determined by the communication speed determination unit 2372, and the information on the processing content of each distribution information in the determined multi-stage distribution pattern. Further, since the data to be transmitted includes processed data and processing data in addition to the acquired data, the transmission time required for each data transmission of the processed data and the processing data is also estimated.

[0113] Here, as shown in Table T102 of FIG. 8, since at least a plurality of distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.) are defined for each multi-stage distribution pattern, when the total time estimation unit 2374 estimates the data transmission time, it estimates the acquired data and processing data required to generate each distribution information according to the processing content of each distribution information, and further estimates the data amount of each generated distribution information. Based on the data amount of the acquired data, the processing data, and each distribution information, the transmission time of each distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.) in each transmission path is estimated.

[0114] In addition, in the secondary distribution information of No. 001 in Table T102 of the analysis process, "geographic information" is required as processing data. Also, in the secondary distribution information of No. 004, "complementary data (geographic information)" is required as processing data. In the secondary distribution information of No. 005, "past map integration data" is required as processing data. Thus, when performing an analysis process using the processing data, the processing data recorded in the processing data recording unit 3300 of the data processing base system is transmitted to the data processing unit that executes the analysis process. Therefore, based on the data volume of the processing data recorded in the processing data recording unit 3300 in advance and the information on the communication speed for each transmission path of the processing data, the transmission time of the processing data in each transmission path is estimated.

[0115] Note that patterns such as "P01" of the data transmission path and the data processing execution location shown in Table T105 of FIG. 12 indicate examples where data transmission from an aircraft to a data acquisition base etc. is performed not by transmission using a communication line but by physically moving a recording medium such as a memory. In the case of using such a data transmission method of physically moving the recording medium, the data transmission time, for example, for the physical memory movement from the aircraft to the data acquisition base system, may be estimated as the time required until the aircraft completes landing at the data acquisition base system and the memory is taken out from inside the aircraft body and the acquired data in the memory is read out. Also, for the physical memory movement from the data acquisition base system to the data processing base system, in addition to the movement time from the data acquisition base system to the data processing base system, the time required until the acquired data is read out from the memory may be estimated as the transmission time.

[0116] Here, since the acquired data is sensed images or point cloud data, the data volume is larger than that of the processed data. For example, the data volume of the processed data is about 1 / 10 of that of the acquired data. Also, although it varies depending on the analysis content shown in Table T101, the data volume of the processing data is equal to or less than that of the processed data.

[0117] Next, a method for the total time estimator 2374 to estimate the total time considering the data transmission time and analysis processing time estimated by the above-described method will be described. First, for each pattern of the processing means shown in Table T105, the total time can be estimated considering the transmission time and analysis processing time for each of the primary distribution information, secondary distribution information, (and tertiary distribution information) estimated by the above-described method. As an example, when the multi-stage distribution pattern No. 001 is the determination result by the multi-stage distribution pattern determination unit 2360, the first total time considering (or adding) the transmission time and analysis processing time for the "ortho image" which is the primary distribution information is estimated, and further, the second total time considering (or adding) the transmission time and analysis processing time for the "map integrated image" which is the secondary distribution information is estimated.

[0118] On the other hand, when a part of each process from the data acquisition process by the aircraft sensor until the primary distribution information is distributed to the user terminal device can be executed in parallel, or when a part of the transmission process and analysis process (distribution information generation process) for the primary distribution information and secondary distribution information (furthermore, tertiary distribution information) can be executed in parallel, it is desirable to estimate the total time considering the parallel execution time of each process executed in parallel.

[0119] (A-1-6―7―5. Processing means determination unit 2375) Based on the estimation results of the total time for each of the distribution information (primary distribution information, secondary distribution information, tertiary distribution information) estimated by the total time estimator 2374, the processing means determination unit 2375 determines the pattern of the analysis execution location and transmission path where the first total time for the primary distribution information becomes the shortest, and determines the pattern of the analysis execution location and transmission path where the second total time for the secondary distribution information becomes the shortest, and displays the determination result on the display constituting the output device 200.

[0120] (A-1-6―7―6. Processing means determination unit 2376) The processing means determination unit 2376 determines a pattern for executing processing based on the analysis processing execution location and the pattern of the transmission path in each of the pieces of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2375.

[0121] First, the processing means determination unit 2376 proposes to the user one or a plurality of candidate patterns of the analysis processing execution location and the transmission path in each of the pieces of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2375. For example, the proposal to the user is made by displaying the candidate patterns proposed to the output device 200 (such as a display) of the work determination system.

[0122] Next, the processing means determination unit 2376 receives approval or selection for one or a plurality of candidate patterns of the analysis processing execution location and the transmission path proposed to the user via the input device 100 (a touch panel, a keyboard, a mouse, or an audio input device such as a microphone) of the work determination system. The processing means determination unit 2376 determines the processing means in each of the pieces of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) based on the approval or selection input received from the user. The detailed proposal method and selection reception method by the processing means determination unit 2376 will be described later.

[0123] Note that the determination of the processing means by the processing means determination unit 2376 is not limited to the method of determining the processing means based on the approval or selection input received from the user as described above. For example, the pattern determined by the processing means determination unit 2375 can be automatically determined without approval or selection by the user.

[0124] (A-1-6―8. Processing execution command unit 2380) The processing execution instruction unit 2380 transmits operation instructions based on the multi-stage distribution pattern information determined by the multi-stage distribution pattern determination unit 2360 and the information on the processing means pattern in each of the distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2376 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, thereby causing the aircraft to execute data acquisition processing, data transmission processing, and generation of primary distribution information involving analysis processing, distribution of primary distribution information, data transmission processing, and generation of secondary distribution information involving analysis processing, and distribution of secondary distribution information. Further, when the content of the analysis processing is an analysis processing that requires processed data such as geographical information as shown in Nos. 001 and 004 of Table T102, the operation instruction transmitted to the data processing base system 3000 includes a request instruction to transmit the processed data recorded in the processed data recording unit 3300 of the data processing base system to the data processing unit that executes the analysis processing. Here, the primary distribution information in the multi-stage distribution pattern is distribution information that is distributed to the user terminal device 5000 prior to other distribution information, the secondary distribution information is distribution information that is distributed to the user terminal device 5000 after the primary distribution information, and furthermore, the tertiary distribution information is distribution information that is distributed to the user terminal device 5000 even later than the secondary distribution information. Therefore, the operation instructions transmitted to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 include an information provision instruction such that the secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is provided after the secondary distribution information.

[0125] The aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 that have received the operation command from the processing execution command unit 2380 execute the operation tasks of their own systems (including data transmission and analysis processing) in the processing means pattern determined according to the operation command. As described above, the operation command includes an information provision command in which secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and tertiary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the secondary distribution information. Therefore, the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 provide or distribute the secondary distribution information to the distribution system 4000 or the user terminal device 5000 step by step after the primary distribution information, and the tertiary distribution information to the distribution system 4000 or the user terminal device 5000 step by step according to the operation command.

[0126] In addition, if part of each process from data sensing to data transmission and data processing until the primary distribution information is distributed to the user terminal device can be executed in parallel, or if part of the transmission process and data processing (generation process of distribution information) related to the primary distribution information and the secondary distribution information (and further the tertiary distribution information) can be executed in parallel, these processes may be executed in parallel.

[0127] For example, in the multi-stage distribution pattern of "No. 002" described in Table T102, when an integrated image is generated as the primary distribution information and an ortho image is generated as the secondary distribution information, and the primary distribution information is analyzed and processed by the data processing unit of the aircraft according to the processing means pattern "A01", and the secondary distribution information is analyzed and processed by the data processing unit of the data acquisition base system according to the processing means pattern "C01-1", at least part of the work of analyzing and processing the primary distribution information by the data processing unit of the aircraft and the data transmission process of transmitting the acquired data used for the analysis process of the secondary distribution information from the aircraft to the data acquisition base system are carried out in parallel.

[0128] In this way, by executing at least some of the operations of the transmission process and the analysis process (distribution information generation process) related to the primary distribution information and the secondary distribution information (and further the tertiary distribution information) in parallel, during the operations of the transmission process and the analysis process for the distribution of the primary distribution information, at least some of the operations of the transmission process and the analysis process for the distribution of the secondary distribution information can be executed in parallel. Therefore, it becomes possible to quickly distribute the secondary distribution information.

[0129] The parallel execution of at least some of the operations of the transmission process and the analysis process (distribution information generation process) related to the primary distribution information and the secondary distribution information (and further the tertiary distribution information) as described above can be carried out between various processing operations. For example, it can be carried out in parallel between the data acquisition process and the data transmission process, the data acquisition process and the data analysis process, the data transmission process and the data analysis process, the data transmission process and the data transmission process, and the data analysis process and the data analysis process.

[0130] <Hardware Configuration> FIG. 15 is a diagram showing an example of the hardware configuration of the operation determination system. Here, the operation determination system 2300 in the present invention is an information processing device such as a server device or a PC. As shown in the figure, the operation determination system 2300 includes an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary storage device 500, a communication device 600, and a bus 700 that electrically connects these devices.

[0131] The input device 100 is a device for a user to input information and instructions into the operation determination system. Specifically, the input device 801 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.

[0132] The output device 200 is a device for outputting the information generated by the operation determination system 2300. Specifically, the output device 802 is a display, a printer, or a speaker.

[0133] The processing device 300 is a device that performs arithmetic processing, for example. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing arithmetic operations.

[0134] The main memory device 400 is a memory device such as a RAM that temporarily stores various read information, a ROM that stores programs and application programs executed by the processing device 300, and various other information. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that can store digital information.

[0135] The communication device 600 is a device that performs information communication, either wirelessly or wired, with an external device.

[0136] Although FIG. 11 illustrates the hardware configuration of the work determination system 2300, the same hardware configuration as that of FIG. 11 described above can also be realized in other systems (communication infrastructure management system 2100, aircraft operation operating system 2200, data processing unit 2400, operation management system 2500, airspace monitoring system 2600) within the data acquisition base system 2000, the data processing base system 3000, the distribution system 4000, and the user terminal device 5000 (including the crisis management headquarters terminal).

[0137] <Control Flow> (A-1-7. Upper-level Control Flow of the Aviation Data Processing System) Next, the processing flow of the work determination system will be described with reference to the drawings. FIG. 16 is a flowchart showing the processing flow of the work determination system.

[0138] First, the user demand acquisition unit 2310 acquires user demand information via a user terminal device 5000 including a crisis management headquarters terminal (step 101).

[0139] Next, the acquired data amount estimation unit 2320 predicts the total amount of the data amount of the acquired data (step 102). Note that this step is executed before the start of the sensing operation by the aircraft or at least before the completion of the sensing operation.

[0140] Next, the multi-stage distribution pattern generation unit 2330 generates a plurality of multi-stage distribution pattern candidates for the distribution data provided in multiple stages (step 103).

[0141] Next, the processing time estimation unit 2340 estimates the required processing time for each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated in each of the plurality of multi-stage distribution pattern candidates (step 104). Note that the required processing time may be estimated in consideration of not only the time related to the analysis processing for generating each distribution information but also the required time related to the data acquisition processing and the data transmission processing.

[0142] Next, the disaster cycle information acquisition unit 2350 acquires disaster cycle information (that is, the corresponding time of the current situation information in the disaster cycle) (step 105).

[0143] Next, the multi-stage distribution pattern determination unit 2360 determines one or a plurality of multi-stage distribution patterns from among the multi-stage distribution pattern candidates (step 106).

[0144] Next, the processing means determination unit 2370 determines the data processing execution location and the transmission path for generating each distribution information (primary distribution information, secondary distribution information, tertiary distribution information,...) (step 107).

[0145] Next, the processing execution command unit 2380 causes the aircraft 1000 to execute data acquisition processing (sensing processing by the sensor) (step 108).

[0146] Next, the distribution pattern correction necessity determination unit 2363 of the multi-stage distribution pattern determination unit 2360 determines whether correction of the distribution pattern is necessary (step 109).

[0147] Next, operation commands based on the multi-stage distribution pattern information determined by the multi-stage distribution pattern determination unit 2360 and the processing means pattern information in each of the distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2376 are output to each of the systems of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, and transmission processing, analysis processing, and operation of providing or distributing to the distribution system 4000 or the user terminal device 5000 are performed for each of the multi-stage divided distribution information (primary distribution information, secondary distribution information, tertiary distribution information) (step 110). Here, regarding the providing or distributing operation, since the operation command includes an information providing command in which secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and tertiary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the secondary distribution information, the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 provide or distribute the secondary distribution information after the primary distribution information and the tertiary distribution information after the secondary distribution information to the distribution system 4000 or the user terminal device 5000 step by step according to the operation command. Note that the generation processes of the primary and secondary distribution information executed in this step are both generated using the common acquisition data sensed in step 108 or data obtained by processing the acquisition data.

[0148] (A-1-8. Detailed Control Flow of Acquisition Data Amount Estimation Unit 2320) FIG. 17 is a flowchart showing an example of a control flow when the work determination system determines the total amount of acquisition data. In particular, it is a control flow for explaining an example of the detailed processing in step 102, "Estimation of Total Amount of Acquisition Data," in the flowchart shown in FIG. 16.

[0149] First, the acquired data volume estimation unit 2320 estimates the area of the sensing target area by the sensors mounted on the aircraft (step 201). For example, based on the information of the "acquisition target area" acquired by the user requirement acquisition unit 2310, the area of the target area for sensing is estimated. Note that in this step, not limited to the area of the sensing target area, as long as information on the sensing range can be estimated, instead of estimating the area, for example, the planned flight route of the aircraft, the planned flight time, the surface sensing target range, or the range of the planned flight airspace may be estimated.

[0150] Next, the acquired data volume estimation unit 2320 determines the type of acquired data (step 202). The type of acquired data is, for example, an optical image, an infrared image, point cloud data, etc. In this step, instead of the type of acquired data, the type of sensor used to acquire the acquired data may be determined. Here, the type of sensor includes an optical camera for taking an optical image, an infrared sensor for acquiring an infrared image, a laser sensor including LiDAR for acquiring point cloud data, etc. The information on the type of this acquired data or the type of sensor can be determined by the information acquired from the input device 100 of the aircraft 1000, the aircraft operation operating system 2200, or the work determination system 2300.

[0151] Next, the acquired data volume estimation unit 2320 determines the unit information amount (step 203). The determination of the unit information amount is a set parameter regarding the data amount per unit area, for example, the resolution of an optical image or an infrared image, or the point cloud density of point cloud data. The information on the type of this acquired data or the type of sensor can be determined by the information acquired from the input device 100 of the aircraft 1000, the aircraft operation operating system 2200, or the work determination system 2300.

[0152] Next, the acquired data volume estimation unit 2320 estimates the total amount of acquired data (step 204). The total amount of acquired data can be calculated based on the combination of the information acquired in each of the above-described processing steps 201 to 203, or at least any of the information.

[0153] As shown in FIG. 17, the process of estimating the total amount of acquired data by the acquired data volume estimation unit 2320 is performed before starting the sensing process by the aircraft or at least before the sensing process is completed. By estimating the total amount of acquired data at such a timing, it is possible to determine an appropriate transmission path and a data processing execution location according to the estimated value of the total amount of acquired data at least before the transmission process and the analysis process of the acquired data are started.

[0154] (A-1-9. Detailed Control Flow of the Multi-Stage Distribution Pattern Determination Unit 2360) FIG. 18 is a flowchart showing an example of a control flow when the multi-stage distribution pattern determination unit 2360 determines a distribution pattern. In particular, it is a control flow for explaining an example of the detailed processing of step 106 "Determination of the multi-stage distribution pattern" in the flowchart shown in FIG. 16.

[0155] First, the distribution pattern selection unit 2361 of the multi-stage distribution pattern determination unit 2360 selects one or more multi-stage distribution patterns from among the multi-stage distribution pattern candidates based on the disaster cycle information (step 301). In this processing step, as an example, one or more multi-stage distribution patterns are selected based on the distribution pattern determination criteria as shown in Table T104 of FIG. 11 and the disaster cycle information acquired by the disaster cycle information acquisition unit 2350.

[0156] Next, the distribution pattern selection unit 2361 of the multi-stage distribution pattern determination unit 2360 selects one or more multi-stage distribution patterns from the multi-stage distribution pattern candidates based on the priority distribution information acquired by the user demand acquisition unit 2310 (step 302). For example, in this processing step, the distribution pattern selection unit 2361 selects, from the multi-stage distribution pattern candidates shown in Table T102 of FIG. 8 generated by the multi-stage distribution pattern generation unit 2330, a distribution pattern in which the content of the processed data of the primary distribution information (that is, the distribution information) matches the priority distribution information acquired by the user demand acquisition unit 2310.

[0157] Next, the distribution pattern selection unit 2361 of the multi-stage distribution pattern determination unit 2360 selects one or more multi-stage distribution patterns from the multi-stage distribution pattern candidates based on the desired distribution time acquired by the user demand acquisition unit 2310 (step 303). For example, in this processing step, the distribution pattern selection unit 2361 compares the scheduled distribution time shown in Table T103 of FIG. 9 estimated by the above-described processing time estimation unit with the information on the desired distribution time acquired by the user demand acquisition unit 2310, and selects a distribution pattern in which the scheduled distribution time is earlier than the desired distribution time input by the user. Note that it is not always necessary for the scheduled distribution time to be earlier than the desired distribution time, and a distribution pattern in which the scheduled distribution time is close to the desired distribution time may be selected.

[0158] In this flowchart, an example in which the three selection processes described in steps 301 to 303 are performed under an AND condition has been described. Thus, by selecting a multi-stage distribution pattern through a plurality of selection processes, a distribution pattern that better matches the user demand can be selected. Further, in the present invention, it is sufficient to have at least any one of the selection processes of steps 301 to 303 without using a plurality of selection criteria.

[0159] Next, the user designation reception unit 2362 of the multi-stage distribution pattern determination unit 2360 displays one or more multi-stage distribution patterns selected by the distribution pattern selection unit 2361 on the display that constitutes the output device 200 of the work determination system 2300 or the user terminal device 5000 (step 304).

[0160] Here, FIG. 19 is a diagram showing an example of a display screen of a determination result when the multi-stage distribution pattern determination unit determines a distribution pattern. In the example of the display screen shown in FIG. 19, as user requests, wired distribution information "ortho image" and distribution desired time "9:30" information are acquired, and in the case of acquiring "ultra-acute phase / before initial motion determination" as disaster cycle information, the results of the determination processes in steps 301 to 303 described above are shown. Since the two patterns of distribution pattern Nos. 002 and 003 satisfy the determination criteria based on the user requests and disaster cycle information, on this display screen, it is described that the two patterns match the determination conditions, and the two patterns are shaded and displayed in bold in a coordinated manner.

[0161] Next, the user designation reception unit 2362 of the multi-stage distribution pattern determination unit 2360 receives a user's designated input for the determination result of one or more multi-stage distribution patterns displayed on the display screen (step 305). In the example shown in FIG. 19, for the selection result of the multi-stage distribution pattern (distribution pattern Nos. 002 and 003) displayed in step 304, a selection input field is displayed where the user can select either distribution pattern No. 002 or 003, and further, a confirmation button (labeled "confirmation of selected pattern" in the figure) for confirming the distribution pattern selected by the selection input field is displayed. In the example shown in FIG. 19, since distribution pattern No. 002 is selected in the selection input field on the left side of the screen, by pressing the confirmation button on the screen, the user can perform a designated input of distribution pattern No. 002.

[0162] Here, as shown in FIG. 19, not only for No. 002 and 003 which are the determination results of the multi-stage distribution pattern determined in steps 301 to 303, but also for other No. 001, 004, 005, and 006, selection input fields are provided and the user can perform specified input. That is, regardless of the automatic determination result of the multi-stage distribution pattern by the multi-stage distribution pattern determination unit 2360, the user may be allowed to specify and input an arbitrary multi-stage distribution pattern.

[0163] Next, based on the received user-specified input, the distribution pattern is determined by the user-specified reception unit 2362 of the multi-stage distribution pattern determination unit 2360 (step 306). In this flowchart, the determination process of the distribution pattern in this step, in addition to the method based on the received user-specified input, in the determination process of the multi-stage distribution pattern in steps 301 to 303, if one distribution pattern can be selected, the determination result of the multi-stage distribution pattern may be determined as the distribution pattern (regardless of the presence or absence of user-specified input).

[0164] (A-1-10. Detailed Control Flow of the Processing Means Determination Unit 2370) FIG. 20 is a flowchart showing an example of the control flow when the processing means determination unit determines the processing means. In particular, it is a control flow for explaining an example of the detailed processing in step 107 "Determination of the Data Processing Execution Location and Transmission Path" of the flowchart shown in FIG. 16.

[0165] First, the data processing execution location candidate generation unit 2371 generates a combination pattern of a plurality of data processing execution locations and a plurality of transmission paths of data in the aviation data processing system (step 401).

[0166] Next, the communication speed determination unit 2372 and the data processing speed determination unit 2373 determine the communication speed for each of the plurality of transmission paths, and determine the processing speed of the data analysis process for each of the plurality of data processing execution locations (step 402). In the determination of the communication speed for each of the plurality of transmission paths, the communication speed for each of the plurality of communication means in each transmission path is grasped, the communication means with the fastest communication speed among the plurality of communication means is determined, and the communication means is determined as the communication speed of the transmission path.

[0167] Next, the total time estimation unit 2374 estimates the data acquisition time required for data acquisition processing (sensing processing) by the sensors of the aircraft 1000 (step 403). Note that information regarding the sensing range (for example, the planned flight path of the aircraft, the planned flight time, the surface sensing target range, or the range of the planned flight airspace, etc.) is generated based on information such as the information of the acquisition target area acquired by the user request acquisition unit 2310, and the data acquisition time required for the data acquisition processing is estimated based on the information regarding the sensing range.

[0168] Next, the total time estimation unit 2374 estimates the data transmission time when data transmission is performed using a communication line (step 404). As an example of a method for estimating the data transmission time using the communication line in this step, for example, information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2320, information on the communication speed for each transmission path determined by the communication speed determination unit 2372, and information on the analysis processing content for generating each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) in the determined multi-stage distribution pattern. Based on all or at least any of the information, the data transmission time is estimated for each combination pattern of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and each transmission path.

[0169] Next, the total time estimation unit 2374 estimates the data transmission time when data transmission is performed using the physical movement of the recording medium (step 405). As an example of the method for estimating the data transmission time using the physical movement of the recording medium in this step, for example, the physical movement of the recording medium from the aircraft to the data acquisition base system may be estimated as the data transmission time by the time required until the aircraft completes landing at the data acquisition base system and the acquired data in the recording medium is read out after taking out the recording medium from inside the aircraft fuselage. Also, for the physical movement of the recording medium from the data acquisition base system to the data processing base system, in addition to the movement time from the data acquisition base system to the data processing base system, the time required until the acquired data is read out from the recording medium may be estimated as the data transmission time.

[0170] Next, the total time estimation unit 2374 estimates the data analysis time (step 406). As an example of the method for estimating the data analysis time in this step, for example, based on all or at least any of the information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2320, the information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2373, and the information on the analysis processing content for generating each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) in the determined multi-stage distribution pattern, the data analysis time is estimated for each combination pattern of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and each data processing execution location.

[0171] Next, the total time estimation unit 2374 checks whether it is possible to perform a parallel operation in which some of the data acquisition process, data transmission process, data analysis process, and transmission process of the processed data are executed in parallel from the start of the data acquisition process until the distribution information is distributed to the user terminal device, or a parallel operation in which the transmission process and analysis process related to the primary distribution information and some of the transmission process and analysis process related to the secondary distribution information (or tertiary distribution information) are executed in parallel (step 407).

[0172] Next, the total time estimation unit 2374 estimates the total processing time (step 408). If, as a result of checking the feasibility of parallel operations in step 407, parallel operations are not possible, then for each combination of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and the data processing execution location and transmission path pattern shown in Table T105, the total required time is estimated by adding the calculated transmission time and analysis processing time. In this case, for calculating the total required time of the primary distribution information, in addition to the transmission time and analysis processing time, the data acquisition time may be added to estimate the total required time.

[0173] Conversely, if, as a result of checking the feasibility of parallel operations in step 305, parallel operations are possible, then for each combination of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and the data processing execution location and transmission path pattern shown in Table T105, the parallel execution possible time of each process is obtained, and the total required time is estimated by subtracting the parallel execution possible time from the processing time of the processes for which parallel operations are possible.

[0174] Next, the processing means determination unit 2375 compares the total processing times of the candidate patterns of each processing means, which are the estimation results of the total processing time estimated in step 408, and determines the candidate for the processing means pattern with the shortest total processing time for each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) (step 409). For example, the candidate for the processing means pattern with the shortest total processing time of the primary distribution information is determined, and the processing means pattern with the shortest total processing time of the secondary distribution information is determined.

[0175] Next, the processing means determination unit 2376 displays the determination results of the processing means patterns of each distribution information determined on an output device 200 such as a display device, and determines the processing means pattern of each distribution information by accepting the user's approval or designated input for the displayed determination results (step 410).

[0176] Here, FIG. 21 is a diagram showing an example of a display screen displayed to the user when the processing means determination unit 2376 determines a processing means pattern for the primary distribution information. Further, FIG. 22 is a diagram showing an example of a display screen displayed to the user when the processing means determination unit determines a processing means pattern for the secondary distribution information. In FIGS. 21 and 22, in particular, as a multi-stage distribution pattern, an example of a display screen in the case of determining to distribute the multi-stage distribution pattern “002” in Table T102 of FIG. 8, that is, “low-resolution ortho image” as the primary distribution information and “high-resolution ortho image” as the secondary distribution information, is shown.

[0177] FIG. 21 shows the estimation result of the total processing time estimated for the primary distribution information, and the total processing time in the patterns of a plurality of data processing execution locations is displayed. Further, among these patterns of a plurality of data processing execution locations (that is, processing means patterns), “A01” determined as the processing means pattern with the shortest total processing time is shown as an example of cooperative display with hatching and boldface. On the other hand, FIG. 22 shows the estimation result of the total processing time estimated for the secondary distribution information, and the total processing time in the patterns of a plurality of data processing execution locations is displayed. Further, among these patterns of a plurality of data processing execution locations, “C01-1” determined as the processing means pattern with the shortest total processing time is shown as an example of cooperative display with hatching and boldface.

[0178] Note that in FIGS. 21 and 22, a plurality of processing means patterns including the processing means pattern with the shortest total processing time determined in step 409 are displayed, and a selection input field for selecting each processing means pattern is displayed on the left side of the display screen. Further, an OK button (labeled "Confirmation of Selected Pattern" in the figure) for confirming the processing means pattern selected by the selection input field is displayed. In FIG. 21, since the processing means pattern "A01" is selected in the selection input field on the left side of the screen, by pressing the OK button labeled "Confirmation of Selected Pattern" on the screen, the user can perform a designated input of "A01" as the processing means pattern. Similarly in FIG. 22, by operating the OK button, a designated input of the processing means pattern can be performed as in FIG. 21.

[0179] Note that in an embodiment, only one processing means pattern with the shortest total processing time determined in step 409 may be displayed on the screen for receiving a designated input of the processing means pattern from the user, and the processing means confirmation unit 2376 receives an input as to whether the user approves the one processing means pattern. On the other hand, as shown in FIGS. 21 and 22, a plurality of processing means patterns including the processing means pattern with the shortest total processing time determined in step 409 may be displayed, and the processing means confirmation unit 2376 receives a designated input of a specific processing means pattern from the plurality of processing means patterns. Alternatively, regardless of the automatic determination result of the processing means pattern in step 409, all processing means pattern candidates may be displayed to the user, and an arbitrary processing means pattern may be designated and input from among all the processing means pattern candidates.

[0180] The processing means confirmation unit 2376 determines the processing means pattern based on an approval input or a designated input from the user for one or more of the above-described processing means pattern candidates. Alternatively, regardless of the input information from the user, the processing means pattern with the shortest total processing time determined by the processing means determination unit 2375 may be determined as the processing means pattern for each distribution information.

[0181] (A-1-11. Details Control Flow of the Delivery Pattern Modification Necessity Determination Unit 2363) FIG. 23 is a diagram showing an example of a control flow when the delivery pattern modification necessity determination unit 2363 determines whether modification of the delivery pattern is necessary. In particular, it is a control flow showing an example of detailed processing in step 109, "Determination of Necessity to Modify Delivery Pattern" of the flowchart shown in FIG. 16.

[0182] First, the delivery pattern modification necessity determination unit 2363 calculates the difference between the total amount of acquisition data actually sensed by the aircraft 1000 and the total amount of acquisition data estimated in step 102 of FIG. 16 (step 501).

[0183] Next, it is determined whether the difference calculated in step 501 is greater than a predetermined value (step 502). When it is determined that the absolute value of the difference is less than or equal to the predetermined value, the process proceeds to step 504, and when it is determined that the absolute value of the difference is greater than the predetermined value, the process proceeds to step 503.

[0184] Next, when it is determined that the absolute value of the difference is greater than the predetermined value, the processing time estimation unit 2340 re-estimates the required processing time for each delivery information (primary delivery information, secondary delivery information, and tertiary delivery information) generated in each of the plurality of multi-stage delivery pattern candidates (step 503). Note that the processing in this step can be the same as the processing in step 104 described above.

[0185] Next, the multi-stage delivery pattern determination unit 2360 performs re-determination of the multi-stage delivery pattern (step 504). Note that the processing in this step can be the same as the processing in step 106 described above.

[0186] Next, the communication speed determination unit 2372 re-measures the communication speed of the transmission path (step 505).

[0187] Next, it is determined whether or not the absolute value of the change amount between the communication speed re-measured in step 505 and the previously measured communication speed is greater than a predetermined value (step 506). If the change amount is greater than the predetermined value, the process proceeds to step 507, and if the change amount is less than or equal to the predetermined value, the process proceeds to step 508.

[0188] Next, when the change amount of the communication speed is greater than the predetermined value, the data processing execution location and the transmission path pattern are re-determined by the processing means determination unit 2370 (step 507). Note that the processing in this step can be the same as the processing in step 107 described above.

[0189] As shown in FIG. 23, even after determining the multi-stage distribution pattern and the processing means pattern, there may be a case where the data amount of the actually sensed acquisition data is significantly different from the previous estimated value, or a case where the communication speed in the transmission path changes significantly. In such a case, since the previously determined multi-stage distribution pattern and the processing means pattern are likely to be inappropriate for satisfying the user's requirements, in such a case, by determining the multi-stage distribution pattern and the processing means pattern again, it becomes possible to perform processing based on an appropriate multi-stage distribution pattern and processing means pattern that satisfy the user's requirements in the case where the above-described situation change has occurred.

[0190] [A-2. Effects of this Embodiment] Regarding an aerial data processing system that acquires data on a sensing target range such as a disaster area by an aircraft using sensors such as a camera or a LiDAR device mounted on the aircraft, performs analysis processing on the acquired data, and provides the processed data to a user terminal such as a crisis management headquarters terminal, there has been a problem that the crisis management headquarters etc. cannot obtain disaster information until the processed data is provided to the user terminal, and appropriate countermeasures cannot be determined until the disaster information is obtained. On the other hand, as time elapses after a disaster occurs, there has been a tendency for users to demand processed data that has undergone more detailed analysis processing. As in the first embodiment described above, by dividing the information distributed to the user terminal into multiple types and providing it to the user step by step over time, it becomes possible to provide information corresponding to the above-described user demands. As an example, the primary distribution information can be used for initial situation determination at the scene, and the secondary distribution information can be used as information for media announcements.

[0191] The above-described embodiments are merely examples for facilitating the understanding of the present invention and are not for limiting the interpretation of the present invention. The present invention can be changed and improved without departing from its gist, and it goes without saying that equivalents of the present invention are included therein.

Explanation of Reference Numerals

[0192] 1…Aerial data processing system 100…Input device 200…Output device 300…Processing device 400…Main memory device 500…Auxiliary storage device 600…Communication device 700…Bus 1000…Aircraft 1100…Flight unit 1110…Self-position and speed determination unit 1120…Attitude determination unit 1130…Flight control unit 1200…Sensing unit 1210…Sensor 1220…Sensor attitude control unit 1230…Sensor control unit 1300…Communication unit 1310…Control communication unit 1320…Data communication unit 1330…Status data communication unit 1400…Status determination unit 1410…Flight state determination unit 1420…Sensing state determination unit 1430…Communication state determination unit 1500…Data processing unit 1600…Data recording unit 1610…Acquired data recording unit 1620…Processed data recording unit 1630…Communication state recording unit 2000…Data acquisition base system 2100…Communication infrastructure management system 2200…Aircraft operation system 2300…Operation determination system 2310…User requirement acquisition unit 2320…Estimated amount of acquired data unit 2330…Multi - stage distribution pattern generation unit 2340…Estimated processing time unit 2350…Disaster cycle information acquisition unit 2360…Multi - stage distribution pattern determination unit 2361…Distribution pattern selection unit 2362…User designation reception unit 2363…Determination unit for necessity of modifying distribution pattern 2370…Processing means determination unit 2371…Candidate generation unit for data processing execution location 2372…Communication speed determination unit 2373…Data processing speed determination unit 2374…Total time estimation unit 2375…Processing means determination unit 2376…Processing means determination unit 2380…Processing execution command unit 2400…Data processing unit 2500…Operation management system 2600…Airspace monitoring system 3000…Data processing base system 3100…Communication unit 3200…Data processing unit 3300…Processing data recording unit 4000…Distribution system 4100…Communication unit 4200…Distributed data management unit 5000…Crisis management headquarters terminal

Claims

1. An aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for communicating control information related to flight or data acquisition with the aircraft, and a data processing unit for processing acquired data obtained by the sensor to generate processed data, a control system for determining the content of processing work by an aerial data processing system, First data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data, Second data processing for generating second distribution information from the acquired data or the first distribution information, First distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device, Second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, A processing execution command unit for causing the aerial data processing system to execute, The processing execution command unit, A control system that causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution information is started to be provided to the user terminal device or the distribution system by the first distribution processing.

2. The control system according to claim 1, The first distribution information and the second distribution information are generated from the common acquired data or the processed data obtained by processing the common acquired data.

3. The control system according to claim 1, Generating a distribution pattern including a plurality or a single combination regarding the distribution information content of the first distribution information and the second distribution information.

4. The control system according to claim 1, A control system that displays on a display device a delivery pattern including a plurality or a single combination of the delivery information contents of the first delivery information and the second delivery information.

5. The control system according to claim 3 or 4, wherein In the delivery pattern, there is included at least one of a combination of delivery information in which the processing load of the second data processing for generating the second delivery information is greater than the processing load of the first data processing for generating the first delivery information, and a combination of delivery information in which the time required to generate the second delivery information and provide it to the user terminal device or the delivery system is longer than the time required to generate the first delivery information and provide it to the user terminal device or the delivery system. A control system.

6. The control system according to claim 4, wherein The control system includes a designated input receiving unit that receives a designated input for the delivery pattern displayed on the display device.

7. The control system according to claim 1, wherein The control system generates a delivery pattern including a single combination of the delivery information contents of the first delivery information and the second delivery information, The processing execution instruction unit causes the first delivery processing and the second delivery processing to be executed by the aviation data processing system based on the generated combination. A control system.

8. The control system according to any one of claims 3, 4, and 7, wherein The control system generates the delivery pattern according to the timing after a disaster occurs.

9. The control system according to any one of claims 3, 4, and 7, wherein The control system includes a user request receiving unit that receives request information regarding at least one of the first delivery information and the second delivery information.

10. The control system according to claim 9, wherein A control system that generates the distribution pattern based on the desired distribution time when the user request reception unit receives information on the desired distribution time regarding at least one of the first distribution information and the secondary distribution information.

11. The control system according to claim 9, A control system that generates the distribution pattern based on the priority distribution desired information when the user request reception unit receives priority distribution desired information regarding at least one of the contents of the first distribution information and the secondary distribution information.

12. The control system according to claim 1, The first distribution information is an ortho image obtained by orthorectifying the image of the target area acquired by the sensor and integrating a plurality of orthorectified images, The second distribution information is a map integrated image obtained by integrating the ortho image and geographical information. The control system.

13. The control system according to claim 1, The first distribution information is an integrated image obtained by integrating a plurality of images of the target area acquired by the sensor, The second distribution information is an ortho image obtained by orthorectifying a plurality of images of the target area acquired by the sensor and integrating a plurality of orthorectified images. The control system.

14. The control system according to claim 1, The first distribution information is an ortho image obtained by orthorectifying the image of the target area acquired by the sensor and integrating a plurality of orthorectified images, The second distribution information is complemented data obtained by complementing the defect data included in the ortho image with other data. The control system.

15. The control system according to claim 1, The first distribution information is a map integrated image obtained by orthorectifying an image of the target area acquired by the sensor, integrating a plurality of orthorectified images, and integrating the ortho image with geographical information. The second distribution information is a control system which is a result of differential analysis between the map integrated image and a map integrated image generated earlier than the map integrated image.

16. The control system according to claim 1, wherein the first distribution information generates a map integrated image obtained by orthorectifying an image of the target area acquired by the sensor, integrating a plurality of orthorectified images, and integrating the ortho image with geographical information, and is a result of differential analysis between the map integrated image and a map integrated image generated earlier than the map integrated image. The second distribution information is a control system which is a detailed analysis result for an area within the target area determined to have a difference based on the differential analysis result of the first distribution information.

17. The control system according to claim 1, a third data process for generating third distribution information from the acquired data or processed data obtained by processing the acquired data, a third distribution process for causing the third distribution information generated by the third data process to be provided to the user terminal device or the distribution system capable of distributing information to the user terminal device, further comprising: wherein the process execution command unit causes the third distribution information to be provided to the user terminal device or the distribution system by the third distribution process after the second distribution information is started to be provided to the user terminal device or the distribution system by the second distribution process.

18. The control system according to claim 17, wherein the first distribution information is a first ortho image obtained by orthorectifying an image of the target area acquired by the sensor and integrating a plurality of orthorectified images. The second distribution information is a second orthoimage with a higher resolution than the first orthoimage and corresponding to an area narrower than the first orthoimage. The third distribution information is a control system that is a third orthoimage with a higher resolution than the first orthoimage and corresponding to an area wider than the second orthoimage.

19. The control system according to claim 1, The second process including the second data process and the second distribution process is executed in parallel with at least a part of the first process including the first data process and the first distribution process. A control system.

20. The control system according to claim 1, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays the processing speed of each of the plurality of data processing units.

21. The control system according to claim 1, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates the first processing time of the first data process and the second processing time of the second data process for each of the plurality of data processing units, or displays the estimation results.

22. The control system according to claim 1, When the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays on a display device the data transmission speed in the transmission path among the flying object, the data acquisition base system, and the data processing base system.

23. The control system according to claim 1, when the data processing unit is mounted on at least one of the flying object, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that estimates or displays on a display device the first transmission time of the data used for the first data processing and the second transmission time of the data used for the second data processing in each of the plurality of transmission paths.

24. The control system according to claim 1, when the data processing unit is mounted on at least one of the flying object, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that determines or displays on a display device the combination pattern of the installation location of the data processing unit that executes the first data processing for which the first total required time including the time required for the first data processing and the time required for the first distribution processing is the shortest, and the transmission path of the data related to the first data processing.

25. The control system according to claim 1, when the data processing unit is mounted on at least one of the flying object, the data acquisition base system, and other data processing base systems, and the data processing unit is installed at multiple locations within the aviation data processing system, A control system that determines or displays on a display device the combination pattern of the installation location of the data processing unit that executes the second data processing for which the second total required time including the time required for the second data processing and the time required for the second distribution processing is the shortest, and the transmission path of the data related to the second data processing.

26. An aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing unit for processing acquired data obtained by the sensor to generate processed data, the aerial data processing system comprising: First data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; Second data processing for generating second distribution information from the acquired data or the first distribution information; First distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; Second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system; And a processing execution command unit for executing the above, The processing execution command unit: An aerial data processing system that causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution information is started to be provided to the user terminal device or the distribution system by the first distribution processing.

27. A control method using an aerial data processing system comprising an aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing unit for processing acquired data obtained by the sensor to generate processed data, the method comprising: A computer: A first data processing step of generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; A first distribution processing step of causing the first distribution information generated by the first data processing step to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; A second data processing step of generating second distribution information from the acquired data or the first distribution information; A control method that executes a second distribution processing step of causing the user terminal device or the distribution system to provide the second distribution information generated by the second data processing step after the first distribution information is started to be provided by the first distribution processing step.

Images