Work determination system, work determination method, and program

Abstract

To provide a system capable of quickly executing a series of processing for providing a result of processing aviation data acquired by an aircraft.SOLUTION: When a data processing unit is provided in at least one of a data processing base system, an aircraft, and a data acquisition base system, and when data processing units are provided at a plurality of locations in an aviation data processing system, a work determination system is configured to: display, on a display device, a plurality of candidate patterns for a data processing unit to execute data processing among the data processing units provided at the plurality of locations, or a determination result indicating that the data processing unit to execute data processing among the data processing units provided at the plurality of locations has been selected or determined; or cause the data processing unit according to the determination result to execute data processing.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a work determination system, a work determination method, and a program.

Background Art

[0002] In recent years, in abnormal situations (crisis occurrence states) where crises such as natural disasters and disasters caused by enemy aircraft attacks occur, it is required to quickly grasp wide-area information on the affected areas. Therefore, in order to quickly grasp the damage situation during disasters, practical application studies of technologies for analyzing image data obtained from the sky using aircraft and the like have been promoted. When a crisis occurs, it is required to quickly grasp the damage situation in order to quickly determine the initial actions of crisis response such as evacuation instructions and rescue. Also, immediately after a crisis occurs, it is called the ultra-acute phase or the acute phase, and the damage situation changes rapidly in a short time. Therefore, a quick update function for grasping the damage situation that can follow such short-time situation changes is required.

[0003] Patent Document 1 discloses a technique for estimating the damage situation of a building by analyzing an aerial image obtained from the sky using a pre-learned building damage estimation model.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In order to analyze the aerial acquisition data obtained by an aircraft or the like, determine the disaster situation, and provide the user, such as a crisis management headquarters, who determines crisis response measures, with the result of the disaster situation interpretation, it is necessary to execute operations such as data acquisition data analysis and data transmission in each of the aircraft, analysis device, and user terminal device located at physically different locations. Therefore, it has taken a long time from the acquisition of aerial acquisition data by the aircraft to the provision of information to the user terminal device.

[0006] The technique described in Patent Document 1 above focuses on improving the speed and interpretation accuracy of data processing alone, and the acceleration of a series of processes from the acquisition of aerial acquisition data by the aircraft to the provision of information to the user terminal device has not been sufficiently considered.

[0007] Therefore, an object of the present invention is to provide a system capable of quickly executing a series of processes until the analysis result of aerial data acquired by an aircraft is provided.

Means for Solving the Problems

[0008] According to the present invention, there is provided a work determination system for determining the content of processing work by an aerial data processing system having an aircraft equipped with a sensor for acquiring an image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing base system including a data processing unit for processing the acquisition data acquired by the sensor to generate post-data processing data. When the data processing unit is provided in at least any one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided at a plurality of locations within the aerial data processing system, the work determination system determines a plurality of candidate patterns for where to execute data processing among the data processing units provided at the plurality of locations, or displays on a display device the determination result of which of the data processing units provided at the plurality of locations is selected or determined to execute data processing, or a work determination system for causing the data processing unit corresponding to the determination result to execute data processing is obtained.

Effects of the Invention

[0009] According to the present invention, a series of processes from the acquisition of aviation acquisition data by an aircraft to the provision of information to a user terminal device can be executed quickly.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Embodiments for Carrying Out the Invention

[0011] The contents of the embodiments of the present invention will be listed and described. The present invention has the following configuration. [Item 1] An aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for transmitting a flight control command to the aircraft, and a data processing base system including a data processing unit for processing acquired data acquired by the sensor to generate processed data, a work determination system for determining the content of processing work by an aviation data processing system, When the data processing unit is provided not only in the data processing base system but also in at least one of the aircraft and the data acquisition base system, and the data processing unit is provided at a plurality of locations within the aviation data processing system, The operation determination system selects a specific pattern from a plurality of candidate patterns for where to execute data processing among the plurality of data processing units provided at a plurality of locations, displays the selection result on a display device, or executes data processing and data transmission processing according to the selection result. [Item 2] In the operation determination system according to Item 1, The operation determination system includes a required time estimation unit that determines the total time including the data processing time required for the data processing for each of the plurality of candidate patterns of the data processing unit that executes the data processing. [Item 3] In the operation determination system according to Item 1, The operation determination system selects a specific pattern from a plurality of candidate patterns of combinations of the data processing unit that executes the data processing and the transmission paths of the acquired data, displays the determination result on a display device, or executes data processing and data transmission processing according to the determination result. [Item 4] In the operation determination system according to Item 3, The operation determination system includes a required time estimation unit that determines the total time including the data processing time required for the data processing and the data transmission time required for the data transmission processing for each of the plurality of candidate patterns obtained by combining the candidates of the data processing unit that executes the data processing and the transmission paths of the acquired data. [Item 5] In the operation determination system according to Item 4, The required time estimation unit determines the data transmission time based on at least one of the data amount of the acquired data transmitted through the transmission path and the data communication speed of the transmission path. [Item 6] In the operation determination system according to Item 2 or Item 4, The required time estimation unit is a work determination system that determines the data processing time based on at least one of the amount of data of the acquired data and the analysis speed of the data processing unit that executes the data processing. [Item 7] In the work determination system according to Item 2 or Item 4, The work determination system selects, as the specific pattern, the pattern with the shortest total time calculated by the required time estimation unit from among a plurality of candidate patterns, or selects, as the specific pattern, a pattern with a shorter total time than other candidate patterns. [Item 8] In the work determination system according to Item 5, The required time estimation unit is a work determination system that determines the data communication speed based on measured values of past or current data communication speeds in each candidate of the transmission path. [Item 9] In the work determination system according to Item 5, The required time estimation unit is a work determination system that determines the data communication speed of at least one of satellite wireless communication using relay by artificial satellites, direct wireless communication, wireless communication using a mobile phone communication line, and wired communication using a wired line in each candidate of the transmission path. [Item 10] In the work determination system according to Item 9, When the required time estimation unit determines the data communication speed for each communication means using a wireless or wired line, it determines the communication speed of the section with the slowest communication speed in the communication section by the communication means as the actual data communication speed in the communication section. [Item 11] In the work determination system according to Item 9, When there are a plurality of available communication means in a certain transmission path, the required time estimation unit is a work determination system that selects the communication means determined to have the fastest data communication speed as the communication means of the transmission path. [Item 12] In the work determination system according to Item 5, The required time estimation unit determines the data transmission time including at least one of the transmission time of the acquired data transmitted through the transmission path, the transmission time of the processed data, and the transmission time of the processing data used for data processing, based on at least one of the data amount of the acquired data transmitted through the transmission path and the data communication speed of the transmission path. A work determination system. [Item 13] In the work determination system according to Item 12, The processing data is recorded in the data processing base system, When a pattern of performing the data processing by the data processing unit provided in the aircraft or the data acquisition base system is selected, the work determination system causes the data processing base system to transmit the processing data to the aircraft or the data acquisition base system. A work determination system. [Item 14] In the work determination system according to Item 6, When the required time estimation unit determines the processing speed of data processing in a plurality of the data processing units, the required time estimation unit determines the processing speed based on a measured value of the data processing unit in the past or present, or information on the processing speed acquired in advance. A work determination system. [Item 15] In the work determination system according to Item 6, When the required time estimation unit determines the processing speed of data processing in a plurality of the data processing units, the required time estimation unit determines the actual analysis speed based on the status of data processing tasks being executed or scheduled to be executed in the plurality of data processing units. A work determination system. [Item 16] In the work determination system according to Item 4, When the aircraft includes the data processing unit, The required time estimation unit determines the total time according to the parallel operation time in which at least a part of the sensing operation of acquiring the image or point cloud information by the sensor of the aircraft and the operation of data processing by the data processing unit of the aircraft are executed in parallel. A work determination system. [Item 17] In the work determination system according to Item 4, when the data acquisition base system includes the data processing unit, the total time is determined by the required time estimation unit according to the parallel operation time in which at least part of the processing operation in which the data acquisition base system receives the acquired data from the aircraft and the data processing operation by the data processing unit of the data acquisition base system are executed in parallel. A work determination system. [Item 18] In the work determination system according to Item 4, the total time is determined by the required time estimation unit according to the parallel operation time in which at least part of the processing operation in which the data processing base system receives the acquired data from the aircraft or the data acquisition base system and the data processing operation by the data processing unit of the data processing base system are executed in parallel. A work determination system. [Item 19] In the work determination system according to Item 4, the total time is determined by the required time estimation unit according to the parallel operation time in which at least part of the sensing operation of acquiring the image or point cloud information by the sensor of the aircraft and the processing operation of transmitting the acquired data from the aircraft to the data acquisition base system or the data processing base system are executed in parallel. A work determination system. [Item 20] In the work determination system according to Item 4, the total time is determined by the required time estimation unit according to the parallel operation time in which at least part of the processing operation in which the data acquisition base system receives the acquired data from the aircraft and the processing operation of transmitting the acquired data from the data acquisition base system to the data processing base system are executed in parallel. A work determination system. [Item 21] In the work determination system according to Item 4, when the aircraft includes the data processing unit, The required time estimation unit is a work determination system that determines the total time according to the parallel operation time in which at least part of the operation of the data processing by the data processing unit of the aircraft and the processing operation of transmitting the data processing unit from the aircraft to the outside are executed in parallel. [Item 22] In the work determination system according to Item 4, When the data acquisition base system includes the data processing unit, The required time estimation unit is a work determination system that determines the total time according to the parallel operation time in which at least part of the operation of the data processing by the data processing unit of the data acquisition base system and the processing operation of transmitting the data processing unit from the data acquisition base system to the outside are executed in parallel. [Item 23] In the work determination system according to Item 4, The required time estimation unit is a work determination system that determines the total time according to the parallel operation time in which at least part of the operation of the data processing by the data processing unit of the data processing base system and the processing operation of transmitting the data processing unit from the data processing base system to the outside are executed in parallel. [Item 24] In the work determination system according to Item 2, When a part of the data processing is shared and implemented between the data processing unit of the data processing base system and the data processing unit provided in the aircraft or the data acquisition base system, a plurality of candidates for the data processing sharing pattern are generated. The required time estimation unit is a work determination system that determines the total time in the plurality of candidates for the data processing sharing pattern. [Item 25] In the work determination system according to Item 1, The data processing includes a display adjustment process for adjusting the display when the processed data is displayed on the user terminal device. [Item 26] In the work determination system according to Item 2 or Item 4, An operation determination system that predicts the total amount of acquisition data or selects a specific pattern from a plurality of candidate patterns before the start of or before the completion of the acquisition process of the image or point cloud information of the target area by the aircraft. [Item 27] In the operation determination system according to Item 26, When the operation determination system predicts the total amount of acquisition data, the total amount of acquisition data is predicted based on data sensing conditions including at least any one of the sensing range by the aircraft, the planned flight route, the planned flight time, the type of the sensor, and the resolution of the image which is the acquisition data. [Item 28] In the operation determination system according to Item 5, After the operation determination system selects and determines a specific pattern from the plurality of candidate patterns, based on the measured value of the data communication speed of the transmission path updated after the selection determination, the operation determination system re - performs at least any one of the determination of the data transmission time, the determination of the total time, or the selection determination of the specific pattern from the plurality of candidate patterns. [Item 29] A computer Obtaining information of a target area by an aircraft equipped with a sensor for obtaining an image or point cloud information of the target area; Performing flight control of the aircraft by a data acquisition base system that transmits a flight control command to the aircraft; Processing the acquisition data acquired by the sensor by a data processing base system including a data processing unit; In addition to the data processing base system, when a data processing unit is provided in at least any one of the aircraft and the data acquisition base system and the data processing unit is provided at a plurality of locations, selecting a specific pattern from a plurality of candidate patterns as to where to execute data processing among the data processing units provided at the plurality of locations; Displaying the selection result on a display device or executing data processing and data transmission processing according to the selection result; A work determination method for execution. [Item 30] On a computer, A step of acquiring information on a target area by an aircraft equipped with a sensor for acquiring an image or point cloud information of the target area; A step of controlling the flight of the aircraft by a data acquisition base system that transmits a flight control command to the aircraft; A step of processing acquired data acquired by the sensor by a data processing base system including a data processing unit; In addition to the data processing base system, when a data processing unit is provided in at least one of the aircraft and the data acquisition base system and the data processing unit is provided at a plurality of locations, a specific pattern is selected from a plurality of candidate patterns as to where to execute data processing by the data processing units provided at the plurality of locations; A step of displaying the selection result on a display device or executing data processing and data transmission processing according to the selection result; A program for causing execution.

[0012] <A. First Embodiment> Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted. Further, the embodiments shown below are merely examples, and other known elements and alternative means can be adopted according to the use, purpose, scale, etc.

[0013] [A-1. Configuration] (A-1-1. Overview) FIG. 1 is an overall configuration diagram of an aerial data processing system 1 (hereinafter also referred to as "this system 1") according to an embodiment of the present invention. As shown in FIG. 1, this system includes an aircraft 1000, a data acquisition base system 2000, a data processing base system 3000, and a distribution system 4000.

[0014] The aircraft 1000 uses sensors such as an optical camera, an infrared camera, and a laser sensor such as LiDAR to obtain information on the disaster area from the air and acquires the acquired data. The data acquisition base system 2000 is a base equipped with a remote control device that communicates with the aircraft when the aircraft is an unmanned aircraft, and is configured as a movable vehicle type or an immovable fixed type base. The data processing base system 3000 is a system that acquires the acquired data obtained by the aircraft, performs data processing, and generates processed data. The distribution system 4000 acquires the processed data and distributes the processed data to user terminal devices including the crisis management headquarters terminal via the Internet line. The crisis management headquarters terminal, which is an example of a user terminal device, is a terminal device used by a user such as a person in charge of the crisis management headquarters. By accessing the distribution system from the crisis management headquarters terminal, the processed data can be viewed.

[0015] The data processing unit that performs data processing on the acquired data can be implemented not only in the data processing base system 3000 but also in the data acquisition base system 2000 and the aircraft 1000. Therefore, the aviation data processing system 1 determines which data processing unit among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 will execute the data processing according to the situation. Note that the data processing executed in each data processing unit may include Web optimization processing for processing the processed data so that the processed data displayed on the user terminal device via the Internet line from the distribution system is easily viewable by the user.

[0016] Here, when data processing is performed by the data processing unit mounted on the aircraft 1000, in the aircraft 1000, sensing processing is performed to generate acquired data, and data processing is performed to generate processed data. The processed data is transmitted directly from the aircraft 1000 to the distribution system, or transmitted to the distribution system 4000 via the data acquisition base system 2000 or the data processing base system 3000.

[0017] Next, when data processing is performed by the data processing unit mounted on the data acquisition base system 2000, in the aircraft 1000, sensing processing is performed to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data acquisition base system 2000. The data acquisition base system 2000 performs data processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0018] Finally, when data processing is performed by the data processing unit mounted on the data processing base system 3000, in the aircraft 1000, sensing processing is performed to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data processing base system 3000. Here, the transmission of the acquired data may be directly transmitted from the aircraft 1000 to the data processing base system 3000, or may be transmitted to the data processing base system 3000 via the data acquisition base system 2000. The data processing base system 3000 performs data processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0019] Note that in the above-described example, an embodiment in which the processed data is distributed to the user terminal device via the distribution system is shown. However, the processed data can also be directly sent from the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 to the user terminal device without passing through the distribution system.

[0020] (A-1-2. Aircraft 1000) FIG. 2 is a functional configuration diagram of an aircraft according to an embodiment of the present invention. The aircraft 1000 is a system that constitutes an aircraft, and includes a flight unit 1100 having a flight function, a sensing unit 1200 that performs sensing by sensors, a communication unit 1300 that communicates with other subsystems (data acquisition base system, data processing base system, distribution system, etc.) in the aircraft data processing system 1, a state determination unit 1400 that determines each state of flight, sensing, and positioning, a data processing unit 1500 that executes data processing, and a data recording unit 1600 that records acquired data and the like.

[0021] In this specification, the term "aircraft" refers to all flying objects having the function of autonomously controlling their attitude, regardless of the power means (such as electricity, prime mover, etc.), the control method (whether wireless or wired, and whether fully autonomous flight type or partially manually controlled type, etc.), and whether manned or unmanned. An aircraft may also be referred to as an unmanned aerial vehicle (UAV), a flying object, a multi-copter, an RPAS (Remote Piloted Aircraft Systems), or a UAS (Unmanned Aircraft Systems), etc. Further, the aircraft may be of any of a fixed-wing type having a fixed wing, a multi-copter type having a plurality of propellers, or a VTOL type having both a fixed wing and a plurality of propellers.

[0022] (A-1-2―1. Flight unit 1100) The flight unit 1100 includes a self-position / velocity determination unit 1110, an attitude determination unit 1120, and a flight control unit 1130.

[0023] The self-position / velocity determination unit 1110 has the function of determining the position and velocity of the aircraft 1000. For example, based on satellite signals received from artificial satellites by a satellite signal antenna mounted on the aircraft using GPS (Global Positioning System), GNSS (Global Navigation Satellite System), etc., the position (absolute position) of the aircraft body is measured. Also, for the determination of the self-position and velocity, for example, RTK-GNSS (Real Time Kinematic - Global Navigation Satellite System) can also be used. The position information includes at least two-dimensional coordinate information (such as latitude and longitude) in a plan view, and preferably includes three-dimensional coordinate information including altitude information.

[0024] Next, the attitude determination unit 1120 has a function of determining the attitude (azimuth) of the aircraft 1000. Specifically, the attitude of the aircraft is determined by a GPS compass composed of a pair of satellite antennas mounted on the aircraft, or a geomagnetic sensor or the like.

[0025] Next, the flight control unit 1130 has a processing unit also called a flight controller. The processing unit can have one or more processors such as a programmable processor (for example, a central processing unit (CPU), MPU, or DSP). The processing unit is accessible to a memory (storage unit). The memory stores logic, code, and / or program instructions executable by the processing unit to perform one or more steps.

[0026] The processing unit has a function of controlling the flight state of the aircraft by controlling the output of the thrust generating device. Specifically, the thrust generated from the propeller is controlled by a propeller, a motor that drives the propeller, and a motor control unit that controls the motor output, to adjust the spatial arrangement, attitude angle, angular velocity, angular acceleration, angular jerk velocity, and / or acceleration of an aircraft having six degrees of freedom (translational motions x, y, and z, and rotational motions θx, θy, and θz). That is, the flight control unit 1130 causes the aircraft to perform operations such as takeoff, forward movement, turning, and landing, and controls the attitude angle control and flight operations of the aircraft from takeoff to in-flight and landing, to control the flight state of the aircraft.

[0027] (A-1-2-2. Sensing unit 1200) The sensing unit 1200 includes a sensor 1210, a sensor attitude control unit 1220, and a sensor control unit 1230.

[0028] The sensor 1210 is composed of, for example, an optical camera that acquires an optical image, an infrared camera that acquires an infrared image, a laser sensor such as a LiDAR that acquires point cloud data, etc. The sensor acquires an optical image, an infrared image, point cloud data, etc. of the ground surface of the disaster area from above the disaster area as acquired data.

[0029] The sensor attitude control unit 1220 controls the relative angle of the sensor with respect to the airframe of the aircraft. For example, it controls at least one of the angles around the three axes of the gimbal provided between the sensor and the airframe to support the sensor, thereby controlling the relative angle of the sensor with respect to the airframe.

[0030] The sensor control unit 1230 has a function of changing the timing of sensing execution and measurement parameters by the sensor 1210. For example, when the sensor is an optical camera, it controls the image acquisition timing, shutter speed, resolution, etc.

[0031] (A-1-2―3. Communication Unit 1300) The communication unit 1300 includes a control communication unit 1310, a data communication unit 1320, and a status data communication unit 1330. Also, the communication unit 1300 is capable of radio communication via the communication network NW and includes, for example, a radio communication module. The communication unit 1300 can communicate with a data acquisition base system, a data processing base system, a distribution system, etc. via the communication network NW. The communication unit 1300 has a communication function for performing wireless communication with a data acquisition base system, a data processing base system, a distribution system, etc. using, for example, wireless communication in frequency bands such as Wi-Fi, 2.4 GHz, and 5.6 - 5.8 GHz. Also, the communication unit 1300 has a wireless communication function capable of communicating with a data acquisition base system, a data processing base system, a distribution system, etc. via the communication network NW using a communication standard such as LTE (Long Term Evolution).

[0032] The control communication unit 1310 performs communication related to flight control of the aircraft that is exchanged between the aircraft 1000 and the data acquisition base system 2000. For example, when the aircraft is an unmanned aircraft and is remotely controlled from the data acquisition base system, the control communication unit 1310 receives a flight control command transmitted from the data acquisition base system to the aircraft. Also, the control communication unit 1310 transmits information related to the flight state of the aircraft, including the position, speed, and attitude of the airframe determined by the flight unit 1100, from the aircraft to the data acquisition base system.

[0033] The data communication unit 1320 transmits the acquired data obtained by the sensing unit 1200 to a data acquisition base system, a data processing base system, a distribution system, or the like. Also, when the data analysis is performed by the data processing unit 1500 described later, the data communication unit 1320 transmits the processed data generated by the data processing unit 1500 to a distribution system or the like. That is, the data communication unit 1320 transmits the acquired data obtained by the sensing unit 1200 or the processed data obtained by analyzing the acquired data to the outside of the aircraft.

[0034] The state data communication unit 1330 transmits the determination results of the flight state, the sensing state, and the communication state determined by the state determination unit 1400 described later to the data acquisition base system. In particular, it transmits the determination result of the communication speed determined by the communication state determination unit 1430 to the data acquisition base system.

[0035] (A-1-2―4. State determination unit 1400) The state determination unit 1400 includes a flight state determination unit 1410, a sensing state determination unit 1420, and a communication state determination unit 1430.

[0036] The flight state determination unit 1410 determines that there is a flight abnormality when the position, speed, or attitude of the aircraft determined by the self-position / speed determination unit 1110 or the attitude of the aircraft determined by the attitude determination unit 1120 deviates from a preset normal range. Also, even when the position, speed, and attitude do not deviate from the normal range, if at least one of the position, speed, and attitude does not normally follow the control command value by the flight control unit 1130, it is also determined that there is a flight abnormality.

[0037] The sensing state determination unit 1420 determines that there is a sensing abnormality when the acquired data is not acquired by the sensor 1210 of the sensing unit 120 or when an abnormality is found in the acquired data. Also, it may be determined that there is a sensing abnormality when the sensor attitude control unit 1220 does not operate correctly with respect to the control command value.

[0038] The communication status determination unit 1430 determines the communication status between the aircraft and the external (such as the data acquisition base system, the data processing base system, or the distribution system, etc.) by the communication unit 1300. Specifically, the communication status to be determined is the communication speed (such as bps), and may include the communication strength (such as dB) in addition to the communication speed. The communication status determination unit 1430 particularly determines the data communication speed of the acquired data or the post-processed data by the data communication unit 1320.

[0039] (A-1-2―5. Data Processing Unit 1500) When the data processing unit 1500 is determined by the work determination system 2300 to perform data processing within the aircraft, the data processing unit 1500 processes the acquired data acquired by the sensing unit 1200. The data processing unit 1500 is configured by, for example, a workstation so as to be able to execute data processing with a relatively large processing load.

[0040] Figure 7 is a table showing variations in data processing in the aircraft data processing system. In the data processing unit 1500, it is possible to execute various data processing as shown in the table T101 of Figure 7. The content of each data processing shown in the table T101 is as follows. · Identification No. 001: A process of acquiring a plurality of optical images as acquired data, performing orthoimage conversion on the acquired plurality of optical images, and generating an orthoimage by integrating the plurality of orthoimages. · Identification No. 002: A process of acquiring a plurality of optical images as acquired data and generating three-dimensional spatial data from the plurality of optical images using SfM (Structure from Motion) processing. · Identification No. 003: A process of acquiring point cloud data as acquired data and generating three-dimensional spatial data by DSM (Digital Surface Model) or DEM (Digital Elevation Model) from the point cloud data. · Identification No. 004: A process of performing the orthoimage generation process shown in No. 001, acquiring geographical data as processing data, and generating map integration data by integrating the orthoimage and the geographical data. · Identification No. 005: A process of performing the map integration image generation process shown in No. 004, obtaining a past map integration image as processing data, and performing a differential analysis of the current and past map integration images. · Identification No. 006: A process of performing the orthoimage generation process shown in No. 001, obtaining disaster information as processing data, and generating a disaster information integrated image by integrating the orthoimage and the disaster information. · Identification No. 007: A process of performing the orthoimage generation process shown in No. 001, obtaining on-site team information as processing data, and generating an on-site team information integrated image by integrating the orthoimage and the on-site team information. · Identification No. 008: A process of performing any one of the processes of No. 001 to 007, and performing a Web optimization process of processing the processed data so as to optimize the display screen on the display screen of the user terminal device to generate Web-optimized data.

[0041] Note that the data processing executed in the data processing unit 1500 may include a Web optimization process of generating Web-optimized data by processing the processed data so that the processed data displayed on the user terminal device via the Internet line from the distribution system is easily visible to the user on the display screen of the user terminal device, as described in the data processing of Identification No. 008.

[0042] (A-1-2―6. Data recording unit 1600) The data recording unit 1600 includes an acquired data recording unit 1610, a processed data recording unit 1620, and a communication state recording unit 1630. The data recording unit 1600 is constituted by a storage device such as a RAM or a ROM.

[0043] The acquired data recording unit 1610 records the acquired data acquired by the sensing unit 1200. The recorded acquired data is transmitted by the data communication unit 1320 to a data acquisition base system, a data processing base system, a distribution system, or the like.

[0044] The post - processing data recording unit 1620 records the post - processing data generated by the data processing unit 1500. The recorded post - processing data is transmitted by the data communication unit 1320 to a distribution system or the like.

[0045] The communication state recording unit 1630 records information on the communication speed and communication strength determined by the communication state determination unit 1430. The recorded information on the communication speed and communication strength is transmitted by the state data communication unit 1330 to the data acquisition base system.

[0046] (A - 1 - 3. Data Acquisition Base System 2000) FIG. 3 is a configuration diagram of a data acquisition base system according to an embodiment of the present invention. The data acquisition base system includes a communication infrastructure management system 2100, an aircraft operation control system 2200, a work determination system 2300, a data processing unit 2400, an operation management system 2500, and an airspace monitoring system 2600.

[0047] When the aircraft is an unmanned aircraft, the data acquisition base system 2000 is a system that exchanges control information regarding the aircraft, flight unit, and sensing unit, enabling remote control or data acquisition work by an operator (user) who uses the data acquisition base system. On the other hand, when the aircraft is a manned aircraft, the data acquisition base system 2000 is a system that exchanges control information and aircraft state information regarding the aircraft, flight unit, and sensing unit, assisting the data acquisition work by the aircraft. Also, the data acquisition base system may be composed of movable vehicles, ships, flying objects, etc., or may be composed of immovable buildings (fixed type) that do not move.

[0048] The communication infrastructure management system 2100 is a system that manages the communication means for data (acquired data or processed data) and control communication information transmitted and received between the data acquisition base system 2000, the aircraft 1000, the data processing base system 3000, and the distribution system 4000. The communication infrastructure management system 2100 transmits, for example, information generated by the aircraft operation control system 2200 and the work determination system 2300, which will be described later, to the aircraft 1000. Also, the communication infrastructure management system 2100 monitors the communication speed in addition to the communication availability of the existing infrastructure, and executes data transmission and reception according to the processing means determined by the work determination system, which will be described later, and the communication means for data transmission. The transmission process may be, for example, parallel transmission or switching transmission. Further, when the communication infrastructure management system 2100 determines, based on the work determination system 2300, that it is appropriate to transmit data by physically transporting a memory by a person, it may display this fact on an appropriate display unit and request the administrator to physically transport the memory.

[0049] The aircraft operation control system 2200 is a system that generates a mission for the aircraft to be controlled and controls the movement of the aircraft. The mission is, for example, a movement plan including the movement route and movement speed of the aircraft 1000. The movement route is generated, for example, in an airspace below an altitude of 150 m in order to avoid interference with, for example, a passenger aircraft in advance. The aircraft operation control system 2200 transmits a control signal to the aircraft 1000 via the communication infrastructure management system 2100 in order to automatically operate the aircraft.

[0050] The operation management system 2500 is a system that makes decisions and gives instructions for the operation of the aircraft 1000. The operation management system 2500 formulates a plan regarding the operations of the aircraft 1000, including, for example, sensing and flight, and transmits it to the aircraft 1000 via the communication infrastructure management system 2100. Further, the operation management system 2500 may determine the priority of the operations that require processing and transmit it to the aircraft 1000. The operation management system 2500 may formulate plans for a plurality of aircraft 1000 and transmit the information of the respective plans to each aircraft 1000.

[0051] The airspace monitoring system 2600 is a system that monitors the airspace in which the aircraft 1000 to be controlled is flying. The airspace monitoring system 2600 acquires information from an existing air traffic control system. The air traffic control system may be, for example, a drone operation management system (UTM), an operation management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace monitoring system 2600 measures or acquires information on the environment and other aircraft in the airspace in which the aircraft 1000 is flying and transmits the information to the operation management system 2500. Based on the information from the airspace monitoring system 2600, the operation management system 2500 changes the operation plan if there is a problem with the operation plan of the aircraft 1000.

[0052] The operation determination system 2300 determines the processing means for the acquired data acquired by the aircraft 1000. Since the amount of acquired data is enormous, unless the transmission path and data processing of the acquired data are appropriately determined, the total time until the processed data is provided to the user terminal device cannot be shortened. Therefore, the operation determination system 2300 determines the processing means that shortens the total time until the processed data is provided to the user terminal device, and transmits the determination result to the aircraft 1000, the data processing base system 3000, and the distribution system 4000 via the communication infrastructure management system 2100. The detailed functions of the operation determination system 2300 will be described later.

[0053] When the work determination system 2300 determines that data processing is to be performed within the data acquisition base system, the data processing unit 2400 processes the acquired data obtained by the aircraft 1000. The data processing unit 2400 is configured by, for example, a workstation or the like so as to be able to execute data processing with a relatively large processing load. A specific example of the data processing executed here is the same as the specific example of the data processing described in the description of the data processing unit 1500.

[0054] (A-1-4. Data Processing Base System 3000) FIG. 4 is a configuration diagram of a data processing base system according to an embodiment of the present invention. The data processing base system includes a communication unit 3100 and a data processing unit 3200.

[0055] The communication unit 3100 transmits and receives data (acquired data or processed data) between the data processing base system 3000 and external systems (the aircraft 1000, the data acquisition base system 2000, and the distribution system 4000). The communication unit 3100 receives acquired data from, for example, the aircraft 1000 or the data acquisition base system 2000. Further, the processed data generated in the data processing base system 3000 is transmitted to the distribution system 4000.

[0056] When the work determination system 2300 determines that data processing is to be performed within the data processing base system, the data processing unit 3200 acquires the acquired data obtained by the aircraft 1000 via the communication unit 3100 and executes data processing.

[0057] (A-1-5. Distribution System 4000) FIG. 5 is a configuration diagram of a distribution system according to an embodiment of the present invention. The distribution system 4000 includes a communication unit 4100 and a distribution data management unit 4200.

[0058] The communication unit 4100 receives the processed data from any one of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. The received processed data may be the data after the Web optimization process is performed in the data processing implemented in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Also, the communication unit 4100 distributes the processed data to user terminal devices including the crisis management headquarters terminal via the Internet line.

[0059] The distribution data management unit 4200 records the processed data received via the communication unit 4100, and distributes the latest processed data recorded in the distribution data management unit 4200 to user terminal devices including the crisis management headquarters terminal that accesses via the Internet line.

[0060] (A-1-6. Work determination system 2300) FIG. 6 is a functional configuration diagram of a work determination system according to an embodiment of the present invention. The work determination system 2300 includes an acquired data amount estimation unit 2310, a data processing execution location candidate generation unit 2320, a required time estimation unit 2330, a processing means determination unit 2340, a processing means determination unit 2350, and a processing execution command unit 2360.

[0061] (A-1-6-1. Acquired data amount estimation unit 2310) The acquired data volume estimation unit 2310 predicts the total volume of the acquired data (defined in, for example, gigabytes, terabytes, etc.) before starting the sensing process by the aircraft or at least before the sensing process is completed. The total volume of the acquired data can be predicted based on data sensing conditions such as information regarding the sensing range, the type of sensor and setting parameters regarding the data volume per unit area. Here, the information regarding the sensing range can be defined, for example, based on the planned flight route of the aircraft, the planned flight time, the sensing target range on the ground surface, or the range of the planned flight airspace. Also, the type of sensor includes, for example, an optical camera, an infrared camera, a laser sensor including LiDAR. The setting parameters are defined by, for example, the resolution of the acquired image and the point cloud density of the point cloud data. Note that the information on the estimated total data volume may be displayed on a display device.

[0062] (A-1-6-2. Data processing execution location candidate generation unit 2320) The data processing execution location candidate generation unit 2320 identifies the systems among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, which are each a subsystem constituting the aviation data processing system 1, and which are equipped with a data processing unit capable of performing data processing. For example, the data processing execution location candidate generation unit 2320 may communicate with the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 to obtain information regarding the presence or absence of a data processing unit, or may obtain information regarding the presence or absence of a data processing unit pre-recorded in the acquired data volume estimation unit 2310.

[0063] In addition, the data processing location candidate generation unit 2320 grasps the variations in the transmission paths among the aircraft 1000, data acquisition base system 2000, data processing base system 3000, and distribution system 4000, which are the respective subsystems constituting the aviation data processing system 1. Specifically, it grasps the variations in the transmission paths through which the acquired data and the processed data are transmitted, from when the acquired data obtained by the aircraft 1000 is processed by any of the subsystems until the processed data is transmitted to the distribution system. This transmission path variation information may be pre-recorded in the acquired data amount estimation unit 2310, or the data processing location candidate generation unit 2320 may generate the communication path variations based on the information regarding the presence or absence of the data processing unit.

[0064] Here, there may be an embodiment in which the processed data is directly transmitted to the user terminal device without passing through the distribution system. In that case, it grasps the variations in the transmission paths through which the acquired data and the processed data are transmitted, from when the acquired data obtained by the aircraft 1000 is processed by any of the subsystems until the processed data is transmitted to the user terminal device.

[0065] FIG. 8 is a table showing an example of the patterns of data transmission paths and data processing locations in the aviation data processing system. In the example shown in the table T102 of FIG. 8, when the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 each have a data processing unit, it shows the patterns of the processing methods that combine the variations in the locations where data analysis is executed (described as "data analysis implementation location" in the table) and the variations in the data transmission paths among the respective systems. The data processing location candidate generation unit 2320 generates the pattern information of the locations where data analysis is executed and the transmission paths as shown in the table T102 of FIG. 8.

[0066] In Table T102, A01, A02-1, A02-2, and A03 show patterns when the data analysis execution location is inside the aircraft. Also, A01 shows a pattern where the processed data is transmitted directly from the aircraft to the distribution system. Both A02-1 and A02-2 show patterns where the processed data is transmitted from the aircraft to the distribution system via the data acquisition base system. In particular, for A02-1, the transmission of the processed data from the aircraft to the data acquisition base system is performed by wireless communication, while for A02-2, the transmission of the processed data from the aircraft to the data acquisition base system is by physical movement of the memory device, that is, the aircraft lands and the memory installed in the aircraft is physically brought into the data acquisition base system. A03 shows a pattern where the processed data is transmitted from the aircraft to the distribution system via the data processing base system.

[0067] In Table T102, P01, P02-1, P02-2, and P02-3 show patterns when the data analysis execution location is inside the data processing base system. P01 shows a pattern where the acquired data is transmitted from the aircraft directly to the data processing base system by communication. P02-1, P02-2, and P02-3 all show patterns where the acquired data is transmitted to the data processing base system via the data acquisition base system. P02-1 shows a pattern where both the transmission from the aircraft to the data acquisition base system and the transmission from the data acquisition base system to the data processing base system are by communication. P02-2 shows a pattern where the method of transmitting the acquired data from the aircraft to the data acquisition base system is by physical movement of the memory device. P02-3 shows a pattern where both the transmission from the aircraft to the data acquisition base system and the transmission from the data acquisition base system to the data processing base system are by physical movement of the memory device.

[0068] In Table T102, C01-1 and C01-2 indicate patterns when the data analysis execution location is within the data acquisition base system. C01-1 is a pattern in which the transmission of acquired data from the aircraft to the data acquisition base system is performed by communication, while C01-2 is a pattern in which the transmission of acquired data from the aircraft to the data acquisition base system is performed by physical movement of the memory device.

[0069] (A-1-6―3. Required Time Estimation Unit 2330) The required time estimation unit 2330 estimates the total required time until the acquired data obtained by the aircraft 1000 is data-processed by any subsystem and the processed data is transmitted to the distribution system (or user terminal device). The required time estimation unit 2330 includes a communication speed determination unit 2331, a data processing speed determination unit 2332, and a total time estimation unit 2333.

[0070] (A-1-6―3―1. Communication Speed Determination Unit 2331) The communication speed determination unit 2331 grasps the communication speed for each of the plurality of communication means in each transmission path grasped by the data processing execution location candidate generation unit 2320. Further, the communication means with the fastest communication speed among the plurality of communication means is determined. The communication speed is grasped, for example, by acquiring information measured by the communication state determination unit 1430 of the aircraft 1000 or the communication infrastructure management system. Note that it is desirable that the communication speed be grasped based on the measured value of the communication speed at the current time, but it may also be grasped based on the measured value of the communication speed measured in the past.

[0071] FIG. 9 is a table showing an example of the communication speed of communication means for each data transmission path in an aviation data processing system. For example, as shown in table T103 of FIG. 9, in the transmission path from aircraft 1000 to data acquisition base system 2000, direct wireless communication using radio waves in the 2.4 GHz band etc. (described as "direct 2.4G" in the table), satellite communication using relay by artificial satellite (described as "satellite relay" in the table), wireless communication using a mobile phone communication line such as LTE (Long Term Evolution) (described as "mobile phone communication line (LTE)" in the table), these three types of communication means are conceivable. Therefore, communication speed determination unit 2331 grasps the communication speed for each of these communication means. The estimated information on the communication speed shown in FIG. 9 may be displayed on the display device of the work determination system.

[0072] In the example shown in table T103 of FIG. 9, further, the communication speeds of satellite relay and mobile phone communication line (LTE) are grasped as communication means in the transmission path from aircraft 1000 to data processing base system 3000, the communication speeds of satellite relay and mobile phone communication line (LTE) are grasped as communication means in the transmission path from aircraft 1000 to distribution system 4000, the communication speed of mobile phone communication line (LTE) is grasped as communication means in the transmission path from data acquisition base system 2000 to data processing base system 3000, the communication speed of mobile phone communication line (LTE) is grasped as communication means in the transmission path from data acquisition base system 2000 to distribution system 4000, and the communication speed of a wired line is grasped as communication means in the transmission path from data processing base system 3000 to distribution system 4000.

[0073] In the example shown in table T103 of FIG. 9, an example using four types of communication means, direct 2.4G, satellite relay, mobile phone communication line (LTE), and wired line, is shown, but the communication means is not limited to this, and it is also possible to use other mobile phone communication lines such as 4G and 5G, or Wi-Fi lines.

[0074] When determining the communication speed, if communication means passing through multiple devices such as satellite communication are used, the communication speed between each device is measured, and the slowest communication speed within the communication path is taken as the actual communication speed. For example, when satellite communication is used as the communication means for the transmission path from an aircraft to a data acquisition base system, the communication speed from the aircraft to the artificial satellite and from the artificial satellite to the data acquisition base system is measured, and the slower of the two communication speeds is determined as the actual communication speed of the satellite communication.

[0075] (A-1-6―3―2. Data Processing Speed Determination Unit 2332) The data processing speed determination unit 2332 determines the processing speed of data processing for each subsystem (aircraft 1000, data acquisition base system 2000, data processing base system 3000) that can perform the data processing grasped by the data processing execution location candidate generation unit 2320. Here, the processing speed of data processing may be determined by measuring the processing speed when data processing is actually performed in each system, or may be determined based on the rated processing speed grasped in advance.

[0076] Note that in any of the data processing units of the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000, if there is a data processing task that is currently being executed, the actual processing speed may be calculated based on the progress status or the scheduled completion time of the data processing task being executed. Alternatively, if there is a data processing task scheduled to be executed in the future in the data processing unit, the actual processing speed may be calculated based on the time required until the completion of the data processing task or the scheduled completion time.

[0077] FIG. 10 is a table showing an example of data processing speeds in each subsystem constituting the aircraft data processing system. For example, as shown in table T104 of FIG. 10, the analysis speeds of each data processing unit installed in aircraft 1000, data acquisition base system 2000, and data processing base system 3000 are determined. In the example shown in T104, the analysis speed of each data processing unit is 4 GHz for the data processing unit of the aircraft, 8 GHz for the data processing unit of the data acquisition base system, and 24 GHz for the data processing unit of the data processing base system. The estimated communication speed information shown in FIG. 10 may be displayed on the display device of the work determination system.

[0078] (A-1-6―3―3. Total time estimation unit 2333) The total time estimation unit 2333 estimates the data transmission time and the data processing time for each pattern of the data analysis execution location and the transmission path generated by the data processing execution location candidate generation unit 2320, and estimates the total time considering the data transmission time and the data processing time.

[0079] First, a method for estimating the data processing time in the pattern of the data analysis execution location will be described. The total time estimation unit 2333 estimates the data processing time in each data processing unit installed in aircraft 1000, data acquisition base system 2000, and data processing base system 3000 based on both or at least one of the information on the amount of acquired data estimated by the acquired data amount estimation unit 2310 and the information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2332.

[0080] Here, as shown in table T101 of FIG. 7, since there are multiple patterns in the data processing executed by the data processing unit, when estimating the data processing time, in addition to the information on the amount of acquired data and the analysis speed of each data processing unit as described above, based on the content of the data processing, the data processing time in each data processing unit installed in aircraft 1000, data acquisition base system 2000, and data processing base system 3000 may be estimated.

[0081] In the example shown in Table T104 of FIG. 10, since the analysis speed of the data processing unit of the data processing base system is higher than that of the data processing units in other aircraft 1000 and the data acquisition base system, the data processing time is the shortest for the data processing base system, followed by the data acquisition base system, and the longest for the aircraft.

[0082] Next, a method for estimating the transmission time in each pattern of the data transmission path will be described. The total time estimation unit 2333 estimates the transmission time of the acquired data in each transmission path based on both or at least one of the information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2310 and the information on the communication speed for each transmission path determined by the communication speed determination unit 2331. In addition, since the data to be transmitted includes processed data and processing data in addition to the acquired data, the transmission time required for each data transmission of the processed data and the processing data is also estimated.

[0083] The transmission time of the processed data is estimated by estimating the data amount of the processed data from the data amount of the acquired data and based on the information on the communication speed for each transmission path of the processed data, and estimating the transmission time of the processed data in each transmission path.

[0084] Also, when the data processing content is data processing that requires processing data as shown in Nos. 004 to 008 of Table T101, the processing data recorded in the processing data recording unit 3300 of the data processing base system is transmitted to the data processing unit that executes the data processing. Therefore, based on the data amount of the processing data recorded in the processing data recording unit 3300 in advance and the information on the communication speed for each transmission path of the processing data, the transmission time of the processing data in each transmission path is estimated.

[0085] Here, since the acquired data is sensed image or point cloud data, the data amount is larger than that of the processed data. For example, the data amount of the processed data is about 1 / 10 of that of the acquired data. Also, although it varies depending on the analysis content shown in Table T101, the data amount of the processing data is equal to or less than that of the processed data.

[0086] Next, a method for estimating the total time by the total time estimation unit 2333 considering the data transmission time and data processing time estimated by the above-described method will be described. First, for each pattern of the processing means shown in Table T102, the total time can be estimated by adding the transmission time and the data processing time. When a part of the data transmission and data processing is not executed in parallel or the parallel processing time is short, it is desirable to adopt this estimation method.

[0087] On the other hand, when a part of each process from data sensing to the transmission of processed data to the user terminal device is executed in parallel, it is desirable to estimate the total time in consideration of the processes executed in parallel. Therefore, a method for estimating the total time when estimating the total time in consideration of the processes executed in parallel will be described below.

[0088] The processes to be considered for calculating the total time are sensing processing, transmission processing of acquired data, data processing, and transmission processing of processed data, and some of the processes performed in sequence before and after can be executed in parallel. Details will be described separately for each pattern below.

[0089] [Parallel processing of sensing processing and data processing / When performing data processing on an aircraft] As shown in A01, A02-1, A02-2, and A03 in Table T102, in the pattern of performing data processing on the aircraft 1000, it is possible to execute in parallel a part of the sensing processing by the aircraft and the data processing by the aircraft. Therefore, the time during which the sensing processing and the data processing can be executed in parallel is obtained, and the total time is calculated by subtracting the parallel executable time from the data processing time by the aircraft. Note that the time during which the sensing processing and the data processing can be executed in parallel may be obtained using information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the amount of acquired data estimated by the acquired data amount estimation unit 2310.

[0090] [Parallel Processing of Sensing and Transmission Processing / When Performing Data Processing in a Data Acquisition Base System or a Data Processing Base System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, in the pattern of performing data processing in the data acquisition base system 2000 or the data processing base system 3000, it is possible to execute part of the sensing processing by the aircraft and the transmission processing of the acquired data from the aircraft in parallel. Therefore, obtain the time during which this sensing processing and transmission processing can be executed in parallel, and calculate the total time by subtracting the parallel-executable time from the processing time of the acquired data transmission (1) from the aircraft. Also, the information on the calculated total time is displayed on the display device. Note that the parallel-executable time may utilize information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the estimated data volume of the acquired data.

[0091] [Parallel Processing of Acquired Data Reception Processing and Data Processing / When Performing Data Processing in a Data Acquisition Base System or a Data Processing Base System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, in the pattern of performing data processing in the data acquisition base system 2000 or the data processing base system 3000, in the data acquisition base system 2000 or the data processing base system 3000, it is possible to execute part of the acquired data reception processing from the aircraft and the data processing in parallel. Therefore, obtain the time during which this reception processing (transmission processing) and data processing can be executed in parallel, and calculate the total time by subtracting the parallel-executable time from the processing time of the acquired data transmission (1) and the data processing time. Also, the information on the calculated total time is displayed on the display device. Note that the parallel-executable time may utilize information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the estimated data volume of the acquired data.

[0092] [Parallel Processing of Acquired Data Reception Processing and Transmission Processing / When Performing Data Processing in a Data Processing Base System] As shown in P02-1, P02-2, and P02-3 in Table T102, in the pattern where the acquired data is transmitted to the data processing base system 3000 via the data acquisition base system 2000 and data processing is performed in the data processing base system, in the data acquisition base system 2000, it is possible to execute part of the acquired data reception process from the aircraft and the transmission process of the acquired data to the data processing base system in parallel. Therefore, obtain the time during which this reception process (transmission process) and transmission process (transmission process) can be executed in parallel, and calculate the total time by subtracting this parallel-executable time from the processing time of the acquired data transmission (1) and the processing time of the acquired data transmission (2). Also, the information on the calculated total time is displayed on the display device. Note that the parallel-executable time may utilize information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the estimated data volume of the acquired data.

[0093] [Parallel Processing of Data Processing and Post-Processing Data Transmission Processing / When Data Processing is Performed on the Aircraft] As shown in A01, A02-1, A02-2, and A03 in Table T102, in the pattern where data processing is performed on the aircraft 1000, it is possible to execute part of the data processing by the aircraft and the transmission process of the post-processing data in parallel. Therefore, obtain the time during which this data processing and the transmission process of the post-processing data can be executed in parallel, and calculate the total time by subtracting this parallel-executable time from the data processing time by the aircraft and the transmission processing time of the post-processing data. Also, the information on the calculated total time is displayed on the display device. Note that the parallel-executable time may utilize information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the estimated data volume of the acquired data estimated by the acquired data volume estimation unit 2310.

[0094] [Parallel Processing of Data Processing and Post-Processing Data Transmission Processing / When Data Processing is Performed in the Data Acquisition Base System or the Data Processing Base System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, in the pattern of performing data processing in the data acquisition base system 2000 or the data processing base system 3000, in the data acquisition base system 2000 or the data processing base system 3000, it is possible to execute part of the data processing and the transmission processing of the processed data in parallel. Therefore, obtain the time during which this parallel execution of data processing and processed data transmission processing is possible, and calculate the total time by subtracting this parallel execution possible time from the data processing and processed data transmission time. Also, the information on the calculated total time is displayed on the display device. Note that the parallel execution possible time may utilize information registered in the system in advance, or may be calculated based on a predetermined ratio with respect to the data amount of the acquired data estimated.

[0095] (A-1-6―4. Processing means determination unit 2340) The processing means determination unit 2340 determines the pattern of the data processing execution location and the transmission path that minimizes the total time estimated by the total time estimation unit 2333. Specifically, it determines the pattern that minimizes the total time from each pattern shown in Table T102.

[0096] (A-1-6―5. Processing means determination unit 2350) The processing means determination unit 2350 determines the pattern for executing the processing based on the pattern of the data processing execution location and the transmission path determined by the processing means determination unit 2340. The processing means determination unit 2350 includes a processing means proposal unit 2351 and a processing means selection reception unit 2352.

[0097] (A-1-6―5―1. Processing means proposal unit 2351) The processing means proposal unit 2351 proposes one or more candidate patterns of the data processing execution location and the transmission path determined by the processing means determination unit 2340 to the user. For example, it proposes to the user by displaying the candidate patterns on the output device (such as a display device) of the work determination system.

[0098] (A-1-6―5―2. Processing Means Selection Reception Unit 2352) The processing means selection reception unit 2352 receives approval or selection for one or more candidate patterns of the processing means proposed to the user by the processing means proposal unit 2351 via an input device (such as a touch panel, keyboard, mouse, or voice input device like a microphone) of the work determination system. The processing means determination unit 2350 determines the processing means based on the approval or selection input received from the user. The detailed proposal method and selection reception method by the processing means proposal unit 2351 and the processing means selection reception unit 2352 will be described later.

[0099] Note that the determination of the processing means by the processing means determination unit 2350 is not limited to the method of determining the processing means based on the approval or selection input received from the user as described above. For example, the pattern determined by the processing means determination unit 2340 can also be automatically determined without going through the approval or selection by the user.

[0100] (A-1-6―6. Processing Execution Command Unit 2360) The processing execution command unit 2360 transmits an operation command based on the processing means pattern determined by the processing means determination unit 2350 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Also, when the data processing content is data processing that requires processing data as shown in Nos. 004 to 008 of Table T101, the operation command transmitted to the data processing base system 3000 includes a request command to transmit the processing data recorded in the processing data recording unit 3300 of the data processing base system to the data processing unit that executes the data processing.

[0101] The aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 that receive the operation command from the processing execution command unit 2360 execute the operation tasks (including data transmission and data processing) of their own systems in the processing means pattern determined according to the operation command.

[0102] <Hardware Configuration> FIG. 11 is a diagram showing an example of the hardware configuration of the work determination system. Here, the work determination system 2300 in the present invention is an information processing device such as a server device or a PC. As shown in the figure, the work determination system 2300 includes an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary storage device 500, a communication device 600, and a bus 700 that electrically connects these devices.

[0103] The input device 100 is a device for a user to input information and instructions into the work determination system. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.

[0104] The output device 200 is a device that outputs the information generated by the work determination system 2300. Specifically, the output device 200 is a display device (including display devices for eyewear, AR, VR, etc.), a printer, or a speaker.

[0105] The processing device 300 is a device that performs arithmetic processing, for example. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing arithmetic operations.

[0106] The main memory device 400 is a memory device such as a RAM that temporarily stores various read information, a program executed by the processing device 300, an application program, and other various information, and a ROM that stores the program and application program. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that can store digital information.

[0107] The communication device 600 is a device that performs information communication wirelessly or by wire with an external device.

[0108] Although FIG. 11 illustrates the hardware configuration of the work determination system, other systems within the data acquisition base system 2000 (communication infrastructure management system 2100, aircraft operation control system 2200, data processing unit 2400, operation management system 2500, airspace monitoring system 2600), data processing base system 3000, distribution system, and user terminal devices (including the crisis management headquarters terminal) can also be implemented with the same hardware configuration as that of FIG. 11 described above.

[0109] <Control Flow> (A-1-7. Upper-level Control Flow of Aircraft Data Processing System) Next, the control flow of the aircraft data processing system will be described with reference to the drawings. FIG. 12 is a flowchart showing the processing flow by the aircraft data processing system.

[0110] First, the acquisition data volume estimation unit 2310 predicts the total volume of the acquired data (step 101). Note that this step is executed before the start of the sensing operation by the aircraft or at least before the completion of the sensing operation.

[0111] Next, the data processing execution location candidate generation unit 2320 grasps the variations of the execution location of data processing and the transmission path (step 102). Specifically, patterns A01 to C01-2 as shown in the table T102 of FIG. 8 are grasped.

[0112] Next, the communication speed determination unit 2331 of the required time estimation unit 2330 grasps the communication speed for each of the plurality of communication means in each transmission path (step 103).

[0113] Next, the data processing speed determination unit 2332 of the required time estimation unit 2330 determines the processing speed of data processing at each data analysis execution location (step 104).

[0114] Next, the total time estimator 2333 of the required time estimator 2330 estimates the total time considering the data transmission time and the data processing time for each pattern of the generated data analysis execution location and the transmission path (step 105).

[0115] Next, the processing means determination unit 2340 of the required time estimator 2330 determines the pattern of the processing means that results in the shortest total time, and the processing means determination unit 2350 receives approval or selection input from the user to determine the pattern of the processing means (step 106). Note that this step is executed before the start of the sensing operation by the aircraft or at least before the completion of the sensing operation. Here, the determination criterion for the processing means pattern by the processing means determination unit 2340 is not necessarily limited to the shortest total time, and it may be a determination criterion that preferentially selects a processing means pattern that uses a transmission path with high communication speed, short transmission time, and strong communication intensity.

[0116] Next, the processing execution command unit 2360 transmits an operation command based on the processing means pattern determined by the processing means determination unit 2350 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 to execute the processing (step 107).

[0117] (A-1-8. Control Flow When Estimating the Total Amount of Acquired Data) FIG. 13 is a flowchart showing the processing flow performed when the aircraft data processing system estimates the total amount of acquired data. In particular, it is a detailed flowchart of the process of predicting the total amount of the data amount of the acquired data by the acquired data amount estimator 2310 in step 101 of FIG. 12.

[0118] First, the acquired data amount estimation unit 2310 grasps the data acquisition conditions (step 201). The data acquisition conditions include information regarding the sensing range, the type of sensor and setting parameters related to the amount of data per unit area, etc. Here, the information regarding the sensing range can be defined based on, for example, the planned flight route of the aircraft, the planned flight time, the sensing target range on the ground surface, or the range of the planned flight airspace. Also, the types of sensors include, for example, optical cameras, infrared cameras, and laser sensors including LiDAR. The setting parameters are defined by the resolution of the captured image, the point cloud density of the point cloud data, etc.

[0119] Next, the acquired data amount estimation unit 2310 estimates the total amount of the acquired data (step 202). The estimation of the total amount of the acquired data can be performed using at least any one of the information regarding the sensing range described above and the information regarding the amount of data per unit area. Estimating based on both the information regarding the sensing range and the information regarding the amount of data per unit area can more accurately estimate the total amount of the acquired data. For example, when the type of sensor is an optical camera and the resolution of the captured image can be grasped, and furthermore, the planned flight route can be grasped as the sensing range, the amount of data per captured image can be estimated based on the resolution information, and the number of images captured on the route can be roughly predicted based on the planned flight route. Therefore, the total amount of the acquired data can be estimated by multiplying the amount of data per captured image by the number of images.

[0120] Next, the acquired data amount estimation unit 2310 determines whether the estimated total amount of the acquired data is greater than a predetermined value (step 203). Here, the predetermined value can be set to about 30GB, for example.

[0121] Next, when it is determined in step 203 that the estimated total amount of the acquired data is greater than the predetermined value, the process proceeds to the process of step 102 "Grasp candidates for data processing location and transmission path" in FIG. 12 (step 204).

[0122] Next, when it is determined that the total amount of acquired data estimated in step 203 is equal to or less than a predetermined value, a pre-default set analysis execution location and transmission path are determined as processing means (step 205).

[0123] Next, the process proceeds to the process of step 107 "Execution of Process" in FIG. 12, and the determined processing means is executed (step 204).

[0124] Here, as shown in FIG. 13, depending on whether the total amount of acquired data is greater than a predetermined reference value (for example, about 100 MB), it is determined whether to execute the process with the pre-set default processing means, so that it is not necessary to perform the selection process of the processing means pattern unnecessarily. That is, when the total amount of acquired data is equal to or less than the predetermined reference value, since the total amount of data is small enough, even if data processing is performed by any subsystem, the total time is less affected. Therefore, even if the default set processing means is compared with the processing means that minimizes the total time, almost no time reduction effect can be obtained. In such a case, without performing the selection process of the processing means pattern, the process proceeds to step 107 and the process is executed according to the pre-default set data processing execution location and transmission path.

[0125] (A-1-9. Control Flow When Estimating Total Processing Time) FIG. 14 is a flowchart showing a processing flow performed when the aviation data processing system estimates the total processing time. In particular, it is a detailed flowchart when estimating the total processing time by the total time estimation unit 2333 in step 105 of FIG. 12.

[0126] First, the total time estimation unit 2333 estimates the data sensing time (step 301). Here, the data sensing time can be grasped based on the information regarding the sensing range obtained by the processing of the acquired data amount estimation unit 2310 or the total amount of the acquired data. The information regarding the sensing range is, for example, the planned flight route of the aircraft, the planned flight time, the sensing target range on the ground surface, or the range of the planned flight airspace.

[0127] Next, the total time estimation unit 2333 estimates the data transmission time via the communication line (step 302). Specifically, based on the information on the data amount of the acquired data estimated by the acquired data amount estimation unit 2310, the data amount of the processed data, the data amount of the data for processing, and the information on the communication speed of the fastest communication means for each transmission path determined by the communication speed determination unit 2331, the transmission time of each data of the acquired data, the processed data, and the data for processing in each transmission path is estimated.

[0128] Next, the total time estimation unit 2333 estimates the data transmission time due to physical movement (step 303). In the patterns of A02-2, P02-2, P02-3, and C01-2 in Table T102, since data transmission is performed by physically moving the memory device, the data transmission time of the section in which data transmission is performed by memory physical movement in the pattern is estimated. For example, for the physical movement of the memory from the aircraft to the data acquisition base system, it is sufficient if the required time from when the aircraft has completed landing at the data acquisition base system until the memory is taken out from inside the aircraft body and the acquired data in the memory is read out is recorded in advance as the expected required time. Also, for the physical movement of the memory from the data acquisition base system to the data processing base system, it is sufficient if the required time from when the memory is taken out from the data acquisition base system until the acquired data is read out is recorded in advance as the expected required time in addition to the movement time from the data acquisition base system to the data processing base system.

[0129] Next, the total time estimation unit 2333 estimates the data analysis time (step 304). Based on the information on the data volume of the acquired data estimated by the acquired data volume estimation unit 2310 and the information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2332, the total time estimation unit 2333 estimates the data processing time in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000.

[0130] Next, the total time estimation unit 2333 checks whether parallel operations can be performed for each process when the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 execute the sensing process by the aircraft, the acquired data transmission process, the data processing, and the processed data transmission process in parallel (step 305).

[0131] Next, the total time estimation unit 2333 estimates the total processing time (step 306). If, as a result of checking the feasibility of parallel operations in step 305, parallel operations cannot be performed, the total required time is estimated by adding the transmission time and the data processing time for each pattern of the processing means shown in Table T102. In this case, the total data sensing time may be further added to estimate the total required time.

[0132] Conversely, if, as a result of checking the feasibility of parallel operations in step 305, parallel operations are possible, for each pattern of the processing means shown in Table T102, the parallel execution possible time for each process is obtained, and the total required time is estimated by subtracting the parallel execution possible time from the processing time of the processes for which parallel operations are possible.

[0133] FIG. 15 is a diagram showing an example of the estimation result of the total processing time considering parallel processing when estimating the total processing time. FIG. 15 shows an example of the estimation result of the total processing time for each of the patterns A01, A02-2, and P01 in Table T102, particularly when it is determined that at least a part of the processes can be parallelized.

[0134] In A01, within the aircraft, during the execution period of the sensing process, the processing data is received from the data processing base system in parallel. Furthermore, during the execution period of the sensing process, the first half of the data processing is carried out in parallel. Also, the second half of the data processing and the first half of the post - processing data transmission process are carried out in parallel. Therefore, the total processing time from the start of the sensing operation to the completion of transmitting the post - processing data to the distribution system is shorter than the total time obtained by adding up all the processing times.

[0135] In A02 - 2, within the aircraft, during the execution period of the sensing process, the processing data is received from the data processing base system in parallel. Furthermore, during the execution period of the sensing process, the first half of the data processing is carried out in parallel. Also, during the execution of the second half of the data processing, a landing at the data acquisition base system is performed. After that, immediately after the data processing and the landing operation are completed, in the data acquisition base system, the memory information in the aircraft where the post - processing data is recorded is read out, and the read post - processing data is transmitted to the distribution system. In the example shown in this figure, the total processing time from the start of the sensing operation to the completion of transmitting the post - processing data to the distribution system is shorter than the total time obtained by adding up all the processing times, but the total processing time of A02 - 2 is longer than the total processing time of A01.

[0136] In P01, within the aircraft, acquired data is transmitted to the data processing base system using wireless communication in parallel during the execution period of the sensing process. Also, in the data processing base system, data processing is started from the timing when the transmission process of the acquired data has progressed by about 25%, and the transmission process of the acquired data and the data processing are carried out in parallel. Further, immediately after the transmission process of the acquired data is completed, the transmission process of the processed data to the distribution system is started, and the data processing and the transmission process of the processed data are carried out in parallel. In the example shown in this figure, the total processing time from the start of the sensing operation to the completion of transmitting the processed data to the distribution system is shorter than the total time obtained by adding up all the processing times. The total processing time of P01 is longer than the total processing time of A01 and shorter than the total processing time of A02-2.

[0137] (A-1-10. Control Flow When Determining Processing Means) FIG. 16 is a flowchart showing the processing flow performed when the aircraft data processing system determines the processing means. In particular, it is a detailed flowchart when determining the processing means in step 106 of FIG. 12.

[0138] First, the processing means determination unit 2340 determines candidates for the processing means pattern with the shortest total processing time (step 401). Here, the total processing times of the candidate processing means patterns estimated in step 306 are compared to determine the candidate for the processing means pattern with the shortest total processing time. If the result of calculating the total processing times of the candidate processing means patterns is the situation shown in FIG. 15, the one with the shortest total processing time, "A01", is determined as the candidate pattern.

[0139] Next, the processing means determination unit 2350 displays the determined candidate processing means pattern on a display device or the like (step 402).

[0140] Next, the processing means determination unit 2350 receives approval from the user for the candidate processing means pattern displayed on a display device or the like or a command input for the processing means pattern (step 403).

[0141] Next, the processing means determination unit 2350 determines a processing means pattern (step 404). Here, in this step, the processing means determination unit 2350 may determine, regardless of the approval or designated input from the user for the processing means pattern candidate, the processing means pattern with the shortest total processing time determined by the processing means determination unit 2340 as the processing means pattern.

[0142] FIG. 17 is a diagram showing an example of a display screen displayed on a display device when an aviation data processing system determines processing means. This figure shows the processing means pattern candidates displayed by the processing means determination unit 2350 on the display device of the work determination system in step 402.

[0143] As shown in FIG. 17, information on the total processing time estimated for each of a plurality of processing means patterns is displayed on the screen, and the processing means pattern with the shortest total processing time among them is highlighted as a proposed candidate. Also, the highlighted processing means pattern candidate does not necessarily have to be single, and a plurality of patterns may be highlighted as proposed candidates. In the example shown in FIG. 17, A01 is highlighted as the pattern candidate with the shortest total processing time, but other A02-2 and P01 are also highlighted as the second and third candidates.

[0144] Note that in the example shown in FIG. 17, the user can select and input any pattern from among the plurality of displayed processing means patterns, and detailed information on the selected A01 is displayed in a pop-up. As the detailed information, for example, the processing process (information on processing items and processing order) and the processing time for each processing process (data acquisition time, transmission time of acquired data, transmission time of processed data, data processing time, etc.) can be displayed.

[0145] In the example shown in FIG. 17, further in step 403, an example is shown in which the processing means determination unit 2350 accepts user approval or designated input for the processing means pattern candidates to be displayed on the display device. Specifically, in a state where the user is performing A01 among the plurality of displayed processing means patterns, by selecting the "Determine Selection Pattern" button in the upper right, A01 is determined as the processing means pattern.

[0146] (A-1-11. Control Flow When Executing Processing Means) FIG. 18 is a flowchart showing the processing flow performed when the aviation data processing system determines the processing means. In particular, it is a detailed flowchart when executing the process in step 107 of FIG. 12.

[0147] First, the processing execution command unit 2360 of the work determination system determines whether the communication speed in the transmission path of the processing means pattern determined by the processing means determination unit 2350 has dropped below a predetermined value (step 501). If the determination result is YES, the process proceeds to step 505. Conversely, if the determination result is NO, the process proceeds to step 502.

[0148] Next, when the determination result in step 501 is NO, the processing execution command unit 2360 of the work determination system outputs an instruction to execute data sensing processing to the aircraft 1000 and the airframe operation control system 2200 (step 502).

[0149] Next, the processing execution command unit 2360 of the work determination system again determines whether the communication speed in the transmission path of the processing means pattern determined by the processing means determination unit 2350 has dropped below a predetermined value (step 503). If the determination result is YES, the process proceeds to step 505. Conversely, if the determination result is NO, the process proceeds to step 504.

[0150] Next, when the determination result in step 503 is NO, the processing execution instruction unit 2360 of the work determination system outputs an execution instruction for data processing to at least one of the data processing units of the aircraft 1000 determined to perform data processing, the data acquisition base system 2000, and the data processing base system 3000 (step 502).

[0151] Next, when the determination result in step 501 or 503 is YES, the process is transitioned to "estimation of total processing time" in step 105 shown in FIG. 12. That is, even after determining the processing means to be executed, the measurement of the data communication speed is continued. When the measured value is updated, by returning to the process of step 105, based on the measured value of the data communication speed of the transmission path, each process of determining the data transmission time, determining the total processing time, and selecting and determining a specific processing means from a plurality of candidate patterns of the processing means is performed again, and the determination result is displayed on the display device.

[0152] [A-2. Effects of this Embodiment] According to the first embodiment described above, in an aircraft data processing system that acquires data on a sensing target range such as a disaster area by an aircraft using sensors such as a camera or a LiDAR device mounted on the aircraft, performs data processing on the acquired data, and provides the processed data to a user terminal such as a disaster countermeasure headquarters terminal, when there are a plurality of data processing units capable of data processing in the system, it is possible to determine which data processing unit can complete a series of processes (processes until the processed data is provided to the user terminal) more quickly or more reliably. Further, in this determination, since there are multiple possibilities not only for the selection of the data processing unit that executes the data processing but also for the patterns of the transmission paths of the acquired data, the processed data, and the processing data, it is possible to determine a processing means pattern that can complete a series of processes more quickly or more reliably from the processing means patterns considering such transmission path patterns.

[0153] <B. Second Embodiment> [B-1. Configuration] In the above-described first embodiment, an example was described in which when data processing is executed in any of the data processing units of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, a combination pattern of a data processing execution location and a transmission path that minimizes the total processing time is selected. However, it is also conceivable to distribute the tasks of data processing among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Therefore, in the present embodiment, an embodiment will be described in which, when the tasks of data processing are distributed among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 in this way, a combination pattern of a data processing execution location and a transmission path that minimizes the total processing time is selected. In the description of the present embodiment, configurations different from those of the above-described first embodiment will be described, and descriptions of the same configurations will be omitted.

[0154] FIG. 19 is a table showing patterns of data transmission paths and data processing execution locations when an aircraft data processing system executes data processing by sharing among a plurality of subsystems. In the present embodiment, in addition to the patterns of data transmission paths and data processing execution locations shown in FIG. 8, a pattern in which a data processing task is divided and executed at two or three locations as shown in FIG. 19 is also included, and a pattern with the shortest total processing time is selected from each pattern.

[0155] Also, in FIG. 19, an example is shown in which the data processing task is evenly divided into two or three locations in advance. However, as a modification, the ratio of the data amount of data processing assigned to each data processing unit may be an arbitrary ratio according to the ratio of the processing speeds of the respective data processing units determined by the data processing speed determination unit 2332. Specifically, the data amount is distributed so that the data processing unit with a higher processing speed has a greater processing load of data processing. In this way, by determining the ratio of the amount of acquired data to be distributed according to the ratio of the processing speeds of the data processing units, the task sharing of data processing can be performed so that the time required for data processing is minimized.

[0156] As described above, when performing task sharing for data processing in a plurality of data processing units, the post - processing data after data processing is collected at any one of the data processing units in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Then, web optimization processing is executed in the data processing unit, and the post - processing data after web optimization processing is transmitted from the data processing unit to the distribution system.

[0157] In each of the above - described embodiments, the form of implementing the work determination system 2300 within the data acquisition base system 2000 has been described. However, all or part of the functions of the work determination system 2300 can be implemented in the aircraft 1000, the data processing base system 3000, the distribution system 4000, or other systems.

[0158] [B - 2. Effects of this Embodiment] According to the above - described second embodiment, considering the pattern of dispersing and processing a part of the data processing tasks by a plurality of data processing units in the aircraft data processing system, the optimal processing means pattern can be determined. Therefore, it is possible to determine the processing means that can complete a series of processes (processes until the post - processing data is provided to the user terminal) more quickly.

[0159] <C. Third Embodiment> [C - 1. Configuration] In the above-described first and second embodiments, the data processing unit is implemented in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, respectively, and the case where data processing is executed at any one or a plurality of these data processing units has been described. However, the data processing unit does not necessarily have to be implemented in all of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, and it is sufficient that a plurality of data processing units are implemented in the entire aircraft data processing system. Therefore, an embodiment in which the data processing unit is implemented in at least two of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 may be used. Alternatively, in the case of a system configuration in which the aircraft data processing system includes a plurality of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, respectively, an embodiment in which the data processing unit is implemented in each of the plurality of aircraft 1000, or an embodiment in which the data processing unit is implemented in each of the plurality of data acquisition base systems 2000, or an embodiment in which the data processing unit is implemented in each of the plurality of data processing base systems 3000 may be used.

[0160] The above-described first and second embodiments are merely examples for facilitating the understanding of the present invention, and are not for limiting and interpreting the present invention. It goes without saying that the present invention can be changed and improved without departing from its gist, and equivalents thereof are included in the present invention.

Explanation of Reference Numerals

[0161] 1... Aircraft data processing system 100... Input device 200... Output device 300... Processing device 400... Main memory device 500... Auxiliary storage device 600... Communication device 700... Bus 1000... Aircraft 1100... Flight unit 1110... Self-position / velocity determination unit 1120... Attitude determination unit 1130... Flight control unit 1200... Sensing unit 1210... Sensor 1220... Sensor attitude control unit 1230…Sensor control unit 1300…Communication unit 1310…Control and communication unit 1320…Data communication unit 1330…Status data communication unit 1400…Status determination unit 1410…Flight status determination unit 1420…Sensing status determination unit 1430…Communication status determination unit 1500…Data processing unit 1600…Data recording unit 1610…Acquired data recording unit 1620…Processed data recording unit 1630…Communication status recording unit 2000…Data acquisition base system 2100…Communication infrastructure management system 2200…Aircraft operation system 2300…Operation determination system 2310…Estimation unit for amount of acquired data 2320…Candidate generation unit for data processing location 2330…Candidate generation unit for required time 2331…Communication speed determination unit 2332…Data processing speed determination unit 2333…Total time estimation unit 2340…Processing means determination unit 2350…Processing means determination unit 2351…Processing means proposal unit 2352…Processing means selection acceptance unit 2360…Processing execution command unit 2400…Data processing unit 2500…Operation management system 2600…Airspace monitoring system 3000…Data processing base system 3100…Communication unit 3200…Data processing unit 3300…Processing data recording unit 4000…Distribution system 4100…Communication unit 4200…Distribution data management unit 5000…Crisis management headquarters terminal

Claims

1. An aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing base system including a data processing unit for processing acquired data obtained by the sensor. A work determination system for determining the content of processing work by an aerial data processing system, when the data processing unit is provided in at least any one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided at a plurality of locations within the aerial data processing system, the work determination system displays, on a display device, a plurality of candidate patterns of where to execute data processing among the data processing units provided at a plurality of locations, or a determination result of where to execute data processing among the data processing units provided at a plurality of locations that has been selected or determined, or causes data processing to be executed by a data processing unit according to the determination result.

2. In the work determination system according to Claim 1, the work determination system estimates or displays a total time including the data processing time required for the data processing for each of the plurality of candidate patterns of the data processing unit that executes the data processing.

3. In the work determination system according to Claim 1, the work determination system displays, on a display device, a plurality of candidate patterns of combinations of the data processing unit that executes the data processing and the transmission path of the acquired data, or a determination result of the transmission path of the data processing unit that executes the data processing and the acquired data that has been selected or determined, or causes data processing and data transmission processing to be executed according to the determination result.

4. In the work determination system according to Claim 3, The operation determination system is an operation determination system that estimates or displays the total time including the data processing time required for the data processing and the data transmission time required for data transmission for a plurality of candidate patterns obtained by combining the data processing unit that executes the data processing and candidates for the transmission path of the acquired data.

5. In the operation determination system according to claim 4, the operation determination system is an operation determination system that estimates or displays the data transmission time based on at least any one of the amount of data of the acquired data transmitted through the transmission path and the data communication speed of the transmission path.

6. In the operation determination system according to claim 2 or claim 4, the operation determination system is an operation determination system that estimates or displays the data processing time based on at least any one of the amount of data of the acquired data and the data processing speed of the data processing unit that executes the data processing.

7. In the operation determination system according to claim 2 or claim 4, the operation determination system is an operation determination system that determines or displays a pattern in which the estimated total time is the shortest or a pattern in which the total time is shorter than other candidate patterns from among the plurality of candidate patterns.

8. In the operation determination system according to claim 5, the operation determination system is an operation determination system that estimates or displays the data communication speed based on the measured values of the past or current data communication speed in each candidate of the transmission path.

9. In the operation determination system according to claim 5, The operation determination system is an operation determination system that estimates or displays the data communication speed of at least any one of satellite wireless communication using a relay by a satellite in each candidate of the transmission path, direct wireless communication, wireless communication using a mobile phone communication line, and wired communication using a wired line.

10. In the operation determination system according to claim 9, When the operation determination system determines the data communication speed for each communication means using a wireless or wired line, the operation determination system estimates or displays the communication speed of the section with the slowest communication speed in the communication section by the communication means as the actual data communication speed in the communication section.

11. In the operation determination system according to claim 9, When there are a plurality of available communication means in a certain transmission path, the operation determination system determines or displays the communication means determined to have the fastest data communication speed as the communication means of the transmission path.

12. In the operation determination system according to claim 5, Based on at least any information of the data amount of the acquired data transmitted through the transmission path and the data communication speed of the transmission path, in addition to the transmission time of the acquired data, the operation determination system estimates the data transmission time including at least any one of the transmission time of the processed data generated by the data processing and the transmission time of the processing data used for the data processing, or displays the estimation result.

13. In the operation determination system according to claim 12, The processing data is recorded in the data processing site system, When a pattern of performing the data processing by the data processing unit provided in the aircraft or the data acquisition site system is selected or determined, the operation determination system causes the data processing site system to transmit the processing data to the aircraft or the data acquisition site system.

14. In the work determination system according to claim 6, when determining the processing speed of data processing in a plurality of the data processing units, the work determination system estimates the processing speed or displays an estimation result based on measurement values of the data processing units in the past or present, or information regarding the processing speed acquired in advance.

15. In the work determination system according to claim 6, when determining the processing speed of data processing in a plurality of the data processing units, the work determination system estimates the actual data processing speed or displays an estimation result based on the status of data processing tasks being executed or scheduled to be executed in the plurality of data processing units.

16. In the work determination system according to claim 4, when the aircraft includes the data processing unit, the work determination system estimates or displays the total time according to the parallel operation time during which at least part of the sensing operation of acquiring the image or point cloud information by the sensor of the aircraft and the operation of data processing by the data processing unit of the aircraft are executed in parallel.

17. In the work determination system according to claim 4, when the data acquisition base system includes the data processing unit, the work determination system estimates or displays the total time according to the parallel operation time during which at least part of the processing operation of the data acquisition base system receiving the acquired data from the aircraft and the operation of data processing by the data processing unit of the data acquisition base system are executed in parallel.

18. In the work determination system according to claim 4, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the processing operation in which the data processing base system receives the acquired data from the aircraft or the data acquisition base system and the data processing operation by the data processing unit of the data processing base system are executed in parallel.

19. In the operation determination system according to claim 4, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the sensing operation in which the sensor of the aircraft acquires the image or point cloud information and the processing operation of transmitting the acquired data from the aircraft to the data acquisition base system or the data processing base system are executed in parallel.

20. In the operation determination system according to claim 4, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the processing operation in which the data acquisition base system receives the acquired data from the aircraft and the processing operation of transmitting the acquired data from the data acquisition base system to the data processing base system are executed in parallel.

21. In the operation determination system according to claim 4, When the aircraft includes the data processing unit, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the data processing operation by the data processing unit of the aircraft and the processing operation of transmitting the data processing unit from the aircraft to the outside are executed in parallel.

22. In the operation determination system according to claim 4, When the data acquisition base system includes the data processing unit, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the data processing operation by the data processing unit of the data acquisition base system and the processing operation of transmitting the data processing unit from the data acquisition base system to the outside are executed in parallel.

23. In the operation determination system according to claim 4, The operation determination system estimates or displays the total time according to the parallel operation time during which at least a part of the data processing operation by the data processing unit of the data processing base system and the processing operation of transmitting the data processing unit from the data processing base system to the outside are executed in parallel.

24. In the operation determination system according to claim 2, The operation determination system estimates or displays the total time in a plurality of candidates of data processing sharing patterns when a part of the data processing is shared and implemented between the data processing unit of the data processing base system and the data processing unit provided in the aircraft or the data acquisition base system.

25. In the operation determination system according to claim 1, The data processing includes a display adjustment process for adjusting the display when the processed data generated by the data processing is displayed on the user terminal device.

26. In the operation determination system according to claim 2 or claim 4, Before the start of the acquisition process of the image or point cloud information of the target area by the aircraft or before the completion of the acquisition process, the total amount of the acquired data is predicted or the prediction result is displayed, or a specific pattern is determined from the plurality of candidate patterns or the determination result is displayed.

27. In the operation determination system according to claim 26, When the operation determination system predicts the total amount of the acquired data, the total amount of the acquired data is predicted based on data sensing conditions including at least any one of the sensing range by the aircraft, the planned flight route, the planned flight time, the type of the sensor, and the resolution of the image which is the acquired data.

28. In the operation determination system according to claim 5, after the operation determination system selects and determines a specific pattern from the plurality of candidate patterns, the operation determination system re - performs at least any one of the determination of the data transmission time, the determination of the total time, or the selection and determination of the specific pattern from the plurality of candidate patterns, or displays the determination result.

29. An operation determination method for determining by a computer the processing operation content of an aircraft data processing system having an aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for communicating control information related to flight or data acquisition with the aircraft, and a data processing base system including a data processing unit for processing the acquired data acquired by the sensor to generate post - processed data, wherein when the data processing unit is provided in at least any one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided at a plurality of locations within the aircraft data processing system, the step of the computer displaying a plurality of candidate patterns of where to execute data processing among the data processing units provided at a plurality of locations; the step of displaying on a display device the determination result of which of the data processing units provided at a plurality of locations is selected or determined to execute data processing; the step of causing the data processing unit corresponding to the determination result to execute data processing, An operation determination method that executes at least any one of the above steps.

30. A program for causing a computer to determine the processing work content by an aircraft data processing system having an aircraft equipped with a sensor for acquiring image or point cloud information of a target area, a data acquisition base system for exchanging control information related to flight or data acquisition with the aircraft, and a data processing base system including a data processing unit for processing acquired data acquired by the sensor to generate post-data processing data. When the data processing unit is provided in at least one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided at a plurality of locations within the aircraft data processing system. Causing the computer to display a plurality of candidate patterns of where to execute data processing among the data processing units provided at a plurality of locations. Displaying, on a display device, a determination result of where to execute data processing among the data processing units provided at a plurality of locations, which has been selected or determined. Causing data processing to be executed by a data processing unit according to the determination result. A program for executing at least one of the above steps.

Images