Work determination system, work determination method, and program

Abstract

[Problem] To provide a system capable of quickly executing a series of processing until a data processing result of aviation data acquired by an aircraft is provided. [Solution] The present invention is a work determination system which, when a data processing unit is provided in at least one of a data processing base system, an aircraft, and a data acquisition base system, and data processing units are provided at a plurality of locations in an aviation data processing system: displays, on a display device, a plurality of candidate patterns for a data processing unit to execute data processing among the data processing units provided at the plurality of locations, or a determination result indicating that the data processing unit to execute data processing among the data processing units provided at the plurality of locations has been selected or determined; or causes the data processing unit according to the determination result to execute data processing.

Description

Work determination system, work determination method, and program

[0001] The present invention relates to an operation determination system, an operation determination method, and a program.

[0002] In recent years, in abnormal situations (crisis situations) such as natural disasters or disasters caused by enemy aircraft attacks, rapid understanding of wide-area information on the affected area is required. Therefore, research is being conducted into the practical application of technology that can rapidly grasp the damage situation during a disaster by analyzing image data acquired from the air using aircraft, etc. When a crisis occurs, it is necessary to quickly grasp the damage situation in order to quickly determine the initial crisis response actions, such as issuing evacuation orders and rescue. In addition, the period immediately after the occurrence of a crisis is called the hyper-acute or acute phase, and the damage situation changes rapidly in a short period of time. Therefore, a function to quickly update the damage situation understanding that can keep up with such rapid situation changes is required.

[0003] Patent Document 1 discloses a technology for estimating the damage status of a building by analyzing aerial images acquired from the sky using a pre-trained building damage estimation model.

[0004] Japanese Patent Application Laid-Open No. 2019-095886

[0005] In order to analyze aerial data acquired by aircraft, interpret the damage situation, and provide the results of the interpretation of the damage situation to users such as crisis response headquarters that decide on crisis response measures, tasks such as data acquisition, data analysis, and data transmission must be performed on each of the aircraft, analysis devices, and user terminal devices, which are located in physically different locations.As a result, it took a long time from the acquisition of aerial data by aircraft to the provision of the information to the user terminal device.

[0006] The technology described in Patent Document 1 above focuses on improving the speed and interpretation accuracy of data processing alone, and does not sufficiently consider speeding up the entire process from the acquisition of aeronautical data by an aircraft to the provision of the information to a user terminal device.

[0007] Therefore, an object of the present invention is to provide a system that can quickly execute a series of processes up to providing the analysis results of the aircraft data acquired by the aircraft.

[0008] According to the present invention, there is provided a work determination system that determines the content of processing work by an aviation data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information regarding flight or data acquisition with the aircraft, and a data processing base system that has a data processing unit that processes the data acquired by the sensor to generate processed data, wherein when the data processing unit is provided in at least one of the data processing base system, the aircraft, or the data acquisition base system, and data processing units are provided at multiple locations within the aviation data processing system, the work determination system displays on a display device multiple candidate patterns for where data processing should be performed among the data processing units provided at the multiple locations, or the determination result selected or determined as to where data processing should be performed among the data processing units provided at the multiple locations, or causes data processing to be performed by a data processing unit according to the determination result.

[0009] According to the present invention, a series of processes from the acquisition of aeronautical acquired data by an aircraft to the provision of the information to a user terminal device can be quickly executed.

[0010] 1 is an overall configuration diagram of an aviation data processing system according to one embodiment of the present invention. FIG. 2 is a functional configuration diagram of an aircraft according to one embodiment of the present invention. FIG. 3 is a functional configuration diagram of a data acquisition base system according to one embodiment of the present invention. FIG. 4 is a configuration diagram of a data processing base system according to one embodiment of the present invention. FIG. 5 is a configuration diagram of a distribution system according to one embodiment of the present invention. FIG. 6 is a functional configuration diagram of an operation determination system according to one embodiment of the present invention. FIG. 7 is a table showing variations in data processing in the aviation data processing system. FIG. 8 is a table showing an example of patterns of data transmission paths and data processing locations in the aviation data processing system. FIG. 9 is a table showing an example of communication speeds of communication means for each data transmission path in the aviation data processing system. FIG. 10 is a table showing an example of data processing speeds in each subsystem constituting the aviation data processing system. FIG. 11 is a diagram showing an example of the hardware configuration of an operation determination system. FIG. 12 is a flowchart showing a processing flow by the aviation data processing system. FIG. 13 is a flowchart showing a processing flow performed when the aviation data processing system estimates the total amount of acquired data. FIG. 14 is a flowchart showing a processing flow performed when the aviation data processing system estimates a total processing time. FIG. 15 is a diagram showing an example of an estimated result of total processing time taking parallel processing into consideration when estimating the total processing time. FIG. 16 is a flowchart showing a processing flow performed when the aviation data processing system determines a processing means. FIG. 17 is a diagram showing an example of a display screen displayed on a display device when the aviation data processing system determines a processing means. 1 is a table showing patterns of data transmission paths and data processing locations when an aviation data processing system divides data processing among multiple subsystems.

[0011] The present invention provides an operation determination system for determining the content of an operation to be performed by an aviation data processing system including an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that transmits flight control commands to the aircraft, and a data processing base system that includes a data processing unit that processes the data acquired by the sensor to generate processed data, wherein the data processing unit is provided in at least one of the aircraft and the data acquisition base system in addition to the data processing base system, and the data processing unit is provided at multiple locations within the aviation data processing system, the operation determination system selects a specific pattern from multiple candidate patterns for where data processing should be performed among the multiple data processing units, and displays the selection result on a display device, or performs data processing and data transmission processing in accordance with the selection result. [Item 2] The operation determination system according to item 1, further comprising a required time estimation unit that determines a total time, including data processing time, required for the data processing for each of the multiple candidate patterns for the data processing unit that performs the data processing. [Item 3] The work determination system according to item 1, wherein the work determination system selects a specific pattern from a plurality of candidate combination patterns of the data processing unit that executes the data processing and the transmission path of the acquired data, and displays the determination result on a display device, or performs data processing and data transmission processing in accordance with the determination result. [Item 4] The work determination system according to item 3, wherein the work determination system includes a required time estimation unit that determines a total time including the data processing time required for the data processing and the data transmission time required for the data transmission processing for each of a plurality of candidate patterns combining the data processing unit that executes the data processing and candidate transmission paths of the acquired data.[Item 5] The task determination system described in Item 4, wherein the required time estimation unit determines the data transmission time based on at least one of information regarding the amount of acquired data transmitted over the transmission path and the data communication speed of the transmission path. [Item 6] The task determination system described in Item 2 or 4, wherein the required time estimation unit determines the data processing time based on at least one of information regarding the amount of acquired data and the analysis speed of the data processing unit that executes the data processing. [Item 7] The task determination system described in Item 2 or 4, wherein the task determination system selects as the specific pattern from among multiple candidate patterns the pattern with the shortest total time calculated by the required time estimation unit, or selects as the specific pattern a pattern with a shorter total time than other candidate patterns. [Item 8] The task determination system described in Item 5, wherein the required time estimation unit determines the data communication speed based on measured values ​​of past or current data communication speeds for each candidate transmission path. [Item 9] The work determination system of item 5, wherein the required time estimation unit determines the data communication speed of at least one of the communication means for each of the candidate transmission routes, including satellite wireless communication using relays by artificial satellites, direct wireless communication, wireless communication using a mobile phone communication line, and wired communication using a wired line. [Item 10] The work determination system of item 9, wherein, when determining the data communication speed for each communication means using wireless or wired lines, the required time estimation unit determines the communication speed of the section with the slowest communication speed among the communication sections of the communication means as the actual data communication speed for that communication section. [Item 11] The work determination system of item 9, wherein, when there are multiple communication means available for a certain transmission route, the required time estimation unit selects the communication means determined to have the fastest data communication speed as the communication means for that transmission route.[Item 12] The task determination system according to Item 5, wherein the required time estimation unit determines the data transmission time, which includes at least one of the transmission time of the processed data and the transmission time of the processing data used for the data processing, in addition to the transmission time of the acquired data, based on information on at least one of the data volume of the acquired data transmitted over the transmission path and the data communication speed of the transmission path. [Item 13] The task determination system according to Item 12, wherein the processing data is recorded in the data processing base system, and when a pattern of performing the data processing in the data processing unit provided in the aircraft or the data acquisition base system is selected, the task determination system transmits the processing data from the data processing base system to the aircraft or the data acquisition base system. [Item 14] The task determination system according to Item 6, wherein the required time estimation unit, when determining the processing speeds of data processing in a plurality of data processing units, determines the processing speeds based on past or current measurement values ​​of the data processing units or information related to the processing speeds obtained in advance. [Item 15] The task determination system according to Item 6, wherein, when determining the processing speeds of data processing in a plurality of the data processing units, the required time estimation unit determines the actual analysis speed based on the status of data processing tasks being executed or scheduled to be executed in the plurality of data processing units. [Item 16] The task determination system according to Item 4, wherein, when the aircraft is equipped with the data processing unit, the required time estimation unit determines the total time according to a parallel operation time during which at least a part of a sensing operation of acquiring the image or point cloud information by the sensor of the aircraft and the data processing operation by the data processing unit of the aircraft are executed in parallel.[Item 17] The task determination system according to Item 4, wherein, when the data acquisition base system includes the data processing unit, the required time estimation unit determines the total time in accordance with a parallel operation time during which at least a portion of a processing operation by the data acquisition base system to receive the acquired data from the aircraft and a data processing operation by the data processing unit of the data acquisition base system are executed in parallel. [Item 18] The task determination system according to Item 4, wherein the required time estimation unit determines the total time in accordance with a parallel operation time during which at least a portion of a processing operation by the data processing base system to receive the acquired data from the aircraft or the data acquisition base system and a data processing operation by the data processing unit of the data processing base system are executed in parallel. [Item 19] The task determination system according to Item 4, wherein the required time estimation unit determines the total time in accordance with a parallel operation time during which at least a portion of a sensing operation to acquire the image or point cloud information by the sensor of the aircraft and a processing operation to transmit the acquired data from the aircraft to the data acquisition base system or the data processing base system are executed in parallel. [Item 20] The task determination system according to Item 4, wherein the required time estimation unit determines the total time in accordance with a parallel operation time during which at least a portion of a processing operation by the data acquisition base system to receive the acquired data from the aircraft and a processing operation by the data acquisition base system to transmit the acquired data from the data acquisition base system to the data processing base system are executed in parallel. [Item 21] The task determination system according to Item 4, wherein, when the aircraft is equipped with the data processing unit, the required time estimation unit determines the total time in accordance with a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the aircraft and a processing operation of transmitting the data from the aircraft to an external device are executed in parallel.[Item 22] The task determination system according to Item 4, wherein, when the data acquisition base system includes the data processing unit, the required time estimation unit determines the total time based on a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the data acquisition base system and a processing operation for transmitting the data from the data acquisition base system to an external device are executed in parallel. [Item 23] The task determination system according to Item 4, wherein the required time estimation unit determines the total time based on a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the data processing base system and a processing operation for transmitting the data from the data processing base system to an external device are executed in parallel. [Item 24] The task determination system according to Item 2, wherein a plurality of candidate data processing sharing patterns are generated for a case in which part of the data processing is shared between a data processing unit of the data processing base system and a data processing unit included in the aircraft or the data acquisition base system, and the required time estimation unit determines the total time for the plurality of candidate data processing sharing patterns. [Item 25] The task judgment system according to item 1, wherein the data processing includes a display adjustment process for adjusting the display of the processed data when it is displayed on a user terminal device. [Item 26] The task judgment system according to item 2 or 4, wherein the task judgment system predicts the total amount of acquired data or selects a specific pattern from a plurality of candidate patterns before the aircraft starts acquiring images or point cloud information of the target area or before the acquisition process is completed. [Item 27] ​​The task judgment system according to item 26, wherein when the task judgment system predicts the total amount of acquired data, the prediction is made based on data sensing conditions including at least one of the sensing range of the aircraft, the planned flight route, the planned flight time, the type of the sensor, and the resolution of the images that are the acquired data.[Item 28] The task determination system according to Item 5, wherein the task determination system re-determines at least one of the data transmission time, the total time, or the selection of a specific pattern from the multiple candidate patterns based on an updated measurement value of the data communication speed of the transmission path after selecting and determining a specific pattern from the multiple candidate patterns. [Item 29] A task determination method comprising: a computer acquiring information about a target area using an aircraft equipped with a sensor that acquires images or point cloud information of the target area; performing flight control of the aircraft using a data acquisition base system that transmits flight control commands to the aircraft; processing the acquired data acquired by the sensor using a data processing base system that includes a data processing unit; and, when a data processing unit is provided in at least one of the aircraft and the data acquisition base system in addition to the data processing base system, and data processing units are provided at multiple locations, selecting a specific pattern from the multiple candidate patterns for which data processing should be performed at the data processing unit; and displaying the selection result on a display device or causing data processing and data transmission processing to be performed in accordance with the selection result. [Item 30] A program that causes a computer to execute the following steps: acquiring information about a target area using an aircraft equipped with a sensor that acquires images or point cloud information of the target area; performing flight control of the aircraft using a data acquisition base system that transmits flight control commands to the aircraft; processing the acquired data acquired by the sensor using a data processing base system that is equipped with a data processing unit; and, when a data processing unit is provided in at least one of the aircraft and the data acquisition base system in addition to the data processing base system, and data processing units are provided in multiple locations, selecting a specific pattern from multiple candidate patterns for where data processing should be performed in the data processing units provided in the multiple locations; and displaying the selection result on a display device, or executing data processing and data transmission processing in accordance with the selection result.

[0012] <A. First Embodiment> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted. Furthermore, the embodiment described below is merely an example, and other known elements or alternative means may be adopted depending on the application, purpose, scale, etc.

[0013] [A-1. Configuration] (A-1-1. Overview) Fig. 1 is a diagram showing the overall configuration of an aviation data processing system 1 (hereinafter also referred to as "this system 1") according to one embodiment of the present invention. As shown in Fig. 1, this system includes an aircraft 1000, a data acquisition base system 2000, a data processing base system 3000, and a distribution system 4000.

[0014] The aircraft 1000 acquires information about the disaster area from the sky using sensors such as optical cameras, infrared cameras, and laser sensors such as LiDAR, and obtains the acquired data. The data acquisition base system 2000, if the aircraft is an unmanned aircraft, is a base equipped with a remote control device that exchanges control information with the aircraft. It can be configured as a mobile vehicle or a fixed, immobile base. The data processing base system 3000 acquires the acquired data acquired by the aircraft, processes it, and generates processed data. The distribution system 4000 acquires the processed data and distributes it via an Internet connection to user terminal devices, including a crisis management headquarters terminal. The crisis management headquarters terminal, an example of a user terminal device, is a terminal device used by users such as the head of the crisis management headquarters. The processed data can be viewed by accessing the distribution system from the crisis management headquarters terminal.

[0015] The data processing unit that performs data processing on the acquired data can be implemented not only in the data processing base system 3000, but also in the data acquisition base system 2000 and the aircraft 1000, and therefore the aviation data processing system 1 determines, depending on the situation, which data processing unit to perform the data processing in: the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000. Note that the data processing performed in each data processing unit may include web optimization processing that processes the processed data so that the processed data displayed on a user terminal device from the distribution system via an Internet line is easily viewable by the user.

[0016] Here, when data processing is performed by a data processing unit installed on the aircraft 1000, sensing processing is performed to generate acquired data, and data processing is performed to generate processed data in the aircraft 1000. The processed data is transmitted directly from the aircraft 1000 to the distribution system, or transmitted to the distribution system 4000 via the data acquisition base system 2000 or the data processing base system 3000.

[0017] Next, when data processing is performed by a data processing unit installed in the data acquisition base system 2000, sensing processing is performed in the aircraft 1000 to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data acquisition base system 2000. The data acquisition base system 2000 performs data processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0018] Finally, when data processing is performed by a data processing unit installed in the data processing base system 3000, sensing processing is performed in the aircraft 1000 to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data processing base system 3000. Here, the acquired data may be transmitted directly from the aircraft 1000 to the data processing base system 3000, or may be transmitted to the data processing base system 3000 via the data acquisition base system 2000. The data processing base system 3000 performs data processing to generate processed data, and transmits the processed data to the distribution system 4000.

[0019] In the above example, an embodiment is shown in which processed data is distributed to a user terminal device via a distribution system, but the processed data can also be sent directly to a user terminal device from the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000 without going through the distribution system.

[0020] (A-1-2. Aircraft 1000) Figure 2 is a functional configuration diagram of an aircraft according to one embodiment of the present invention. The aircraft 1000 is a system that constitutes an aircraft, and includes a flight unit 1100 with flight capabilities, a sensing unit 1200 that performs sensing using sensors, a communication unit 1300 that communicates with other subsystems within the aviation data processing system 1 (such as a data acquisition base system, a data processing base system, and a distribution system), a state determination unit 1400 that determines the flight, sensing, and positioning states, a data processing unit 1500 that performs data processing, and a data recording unit 1600 that records acquired data, etc.

[0021] In this specification, the term "aircraft" refers to any flying object capable of autonomous attitude control, regardless of the power source (electric power, prime mover, etc.), the control method (wireless or wired, fully autonomous flight type or partially manual flight type, etc.), and whether manned or unmanned. Aircraft may also be referred to as unmanned aerial vehicles (UAVs), flying objects, multicopters, RPAS (remote piloted aircraft systems), or UAS (unmanned aircraft systems). Aircraft may be fixed-wing type with fixed wings, multicopter type with multiple propellers, or VTOL type with both fixed wings and multiple propellers.

[0022] (A-1-2-1. Flight Unit 1100) The flight unit 1100 includes a self-position / velocity determination unit 1110, an attitude determination unit 1120, and a flight control unit 1130.

[0023] The aircraft's own position / speed determination unit 1110 has a function of determining the position and speed of the aircraft 1000. For example, the aircraft's position (absolute position) is measured based on satellite signals received from artificial satellites by a satellite signal antenna mounted on the aircraft using a GPS (Global Positioning System) or a GNSS (Global Navigation Satellite System). The aircraft's own position and speed can also be determined using, for example, an RTK-GNSS (Real Time Kinematic - Global Navigation Satellite System). The position information includes at least two-dimensional coordinate information (e.g., latitude and longitude) in a planar view, and preferably includes three-dimensional coordinate information including altitude information.

[0024] Next, the attitude determination unit 1120 has a function of determining the attitude (orientation) of the aircraft 1000. Specifically, the attitude of the aircraft is determined by a GPS compass consisting of a pair of satellite antennas mounted on the aircraft, a geomagnetic sensor, or the like.

[0025] Flight control section 1130, in turn, includes a processing unit, also referred to as a flight controller. The processing unit may include one or more processors, such as a programmable processor (e.g., a central processing unit (CPU), MPU, or DSP). The processing unit has access to memory. The memory stores logic, code, and / or program instructions that the processing unit can execute to perform one or more steps.

[0026] The processing unit has a function of controlling the flight state of the aircraft by controlling the output of the thrust generating device. Specifically, the processing unit controls the thrust generated from the propeller using the propeller, the motor that drives the propeller, and the motor control unit that controls the motor output, thereby adjusting the spatial arrangement, attitude angle, angular velocity, angular acceleration, angular jerk rate, and / or acceleration of the aircraft, which has six degrees of freedom (translational motion x, y, and z, and rotational motion θx, θy, and θz). In other words, the flight control unit 1130 controls the aircraft to perform various operations such as liftoff, forward movement, turning, and landing, and controls the attitude angle control and flight operations of the aircraft from takeoff to flight and landing, thereby controlling the flight state of the aircraft.

[0027] (A-1-2-2. Sensing Unit 1200) The sensing unit 1200 includes a sensor 1210, a sensor attitude control unit 1220, and a sensor control unit 1230.

[0028] The sensor 1210 is composed of, for example, an optical camera that acquires optical images, an infrared camera that acquires infrared images, a laser sensor such as LiDAR that acquires point cloud data, etc. The sensor acquires optical images, infrared images, point cloud data, etc. of the ground surface of the disaster area from the sky above the disaster area as acquired data.

[0029] The sensor attitude control unit 1220 controls the relative angle of the sensor with respect to the aircraft body, for example, by controlling at least one of the angles around the three axes of a gimbal that is provided between the sensor and the aircraft and supports the sensor, thereby controlling the relative angle of the sensor with respect to the aircraft body.

[0030] The sensor control unit 1230 has a function of changing the timing and measurement parameters of sensing performed by the sensor 1210. For example, if the sensor is an optical camera, it controls the image acquisition timing, shutter speed, resolution, and the like.

[0031] (A-1-2-3. Communication Unit 1300) The communication unit 1300 includes a control communication unit 1310, a data communication unit 1320, and a status data communication unit 1330. The communication unit 1300 is capable of radio wave communication via a communication network NW and includes, for example, a radio wave communication module. The communication unit 1300 is capable of communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via the communication network NW. The communication unit 1300 includes a communication function for wirelessly communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via wireless communication using, for example, Wi-Fi, 2.4 GHz, or a frequency band of 5.6 to 5.8 GHz. The communication unit 1300 also includes a wireless communication function for communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via the communication network NW using a communication standard such as LTE (Long Term Evolution).

[0032] The control communication unit 1310 performs communication related to aircraft flight control exchanged between the aircraft 1000 and the data acquisition base system 2000. For example, if the aircraft is an unmanned aircraft and is remotely controlled from the data acquisition base system, the control communication unit 1310 receives flight control commands transmitted from the data acquisition base system to the aircraft. The control communication unit 1310 also transmits information related to the aircraft's flight status, including the aircraft's position, speed, and attitude determined by the flight unit 1100, from the aircraft to the data acquisition base system.

[0033] The data communication unit 1320 transmits the acquired data acquired by the sensing unit 1200 to a data acquisition base system, a data processing base system, a distribution system, or the like. Furthermore, when data analysis is performed by the data processing unit 1500 (described later), the data communication unit 1320 transmits processed data generated by the data processing unit 1500 to the distribution system, etc. In other words, the data communication unit 1320 transmits the acquired data acquired by the sensing unit 1200 or the processed data obtained by analyzing the acquired data to the outside of the aircraft.

[0034] The status data communication unit 1330 transmits to the data acquisition base system the flight status, sensing status, and communication status determined by the status determination unit 1400 (described later). In particular, it transmits to the data acquisition base system the communication speed determined by the communication status determination unit 1430.

[0035] (A-1-2-4. State Determination Unit 1400) The state determination unit 1400 includes a flight state determination unit 1410, a sensing state determination unit 1420, and a communication state determination unit 1430.

[0036] The flight state determination unit 1410 determines that a flight abnormality has occurred when the position or speed of the aircraft determined by the aircraft's own position / speed determination unit 1110, or the attitude of the aircraft determined by the attitude determination unit 1120, deviates from a preset normal range. In addition, even if the position, speed, or attitude does not deviate from the normal range, the flight state determination unit 1410 also determines that a flight abnormality has occurred when at least one of the position, speed, or attitude does not normally follow the control command value from the flight control unit 1130.

[0037] The sensing state determination unit 1420 determines that a sensing abnormality has occurred when no data has been acquired by the sensor 1210 of the sensing unit 120 or when an abnormality is found in the acquired data. Alternatively, a sensing abnormality may be determined when the sensor attitude control unit 1220 does not operate correctly in response to a control command value.

[0038] The communication status determination unit 1430 determines the communication status between the aircraft and an external system (such as a data acquisition base system, a data processing base system, or a distribution system) via the communication unit 1300. The communication status to be determined is specifically the communication speed (e.g., bps) and may also include communication strength (e.g., dB) in addition to the communication speed. The communication status determination unit 1430 particularly determines the data communication speed of the data acquired by the data communication unit 1320 or the processed data.

[0039] (A-1-2-5. Data Processing Unit 1500) When the operation determination system 2300 determines that data processing is to be performed on board the aircraft, the data processing unit 1500 processes the data acquired by the sensing unit 1200. The data processing unit 1500 is configured as, for example, a workstation so that it can perform data processing that imposes a relatively large processing load.

[0040] FIG. 7 is a table showing variations in data processing in the aviation data processing system. The data processing unit 1500 can execute various data processing operations, as shown in Table T101 in FIG. 7 . The details of each data processing operation in Table T101 are as follows: Identification No. 001: A process of acquiring multiple optical images as acquired data, performing orthoimage conversion on the acquired multiple optical images, and generating an orthoimage by integrating the multiple orthoimages. Identification No. 002: A process of acquiring multiple optical images as acquired data and generating three-dimensional spatial data from the multiple optical images using SfM (Structure from Motion) processing. Identification No. 003: A process of acquiring point cloud data as acquired data and generating three-dimensional spatial data from the point cloud data using DSM (Digital Surface Model) or DEM (Digital Elevation Model). Identification No. 004: A process of performing the orthoimage generation process shown in No. 001, acquiring geographic data as processing data, and generating integrated map data by integrating the orthoimage and geographic data. - Identification No. 005: A process for generating the map integrated image shown in No. 004, obtaining past map integrated images as data for processing, and performing a difference analysis between the current and past map integrated images. - Identification No. 006: A process for generating the orthoimage shown in No. 001, obtaining disaster information as data for processing, and generating a disaster information integrated image that integrates the orthoimage and the disaster information. - Identification No. 007: A process for generating the orthoimage shown in No. 001, obtaining on-site unit information as data for processing, and generating an on-site unit information integrated image that integrates the orthoimage and the on-site unit information. - Identification No. 008: A process for performing one of the processes No. 001 to 007, and performing a web optimization process that processes the processed data to optimize the display screen on the user terminal device, generating web-optimized data.

[0041] In addition, the data processing performed in the data processing unit 1500 may include, as described in the data processing of identification No. 008, a web optimization process that generates web-optimized data by processing the processed data so that the processed data displayed on the user terminal device from the distribution system via an Internet line is displayed in an easy-to-read manner for the user on the display screen of the user terminal device.

[0042] (A-1-2-6. Data Recording Unit 1600) The data recording unit 1600 includes an acquired data recording unit 1610, a processed data recording unit 1620, and a communication status recording unit 1630. The data recording unit 1600 is configured by a storage device such as a RAM or ROM.

[0043] The acquired data recording unit 1610 records the acquired data acquired by the sensing unit 1200. The recorded acquired data is transmitted by the data communication unit 1320 to a data acquisition site system, a data processing site system, a distribution system, or the like.

[0044] The processed data recording unit 1620 records the processed data generated by the data processing unit 1500. The recorded processed data is transmitted by the data communication unit 1320 to a distribution system or the like.

[0045] The communication status recording unit 1630 records information on the communication speed and communication strength determined by the communication status determination unit 1430. The recorded information on the communication speed and communication strength is transmitted by the status data communication unit 1330 to the data acquisition site system.

[0046] (A-1-3. Data Acquisition Base System 2000) Fig. 3 is a configuration diagram of a data acquisition base system according to one embodiment of the present invention. The data acquisition base system includes a communications infrastructure management system 2100, an aircraft flight operation system 2200, an operation determination system 2300, a data processing unit 2400, an flight management system 2500, and an airspace monitoring system 2600.

[0047] If the aircraft is an unmanned aircraft, the data acquisition base system 2000 is a system that exchanges control information regarding the aircraft's flight section and sensing section with the aircraft, enabling remote control or data acquisition by a pilot (user) using the data acquisition base system. On the other hand, if the aircraft is a manned aircraft, the system exchanges control information and aircraft status information regarding the aircraft's flight section and sensing section with the aircraft, supporting data acquisition by the aircraft. The data acquisition base system may be composed of a mobile vehicle, ship, aircraft, etc., or may be composed of a non-moving, immovable building (fixed type).

[0048] The communication infrastructure management system 2100 is a system that manages communication means for data (acquired data or processed data) and control communication information transmitted and received between the data acquisition base system 2000 and the aircraft 1000, the data processing base system 3000, and the distribution system 4000. The communication infrastructure management system 2100 transmits, for example, information generated by the aircraft flight operation system 2200 and the work determination system 2300 (described below) to the aircraft 1000. The communication infrastructure management system 2100 also monitors the communication speed as well as the availability of communication through the existing infrastructure, and transmits and receives data according to the processing means and communication means for data transmission determined by the work determination system (described below). The transmission process may be, for example, parallel transmission or switched transmission. Furthermore, if the work determination system 2300 (described below) determines that data should be transmitted by physically transporting the memory by a person, the communication infrastructure management system 2100 may display this information on an appropriate display unit and request an administrator to physically transport the memory.

[0049] The aircraft flight operating system 2200 is a system that generates a mission for the aircraft to be operated and controls the movement of the aircraft. The mission is, for example, a movement plan including the movement route and movement speed of the aircraft 1000, and the movement route is generated in an airspace at an altitude of, for example, 150 m or less to avoid interference with passenger aircraft and the like. The aircraft flight operating system 2200 transmits a control signal to the aircraft 1000 via the communication infrastructure management system 2100 to operate the aircraft automatically.

[0050] The flight operations management system 2500 is a system that makes decisions and gives instructions for the operation of the aircraft 1000. The flight operations management system 2500 prepares plans for the aircraft 1000, including, for example, sensing and flight, and transmits the plans to the aircraft 1000 via the communication infrastructure management system 2100. The flight operations management system 2500 may also determine the priorities of the tasks that require processing and transmit them to the aircraft 1000. The flight operations management system 2500 may prepare plans for multiple aircraft 1000 and transmit information about the plans to each aircraft 1000.

[0051] The airspace monitoring system 2600 is a system that monitors the airspace in which the aircraft 1000 to be piloted is flying. The airspace monitoring system 2600 acquires information from an existing air traffic control system. The air traffic control system may be, for example, a drone traffic management system (UTM), an air traffic management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace monitoring system 2600 measures or acquires information about the environment and other aircraft in the airspace in which the aircraft 1000 is flying, and transmits the information to the flight management system 2500. If there is a problem with the work plan for the aircraft 1000 based on the information from the airspace monitoring system 2600, the flight management system 2500 changes the work plan.

[0052] The work determination system 2300 determines the processing means for the acquired data acquired by the aircraft 1000. Because the amount of acquired data is enormous, unless the transmission path and data processing of the acquired data are appropriately determined, the total time until the processed data is provided to the user terminal device cannot be shortened. Therefore, the work determination system 2300 determines the processing means that will shorten the total time until the processed data is provided to the user terminal device, and transmits the determination result to the aircraft 1000, data processing base system 3000, and distribution system 4000 via the communication infrastructure management system 2100. The detailed functions of the work determination system 2300 will be described later.

[0053] When the operation determination system 2300 determines that data processing is to be performed within the data acquisition base system, the data processing unit 2400 processes the acquired data acquired by the aircraft 1000. The data processing unit 2400 is configured, for example, as a workstation so that it can execute data processing that involves a relatively large processing load. A specific example of the data processing executed here is the same as the specific example of data processing described in the explanation of the data processing unit 1500.

[0054] (A-1-4. Data Processing Base System 3000) Fig. 4 is a configuration diagram of a data processing base system according to one embodiment of the present invention. The data processing base system comprises a communication unit 3100 and a data processing unit 3200.

[0055] The communication unit 3100 transmits and receives data (acquired data or processed data) between the data processing base system 3000 and external systems (aircraft 1000, data acquisition base system 2000, and distribution system 4000). The communication unit 3100 receives acquired data from, for example, the aircraft 1000 or the data acquisition base system 2000. The communication unit 3100 also transmits processed data generated in the data processing base system 3000 to the distribution system 4000.

[0056] When the work determination system 2300 determines that data processing is to be performed within the data processing base system, the data processing unit 3200 acquires the acquired data acquired by the aircraft 1000 via the communication unit 3100 and performs the data processing.

[0057] (A-1-5. Distribution System 4000) Fig. 5 is a configuration diagram of a distribution system according to one embodiment of the present invention. The distribution system 4000 comprises a communication unit 4100 and a distribution data management unit 4200.

[0058] The communication unit 4100 receives processed data from any one of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. The received processed data may be data that has undergone web optimization processing in the data processing performed in the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000. The communication unit 4100 also distributes the processed data to user terminal devices, including crisis management headquarters terminals, via an Internet line.

[0059] The distribution data management unit 4200 records the processed data received via the communication unit 4100, and distributes the latest processed data recorded in the distribution data management unit 4200 to user terminal devices, including device countermeasure headquarters terminals, accessed via an Internet line.

[0060] (A-1-6. Task Determination System 2300) Figure 6 is a functional configuration diagram of a task determination system according to one embodiment of the present invention. The task determination system 2300 comprises an acquired data amount estimator 2310, a data processing location candidate generator 2320, a required time estimator 2330, a processing means determiner 2340, a processing means determination unit 2350, and a processing execution command unit 2360.

[0061] (A-1-6-1. Acquired Data Amount Estimation Unit 2310) The acquired data amount estimation unit 2310 predicts the total amount of acquired data (defined in, for example, gigabytes, terabytes, etc.) before the sensing process by the aircraft begins, or at least before the sensing process is completed. The total amount of acquired data can be predicted based on data sensing conditions such as information about the sensing range, the type of sensor related to the amount of data per unit area, and setting parameters. Here, information about the sensing range can be defined based on, for example, the aircraft's planned flight path, planned flight time, the sensing target area on the Earth's surface, or the range of the planned flight airspace. Furthermore, the type of sensor can be, for example, an optical camera, an infrared camera, or a laser sensor including LiDAR. Setting parameters are defined by, for example, the resolution of the acquired image and the point cloud density of the point cloud data. Note that information about the estimated total amount of data may be displayed on a display device.

[0062] (A-1-6-2. Data processing location candidate generation unit 2320) The data processing location candidate generation unit 2320 identifies systems that are equipped with a data processing unit that can perform data processing among the aircraft 1000, data acquisition base system 2000, and data processing base system 3000, which are the subsystems that make up the aviation data processing system 1. For example, the data processing location candidate generation unit 2320 may communicate with the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 to obtain information regarding the presence or absence of a data processing unit, or may obtain information regarding the presence or absence of a data processing unit that is pre-recorded in the acquisition data amount estimation unit 2310.

[0063] The data processing location candidate generation unit 2320 also identifies variations in transmission routes between the subsystems that make up the aviation data processing system 1, namely the aircraft 1000, the data acquisition base system 2000, the data processing base system 3000, and the distribution system 4000. Specifically, it identifies variations in transmission routes for transmitting acquired data and processed data from the time when acquired data acquired by the aircraft 1000 is processed in one of the subsystems until the processed data is transmitted to the distribution system. This information on variations in transmission routes may be pre-recorded in the acquired data amount estimation unit 2310, or the data processing location candidate generation unit 2320 may generate variations in communication routes based on information on the presence or absence of a data processing unit.

[0064] Here, there may be an embodiment in which the processed data is transmitted directly to the user terminal device without going through the distribution system. In such a case, the variations in the transmission paths for transmitting the acquired data and processed data are understood, from when the acquired data acquired by the aircraft 1000 is processed in one of the subsystems until the processed data is sent to the user terminal device.

[0065] Figure 8 is a table showing an example of patterns of data transmission paths and data processing locations in an aviation data processing system. The example shown in Table T102 in Figure 8 shows processing method patterns that combine variations in the locations where data analysis is performed (referred to in the table as "data analysis implementation locations") and variations in the data transmission paths between each system, in a case where the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 each have a data processing unit. The data processing location candidate generation unit 2320 generates pattern information of locations where data analysis is performed and transmission paths, such as that shown in Table T102 in Figure 8.

[0066] A01, A02-1, A02-2, and A03 in Table T102 indicate patterns where data analysis is performed onboard an aircraft. A01 indicates a pattern where processed data is transmitted directly from the aircraft to the distribution system. A02-1 and A02-2 indicate patterns where processed data is transmitted from the aircraft to the distribution system via a data acquisition center system. In particular, A02-1 indicates that processed data is transmitted from the aircraft to the data acquisition center system via wireless communication, whereas A02-2 indicates that processed data is transmitted from the aircraft to the data acquisition center system by physically moving the memory device, i.e., by landing the aircraft and physically bringing the memory installed onboard the aircraft to the data acquisition center system. A03 indicates a pattern where processed data is transmitted from the aircraft to the distribution system via a data processing center system.

[0067] P01, P02-1, P02-2, and P02-3 in Table T102 indicate patterns where data analysis is performed within a data processing center system. P01 indicates a pattern where acquired data is transmitted directly from an aircraft to the data processing center system via communications. P02-1, P02-2, and P02-3 indicate patterns where acquired data is transmitted to the data processing center system via a data acquisition center system. P02-1 indicates a pattern where both transmission from the aircraft to the data acquisition center system and transmission from the data acquisition center system to the data processing center system are via communications. P02-2 indicates a pattern where the transmission method for acquired data from the aircraft to the data acquisition center system is physical movement of a memory device. P02-3 indicates a pattern where both transmission from the aircraft to the data acquisition center system and transmission from the data acquisition center system to the data processing center system are physical movement of a memory device.

[0068] C01-1 and C01-2 in Table T102 indicate patterns where data analysis is performed within a data acquisition site system. C01-1 is a pattern where acquired data is transmitted from an aircraft to a data acquisition site system via communication, while C01-2 is a pattern where acquired data is transmitted from an aircraft to a data acquisition site system by physically moving a memory device.

[0069] (A-1-6-3. Required time estimation unit 2330) The required time estimation unit 2330 estimates the total time required from when the data acquired by the aircraft 1000 is processed in one of the subsystems until the processed data is transmitted to the distribution system (or user terminal device). The required time estimation unit 2330 includes a communication speed determination unit 2331, a data processing speed determination unit 2332, and a total time estimation unit 2333.

[0070] (A-1-6-3-1. Communication speed determination unit 2331) The communication speed determination unit 2331 determines the communication speed for each of the multiple communication means for each transmission path determined by the data processing location candidate generation unit 2320. Furthermore, it determines the communication means with the fastest communication speed among the multiple communication means. The communication speed is determined, for example, by acquiring information measured by the communication status determination unit 1430 of the aircraft 1000 or a communication infrastructure management system. Note that while it is desirable to determine the communication speed from the measurement value of the communication speed at the current time, it may also be determined from the measurement value of the communication speed measured in the past.

[0071] FIG. 9 is a table showing an example of the communication speeds of communication means for each data transmission path in the aviation data processing system. For example, as shown in Table T103 in FIG. 9 , three types of communication means are possible for the transmission path from the aircraft 1000 to the data acquisition base system 2000: direct wireless communication using radio waves in the 2.4 GHz band (referred to as "Direct 2.4G" in the table), satellite communication using a relay via an artificial satellite (referred to as "Satellite Relay" in the table), and wireless communication using a mobile phone communication line such as LTE (Long Term Evolution) (referred to as "Mobile Phone Communication Line (LTE)" in the table). Therefore, the communication speed determination unit 2331 determines the communication speed for each of these communication means. The communication speed estimation information shown in FIG. 9 may be displayed on a display device of the operation determination system.

[0072] In the example shown in Table T103 of Figure 9, the communication speeds of satellite relay and mobile phone communication lines (LTE) are further grasped as communication means on the transmission path from the aircraft 1000 to the data processing base system 3000, the communication speeds of satellite relay and mobile phone communication lines (LTE) are grasped as communication means on the transmission path from the aircraft 1000 to the distribution system 4000, the communication speed of the mobile phone communication line (LTE) is grasped as communication means on the transmission path from the data acquisition base system 2000 to the data processing base system 3000, the communication speed of the mobile phone communication line (LTE) is grasped as communication means on the transmission path from the data acquisition base system 2000 to the distribution system 4000, and the communication speed of the wired line is grasped as communication means on the transmission path from the data processing base system 3000 to the distribution system 4000.

[0073] In the example shown in Table T103 of Figure 9, four types of communication means are used: direct 2.4G, satellite relay, mobile phone communication line (LTE), and wired line. However, the communication means are not limited to these, and other mobile phone communication lines such as 4G and 5G, or Wi-Fi lines, etc. can also be used.

[0074] When determining the communication speed, if a communication means that goes through multiple devices, such as satellite communication, is used, the communication speed between each device is measured, and the slowest communication speed within the communication path is determined to be the actual communication speed. For example, if satellite communication is used as the communication means for the transmission path from an aircraft to a data acquisition base system, the communication speeds from the aircraft to the satellite and from the satellite to the data acquisition base system are measured, and the slower of the two communication speeds is determined to be the actual communication speed of the satellite communication.

[0075] (A-1-6-3-2. Data processing speed determination unit 2332) The data processing speed determination unit 2332 determines the data processing speed for each subsystem (aircraft 1000, data acquisition base system 2000, data processing base system 3000) that can perform the data processing identified by the data processing location candidate generation unit 2320. Here, the data processing speed may be determined by measuring the processing speed when data processing is actually performed in each system, or may be determined based on a rated processing speed that is identified in advance.

[0076] If there is a data processing task currently being executed in any of the data processing units of the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000, the actual processing speed may be calculated based on the progress or scheduled end time of the currently executing data processing task. Alternatively, if there is a data processing task scheduled to be executed in the future in the data processing unit, the actual processing speed may be calculated based on the time required to complete the data processing task or the scheduled end time.

[0077] Figure 10 is a table showing an example of the data processing speed of each subsystem constituting the aviation data processing system. For example, as shown in Table T104 of Figure 10, the analysis speed of each data processing unit installed in the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 is determined. In the example shown in T104, the analysis speed of each data processing unit is 4 GHz for the data processing unit of the aircraft, 8 GHz for the data processing unit of the data acquisition base system, and 24 GHz for the data processing unit of the data processing base system. The communication speed estimation information shown in Figure 10 may be displayed on a display device of the operation determination system.

[0078] (A-1-6-3-3. Total time estimation unit 2333) The total time estimation unit 2333 estimates the data transmission time and data processing time for each pattern of data analysis execution location and transmission route generated by the data processing execution location candidate generation unit 2320, and estimates the total time taking the data transmission time and data processing time into consideration.

[0079] First, a method for estimating the data processing time for a data analysis execution location pattern will be described. The total time estimation unit 2333 estimates the data processing time for each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 based on both or at least one of information on the data amount of acquired data estimated by the acquired data amount estimation unit 2310 and information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2332.

[0080] As shown in Table T101 in Figure 7, there are multiple patterns of data processing performed by the data processing unit. Therefore, when estimating the data processing time, the data processing time in each data processing unit installed in the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 may be estimated based on the content of the data processing in addition to the information on the amount of acquired data and the analysis speed of each data processing unit as described above.

[0081] In the example shown in Table T104 of Figure 10, the analysis speed of the data processing unit of the data processing center system is faster than that of the data processing unit of the other aircraft 1000 and the data acquisition center system, so the data processing time is shortest for the data processing center system, followed by the data acquisition center system, and longest for the aircraft.

[0082] Next, a method for estimating the transmission time for each pattern of data transmission path will be described. The total time estimation unit 2333 estimates the transmission time for the acquired data for each transmission path based on both or at least one of information on the data amount of acquired data estimated by the acquired data amount estimation unit 2310 and information on the communication speed for each transmission path determined by the communication speed determination unit 2331. Furthermore, since the transmitted data includes not only the acquired data but also post-processing data and data for processing, the transmission time required for transmitting each of the post-processing data and data for processing is also estimated.

[0083] The transmission time of the processed data is estimated by estimating the amount of processed data from the amount of acquired data, and estimating the transmission time of the processed data on each transmission path based on information on the communication speed for each transmission path of the processed data.

[0084] Furthermore, if the content of the data processing requires processing data such as those shown in Nos. 004 to 008 in Table T101, the processing data recorded in the processing data recording unit 3300 of the data processing base system is transmitted to the data processing unit that executes the data processing. Therefore, the transmission time of the processing data on each transmission path is estimated based on the amount of processing data previously recorded in the processing data recording unit 3300 and information on the communication speed for each transmission path of the processing data.

[0085] Here, the acquired data is a sensed image or point cloud data, so the amount of data is larger than the processed data. For example, the amount of data in the processed data is about 1 / 10 of the amount of data in the acquired data. Also, although it varies depending on the analysis content shown in Table T101, the amount of data in the processing data is equal to or less than the amount of data in the processed data.

[0086] Next, we will explain how the total time estimation unit 2333 estimates the total time by taking into account the data transmission time and data processing time estimated by the above-mentioned method. First, for each processing means pattern shown in Table T102, the total time can be estimated by adding the transmission time and data processing time. It is desirable to adopt this estimation method when some of the data transmission and data processing processes are not executed in parallel or when the parallel processing time is short.

[0087] On the other hand, if some of the processes from data sensing to transmission of processed data to the user terminal device are executed in parallel, it is desirable to estimate the total time taking into account the processes executed in parallel. Therefore, a method for estimating the total time when taking into account the processes executed in parallel will be described below.

[0088] The processes that must be considered to calculate the total time are sensing processing, transmission processing of acquired data, data processing, and transmission processing of processed data, and some of the processes that are performed one after the other in chronological order can be executed in parallel. Each pattern will be explained in detail below.

[0089] [Parallel Processing of Sensing Processing and Data Processing / Data Processing on the Aircraft] As shown in A01, A02-1, A02-2, and A03 in Table T102, in a pattern in which data processing is performed on the aircraft 1000, it is possible to execute part of the sensing processing by the aircraft and the data processing by the aircraft in parallel. Therefore, the time available for parallel execution of the sensing processing and data processing is obtained, and the total time is calculated by subtracting this time available for parallel execution from the data processing time by the aircraft. Note that the time available for parallel execution of the sensing processing and data processing may use information registered in the system in advance, or may be calculated based on a predetermined ratio of the amount of acquired data estimated by the acquired data amount estimation unit 2310.

[0090] [Parallel Processing of Sensing and Transmission Processing / Data Processing in a Data Acquisition Center System or a Data Processing Center System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, in a pattern in which data processing is performed in the data acquisition center system 2000 or the data processing center system 3000, it is possible to execute the sensing processing by the aircraft and a portion of the transmission processing of the acquired data from the aircraft in parallel. Therefore, the time available for parallel execution of the sensing processing and transmission processing is obtained, and the total time is calculated by subtracting this available time from the processing time for the transmission of acquired data from the aircraft (1). The calculated total time information is displayed on the display device. The available time for parallel execution may be calculated using information previously registered in the system, or may be calculated based on a predetermined percentage of the estimated amount of acquired data.

[0091] [Parallel Processing of Acquired Data Reception Processing and Data Processing / Data Processing at a Data Acquisition Center System or a Data Processing Center System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, in the pattern of performing data processing at the data acquisition center system 2000 or the data processing center system 3000, it is possible to execute the acquisition data reception processing from the aircraft and part of the data processing in parallel at the data acquisition center system 2000 or the data processing center system 3000. Therefore, the parallel execution time for this reception processing (transmission processing) and data processing is obtained, and the parallel execution time is subtracted from the processing time and data processing time for Acquired Data Transmission (1) to calculate the total time. The calculated total time information is displayed on the display device. Note that the parallel execution time may be calculated using information previously registered in the system, or may be calculated based on a predetermined ratio of the estimated amount of acquired data.

[0092] [Parallel Processing of Acquired Data Reception and Transmission / Data Processing at a Data Processing Center System] As shown in P02-1, P02-2, and P02-3 in Table T102, in a pattern in which acquired data is transmitted to data processing center system 3000 via data acquisition center system 2000 and data processing is performed at the data processing center system, it is possible for data acquisition center system 2000 to execute a portion of the acquisition data reception process from the aircraft and the transmission process of the acquired data to the data processing center system in parallel. Therefore, the parallel execution time for the reception process (transmission process) and the transmission process (transmission process) is obtained, and the total time is calculated by subtracting this parallel execution time from the processing time for Acquired Data Transmission (1) and the processing time for Acquired Data Transmission (2). The calculated total time information is displayed on a display device. The parallel execution time may be calculated using information previously registered in the system, or may be calculated based on a predetermined percentage of the estimated amount of acquired data.

[0093] [Parallel Processing of Data Processing and Post-Processing Data Transmission Processing / Data Processing on the Aircraft] As shown by A01, A02-1, A02-2, and A03 in Table T102, in a pattern in which data processing is performed on the aircraft 1000, it is possible to execute part of the data processing by the aircraft and part of the transmission processing of the post-processing data in parallel. Therefore, the time available for parallel execution of this data processing and the transmission processing of the post-processing data is obtained, and the total time is calculated by subtracting this available time from the data processing time by the aircraft and the transmission processing time of the post-processing data. The calculated total time is displayed on the display device. The available time for parallel execution may use information previously registered in the system, or may be calculated based on a predetermined percentage of the amount of acquired data estimated by the acquired data amount estimation unit 2310.

[0094] [Parallel Processing of Data Processing and Post-Processing Data Transmission Processing / Data Processing at a Data Acquisition Site System or a Data Processing Site System] As shown in P01, P02-1, P02-2, P02-3, C01-1, and C01-2 in Table T102, when data processing is performed at the data acquisition site system 2000 or the data processing site system 3000, it is possible to execute part of the data processing and part of the post-processing data transmission processing in parallel at the data acquisition site system 2000 or the data processing site system 3000. Therefore, the time available for parallel execution of this data processing and post-processing data transmission processing is obtained, and the total time is calculated by subtracting this available time from the data processing and post-processing data transmission time. The calculated total time information is displayed on a display device. The available time for parallel execution may be calculated using information previously registered in the system, or may be calculated based on a predetermined percentage of the estimated amount of acquired data.

[0095] (A-1-6-4. Processing means determination unit 2340) The processing means determination unit 2340 determines the pattern of data processing execution locations and transmission routes that will result in the shortest total time estimated by the total time estimation unit 2333. Specifically, it determines the pattern that will result in the shortest total time from each pattern such as those shown in Table T102.

[0096] (A-1-6-5. Processing means determination unit 2350) The processing means determination unit 2350 determines a pattern for executing processing based on the data processing execution location and transmission path pattern determined by the processing means determination unit 2340. The processing means determination unit 2350 includes a processing means suggestion unit 2351 and a processing means selection reception unit 2352.

[0097] (A-1-6-5-1. Processing means suggestion unit 2351) The processing means suggestion unit 2351 suggests to the user one or more candidate patterns for the data processing execution location and transmission path determined by the processing means determination unit 2340. For example, the suggestion is made to the user by displaying the proposed candidate pattern on an output device (such as a display device) of the task determination system.

[0098] (A-1-6-5-2. Processing means selection receiving unit 2352) The processing means selection receiving unit 2352 receives approval or selection of one or more candidate patterns of processing means proposed to the user by the processing means suggestion unit 2351 via an input device of the task assessment system (a touch panel, keyboard, mouse, or audio input device such as a microphone). The processing means determination unit 2350 determines the processing means based on the approval or selection input received from the user. Detailed methods of proposal and selection reception by the processing means suggestion unit 2351 and the processing means selection receiving unit 2352 will be described later.

[0099] It should be noted that the determination of the processing means by the processing means determination unit 2350 is not limited to the method of determining the processing means based on approval or selection input received from the user as described above. For example, the pattern determined by the processing means determination unit 2340 can be automatically determined without approval or selection by the user.

[0100] (A-1-6-6. Processing execution command unit 2360) The processing execution command unit 2360 transmits operation commands based on the processing means pattern determined by the processing means determination unit 2350 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Furthermore, if the content of the data processing requires processing data such as those shown in Nos. 004 to 008 of Table T101, the operation command transmitted to the data processing base system 3000 includes a request command to transmit the processing data recorded in the processing data recording unit 3300 of the data processing base system to the data processing unit that executes the data processing.

[0101] The aircraft 1000, data acquisition base system 2000, and data processing base system 3000 that receive the operation command from the processing execution command unit 2360 execute the operation tasks (including data transmission and data processing) of their own systems in the processing means pattern determined in accordance with the operation command.

[0102] <Hardware Configuration> Figure 11 shows an example of the hardware configuration of an activity determination system. Here, the activity determination system 2300 of the present invention is an information processing device such as a server device or a PC. As shown in the figure, the activity determination system 2300 has an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary memory device 500, a communication device 600, and a bus 700 that electrically connects these devices.

[0103] The input device 100 is a device that allows a user to input information and instructions to the task determination system. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.

[0104] The output device 200 is a device that outputs information generated by the activity determination system 2300. Specifically, the output device 200 is a display device (including eyewear, AR, VR display devices, etc.), a printer, or a speaker.

[0105] The processing device 300 is, for example, a device that performs arithmetic processing. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing calculations.

[0106] The main storage device 400 is a memory device such as a RAM that temporarily stores various read information and a ROM that stores programs, application programs, and other various information executed by the processing device 300. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that can store digital information.

[0107] The communication device 600 is a device that performs wireless or wired information communication with an external device.

[0108] Note that while Figure 11 explains the hardware configuration of the work determination system, other systems within the data acquisition base system 2000 (communications infrastructure management system 2100, aircraft operation operating system 2200, data processing unit 2400, operation management system 2500, airspace monitoring system 2600), data processing base system 3000, distribution system, and user terminal devices (including crisis management headquarters terminals) can also be realized with a hardware configuration similar to that shown in Figure 11 above.

[0109] <Control Flow> (A-1-7. Upper Control Flow of the Aviation Data Processing System) Next, the control flow of the aviation data processing system will be described with reference to the drawings. Figure 12 is a flowchart showing the processing flow by the aviation data processing system.

[0110] First, the acquired data amount estimation unit 2310 estimates the total amount of acquired data (step 101). Note that this step is executed before the sensing operation by the aircraft is started, or at least before the sensing operation is completed.

[0111] Next, the data processing location candidate generation unit 2320 grasps variations in data processing locations and transmission routes (step 102). Specifically, it grasps patterns A01 to C01-2 as shown in Table T102 of FIG.

[0112] Next, the communication speed determination unit 2331 of the required time estimation unit 2330 determines the communication speed for each of the multiple communication means on each transmission path (step 103).

[0113] Next, the data processing speed determination unit 2332 of the required time estimation unit 2330 determines the processing speed of data processing at each data analysis execution location (step 104).

[0114] Next, the total time estimation unit 2333 of the required time estimation unit 2330 estimates the total time taking into account the data transmission time and data processing time for each of the generated patterns of data analysis execution locations and transmission routes (step 105).

[0115] Next, the processing means determination unit 2340 of the required time estimation unit 2330 determines the processing means pattern that will minimize the total time, and the processing means determination unit 2350 receives approval or selection input from the user and determines the processing means pattern (step 106). Note that this step is executed before the sensing operation by the aircraft is started, or at least before the sensing operation is completed. Here, the criterion for determining the processing means pattern by the processing means determination unit 2340 is not necessarily limited to the shortest total time, but may be a determination criterion that preferentially selects a processing means pattern that utilizes a transmission route with high communication speed, short transmission time, and strong communication strength.

[0116] Next, the processing execution command unit 2360 sends an operation command based on the processing means pattern determined by the processing means determination unit 2350 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, and causes the processing to be executed (step 107).

[0117] (A-1-8. Control Flow for Estimating the Total Amount of Acquired Data) Figure 13 is a flowchart showing the processing flow performed by the aviation data processing system when estimating the total amount of acquired data. In particular, it is a detailed flowchart of the processing performed by the acquired data amount estimation unit 2310 in step 101 of Figure 12 to predict the total amount of acquired data.

[0118] First, the acquired data amount estimation unit 2310 determines the data acquisition conditions (step 201). The data acquisition conditions include information about the sensing range, the type of sensor and setting parameters related to the amount of data per unit area, etc. Here, the information about the sensing range can be defined based on, for example, the planned flight path of the aircraft, the planned flight time, the sensing target range on the Earth's surface, or the range of the planned flight airspace. Furthermore, the type of sensor can be, for example, an optical camera, an infrared camera, or a laser sensor including LiDAR. The setting parameters are defined by, for example, the resolution of the captured image and the point cloud density of the point cloud data.

[0119] Next, the acquired data amount estimation unit 2310 estimates the total amount of acquired data (step 202). The total amount of acquired data can be estimated using at least one of the above-mentioned information about the sensing range and information about the amount of data per unit area. Estimating the total amount of acquired data based on both the information about the sensing range and the information about the amount of data per unit area allows for a more accurate estimation of the total amount of acquired data. For example, if the sensor type is an optical camera and the resolution of the captured images is known, and the planned flight route is known as the sensing range, the amount of data per captured image can be estimated based on the resolution information. Furthermore, the number of images to be captured along the route can be roughly predicted based on the planned flight route. Therefore, the total amount of acquired data can be estimated by multiplying the amount of data per captured image by the number of images.

[0120] Next, the acquired data amount estimation unit 2310 determines whether the estimated total amount of acquired data is greater than a predetermined value (step 203). Here, the predetermined value can be set to, for example, about 30 GB.

[0121] Next, if it is determined in step 203 that the estimated total amount of acquired data is greater than a predetermined value, the process proceeds to step 102 in FIG. 12 "identify data processing locations and transmission route candidates" (step 204).

[0122] Next, if it is determined in step 203 that the total amount of acquired data estimated is equal to or less than a predetermined value, the analysis execution location and transmission route that are set as defaults in advance are determined as processing means (step 205).

[0123] Next, the process proceeds to step 107 "execute processing" in FIG. 12, where the determined processing means is executed (step 204).

[0124] 13, whether or not to execute processing using a preset default processing means is determined depending on whether the total data volume of the acquired data exceeds a predetermined reference value (e.g., approximately 100 MB), thereby eliminating the need for unnecessary processing means pattern selection. In other words, if the total data volume of the acquired data is equal to or less than the predetermined reference value, the total data volume is small enough that no matter which subsystem processes the data, there is little effect on the total time, and therefore, comparing the default processing means with the processing means that results in the shortest total time will not result in much time savings. In such cases, the processing means pattern selection process is not performed, and the process proceeds to step 107, where processing is executed according to the preset default data processing execution location and transmission path.

[0125] (A-1-9. Control flow for estimating total processing time) Figure 14 is a flowchart showing the processing flow performed by the aviation data processing system when estimating the total processing time. In particular, it is a detailed flowchart for estimating the total processing time by the total time estimation unit 2333 in step 105 of Figure 12.

[0126] First, the total time estimation unit 2333 estimates the data sensing time (step 301). Here, the data sensing time can be determined based on information about the sensing range acquired by processing by the acquired data amount estimation unit 2310, or the total amount of acquired data. Information about the sensing range is, for example, the planned flight route of the aircraft, the planned flight time, the sensing target range on the ground, or the range of the planned flight airspace.

[0127] Next, the total time estimation unit 2333 estimates the data transmission time via the communication line (step 302). Specifically, the transmission time for each of the acquired data, processed data, and processing data via each transmission path is estimated based on information on the data amount of the acquired data, processed data, and processing data estimated by the acquired data amount estimation unit 2310, and information on the communication speed of the communication means with the fastest communication speed for each transmission path determined by the communication speed determination unit 2331.

[0128] Next, the total time estimation unit 2333 estimates the data transmission time due to physical movement (step 303). In the patterns A02-2, P02-2, P02-3, and C01-2 in Table T102, data transmission is performed by physically moving the memory device, so the data transmission time for the section in which data transmission by physical memory movement occurs in these patterns is estimated. For example, for the physical memory movement from an aircraft to a data acquisition center system, the estimated required time may be recorded in advance as the time required from the aircraft's landing at the data acquisition center system until the memory is removed from the aircraft's fuselage and the acquired data is read from the memory. Furthermore, for the physical memory movement from a data acquisition center system to a data processing center system, the estimated required time may be recorded in advance as the time required from the data acquisition center system to the data processing center system until the acquired data is read from the memory, in addition to the travel time from the data acquisition center system to the data processing center system.

[0129] Next, the total time estimation unit 2333 estimates the data analysis time (step 304). The total time estimation unit 2333 estimates the data processing time in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, based on information on the data amount of acquired data estimated by the acquired data amount estimation unit 2310 and information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2332.

[0130] Next, the total time estimation unit 2333 checks whether parallel work is possible to perform each process in parallel when the aircraft sensing process, acquired data transmission process, data processing, and post-processing data transmission process are performed in the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 (step 305).

[0131] Next, the total processing time is estimated by the total time estimation unit 2333 (step 306). If parallel work is not possible as a result of checking whether parallel work is possible in step 305, the total required time is estimated by adding the transmission time and data processing time for each processing means pattern shown in Table T102. In this case, the data sensing time may also be added to estimate the total required time.

[0132] Conversely, if parallel work is possible as a result of checking whether parallel work is possible in step 305, the parallel execution time of each process is obtained for each processing means pattern shown in Table T102, and the parallel execution time is subtracted from the processing time of processes that can be performed in parallel to estimate the total required time.

[0133] 15 shows an example of the estimated total processing time taking parallel processing into account when estimating the total processing time. Fig. 15 shows an example of the estimated total processing time for each of patterns A01, A02-2, and P01 in Table T102, when it is determined that at least a portion of the processing can be performed in parallel.

[0134] In A01, data to be processed is received from the data processing base system in parallel within the aircraft during the execution period of the sensing process. Furthermore, the first half of the data processing is performed in parallel within the execution period of the sensing process. The second half of the data processing and the first half of the post-processing data transmission process are also performed in parallel. Therefore, the total processing time from the start of the sensing work to the completion of transmission of the post-processing data to the distribution system is shorter than the sum of all processing times.

[0135] In A02-2, data to be processed is received from the data processing base system in parallel within the aircraft during the execution period of the sensing process. Furthermore, the first half of the data processing is performed in parallel within the execution period of the sensing process. Furthermore, the aircraft lands at the data acquisition base system while the second half of the data processing is being performed. Thereafter, immediately after the data processing and landing operation are completed, the data acquisition base system reads the memory information within the aircraft in which the processed data is recorded and transmits the read processed data to the distribution system. In the example shown in this figure, the total processing time from the start of the sensing work to the completion of transmitting the processed data to the distribution system is shorter than the sum of all processing times, but the total processing time of A02-2 is longer than the total processing time of A01.

[0136] In P01, acquired data is transmitted to the data processing center system via wireless communication in parallel within the aircraft during the sensing processing period. Furthermore, in the data processing center system, data processing begins when the acquired data transmission processing has progressed approximately 25%. The acquired data transmission processing and data processing are performed in parallel. Furthermore, immediately after the acquired data transmission processing is completed, the transmission processing of the processed data to the distribution system begins. The data processing and the transmission processing of the processed data are performed in parallel. In the example shown in this figure, the total processing time from the start of the sensing operation to the completion of transmission of the processed data to the distribution system is shorter than the sum of all processing times. Therefore, the total processing time of P01 is longer than the total processing time of A01, but shorter than the total processing time of A02-2.

[0137] (A-1-10. Control flow when determining processing means) Figure 16 is a flowchart showing the processing flow performed when the aviation data processing system determines the processing means. In particular, it is a detailed flowchart when determining the processing means in step 106 of Figure 12.

[0138] First, the processing means determination unit 2340 determines the candidate processing means pattern that will have the shortest total processing time (step 401). Here, the total processing times of the candidate processing means patterns estimated in step 306 are compared to determine the candidate processing means pattern that will have the shortest total processing time. If the result of calculating the total processing time of each candidate processing means pattern is as shown in Fig. 15, "A01" with the shortest total processing time is determined to be the candidate pattern.

[0139] Next, the processing means determining unit 2350 displays the determined processing means pattern candidates on a display device or the like (step 402).

[0140] Next, the processing means determination unit 2350 accepts approval from the user for the processing means pattern candidates displayed on the display device or the like, or receives a command input for the processing means pattern (step 403).

[0141] Next, the processing means determination unit 2350 determines a processing means pattern (step 404). Here, in this step, the processing means determination unit 2350 may determine the processing means pattern that has the shortest total processing time determined by the processing means determination unit 2340 as the processing means pattern, regardless of whether the candidate processing means pattern is approved or designated by the user.

[0142] 17 is a diagram showing an example of a display screen displayed on a display device when the aviation data processing system determines a processing means. This diagram shows processing means pattern candidates that the processing means determination unit 2350 displays on the display device of the operation determination system in step 402.

[0143] As shown in Figure 17, information on the estimated total processing time for each of multiple processing means patterns is displayed on the screen, and the processing means pattern with the shortest total processing time is highlighted as a suggested candidate. The highlighted processing means pattern candidate does not necessarily have to be a single one; multiple patterns may be highlighted as suggested candidates. In the example shown in Figure 17, A01 is highlighted as the pattern candidate with the shortest total processing time, but the other patterns, A02-2 and P01, are also highlighted as second and third candidates.

[0144] 17, the user can select and input any pattern from the multiple processing means patterns displayed, and detailed information of the selected A01 is displayed in a pop-up. The detailed information can include, for example, the processing process (information on processing items and processing order) and the processing time for each processing process (data acquisition time, acquired data transmission time, processed data transmission time, data processing time, etc.).

[0145] 17 also shows an example in which the processing means determination unit 2350 receives user approval or designation input for the processing means pattern candidates displayed on the display device in step 403. Specifically, when the user selects A01 from the multiple processing means patterns displayed, A01 is determined as the processing means pattern by selecting the "Determine selected pattern" button on the upper right.

[0146] (A-1-11. Control flow when executing processing means) Figure 18 is a flowchart showing the processing flow performed when the aviation data processing system determines the processing means. In particular, it is a detailed flowchart when the processing is executed in step 107 of Figure 12.

[0147] First, the processing execution command unit 2360 of the work determination system determines whether the communication speed on the transmission path of the processing means pattern determined by the processing means determination unit 2350 has decreased by a predetermined value or more (step 501). If the determination result is YES, the process proceeds to step 505, and conversely, if the determination result is NO, the process proceeds to step 502.

[0148] Next, if the determination result in step 501 is NO, the process execution command unit 2360 of the work determination system outputs an instruction to execute data sensing processing to the aircraft 1000 and aircraft flight operating system 2200 (step 502).

[0149] Next, the processing execution command unit 2360 of the work determination system again determines whether the communication speed on the transmission path of the processing means pattern determined by the processing means determination unit 2350 has decreased by a predetermined value or more (step 503). If the determination result is YES, the process proceeds to step 505, and conversely, if the determination result is NO, the process proceeds to step 504.

[0150] Next, if the judgment result of step 503 is NO, the processing execution command unit 2360 of the work judgment system outputs an instruction to execute data processing to at least one of the data processing units of the aircraft 1000, data acquisition base system 2000, or data processing base system 3000 that has been determined to perform data processing (step 502).

[0151] Next, if the determination result in step 501 or 503 is YES, the process transitions to "Estimation of total processing time" in step 105 shown in Fig. 12. In other words, even after the processing means to be executed has been determined, the measurement of the data communication speed continues, and if the measurement value is updated, the process returns to step 105, whereby the processes of determining the data transmission time, determining the total processing time, and selecting a specific processing means from a plurality of candidate patterns for processing means are performed again based on the measurement value of the data communication speed of the transmission path, and the determination results are displayed on the display device.

[0152] [A-2. Effect of this embodiment] According to the first embodiment described above, in an aeronautical data processing system in which an aircraft acquires data of a sensing target range such as a disaster area using sensors such as a camera or LiDAR device mounted on the aircraft, processes the acquired data, and provides the processed data to a user terminal such as a disaster response headquarters terminal, if the system has multiple data processing units capable of data processing, it is possible to determine which data processing unit should perform the data processing to more quickly or more reliably complete a series of processes (processing up to providing the processed data to the user terminal). Furthermore, in this determination, not only is it possible to select a data processing unit that executes data processing, but there are also multiple possible patterns of transmission paths for the acquired data, processed data, and data to be processed, so it is possible to determine a processing unit pattern that can more quickly or more reliably complete a series of processes from processing unit patterns that also take such transmission path patterns into consideration.

[0153] <B. Second Embodiment> [B-1. Configuration] In the first embodiment described above, an example was described in which a combination pattern of data processing execution locations and transmission routes that minimizes the total processing time was selected when data processing is executed by a data processing unit in one of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. However, it is also possible to share data processing tasks among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Therefore, in this embodiment, an embodiment is described in which a combination pattern of data processing execution locations and transmission routes that minimizes the total processing time is selected when data processing tasks are shared among the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. Note that in the description of this embodiment, configurations that differ from those in the first embodiment described above will be described, and descriptions of the same configurations will be omitted.

[0154] Fig. 19 is a table showing patterns of data transmission paths and data processing locations when an aviation data processing system divides data processing among multiple subsystems. In this embodiment, in addition to the patterns of data transmission paths and data processing locations shown in Fig. 8, the pattern that minimizes the total processing time is selected from among all patterns including patterns in which the data processing task is divided and executed among two or three locations as shown in Fig. 19.

[0155] 19 shows an example in which the data processing task is divided equally into two or three locations in advance, but as a modification, the ratio of the data amount of data processing allocated to each data processing unit may be set to any ratio depending on the ratio of the processing speeds of each data processing unit determined by the data processing speed determination unit 2332. Specifically, the data amount is distributed so that the faster the processing speed of the data processing unit, the greater the data processing load. In this way, by determining the ratio of the allocation amount of acquired data to be allocated depending on the ratio of the processing speeds of the data processing units, it is possible to allocate data processing tasks so as to minimize the time required for data processing.

[0156] As described above, when data processing tasks are shared among multiple data processing units, the processed data after data processing is collected at one of the data processing units, either the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000, where web optimization processing is performed, and the processed data after web optimization processing is transmitted from the data processing unit to the distribution system.

[0157] In each of the above-described embodiments, the work determination system 2300 is implemented within the data acquisition base system 2000, but all or part of the functions of the work determination system 2300 can be implemented in the aircraft 1000, the data processing base system 3000, the distribution system 4000, or other systems.

[0158] [B-2. Effects of this embodiment] According to the second embodiment described above, it is possible to determine the optimal processing means pattern, taking into consideration a pattern in which some of the data processing tasks are distributed among multiple data processing units within the aviation data processing system, and therefore it is possible to determine the processing means that can more quickly complete a series of processes (processing up to providing the processed data to the user terminal).

[0159] <C. Third Embodiment> [C-1. Configuration] In the first and second embodiments described above, a data processing unit is implemented in each of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, and data processing is performed in one or more of these data processing units. However, it is not necessarily required that a data processing unit be implemented in all of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000; it is sufficient that multiple data processing units are implemented in the entire aircraft data processing system. Therefore, an embodiment in which a data processing unit is implemented in at least two locations: the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 may also be used. Alternatively, in the case where the aviation data processing system has a system configuration including multiple aircraft 1000, multiple data acquisition base systems 2000, and multiple data processing base systems 3000, the embodiment may be such that a data processing unit is implemented in each of the multiple aircraft 1000, or in such that a data processing unit is implemented in each of the multiple data acquisition base systems 2000, or in such that a data processing unit is implemented in each of the multiple data processing base systems 3000.

[0160] The first and second embodiments described above are merely examples for facilitating understanding of the present invention, and are not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit thereof, and it goes without saying that the present invention includes equivalents thereof.

[0161] DESCRIPTION OF SYMBOLS 1...Aviation data processing system 100...Input device 200...Output device 300...Processing device 400...Main memory device 500...Auxiliary memory device 600...Communication device 700...Bus 1000...Aircraft 1100...Flight unit 1110...Self-position / speed determination unit 1120...Attitude determination unit 1130...Flight control unit 1200...Sensing unit 1210...Sensor 1220...Sensor attitude control unit 1230...Sensor control unit 1300...Communication unit 1310...Control communication unit 1320...Data communication unit 1330...Status data communication unit 1400...Status determination unit 1410...Flight state determination unit 1420...Sensing state determination unit 1430...Communication state determination unit 1500...Data processing unit 1600...Data recording unit 1610...Acquired data recording unit 1620...Processed data recording unit 1630...Communication status recording unit 2000...Data acquisition base system 2100...Communication infrastructure management system 2200...Aircraft flight operating system 2300...Work determination system 2310...Acquired data amount estimation unit 2320...Data processing implementation location candidate generation unit 2330...Required time candidate generation unit 2331...Communication speed determination unit 2332...Data processing speed determination unit 2333...Total time estimation unit 2340...Processing means determination unit2350... Processing means determination unit 2351... Processing means proposal unit 2352... Processing means selection reception unit 2360... Processing execution command unit 2400... Data processing unit 2500... Flight operation management system 2600... Airspace monitoring system 3000... Data processing base system 3100... Communication unit 3200... Data processing unit 3300... Processing data recording unit 4000... Distribution system 4100... Communication unit 4200... Distribution data management unit 5000... Crisis response headquarters terminal

Claims

1. A work determination system that determines the content of work to be processed by an aviation data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information regarding flight or data acquisition with the aircraft, and a data processing base system that has a data processing unit that processes the data acquired by the sensor, wherein when the data processing unit is provided in at least one of the data processing base system, the aircraft, or the data acquisition base system, and the data processing unit is provided in a plurality of locations within the aviation data processing system, the work determination system displays on a display device a plurality of candidate patterns as to where among the data processing units provided in the plurality of locations data processing should be performed, or a determination result selected or determined as to where among the data processing units provided in the plurality of locations data processing should be performed, or causes data processing to be performed by a data processing unit according to the determination result.

2. An activity judgment system as claimed in claim 1, wherein the activity judgment system estimates a total time including a data processing time required for the data processing for each of a plurality of candidate patterns of the data processing unit that executes the data processing, or displays the total time.

3. The work judgment system according to claim 1, wherein the work judgment system displays on a display device a plurality of candidate combination patterns of the data processing unit which performs the data processing and the transmission path of the acquired data, or a judgment result in which the data processing unit which performs the data processing and the transmission path of the acquired data have been selected or judged, or the work judgment system executes data processing and data transmission processing in accordance with the judgment result.

4. A work determination system as described in claim 3, wherein the work determination system estimates a total time including the data processing time required for the data processing and the data transmission time required for data transmission for multiple candidate patterns that combine the data processing unit that executes the data processing and candidates for the transmission path of the acquired data, or displays the total time.

5. A work determination system as claimed in claim 4, wherein the work determination system estimates the data transmission time based on at least one of information regarding the amount of acquired data transmitted over the transmission path and the data communication speed of the transmission path, or displays the data transmission time.

6. A work determination system as claimed in claim 2 or claim 4, wherein the work determination system estimates the data processing time or displays the data processing time based on at least one of information regarding the amount of acquired data and the data processing speed of the data processing unit which executes the data processing.

7. An activity judgment system as claimed in claim 2 or claim 4, wherein the activity judgment system judges or displays, from among the plurality of candidate patterns, a pattern having the shortest estimated total time, or a pattern having a shorter total time than other candidate patterns.

8. A work determination system according to claim 5, wherein the work determination system estimates the data communication speed based on a measurement value of a past or present data communication speed for each candidate of the transmission route, or displays the data communication speed.

9. A work judgment system as described in claim 5, which estimates or displays the data communication speed of at least one of the communication means of satellite wireless communication using relay by an artificial satellite, direct wireless communication, wireless communication using a mobile phone communication line, and wired communication using a wired line for each candidate of the transmission path.

10. A work determination system as described in claim 9, wherein, when determining the data communication speed for each communication means using a wireless or wired line, the work determination system estimates or displays the communication speed of the section with the slowest communication speed among the communication sections of the communication means as the actual data communication speed in the communication section.

11. A work determination system as claimed in claim 9, wherein when there are multiple communication means available on a certain transmission path, the work determination system determines or displays the communication means determined to have the fastest data communication speed as the communication means of the transmission path.

12. A work judgment system as described in claim 5, wherein the work judgment system estimates the data transmission time including at least one of the transmission time of processed data generated by the data processing and the transmission time of processing data used in the data processing in addition to the transmission time of the acquired data based on at least one of information regarding the amount of acquired data transmitted over the transmission path and the data communication speed of the transmission path, or displays the estimated result.

13. A work judgment system as described in claim 12, wherein the processing data is recorded in the data processing base system, and when a pattern of processing the data is selected or determined in the data processing unit provided in the aircraft or the data acquisition base system, the work judgment system transmits the processing data from the data processing base system to the aircraft or the data acquisition base system.

14. A work judgment system as described in claim 6, wherein when judging the processing speed of data processing in a plurality of data processing units, the work judgment system estimates the processing speed or displays the estimated result based on past or current measurement values ​​of the data processing units or information regarding the processing speed acquired in advance.

15. A work judgment system as described in claim 6, wherein when judging the processing speed of data processing in a plurality of said data processing units, said work judgment system estimates the actual data processing speed or displays the estimated result based on the status of data processing tasks being executed or scheduled to be executed in said plurality of data processing units.

16. A work determination system as described in claim 4, wherein when the aircraft is equipped with the data processing unit, the work determination system estimates the total time according to a parallel operation time during which at least a portion of a sensing operation for acquiring the image or point cloud information by the sensor of the aircraft and a data processing operation by the data processing unit of the aircraft are executed in parallel, or displays the total time.

17. A work determination system as described in claim 4, wherein when the data acquisition base system is equipped with the data processing unit, the work determination system estimates the total time according to a parallel operation time during which at least a portion of the processing operation of the data acquisition base system receiving the acquired data from the aircraft and the data processing operation by the data processing unit of the data acquisition base system are executed in parallel, or displays the total time.

18. A work determination system as described in claim 4, wherein the work determination system estimates the total time based on a parallel operation time during which at least a portion of the processing operation of the data processing base system receiving the acquired data from the aircraft or the data acquisition base system and the data processing operation by the data processing unit of the data processing base system are executed in parallel, or displays the total time.

19. A work determination system as described in claim 4, wherein the work determination system estimates the total time based on a parallel operation time during which at least a portion of a sensing operation of acquiring the image or point cloud information by the sensor of the aircraft and a processing operation of transmitting the acquired data from the aircraft to the data acquisition base system or the data processing base system are executed in parallel, or displays the total time.

20. A work determination system as described in claim 4, wherein the work determination system estimates the total time based on a parallel operation time during which at least a portion of a processing operation in which the data acquisition base system receives the acquired data from the aircraft and a processing operation in which the data acquisition base system transmits the acquired data to the data processing base system are executed in parallel, or displays the total time.

21. A work determination system as described in claim 4, wherein when the aircraft is equipped with the data processing unit, the work determination system estimates the total time according to a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the aircraft and the processing operation of transmitting the data from the aircraft to the outside are executed in parallel, or displays the total time.

22. A work determination system as described in claim 4, wherein when the data acquisition base system is equipped with the data processing unit, the work determination system estimates the total time based on a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the data acquisition base system and the processing operation of transmitting the data processing unit to the outside from the data acquisition base system are executed in parallel, or displays the total time.

23. A work determination system as described in claim 4, wherein the work determination system estimates the total time based on a parallel operation time during which at least a portion of the data processing operation by the data processing unit of the data processing base system and the processing operation of transmitting the data processing unit to the outside from the data processing base system are executed in parallel, or displays the total time.

24. A work determination system as described in claim 2, wherein the work determination system estimates the total time for a plurality of candidate data processing sharing patterns when a portion of the data processing is shared and performed between a data processing unit of the data processing base system and a data processing unit provided in the aircraft or the data acquisition base system, or displays the total time.

25. A task determination system according to claim 1, wherein the data processing includes a display adjustment process for adjusting the display of the processed data generated by the data processing when the processed data is displayed on a user terminal device.

26. A work judgment system as claimed in claim 2 or claim 4, which predicts the total amount of acquired data or displays the prediction result before the aircraft starts acquiring images or point cloud information of the target area or before the acquisition process is completed, or determines a specific pattern from the multiple candidate patterns or displays the determination result.

27. A task judgment system as described in claim 26, wherein when the task judgment system predicts the total amount of acquired data, the total amount of acquired data is predicted based on data sensing conditions including at least one of the sensing range of the aircraft, the planned flight route, the planned flight time, the type of the sensor, and the resolution of images which are the acquired data.

28. An activity determination system as claimed in claim 5, wherein after selecting and determining a specific pattern from the plurality of candidate patterns, the activity determination system re-performs at least one of the determination of the data transmission time, the determination of the total time, and the selection and determination of a specific pattern from the plurality of candidate patterns, or displays the determination result.

29. A task determination method in which a computer determines the content of processing work to be performed by an aviation data processing system having an aircraft equipped with a sensor for acquiring images or point cloud information of a target area, a data acquisition base system which exchanges control information regarding flight or data acquisition with the aircraft, and a data processing base system which is equipped with a data processing unit which processes the data acquired by the sensor to generate processed data, wherein, when the data processing unit is provided in at least one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided in a plurality of locations within the aviation data processing system, the task determination method executes at least one of the following steps: a step in which the computer displays a plurality of candidate patterns of where among the data processing units provided in the plurality of locations data processing will be performed; a step in which the determination result of where among the data processing units provided in the plurality of locations data processing will be performed is selected or determined, and a step in which the data processing is executed by a data processing unit in accordance with the determination result.

30. A program for causing a computer to determine the content of processing work to be performed by an aviation data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information regarding flight or data acquisition with the aircraft, and a data processing base system that has a data processing unit that processes the data acquired by the sensor to generate processed data, wherein when the data processing unit is provided in at least one of the data processing base system, the aircraft, and the data acquisition base system, and the data processing unit is provided in a plurality of locations within the aviation data processing system, the program causes the computer to execute at least one of the following steps: displaying on a display device a plurality of candidate patterns of where among the data processing units provided in the plurality of locations data processing should be performed; displaying a determination result selected or determined as to where among the data processing units provided in the plurality of locations data processing should be performed; and causing a data processing unit in accordance with the determination result.

Images