Control system, aviation data processing system, and control method
The control system addresses the inefficiencies in analyzing aviation data during crises by generating and distributing tailored information to users, ensuring timely and effective crisis response actions.
Patent Information
- Application Number
- PCT/JP2024/042732
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-07
- Filing Date
- 2024-12-03
- Publication Date
- 2025-06-12
AI Technical Summary
Existing systems for analyzing aviation data to assess damage during crises, such as natural disasters or attacks, are inefficient, requiring a long time for data acquisition, transmission, and processing, which hinders rapid decision-making in the ultra-acute phase of a disaster.
A control system that determines the content of processing work for an aviation data processing system, which includes an aircraft equipped with sensors, a data acquisition base system, and a data processing unit. The system generates first and second distribution information from acquired data and processes it to provide information corresponding to user desires as time passes after a crisis.
Enables rapid provision of information necessary for initial crisis response actions and subsequent detailed analysis, addressing the inefficiencies of existing systems by facilitating timely and relevant data distribution to users.
Smart Images

Figure JP2024042732_12062025_PF_FP_ABST
Abstract
Description
Control system, aviation data processing system and control method
[0001] The present invention relates to a control system, an aircraft data processing system, and a control method.
[0002] In recent years, in abnormal situations (crisis situations) such as natural disasters or disasters caused by enemy aircraft attacks, rapid understanding of wide-area information on the affected area is required. Therefore, research is being conducted into the practical application of technology that can rapidly grasp the damage situation during a disaster by analyzing image data acquired from the air using aircraft, etc. When a crisis occurs, it is necessary to quickly grasp the damage situation in order to quickly determine the initial crisis response actions, such as issuing evacuation orders and rescue. In addition, the period immediately after the occurrence of a crisis is called the hyper-acute or acute phase, and the damage situation changes rapidly in a short period of time. Therefore, a function to quickly update the damage situation understanding that can keep up with such rapid situation changes is required.
[0003] Patent Document 1 discloses a technology in which aerial images acquired from the sky are transmitted from an aircraft to the ground, and changes in the shape of buildings are detected on the ground.
[0004] Japanese Patent Application Laid-Open No. 2007-2248364
[0005] In order to analyze aerial data acquired by aircraft, etc., interpret the damage situation, and provide the results of the interpretation of the damage situation to users such as crisis response headquarters that decide on crisis response measures, it is necessary to perform various processes such as data acquisition by the aircraft, data transmission from the aircraft to an analysis device, data analysis processing by the analysis device, and data transmission to the user terminal device, and the series of processes from data acquisition of aerial data to providing the information to the user terminal device took a long time.
[0006] Furthermore, for example, in the hyperacute phase immediately after a disaster occurs, it is necessary to quickly determine the initial response measures for a crisis, and therefore the initial information distributed to users such as crisis headquarters must be provided with the information necessary for the initial response. On the other hand, after the initial response determination, it is necessary to determine more effective crisis response measures as subsequent responses to the initial response, and therefore there is a tendency for more detailed analytical information to be required than the information distributed earlier.
[0007] The technology described in Patent Document 1 above focuses on quickly providing processing information for estimating the damage status of a building, which requires a relatively long time for analytical processing, and does not consider the fact that the information desired by users changes over time after the occurrence of a crisis such as a disaster, as described above.
[0008] Therefore, an object of the present invention is to provide a system that can provide information that meets user needs regarding distribution information that changes over time after the occurrence of a crisis such as a disaster.
[0009] According to the present invention, a control system is obtained that determines the content of processing work by an aeronautical data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information regarding flight or data acquisition with the aircraft, and a data processing unit that processes the acquired data acquired by the sensor to generate processed data, and that is equipped with a processing execution command unit that causes the aeronautical data processing system to execute the following: a first data process that generates first distribution information from the acquired data or the processed data obtained by processing the acquired data; a second data process that generates second distribution information from the acquired data or the first distribution information; a first distribution process that causes the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to a user terminal device; and a second distribution process that causes the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, and the processing execution command unit causes the second distribution information to be provided to the user terminal device or the distribution system after the first distribution information has begun to be provided to the user terminal device or the distribution system by the first distribution process.
[0010] According to the present invention, it is possible to provide information that meets user needs for distribution information that changes with the passage of time after the occurrence of a crisis such as a disaster.
[0011] FIG. 1 is an overall configuration diagram of an aviation data processing system according to one embodiment of the present invention. FIG. 2 is a functional configuration diagram of an aircraft according to one embodiment of the present invention. FIG. 3 is a configuration diagram of a data acquisition base system according to one embodiment of the present invention. FIG. 4 is a configuration diagram of a data processing base system according to one embodiment of the present invention. FIG. 5 is a configuration diagram of a distribution system according to one embodiment of the present invention. FIG. 6 is a functional configuration diagram of an operation determination system according to one embodiment of the present invention. FIG. 7 is a table showing an example of user request information acquired by an operation determination system according to one embodiment of the present invention. FIG. 8 is a table showing an example of a multi-stage distribution pattern generated by a multi-stage distribution pattern generation unit according to one embodiment of the present invention. FIG. 9 is a table showing an example of a processing time estimation result for each distribution pattern generated by a processing time estimation unit according to one embodiment of the present invention. FIG. 10 is a diagram showing an example of current state information for a disaster cycle acquired by a disaster cycle information acquisition unit according to one embodiment of the present invention. FIG. 11 is a table showing an example of a determination criterion when a distribution pattern is determined by a distribution pattern selection unit according to one embodiment of the present invention. FIG. 12 is a table showing an example of a pattern of data transmission paths and data processing locations in an aviation data processing system according to one embodiment of the present invention. FIG. 13 is a table showing an example of the communication speed of communication means for each data transmission path in an aviation data processing system. FIG. 14 is a table showing an example of data analysis speed in each subsystem constituting the aviation data processing system. FIG. 15 is a diagram showing an example of the hardware configuration of an operation determination system. FIG. 16 is a flowchart showing the processing flow of the operation determination system. 1 is a flowchart showing an example of a control flow when the work determination system determines the total amount of acquired data. FIG. 2 is a flowchart showing an example of a control flow when the multistage distribution pattern determination unit determines a distribution pattern. FIG. 3 is a diagram showing an example of a display screen on an output device of a selection result when the multistage distribution pattern determination unit determines a distribution pattern. FIG. 4 is a flowchart showing an example of a control flow when the processing means determination unit determines a processing means. FIG. 5 is a diagram showing an example of a display screen displayed to a user when the processing means determination unit determines a processing means pattern for primary distribution information. FIG. 6 is a diagram showing an example of a display screen displayed to a user when the processing means determination unit determines a processing means pattern for secondary distribution information. FIG. 7 is a diagram showing an example of a control flow when the distribution pattern correction necessity determination unit determines whether a distribution pattern needs to be corrected.
[0012] The present invention will be described below by listing the contents of the embodiments. The present invention has the following configuration. [Item 1] A control system for determining the content of processing work to be performed by an aeronautical data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information related to flight or data acquisition with the aircraft, and a data processing unit that processes the acquired data acquired by the sensor to generate processed data, the control system comprising: a first data processing that generates first distribution information from the acquired data or processed data obtained by processing the acquired data; a second data processing that generates second distribution information from the acquired data or the first distribution information; a first distribution processing that causes the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system that can distribute information to the user terminal device; and a second distribution processing that causes the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, wherein the control system is further configured to have the processing execution command unit cause the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution processing has started to provide the first distribution information to the user terminal device or the distribution system. [Item 2] The control system according to item 1, wherein the first distribution information and the second distribution information are generated from the common acquired data or processed data obtained by processing the common acquired data. [Item 3] The control system according to item 1 or 2, wherein a distribution pattern including multiple or single combinations of distribution information content of the first distribution information and the second distribution information is generated. [Item 4] The control system according to any of items 1 to 3, wherein a distribution pattern including multiple or single combinations of distribution information content of the first distribution information and the second distribution information is displayed on a display device.[Item 5] The control system according to any one of items 1 to 4, wherein the distribution pattern includes at least one of a combination of distribution information in which the processing load of the second data processing for generating the second distribution information is greater than the processing load of the first data processing for generating the first distribution information, and a combination of distribution information in which the time required to generate the second distribution information and provide it to the user terminal device or the distribution system is longer than the time required to generate the first distribution information and provide it to the user terminal device or the distribution system. [Item 6] The control system according to any one of items 1 to 5, comprising a designation input accepting unit that accepts a designation input for the distribution pattern displayed on the display device. [Item 7] The control system according to any one of items 1 to 6, wherein the control system generates a distribution pattern including a single combination of distribution information content of the first distribution information and the second distribution information, and the process execution command unit causes the aviation data processing system to execute the first distribution process and the second distribution process based on the generated combination. [Item 8] The control system according to any one of items 1 to 7, wherein the distribution pattern is generated according to a timing after a disaster occurs. [Item 9] The control system according to any one of items 1 to 8, comprising a user request accepting unit that accepts request information related to at least one of the first distribution information and the second distribution information. [Item 10] The control system according to any one of items 1 to 9, wherein, when information on a desired delivery time related to at least one of the first distribution information and the second distribution information is accepted by the user request accepting unit, the control system generates the distribution pattern based on the desired delivery time. [Item 11] The control system according to any one of items 1 to 10, when priority delivery request information related to at least one of the first distribution information and the second distribution information is accepted by the user request accepting unit, the control system generates the distribution pattern based on the priority delivery request information.[Item 12] The control system according to any one of items 1 to 11, wherein the first distribution information is an orthoimage obtained by ortho-transforming an image of the target area acquired by the sensor and integrating a plurality of ortho-transformed images, and the second distribution information is an integrated map image obtained by integrating the orthoimage with geographic information. [Item 13] The control system according to any one of items 1 to 12, wherein the first distribution information is an orthoimage obtained by ortho-transforming an image of the target area acquired by the sensor and integrating a plurality of ortho-transformed images, and the second distribution information is a second orthoimage having a higher resolution than the first orthoimage. [Item 14] The control system according to any one of items 1 to 13, wherein the first distribution information is an orthoimage obtained by ortho-transforming an image of the target area acquired by the sensor and integrating a plurality of ortho-transformed images, and the second distribution information is complemented data obtained by complementing defect data included in the orthoimage with other data. [Item 15] The control system according to any one of items 1 to 14, wherein the first distribution information is an integrated map image obtained by ortho-image conversion of an image of the target area acquired by the sensor and integrating geographic information with an ortho-image obtained by integrating a plurality of ortho-transformed images, and the second distribution information is a difference analysis result between the integrated map image and an integrated map image generated earlier than the integrated map image. [Item 16] The control system according to any one of items 1 to 15, wherein the first distribution information is a difference analysis result between an integrated map image generated earlier than the integrated map image and the integrated map image obtained by ortho-image conversion of an image of the target area acquired by the sensor and integrating a plurality of ortho-transformed images with geographic information, and the second distribution information is a detailed analysis result for an area within the target area determined to have a difference based on the difference analysis result of the first distribution information.[Item 17] A control system according to any one of items 1 to 16, further comprising: a third data process for generating third distribution information from the acquired data or processed data obtained by processing the acquired data; and a third distribution process for causing the third distribution information generated by the third data process to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device, wherein the process execution command unit causes the third distribution information to be provided to the user terminal device or the distribution system by the third distribution process after the second distribution process begins to provide the second distribution information to the user terminal device or the distribution system. [Item 18] The control system according to any one of items 1 to 17, wherein the first distribution information is a first orthoimage obtained by ortho-transforming an image of the target area acquired by the sensor and integrating a plurality of ortho-transformed images, the second distribution information is a second orthoimage having a higher resolution than the first orthoimage and corresponding to an area smaller than the first orthoimage, and the third distribution information is a third orthoimage having a higher resolution than the first orthoimage and corresponding to an area larger than the second orthoimage. [Item 19] The control system according to any one of items 1 to 18, wherein the second processing including the second data processing and the second distribution processing is executed in parallel with at least a part of the first processing including the first data processing and the first distribution processing. [Item 20] A control system according to any one of items 1 to 19, wherein when the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system estimates the processing speed of each of the multiple data processing units or displays it on a display device.[Item 21] The control system according to any one of items 1 to 20, wherein, when the data processing unit is mounted on at least one of the air vehicle, the data acquisition base system, and another data processing base system, and the data processing units are installed at multiple locations within the air data processing system, the control system estimates a first processing time for the first data processing and a second processing time for the second data processing in each of the multiple data processing units, or displays the estimation results. [Item 22] The control system according to any one of items 1 to 21, wherein, when the data processing unit is mounted on at least one of the air vehicle, the data acquisition base system, and another data processing base system, and the data processing units are installed at multiple locations within the air data processing system, the control system estimates a data transmission speed on a transmission path between the air vehicle, the data acquisition base system, and the data processing base system, or displays the estimated speed on a display device. [Item 23] The control system according to any one of items 1 to 22, wherein, when the data processing unit is mounted on at least one of the air vehicle, the data acquisition base system, and another data processing base system, and the data processing units are installed at multiple locations within the air data processing system, the control system estimates a first transmission time for data used for the first data processing and a second transmission time for data used for the second data processing on each of multiple transmission paths, or displays these on a display device. [Item 24] The control system according to any one of items 1 to 23, wherein, when the data processing unit is mounted on at least one of the air vehicle, the data acquisition base system, and another data processing base system, and the data processing units are installed at multiple locations within the air data processing system, the control system determines a combination pattern of the installation location of the data processing unit that performs the first data processing and the transmission path of the data related to the first data processing, which results in the shortest first total required time, including the time required for the first data processing and the time required for the first distribution processing, or displays this on a display device.[Item 25] A control system according to any one of Items 1 to 24, wherein when the data processing unit is mounted on at least one of the aircraft, the data acquisition base system, and another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system determines, or displays on a display device, a combination pattern of the installation location of the data processing unit that executes the second data processing and the transmission path of the data related to the second data processing that minimizes a second total required time, which includes the time required for the second data processing and the time required for the second distribution processing. [Item 26] An aeronautical data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information related to flight or data acquisition with the aircraft, and a data processing unit that processes the acquired data acquired by the sensor to generate processed data, wherein the system is further equipped with a processing execution command unit that executes the following: a first data processing that generates first distribution information from the acquired data or processed data obtained by processing the acquired data; a second data processing that generates second distribution information from the acquired data or the first distribution information; a first distribution processing that causes the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system that can distribute information to the user terminal device; and a second distribution processing that causes the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, wherein the processing execution command unit causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution processing has started to provide the first distribution information to the user terminal device or the distribution system.[Item 27] A control method using an aeronautical data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information related to flight or data acquisition with the aircraft, and a data processing unit that processes the acquired data acquired by the sensor to generate processed data, wherein the computer executes the following steps: a first data processing step that generates first distribution information from the acquired data or processed data obtained by processing the acquired data; a first distribution processing step that causes the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system that can distribute information to the user terminal device; a second data processing step that generates second distribution information from the acquired data or the first distribution information; and a second distribution processing step that causes the user terminal device or the distribution system to provide the second distribution information generated by the second data processing after provision of the first distribution information has begun by the first distribution processing step.
[0013] <A. First Embodiment> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted. Furthermore, the embodiment described below is merely an example, and other known elements or alternative means may be adopted depending on the application, purpose, scale, etc.
[0014] [A-1. Configuration] (A-1-1. Overview) Fig. 1 is a diagram showing the overall configuration of an aviation data processing system 1 (hereinafter also referred to as "this system 1") according to one embodiment of the present invention. As shown in Fig. 1, this system includes an aircraft 1000, a data acquisition base system 2000, a data processing base system 3000, and a distribution system 4000.
[0015] The aircraft 1000 acquires information about the disaster area from the sky using sensors such as optical cameras, infrared cameras, and laser sensors such as LiDAR, and obtains the acquired data. The data acquisition base system 2000, if the aircraft is an unmanned aircraft, is a base equipped with a remote control device that exchanges control information with the aircraft. It can be configured as a mobile vehicle or a fixed, immobile base. The data processing base system 3000 acquires the acquired data acquired by the aircraft, performs data analysis processing, and generates processed data. The distribution system 4000 acquires the processed data and distributes it via an Internet connection to user terminal devices, including a crisis management headquarters terminal. The crisis management headquarters terminal, an example of a user terminal device, is a terminal device used by users such as the head of the crisis management headquarters. The processed data can be viewed by accessing the distribution system from the crisis management headquarters terminal.
[0016] The data processing unit that performs data analysis processing on acquired data can be implemented not only in the data processing base system 3000, but also in the data acquisition base system 2000 and the aircraft 1000. Therefore, the aviation data processing system 1 determines, depending on the situation, which data processing unit to perform the data analysis processing in: the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000. The data analysis processing executed in each data processing unit may include web optimization processing that processes the processed data so that the processed data displayed on a user terminal device from the distribution system via an Internet line is easily viewable by the user.
[0017] Here, when analysis processing is performed by a data processing unit installed on the aircraft 1000, sensing processing is performed to generate acquired data, and data analysis processing is performed to generate processed data in the aircraft 1000. The processed data is transmitted directly from the aircraft 1000 to the distribution system, or transmitted to the distribution system 4000 via the data acquisition base system 2000 or the data processing base system 3000.
[0018] Next, when analysis processing is performed by a data processing unit installed in the data acquisition center system 2000, sensing processing is performed in the aircraft 1000 to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data acquisition center system 2000. The data acquisition center system 2000 performs data analysis processing to generate processed data, and transmits the processed data to the distribution system 4000.
[0019] Finally, when analytical processing is performed in a data processing unit installed in the data processing base system 3000, sensing processing is performed in the aircraft 1000 to generate acquired data, and the acquired data is transmitted from the aircraft 1000 to the data processing base system 3000. Here, the acquired data may be transmitted directly from the aircraft 1000 to the data processing base system 3000, or may be transmitted to the data processing base system 3000 via the data acquisition base system 2000. The data processing base system 3000 performs data analytical processing to generate processed data, and transmits the processed data to the distribution system 4000.
[0020] Although the above example shows an embodiment in which processed data is distributed to a user terminal device via a distribution system, the processed data can also be sent directly to a user terminal device from the aircraft 1000, the data acquisition center system 2000, or the data processing center system 3000 via an Internet line or the like, without going through the distribution system. Note that a user terminal device such as a crisis management headquarters terminal and the data acquisition center system are communicatively connected via an Internet line or the like, and input information from the user terminal device can be sent to the data acquisition center system. Furthermore, the aircraft 1000 in this embodiment may be a flying object other than an aircraft, such as a balloon, a weather balloon, or an artificial satellite.
[0021] (A-1-2. Aircraft 1000) Figure 2 is a functional configuration diagram of an aircraft according to one embodiment of the present invention. The aircraft 1000 is a system that constitutes an aircraft, and includes a flight unit 1100 with flight capabilities, a sensing unit 1200 that performs sensing using sensors, a communication unit 1300 that communicates with other subsystems within the aviation data processing system 1 (such as a data acquisition base system, a data processing base system, and a distribution system), a state determination unit 1400 that determines the flight, sensing, and positioning states, a data processing unit 1500 that performs data analysis processing, and a data recording unit 1600 that records acquired data, etc.
[0022] In this specification, the term "aircraft" refers to any flying object capable of autonomous attitude control, regardless of the power source (electric power, prime mover, etc.), the control method (wireless or wired, fully autonomous flight type or partially manual flight type, etc.), and whether manned or unmanned. Aircraft may also be referred to as unmanned aerial vehicles (UAVs), flying objects, multicopters, RPAS (remote piloted aircraft systems), or UAS (unmanned aircraft systems). Aircraft may be fixed-wing type with fixed wings, multicopter type with multiple propellers, or VTOL type with both fixed wings and multiple propellers.
[0023] (A-1-2-1. Flight Unit 1100) The flight unit 1100 includes a self-position / velocity determination unit 1110, an attitude determination unit 1120, and a flight control unit 1130.
[0024] The aircraft's own position / speed determination unit 1110 has a function of determining the position and speed of the aircraft 1000. For example, the aircraft's position (absolute position) is measured based on satellite signals received from artificial satellites by a satellite signal antenna mounted on the aircraft using a GPS (Global Positioning System) or a GNSS (Global Navigation Satellite System). The aircraft's own position and speed can also be determined using, for example, an RTK-GNSS (Real Time Kinematic - Global Navigation Satellite System). The position information includes at least two-dimensional coordinate information (e.g., latitude and longitude) in a planar view, and preferably includes three-dimensional coordinate information including altitude information.
[0025] Next, the attitude determination unit 1120 has a function of determining the attitude (orientation) of the aircraft 1000. Specifically, the attitude of the aircraft is determined by a GPS compass consisting of a pair of satellite antennas mounted on the aircraft, a geomagnetic sensor, or the like.
[0026] Flight control section 1130, in turn, includes a processing unit, also referred to as a flight controller. The processing unit may include one or more processors, such as a programmable processor (e.g., a central processing unit (CPU), MPU, or DSP). The processing unit has access to memory. The memory stores logic, code, and / or program instructions that the processing unit can execute to perform one or more steps.
[0027] The processing unit has a function of controlling the flight state of the aircraft by controlling the output of the thrust generating device. Specifically, the processing unit controls the thrust generated from the propeller using the propeller, the motor that drives the propeller, and the motor control unit that controls the motor output, thereby adjusting the spatial arrangement, attitude angle, angular velocity, angular acceleration, angular jerk rate, and / or acceleration of the aircraft, which has six degrees of freedom (translational motion x, y, and z, and rotational motion θx, θy, and θz). In other words, the flight control unit 1130 controls the aircraft to perform various operations such as liftoff, forward movement, turning, and landing, and controls the attitude angle control and flight operations of the aircraft from takeoff to flight and landing, thereby controlling the flight state of the aircraft.
[0028] (A-1-2-2. Sensing Unit 1200) The sensing unit 1200 includes a sensor 1210, a sensor attitude control unit 1220, and a sensor control unit 1230.
[0029] The sensor 1210 is composed of, for example, an optical camera that acquires optical images, an infrared camera that acquires infrared images, a laser sensor such as LiDAR that acquires point cloud data, etc. The sensor acquires optical images, infrared images, point cloud data, etc. of the ground surface of the disaster area from the sky above the disaster area as acquired data.
[0030] The sensor attitude control unit 1220 controls the relative angle of the sensor with respect to the aircraft body, for example, by controlling at least one of the angles around the three axes of a gimbal that is provided between the sensor and the aircraft and supports the sensor, thereby controlling the relative angle of the sensor with respect to the aircraft body.
[0031] The sensor control unit 1230 has a function of changing the timing and measurement parameters of sensing performed by the sensor 1210. For example, if the sensor is an optical camera, it controls the image acquisition timing, shutter speed, resolution, and the like.
[0032] (A-1-2-3. Communication Unit 1300) The communication unit 1300 includes a control communication unit 1310, a data communication unit 1320, and a status data communication unit 1330. The communication unit 1300 is capable of radio wave communication via a communication network NW and includes, for example, a radio wave communication module. The communication unit 1300 is capable of communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via the communication network NW. The communication unit 1300 includes a communication function for wirelessly communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via wireless communication using, for example, Wi-Fi, 2.4 GHz, or a frequency band of 5.6 to 5.8 GHz. The communication unit 1300 also includes a wireless communication function for communicating with a data acquisition site system, a data processing site system, a distribution system, or the like via the communication network NW using a communication standard such as LTE (Long Term Evolution).
[0033] The control communication unit 1310 performs communication related to aircraft flight control exchanged between the aircraft 1000 and the data acquisition base system 2000. For example, if the aircraft is an unmanned aircraft and is remotely controlled from the data acquisition base system, the control communication unit 1310 receives flight control commands transmitted from the data acquisition base system to the aircraft. The control communication unit 1310 also transmits information related to the aircraft's flight status, including the aircraft's position, speed, and attitude determined by the flight unit 1100, from the aircraft to the data acquisition base system.
[0034] The data communication unit 1320 transmits the acquired data acquired by the sensing unit 1200 to a data acquisition base system, a data processing base system, a distribution system, or the like. Furthermore, when data analysis is performed by the data processing unit 1500 (described later), the data communication unit 1320 transmits processed data generated by the data processing unit 1500 to the distribution system, etc. In other words, the data communication unit 1320 transmits the acquired data acquired by the sensing unit 1200 or the processed data obtained by analyzing the acquired data to the outside of the aircraft.
[0035] The status data communication unit 1330 transmits to the data acquisition base system the flight status, sensing status, and communication status determined by the status determination unit 1400 (described later). In particular, it transmits to the data acquisition base system the communication speed determined by the communication status determination unit 1430.
[0036] (A-1-2-4. State Determination Unit 1400) The state determination unit 1400 includes a flight state determination unit 1410, a sensing state determination unit 1420, and a communication state determination unit 1430.
[0037] The flight state determination unit 1410 determines that a flight abnormality has occurred when the position or speed of the aircraft determined by the aircraft's own position / speed determination unit 1110, or the attitude of the aircraft determined by the attitude determination unit 1120, deviates from a preset normal range. In addition, even if the position, speed, or attitude does not deviate from the normal range, the flight state determination unit 1410 also determines that a flight abnormality has occurred when at least one of the position, speed, or attitude does not normally follow the control command value from the flight control unit 1130.
[0038] The sensing state determination unit 1420 determines that a sensing abnormality has occurred when no data has been acquired by the sensor 1210 of the sensing unit 120 or when an abnormality is found in the acquired data. Alternatively, a sensing abnormality may be determined when the sensor attitude control unit 1220 does not operate correctly in response to a control command value.
[0039] The communication status determination unit 1430 determines the communication status between the aircraft and an external system (such as a data acquisition base system, a data processing base system, or a distribution system) via the communication unit 1300. The communication status to be determined is specifically the communication speed (e.g., bps) and may also include communication strength (e.g., dB) in addition to the communication speed. The communication status determination unit 1430 particularly determines the data communication speed of the data acquired by the data communication unit 1320 or the processed data.
[0040] (A-1-2-5. Data Processing Unit 1500) When the operation determination system 2300 determines that data analysis processing is to be performed on board the aircraft, the data processing unit 1500 analyzes the data acquired by the sensing unit 1200. The data processing unit 1500 is configured as, for example, a workstation so that it can perform data analysis that imposes a relatively large processing load.
[0041] The data processing unit 1500 executes various types of analysis processes. Examples of the analysis processes are as follows: "Orthoimage generation": A process of acquiring multiple optical images as acquired data, converting the acquired multiple optical images into orthoimages, and generating an orthoimage by integrating the multiple orthoimages. "Three-dimensional space data generation (image)": A process of acquiring multiple optical images as acquired data and generating three-dimensional space data from the multiple optical images using SfM (Structure from Motion) processing. "Three-dimensional space data generation (point cloud)": A process of acquiring point cloud data as acquired data and generating three-dimensional space data from the point cloud data. "Defect data completion": A process of determining defect data contained in the optical image or point cloud data used to generate the orthoimage or three-dimensional space data, and generating stored data in which the areas where the defect data was used are completed with completion data (geographical information, previously acquired data, etc.).・"Integration of orthoimages and geographic information": A process that generates orthoimages, acquires geographic information as data for processing, and generates integrated map data that integrates the orthoimages and geographic information. ・"Difference analysis of integrated map data": A process that generates an integrated map image, acquires past integrated map images as data for processing, and performs a difference analysis between the current and past integrated map images. ・"Detailed analysis of difference detected areas": A process that imports external information related to areas where differences were detected through the difference analysis of integrated map data, and performs a detailed analysis by combining it with data obtained from the aircraft. ・"Web optimization processing": A process that performs one of the above processes, and then performs a web optimization process that processes the processed data to optimize the display screen on the user terminal device, generating web-optimized data.
[0042] The web optimization process executed by the data processing unit 1500 is a process of processing the processed data so that the processed data displayed on the user terminal device from the distribution system via the Internet line is displayed on the display screen of the user terminal device in an easy-to-read format for the user.
[0043] (A-1-2-6. Data Recording Unit 1600) The data recording unit 1600 includes an acquired data recording unit 1610, a processed data recording unit 1620, and a communication status recording unit 1630. The data recording unit 1600 is configured by a storage device such as a RAM or ROM.
[0044] The acquired data recording unit 1610 records the acquired data acquired by the sensing unit 1200. The recorded acquired data is transmitted by the data communication unit 1320 to a data acquisition site system, a data processing site system, a distribution system, or the like.
[0045] The processed data recording unit 1620 records the processed data generated by the data processing unit 1500. The recorded processed data is transmitted by the data communication unit 1320 to a distribution system or the like.
[0046] The communication status recording unit 1630 records information on the communication speed and communication strength determined by the communication status determination unit 1430. The recorded information on the communication speed and communication strength is transmitted by the status data communication unit 1330 to the data acquisition site system.
[0047] (A-1-3. Data Acquisition Base System 2000) Fig. 3 is a configuration diagram of a data acquisition base system according to one embodiment of the present invention. The data acquisition base system includes a communications infrastructure management system 2100, an aircraft flight operation system 2200, an operation determination system 2300, a data processing unit 2400, an flight management system 2500, and an airspace monitoring system 2600.
[0048] When the aircraft is an unmanned aircraft, the data acquisition base system 2000 exchanges control information with the aircraft and enables remote control by a pilot (user) using the data acquisition base system. The data acquisition base system may be configured as a mobile vehicle or as a stationary building (fixed type).
[0049] The communication infrastructure management system 2100 is a system that manages communication means for data (acquired data or processed data) and control communication information transmitted and received between the data acquisition base system 2000 and the aircraft 1000, the data processing base system 3000, and the distribution system 4000. The communication infrastructure management system 2100 transmits, for example, information generated by the aircraft flight operating system 2200 and the work determination system 2300 (described below) to the aircraft 1000. The communication infrastructure management system 2100 also monitors the communication speed as well as the availability of communication through the existing infrastructure, and transmits and receives data according to the processing means and communication means for data transmission determined by the work determination system (described below). The transmission process may be, for example, parallel transmission or switched transmission. Furthermore, if the work determination system 2300 (described below) determines that data should be transmitted by physically transporting the memory by a person, the communication infrastructure management system 2100 may display this information on an appropriate display unit and request an administrator to physically transport the memory.
[0050] The aircraft flight operating system 2200 is a system that generates a mission for the aircraft to be operated and controls the movement of the aircraft. The mission is, for example, a movement plan including the movement route and movement speed of the aircraft 1000, and the movement route is generated in an airspace at an altitude of, for example, 150 m or less to avoid interference with passenger aircraft and the like. The aircraft flight operating system 2200 transmits a control signal to the aircraft 1000 via the communication infrastructure management system 2100 to operate the aircraft automatically.
[0051] The flight operations management system 2500 is a system that makes decisions and gives instructions for the operation of the aircraft 1000. The flight operations management system 2500 prepares plans for the aircraft 1000, including, for example, sensing and flight, and transmits the plans to the aircraft 1000 via the communication infrastructure management system 2100. The flight operations management system 2500 may also determine the priorities of the tasks that require processing and transmit them to the aircraft 1000. The flight operations management system 2500 may prepare plans for multiple aircraft 1000 and transmit information about the plans to each aircraft 1000.
[0052] The airspace monitoring system 2600 is a system that monitors the airspace in which the aircraft 1000 to be piloted is flying. The airspace monitoring system 2600 acquires information from an existing air traffic control system. The air traffic control system may be, for example, a drone traffic management system (UTM), an air traffic management subsystem (UASSP), or an air traffic management system (ATM). That is, the airspace monitoring system 2600 measures or acquires information about the environment and other aircraft in the airspace in which the aircraft 1000 is flying, and transmits the information to the flight management system 2500. If there is a problem with the work plan for the aircraft 1000 based on the information from the airspace monitoring system 2600, the flight management system 2500 changes the work plan.
[0053] The operation determination system 2300 determines the processing content for the acquired data acquired by the aircraft 1000. Here, immediately after a disaster occurs, it is necessary to quickly grasp the disaster situation and implement an initial response within a short period of time. On the other hand, after the initial response, it is necessary to grasp the damage situation in more detail and determine effective next steps. Therefore, it is desirable to divide the analysis results provided to users in the early stages after a disaster and the analysis results provided to users thereafter into multiple stages. The operation determination system 2300 determines a specific distribution pattern from multiple distribution pattern candidates, which are obtained by dividing the analysis processing content into multiple stages over time, and determines the location of a data processing unit that executes the specific distribution pattern and the transmission route of acquired data, etc. The distribution pattern, etc. determined by the operation determination system 2300 are transmitted to the aircraft 1000, the data processing base system 3000, and the distribution system 4000 via the communication infrastructure management system 2100. Detailed functions of the operation determination system 2300 will be described later.
[0054] When the operation determination system 2300 determines that data analysis processing is to be performed within the data acquisition base system, the data processing unit 2400 analyzes the acquired data acquired by the aircraft 1000. The data processing unit 2400 is configured, for example, as a workstation so that it can perform data analysis that involves a relatively large processing load. A specific example of the analysis processing performed here is the same as the specific example of the analysis processing described in the explanation of the data processing unit 1500.
[0055] (A-1-4. Data Processing Base System 3000) Fig. 4 is a configuration diagram of a data processing base system according to one embodiment of the present invention. The data processing base system comprises a communication unit 3100 and a data processing unit 3200.
[0056] The communication unit 3100 transmits and receives data (acquired data or processed data) between the data processing base system 3000 and external systems (aircraft 1000, data acquisition base system 2000, and distribution system 4000). The communication unit 3100 receives acquired data from, for example, the aircraft 1000 or the data acquisition base system 2000. The communication unit 3100 also transmits processed data generated in the data processing base system 3000 to the distribution system 4000.
[0057] When the work determination system 2300 determines that data analysis processing is to be performed within the data processing base system, the data processing unit 3200 acquires the acquired data acquired by the aircraft 1000 via the communication unit 3100 and performs the analysis processing.
[0058] (A-1-5. Distribution System 4000) Fig. 5 is a configuration diagram of a distribution system according to one embodiment of the present invention. The distribution system 4000 comprises a communication unit 4100 and a distribution data management unit 4200.
[0059] The communication unit 4100 receives processed data from any one of the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000. The received processed data may be data that has undergone web optimization processing in the analysis processing performed in the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000. The communication unit 4100 also distributes the processed data to user terminal devices, including crisis management headquarters terminals, via an internet line.
[0060] The distribution data management unit 4200 records the processed data received via the communication unit 4100, and distributes the latest processed data recorded in the distribution data management unit 4200 to user terminal devices, including device countermeasure headquarters terminals, accessed via an Internet line.
[0061] (A-1-6. Work Determination System 2300) Figure 6 is a functional configuration diagram of the work determination system according to one embodiment of the present invention. The work determination system 2300 includes a user request acquisition unit 2310, an acquisition data amount estimation unit 2320, a multi-stage delivery pattern generation unit 2330, a processing time estimation unit 2340, a disaster cycle information acquisition unit 2350, a multi-stage delivery pattern determination unit 2360, a processing means determination unit 2370, and a process execution command unit 2380.
[0062] (A-1-6-1. User request acquisition unit 2310) The user request acquisition unit 2310 acquires user request information input by a user via an input unit of a user terminal device 5000, which may include a crisis management headquarters terminal. Fig. 7 is a table showing an example of user request information acquired by an operation determination system according to an embodiment of the present invention. As shown in T101 in Fig. 7, the user request information includes at least one of the following: target acquisition area, type of information to be acquired, unit information amount, priority delivery information, and desired delivery time.
[0063] The acquisition target area is area information of the ground surface or airspace acquired by the aircraft 1000. The acquired information type is the type of acquired data acquired by the aircraft 1000, such as optical camera, point cloud data, or spatial information. The unit information amount is the amount of information for each unit of acquired data, such as image resolution. The priority distribution information is distribution information that is preferentially provided to the user from among multiple candidate analysis processes, such as "orthoimage." The desired distribution time is the time at which the user desires to receive the analysis results. The priority distribution information and desired distribution time accepted as user-requested information are not limited to primary distribution information, but may also be requested information regarding secondary distribution information or tertiary distribution information.
[0064] (A-1-6-2. Acquired Data Amount Estimation Unit 2320) The acquired data amount estimation unit 2320 predicts the total amount of acquired data (defined in, for example, gigabytes, terabytes, etc.). The total amount of acquired data can be predicted based on data sensing conditions such as information about the sensing range and the type of sensor and setting parameters related to the amount of data per unit area. Here, the information about the sensing range can be defined based on, for example, the planned flight path of the aircraft, the planned flight time, the sensing target range on the Earth's surface, or the range of the planned flight airspace. In addition, the information about the sensing range can be generated based on information about the acquisition target area acquired by the user request acquisition unit 2310, which will be described later.
[0065] The type of sensor may be, for example, an optical camera, an infrared camera, or a laser sensor including LiDAR. The setting parameters are defined by the resolution of the acquired image, the point cloud density of the point cloud data, etc. The acquired data amount estimation unit 2320 estimates the total amount of acquired data before the sensing process by the aircraft starts, or at least before the sensing process is completed.
[0066] (A-1-6-3. Multistage Distribution Pattern Generation Unit 2330) The multistage distribution pattern generation unit 2330 generates multiple candidate patterns of distribution data provided in multiple stages. FIG. 8 is a table illustrating an example of a multistage distribution pattern generated by a multistage distribution pattern generation unit according to an embodiment of the present invention. Table T102 in FIG. 8 shows six patterns, pattern identification numbers 001 to 006, as multistage distribution patterns generated by the multistage distribution pattern generation unit. Generally, during a crisis such as a disaster, primary distribution information is required to be distributed more quickly, and secondary distribution information is required to provide more detailed information than the primary distribution information. Therefore, the multistage distribution pattern shown in FIG. 8 includes a pattern in which processes with a higher processing load than the primary data processing that generates the primary distribution information are selected as candidates for secondary distribution information. Here, a process with a higher processing load includes a process that takes a longer time to process. Furthermore, regardless of the magnitude of the processing load of data processing, the multi-stage distribution pattern shown in Figure 8 may include a pattern in which the time required for data processing and data transmission until the secondary distribution information is transmitted to the distribution system is longer than the time required for data processing and data transmission until the primary distribution information is transmitted to the distribution system. Furthermore, in the multi-stage distribution pattern, the primary distribution information is distribution information that is distributed to the user terminal device 5000 prior to other distribution information, the secondary distribution information is distribution information that is distributed to the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is distribution information that is distributed to the user terminal device 5000 even later than the secondary distribution information. The details of each pattern are as follows.
[0067] [Pattern Classification No. 001] As primary distribution information, optical images acquired as acquired data are converted into orthoimages, and multiple images after orthoimage conversion are integrated to generate an orthoimage. Next, as secondary distribution information, the orthoimage is integrated with geographic information (map information) to generate an integrated map image.
[0068] [Pattern Identification No. 002] As primary distribution information, multiple optical images acquired as acquired data are integrated to generate an integrated image of the desired area. Next, as secondary distribution information, the optical images of the acquired data are orthogonally converted, and the multiple images after orthogonal conversion are integrated to generate an orthogonal image. Note that, here, an example has been described in which the acquired images are integrated as primary distribution information without orthogonal conversion, but an orthogonal image with a lower resolution than the orthogonal image to be distributed as secondary distribution information may also be generated as primary distribution information.
[0069] [Pattern Classification No. 003] As primary distribution information, image data volume compression processing is performed to reduce the resolution of the optical image of the wide area acquired as acquired data, and the low-resolution image is orthoimage converted. Multiple orthoimage-reflected images are integrated to generate a low-resolution wide-area orthoimage. Next, as secondary distribution information, optical image (high resolution) of the narrow area acquired as acquired data is orthoimage converted, and multiple orthoimage-reflected images are integrated to generate a high-resolution narrow-area orthoimage. Finally, as tertiary distribution information, optical image (high resolution) of the wide area acquired as acquired data is orthoimage converted, and multiple orthoimage-reflected images are integrated to generate a high-resolution wide-area orthoimage.
[0070] [Pattern Classification No. 004] As primary distribution information, the optical image acquired as acquired data is converted into an orthoimage, and multiple images after orthoimage conversion are integrated to generate an orthoimage. Next, as secondary distribution information, defective data contained in the optical image of the acquired data is identified, and the orthoimage of the position determined to be defective is complemented with complementary data such as geographic information to generate complemented data.
[0071] [Pattern Classification No. 005] As primary distribution information, optical images acquired as acquired data are converted into orthoimages, and multiple images after orthoimage conversion are integrated to generate an orthoimage. Furthermore, the orthoimage is integrated with geographic information (map information) to generate an integrated map image. Next, as secondary distribution information, a difference analysis is performed between the generated integrated map image (current information) and previously generated integrated map images.
[0072] [Pattern Classification No. 006] As primary distribution information, optical images acquired as acquired data are converted into orthoimages, and multiple images after orthoimage conversion are integrated to generate an orthoimage. Furthermore, the orthoimage is integrated with geographic information (map information) to generate an integrated map image. Furthermore, a difference analysis is performed between the generated integrated map image (current information) and previously generated integrated map images. Next, as secondary distribution information, external information related to the area where a difference was detected by the difference analysis is imported, and a detailed analysis is performed by combining it with acquired data acquired from the aircraft.
[0073] (A-1-6-4. Processing Time Estimation Unit 2340) The processing time estimation unit 2340 estimates the required analysis time for each piece of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated for each distribution pattern (No. 001 to 006) shown in Table T102 as described above. The required analysis time may be calculated based on information on the total data volume of acquired data estimated by the acquired data volume estimation unit 2320 and information on the processing load of the analysis process for generating each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.), or may be calculated based on a standard processing time previously set for each piece of distribution information for each distribution pattern recorded in the work determination system. Note that the required analysis time may be calculated based on at least one of the standard speeds, i.e., data transmission speed and analysis speed, in addition to information on the total data volume and processing load.
[0074] FIG. 9 is a table showing an example of processing time estimation results for each multi-stage distribution pattern generated by a processing time estimation unit according to an embodiment of the present invention. As shown in Table T103 of FIG. 9, the required analysis time for the distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated for each distribution pattern (No. 001 to 006) shown in Table T104 of FIG. 8 is estimated. In the example shown in Table T103, in addition to the required analysis time for each distribution information, the required measurement time is also estimated. This required measurement time can be calculated, for example, based on information about the total amount of acquired data estimated by the acquired data amount estimation unit 2320, or based on information about the total amount of data, the analysis speed, and a reference data transmission rate. The scheduled delivery time of the analyzed information is estimated from information about the estimated required measurement time, the required analysis time, and the current time. For example, the scheduled delivery time of the analyzed information can be estimated as the time elapsed from the current time when the estimated required measurement time and the required analysis time are added together.
[0075] Table T103 shows the estimated results for the current time of 08:00. Since the required measurement time and required analysis time for primary distribution information for pattern identification No. 001 are estimated to be 60 minutes and 60 minutes, respectively, the estimated distribution time for primary distribution information is 10:00, which is 60+60 minutes after the current time of 08:00. Furthermore, since the required analysis time for secondary distribution information for pattern identification No. 001 is estimated to be 60 minutes, the estimated distribution time for primary distribution information is 11:00, which is another 60 minutes after the scheduled distribution time of 10:00. The required measurement time, required analysis time, and scheduled distribution time for pattern identification Nos. 002 to 006 in Table T103 are calculated using the same estimation method as for No. 001, as shown in Table T103.
[0076] The required analysis time calculated by the processing time estimation unit 2340 does not need to be calculated based on analysis speed information that differs for each analysis device that actually performs the analysis processing, or on actual data transmission speed information on the data transmission path from the aircraft to the analysis device that actually performs the analysis processing, but can be generated as an approximate value of the required analysis time, etc.
[0077] (A-1-6-5. Disaster cycle information acquisition unit 2350) The disaster cycle information acquisition unit 2350 acquires the relevant period of current situation information in a medium- to long-term disaster cycle that starts with the occurrence of a disaster and repeats the following cycle: "disaster occurrence → hyperacute phase → acute phase → subacute phase → chronic phase → calm phase → disaster occurrence." The hyperacute phase, which is the period immediately after the occurrence of a disaster in the disaster cycle, differs depending on the type of disaster, but for example, in the case of a disaster such as an earthquake, it corresponds to a period of about two to three days after the occurrence of the disaster, and generally, in this hyperacute phase, the situation in the affected area changes rapidly in a short period of time.
[0078] FIG. 10 is a diagram illustrating an example of current status information for a disaster cycle acquired by a disaster cycle information acquisition unit according to one embodiment of the present invention. The example illustrated in FIG. 10 indicates that the current situation corresponds to the "hyperacute phase." Furthermore, within the "hyperacute phase," the timing of each command decision, including the primary (initial) command decision, the secondary command decision, and the tertiary command decision, is defined, and the current situation corresponds to "after the secondary command decision in the hyperacute phase." The example illustrated in FIG. 10 also illustrates an example in which, in addition to the disaster cycle information corresponding to the current time, analysis information that has already been provided to the user terminal device (crisis management headquarters terminal) is displayed.
[0079] The disaster cycle information as described above may be input from a user terminal device 5000 such as a disaster response headquarters terminal or the input device 100 of the work assessment system 2300, or may be acquired by the disaster cycle information acquisition unit 2350 generating it based on input information from the user terminal device or input device (for example, the command status at the disaster response headquarters).
[0080] (A-1-6-6. Multistage delivery pattern determination unit 2360) The multistage delivery pattern determination unit 2360 includes a delivery pattern selection unit 2361, a user designation acceptance unit 2362, and a delivery pattern correction necessity determination unit 2363, and selects one or more multistage delivery patterns from among the multistage delivery pattern candidates shown in Table T102 in Fig. 8 and proposes the selection results to the user, thereby determining a delivery method for performing multistage delivery. Note that the multistage delivery pattern determination unit 2360 may determine the multistage delivery pattern selected by the delivery pattern selection unit 2361 as the delivery method without receiving a designation input of the multistage delivery pattern from the user via the user designation acceptance unit 2362.
[0081] (A-1-6-6-1. Delivery pattern selection unit 2361) The delivery pattern selection unit 2361 selects one or more multi-stage delivery patterns from among the multi-stage delivery pattern candidates such as those shown in Table T102 in Fig. 8 described above, displays the selection results on a display device, and causes the process execution command unit 2380 (described later) to execute processing based on the selection results. This selection method can be, for example, any of the following selection methods: selection based on disaster cycle information, selection based on priority delivery information, or selection based on desired delivery time, or a combination of these. Each selection method is described below.
[0082] First, a selection method based on disaster cycle information will be described. Disaster cycle information is information on the relevant period of current status information in a disaster cycle acquired by the disaster cycle information acquisition unit 2350 described above. When this selection method is used, the delivery pattern selection unit 2361 selects a delivery pattern that is previously associated with disaster cycle information, depending on the content of the acquired disaster cycle information.
[0083] 11 is a table showing an example of determination criteria used when a delivery pattern is determined by a delivery pattern selection unit according to one embodiment of the present invention. As shown in Table T104 in FIG. 11 , a correspondence table in which disaster cycle information and delivery patterns (No. 001 to 006) are associated is pre-recorded, and the delivery pattern selection unit 2361 can select one or more multi-stage delivery patterns based on the correspondence table T104 and the content of the acquired disaster cycle information. In the example shown in FIG. 11 , the multi-stage delivery patterns corresponding to the disaster cycle information "hyperacute phase / before primary (initial) command determination" are No. 001, 002, and 003, the multi-stage delivery pattern corresponding to "hyperacute phase / before secondary command determination" is No. 004, and the multi-stage delivery pattern corresponding to "acute phase" is No. 005 and 006.
[0084] Next, a selection method based on priority delivery information will be described. The priority delivery information is information acquired by the above-mentioned user request acquisition unit 2310. When using this selection method, the delivery pattern selection unit 2361 selects a delivery pattern from the multistage delivery pattern candidates shown in Table T102 of Fig. 8 generated by the multistage delivery pattern generation unit 2330, in which the content of the processed data of the primary delivery information (i.e., the delivery information) matches the priority delivery information acquired by the user request acquisition unit 2310.
[0085] When the priority distribution information acquired by the user request acquisition unit 2310 is "orthoimage" as shown in Table 101 of FIG. 7, the distribution pattern selection unit 2361 selects No. 001, 002, 003, and 004 from the multi-stage distribution pattern candidates shown in Table 102 of FIG. 8.
[0086] Next, a selection method based on a desired delivery time will be described. The desired delivery time is information acquired by the user request acquisition unit 2310 described above. When this selection method is used, the delivery pattern selection unit 2361 compares the scheduled delivery time shown in Table T103 in FIG. 9 estimated by the processing time estimation unit described above with the desired delivery time information acquired by the user request acquisition unit 2310, and selects a delivery pattern whose scheduled delivery time is earlier than the desired delivery time input by the user. Note that the scheduled delivery time does not necessarily have to be earlier than the desired delivery time; a delivery pattern whose scheduled delivery time is close to the desired delivery time may be selected.
[0087] When the desired delivery time acquired by the user request acquisition unit 2310 is "August 30, 2023, 9:30 AM" as shown in Table 101 of FIG. 7, the delivery pattern selection unit 2361 selects No. 002 and 003 from the multi-stage delivery pattern candidates shown in Table 102 of FIG. 8.
[0088] Furthermore, when the selection method based on the priority distribution information and the selection method based on the desired distribution time are combined to perform selection under the AND condition of both selection criteria, the distribution pattern selection unit 2361 selects, from among the multi-stage distribution pattern candidates, a distribution pattern that satisfies both conditions of the priority distribution information "orthoimage" and the desired distribution time "August 30, 2023, 9:30 AM" shown in Table 101 of Fig. 7 acquired by the user request acquisition unit 2310. In the example shown in Table T103 of Fig. 9, distribution pattern Nos. 002 and 003 satisfy both of the above-mentioned conditions, and therefore, distribution pattern Nos. 002 and 003 are selected by the distribution pattern selection unit 2361.
[0089] (A-1-6-6-2. User designation acceptance unit 2362) The user designation acceptance unit 2362 displays one or more multi-stage distribution patterns selected by the distribution pattern selection unit 2361 on the display constituting the output device 200, accepts user command inputs for the one or more displayed multi-stage distribution patterns, and finalizes the distribution pattern based on the designated input information. Details of the display screen and designation input method by the user designation acceptance unit 2362 will be described later.
[0090] As a modified example, regardless of the selection result of the distribution pattern by the distribution pattern selection unit 2361, all of the multi-stage distribution pattern candidates shown in Table T102 of FIG. 8 generated by the multi-stage distribution pattern generation unit 2330 can be displayed on the display constituting the output device 200, a user command input for all the displayed multi-stage distribution pattern candidates can be accepted, and the distribution pattern can be determined based on the designated input information.
[0091] (A-1-6-6-3. Distribution Pattern Modification Needed Determination Unit 2363) After determining the multistage distribution pattern, the distribution pattern modification needed determination unit 2363 determines whether the once determined multistage distribution pattern needs to be modified when actually performing data acquisition processing by the aircraft 1000. For example, if it is determined that the total data amount of acquired data actually acquired by the aircraft is significantly larger or smaller than the total data amount of acquired data estimated by the acquired data amount estimation unit 2320, there is a possibility that the once determined multistage distribution pattern is not an appropriate distribution pattern for the user. Therefore, the distribution pattern modification needed determination unit 2363 determines that the distribution pattern needs to be modified and causes the processing time estimation unit 2340 to re-execute processing time estimation processing and the multistage distribution pattern determination unit 2360 to re-determine the multistage distribution pattern. A detailed processing flow at this time will be described later.
[0092] (A-1-6-7. Processing means determination unit 2370) The processing means determination unit 2370 determines, from multiple candidates, a data processing unit that executes each analysis process that generates multi-stage distribution information (primary distribution information, secondary distribution information, tertiary distribution information, ...) in the multi-stage distribution pattern, and a transmission path for acquired data etc. necessary for the analysis process, in accordance with the content of the multi-stage distribution pattern determined by the above-mentioned multi-stage distribution pattern determination unit 2360. In order to realize functions including the determination function, the processing means determination unit 2370 includes a data processing location candidate generation unit 2371, a communication speed determination unit 2372, a data processing speed determination unit 2373, a total time estimation unit 2374, a processing means determination unit 2375, and a processing means determination unit 2376.
[0093] (A-1-6-7-1. Data processing location candidate generation unit 2371) The data processing location candidate generation unit 2371 identifies systems that are equipped with data processing units capable of performing analytical processing among the aircraft 1000, data acquisition base system 2000, and data processing base system 3000, which are the subsystems that make up the aviation data processing system 1. For example, the data processing location candidate generation unit 2371 may communicate with the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 to obtain information regarding the presence or absence of a data processing unit, or may obtain information regarding the presence or absence of a data processing unit that is pre-recorded in the acquisition data amount estimation unit 2320.
[0094] Furthermore, the data processing location candidate generation unit 2371 may grasp variations in transmission routes between the respective subsystems that make up the aviation data processing system 1, namely the aircraft 1000, the data acquisition base system 2000, the data processing base system 3000, and the distribution system 4000. Specifically, the unit grasps variations in transmission routes for transmitting acquired data and processed data from the time when acquired data acquired by the aircraft 1000 is analyzed and processed in one of the subsystems until the processed data is transmitted to the distribution system. This information on variations in transmission routes may be pre-recorded in the acquired data amount estimation unit 2320, or the data processing location candidate generation unit 2371 may generate variations in communication routes based on information on the presence or absence of a data processing unit.
[0095] Here, there may be an embodiment in which the processed data is transmitted directly to the user terminal device without going through the distribution system. In such a case, the variations in the transmission paths along which the acquired data and processed data are transmitted are understood, from when the acquired data acquired by the aircraft 1000 is analyzed and processed in one of the subsystems until the processed data is sent to the user terminal device.
[0096] Fig. 12 is a table showing an example of patterns of data transmission paths and data processing locations in an aviation data processing system. The example shown in Table T104 of Fig. 12 shows processing method patterns that combine variations in the locations where data analysis is performed (referred to in the table as "data analysis implementation locations") and variations in the data transmission paths between each system, in a case where the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 each have a data processing unit. The data processing location candidate generation unit 2371 generates pattern information of locations where data analysis is performed and transmission paths, as shown in Table T105 of Fig. 12.
[0097] A01, A02-1, A02-2, and A03 in Table T105 indicate patterns where data analysis is performed onboard an aircraft. A01 indicates a pattern where processed data is transmitted directly from the aircraft to the distribution system. A02-1 and A02-2 indicate patterns where processed data is transmitted from the aircraft to the distribution system via a data acquisition center system. In particular, A02-1 indicates that processed data is transmitted from the aircraft to the data acquisition center system via wireless communication, whereas A02-2 indicates that processed data is transmitted from the aircraft to the data acquisition center system by physically moving the memory device, i.e., by landing the aircraft and physically bringing the memory installed onboard the aircraft to the data acquisition center system. A03 indicates a pattern where processed data is transmitted from the aircraft to the distribution system via a data processing center system.
[0098] P01, P02-1, P02-2, and P02-3 in Table T105 indicate patterns where data analysis is performed within a data processing center system. P01 indicates a pattern where acquired data is transmitted directly from the aircraft to the data processing center system via communications. P02-1, P02-2, and P02-3 indicate patterns where acquired data is transmitted to the data processing center system via a data acquisition center system. P02-1 indicates a pattern where both transmission from the aircraft to the data acquisition center system and transmission from the data acquisition center system to the data processing center system are via communications. P02-2 indicates a pattern where the transmission method for acquired data from the aircraft to the data acquisition center system is physical movement of a memory device. P02-3 indicates a pattern where both transmission from the aircraft to the data acquisition center system and transmission from the data acquisition center system to the data processing center system are physical movement of a memory device.
[0099] C01-1 and C01-2 in Table T105 indicate patterns where data analysis is performed within a data acquisition site system. C01-1 is a pattern where acquired data is transmitted from an aircraft to a data acquisition site system via communication, while C01-2 is a pattern where acquired data is transmitted from an aircraft to a data acquisition site system by physically moving a memory device.
[0100] (A-1-6-7-2. Communication speed determination unit 2372) The communication speed determination unit 2372 determines the communication speed for each of the multiple communication means for each transmission path determined by the data processing location candidate generation unit 2371. Furthermore, it determines the communication means with the fastest communication speed among the multiple communication means. The communication speed is determined, for example, by acquiring information measured by the communication status determination unit 1430 of the aircraft 1000 or a communication infrastructure management system. Note that while it is desirable to determine the communication speed from the measurement value of the communication speed at the current time, it may also be determined from the measurement value of the communication speed measured in the past.
[0101] FIG. 13 is a table showing an example of the communication speeds of communication means for each data transmission path in an aviation data processing system. For example, as shown in Table T106 of FIG. 13 , three types of communication means are possible for the transmission path from the aircraft 1000 to the data acquisition base system 2000: direct wireless communication using radio waves in the 2.4 GHz band (referred to as "Direct 2.4G" in the table), satellite communication using a relay via an artificial satellite (referred to as "Satellite Relay" in the table), and wireless communication using a mobile phone communication line such as LTE (Long Term Evolution) (referred to as "Mobile Phone Communication Line (LTE)" in the table). Therefore, the communication speed determination unit 2372 determines the communication speed for each of these communication means. The information shown in FIG. 13 may be displayed on the display device of the output device 200.
[0102] In the example shown in Table T106 of Figure 13, the communication speeds of satellite relay and mobile phone communication lines (LTE) are further grasped as communication means on the transmission path from the aircraft 1000 to the data processing base system 3000, the communication speeds of satellite relay and mobile phone communication lines (LTE) are grasped as communication means on the transmission path from the aircraft 1000 to the distribution system 4000, the communication speed of the mobile phone communication line (LTE) is grasped as communication means on the transmission path from the data acquisition base system 2000 to the data processing base system 3000, the communication speed of the mobile phone communication line (LTE) is grasped as communication means on the transmission path from the data acquisition base system 2000 to the distribution system 4000, and the communication speed of the wired line is grasped as communication means on the transmission path from the data processing base system 3000 to the distribution system 4000.
[0103] In the example shown in Table T106 of Figure 13, four types of communication means are used: direct 2.4G, satellite relay, mobile phone communication line (LTE), and wired line. However, the communication means are not limited to these, and other mobile phone communication lines such as 4G and 5G, or Wi-Fi lines, etc. can also be used.
[0104] When determining the communication speed, if a communication means that goes through multiple devices, such as satellite communication, is used, the communication speed between each device is measured, and the slowest communication speed within the communication path is determined to be the actual communication speed. For example, if satellite communication is used as the communication means for the transmission path from an aircraft to a data acquisition base system, the communication speeds from the aircraft to the satellite and from the satellite to the data acquisition base system are measured, and the slower of the two communication speeds is determined to be the actual communication speed of the satellite communication.
[0105] (A-1-6-7-3. Data processing speed determination unit 2373) The data processing speed determination unit 2373 determines the processing speed of the data analysis processing for each subsystem (aircraft 1000, data acquisition base system 2000, data processing base system 3000) that can perform the analysis processing identified by the data processing location candidate generation unit 2371. Here, the processing speed of the data analysis processing may be determined by measuring the processing speed when the analysis processing is actually performed in each system, or may be determined based on a rated processing speed that is identified in advance.
[0106] If there is an analytical processing task currently being executed in any of the data processing units of the aircraft 1000, the data acquisition base system 2000, or the data processing base system 3000, the actual processing speed may be calculated based on the progress or scheduled end time of the analytical processing task currently being executed. Alternatively, if there is an analytical processing task scheduled to be executed in the data processing unit, the actual processing speed may be calculated based on the time required to complete the analytical processing task or the scheduled end time.
[0107] 14 is a table showing an example of the data analysis speed in each subsystem constituting the aviation data processing system. For example, as shown in table T107 in FIG. 14, the analysis speed of each data processing unit installed in the aircraft 1000, data acquisition base system 2000, and data processing base system 3000 is determined. In the example shown in T107, the analysis speed of each data processing unit is 4 GHz for the data processing unit of the aircraft, 8 GHz for the data processing unit of the data acquisition base system, and 24 GHz for the data processing unit of the data processing base system.
[0108] (A-1-6-7-4. Total time estimation unit 2374) The total time estimation unit 2374 estimates the data transmission time and analysis processing time required to perform the transmission processing and analysis processing for each pattern of data analysis execution locations and transmission routes generated by the data processing location candidate generation unit 2371 for each of the primary distribution information and secondary distribution information (and tertiary distribution information) in the multistage distribution pattern determined by the multistage distribution pattern determination unit 2360, and estimates the total time taking into account the data transmission time and analysis processing time for each of the primary distribution information and secondary distribution information (and tertiary distribution information). Note that this total time may include the time required for data measurement by sensors on the aircraft 1000.
[0109] First, a method for estimating the analysis processing time in the data analysis execution location pattern will be described. The total time estimation unit 2374 estimates the analysis processing time required to generate each piece of distribution information in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, based on at least one of information on the data amount of acquired data estimated by the acquired data amount estimation unit 2320, information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2373, and information on the processing content of the primary distribution information, secondary distribution information (and tertiary distribution information) in the confirmed multi-stage distribution pattern.
[0110] Here, as shown in Table T102 in FIG. 8 , at least primary distribution information and secondary distribution information (and tertiary distribution information) are defined for each multi-stage distribution pattern. Therefore, when estimating the analysis processing time, the total time estimation unit 2374 estimates the analysis processing time in each data processing unit installed in the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 for each piece of distribution information, based on information on the analysis processing load for generating each piece of distribution information according to the processing content of each piece of distribution information.
[0111] In the example shown in Table T107 of Figure 14, the analysis speed of the data processing unit of the data processing center system is faster than that of the data processing unit of the other aircraft 1000 and the data acquisition center system, so the analysis processing time is shortest for the data processing center system, followed by the data acquisition center system, and longest for the aircraft.
[0112] Next, a method for estimating the transmission time for each pattern of data transmission paths will be described. The total time estimation unit 2374 estimates the transmission time for the acquired data for each transmission path for each piece of distribution information based on at least one of the following information: information on the data amount of acquired data estimated by the acquired data amount estimation unit 2320, information on the communication speed for each transmission path determined by the communication speed determination unit 2372, and information on the processing content of each piece of distribution information in the confirmed multi-stage distribution pattern. Furthermore, since the transmitted data includes not only the acquired data but also post-processing data and data for processing, the transmission time required for transmitting each piece of data, including the post-processing data and data for processing, is also estimated.
[0113] Here, as shown in Table T102 in FIG. 8 , each multi-stage distribution pattern defines at least multiple pieces of distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.). Therefore, when estimating the data transmission time, the total time estimation unit 2374 estimates the acquisition data and processing data necessary to generate each piece of distribution information according to the processing content of each piece of distribution information, as well as the data volume of each piece of distribution information to be generated, and estimates the transmission time of each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information, etc.) on each transmission path based on the acquisition data, processing data, and data volume of each piece of distribution information.
[0114] Furthermore, in the secondary distribution information No. 001 in Table T102, the content of the analysis process requires "geographic information" as processing data. Furthermore, in the secondary distribution information No. 004, "supplementary data (geographic information)" is required as processing data. In the secondary distribution information No. 005, "past map integrated data" is required as processing data. Thus, when performing analysis using processing data, the processing data recorded in the processing data recording unit 3300 of the data processing base system is transmitted to the data processing unit that executes the analysis process. Therefore, the transmission time of the processing data on each transmission path is estimated based on the amount of processing data previously recorded in the processing data recording unit 3300 and information on the communication speed for each transmission path of the processing data.
[0115] Note that the data transmission path and data processing location pattern "P01" shown in Table T105 of Figure 12 illustrates an example in which data is transmitted from an aircraft to a data acquisition site, etc., by physically moving a storage medium such as a memory, rather than using a communication line. When using a data transmission method that physically moves a storage medium, the data transmission time can be estimated as, for example, the time required for the aircraft to physically move a memory from an aircraft to a data acquisition site system, from the time the aircraft lands at the data acquisition site system, to the time the memory is removed from the aircraft's fuselage, and the acquired data is read from the memory. Similarly, when physically moving a memory from a data acquisition site system to a data processing site system, the transmission time can be estimated as the time required for the memory to be read from the memory, in addition to the time required for the aircraft to move from the data acquisition site system to the data processing site system.
[0116] Here, the acquired data is a sensed image or point cloud data, so the amount of data is larger than the processed data. For example, the amount of data in the processed data is about 1 / 10 of the amount of data in the acquired data. Also, although it varies depending on the analysis content shown in Table T101, the amount of data in the processing data is equal to or less than the amount of data in the processed data.
[0117] Next, a method for the total time estimation unit 2374 to estimate the total time by taking into account the data transmission time and analysis processing time estimated by the above-described method will be described. First, for each processing means pattern shown in Table T105, the total time can be estimated by taking into account the transmission time and analysis processing time for each of the primary distribution information, secondary distribution information (and tertiary distribution information) estimated by the above-described method. As an example, if multistage distribution pattern No. 001 is the determination result by the multistage distribution pattern determination unit 2360, a first total time is estimated by taking into account (or adding) the transmission time and analysis processing time for the "orthoimage" which is the primary distribution information, and a second total time is estimated by taking into account (or adding) the transmission time and analysis processing time for the "map-integrated image" which is the secondary distribution information.
[0118] On the other hand, if some of the processes from the data acquisition process by the aircraft's sensors to the distribution of primary distribution information to the user terminal device can be executed in parallel, or if some of the transmission processes and analysis processes (distribution information generation processes) related to the primary distribution information and secondary distribution information (and even tertiary distribution information) can be executed in parallel, it is desirable to estimate the total time by taking into account the parallel execution time of each process executed in parallel.
[0119] (A-1-6-7-5. Processing means determination unit 2375) Based on the estimated total time for each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) estimated by the total time estimation unit 2374, the processing means determination unit 2375 determines the pattern of analysis execution location and transmission route that will result in the shortest first total time for the primary distribution information, and determines the pattern of analysis execution location and transmission route that will result in the shortest second total time for the secondary distribution information, and displays the determination results on a display that constitutes the output device 200.
[0120] (A-1-6-7-6. Processing means determination unit 2376) The processing means determination unit 2376 determines a pattern for executing processing based on the pattern of the analysis processing execution location and transmission route for each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2375.
[0121] The processing means determination unit 2376 first proposes to the user one or more candidate patterns for the analysis processing location and transmission route for each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2375. For example, the proposal is made to the user by displaying the proposed candidate pattern on the output device 200 (such as a display) of the work determination system.
[0122] Next, the processing means determination unit 2376 receives approval or selection from the user for one or more candidate patterns for the proposed analysis processing location and transmission route via the input device 100 of the work determination system (a touch panel, keyboard, mouse, or audio input device such as a microphone). The processing means determination unit 2376 determines the processing means for each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) based on the approval or selection input received from the user. The detailed methods of proposal and selection reception by the processing means determination unit 2376 will be described later.
[0123] It should be noted that the determination of the processing means by the processing means determination unit 2376 is not limited to the method of determining the processing means based on approval or selection input received from the user as described above, and for example, the pattern determined by the processing means determination unit 2375 can also be automatically determined without approval or selection by the user.
[0124] (A-1-6-8. Processing execution command unit 2380) The processing execution command unit 2380 transmits operation commands based on the multistage distribution pattern information determined by the multistage distribution pattern determination unit 2360 and the processing means pattern information for each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2376 to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, thereby causing the aircraft to perform the following processes: data acquisition processing by the aircraft, generation of primary distribution information accompanied by data transmission processing and analysis processing, distribution of the primary distribution information, generation of secondary distribution information accompanied by data transmission processing and analysis processing, and distribution of the secondary distribution information. Furthermore, if the content of the analysis processing requires processing data such as geographic information, as shown in No. 001 and 004 of Table T102, the operation command transmitted to the data processing base system 3000 includes a request command to transmit the processing data recorded in the processing data recording unit 3300 of the data processing base system to the data processing unit that executes the analysis processing. Here, the primary distribution information in the multi-stage distribution pattern is distribution information that is distributed to the user terminal device 5000 prior to other distribution information, the secondary distribution information is distribution information that is distributed to the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is distribution information that is distributed even later than the secondary distribution information to the user terminal device 5000. Therefore, the operation command transmitted to the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 includes an information provision command so that the secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the secondary distribution information.
[0125] Upon receiving the operation command from the processing execution command unit 2380, the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 execute the operation tasks (including data transmission and analysis processing) of their own systems in the processing means pattern determined in accordance with the operation command. As described above, the operation command includes an information provision command in which the secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the secondary distribution information. Therefore, in accordance with the operation command, the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000 provide or distribute the secondary distribution information after the primary distribution information and the tertiary distribution information after the secondary distribution information to the distribution system 4000 or the user terminal device 5000 in stages.
[0126] In addition, if it is possible to execute part of each process in parallel from data sensing to data transmission and data processing until the primary distribution information is distributed to the user terminal device, or if it is possible to execute part of the transmission process and data process (distribution information generation process) related to the primary distribution information and secondary distribution information (and even tertiary distribution information) in parallel, these processes may be executed in parallel.
[0127] For example, in the multi-stage distribution pattern "No. 002" described in Table T102, when an integrated image is generated as the primary distribution information and an orthoimage is generated as the secondary distribution information, and the primary distribution information is analyzed and processed by the data processing unit of the aircraft in accordance with processing means pattern "A01," and the secondary distribution information is analyzed and processed by the data processing unit of the data acquisition base system in accordance with processing means pattern "C01-1," the work of analyzing and processing the primary distribution information by the data processing unit of the aircraft and at least part of the work of data transmission processing to transmit the acquired data used for analyzing and processing the secondary distribution information from the aircraft to the data acquisition base system are performed in parallel.
[0128] In this way, by performing at least some of the transmission processing and analysis processing (processing for generating distribution information) for primary distribution information and secondary distribution information (and even tertiary distribution information) in parallel, at least some of the transmission processing and analysis processing for distributing secondary distribution information can be performed in parallel while the transmission processing and analysis processing for distributing primary distribution information is being performed, making it possible to distribute secondary distribution information quickly.
[0129] As described above, at least some of the transmission processing and analysis processing (distribution information generation processing) related to primary distribution information and secondary distribution information (and even tertiary distribution information) can be performed in parallel between various processing tasks, for example, between data acquisition processing and data transmission processing, data acquisition processing and data analysis processing, data transmission processing and data analysis processing, data transmission processing and data transmission processing, and data analysis processing and data analysis processing.
[0130] <Hardware Configuration> Figure 15 is a diagram showing an example of the hardware configuration of an activity determination system. Here, the activity determination system 2300 of the present invention is an information processing device such as a server device or a PC. As shown in the figure, the activity determination system 2300 has an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary memory device 500, a communication device 600, and a bus 700 that electrically connects these devices.
[0131] The input device 100 is a device that allows a user to input information and instructions to the task determination system. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.
[0132] The output device 200 is a device that outputs information generated by the operation determination system 2300. Specifically, the output device 802 is a display, a printer, or a speaker.
[0133] The processing device 300 is, for example, a device that performs arithmetic processing. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing calculations.
[0134] The main storage device 400 is a memory device such as a RAM that temporarily stores various read information and a ROM that stores programs, application programs, and other various information executed by the processing device 300. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory that can store digital information.
[0135] The communication device 600 is a device that performs wireless or wired information communication with an external device.
[0136] Note that while Figure 11 explains the hardware configuration of the work determination system 2300, other systems within the data acquisition base system 2000 (communications infrastructure management system 2100, aircraft operation operating system 2200, data processing unit 2400, operation management system 2500, airspace monitoring system 2600), data processing base system 3000, distribution system 4000, and user terminal device 5000 (including crisis management headquarters terminals) can also be realized with a hardware configuration similar to that shown in Figure 11 above.
[0137] <Control Flow> (A-1-7. High-Level Control Flow of the Aviation Data Processing System) Next, the processing flow of the work determination system will be described with reference to the drawings. Figure 16 is a flowchart showing the processing flow of the work determination system.
[0138] First, the user request acquisition unit 2310 acquires user request information via the user terminal device 5000, which includes the crisis countermeasure headquarters terminal, etc. (step 101).
[0139] Next, the acquired data amount estimation unit 2320 predicts the total amount of acquired data (step 102). Note that this step is executed before the sensing operation by the aircraft is started, or at least before the sensing operation is completed.
[0140] Next, the multi-stage distribution pattern generation unit 2330 generates a plurality of multi-stage distribution pattern candidates for distribution data that is provided in a plurality of stages (step 103).
[0141] Next, the processing time estimation unit 2340 estimates the required processing time for each piece of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated for each of the multiple multistage distribution pattern candidates (step 104). Note that the required processing time may be estimated taking into account not only the time required for the analysis process to generate each piece of distribution information, but also the time required for the data acquisition process and data transmission process.
[0142] Next, the disaster cycle information acquisition unit 2350 acquires disaster cycle information (that is, the period in the disaster cycle corresponding to the current situation information) (step 105).
[0143] Next, the multistage distribution pattern determination unit 2360 determines one or more multistage distribution patterns from the multistage distribution pattern candidates (step 106).
[0144] Next, the processing means determining unit 2370 determines the data processing location and transmission route for generating each piece of distribution information (primary distribution information, secondary distribution information, tertiary distribution information, . . . ) (step 107).
[0145] Next, the process execution command unit 2380 causes the aircraft 1000 to execute a data acquisition process (sensing process by the sensors) (step 108).
[0146] Next, the distribution pattern correction necessity determining section 2363 of the multi-stage distribution pattern determining section 2360 determines whether or not the distribution pattern needs to be corrected (step 109).
[0147] Next, an operational command based on the multistage distribution pattern information determined by the multistage distribution pattern determination unit 2360 and the information on the processing means pattern for each of the distribution information (primary distribution information, secondary distribution information, tertiary distribution information) determined by the processing means determination unit 2376 is output to each system, namely, the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, to execute transmission processing, analysis processing, provision to the distribution system 4000 or the user terminal device 5000, or distribution processing operations for each of the distribution information divided into multiple stages (primary distribution information, secondary distribution information, tertiary distribution information) (step 110). Here, with regard to the providing or distributing operation, the operation command includes an information providing command in which the secondary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the primary distribution information, and the tertiary distribution information is provided to the distribution system 4000 or the user terminal device 5000 after the secondary distribution information, so that the aircraft 1000, the data acquisition base system 2000, and the data processing base system 3000, in accordance with the operation command, provide or distribute the secondary distribution information after the primary distribution information, and the tertiary distribution information after the secondary distribution information, in stages, to the distribution system 4000 or the user terminal device 5000. Note that the processes for generating the primary and secondary distribution information executed in this step are both generated using the common acquired data sensed in step 108, or using data obtained by processing the acquired data.
[0148] (A-1-8. Detailed Control Flow of Acquired Data Amount Estimation Unit 2320) Fig. 17 is a flowchart showing an example of the control flow when the operation determination system determines the total amount of acquired data. In particular, this control flow explains an example of detailed processing of step 102 "Estimate total amount of acquired data" in the flowchart shown in Fig. 16.
[0149] First, the acquired data amount estimation unit 2320 estimates the area of the sensing target area by the sensors mounted on the aircraft (step 201). For example, the area of the sensing target area is estimated based on information on the "acquisition target area" acquired by the user request acquisition unit 2310. Note that in this step, it is sufficient to estimate information related to the sensing range, not just the area of the sensing target area. Therefore, instead of estimating the area, it is also possible to estimate, for example, the aircraft's planned flight path, planned flight time, the sensing target range on the Earth's surface, or the range of the planned flight airspace.
[0150] Next, the acquired data amount estimation unit 2320 determines the type of acquired data (step 202). The type of acquired data may be, for example, optical images, infrared images, point cloud data, or the like. In this step, instead of the type of acquired data, the type of sensor used to acquire the acquired data may be determined. Here, the sensor type may be an optical camera that captures optical images, an infrared sensor that acquires infrared images, or a laser sensor including LiDAR that acquires point cloud data. Information on the type of acquired data or sensor type can be determined from information acquired from the input device 100 of the aircraft 1000, the aircraft flight operating system 2200, or the task determination system 2300.
[0151] Next, the acquired data amount estimation unit 2320 determines the unit information amount (step 203). The unit information amount is a setting parameter related to the amount of data per unit area, such as the resolution of optical images or infrared images, or the point cloud density of point cloud data. Information on the type of acquired data or sensor type can be determined from information acquired from the input device 100 of the aircraft 1000, the aircraft flight operating system 2200, or the task determination system 2300.
[0152] Next, the total amount of acquired data is estimated by the acquired data amount estimation unit 2320 (step 204). The total amount of acquired data can be calculated based on a combination of the information acquired in each of the processing steps 201 to 203 described above, or on at least one of the pieces of information.
[0153] 17, the process of estimating the total amount of acquired data by the acquired data amount estimator 2320 is performed before the sensing process by the aircraft is started, or at least before the sensing process is completed. By calculating the total amount of acquired data at such timing, it becomes possible to determine an appropriate transmission route and data processing location according to the estimated value of the total amount of acquired data, at least before the transmission process and analysis process of the acquired data are started.
[0154] (A-1-9. Detailed Control Flow of the Multistage Delivery Pattern Determination Unit 2360) Fig. 18 is a flowchart showing an example of a control flow when the multistage delivery pattern determination unit 2360 determines a delivery pattern. In particular, this is a control flow explaining an example of detailed processing of step 106 "Determination of multistage delivery pattern" in the flowchart shown in Fig. 16.
[0155] First, the distribution pattern selection unit 2361 of the multistage distribution pattern determination unit 2360 selects one or more multistage distribution patterns from among multistage distribution pattern candidates based on disaster cycle information (step 301). In this processing step, one or more multistage distribution patterns are selected based on, for example, the distribution pattern determination criteria shown in Table T104 in Fig. 11 and the disaster cycle information acquired by the disaster cycle information acquisition unit 2350.
[0156] Next, the delivery pattern selection unit 2361 of the multistage delivery pattern determination unit 2360 selects one or more multistage delivery patterns from the multistage delivery pattern candidates based on the priority delivery information acquired by the user request acquisition unit 2310 (step 302). For example, in this processing step, the delivery pattern selection unit 2361 selects a delivery pattern whose content of the processed data of the primary delivery information (i.e., delivery information) matches the priority delivery information acquired by the user request acquisition unit 2310 from the multistage delivery pattern candidates shown in Table T102 of Fig. 8 generated by the multistage delivery pattern generation unit 2330.
[0157] Next, the delivery pattern selection unit 2361 of the multistage delivery pattern determination unit 2360 selects one or more multistage delivery patterns from the multistage delivery pattern candidates based on the desired delivery time acquired by the user request acquisition unit 2310 (step 303). For example, in this processing step, the delivery pattern selection unit 2361 compares the scheduled delivery time shown in Table T103 of Fig. 9 estimated by the above-mentioned processing time estimation unit with the information on the desired delivery time acquired by the user request acquisition unit 2310, and selects a delivery pattern whose scheduled delivery time is earlier than the desired delivery time input by the user. Note that the scheduled delivery time does not necessarily have to be earlier than the desired delivery time, and a delivery pattern whose scheduled delivery time is close to the desired delivery time may be selected.
[0158] In this flowchart, an example has been described in which the three selection processes described in steps 301 to 303 are performed under an AND condition. In this way, by selecting a multi-stage delivery pattern using multiple selection processes, it is possible to select a delivery pattern that better matches the user's needs. Furthermore, in the present invention, it is sufficient to have at least one of the selection processes in steps 301 to 303 without using multiple selection criteria.
[0159] Next, the user specification receiving unit 2362 of the multistage distribution pattern determination unit 2360 displays one or more multistage distribution patterns selected by the distribution pattern selection unit 2361 on a display constituting the output device 200 of the work determination system 2300 or the user terminal device 5000 (step 304).
[0160] 19 is a diagram showing an example of a display screen of the determination result when the multistage distribution pattern determination unit determines the distribution pattern. The example display screen shown in FIG. 19 shows the results of the determination process in steps 301 to 303 described above when the user requests wired distribution information to be "orthoimages" and the desired distribution time to be "9:30 AM," and also receives disaster cycle information that is "hyperacute phase / before initial response determination." Since only two distribution patterns, No. 002 and No. 003, meet the determination criteria based on the user request and the disaster cycle information, this display screen indicates that these two patterns meet the determination criteria, and the two patterns are highlighted in bold and shaded.
[0161] Next, the user designation accepting unit 2362 of the multistage distribution pattern determination unit 2360 accepts a user designation input for one or more determination results of multistage distribution patterns displayed on the display screen (step 305). In the example shown in Fig. 19, a selection input field is displayed in which the user can select either distribution pattern No. 002 or 003 for the multistage distribution pattern selection result (distribution pattern Nos. 002 and 003) displayed in step 304, and further, a confirmation button (indicated as "Confirm selected pattern" in the drawing) for confirming the distribution pattern selected in the selection input field is displayed. In the example shown in Fig. 19, since distribution pattern No. 002 is selected in the selection input field on the left side of the screen, the user can specify distribution pattern No. 002 by pressing the confirmation button on the screen.
[0162] 19, selection input fields are provided for not only No. 002 and 003, which are the multistage distribution pattern determination results determined in steps 301 to 303, but also other No. 001, 004, 005, and 006, allowing the user to specify and input. In other words, regardless of the automatic determination result of the multistage distribution pattern by the multistage distribution pattern determination unit 2360, the user may be allowed to specify and input an arbitrary multistage distribution pattern.
[0163] Next, the user specification accepting unit 2362 of the multistage distribution pattern determining unit 2360 determines the distribution pattern based on the received user specification input (step 306). Note that in this flowchart, the process of determining the distribution pattern in this step may be performed not only based on the received user specification input, but also by determining the multistage distribution pattern in steps 301 to 303. If one distribution pattern can be selected in the process of determining the multistage distribution pattern, the determination result of the multistage distribution pattern may be determined as the distribution pattern (regardless of whether or not a user specification input is present).
[0164] (A-1-10. Detailed Control Flow of the Processing Means Determination Unit 2370) Fig. 20 is a flowchart showing an example of the control flow when the processing means determination unit determines the processing means. In particular, this is a control flow that explains an example of detailed processing of step 107 "Determination of data processing location and transmission route" in the flowchart shown in Fig. 16.
[0165] First, the data processing location candidate generating unit 2371 generates combination patterns of a plurality of data processing locations and a plurality of transmission routes for data in the aviation data processing system (step 401).
[0166] Next, the communication speed determination unit 2372 and the data processing speed determination unit 2373 determine the communication speed for each of the multiple transmission routes and the processing speed of the data analysis process for each of the multiple data processing locations (step 402). Note that in determining the communication speed for each of the multiple transmission routes, the communication speed for each of the multiple communication means on each transmission route is grasped, and the communication means with the fastest communication speed is determined from the multiple communication means, and this communication means is determined as the communication speed for that transmission route.
[0167] Next, the total time estimation unit 2374 estimates the data acquisition time required for the data acquisition process (sensing process) by the sensors of the aircraft 1000 (step 403). Information about the sensing range (for example, the planned flight path of the aircraft, the planned flight time, the sensing target range on the Earth's surface, or the range of the planned flight airspace) is generated based on information about the acquisition target area acquired by the user request acquisition unit 2310, and the data acquisition time required for the data acquisition process is estimated based on the information about the sensing range.
[0168] Next, the total time estimation unit 2374 estimates the data transmission time when data is transmitted using a communication line (step 404). As an example of a method for estimating the data transmission time using a communication line in this step, for example, the data transmission time is estimated for each combination pattern of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and each transmission path based on all or at least one of information on the data amount of acquired data estimated by the acquired data amount estimation unit 2320, information on the communication speed for each transmission path determined by the communication speed determination unit 2372, and information on the analysis processing content for generating each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) in the confirmed multi-stage distribution pattern.
[0169] Next, the total time estimation unit 2374 estimates the data transmission time when data transmission is performed using the physical movement of the recording medium (step 405). As an example of a method for estimating the data transmission time using the physical movement of the recording medium in this step, for example, in the case of the physical movement of the recording medium from an aircraft to a data acquisition center system, the data transmission time can be estimated as the time required from the aircraft landing at the data acquisition center system, removing the recording medium from the fuselage of the aircraft, and reading the acquired data from the recording medium. Also, in the case of the physical movement of the recording medium from a data acquisition center system to a data processing center system, the data transmission time can be estimated as the time required from the data acquisition center system to the data processing center system to reading the acquired data from the recording medium in addition to the travel time from the data acquisition center system to the data processing center system.
[0170] Next, the total time estimation unit 2374 estimates the data analysis time (step 406). As an example of a method for estimating the data analysis time in this step, for example, the data analysis time is estimated for each combination pattern of each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and each data processing location based on all or at least one of information on the data amount of acquired data estimated by the acquired data amount estimation unit 2320, information on the analysis speed of each data processing unit determined by the data processing speed determination unit 2373, and information on the analysis processing content for generating each distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) in the confirmed multi-stage distribution pattern.
[0171] Next, the total time estimation unit 2374 checks whether parallel work is possible in which parts of the data acquisition process, data transmission process, data analysis process, and post-processing data transmission process are performed in parallel from the time the data acquisition process is performed until the distribution information is distributed to the user terminal device, or whether parallel work is possible in which parts of the transmission process and analysis process for the primary distribution information and the transmission process and analysis process for the secondary distribution information (or tertiary distribution information) are performed in parallel (step 407).
[0172] Next, the total processing time is estimated by the total time estimation unit 2374 (step 408). If parallel work is not possible as a result of checking whether parallel work is possible in step 407, the total required time is estimated by adding the transmission time and analysis processing time calculated for each combination of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and data processing location and transmission route pattern shown in Table T105. In this case, the total required time for primary distribution information may be calculated by adding the data acquisition time in addition to the transmission time and analysis processing time.
[0173] Conversely, if parallel work is possible as a result of checking whether parallel work is possible in step 305, the parallel execution time of each process is obtained for each combination of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) and the data processing location and transmission route pattern shown in Table T105, and the parallel execution time is subtracted from the processing time of processes that can be performed in parallel to estimate the total required time.
[0174] Next, the processing means determination unit 2375 compares the total processing times of the candidate processing means patterns, which are the results of the estimation of the total processing times estimated in step 408, and determines the candidate processing means pattern that will result in the shortest total processing time for each type of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) (step 409). For example, it determines the candidate processing means pattern that will result in the shortest total processing time for primary distribution information, and it also determines the processing means pattern that will result in the shortest total processing time for secondary distribution information.
[0175] Next, the processing means determination unit 2376 displays the determination result of the processing means pattern for each distribution information item on the output device 200 such as a display device, and determines the processing means pattern for each distribution information item by accepting user approval or designated input for the displayed determination result (step 410).
[0176] 21 is a diagram showing an example of a display screen displayed to a user when the processing means determination unit 2376 determines a processing means pattern for primary distribution information. Also, Fig. 22 is a diagram showing an example of a display screen displayed to a user when the processing means determination unit 2376 determines a processing means pattern for secondary distribution information. In particular, Fig. 21 and Fig. 22 show an example of a display screen when it is determined that the multistage distribution pattern is multistage distribution pattern "002" in Table T102 of Fig. 8, that is, that "low-resolution orthoimages" are to be distributed as primary distribution information and "high-resolution orthoimages" are to be distributed as secondary distribution information.
[0177] Figure 21 shows the estimated results of the total processing time estimated for primary distribution information, displaying the total processing time for multiple data processing location patterns. Also, a display example is shown in which "A01," which was determined to be the processing means pattern with the shortest total processing time among these multiple data processing location patterns (i.e., processing means patterns), is highlighted with shading and bold text. Meanwhile, Figure 22 shows the estimated results of the total processing time estimated for secondary distribution information, displaying the total processing time for multiple data processing location patterns. Also, a display example is shown in which "C01-1," which was determined to be the processing means pattern with the shortest total processing time among these multiple data processing location patterns, is highlighted with shading and bold text.
[0178] 21 and 22 display a plurality of processing means patterns, including the processing means pattern that has the shortest total processing time as determined in step 409, and a selection input field is displayed on the left side of the display screen from which each processing means pattern can be selected. Furthermore, a confirmation button (labeled "Confirm Selected Pattern" in the figures) is displayed to confirm the processing means pattern selected in the selection input field. In FIG. 21, since the processing means pattern "A01" has been selected in the selection input field on the left side of the screen, the user can input "A01" as the processing means pattern by pressing the confirmation button labeled "Confirm Selected Pattern" on the screen. In FIG. 22, as in FIG. 21, the processing means pattern can be specified by operating the confirmation button.
[0179] In addition, an embodiment may also be possible in which only one processing means pattern that has the shortest total processing time determined in step 409 is displayed on the screen that receives the user's input to designate a processing means pattern, and the processing means determination unit 2376 receives an input from the user as to whether or not to approve that one processing means pattern. On the other hand, as shown in Figures 21 and 22, an embodiment may also be possible in which a plurality of processing means patterns including the processing means pattern that has the shortest total processing time determined in step 409 are displayed, and the processing means determination unit 2376 receives an input from the user to designate a specific processing means pattern from the plurality of processing means patterns. Alternatively, regardless of the result of the automatic determination of the processing means pattern in step 409, all processing means pattern candidates may be displayed to the user, and the user may designate and input an arbitrary processing means pattern from all processing means pattern candidates.
[0180] The processing means determination unit 2376 determines a processing means pattern based on the user's approval input or designation input for one or more of the above-mentioned processing means pattern candidates. Alternatively, regardless of the information input by the user, the processing means determination unit 2375 may determine the processing means pattern that results in the shortest total processing time as the processing means pattern for each piece of distribution information.
[0181] (A-1-11. Detailed Control Flow of the Distribution Pattern Modification Necessity Determination Unit 2363) Fig. 23 is a diagram showing an example of a control flow when the distribution pattern modification necessity determination unit 2363 determines whether the distribution pattern needs to be modified. In particular, this is a control flow showing an example of detailed processing of step 109 "Determine whether distribution pattern needs to be modified" in the flowchart shown in Fig. 16.
[0182] First, the distribution pattern correction necessity determining unit 2363 calculates the difference between the total amount of data actually acquired by sensing the aircraft 1000 and the total amount of acquired data estimated in step 102 of FIG. 16 (step 501).
[0183] Next, it is determined whether the difference calculated in step 501 is greater than a predetermined value (step 502). If it is determined that the absolute value of the difference is equal to or less than the predetermined value, the process proceeds to step 504. If it is determined that the absolute value of the difference is greater than the predetermined value, the process proceeds to step 503.
[0184] Next, if it is determined that the absolute value of the difference is greater than a predetermined value, the processing time estimation unit 2340 re-estimates the required processing time for each piece of distribution information (primary distribution information, secondary distribution information, and tertiary distribution information) generated in each of the multiple multi-stage distribution pattern candidates (step 503). Note that the processing in this step can be the same as the processing in step 104 described above.
[0185] Next, the multistage distribution pattern determination unit 2360 re-determines the multistage distribution pattern (step 504). Note that the processing in this step can be the same as the processing in step 106 described above.
[0186] Next, the communication speed determination unit 2372 remeasures the communication speed of the transmission path (step 505).
[0187] Next, it is determined whether the absolute value of the change in the communication speed re-measured in step 505 and the communication speed measured previously is greater than a predetermined value (step 506). If the change is greater than the predetermined value, the process proceeds to step 507, and if the change is equal to or less than the predetermined value, the process proceeds to step 508.
[0188] Next, if the amount of change in communication speed is greater than a predetermined value, the processing means determination unit 2370 re-determines the data processing location and transmission path pattern (step 507). Note that the processing in this step can be the same as the processing in step 107 described above.
[0189] As shown in Figure 23, even after determining the multistage delivery pattern and processing means pattern, there may be cases where the amount of data actually acquired by sensing differs significantly from the estimated value in advance, or where the communication speed on the transmission path changes significantly. In such cases, it is highly likely that the multistage delivery pattern and processing means pattern already determined are no longer appropriate to satisfy the user's needs. In such cases, by determining the multistage delivery pattern and processing means pattern again, it becomes possible to perform processing based on an appropriate multistage delivery pattern and processing means pattern that satisfies the user's needs even when the above-mentioned situation change has occurred.
[0190] [A-2. Effect of the Present Embodiment] In an aeronautical data processing system that uses an aircraft to acquire data of a sensing target area, such as a disaster area, using sensors such as cameras and LiDAR devices mounted on the aircraft, analyzes the acquired data, and provides the processed data to a user terminal, such as a crisis management headquarters terminal, there is a problem in that the crisis management headquarters, etc., cannot obtain damage information until the processed data is provided to the user terminal, and therefore cannot determine appropriate countermeasures until the damage information is obtained. On the other hand, as time passes after the occurrence of a disaster, users tend to request processed data that has undergone more detailed analysis processing. As in the first embodiment described above, by dividing the information distributed to the user terminal into multiple types and providing it to the user in stages over time, it is possible to provide information that meets the above-mentioned user requests. As an example, primary distribution information can be used for initial assessment at the scene, and secondary distribution information can be used as information for media announcements.
[0191] The above-described embodiments are merely examples for facilitating understanding of the present invention, and are not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit thereof, and it goes without saying that the present invention includes equivalents thereof.
[0192] DESCRIPTION OF SYMBOLS 1...Aviation data processing system 100...Input device 200...Output device 300...Processing device 400...Main memory device 500...Auxiliary memory device 600...Communication device 700...Bus 1000...Aircraft 1100...Flight unit 1110...Self-position / speed determination unit 1120...Attitude determination unit 1130...Flight control unit 1200...Sensing unit 1210...Sensor 1220...Sensor attitude control unit 1230...Sensor control unit 1300...Communication unit 1310...Control communication unit 1320...Data communication unit 1330...Status data communication unit 1400...Status determination unit 1410...Flight state determination unit 1420...Sensing state determination unit 1430...Communication state determination unit 1500...Data processing unit 1600...Data recording unit 1610...Acquired data recording unit 1620...Processed data recording unit 1630...Communication status recording unit 2000...Data acquisition base system 2100...Communication infrastructure management system 2200...Aircraft flight operating system 2300...Work determination system 2310...User request acquisition unit 2320...Acquisition data amount estimation unit 2330...Multistage distribution pattern generation unit 2340...Processing time estimation unit 2350...Disaster cycle information acquisition unit 2360...Multistage distribution pattern determination unit 2361...Distribution pattern selection unit2362...User designation acceptance unit 2363...Distribution pattern correction necessity determination unit 2370...Processing means determination unit 2371...Data processing implementation location candidate generation unit 2372...Communication speed determination unit 2373...Data processing speed determination unit 2374...Total time estimation unit 2375...Processing means determination unit 2376...Processing means determination unit 2380...Processing execution command unit 2400...Data processing unit 2500...Flight operation management system 2600...Airspace monitoring system 3000...Data processing base system 3100...Communication unit 3200...Data processing unit 3300...Processing data recording unit 4000...Distribution system 4100...Communication unit 4200...Distribution data management unit 5000...Crisis response headquarters terminal
Claims
1. A control system for determining the content of processing work to be performed by an aeronautical data processing system having an aircraft equipped with a sensor for acquiring images or point cloud information of a target area, a data acquisition base system for exchanging control information regarding flight or data acquisition with the aircraft, and a data processing unit for processing the acquired data acquired by the sensor to generate processed data, the control system comprising: a first data processing for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; a second data processing for generating second distribution information from the acquired data or the first distribution information; a first distribution processing for causing the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; and a second distribution processing for causing the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, wherein the processing execution command unit causes the second distribution information to be provided to the user terminal device or the distribution system after the first distribution processing begins to provide the first distribution information to the user terminal device or the distribution system.
2. A control system according to claim 1, wherein the first distribution information and the second distribution information are generated from the common acquired data or processed data obtained by processing the common acquired data.
3. A control system according to claim 1, which generates a distribution pattern including a single or multiple combinations of the contents of the first distribution information and the second distribution information.
4. A control system according to claim 1, which displays on a display device a distribution pattern including a single or multiple combination of the contents of the first distribution information and the second distribution information.
5. A control system as described in claim 3 or 4, wherein the distribution pattern includes at least one of the following: a combination of distribution information in which the processing load of the second data processing that generates the second distribution information is greater than the processing load of the first data processing that generates the first distribution information; and a combination of distribution information in which the time required to generate the second distribution information and provide it to the user terminal device or the distribution system is longer than the time required to generate the first distribution information and provide it to the user terminal device or the distribution system.
6. A control system according to claim 4, further comprising a designated input receiving section for receiving designated input for the distribution pattern displayed on the display device.
7. A control system as described in claim 1, wherein the control system generates a distribution pattern including a single combination regarding the distribution information content of the first distribution information and the second distribution information, and the processing execution command unit causes the aviation data processing system to execute the first distribution processing and the second distribution processing based on the generated combination.
8. A control system according to any one of claims 3, 4 and 7, which generates the distribution pattern in accordance with a timing after the occurrence of a disaster.
9. A control system according to any one of claims 3, 4 and 7, comprising a user request receiving section that receives request information relating to at least one of the first distribution information and the second distribution information.
10. A control system as described in claim 9, wherein when information on a desired delivery time for at least one of the first distribution information and the secondary distribution information is received by the user request receiving unit, the control system generates the distribution pattern based on the desired delivery time.
11. A control system as described in claim 9, wherein, when priority delivery request information relating to the content of at least one of the first distribution information and the secondary distribution information is received by the user request receiving unit, the control system generates the distribution pattern based on the priority delivery request information.
12. A control system as described in claim 1, wherein the first distribution information is an orthoimage obtained by ortho-converting an image of the target area acquired by the sensor into an ortho-image and integrating multiple ortho-converted images, and the second distribution information is an integrated map image that integrates the orthoimage and geographic information.
13. A control system as described in claim 1, wherein the first distribution information is an integrated image obtained by integrating multiple images of the target area acquired by the sensor, and the second distribution information is an orthoimage obtained by orthogonally converting the multiple images of the target area acquired by the sensor into orthogonal images and integrating the multiple orthogonally converted images.
14. A control system as described in claim 1, wherein the first distribution information is an orthoimage obtained by orthogonally converting an image of the target area acquired by the sensor and integrating a plurality of orthogonally converted images, and the second distribution information is complemented data obtained by complementing defective data contained in the orthoimage with other data.
15. A control system as described in claim 1, wherein the first distribution information is a map integrated image obtained by orthogonally converting an image of the target area acquired by the sensor into an orthoimage and integrating multiple orthogonally converted images with geographic information, and the second distribution information is the result of a differential analysis between the map integrated image and a map integrated image generated earlier than the map integrated image.
16. A control system as described in claim 1, wherein the first distribution information is a result of a difference analysis between an image of the target area acquired by the sensor, which is orthogonalized, and a map integrated image is generated by integrating an orthoimage by integrating multiple orthogonal transformed images with geographic information, and the map integrated image generated before the map integrated image is generated, and the map integrated image is generated; and the second distribution information is a result of a detailed analysis of an area within the target area that is determined to have a difference based on the difference analysis result of the first distribution information.
17. A control system as described in claim 1, further comprising: a third data process for generating third distribution information from the acquired data or processed data obtained by processing the acquired data; and a third distribution process for causing the third distribution information generated by the third data process to be provided to the user terminal device or the distribution system capable of distributing information to the user terminal device, wherein the processing execution command unit causes the third distribution information to be provided to the user terminal device or the distribution system by the third distribution process after the second distribution process begins to provide the second distribution information to the user terminal device or the distribution system.
18. A control system as described in claim 17, wherein the first distribution information is a first orthoimage obtained by ortho-converting an image of the target area acquired by the sensor into an ortho-converted image and integrating multiple ortho-converted images, the second distribution information is a second orthoimage having a higher resolution than the first orthoimage and corresponding to a narrower area than the first orthoimage, and the third distribution information is a third orthoimage having a higher resolution than the first orthoimage and corresponding to a wider area than the second orthoimage.
19. A control system as described in claim 1, wherein a second process including the second data process and the second distribution process is executed in parallel with at least a portion of a first process including the first data process and the first distribution process.
20. A control system as described in claim 1, wherein when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, or another data processing base system, and the data processing units are installed at multiple locations within the aviation data processing system, the control system estimates the processing speed of each of the multiple data processing units or displays it on a display device.
21. A control system as described in claim 1, wherein when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, or another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system estimates a first processing time for the first data processing and a second processing time for the second data processing in each of the multiple data processing units, or displays the estimated results.
22. A control system as described in claim 1, wherein when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, and another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system estimates the data transmission speed on the transmission path between the flying vehicle, the data acquisition base system, and the data processing base system, or displays it on a display device.
23. A control system as described in claim 1, wherein when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, or another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system estimates or displays on a display device a first transmission time of data used for the first data processing and a second transmission time of data used for the second data processing in each of multiple transmission paths.
24. A control system as described in claim 1, wherein, when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, or another data processing base system, and the data processing units are installed at multiple locations within the aviation data processing system, the control system determines, or displays on a display device, a combination pattern of the installation location of the data processing unit that performs the first data processing and the transmission path of the data related to the first data processing that minimizes a first total required time, including the time required for the first data processing and the time required for the first distribution processing.
25. A control system as described in claim 1, wherein, when the data processing unit is mounted on at least one of the flying vehicle, the data acquisition base system, or another data processing base system, and the data processing unit is installed at multiple locations within the aviation data processing system, the control system determines, or displays on a display device, a combination pattern of the installation location of the data processing unit that performs the second data processing and the transmission path of the data related to the second data processing that minimizes a second total required time including the time required for the second data processing and the time required for the second distribution processing.
26. An aeronautical data processing system having an aircraft equipped with a sensor that acquires images or point cloud information of a target area, a data acquisition base system that exchanges control information regarding flight or data acquisition with the aircraft, and a data processing unit that processes the acquired data acquired by the sensor to generate processed data, wherein the system is further equipped with a processing execution command unit that executes the following: a first data processing that generates first distribution information from the acquired data or the processed data obtained by processing the acquired data; a second data processing that generates second distribution information from the acquired data or the first distribution information; a first distribution processing that causes the first distribution information generated by the first data processing to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; and a second distribution processing that causes the second distribution information generated by the second data processing to be provided to the user terminal device or the distribution system, wherein the processing execution command unit causes the second distribution information to be provided to the user terminal device or the distribution system by the second distribution processing after the first distribution processing begins to provide the first distribution information to the user terminal device or the distribution system.
27. A control method utilizing an aviation data processing system having an aircraft equipped with a sensor for acquiring images or point cloud information of a target area, a data acquisition base system for exchanging control information regarding flight or data acquisition with the aircraft, and a data processing unit for processing the acquired data acquired by the sensor to generate processed data, wherein the computer executes the following steps: a first data processing step for generating first distribution information from the acquired data or the processed data obtained by processing the acquired data; a first distribution processing step for causing the first distribution information generated by the first data processing step to be provided to a user terminal device or a distribution system capable of distributing information to the user terminal device; a second data processing step for generating second distribution information from the acquired data or the first distribution information; and a second distribution processing step for causing the user terminal device or the distribution system to provide the second distribution information generated by the second data processing step after the provision of the first distribution information has begun by the first distribution processing step.
Citation Information
Patent Citations
Disaster information management apparatus
JP2005031772A
Data processing device and data processing method
JP7241906B2
Real-time disaster information detection system and method using artificial intelligence and drone images
KR102318489B1
Real-time moving platform management system
US20200084414A1