Relay system, relay method, and relay program
The relay system improves communication reliability and speed by dynamically adjusting relay aircraft flight paths based on communication status, addressing interruptions and delays in challenging airspace environments.
Patent Information
- Application Number
- JP2024026679
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-26
- Publication Date
- 2025-09-05
AI Technical Summary
Existing communication systems struggle to maintain stable and high-speed wireless communication between unmanned aerial vehicles and their control terminals, especially in challenging airspace environments, leading to potential communication interruptions and data transmission delays during emergencies or disasters.
A relay system comprising a relay aircraft that dynamically adjusts its flight path based on communication status, using an airspace communication status determination unit to ensure reliable communication by flying through areas with sufficient strength and speed, and employing multiple relay aircraft if needed to maintain connectivity.
The system enhances communication performance by ensuring uninterrupted and high-speed data transmission between field devices and base systems, even in challenging environments, by optimizing relay aircraft flight paths and using redundant communication channels.
Smart Images

Figure 2025129791000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a relay system, a relay method, and a relay program. [Background technology]
[0002] Patent Document 1 discloses a technology that reduces communication interruptions between an unmanned aerial vehicle performing survey work and an operating terminal, and expands the range of remote control of the unmanned aerial vehicle from the operating terminal. In particular, it discloses controlling the state of a relay aerial vehicle that relays communication between the operating terminal and the work aerial vehicle. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-40514 Summary of the Invention [Problem to be solved by the invention]
[0004] In recent years, when an emergency such as a disaster or accident occurs, it is necessary to quickly gather information on the scene by dispatching a unit to the scene or by flying an aircraft over the scene. In such cases, it is important to maintain wireless communication between the unit or aircraft on the scene and a data acquisition site to transmit and receive command information and measurement data. When attempting to remotely fly an unmanned aircraft or the like in an airspace far from an operating terminal or an operating site, a technology has been proposed, such as that disclosed in Patent Document 1, in which a relay aircraft is flown to relay wireless communication between the unmanned aircraft and the operating terminal. However, the system described in Patent Document 1 still has the following problems.
[0005] When collecting information from an emergency scene, it is necessary to transmit measurement data from the scene to a base where the data is analyzed as quickly as possible. Therefore, even when relaying communications using a relay aircraft, it is necessary to operate a relay aircraft that is capable of wirelessly transmitting large volumes of measurement data. However, there are cases where the desired communication speed cannot be maintained due to the communication environment in the airspace in which the relay aircraft flies. Alternatively, when an unmanned aerial vehicle is flying above a site, if flight control communication between the unmanned aerial vehicle and the control device (or control base) is interrupted, the unmanned aerial vehicle cannot continue to fly safely, so it is necessary to maintain a stable connection of wireless communication. Therefore, even when communication is relayed by a relay aircraft, it is necessary to operate the relay aircraft so that communication is not interrupted, but there are cases where the desired communication strength cannot be maintained due to the communication environment of the airspace in which the relay aircraft flies. Alternatively, when manned aircraft, manned vehicles, or other units are dispatched to a site, a remote command center is required to maintain a stable wireless communication connection so that it can constantly grasp the situation at the site and issue commands to the units. Therefore, even when communications are relayed by a relay aircraft, it is required to operate the relay aircraft so that communications are not interrupted. However, there are cases where it is not possible to maintain the desired communication strength due to the communication environment in the airspace in which the relay aircraft flies.
[0006] The present invention has been made in consideration of at least one of the above-mentioned problems, and aims to provide a relay system that can improve communication performance when relaying wireless communications with remote locations using a relay aircraft. [Means for solving the problem]
[0007] In order to achieve the above-mentioned objective, the system comprises a relay aircraft that relays wireless communications between a base system and field equipment that performs measurement work or other work in a target work area; a relay aircraft control unit that controls the flight of the relay aircraft or outputs flight control commands; and an airspace communication status determination unit that determines the communication status, including at least one of communication strength and communication speed, for each airspace area.The relay aircraft control unit comprises a relay system that controls the flight of the relay aircraft or outputs flight control commands to fly the relay aircraft through an airspace area that is an airspace area where wireless communication with both the field equipment and the base system is possible and where the communication status satisfies specified conditions. [Effects of the Invention]
[0008] According to the present invention, it is possible to improve communication performance by using a relay aircraft for wireless communication relay. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a diagram illustrating the overall configuration of a relay system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a configuration diagram showing the main functions of a data acquisition site system. [Figure 3] FIG. 2 is a functional block diagram showing the main functions of the work aircraft. [Figure 4] FIG. 2 is a functional block diagram showing the main functions of the relay aircraft. [Figure 5] FIG. 1 is a functional block diagram of an air traffic control system. [Figure 6] FIG. 2 is a functional block diagram of a communication infrastructure management system. [Figure 7a] FIG. 10 is a diagram showing an example of a communication means via a relay aircraft. [Figure 7b] FIG. 10 is a diagram showing another example of communication means via a relay flying vehicle. [Figure 8a] FIG. 1 is a diagram illustrating an example of a communication means via a communication satellite. [Figure 8b] FIG. 10 is a diagram showing another example of communication means via a communication satellite. [Figure 9a]FIG. 10 is a diagram showing an example of a communication means for directly communicating with a work aircraft. [Figure 9b] FIG. 10 is a diagram showing another example of communication means for directly communicating with a work aircraft. [Figure 10a] FIG. 1 illustrates an example of a means of communication via an air traffic control system. [Figure 10b] FIG. 10 is a diagram illustrating another example of a means of communication via an air traffic control system. [Figure 11] FIG. 2 is a functional block diagram of an aircraft operation system. [Figure 12] FIG. 2 is a functional block diagram of an acquisition data management system. [Figure 13] FIG. 2 is a hardware configuration diagram of a data acquisition site system, etc. [Figure 14] FIG. 1 is a conceptual diagram illustrating a wireless communication failure state. [Figure 15] FIG. 10 is a flowchart illustrating the operation of the relay system. [Figure 16] FIG. 10 is a flowchart illustrating a process of determining a communication means by a communication means determining unit. [Figure 17] FIG. 10 is a flowchart illustrating another example of communication means determination performed by the communication means determination unit. [Figure 18] FIG. 10 is a flowchart illustrating a process for performing wireless communication relay by a relay aircraft. [Figure 19] FIG. 10 is a diagram illustrating the position of a flight geofence of a relay aircraft. [Figure 20] FIG. 10 is a diagram illustrating the setting position of the flight area when flying an additional relay aircraft. [Figure 21] FIG. 10 is a flowchart illustrating a method for changing the relay method of wireless communication by an additional relay aircraft. [Figure 22] A figure showing an example of the determination result when the relay position determination unit determines the flight position of the relay aircraft. [Figure 23a] FIG. 10 is a diagram showing an example of collecting measurement data from a work aircraft via wireless communication. [Figure 23b] FIG. 10 is a diagram showing an example of collecting measurement data from a work aircraft via wireless communication. [Figure 24a] FIG. 10 is a diagram showing an example of collecting measurement data by directly removing a recording medium from a relay aircraft. [Figure 24b] FIG. 10 is a diagram showing an example of collecting measurement data by directly removing a recording medium from a relay aircraft. [Figure 25a] FIG. 10 is a diagram showing an example of collecting measurement data by directly removing the recording medium from the work aircraft and relay aircraft. [Figure 25b] FIG. 10 is a diagram showing an example of collecting measurement data by directly removing the recording medium from the work aircraft and relay aircraft. [Figure 26] A flowchart showing the process of determining whether a relay aircraft is needed while a wireless communication relay is being performed by the relay aircraft. [Figure 27] FIG. 10 is an explanatory diagram showing an example of redundancy in the case where communication is made redundant using a plurality of communication means; [Figure 28] FIG. 10 is a diagram illustrating the overall configuration of a modified example of a relay system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0010] The present invention will be described below by listing the contents of the embodiments. The present invention has the following configuration. [Item 1] a relay aircraft that relays wireless communications between a field device that performs measurement work or other work in a work area and a base system; a relay aircraft control unit that controls the flight of the relay aircraft or outputs flight control commands; an airspace communication status determination unit that determines a communication status including at least one of communication strength and communication speed for each airspace area; The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication status meets specified conditions, or outputs the flight control command to fly through the airspace area. [Item 2] The relay system according to item 1, The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication strength determined by the airspace communication status determination unit is stronger than a predetermined value, or outputs the flight control command to fly the relay aircraft through the airspace area. [Item 3] The relay system according to item 1 or 2, When the amount of measurement data measured by the field device is greater than a predetermined value or is expected to be greater than a predetermined value, The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication speed determined by the airspace communication status determination unit is faster than a predetermined value, or outputs the flight control command to fly the relay aircraft through the airspace area. [Item 4] A relay system according to any one of items 1 to 3, When the communication strength or communication speed or a combination thereof determined by the airspace communication state determination unit does not satisfy a predetermined condition, A relay system in which the relay aircraft control unit controls the flight of the relay aircraft to increase the altitude of the relay aircraft, or outputs the flight control command to increase the altitude. [Item 5] A relay system according to any one of items 1 to 4, When the wireless communication distance between the relay aircraft and the on-site device, or the wireless communication distance between the relay aircraft and the base system, becomes longer than a predetermined distance, or is expected to become longer than a predetermined distance, A relay system in which the relay aircraft control unit controls the flight of the relay aircraft to increase the altitude of the relay aircraft, or outputs the flight control command to increase the altitude. [Item 6] 6. A relay system according to any one of items 1 to 5, A relay system that starts wireless communication relay by the relay aircraft when the communication strength or communication speed between the field device and the base system before wireless communication relay by the relay aircraft becomes lower than a predetermined value. [Item 7] A relay system according to any one of items 1 to 6, A relay system that starts wireless communication relaying by the relay aircraft or determines the number of relay aircraft that will start wireless communication relaying when the communication speed between the field device and the base system before wireless communication relaying by the relay aircraft is expected to be lower than a reference speed corresponding to the amount of measurement data measured by the field device. [Item 8] A relay system according to any one of items 1 to 7, A relay system that, before performing wireless communication relay by the relay aircraft, starts wireless communication relay by the relay aircraft or determines the number of relay aircraft that will start wireless communication relay if the future distance between the field device and the base system based on the planned movement position of the field device is predicted to be longer than a predetermined distance. [Item 9] A relay system according to any one of items 1 to 8, If abnormality information of ground infrastructure facilities including ground communication facilities or power facilities is acquired before the wireless communication relay by the relay aircraft is performed, the wireless communication relay by the relay aircraft is started; The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area surrounding the ground infrastructure facility having an abnormality, or outputs the flight control command to fly through the airspace area. [Item 10] A relay system according to any one of items 1 to 9, A relay system comprising a relay communication status monitoring unit that monitors at least one of a first communication status including communication strength or communication speed between the relay aircraft and the field device, and a second communication status including communication strength or communication speed between the relay aircraft and the base system. [Item 11] A relay system according to any one of items 1 to 10, A relay system that, when either the communication strength or the communication speed in the first communication state or the second communication state does not satisfy a specified condition, flies an additional relay aircraft, a second relay aircraft, and performs wireless communication relay using multiple relay aircraft. [Item 12] A relay system according to any one of items 1 to 11, A relay system that determines the flight area of the second relay aircraft depending on at least one of the first communication state and the second communication state, and controls the flight of the second relay aircraft so that the second relay aircraft flies in the flight area, or outputs a flight control command to fly the second relay aircraft in the flight area. [Item 13] A relay system according to any one of items 1 to 12, When the communication strength of the first communication state is lower than a predetermined value, the second relay aircraft is flown in an airspace area between the relay aircraft and the on-site device, and a series relay is performed by the relay aircraft and the second relay aircraft; Alternatively, a relay system that, when the communication strength of the second communication state is lower than a predetermined value, flies the second relay aircraft in an airspace area between the relay aircraft and the base system, and performs a series relay between the relay aircraft and the second relay aircraft. [Item 14] A relay system according to any one of items 1 to 13, When the communication speed of the first communication state is lower than a predetermined value, the second relay aircraft is flown in an airspace area between the relay aircraft and the on-site device, and a parallel relay is performed by the relay aircraft and the second relay aircraft; Alternatively, a relay system that, when the communication speed of the second communication state is lower than a predetermined value, flies the second relay aircraft in an airspace area between the relay aircraft and the base system, and performs parallel relay by the relay aircraft and the second relay aircraft. [Item 15] A relay system according to any one of items 1 to 14, A relay system in which, when the distance between the relay aircraft and the on-site device is longer than a predetermined distance, or when it is expected that the distance will become longer than the predetermined distance in the future, an additional relay aircraft, a second relay aircraft, is flown to perform wireless communication relay using multiple relay aircraft. [Item 16] A relay system according to any one of items 1 to 15, A relay system that switches wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication that does not go through the relay aircraft when the communication strength and communication speed in the first communication state and the second communication state satisfy predetermined conditions and the field device and the base system are within a distance range where they can communicate directly. [Item 17] A relay system according to any one of items 1 to 16, A relay system that, when switching wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication not via the relay aircraft, moves the field device within a distance range where direct communication with the base system is possible, outputs a movement command to move the field device within said distance range, or outputs a flight mission to move a work aircraft carrying the field device within said distance range. [Item 18] A relay system according to any one of items 1 to 17, A relay system that, when it is possible to move the field device within a distance range where the field device and the base system can directly communicate, moves the field device within that distance range, outputs a movement command to move the field device within that distance range, or outputs a flight mission to move a work aircraft carrying the field device within that distance range. [Item 19] A relay system according to any one of items 1 to 18, A relay system that switches wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication using relay by the communication satellite when the field device is capable of communicating with a communication satellite. [Item 20] A relay system according to any one of items 1 to 19, A relay system that generates a relay flight geofence to limit the flight area of the relay aircraft when the relay aircraft begins flying a wireless communication relay. [Item 21] A relay system according to any one of items 1 to 20, the in-situ device is mounted on a measurement aircraft; A relay system in which at least a portion of the relay flight geofence is generated within an area enclosed by the measurement flight geofence generated for the measurement aircraft. [Item 22] 22. A relay system according to any one of items 1 to 21, A relay system that transmits information about the generated relay flight geofence to an airspace control system that controls the airspace in which the relay flight geofence was generated. [Item 23] 23. The relay system according to any one of items 1 to 22, The relay aircraft includes a measurement data recording unit that records the measurement data received from the on-site device, A relay system in which the relay aircraft receives the measurement data from the field device and records the measurement data in the measurement data recording unit when the relay aircraft is moved to a position closer to the field device than the base system, or when the communication state between the relay aircraft and the field device satisfies a predetermined condition. [Item 24] A relay system according to any one of items 1 to 23, The relay aircraft includes a measurement data recording unit that records the measurement data received from the on-site device, A relay system that transmits the measurement data from the field device to the relay aircraft and records the received measurement data in the measurement data recording unit when the communication status between the relay aircraft and the base system does not satisfy a specified condition and the communication status between the relay aircraft and the field device satisfies a specified condition. [Item 25] A relay system according to any one of items 1 to 24, A relay system that moves the relay aircraft to an airspace area where the communication status between the relay aircraft and the base system satisfies specified conditions, and transmits the measurement data recorded in the measurement data recording unit in the airspace area from the relay aircraft to the base system. [Item 26] 26. A relay system according to any one of items 1 to 25, A relay system that moves the relay aircraft to an airspace area where the communication status between the relay aircraft and a communication satellite satisfies specified conditions, and transmits the measurement data recorded in the measurement data recording unit in the airspace area from the relay aircraft to the base system via the communication satellite. [Item 27] 27. A relay system according to any one of items 1 to 26, A relay system in which the on-site device is mounted on an aircraft, vehicle, ship, other moving body, or portable mobile terminal device. [Item 28] A relay method for relaying wireless communication between a field device that performs measurement work or other work in a work area and a base system using a relay aircraft, comprising: The computer an airspace communication state determination step of determining a communication state including at least one of communication strength and communication speed for each airspace area; a flight control step of controlling the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication state satisfies a predetermined condition, or outputting a flight control command to fly the relay aircraft through the airspace area; Execute the relay method. [Item 28] A relay program that relays wireless communication between a field device that executes measurement work or other work in a work target area and a base system using a relay aircraft, to a computer, an airspace communication state determination command for determining a communication state including at least one of communication intensity and communication speed for each airspace area, a flight control command for controlling the flight of the relay aircraft or outputting a flight control command for flying the airspace area so that the relay aircraft flies in an airspace area that can communicate wirelessly with both the field device and the base system and the communication state satisfies a predetermined condition, A relay program that causes the above to be executed.
[0011] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted. Further, the embodiments shown below are merely examples, and other known elements and alternative means can be adopted according to the use, purpose, scale, etc.
[0012] <A. One Embodiment> [A-1. Configuration] (A-1-1. Overview) FIG. 1 is an overall configuration diagram of a relay system 1 (hereinafter also referred to as “aerial data sensing system 1” or “system 1”) according to an embodiment of the present invention. As shown in FIG. 1, the relay system 1 includes a work aircraft 1000, a data acquisition base system 2000, a relay aircraft 3000, a communication satellite 4000, an air traffic control system 5000, and a spatial information data utilization system 6000.
[0013] The work aircraft 1000 is a manned or unmanned aircraft or other flying object, and is equipped with sensors such as optical cameras, infrared cameras, and laser sensors including LiDAR, and uses these sensors to acquire information about the measurement area from the sky as measurement data. The work aircraft 1000 also wirelessly transmits the measurement data to the data acquisition base system 2000 during flight. The work aircraft 1000 is not limited to acquiring information about the measurement area, but may also be an aircraft that acquires meteorological data or environmental data, tracks suspicious vessels, or performs other tasks. Furthermore, the work aircraft 1000 does not necessarily have to be an air vehicle, but may also be a field device in which the above-mentioned sensors are mounted on a vehicle, ship, other moving object, or a portable mobile terminal device.
[0014] The data acquisition base system 2000 is a system that has the function of remotely controlling the flight and measurement of the work aircraft 1000 by sending and receiving control command information (flight control commands and measurement control commands) with the work aircraft 1000 when the work aircraft 1000 is an unmanned aircraft, and of monitoring the status of the work aircraft 1000 by sending and receiving control status information (flight control status and measurement control status) with the work aircraft 1000 when the work aircraft 1000 is a manned aircraft. The data acquisition base system 2000 also has the function of receiving measurement data acquired by the work aircraft 1000 via wireless communication. The data acquisition base system 2000 is not limited to fixed buildings, but can also be installed on mobile vehicles, ships, etc.
[0015] The relay aircraft 3000 is a manned or unmanned aircraft or other aircraft, and is an aircraft that relays communication of control-related information (control commands, control status information, real-time video, etc.) of the work aircraft 1000 transmitted and received between the work aircraft 1000 and the data acquisition base system 2000, as well as measurement data acquired by the work aircraft 1000. Furthermore, if the relay aircraft 3000 is an unmanned aircraft, it has the function of transmitting and receiving control command information (flight control commands) with the data acquisition base system 2000, and if the relay aircraft 3000 is a manned aircraft, it has the function of transmitting and receiving control status information (flight control status and measurement control status) with the data acquisition base system 2000.
[0016] The communication satellite 4000 is connected via wireless communication to the work aircraft 1000, the relay aircraft 3000, and the data acquisition base system 2000. The communication satellite 4000 has the function of relaying the above-mentioned control-related information and measurement data transmitted and received between the aircraft (including the work aircraft 1000 and the relay aircraft 3000) and the data acquisition base system 2000 via this wireless communication.
[0017] The air traffic control system 5000 is composed of, for example, an air traffic management system (hereinafter referred to as "ATM"), an unmanned aircraft system traffic management system (hereinafter referred to as "UTM"), or an air traffic management subsystem (UASSP). The air traffic control system 5000 communicates wirelessly with the work aircraft 1000 and relay aircraft 3000 flying in the airspace subject to control, sending and receiving control-related information and measurement data. It may also be connected to the data acquisition base system 2000 via wired or wireless communication, and have the function of exchanging control-related information and measurement data sent and received between the work aircraft 1000 and relay aircraft 3000 with the data acquisition base system 2000.
[0018] The spatial information data utilization system 6000 is connected to the data acquisition base system 2000 via wired or wireless communication and receives measurement data acquired by the work aircraft 1000 from the data acquisition base system 2000. The spatial information data utilization system 6000 processes the received measurement data to convert it into data that makes it easier for users to understand the condition of the measurement area, and provides the processed data to a user terminal, etc. For example, if the measurement data is images measured with an optical camera or an infrared camera, the system generates a wide-area image by stitching together multiple images, a wide-area orthoimage by stitching together multiple images after orthogonal transformation, or a map image by integrating the wide-area image or wide-area orthoimage with geographic information. Furthermore, if the measurement data is point cloud data acquired by a laser sensor, the system processes the point cloud data to generate three-dimensional spatial data expressed in a digital surface model (DSM) or digital elevation model (DEM), or a map image by integrating the three-dimensional spatial data with geographic information.
[0019] The wired or wireless communications between the components of the relay system 1 shown in FIG. 1 (work aircraft 1000, data acquisition base system 2000, relay aircraft 3000, communication satellite 4000, air traffic control system 5000, and spatial information data utilization system 6000) may be interconnected via a communication network such as the Internet or a communication method such as LTE. Each wireless communication may constitute a dedicated wireless communication network or may utilize an existing wireless infrastructure. The control communication (e.g., command and control link) for transmitting and receiving the above-mentioned control-related information and the measurement data communication (e.g., payload link) for transmitting and receiving measurement data are each assigned a different communication frequency band or a different communication path, and are communicated via a different wireless communication link.
[0020] (A-1-2. Overview of the data acquisition center system) Next, an overview of the main functions of the data acquisition base system 2000 and its connection relationships with other systems will be explained. Figure 2 is a configuration diagram showing the main functions of the data acquisition base system. The data acquisition base system 2000 has a communication infrastructure management system 2100, an aircraft flight operation system 2200, a measurement data management system 2300, an flight management system 2400, and an airspace monitoring system 2500.
[0021] The communication infrastructure management system 2100 manages the communication means used to transmit control-related information and measurement data exchanged between the data acquisition base system 2000 and other systems in the relay system 1 (the work aircraft 1000, the relay aircraft 3000, the communication satellite 4000, the air traffic control system 5000, and the spatial information data utilization system 6000). Specifically, the system is equipped with multiple communication facilities and has the function of switching between communication means using multiple different types of communication facilities. The communication infrastructure management system 2100 monitors the communication speed as well as the communication strength (communication stability) of the existing infrastructure, determines the appropriate communication means based on the stability and speed required for data transmission and reception, and switches to that communication means. The transmission process may be, for example, parallel transmission or switched transmission. Furthermore, if the communication infrastructure management system 2100 determines that data should be transmitted by physically transporting the memory by a person, it may display this information on an appropriate display unit and request the administrator to physically transport the memory.
[0022] The aircraft flight operating system 2200 is a system that generates flight missions for aircraft (including work aircraft and relay aircraft) to be remotely controlled, acquires the aircraft's real-time flight status (including position and speed), and controls the aircraft by transmitting control target values as control commands to the aircraft. The flight mission is, for example, a movement plan including the movement path and movement speed of the work aircraft 1000 or relay aircraft 3000. The movement path is generated in an airspace at an altitude of 150 m or less to avoid interference with passenger aircraft, for example. The flight mission may include information on a measurement plan obtained by a measurement sensor in addition to information on the movement plan. The aircraft flight operating system 2200 transmits control signals to the aircraft via the communication infrastructure management system 2100 to operate the aircraft automatically.
[0023] The acquired data management system 2300 is a system that manages the measurement data acquired by the work aircraft 1000. Specifically, it determines whether the vast amount of measurement data acquired via the communication infrastructure management system contains defective data, records the measurement data, and determines whether to send the measurement data to an external system.
[0024] The flight management system 2400 is a system that makes decisions and gives instructions regarding the operation of the work aircraft 1000 and the relay aircraft 3000. The flight management system 2400 prepares plans for work of the work aircraft 1000, including sensing and flight, transmits the plans to the aircraft flight operating system, and causes the aircraft flight operating system 2200 to generate flight missions and the like in accordance with the plans. The flight management system 2400 may also prepare plans for multiple aircraft and transmit information about the plans to the aircraft flight operating system 2200 that controls each of the aircraft.
[0025] The airspace monitoring system 2500 is a system that monitors in real time the airspace through which the aircraft, which is the target of control of the data acquisition base system 2000, is flying. The airspace monitoring system 2500 has a function of detecting aircraft flying in the airspace using aircraft detection devices such as radar or sonar, or acquires information from the air traffic control system 5000 described above via the communication infrastructure management system 2100. That is, the airspace monitoring system 2500 measures or acquires information on the environment in the airspace through which the aircraft is flying, other aircraft, etc., and transmits the information to the flight management system 2400 or the aircraft flight operation system 2200. If there is a problem with the aircraft's work plan or flight mission based on the information from the airspace monitoring system 2500, the flight management system 2400 or the aircraft flight operation system 2200 changes the work plan or flight mission.
[0026] (A-1-3. Overview of the Work Vehicle) Next, the work aircraft 1000 will be described. Figure 3 is a functional block diagram showing the main functions of the work aircraft. In this specification, the term "aircraft" refers to any aircraft with flight capabilities, regardless of the power source (electric power, prime mover, etc.), the control method (wireless or wired, fully autonomous flight type or partially manual flight type, etc.), and whether manned or unmanned. Aircraft may also be referred to as unmanned aerial vehicles (UAVs), aircraft, multicopters, remote piloted aircraft systems (RPASs), or unmanned aircraft systems (UASs).
[0027] The work aircraft 1000 is a manned or unmanned aircraft or other aircraft that wirelessly transmits measurement data to the data acquisition base system 2000 during flight. The work aircraft 1000 may be a fixed-wing aircraft, a rotary-wing aircraft, or a vertical take-off and landing aircraft (VTOL) equipped with fixed and rotary wings. The work aircraft 1000 comprises a flight unit 1100, a measurement unit 1200, a control communication unit 1300, a measurement data communication unit 1400, a communication status determination unit 1500, a measurement data processing unit 1600, and a data recording unit 1700. If the work aircraft 1000 is a manned aircraft, it will also comprise a control device (having a control command input unit, display unit, audio output unit, etc.) operated by a pilot appearing on the aircraft.
[0028] (A-1-3-1. Flight Section 1100) The flying unit 1100 is a functional unit that flies the work aircraft 1000, and is equipped with a self-position measurement unit 1110, an attitude measurement unit 1120, a flight control unit 1130, a remote control camera 1140, and a remote control microphone 1150.
[0029] The self-location measurement unit 1110 measures the position (absolute position) of the aircraft. The self-location measurement unit 1110 measures its current position using, for example, a Global Navigation Satellite System (GNSS) or a Global Positioning System (GPS), although this is not particularly limited. For example, a Real Time Kinematic - Global Navigation Satellite System (RTK-GNSS) can also be used as a method for measuring the self-location. The position information includes at least two-dimensional coordinate information (e.g., latitude and longitude) in a planar view, and preferably includes three-dimensional coordinate information including altitude information. Note that the self-location measurement unit 1110 is not limited to measuring the position of the aircraft, and may also measure information on speed and acceleration.
[0030] The attitude measurement unit 1120 measures the attitude (orientation) of the aircraft. The self-location measurement unit 1110 measures the current orientation of the aircraft using, for example, a geomagnetic sensor, a GNSS compass, or the like. The attitude information includes at least an attitude angle (orientation) in a planar view around the Z axis, and preferably includes attitude information around three axes: the X axis, the Y axis, and the Z axis. Note that the attitude measurement unit 1120 is not limited to measuring the attitude of the aircraft, and may also measure information on angular velocity and angular acceleration.
[0031] The flight control unit 1130 is a mechanism and function that controls the flight operation of the work aircraft 1000, generating thrust for the airframe to lift the work aircraft 1000 and move it in a desired direction. The flight control unit 1130 has a processing unit, also called a flight controller. The processing unit can have one or more processors, such as a programmable processor (e.g., a central processing unit (CPU), MPU, or DSP). The processing unit has access to memory (storage unit). The memory stores logic, code, and / or program instructions that the processing unit can execute to perform one or more steps.
[0032] The processing unit includes a control module configured to control the airframe state of the work aircraft 1000. For example, the control module adjusts the spatial configuration, attitude angle, angular velocity, angular acceleration, angular jerk rate, and / or acceleration of the work aircraft 1000, which has six degrees of freedom (translational motion x, y, and z, and rotational motion θx, θy, and θz). That is, the flight control unit 1130 controls the work aircraft 1000 to perform various operations such as liftoff, forward movement, turning, and landing, and controls the attitude angle control and flight operations of the work aircraft 1000 from takeoff to flight and landing.
[0033] The flight control unit 1130 can control the flight of the work aircraft 1000 based on, for example, an autonomous flight program acquired from the aircraft flight operating system 2200. The flight control unit 1130 can also control the flight of the work aircraft 1000 by controlling the motor based on various information such as the measurement target area, flight permitted / prohibited areas, corresponding flight geofence information, map information including two-dimensional or three-dimensional map data, the current position information of the work aircraft 1000, attitude information (heading information), speed information, and acceleration information, as well as any combination of these.
[0034] The remote control camera 1140 is a camera that captures images of the surroundings of the work aircraft, such as the direction of travel of the aircraft. The remote control microphone 1150 is a microphone that picks up audio from the surroundings of the work aircraft. The images and audio captured by the remote control camera 1140 and remote control microphone 1150 are transmitted in real time by the control communication unit 1300 to the aircraft flight operating system 2200 of the data acquisition base system 2000 via a relay aircraft or the like.
[0035] (A-1-3-2. Measurement unit 1200) The measurement unit 1200 is a functional unit that acquires information about a measurement target area using a measurement sensor 1210. The measurement unit 1200 includes the measurement sensor 1210, a sensor attitude control unit 1220, and a sensor control unit 1230.
[0036] The measurement sensor 1210 is composed of, for example, an optical camera that acquires optical images, an infrared camera that acquires infrared images, a laser sensor such as LiDAR that acquires point cloud data, etc. The measurement sensor 1210 acquires optical images, infrared images, point cloud data, etc. of the ground surface of the measurement target area from the sky above the measurement target area as measurement data.
[0037] The sensor attitude control unit 1220 operates an attitude change device such as a gimbal that supports the measurement sensor to control at least one of the attitude angles of the measurement sensor 1210 around the three axes relative to the body of the work aircraft 1000. The sensor attitude control unit 1220 may control either or both of the pitch angle relative to the horizontal attitude of the body and the yaw angle relative to a predetermined reference direction. The sensor attitude control unit 1220 adjusts the sensor attitude change device to control the orientation of the measurement sensor 1210 so that the measurement target area can be photographed from a predetermined flight path.
[0038] The sensor control unit 1230 controls measurement parameters of the measurement sensor 1210, such as the timing of data acquisition by the measurement sensor 1210 and the zoom amount. The sensor control unit 1230 controls the measurement sensor 1210 so that an image is captured according to measurement conditions, such as the data acquisition timing and zoom amount, which are set in advance. For example, if the measurement sensor is an optical camera, the sensor control unit 1230 may control the image acquisition timing, shutter speed, resolution, etc.
[0039] (A-1-3-3. Control communication unit 1300) The control communication unit 1300 includes a radio wave communication module capable of radio wave communication. The control communication unit 1300 transmits and receives control-related information via wireless communication with the data acquisition base system 2000, relay aircraft 3000, communication satellite 4000, or air traffic control system 5000, using wireless communication via a communication network NW or direct wireless communication using Wi-Fi, 2.4 GHz, or 5.6-5.8 GHz frequency bands. The control communication unit 1300 can use a communication network NW that uses a communication standard such as LTE (Long Term Evolution) as the communication network NW. The control-related information transmitted and received by the control communication unit 1300 includes, for example, flight control commands to the flight control unit 1130, sensor attitude control commands to the sensor attitude control unit 1220, sensor control commands to the sensor control unit 1230, measurement information such as the aircraft's position measured by the aircraft's position measurement unit 1110, and measurement information on the aircraft's attitude measured by the attitude measurement unit 1120.
[0040] Furthermore, the control communication unit 1300 transmits the communication status information of the communication strength and communication speed determined by the communication status determination unit 1500 described later as control-related information to the data acquisition base system 2000, the relay aircraft 3000, the communication satellite 4000, or the air traffic control system 5000.
[0041] (A-1-3-4. Measurement data communication unit 1400) The measurement data communication unit 1400 also includes a radio wave communication module capable of radio wave communication, and transmits and receives measurement data by wireless communication with the data acquisition base system 2000, relay aircraft 3000, communication satellite 4000, or air traffic control system 5000 using wireless communication via a communication network NW or direct wireless communication using Wi-Fi, 2.4 GHz, or 5.6 to 5.8 GHz frequency bands. The control communication unit 1300 can use a communication network NW that uses a communication standard such as LTE (Long Term Evolution) as the communication network NW. The measurement data transmitted and received by the measurement data communication unit 1400 includes, for example, optical images measured with an optical camera, infrared images measured with an infrared camera, and point cloud data measured with a laser sensor such as LiDAR.
[0042] Although the amount of control-related information is smaller than that of measurement data, it affects flight control and measurement control, and therefore requires real-time communication with little communication delay. On the other hand, the amount of measurement data is larger than that of control-related information, and it requires transmission via a communication means with a high communication speed, but the real-time nature of communication does not necessarily need to be high, and temporary communication interruptions do not pose a major problem. Therefore, as described above, the control-related information and measurement data are transmitted and received via independent communication means via different communication units (control communication unit 1300, measurement data communication unit 1400).
[0043] (A-1-3-5. Communication status determination unit 1500) The communication status determination unit 1500 determines the communication status between the aircraft itself (the work aircraft 1000) and the outside (the data acquisition base system 2000, the relay aircraft 3000, the communication satellite 4000, or the air traffic control system 5000) for each airspace area via the control communication unit 1300 and the measurement data communication unit 1400. The communication status determination unit 1500 includes a communication strength determination unit 1510 and a communication speed determination unit 1520.
[0044] The communication strength determination unit 1510 determines the communication strength between the device itself and each external system for each airspace area. For example, this determination is made by measuring or calculating the state quantity of the communication strength defined in units such as dB. The communication speed determination unit 1520 determines the communication speed between the device itself and each external system for each airspace area. For example, this determination is made by measuring or calculating the state quantity of the communication speed defined in units such as bps.
[0045] (A-1-3-6. Measurement data processing unit 1600) The measurement data processing unit 1600 processes the measurement data measured by the measurement unit 1200. The measurement data processing unit 1600 is configured as, for example, a workstation so that it can execute data processing with a relatively large processing load.
[0046] For example, when the measurement data is images measured with an optical camera or an infrared camera, the data processing that can be executed by the measurement data processing unit 1600 is processing to generate a wide-area image by stitching together multiple images, a wide-area orthoimage by stitching together multiple images after orthogonal transformation, or a map image by integrating the wide-area image or wide-area orthoimage with geographic information. Alternatively, when the measurement data is point cloud data acquired with a laser sensor, the data processing is processing to generate three-dimensional spatial data expressed as a Digital Surface Model (DSM) or a Digital Elevation Model (DEM) by processing the point cloud data, or a map image by integrating the three-dimensional spatial data with geographic information.
[0047] (A-1-3-7. Data recording unit 1700) The data recording unit 1700 is a functional unit that records measurement data measured by the measurement unit 1200 and other data on a recording medium inside the work aircraft 1000. The recording medium may include, for example, a separable medium such as an SD card or RAM. The data recording unit 1700 includes a measurement data recording unit 1710, a communication status recording unit 1720, and a post-processing data recording unit 1730.
[0048] The measurement data recording unit 1710 records the measurement data measured by the measurement unit 1200. The communication status recording unit 1720 records information on the communication strength and communication speed determined by the communication status determination unit 1500. The processed data recording unit 1730 records the processed data generated by the measurement data processing unit 1600.
[0049] (A-1-4. Overview of the relay aircraft) Next, the relay aircraft 3000 will be described. FIG. 4 is a functional block diagram showing the main functions of the relay aircraft. The relay aircraft 3000 is a manned or unmanned aircraft, or other aircraft. The relay aircraft 3000 relays control-related information (control commands or control status information) of the work aircraft 1000 transmitted and received between the work aircraft 1000 and the data acquisition base system 2000, as well as communication of measurement data acquired by the work aircraft 1000. The relay aircraft 3000 also transmits and receives information related to the control of its own aircraft (the relay aircraft 3000) to and from the data acquisition base system 2000. The relay aircraft 3000 may be a fixed-wing aircraft, a rotary-wing aircraft, or a vertical take-off and landing aircraft (VTOL) equipped with fixed wings and rotary wings.
[0050] The relay aircraft 3000 comprises a flying unit 3100, a control communication unit 3300, a communication status determination unit 3500, a measurement data processing unit 3600, and a data recording unit 3700. If the relay aircraft 3000 is a manned aircraft, it also comprises a control device (having a control command input unit, a display unit, an audio output unit, etc.) operated by a pilot appearing on the aircraft.
[0051] The flying unit 3100 comprises a self-position measuring unit 3110, an attitude measuring unit 3120, a flight control unit 3130, a remote control camera 3140, and a remote control microphone 3150. The flying unit 3100 can have the same functions as the flying unit 1100 of the working aircraft 1000. The control communication unit 3300 can have the same functions as the control communication unit 1300 of the working aircraft 1000.
[0052] The relay communication unit 3400 is equipped with a control information relay communication unit 3410 and a measurement data relay communication unit 3420. The control information relay communication unit 3410 relays control-related information (including control commands, control status information, real-time video, and audio) of the work aircraft 1000 transmitted and received between the work aircraft 1000 and the data acquisition base system 2000. For example, it receives control commands for the work aircraft 1000 from the data acquisition base system 2000 and forwards them to the work aircraft 1000, and receives information regarding the control status of the work aircraft 1000 from the work aircraft 1000 and forwards it to the data acquisition base system 2000. The measurement data relay communication unit 3420 relays measurement data acquired by the work aircraft 1000 and transmits it to the data acquisition base system 2000.
[0053] The communication status determination unit 3500 determines the communication status between the relay aircraft 3000 and an external system (data acquisition base system 2000, work aircraft 1000, communication satellite 4000, or air traffic control system 5000) for each airspace area via the control communication unit 3300 and relay communication unit 3400 (control information relay communication unit 3410, measurement data relay communication unit 3420). The communication status determination unit 3500 includes a communication strength determination unit 3510 and a communication speed determination unit 3520. The communication strength determination unit 3510 and the communication speed determination unit 3520 can have the same functions as the communication strength determination unit 1510 and the communication speed determination unit 1520 of the work aircraft 1000. For example, the communication status determination unit 3500 determines the communication strength and communication speed between the relay aircraft 3000 and the working aircraft 1000, and also the communication strength and communication speed between the relay aircraft 3000 and the data acquisition base system 2000.
[0054] The measurement data processing unit 3600 performs data processing on the measurement data received via the measurement data relay communication unit 3420. The measurement data processing unit 3600 is configured, for example, as a workstation so that it can execute data processing with a relatively large processing load. The data processing that can be executed by the measurement data processing unit 3600 is the same as that executed by the measurement data processing unit 1600 of the work aircraft 1000.
[0055] The data recording unit 3700 is a functional unit that records measurement data received via the measurement data relay communication unit 3420 on a recording medium inside the work aircraft 3000. The recording medium may include, for example, a separable medium such as an SD card or RAM. The data recording unit 3700 includes a relay measurement data recording unit 3710, a communication status recording unit 3720, and a processed data recording unit 3730.
[0056] The relay measurement data recording unit 3710 records the measurement data received via the measurement data relay communication unit 3420. The communication status recording unit 3720 records the information on the communication strength and communication speed determined by the communication status determination unit 3500. The processed data recording unit 3730 records the processed data generated by the measurement data processing unit 3600.
[0057] (A-1-5. Overview of Air Traffic Control System) Next, an explanation will be given of the air traffic control system 5000. Fig. 5 is a functional block diagram of the air traffic control system. The air traffic control system 5000 includes a control communication unit 5100, a relay information communication unit 5200, and an operation control unit 5300.
[0058] The control communication unit 5100 is a functional unit equipped with a radio wave communication module capable of radio wave communication, and transmits and receives information necessary for traffic control within the controlled airspace between aircraft flying in the controlled airspace of the air traffic control system 5000.
[0059] The relay information communication unit 5200 is equipped with a radio wave communication module capable of radio wave communication, and is a functional unit that relays control-related information or measurement data transmitted and received between the work aircraft 1000, the relay aircraft 3000, and the data acquisition base system 2000. The relay information communication unit 5200 has a control information relay communication unit 5210 and a measurement data relay communication unit 5220.
[0060] The control information relay communication unit 5210 relays control-related information (control commands or control status information) of the work aircraft 1000 transmitted and received between the work aircraft 1000 and the data acquisition base system 2000. The control information relay communication unit 5210 may also relay control-related information (control commands or control status information) of the relay aircraft 3000 transmitted and received between the relay aircraft 3000 and the data acquisition base system 2000. The measurement data relay communication unit 5220 relays measurement data measured by the work aircraft 1000 and transmits it to the data acquisition base system 2000.
[0061] The flight control unit 5300 is a functional unit that acquires information and generates commands necessary for traffic control within the controlled airspace. The flight control unit 5300 includes an aircraft status acquisition unit 5310 and a control command generation unit 5320. The aircraft status acquisition unit 5310 acquires information regarding the flight status (position, altitude, speed, acceleration, planned flight path, planned landing position, etc.) and other aircraft status (flight distance, presence or absence of aircraft abnormalities, manned / unmanned identification information, etc.) of the work aircraft 1000, relay aircraft 3000, and other aircraft flying within the controlled airspace. The control command generation unit 5320 generates control commands for each aircraft based on the acquired status information of the aircraft within the controlled airspace. Here, control commands include, for example, a command to change the planned flight path or a command to change the planned landing position.
[0062] (A-1-6. Overview of the Communication Infrastructure Management System 2100) Next, we will explain the communication infrastructure management system 2100. Fig. 6 is a functional block diagram of the communication infrastructure management system. The communication infrastructure management system 2100 includes a candidate communication means acquisition unit 2110, a communication status determination unit 2120, a communication means determination unit 2130, a relay aircraft usage determination unit 2140, a control communication unit 2150, and a measurement data communication unit 2160.
[0063] (A-1-6-1. Communication method candidate acquisition unit 2110) The communication means candidate acquisition unit 2110 acquires information regarding candidate communication means for direct communication between the data acquisition base system 2000 and the work aircraft 1000, and candidate communication means for communication with the work aircraft 1000 via other external systems (relay aircraft 3000, communication satellite 4000, air traffic control system 5000). An example of a communication means candidate acquired by the communication means candidate acquisition unit 2110 is described below with reference to Figures 7a to 10b.
[0064] First, the communication means via a relay aircraft will be described. Figure 7a is a diagram showing an example of a communication means via a relay aircraft. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via the relay aircraft 3000, and in particular, shows an example in which direct wireless communication is performed between the relay aircraft 3000 using wireless communication equipment for direct communication (including wireless communication antennas, etc.) installed in the communication infrastructure management system 2100. The direct wireless communication can utilize wireless communication bands such as, but not limited to, the 2.4 GHz band and the 5.7 GHz band. Wireless communication using ultra-long waves in the 3 kHz to 30 kHz band, long waves in the 30 kHz to 300 kHz band, medium waves in the 300 kHz to 3 MHz band, short waves in the 3 MHz to 30 MHz band, ultra-short waves in the 30 MHz to 300 MHz band, ultra-short waves in the 300 MHz to 3 GHz band, microwaves in the 3 GHz to 30 GHz band, millimeter waves in the 30 GHz to 300 GHz band, and submillimeter waves in the 300 GHz to 3 THz band can also be applied.
[0065] 7b is a diagram showing another example of a communication means via a relay aircraft. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via the relay aircraft 3000, and in particular, communication between the communication infrastructure management system 2100 and the relay aircraft 3000 is performed via an Internet line and public wireless equipment. Wireless communication between public wireless communication equipment (including base stations for aircraft communication, wireless communication antennas, etc.) and the relay aircraft 3000 can appropriately use wireless in the various bands described above.
[0066] Next, communication means via a communication satellite 4000 will be described. FIG. 8a is a diagram showing an example of communication means via a communication satellite. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via the communication satellite 4000, and in particular shows an example in which direct wireless communication is performed with the communication satellite 4000 using wireless communication equipment (including a wireless communication antenna, etc.) for direct communication with the communication satellite provided in the communication infrastructure management system 2100. Note that for this direct wireless communication, wireless communication bands such as the 2.4 GHz band and the 5.7 GHz band can be used, but are not limited to these.
[0067] 8b is a diagram showing another example of a communication means via a communication satellite. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via a communication satellite 4000, and in particular, communication between the communication infrastructure management system 2100 and the communication satellite 4000 is performed via an Internet line and public wireless equipment (including base stations for satellite communication, wireless communication antennas, etc.).
[0068] Next, the communication means when performing direct wireless communication with a work aircraft will be described. Figure 9a is a diagram showing an example of communication means when performing direct communication with a work aircraft. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 directly communicates with the work aircraft 1000, and in particular, shows an example in which direct wireless communication is performed with the work aircraft 1000 using wireless communication equipment for direct communication (including wireless communication antennas, etc.) installed in the communication infrastructure management system 2100. Note that for this direct wireless communication, wireless communication bands such as the 2.4 GHz band and the 5.7 GHz band can be used, but are not limited to these.
[0069] 9b is a diagram showing another example of a communication means for direct communication with a work aircraft. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates directly with the work aircraft 1000, and in particular, communication between the communication infrastructure management system 2100 and the work aircraft 1000 is performed via an Internet line and public wireless equipment (including base stations for aircraft communications, wireless communication antennas, etc.).
[0070] Next, a description will be given of communication means when wireless communication is performed via the air traffic control system 5000. FIG. 10a is a diagram showing an example of communication means via the air traffic control system. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via the air traffic control system 5000, and in particular, shows an example in which wireless communication is performed between the communication infrastructure management system 2100 and the air traffic control system 5000 using wireless communication equipment (including wireless communication antennas, etc.) installed in the communication infrastructure management system 2100. Note that, for example, wireless communication bands in the 2.4 GHz band or the 5.7 GHz band can be used for this wireless communication, but are not limited to these.
[0071] 10b is a diagram showing another example of a communication means via the air traffic control system 5000. The candidate example of communication means shown in this figure shows an example in which the communication infrastructure management system 2100 of the data acquisition base system 2000 communicates with the work aircraft 1000 via the air traffic control system 5000, and in particular, communication between the communication infrastructure management system 2100 and the air traffic control system 5000 is performed via an Internet line and public wireless equipment (including base stations, wireless communication antennas, etc.).
[0072] 7a to 10b, there are multiple candidate communication means for communication between the communication infrastructure management system 2100 of the data acquisition base system 2000 and the work aircraft 1000. The candidate communication means acquisition unit 2110 acquires information on these multiple candidate communication means.
[0073] (A-1-6-2. Communication status determination unit 2120) The communication status determination unit 2120 includes a communication strength determination unit 2121 and a communication speed determination unit 2122, and determines the communication status (communication strength and communication speed) for each airspace area for each of the multiple communication means candidates acquired by the communication means candidate acquisition unit 2110. The communication status is determined for each of multiple communication channels, such as LTE (Long Term Evolution), WiFi, 2.4 GHz, 3.2 GHz, and 5.7 GHz. The communication strength determination unit 2111 determines the communication strength between the device itself and each external system for each airspace area. For example, this determination is made by measuring or calculating the state quantity of the communication strength defined in units such as dB. The communication speed determination unit 2112 determines the communication speed between the device itself and each external system for each airspace area. For example, this determination is made by measuring or calculating the state quantity of the communication speed defined in units such as bps. The communication status (communication strength and communication speed) for each airspace area can be obtained by acquiring information on current or past communication status measured by the communication status determination unit 1500, 3500 of the work aircraft 1000 or relay aircraft 3000, or by other aircraft flying in the same airspace or other communication status measurement means. For example, the communication status determination unit 2120 can determine the communication strength and communication speed between the relay aircraft 3000 and the work aircraft 1000, and also the communication strength and communication speed between the relay aircraft 3000 and the data acquisition base system 2000.
[0074] For example, in the case of a communication means via a communication satellite 4000 as shown in Figures 8a and 8b, the communication strength determination unit 2111 and the communication speed determination unit 2112 measure the communication strength and communication speed between the communication infrastructure management system and the communication satellite 4000, and the communication strength and communication speed between the communication satellite 4000 and the work aircraft 1000, respectively, and determine the worst values of communication strength and communication speed as the communication strength and communication speed of the communication means.
[0075] (A-1-6-3. Communication means determination unit 2130) The communication means determination unit 2130 is a functional unit that determines the control communication means and the measurement data communication means based on the communication state for each communication means candidate determined by the communication state determination unit 2120 and standard information on the communication performance required for the control communication and the measurement data communication. Note that the communication means determination unit 2130 may allocate not only the communication path but also the communication frequency bands to be used for the control communication and the measurement data communication from different frequency bands. The communication means determination unit 2130 includes a control communication means determination unit 2131 and a measurement data communication means determination unit 2132.
[0076] The control communication means determination unit 2131 determines, from among the candidate communication means, a communication means for control communication to transmit and receive control-related information (control commands, control status information, real-time video, etc.). Since the control-related information is information necessary for remote operation of flight control and measurement control of the work aircraft 1000, etc., stable communication without interruption and real-time communication with little communication delay are required to ensure safe operation of the aircraft and reliable execution of measurement work. For this reason, the communication means is determined based on a criterion that prioritizes high communication strength over communication speed.
[0077] The measurement data communication means determination unit 2132 determines the communication means for control communication to receive measurement data (or processed data if data processing is performed in the work aircraft 1000 or relay aircraft 3000) from among the candidate communication means. Unlike control communication, communication of measurement data, etc. is not directly related to flight control or measurement control, and therefore does not require high communication stability or real-time communication performance. On the other hand, measurement data and processed data have a larger data volume than control-related information, and therefore require high-speed transmission of large amounts of data. Therefore, the communication means is determined based on a criterion that prioritizes high communication speed over communication strength.
[0078] The control communication means determination unit 2131 and the measurement data communication means determination unit 2132 are not limited to determining the use of one communication means, but may, for example, perform parallel transmission using multiple communication means, or switch transmission by switching between multiple communication means. Furthermore, when the communication infrastructure management system 2100 determines that data should be transmitted by physically transporting the memory by a person, it may display this fact on an appropriate display unit and request the administrator to physically transport the memory.
[0079] (A-1-6-4. Relay aircraft use determination unit 2140) The relay aircraft usage determination unit 2140 has a relay position determination unit 2141, a relay aircraft addition necessity determination unit 2142, and a relay aircraft unnecessary determination unit 2143. When the communication means determination unit 2130 selects communication via the relay aircraft 3000 as shown in Figures 7a and 7b as the communication means between the work aircraft 1000 and the data acquisition base system 2000, the relay aircraft usage determination unit 2140 determines the position where the communication will be relayed by the relay aircraft 3000, and determines whether or not to add a relay aircraft 3000 or whether or not the relay aircraft 3000 is unnecessary.
[0080] First, we will explain the function of the relay position determination unit 2141. The relay position determination unit 2141 is a functional unit that determines the flight area of the relay aircraft 3000. The relay position determination unit 2141 determines, as an airspace area (i.e., a relay position) in which the relay aircraft will fly, an airspace area that is set in advance as an airspace area and allows wireless communication, or an airspace area that is within a predetermined distance from the data acquisition base system 2000 and the working aircraft 1000 and allows wireless communication, and in which the communication status determined by the communication status determination unit 2120 satisfies predetermined conditions.
[0081] The airspace area where the communication state described above satisfies the predetermined conditions can be an airspace area where the communication strength determined by the communication state determination unit 2120 is stronger than a predetermined strength. In this way, by determining an airspace area where the communication strength is stronger than a predetermined strength as a relay location, wireless communication relay by the relay aircraft 3000 can be performed stably without interruption, and flight control and measurement control of the work aircraft 1000 in particular can be performed stably.
[0082] Furthermore, an airspace area in which the above-mentioned communication state satisfies a predetermined condition can be determined to be an airspace area in which the communication speed determined by the communication state determination unit 2120 is faster than a predetermined speed. In particular, when the amount of measurement data measured by the working aircraft 1000 is greater than a predetermined value, or is expected to be greater than the predetermined value, the airspace area in which the communication speed determined by the communication state determination unit 2120 is faster than a predetermined speed can be determined to be the flight area of the relay aircraft 3000. By determining the flight area of the relay aircraft 3000 in this way, even when the amount of measurement data is large and the communication load of the data communication of the measurement data is heavy, high-speed transmission of the measurement data via the relay aircraft 3000 is possible.
[0083] When wireless communication is performed on Earth, it is necessary to determine the relay location taking into account the presence of obstacles between the two communication points. Therefore, FIG. 14 is used to explain situations in which communication failures occur and how to deal with them. FIG. 14 is a conceptual diagram illustrating a wireless communication failure state. This diagram shows the positional relationship when a relay aircraft 3000 relays wireless communication between a data acquisition base system 2000 and a work aircraft 1000. As shown in this diagram, since the Earth is approximately spherical, as the wireless communication distance increases, mountains and other features may appear on the wireless communication path, obstructing wireless communication. In such cases, increasing the flight altitude of the relay aircraft 3000 eliminates obstacles that block communication between the work aircraft and the relay aircraft, and between the relay aircraft and the data acquisition base system, thereby improving communication conditions.
[0084] Therefore, the relay position determination unit 2141 determines a position higher than the current altitude of the relay aircraft as the relay position when the communication strength or communication speed, or both, determined by the communication status determination unit 2120 do not satisfy a predetermined condition. Alternatively, the relay position may be determined so that the altitude of the relay aircraft increases as the communication strength or communication speed decreases.
[0085] Alternatively, if the wireless communication distance between the relay aircraft 3000 and the working aircraft 1000, or the wireless communication distance between the relay aircraft 3000 and the data acquisition base system 2000, becomes longer than a predetermined distance, or is expected to become longer than a predetermined distance, the relay position determination unit 2141 determines a position higher than the current altitude of the relay aircraft as the relay position. Alternatively, the relay position may be determined so that the altitude of the relay aircraft increases as the wireless communication distance becomes longer than a predetermined distance.
[0086] Next, we will explain the function of the repeater addition necessity determination unit 2142. The repeater addition necessity determination unit 2142 is a functional unit that determines whether or not to dispatch the relay aircraft 3000 to perform wireless communication relay before performing wireless communication relay by the relay aircraft 3000.
[0087] For example, the relay aircraft addition necessity determination unit 2142 determines to start wireless communication relay by the relay aircraft 3000 when the communication strength or communication speed between the data acquisition base system 2000 and the work aircraft 1000 determined by the communication status determination unit 2120 becomes lower than a predetermined value before wireless communication relay by the relay aircraft 3000 is performed.
[0088] Alternatively, the relay unit addition necessity determination unit 2142 determines to start wireless communication relay by the relay aircraft 3000 when the communication speed between the data acquisition base system 2000 and the working aircraft 1000, determined by the communication status determination unit 2120 before wireless communication relay by the relay aircraft 3000, is expected to be lower than a reference speed corresponding to the amount of measurement data measured by the working aircraft 1000. Alternatively, when the amount of measurement data is so large that it is expected that transmission by a single relay aircraft 3000 will take too long, relaying by multiple relay aircraft 3000 is required. Therefore, the relay unit addition necessity determination unit 2142 determines the number of relay aircraft for starting wireless communication relay in this way according to the amount of measurement data. Here, the reference speed is set so that the communication speed increases as the amount of measurement data increases, and decreases as the amount of measurement data decreases.
[0089] Alternatively, the relay aircraft addition necessity determination unit 2142 calculates the future distance between the working aircraft 1000 and the data acquisition base system 2000 based on information regarding the planned movement position of the working aircraft 1000, such as the planned flight path, before wireless communication relay by the relay aircraft 3000 is performed, and if the calculated distance is expected to be longer than a predetermined distance, determines to start wireless communication relay by the relay aircraft 3000. Alternatively, if the calculated distance is very long and it is expected that relaying by a single relay aircraft 3000 is not possible, relaying by multiple relay aircraft 3000 will be necessary. Therefore, the relay aircraft addition necessity determination unit 2142 determines the number of relay aircraft for which wireless communication relay should be started, depending on the distance calculated in this manner.
[0090] Even if the communication state is normal, if an abnormality occurs in ground infrastructure facilities, including communication facilities and power facilities, which are infrastructure related to ground communications, there is a high possibility of a communication abnormality occurring. Therefore, if the repeater addition necessity determination unit 2142 acquires abnormality information of ground infrastructure facilities, including ground communication facilities or power facilities, before performing wireless communication relay by the relay aircraft 3000, it determines to start wireless communication relay by the relay aircraft 3000. In addition, in this case, the relay position determination unit 2141 determines that the airspace area surrounding the abnormal ground infrastructure facility is the flight area of the relay aircraft.
[0091] So far, we have explained the method for determining whether to start wireless communication relay by the relay aircraft 3000 before performing wireless communication relay. Below, we will explain the function of the relay aircraft addition necessity determination unit 2142, which determines whether to dispatch an additional relay aircraft 3000 and perform wireless communication relay using multiple relay aircraft (3000, 3001) while wireless communication relay by the relay aircraft 3000 is being performed.
[0092] The relay aircraft addition necessity determination unit 2142 determines whether or not to dispatch an additional relay aircraft 3000 and perform wireless communication relay using multiple relay aircraft, depending on the first communication state determined by the communication state determination unit 2120, which includes the communication strength and communication speed between the relay aircraft 3000 and the working aircraft 1000, and the second communication state determined by the communication state determination unit 2120, which includes the communication strength and communication speed between the relay aircraft 3000 and the data acquisition base system 2000.
[0093] For example, if either the communication strength or communication speed in the first communication state or the second communication state does not meet a specified condition, it is determined that an additional relay aircraft 3001 should be flown and wireless communication relay should be performed by multiple relay aircraft.
[0094] Furthermore, when the relay aircraft addition necessity determination unit 2142 determines that an additional relay aircraft 3000 will be dispatched to perform wireless communication relay using multiple relay aircraft, the relay position determination unit 2141 determines the flight area of the additional relay aircraft 3001 according to the first communication state and the second communication state. Here, a method for determining the flight area of the additional relay aircraft 3001 will be described using Figure 20. Figure 20 is a diagram illustrating the setting position of the flight area when flying an additional relay aircraft.
[0095] For example, when the communication strength of the first communication state between the relay aircraft 3000 and the working aircraft 1000 is lower than a predetermined value, an additional relay aircraft 3001 is flown in the airspace area between the relay aircraft 3000 and the working aircraft 1000, and a series relay (series relay) is performed in which the relay aircraft 3000 and the additional relay aircraft 3001 are serially relayed. Also, when the communication strength of the second communication state between the relay aircraft 3000 and the data acquisition base system 2000 is lower than a predetermined value, an additional relay aircraft 3001 is flown in the airspace area between the relay aircraft 3000 and the data acquisition base system, and a series relay is performed by the relay aircraft 3000 and the additional relay aircraft 3001. Such series relay shortens the individual wireless communication distance, making it possible to maintain higher communication strength.
[0096] As another example, when the communication speed in the first communication state between the relay aircraft 3000 and the working aircraft 1000 is lower than a predetermined value, an additional relay aircraft 3001 is flown in the airspace area between the relay aircraft 3000 and the working aircraft 1000, and parallel relay is performed by the relay aircraft 3000 and the additional relay aircraft 3001. Also, when the communication speed in the second communication state between the relay aircraft 3000 and the data acquisition base system 2000 is lower than a predetermined value, an additional relay aircraft 3001 is flown in the airspace area between the relay aircraft 3000 and the data acquisition base system 2000, and parallel relay is performed by the relay aircraft 3000 and the additional relay aircraft 3001. Such parallel relay can improve the amount of data that can be transmitted per unit time between the data acquisition base system 2000 and the working aircraft 1000.
[0097] As a method for determining whether an additional relay aircraft 3001 needs to be dispatched while wireless communication relay by the relay aircraft 3000 is being performed, the need for dispatch of the additional relay aircraft 3001 can also be determined based on the distance between the relay aircraft 3000 and the working aircraft 1000, instead of the communication information determined by the communication status determination unit 2120. For example, if the distance between the relay aircraft 3000 and the working aircraft 1000 is longer than a predetermined distance, or if information such as the planned flight path of the working aircraft 1000 indicates that the distance between the relay aircraft 3000 and the working aircraft 1000 will become longer than a predetermined distance in the future, the relay aircraft addition necessity determination unit 2142 flies a second relay aircraft, which is an additional relay aircraft, to perform wireless communication relay by multiple relay aircraft.
[0098] Next, the function of the repeater no longer required determination unit 2143 will be described. The repeater no longer required determination unit 2143 determines to switch from the current wireless communication relay by a relay aircraft to wireless communication without the relay aircraft, depending on the communication state and other conditions. For example, when the communication strength and communication speed in the first communication state between the relay aircraft 3000 and the working aircraft 1000 and the second communication state between the relay aircraft 3000 and the data acquisition base system 2000 satisfy predetermined conditions, and the working aircraft 1000 and the data acquisition base system 2000 are within a distance range where direct communication is possible, a relay no longer required determination is made to switch the wireless communication between the working aircraft 1000 and the data acquisition base system 2000 from wireless communication using relay by a relay aircraft to wireless communication without the relay aircraft.
[0099] Furthermore, the relay no-go determination unit 2143 may have a function to determine that relaying is not required and, when switching to wireless communication that does not involve a relay aircraft, set a flight area for the working aircraft 1000. For example, when switching wireless communication between the working aircraft 1000 and the data acquisition base system 2000 from wireless communication that uses relaying by the relay aircraft 3000 to wireless communication that does not involve the relay aircraft 3000, a flight area within a distance range that allows direct communication with the data acquisition base system 2000 is set as the flight area for the working aircraft 1000, and the working aircraft is moved to that flight area.
[0100] In addition, the relay no-repeater determination unit 2143 may determine that a relay is not required, and if it is possible to move the work aircraft within a flight area within a distance range where direct communication with the data acquisition base system 2000 is possible even before switching to wireless communication that does not involve a relay aircraft, it may set the flight area within the distance range where direct communication with the data acquisition base system 2000 is possible as the flight area of the work aircraft 1000, move the work aircraft to that flight area, and after the work aircraft 1000 has moved to that flight area, it may determine that a relay is not required and switch to wireless communication that does not involve a relay aircraft.
[0101] Furthermore, the relay no-repeater determination unit 2143's relay no-required determination is not limited to a determination to switch from the current wireless communication relay by a relay aircraft to direct communication between the data acquisition base system 2000 and the work aircraft 1000 without using a relay aircraft, but may also be a determination to switch from the current wireless communication relay by a relay aircraft to wireless communication relay by a communication satellite. For example, if the work aircraft 1000 is capable of communicating with the communication satellite 4000, the relay no-repeater determination unit 2143 determines to switch the wireless communication between the work aircraft 1000 and the data acquisition base system 2000 from wireless communication using a relay by the relay aircraft 3000 to wireless communication using a relay by the communication satellite 4000.
[0102] (A-1-6-5. Control communication unit 2150) The control communication unit 2150 switches the communication used for transmitting and receiving control-related information to the communication means determined by the control communication means determination unit 2131.
[0103] (A-1-6-6. Measurement data communication unit 2160) The measurement data communication unit 2160 switches the communication used to receive the measurement data to the communication means determined by the measurement data communication means determination unit 2132. Also, in accordance with the determination result of the data transmission determination unit 2330 of the acquired data management system 2300, the measurement data recorded in the measurement data recording unit 2310 is transmitted to the spatial information data utilization system 6000 or the like.
[0104] (A-1-7. Overview of Aircraft Flight Operating System 2200) Next, the vehicle flight operating system 2200 will be described. Fig. 11 is a functional block diagram of the vehicle flight operating system. The vehicle flight operating system 2200 has functions for setting flight areas, etc. of aircraft to be remotely controlled (including work aircraft and relay aircraft) and for flight control. The vehicle flight operating system 2200 includes a flight area setting unit 2210, a flight geofence setting unit 2220, a flight mission setting unit 2230, a remote control unit 2240, and a flight control command unit 2250.
[0105] (A-1-7-1. Flight area setting unit 2210) The flight area setting unit 2210 sets the flight area of the working aircraft 1000 according to information related to the previously set flight plan of the working aircraft 1000. In addition, when setting the flight area of the working aircraft 1000 before or after the relay no longer required determination is made by the relay no longer required determination unit 2143 described above, the flight area setting unit 2210 obtains information about the flight area from the relay no longer required determination unit 2143 and sets the flight area as the flight area of the working aircraft.
[0106] In addition, the flight area setting unit 2210 sets the flight area of the relay aircraft 3000 according to the various determination results of the relay aircraft usage determination unit 2140. For example, it acquires information on the airspace area (relay position) in which the relay aircraft 3000 or the additional relay aircraft 3001 will fly, as determined by the relay position determination unit 2141, and sets the airspace area as the flight area of the relay aircraft 3000 or the additional relay aircraft 3001, respectively.
[0107] (A-1-7-2. Flight geofence setting unit 2220) The flight geofence setting unit 2220 is a functional unit that generates a flight geofence that restricts the flight area of a work aircraft or relay aircraft to be operated. The flight geofence setting unit 2220 sets a flight geofence at a position that includes the flight area generated by the flight area setting unit 2210, depending on the position of the flight area. Here, the flight geofence is set as a virtual fence at a position that covers an airspace area where the aircraft can safely fly without interfering with other aircraft. When a manual or automatic flight command is issued to move outside the flight geofence, or when there is a risk that the aircraft will move outside the flight geofence due to external disturbances such as strong winds, the flight geofence restricts the flight position of the aircraft so that it remains inside the flight geofence. Furthermore, the flight geofence is generated before the work aircraft or relay aircraft to be operated begins flight.
[0108] Here, when wireless communication relay by the relay aircraft 3000 is started while measurement work or the like is being performed by the work aircraft 1000, in order to secure a new flight-permitted area exclusively for the relay aircraft 3000, arbitration with the air traffic control system is required to ensure that there is no interference with other aircraft in the airspace, and this arbitration may take time. Therefore, by generating a flight geofence for the relay aircraft within an area covered by an already generated flight geofence for the work aircraft, arbitration with the air traffic control system can be omitted, the time required for arbitration can be shortened, or the flight geofence for the relay aircraft can be set in a safer area.
[0109] When the flight geofence setting unit 2220 generates a flight geofence for a work aircraft or a relay aircraft, it transmits information about the flight geofence to the air traffic control system 5000, which controls the airspace in which the flight geofence is set.
[0110] (A-1-7-3. Flight mission setting unit 2230) The flight mission setting unit 2230 generates, as flight mission information, a planned flight route at a position within the airspace area covered by the flight geofence generated by the flight geofence setting unit 2220. Note that the flight mission is not limited to the planned flight route, and may include target information on flight speed at each position on the planned flight route. It may also include planned measurement information for measurement sensors at each position on the planned flight route.
[0111] (A-1-7-4. Remote Control Unit 2240) The remote control unit 2240 is a functional unit that allows a pilot, who is a user of the aircraft flight operating system 2200, to remotely control the work aircraft 1000 or relay aircraft 3000 to be operated from the data acquisition base system 2000. The remote control unit 2240 includes a display unit 2241, an audio output unit 2242, and a control command input unit 2243.
[0112] The display unit 2241 displays control status information to the pilot, including the flight control status (movement control status) and measurement control status of the work aircraft, relay aircraft, or other moving object to be controlled. The flight control status displayed on the display unit 2241 includes real-time video captured by a remote control camera mounted on the work aircraft or relay aircraft. Furthermore, the display unit 2241 may also display information on pilot commands input by the pilot via the pilot command input unit 2243. The audio output unit 2242 outputs real-time audio picked up by a remote control microphone mounted on the work aircraft or relay aircraft.
[0113] The control command input unit 2243 accepts control command inputs from the operator for the work aircraft, relay aircraft, or other moving body that is the control target. For example, it inputs flight commands to the flight control unit of the control target (such as a command to move in any direction in three dimensions, or a command to change attitude around three axes toward a person) and measurement commands to the measurement unit (such as a command to start or stop measurement by a measurement sensor, or a command to change measurement parameters of a measurement sensor).
[0114] With this configuration of the remote control unit 2240, the operator can remotely control the controlled object while checking real-time video and real-time audio captured from the controlled object and information on the control status of the aircraft.
[0115] (A-1-7-5. Flight Control Command Unit 2250) Next, the flight control command unit 2250 will be described. Based on the flight area set by the flight area setting unit 2210, the flight control command unit 2250 generates flight control commands to fly the work aircraft 1000, relay aircraft, or additional relay aircraft within the flight area. Alternatively, based on the flight mission generated by the flight mission setting unit 2230, the flight control command unit 2250 generates flight control commands to cause the work aircraft 1000, relay aircraft, or additional relay aircraft to follow the flight mission. Alternatively, based on the information of the piloting command input by the piloting command input unit 2243, the flight control command unit 2250 generates flight control commands (or measurement control commands) for the work aircraft 1000, relay aircraft, or additional relay aircraft.
[0116] Alternatively, the relay position determination unit 2141 generates a flight control command to have the relay aircraft or additional relay aircraft fly through the relay position based on the determined relay position information. Alternatively, the relay no-repeater determination unit 2143 determines that relaying is not required, and when switching to wireless communication that does not involve a relay aircraft, if a flight area for the work aircraft 1000 is set, a flight control command is generated to fly within that flight area.
[0117] When the data acquisition base system 2000 automatically controls the work aircraft 1000 or relay aircraft 3000, which are the objects of control, the flight control command unit 2250 automatically controls the work aircraft 1000 or relay aircraft 3000 remotely by transmitting flight control commands generated for the work aircraft 1000 or relay aircraft 3000 to the work aircraft 1000 or relay aircraft 3000 via the communication infrastructure management system.
[0118] In addition, when the remote control unit 2240 manually controls the work aircraft 1000 or relay aircraft 3000, which are the objects to be controlled, the flight control command unit 2250 outputs the flight control commands generated for the work aircraft 1000 or relay aircraft 3000 to the display unit 2241 of the remote control unit 2240.
[0119] In addition, if the work aircraft 1000 or relay aircraft 3000 to be controlled is a manned aircraft with a pilot on board, the flight control command unit 2250 outputs the flight control commands generated for the work aircraft 1000 or relay aircraft 3000 to the display unit of the control device provided on the work aircraft 1000 or relay aircraft 3000.
[0120] In this way, the flight control command unit 2250 generates commands for various types of aircraft, including remotely controlled automatic aircraft, remotely controlled manually, and manned aircraft, to directly control the flight of the work aircraft 1000 or relay aircraft 3000 that are the objects of control, or to output flight control commands to the pilot (including screen display, audio output, etc.).
[0121] (A-1-8. Overview of Acquisition Data Management System 2300) Next, we will explain the acquired data management system 2300. Figure 12 is a functional block diagram of the acquired data management system. The acquired data management system 2300 is a system that manages measurement data acquired by the work aircraft 1000, and includes a measurement data recording unit 2310, a defect data determination unit 2320, and a data transmission determination unit 2330.
[0122] The measurement data recording unit 2310 is a functional unit that records measurement data acquired via the communication infrastructure management system on a recording medium. Alternatively, if the measurement data is processed by the measurement data processing unit of the work aircraft 1000 or relay aircraft 3000, the processed data acquired via the communication infrastructure management system is recorded on a recording medium. The defect data determination unit 2320 determines whether the measurement data or processed data contains defects, and records the determination result in the measurement data recording unit 2310 or notifies the user via a display device or the like. The data transmission determination unit 2330 is a functional unit that determines, from each piece of data recorded in the measurement data recording unit 2310, which data to transmit to the spatial information data utilization system or other external systems.
[0123] (A-1-9. Hardware Configuration) 13 is a hardware configuration diagram of a data acquisition base system, etc. Here, the data acquisition base system 2000, air traffic control system 5000, and spatial information data utilization system 6000, which constitute the relay system 1 in the present invention, are information processing devices such as a server device and a PC. As shown in the figure, the data acquisition base system 2000, air traffic control system 5000, and spatial information data utilization system 6000 each include an input device 100, an output device 200, a processing device 300, a main memory device 400, an auxiliary memory device 500, a communication device 600, and a bus 700 that electrically connects these devices.
[0124] The input device 100 is a device for a user of each system to input information and instructions. Specifically, the input device 100 is, for example, a touch panel, a keyboard, a mouse, or a voice input device such as a microphone.
[0125] The output device 200 is a device that outputs information from an information display unit in the data acquisition base system 2000, the air traffic control system 5000, or the spatial information data utilization system 6000. Specifically, the output device 200 is a display device (including eyewear, AR, VR display devices, etc.), a printer, or a speaker.
[0126] The processing device 300 is, for example, a device that performs arithmetic processing. Specifically, the processing device 300 is, for example, a CPU, a microprocessor, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), or other semiconductor devices capable of performing calculations.
[0127] The main storage device 400 is a memory device such as a RAM that temporarily stores various types of read information and a ROM that stores programs, application programs, and other various information executed by the processing device 300. The auxiliary storage device 500 is a non-volatile storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory that can store digital information.
[0128] The communication device 600 is a device that performs wireless or wired information communication with an external device.
[0129] (A-1-10. Flowchart) Next, the operation flow of the relay system 1 will be described. Fig. 15 is a flowchart showing the operation of the relay system. First, the communication status determination unit 2120 determines the communication status (step 101). Here, the communication status determination unit 2120 acquires the communication strength and communication speed as the communication status. The communication status may be measured by a measurement device on the unit itself, or measurement results may be acquired from the work aircraft 1000 or relay aircraft 3000.
[0130] Next, the communication means determination unit 2130 determines a communication means from among a plurality of communication means candidates (step 102). The communication means candidates can include a communication relay by a relay aircraft as shown in Fig. 7, a communication relay by a communication satellite as shown in Fig. 8, and a communication relay via an air traffic control system as shown in Fig. 10.
[0131] Next, the communication means determination unit 2130 determines whether communication relay using a relay aircraft is necessary, and if it is determined that a relay aircraft is necessary, transitions to processing step 104; on the other hand, if it is determined that a relay aircraft is not necessary, transitions to processing step 105 (step 103).
[0132] Next, the relay aircraft usage determination unit 2140, control communication unit 2150, measurement data communication unit 2160, aircraft operation operating system 2200, etc. determine the flight area of the relay aircraft, generate flight control commands, etc., and perform wireless communication relay by the relay aircraft (step 104).
[0133] Next, the relay aircraft usage determination unit 2140 determines whether or not it is necessary to change the relay method used by the relay aircraft, including changing the relay position of the relay aircraft, dispatching additional relay aircraft, or temporarily storing measurement data used by the relay aircraft (step 105).
[0134] Next, if the relay aircraft usage determination unit 2140 determines that a change in the relay method of the relay aircraft is necessary, it transitions to processing step 107, and if it determines that a change in the relay method of the relay aircraft is not necessary, it transitions to processing step 108 (step 106).
[0135] Next, the relay method of the relay aircraft is changed by the relay aircraft utilization determination unit 2140, the control communication unit 2150, the measurement data communication unit 2160, the aircraft operation system 2200, etc. (step 107).
[0136] Next, the repeater unnecessary determination unit 2143 determines whether or not wireless communication relay by a relay aircraft is necessary (step 108).
[0137] Next, if the relay device unnecessary determination unit 2143 determines that wireless communication relay by a relay aircraft is unnecessary, the process proceeds to processing step 110, and if it determines that wireless communication relay by a relay aircraft is necessary, the process of this flowchart is terminated (step 109).
[0138] Next, the communication infrastructure management system 2100 switches from wireless communication relay using the relay aircraft to wireless communication without the relay aircraft (step 110). After this step is performed, the processing of this flowchart ends.
[0139] (A-1-11. Detailed flow of communication means determination) Next, a detailed flow of communication means determination will be described below. Fig. 16 is a flowchart showing the process performed by the communication means determination unit 2130 to determine the communication means.
[0140] First, the communication means determination unit 2130 determines whether the communication state of the communication means currently used for control communication with the work aircraft 1000 satisfies a first predetermined condition, and if the first predetermined condition is satisfied, transitions to processing step 205. On the other hand, if the first predetermined condition is not satisfied, transitions to processing step 202 (step 201). Here, the first predetermined condition is a condition of the communication state required for control communication, such as a relatively strong communication strength (dB) so that communication is unlikely to be interrupted, and a small communication delay. Note that because the data volume of control-related information is relatively small, the required communication speed level may be low.
[0141] Next, if the first predetermined condition is not met in step 201, the communication means determination unit 2130 determines whether there is a communication means other than the communication means using the relay aircraft that satisfies the first predetermined condition, and if there is another communication means that satisfies the first predetermined condition, transitions to processing step 203; on the other hand, if there is no other communication means that satisfies the first predetermined condition, transitions to processing step 204 (step 202).
[0142] Next, if there is another communication means that satisfies the first predetermined condition in step 201, the communication means determination unit 2130 switches the communication means for control communication with the work aircraft 1000 to the other communication means that satisfies the first predetermined condition (step 203).
[0143] Next, if there are no other communication means that satisfy the first predetermined condition in step 201, the communication means determination unit 2130 flies the relay aircraft 3000 and switches the communication means for control communication with the work aircraft 1000 to the communication means using the relay aircraft 3000 (step 204).
[0144] Next, if it is determined in step 201 that the first predetermined condition is satisfied, or if a relay aircraft for control communication relay is dispatched in step 204, the communication means determination unit 2130 proceeds to determining the communication means for data transmission. Specifically, the communication means determination unit 2130 determines whether the communication status of the communication means currently used for data transmission with the work aircraft 1000 satisfies a second predetermined condition. If the second predetermined condition is satisfied, the control flow in this figure is terminated. On the other hand, if the second predetermined condition is not satisfied, the control flow transitions to processing step 206 (step 205). Here, the second predetermined condition is a communication status condition required for the communication transmission of measurement data and processed data. For example, a relatively high communication speed (bps) is required to enable the rapid transmission of large amounts of measurement data, etc. Note that, since temporary communication interruptions do not pose a major problem for measurement data, etc., the required communication strength level may be low. Furthermore, the communication speed defined as the second predetermined condition may be determined according to the amount of measurement data to be transmitted (the greater the amount of data, the higher the communication speed required).
[0145] Next, if the second predetermined condition is not met in step 205, it is determined whether there is any other communication means other than the relay aircraft that meets the second predetermined condition, and if there is any other communication means that meets the second predetermined condition, the process transitions to processing step 207, while if there is no other communication means that meets the second predetermined condition, the process transitions to processing step 208 (step 206).
[0146] Next, if there is another communication means that satisfies the second predetermined condition in step 206, the communication means used for data transmission with the work aircraft 1000 is switched to the other communication means that satisfies the second predetermined condition (step 207).
[0147] Next, if there is no other communication means that satisfies the second predetermined condition in step 206, the relay aircraft 3000 is flown and the communication means used for data transmission with the work aircraft 1000 is switched to the communication means using the relay aircraft 3000 (step 208). After this step is performed, the processing of this flowchart ends.
[0148] (A-1-12. Other detailed flow of communication means determination) While Fig. 16 describes a method for switching the communication means between control communication and measurement data communication depending on the communication state, Fig. 17 describes an example of switching the communication means based on another criterion. Fig. 17 is a flowchart showing another example of communication means determination by the communication means determination unit.
[0149] First, the communication means determination unit 2130 determines whether there is any damage information for terrestrial communication infrastructure (including communication antennas, etc.), and if there is no damage information, transitions to processing step 305, and if there is damage information, transitions to processing step 302 (step 301).
[0150] Next, if there is damage information in step 301, the communication means determination unit 2130 determines whether there are other communication means other than the communication means using the relay aircraft that are not damaged and can use available communication infrastructure facilities, and if there are other communication means that can use available communication infrastructure facilities, it transitions to processing step 303, and if there are no other communication means that can use available communication infrastructure facilities, it transitions to processing step 304 (step 302).
[0151] Next, if the communication means determination unit 2130 determines in step 302 that there is another communication means that can utilize the available communication infrastructure, it switches the communication means for control communication and data transmission to the other communication means that can utilize the available communication infrastructure (step 303).
[0152] In addition, if the communication means determination unit 2130 determines in step 302 that there are no other communication means that can utilize available communication infrastructure facilities, it starts the flight of the relay aircraft 3000 and switches the communication means to wireless communication relay for control communication and data transmission using the relay aircraft 3000 (step 304).
[0153] Next, the communication means determination unit 2130 determines whether the wireless communication distance predicted from the information on the planned flight path of the work aircraft or relay aircraft set in advance is within the communicable distance. If the wireless communication distance is within the communicable distance, the processing of this flowchart ends. If the wireless communication distance is longer than the communicable distance, the processing transitions to processing step 306 (step 305). Here, if the wireless communication distance is the communication distance between the work aircraft and the relay aircraft, it is calculated as the straight-line distance between the work aircraft and the relay aircraft. If the communication distance is the communication distance between the work aircraft or relay aircraft and the data acquisition base system (or air traffic control system), it is calculated as the distance from the work aircraft or relay aircraft to the ground-side communication antenna. In addition, the communicable distance may be set in advance for each communication channel.
[0154] Next, if it is determined in step 305 that the wireless communication distance is longer than the communication possible distance, it is determined whether wireless communication relaying by a relay aircraft is already being performed, and if wireless communication relaying by a relay aircraft is not being performed, the process transitions to processing step 308, while if wireless communication relaying by a relay aircraft is being performed, the process transitions to specified step 307 (step 306).
[0155] Next, if it is determined in step 306 that wireless communication relay by the relay aircraft is being performed, the altitude of the relay aircraft is raised (step 307). In this way, by raising the relay aircraft when the wireless communication distance becomes longer than the predetermined communicable distance, it is possible to eliminate obstacles on the ground on the straight line between the relay aircraft and the communication antenna of the communication partner, as shown in Fig. 14, and it is possible to extend the communicable distance.
[0156] Next, if it is determined in step 306 that wireless communication relaying is not being performed by a relay aircraft, it is determined whether there is a communication means other than using a relay aircraft that can use a communication antenna within communication distance from the work aircraft, and if there is a communication means that can use a communication antenna within communication distance, the process transitions to processing step 309, and if there is no communication means that can use a communication antenna within communication distance, the process transitions to processing step 310 (step 308).
[0157] Next, in step 308, if it is determined that there is a communication means that can use a communication antenna within the communication distance, the communication means for control communication and data transmission is switched to a communication means that can use a communication antenna within the communication distance from the work aircraft (step 309).
[0158] Next, in step 308, if it is determined that there is no communication means that can use a communication antenna within the communication distance, the number of relay aircraft to be dispatched is determined based on the wireless communication distance between the data acquisition base system 2000 and the work aircraft 1000 (step 310).
[0159] Next, the number of relay aircraft determined in step 310 is flown, and the control communication and data transmission are relayed using the multiple relay aircraft (step 311). After this step is performed, the processing of this flowchart ends.
[0160] (A-1-13. Method for starting relay using relay aircraft) Next, a method for performing wireless communication relay by a relay aircraft will be described with reference to the flowchart shown in FIG.
[0161] First, the relay position determination unit 2141 or flight area setting unit 2210 determines the flight area of the relay aircraft (step 401). Here, for example, if the planned flight position of the work aircraft falls within the distance range where wireless communication relay is possible in the fixed flight area of the relay aircraft, the flight area (relay position) of the relay aircraft can be set as a fixed area based on the planned flight position of the work aircraft and planned in advance before the relay aircraft begins flight. On the other hand, if the planned flight position of the work aircraft does not fall within the distance range where wireless communication relay is possible in the fixed flight area of the relay aircraft, the flight area of the relay aircraft is updated in real time according to the current flight position of the work aircraft based on the planned flight position of the work aircraft.
[0162] Next, the flight geofence setting unit 2220 generates a flight geofence for the relay aircraft (step 402). Here, the flight geofence for the relay aircraft is generated within the area covered by the flight geofence for the work aircraft, but if it is necessary to deviate from the communication distance, the flight geofence for the relay aircraft is generated outside the area covered by the flight geofence for the work aircraft as a flight geofence dedicated to the relay aircraft.
[0163] Next, the flight mission setting unit 2230 generates a flight mission for the relay aircraft (step 403). Here, the flight mission of the relay aircraft (including the flight path, flight speed, etc.) may be set in advance before the relay aircraft starts flying, or may be generated or updated in real time during the relay aircraft's flight.
[0164] Next, the flight geofence setting unit 2220 or the flight mission setting unit 2230 transmits information about the generated flight geofence or flight mission to the air traffic control system 5000 (step 404).
[0165] (A-1-14. How to set up a flight geofence for a relay aircraft) Next, we will explain how to set the flight geofence of the relay aircraft by the aircraft operation operating system 2200 when flying the relay aircraft. Figure 19 is a diagram explaining the position of the flight geofence of the relay aircraft.
[0166] If a flight geofence for the work aircraft has already been set, the flight geofence setting unit 2220 of the aircraft operation system 2200 sets the flight area of the relay aircraft and the flight geofence covering it inside the airspace area covered by the flight geofence for the work aircraft. In this way, if the flight geofence for the relay aircraft is set in the airspace inside the flight geofence of the work aircraft for which arbitration with other aircraft has already been completed, new arbitration is not necessary.
[0167] On the other hand, in cases where the communication distance from the ground communication antenna is longer than the wireless communication distance, the flight geofence of the relay aircraft is generated as a flight geofence exclusively for the relay aircraft outside the area covered by the flight geofence of the working aircraft.
[0168] (A-1-15. Change in relay method by relay aircraft) Next, a method for changing or updating the method of wireless communication relay using a relay aircraft will be described. Figure 21 is a flowchart for changing the method of wireless communication relay using an additional relay aircraft.
[0169] First, the communication status determination unit 2120 determines whether the communication strength between the ground communication equipment of the data acquisition base system and the relay aircraft 3000, or between the work aircraft 1000 and the relay aircraft 3000, is lower than a predetermined value, and if the communication strength is lower than the predetermined value, the process transitions to processing step 502, and if the communication strength is higher than the predetermined value, the process transitions to processing step 503 (step 501).
[0170] Next, if step 501 determines that the communication strength is lower than a predetermined value, the relay position determination unit 2141 increases the altitude of the flight position of the relay aircraft or changes the flight position of the relay aircraft to an airspace area with better communication conditions (step 502).
[0171] Next, the communication status determination unit 2120 determines whether the communication speed between the relay aircraft and the data acquisition base system is lower than a predetermined value. If the communication speed is lower than the predetermined reference value, the process proceeds to processing step 504. If the communication speed is higher than the predetermined value, the process of this flowchart ends (step 503). The predetermined reference value in this step may be a reference value that varies depending on the amount of measurement data. For example, the reference communication speed can be set higher as the amount of measurement data increases.
[0172] Next, if it is determined in step 503 that the communication speed is lower than the predetermined value, the communication status determination unit 2120 determines whether the communication speed between the relay aircraft and the working aircraft is lower than the predetermined value. If the determination shows that the communication speed is lower than the predetermined value, the process proceeds to processing step 505, and if the communication speed is higher than the predetermined value, the process proceeds to processing step 506 (step 504).
[0173] Next, if it is determined in step 504 that the communication speed between the relay aircraft and the working aircraft is lower than a predetermined value, the relay aircraft usage determination unit 2140 adjusts the flight position of the relay aircraft so that it flies closer to the working aircraft (step 505). More specifically, in this step, the relay aircraft 3000 is moved to a position closer to the working aircraft 1000 than the data acquisition base system 2000, and the relay aircraft is flown closer to the working aircraft to a position where the communication status between the relay aircraft 3000 and the working aircraft 1000 satisfies a predetermined condition (a state in which the communication speed between the relay aircraft 3000 and the working aircraft 1000 is equal to or higher than the predetermined value in step 504).
[0174] Next, the measurement data relay communication unit 3420 of the relay aircraft 3000 receives the measurement data from the work aircraft 1000 and records the measurement data in the data recording unit 3700 of the relay aircraft 3000 (step 506).
[0175] Next, it is determined whether satellite communication is available for the relay aircraft 3000 (step 507). For example, whether satellite communication is available is determined based on whether the communication state on the communication path from the relay aircraft 3000 to the data acquisition base system 2000 via the communication satellite 4000, measured by the communication state determination unit 2120, satisfies a first predetermined condition. If it is determined that satellite communication is not available, the process proceeds to processing step 508. On the other hand, if it is determined that satellite communication is available, the process proceeds to processing step 510 (step 507).
[0176] Next, if it is determined in step 507 that satellite communication is not available, the relay aircraft usage determination unit 2140 adjusts the flight position of the relay aircraft and moves the relay aircraft to an airspace area where the communication conditions (communication strength and communication speed) between the relay aircraft 3000 and the data acquisition base system 2000 are higher than a predetermined level (step 508).
[0177] Next, in that airspace area, the measurement data accumulated in the data recording unit 3700 of the relay aircraft 3000 is transmitted to the data acquisition base system 2000 by the measurement data relay communication unit 3420 (step 509).
[0178] Furthermore, if it is determined in step 507 that satellite communication is available, the relay aircraft usage determination unit 2140 adjusts the flight position of the relay aircraft and moves it to an airspace area where the communication conditions (communication strength and communication speed) of the satellite communication between the relay aircraft 3000 and the communication satellite 4000 satisfy a second specified standard that is higher than the first specified condition (step 510).
[0179] Next, in that airspace area, the measurement data accumulated in the data recording unit 3700 of the relay aircraft 3000 is transmitted by the measurement data relay communication unit 3420 to the data acquisition base system 2000 via a communication satellite (step 511).
[0180] (A-1-16. Example of flight position determination for relay aircraft) Next, we will explain the flight position determination of the relay flying object 3000 by the relay position determination unit 2141. Figure 22 is a diagram showing an example of the determination result when the flight position of the relay flying object is determined by the relay position determination unit.
[0181] In this figure, the location of the data acquisition base system 2000 and the current flight positions of the work aircraft 1000 and relay aircraft 3000 are shown on a map. The arc centered on the data acquisition base system indicates the airspace area where wireless communication is possible from the data acquisition base system, while the arc centered on the work aircraft indicates the airspace area where wireless communication is possible from the work aircraft. In other words, the area where the two arcs overlap indicates the airspace area where wireless communication is possible with both the data acquisition base system and the work aircraft. The areas indicated by ellipses indicate areas with good communication conditions and areas with poor communication conditions, respectively, as determined by the communication condition determination unit 2120.
[0182] Based on this information for each airspace, the relay position determination unit 2141 determines an airspace area where wireless communication with both the work aircraft and the data acquisition base system is possible and where the communication conditions meet predetermined conditions (area with good communication conditions) as the flight area in which the relay aircraft will fly, and outputs a flight control command to control the flight of the relay aircraft so that the relay aircraft will fly in that flight area or fly through the airspace area via the aircraft flight operating system 2200. In addition, the communication condition determination unit 2120 updates the communication condition for each airspace area, and if the relay aircraft is flying in an area with poor communication conditions, it outputs a flight control command to control the flight of the relay aircraft so that the relay aircraft will fly through an area with good communication conditions or fly through the airspace area.
[0183] (A-1-17. Variations in measurement data collection methods) Next, several variations in the method for collecting measurement data measured by a work aircraft using a data acquisition base system will be explained using FIGS.
[0184] 23a and 23b are diagrams showing an example of collecting measurement data from a work aircraft via wireless communication. The example shown in Fig. 23a shows a case where the communication conditions for transmitting measurement data between the data acquisition base system 2000 and the work aircraft 1000 deteriorate when the data acquisition base system 2000 and the work aircraft 1000 are communicating wirelessly via the relay aircraft 3000. In such a case, as described in processing steps 505 and 506 of the flowchart in Fig. 21, transmission of measurement data from the work aircraft 1000 to the relay aircraft 3000 is prioritized, and the measurement data is stored in a recording device within the relay aircraft 3000. Then, as described in processing step 508 of the flowchart of Figure 21, the relay aircraft is moved to an airspace area with good communication conditions for measurement data with the data acquisition base system 2000, and the measurement data accumulated in the recording device within the relay aircraft 3000 is transmitted from the relay aircraft 3000 to the data acquisition base system 2000, as shown in processing step 509 of the flowchart of Figure 21 and Figure 23b.
[0185] According to the measurement data collection method shown in Figure 23, even if the communication conditions for transmitting measurement data between the relay aircraft 3000 and the data acquisition base system 2000 deteriorate, the transmission of measurement data is prioritized between the work aircraft 1000 and the relay aircraft 3000, which are capable of transmitting measurement data, so that the measurement data transmission work can be carried out quickly even in an environment with poor communication conditions.
[0186] Next, Figures 24a and 24b show an example of retrieving measurement data by directly removing the recording medium from the relay aircraft. The example shown in Figure 24a particularly shows a case where the amount of data acquired by the work aircraft is enormous. In such a case, the relay aircraft 3000 moves to an airspace area with the fastest communication speed with the work aircraft 1000, and prioritizes transmission of measurement data from the work aircraft 1000 to the relay aircraft 3000, storing the measurement data in a recording device within the relay aircraft 3000. Then, as shown in Figure 24b, the relay aircraft 3000 lands at the location of the data acquisition base system 2000, removes the recording medium within the relay aircraft 3000, and directly retrieves the measurement data from the recording medium.
[0187] According to the measurement data collection method shown in Figure 24, even if the amount of measurement data acquired by the work aircraft 1000 is enormous, the transmission of the measurement data between the work aircraft 1000 and the relay aircraft 3000 is prioritized, and data transmission from the relay aircraft 3000 to the data acquisition base system 2000 is performed by landing and directly transporting the recording medium, so that the measurement data transmission work can be carried out quickly even if the amount of measurement data is enormous.
[0188] Next, Figures 25a and 25b show an example of retrieving measurement data by directly removing recording media from the work aircraft and relay aircraft. The example shown in Figure 25a particularly shows a case where the amount of data acquired by the work aircraft is enormous. In such a case, the relay aircraft 3000 moves to an airspace area where the communication speed with the work aircraft 1000 is fastest, records 50% of the total measurement data on the recording media within the work aircraft 1000, and stores the remaining 50% of the total measurement data in the recording device within the relay aircraft 3000. Then, as shown in Figure 25b, both the work aircraft 1000 and the relay aircraft 3000 land at the location of the data acquisition base system 2000, removes both the recording media within the work aircraft 1000 and the recording media within the relay aircraft 3000, and directly retrieves the measurement data from each recording media.
[0189] According to the measurement data collection method shown in Figure 25, even if the amount of measurement data acquired by the work aircraft 1000 becomes enormous, the measurement data is recorded by the work aircraft 1000 and the relay aircraft 3000, each sharing 50% of the data, and data transmission from the relay aircraft 3000 to the data acquisition base system 2000 is performed by landing and directly transporting the recording medium, thereby allowing the measurement data transmission work to proceed more quickly even if the amount of measurement data is enormous.
[0190] (A-1-18. Determining whether or not a relay aircraft is necessary) Next, a description will be given of the determination of whether or not wireless communication relay using a relay aircraft is necessary while the relay aircraft is flying. Fig. 26 shows a flowchart for determining whether or not a relay aircraft is necessary while wireless communication relay is being performed by the relay aircraft.
[0191] First, based on the judgment result of the communication state judgment unit 2120, the relay no-repeater judgment unit 2143 judges whether the communication strength and communication speed in the first communication state between the relay aircraft and the work aircraft and the second communication state between the relay aircraft and the data acquisition base system are better than specified conditions, and if it is judged to be better than the specified conditions, it transitions to processing step 602, and if it is judged to be worse than the specified conditions, it transitions to processing step 607 (step 601).
[0192] Next, if it is determined in step 601 that the conditions are better than the predetermined conditions, the relay no-repeater determination unit 2143 determines whether the work aircraft can fly a distance that allows direct communication with the communication equipment of the data acquisition base system, and if it is determined that flight is possible, it transitions to processing step 603, and if it is determined that flight is not possible, it transitions to processing step 607 (step 602). In this step, an example of determining whether the work aircraft can fly a distance that allows direct communication with the communication equipment of the data acquisition base system has been described, but in a relay system that provides multiple redundancies (e.g., triple redundancy) for communication means between the work aircraft and the data acquisition base system, it is determined whether triple redundancy of communication means with the data acquisition base system has been restored.
[0193] Next, if it is determined in step 602 that flight is possible (or triple redundancy has been restored), the relay aircraft unnecessary determination unit 2143 determines to notify the work aircraft 1000 that mission priority flight is possible, and notifies the work aircraft 1000 via the communication infrastructure management system (step 603). Here, mission priority flight means flight that prioritizes the mission to execute the work task assigned to the work aircraft 1000, regardless of the flight area in which the work aircraft 1000 can communicate with the relay aircraft 3000; for example, if the work task assigned to the work aircraft 1000 is aerial photography of the target area, it means flight with a flight mission that can most efficiently execute the aerial photography.
[0194] Next, the relay aircraft unnecessary determination unit 2143 notifies the user that operation of the relay aircraft is unnecessary (step 604). Here, this notification can be output to the display unit 2241 of the aircraft flight operating system 2200 to notify the user who is remotely controlling the aircraft. Alternatively, instead of notifying the user, a return command may be output from the flight control command unit 2250 to the relay aircraft, and the return operation of the relay aircraft may be performed automatically.
[0195] Next, the repeater unnecessary determination unit 2143 determines that the work aircraft should fly in an airspace area within the distance range where wireless communication with the data acquisition base system 2000 is possible, and the flight area setting unit 2210 of the aircraft flight operating system 2200 sets the airspace area as the flight area for the work aircraft (step 605). Based on the set flight area, a flight geofence and flight mission are generated by the aircraft flight operating system 2200.
[0196] Next, the control communication unit 2150 and the measurement data communication unit 2160 switch at least one of the control communication and the measurement data communication to wireless communication that does not use a relay aircraft (step 606).
[0197] Next, if it is determined in step 601 that the conditions are worse than the specified conditions, or if it is determined in step 602 that flight is not possible, it is determined whether the communication conditions between the work aircraft 1000 and the data acquisition base system 2000 via the communication satellite 4000 are better than the specified conditions, and if they are better than the specified conditions, the process transitions to processing step 608, and if they are worse than the specified conditions, the process transitions to processing step 612 (step 607).
[0198] Next, if it is determined in processing step 607 that the conditions are better than the predetermined conditions, the relay aircraft unnecessary determination unit 2143 determines to notify the work aircraft 1000 that mission priority flight is possible, and notifies the work aircraft 1000 via the communication infrastructure management system (step 608). Here, mission priority flight does not mean that the work aircraft 1000 prioritizes flying within a flight area where it can communicate with the relay aircraft 3000, but rather that it prioritizes flight that prioritizes the execution of the work task assigned to the work aircraft 1000, ignoring the flight area where it can communicate with the relay aircraft 3000. For example, if the work task assigned to the work aircraft 1000 is aerial photography of the target area, it means flying in a flight mission that can most efficiently carry out the aerial photography.
[0199] Next, the relay aircraft unnecessary determination unit 2143 notifies the user that operation of the relay aircraft is unnecessary (step 609). Here, this notification can be output to the display unit 2241 of the aircraft flight operating system 2200 to notify the user who is remotely controlling the aircraft. Alternatively, instead of notifying the user, a return command may be output from the flight control command unit 2250 to the relay aircraft, so that the return operation of the relay aircraft is performed automatically.
[0200] Next, the repeater unnecessary determination unit 2143 determines that the work aircraft should fly in an airspace area where the wireless communication conditions with the communication satellite 4000 are better than predetermined conditions, and the flight area setting unit 2210 of the aircraft flight operating system 2200 sets that airspace area as the flight area for the work aircraft (step 610). Based on the set flight area, a flight geofence and flight mission are generated by the aircraft flight operating system 2200.
[0201] Next, the control communication unit 2150 and the measurement data communication unit 2160 switch at least one of the control communication and the measurement data communication to wireless communication via the communication satellite instead of the relay aircraft (step 606).
[0202] Next, if it is determined in step 607 that the conditions are worse than the predetermined conditions, the wireless communication relay via the relay aircraft 3000 is continued (step 612).
[0203] The communication means switching method shown in this flowchart is not limited to the method of switching communication means currently used for control communication or measurement data communication, but can also be applied to monitoring the status of redundant communication means for backup and switching communication means.
[0204] (A-1-19. Redundant communication system using multiple communication methods) Next, an example of communication redundancy using multiple communication means will be described. This is an explanatory diagram showing an example of redundancy when communication redundancy is performed using multiple communication means. The example shown in Figure 27 shows an example of multiple redundancy in which communication means via a communication satellite is the main communication means actually used, communication means via a terrestrial LTE line and a relay aircraft is the first redundant system, and direct communication (using the 2.4 GHz frequency band) and communication means via a relay aircraft is the second redundant system.
[0205] 27 may be applied to the communication means for control communication, the communication means for measurement data communication, or both. Furthermore, when applying redundancy to the communication means for measurement data communication, it is desirable to select a communication means with a sufficiently high communication speed for the amount of measurement data. The radio frequency band used for wireless communication between the relay aircraft and the work aircraft and the radio frequency band used for wireless communication between the relay aircraft and the data acquisition base system may be different frequency bands.
[0206] (A-1-20. Embodiments for operating multiple work aircraft or field devices) Next, an embodiment in which multiple work aircraft or field devices are operated will be described. Figure 28 is a diagram showing the overall configuration of a modified example of a relay system 1 according to an embodiment of the present invention. This diagram shows an example in which multiple work aircraft (1001, 1002) and a mobile terminal device 7000 transmit and receive control information, measurement data, etc. to and from a data acquisition base system 2000 via a common relay aircraft 3000.
[0207] Here, the data acquisition base system transmits control information such as movement or measurement commands to the multiple work aircraft (1001, 1002) and the mobile terminal device 7000, and receives measurement data from the multiple work aircraft (1001, 1002) at the site and the mobile terminal device 7000. The work aircraft of the present invention can be either manned or unmanned, but in an embodiment in which multiple work aircraft (1001, 1002) are operated as shown in this figure, it is more cost-effective to configure the work aircraft as an unmanned aircraft.
[0208] Furthermore, although it is possible to fly multiple relay aircraft 3000, it is preferable to have a single relay aircraft 3000 relay communication with multiple work aircraft 1000, as shown in this figure. In this case, the relay aircraft 3000 will need to relay large amounts of measurement data from multiple work aircraft 1000, requiring a large relay device. Furthermore, since it takes time to transmit large amounts of measurement data to the data acquisition base system, it is preferable to install a workstation as the measurement data processing unit 3600 of the relay aircraft 3000 and perform data processing of the measurement data within the relay aircraft. In this case, it is preferable to configure the relay aircraft 3000 as a manned aircraft that can be equipped with a large relay device and workstation.
[0209] In addition, since it takes time to transmit large amounts of measurement data to the data acquisition base system, by distributing and transmitting a portion of the measurement data transmitted from the relay aircraft 3000 to the data acquisition base system 2000 via communication means via the communication satellite 4000 or communication means via the air traffic control system 5000, the transmission time for transmitting large amounts of measurement data to the data acquisition base system can be shortened.
[0210] [A-2. Effects of this embodiment] According to this embodiment, it is possible to improve communication performance by using a relay aircraft for wireless communication relay.
[0211] The present invention is not limited to the above-described embodiment, and it goes without saying that various configurations can be adopted based on the contents of the present specification.
[0212] The series of processes described in connection with the above embodiment may be realized using software, hardware, or a combination of software and hardware. A computer program for realizing each function of the relay system 1 according to this embodiment may be created and installed on a PC or the like. A computer-readable recording medium storing such a computer program may also be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a flash memory. The above computer program may also be distributed, for example, via a communication network NW without using a recording medium.
[0213] The flowcharts used in the above embodiments do not necessarily have to be executed in the order shown in the drawings. Some processing steps may be executed in parallel. In addition, additional processing steps may be employed, and some processing steps may be omitted. [Explanation of symbols]
[0214] 1...Relay system (aviation data sensing system) 100...input device 200...output device 300...Processing device 400...Main storage device 500...Auxiliary storage device 600...Communication device 700...bus 1000...Work aircraft 1100...Flight unit 1110...Self-position measurement unit 1120: Attitude measurement unit 1130: Flight control unit 1140...Remote control camera 1150...Remote control microphone 1200... Measuring unit 1210... Measurement sensor 1210 1220: Sensor attitude control unit 1230: Sensor control unit 1300...Control communication unit 1400...Measurement data communication unit 1500: Communication state determination unit 1510: Communication strength determination unit 1520…Communication speed determination unit 1600: Measurement data processing section 1700...Data recording unit 1710...Measurement data recording unit 1720: Communication status recording unit 1730: Post-processing data recording unit 2000...Data acquisition base system 2100...Communication Infrastructure Management System 2110...Communication means candidate acquisition unit 2120: Communication state determination unit 2121: Communication strength determination unit 2122…Communication speed determination unit 2130: Communication means determination unit 2131: Control communication means determination unit 2132...Measurement data communication means determination unit 2140... relay aircraft use determination unit 2141... relay position determination unit 2142: Repeater addition necessity determining unit 2143: Repeater unnecessary determining unit 2150: Control communication unit 2160: Measurement data communication unit 2200...Aircraft Operation System 2210...Flight area setting section 2220...Flight geofence setting section 2230...Flight Mission Setting Department 2240...Remote control unit 2241...Display unit 2242...Audio output unit 2243...Operation command input unit 2250...Flight Control Command 2300...Acquisition data management system 2310...Measurement data recording unit 2320...Defective data determination unit 2330...Data transmission determination unit 2400...Flight Management System 2500...Airspace monitoring system 3000...Relay aircraft 3100...Flight unit 3110...Self-position measurement unit 3120: Attitude measurement unit 3130: Flight control unit 3140...Remote control camera 3150...Remote control microphone 3300...Control and communication unit 3400... relay communication unit 3410... control information relay communication unit 3420...Measurement data relay communication unit 3500: Communication state determination unit 3510: Communication strength determination unit 3520…Communication speed determination unit 3600: Measurement data processing section 3700...Data recording unit 3710...Relay measurement data recording unit 3720: Communication status recording unit 3730: Post-processing data recording unit 4000…Communications satellite 5000...Air traffic control system 5100...Control and Communications Department 5200...Relay information communication unit 5210...Control information relay communication unit 5220...Measurement data relay communication unit 5300: Flight Control Unit 5310: Aircraft Status Acquisition Unit 5320…Control command generation unit 6000...Spatial information data utilization system 7000...Mobile terminal device
Claims
1. a relay aircraft that relays wireless communications between a field device that performs measurement work or other work in a work area and a base system; a relay aircraft control unit that controls the flight of the relay aircraft or outputs flight control commands; an airspace communication status determination unit that determines a communication status including at least one of communication strength and communication speed for each airspace area; The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication status meets specified conditions, or outputs the flight control command to fly through the airspace area.
2. The relay system according to claim 1, The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication strength determined by the airspace communication status determination unit is stronger than a predetermined value, or outputs the flight control command to fly the relay aircraft through the airspace area.
3. The relay system according to claim 1, When the amount of measurement data measured by the field device is greater than a predetermined value or is expected to be greater than a predetermined value, The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication speed determined by the airspace communication status determination unit is faster than a predetermined value, or outputs the flight control command to fly the relay aircraft through the airspace area.
4. The relay system according to claim 1, When the communication strength or communication speed or both determined by the airspace communication state determination unit do not satisfy a predetermined condition, A relay system in which the relay aircraft control unit controls the flight of the relay aircraft to increase the altitude of the relay aircraft, or outputs the flight control command to increase the altitude.
5. The relay system according to claim 1, When the wireless communication distance between the relay aircraft and the on-site device, or the wireless communication distance between the relay aircraft and the base system, becomes longer than a predetermined distance, or is expected to become longer than a predetermined distance, A relay system in which the relay aircraft control unit controls the flight of the relay aircraft to increase the altitude of the relay aircraft, or outputs the flight control command to increase the altitude.
6. The relay system according to claim 1, A relay system that starts wireless communication relay by the relay aircraft when the communication strength or communication speed between the field device and the base system before wireless communication relay by the relay aircraft becomes lower than a predetermined value.
7. The relay system according to claim 1, A relay system that starts wireless communication relaying by the relay aircraft or determines the number of relay aircraft that will start wireless communication relaying when the communication speed between the field device and the base system before wireless communication relaying by the relay aircraft is expected to be lower than a reference speed corresponding to the amount of measurement data measured by the field device.
8. The relay system according to claim 1, A relay system that, before performing wireless communication relay by the relay aircraft, starts wireless communication relay by the relay aircraft or determines the number of relay aircraft that will start wireless communication relay if the future distance between the field device and the base system based on the planned movement position of the field device is predicted to be longer than a predetermined distance.
9. The relay system according to claim 1, If abnormality information of ground infrastructure facilities including ground communication facilities or power facilities is acquired before the wireless communication relay by the relay aircraft is performed, the wireless communication relay by the relay aircraft is started; The relay aircraft control unit controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area surrounding the ground infrastructure facility having an abnormality, or outputs the flight control command to fly through the airspace area.
10. The relay system according to claim 1, A relay system comprising a relay communication status monitoring unit that monitors at least one of a first communication status including communication strength or communication speed between the relay aircraft and the field device, and a second communication status including communication strength or communication speed between the relay aircraft and the base system.
11. The relay system according to claim 10, A relay system in which, when either the communication strength or the communication speed in the first communication state or the second communication state does not satisfy a specified condition, an additional relay aircraft, a second relay aircraft, is flown to perform wireless communication relay using multiple relay aircraft.
12. The relay system according to claim 11, A relay system that determines the flight area of the second relay aircraft depending on at least one of the first communication state and the second communication state, and controls the flight of the second relay aircraft so that the second relay aircraft flies in the flight area, or outputs a flight control command to fly the second relay aircraft in the flight area.
13. The relay system according to claim 12, When the communication strength of the first communication state is lower than a predetermined value, the second relay aircraft is flown in an airspace area between the relay aircraft and the on-site device, and a series relay is performed by the relay aircraft and the second relay aircraft; Alternatively, a relay system in which, when the communication strength of the second communication state is lower than a predetermined value, the second relay aircraft is flown in the airspace area between the relay aircraft and the base system, and a series relay is performed by the relay aircraft and the second relay aircraft.
14. The relay system according to claim 12, When the communication speed of the first communication state is lower than a predetermined value, the second relay aircraft is flown in an airspace area between the relay aircraft and the on-site device, and a parallel relay is performed by the relay aircraft and the second relay aircraft; Alternatively, a relay system in which, when the communication speed of the second communication state is lower than a predetermined value, the second relay aircraft is flown in an airspace area between the relay aircraft and the base system, and parallel relay is performed by the relay aircraft and the second relay aircraft.
15. The relay system according to claim 1, A relay system in which, when the distance between the relay aircraft and the on-site device is longer than a predetermined distance, or when it is expected that the distance will become longer than the predetermined distance in the future, an additional relay aircraft, a second relay aircraft, is flown to perform wireless communication relay using multiple relay aircraft.
16. The relay system according to claim 10, A relay system that switches wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication that does not go through the relay aircraft when the communication strength and communication speed in the first communication state and the second communication state satisfy specified conditions and the field device and the base system are within a distance range where they can communicate directly.
17. The relay system according to claim 1, A relay system that, when switching wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication not via the relay aircraft, moves the field device within a distance range where direct communication with the base system is possible, outputs a movement command to move the field device within said distance range, or outputs a flight mission to move a work aircraft carrying the field device within said distance range.
18. The relay system according to claim 1, A relay system that, when it is possible to move the field device within a distance range where the field device and the base system can directly communicate, moves the field device within that distance range, outputs a movement command to the field device to move the field device within that distance range, or outputs a flight mission to move a work aircraft carrying the field device within that distance range.
19. The relay system according to claim 1, A relay system that switches wireless communication between the field device and the base system from wireless communication using relay by the relay aircraft to wireless communication using relay by the communication satellite when the field device is capable of communicating with a communication satellite.
20. The relay system according to claim 1, A relay system that generates a relay flight geofence to limit the flight area of the relay aircraft when the relay aircraft begins flying a wireless communication relay.
21. 21. The relay system according to claim 20, the in-situ device is mounted on a measurement aircraft; A relay system in which at least a portion of the relay flight geofence is generated within an area enclosed by the measurement flight geofence generated for the measurement aircraft.
22. 21. The relay system according to claim 20, A relay system that transmits information about the generated relay flight geofence to an airspace control system that controls the airspace in which the relay flight geofence was generated.
23. The relay system according to claim 1, The relay aircraft includes a measurement data recording unit that records the measurement data received from the on-site device, A relay system in which the relay aircraft receives the measurement data from the field device and records the measurement data in the measurement data recording unit when the relay aircraft is moved to a position closer to the field device than the base system, or when the communication state between the relay aircraft and the field device satisfies a predetermined condition.
24. The relay system according to claim 1, The relay aircraft includes a measurement data recording unit that records the measurement data received from the on-site device, A relay system that transmits the measurement data from the field device to the relay aircraft and records the received measurement data in the measurement data recording unit when the communication status between the relay aircraft and the base system does not satisfy a specified condition and the communication status between the relay aircraft and the field device satisfies a specified condition.
25. 25. The relay system according to claim 23 or 24, A relay system that moves the relay aircraft to an airspace area where the communication status between the relay aircraft and the base system satisfies specified conditions, and transmits the measurement data recorded in the measurement data recording unit in the airspace area from the relay aircraft to the base system.
26. 25. The relay system according to claim 23 or 24, A relay system that moves the relay aircraft to an airspace area where the communication status between the relay aircraft and a communication satellite satisfies specified conditions, and transmits the measurement data recorded in the measurement data recording unit in the airspace area from the relay aircraft to the base system via the communication satellite.
27. The relay system according to claim 1, A relay system in which the on-site device is mounted on an aircraft, vehicle, ship, other moving body, or portable mobile terminal device.
28. A relay method for relaying wireless communication between a field device that performs measurement work or other work in a work area and a base system using a relay aircraft, comprising: The computer an airspace communication state determination step of determining a communication state including at least one of communication strength and communication speed for each airspace area; a flight control step of controlling the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication state satisfies a predetermined condition, or outputting a flight control command to fly the relay aircraft through the airspace area; Execute the relay method.
29. A relay program that relays wireless communication between a field device that performs measurement work or other work in a work area and a base system using a relay aircraft, On the computer, an airspace communication state determination command for determining a communication state including at least one of communication strength and communication speed for each airspace area; a flight control command that controls the flight of the relay aircraft so that the relay aircraft flies through an airspace area where wireless communication with both the on-site device and the base system is possible and where the communication state satisfies a predetermined condition, or outputs a flight control command that causes the relay aircraft to fly through the airspace area; A relay program that executes the above.
Citation Information
Patent Citations
Communication relay method, relay flying body, program and recording medium
JP2019040514A