Aircraft operation support system and aircraft operation support method

Abstract

To provide a more simplified system regarding navigation management and support regarding a flying object.SOLUTION: A flying object navigation support system comprises: a flying object navigation management device comprising a guidance information generation unit which generates guidance information showing a flight route for every space block sectioned by subdividing a flight space, and a communication unit which transmits the guidance information; and a flight support device comprising a guidance information output unit which outputs the guidance information to a predetermined device of a flying object.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an aircraft operation support system and an aircraft operation support method.

Background Art

[0002] Unmanned aircraft such as drones fly by autonomous navigation using a positioning system such as GPS (Global Positioning System) or manual operation by a remote operator. In addition, manned aircraft have their flights controlled by autonomous navigation or manual operation by the onboard pilot.

[0003] Regarding the flights of such unmanned and manned aircraft, in recent years, systems for controlling the operations of multiple aircraft from the ground have been proposed.

[0004] For example, Patent Document 1 describes flight route management control as follows: "The route management control server is communicably connected to a plurality of first aircraft via a network. The server includes storage means for storing location data including at least any one of map information, terrain information, or building information and route data based on three-dimensional coordinates, control means for reading out the location data and route data, and transmission means for transmitting the read location data and route data to each of the first aircraft."

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the airspace where the aircraft flies, there is no physically laid "road" such as a ground road or railway line. Therefore, when attempting to control the traffic of aircraft by manual operation, for example, a method of indicating in some form the places to fly and the route directions, etc., like on the ground, can be considered. On the other hand, when attempting to control the traffic of aircraft by automatic operation, for example, a method of flying according to route information considering the position of the aircraft and the flight route, etc., can be considered.

[0007] Thus, it is assumed that the methods for controlling the traffic of aircraft are different between manual operation and automatic operation. Therefore, when controlling the traffic in the flight space where manually and automatically operated aircraft are mixed, different types of information are required depending on the operation method, and there is a concern that the system for managing the operation will become complicated. Therefore, it is desired to provide a more simplified operation system.

[0008] Although Patent Document 1 discloses a technique of displaying a flight route and traffic information on a display unit of an aircraft, it does not consider simplifying the system.

[0009] Therefore, the present invention relates to flight operation management and support for an aircraft, and aims to provide a more simplified system.

Means for Solving the Problems

[0010] This application includes a plurality of means for solving at least part of the above problems. For example, it is as follows. An aircraft flight support system according to an aspect of the present invention for solving the above problems includes a guidance information generation unit that generates guidance information indicating a flight route for each space block partitioned by subdividing the flight space, and a communication unit that transmits the guidance information, and an aircraft flight management device, and a flight support device including a guidance information output unit that outputs the guidance information to a predetermined device of the aircraft.

[0011] Further, the guidance information generation unit may generate image information for visualizing the flight route as the guidance information, and the guidance information output unit may display the guidance information superimposed on the scenery seen from above.

[0012] Further, the guidance information generation unit may generate voice information indicating the flight route as the guidance information, and the guidance information output unit may output the guidance information to an output device mounted on the aircraft.

[0013] Further, when the aircraft is controlled by automatic piloting, the flight support device may further include a guidance information analysis unit that analyzes the guidance information and outputs an instruction signal regarding control so that the aircraft flies along the flight route indicated by the guidance information according to the analysis result.

[0014] Further, it may further include a guidance information analysis unit that compares different types of the guidance information and detects a discrepancy in the flight route. The guidance information generation unit generates image information for visualizing the flight route and voice information indicating the flight route as the guidance information. The guidance information output unit outputs the guidance information to a predetermined device of the aircraft, and the guidance information analysis unit detects a discrepancy in the flight route indicated by the image information and the voice information.

[0015] Further, the guidance information generation unit may generate guidance information in which at least one piece of information among flight speed, altitude band, advertisement, and cautionary matters is added to the guidance information.

[0016] Further, an aircraft operation support method according to an aspect of the present invention is an aircraft operation support method executed by an aircraft operation management device and a flight support device. The aircraft operation management device performs a guidance information generation step of generating guidance information indicating a flight route for each space block partitioned by subdividing a flight space, and a communication step of transmitting the guidance information. The flight support device performs a guidance information output step of outputting the guidance information to a predetermined device of the aircraft.

Effect of the Invention

[0017] According to the present invention, it is possible to provide a more simplified system for flight operation management and support related to an aircraft.

[0018] In addition, problems, configurations, effects, etc. other than the above will be clarified by the description of the following embodiments.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0020] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0021] <First Embodiment> FIG. 1 is a diagram showing an example of the outline of the aircraft operation support system 1000 according to the present embodiment. The aircraft operation support system 1000 is a system that manages and supports the operation of the aircraft AM. Note that the aircraft AM is a manned or unmanned aircraft, and is an air mobility such as a helicopter or an airplane, for example.

[0022] As shown in the figure, the aircraft operation support system 1000 subdivides the upper flight space into mesh-like space blocks, and manages and supports the operation of the aircraft AM that has received such information by transmitting information such as the visualization of the flight route according to the space block in which the aircraft is located.

[0023] Such an aircraft operation support system 1000 includes an aircraft operation management device 100 and a flight support device 200 (see FIG. 2). The aircraft operation management device 100 is a device that manages the operation of the aircraft AM, constantly grasps in which space block the aircraft AM is located, and generates guidance information for visualizing the flight route according to the space block in which the aircraft AM is located.

[0024] The flight support device 200 is a device that supports the operation of the aircraft AM and is mounted on the aircraft AM. The flight support device 200 receives the guidance information transmitted from the aircraft operation management device 100 and performs various processes such as visualizing and displaying the flight route.

[0025] FIG. 2 is a block diagram showing an example of the functional configuration of the aircraft operation management device 100 and the flight support device 200. As shown in the figure, the aircraft operation management device 100 includes a storage unit 110, a processing unit 120, and a communication unit 130.

[0026] The storage unit 110 is a functional unit that stores various information used for the processing of the aircraft operation management device 100. Specifically, the storage unit 110 includes space information 111, operation management information 112, and guidance information 113.

[0027] FIG. 3 is a diagram showing an example of the spatial information 111. As shown in the figure, the spatial information 111 is information regarding each spatial block partitioned by subdividing the flight space in the sky into a mesh-like pattern. Specifically, the spatial information 111 has records in which a spatial block ID 111a, an altitude band 111b, and a coordinate range 111c indicating latitude, longitude, and altitude are associated with each other.

[0028] Note that the spatial block ID 111a is information for identifying each spatial block. The altitude band 111b is information for identifying the altitude band to which the spatial block belongs, as shown in FIG. 4 (a diagram showing an example of the altitude band of a spatial block). There are a plurality of altitude bands in the altitude band 111b, such as an altitude A band, an altitude B band, and an altitude C band, for example, in ascending order from near the ground (in ascending order of altitude). The coordinate range 111c is information indicating the coordinate range of latitude, longitude, and altitude showing the partition range of each spatial block.

[0029] FIG. 5 is a conceptual diagram showing an example of a spatial block. As shown in the figure, the spatial block is a rectangular parallelepiped space defined by the spatial block ID 111a registered in the spatial information 111, the altitude band 111b, and the coordinate range 111c. The spatial block is set so that one side has a predetermined length (for example, several tens of meters to several hundreds of meters) according to the coordinate range of latitude, longitude, and altitude.

[0030] The aircraft operation management device 100 manages the operation of the aircraft AM in units of spatial blocks. That is, the aircraft operation management device 100 constantly grasps (manages) the spatial block in which the aircraft AM is located, and generates guidance information 113 according to the spatial block in which the aircraft AM is located.

[0031] That is, conceptually, it can also be considered that the spatial information 111, information for identifying the aircraft AM on the flight route including the spatial block, and guidance information 113 (image information or voice information) such as the route direction and traffic lane showing the flight route viewed from the spatial block are associated with each spatial block.

[0032] In this way, by managing the flight space in units of space blocks, the current position and flight route of the flying object AM can be conceptually managed. Therefore, for example, compared to the case of managing the position and flight route of the flying object AM based on coordinate positions, the system for operating and supporting the flying object AM can be simplified more.

[0033] FIG. 6 is a diagram showing an example of the operation management information 112. The operation management information 112 is information for managing the operation of the flying object AM. Specifically, the operation management information 112 has records in which a flying object ID 112a, a flight route 112b, and the current position 112c of the flying object AM indicated by a coordinate position and a space block ID are associated with each other.

[0034] Note that the flying object ID 112a is information for identifying the flying object AM. The flight route 112b is information indicating the flight route by the transition of the space block IDs to be flown. The current position 112c is information indicating the current position of the flying object AM by a coordinate position and a space block ID. The coordinate position is a coordinate position indicated by latitude, longitude, and altitude, and the position information regularly (for example, every 1 second) acquired from the flight support device 200 is registered. The space block ID is the space block ID where the flying object AM is located, and the space block ID specified based on the coordinate position is registered.

[0035] Such operation management information 112 is updated by the flight position management unit each time the position information of the flying object AM is acquired from the flight support device 200.

[0036] The guidance information 113 is information indicating guidance for supporting flight, and is AR (Augmented Reality) image information indicating the course direction and traffic lane of the flight route. Specifically, the guidance information 113 is AR image information for visualizing the course direction and traffic lane of the flight route when viewed from the flying object AM flying in a certain space block, and is displayed superimposed on the video captured by the camera of the flying object AM by the flight support device 200. Note that the guidance information 113 is generated by the guidance information generation unit 124.

[0037] FIG. 7 is a diagram showing an example of the AR image information that is the guidance information 113. As shown in the drawing, the AR image information is image information showing the route direction 300 and the traffic lane 310 for each space block included in the flight route. Further, the AR image information corresponding to the space blocks that are the departure point and the destination point includes image information or character information indicating that those space blocks are the departure point or the destination point (not shown). Note that, as shown in the drawing, the AR image information may include a boundary line 320 between the space block where the flying object AM is located and other space blocks in order to assist manual operation.

[0038] The processing unit 120 is a functional unit that performs various arithmetic processes executed in the flying object operation management device 100. Specifically, the processing unit 120 includes an information acquisition unit 121, a flight position management unit 122, a flight route calculation unit 123, and a guidance information generation unit 124.

[0039] The information acquisition unit 121 is a functional unit that acquires information from an external predetermined device. Specifically, the information acquisition unit 121 acquires the position information of the flying object AM and an execution instruction for a predetermined process (for example, the flight support process described later) from the flight support device 200 via the communication unit 130.

[0040] The flight position management unit 122 is a functional unit that manages the flight position of the flying object AM. Specifically, the flight position management unit 122 periodically (for example, every 1 second) specifies the current position of the flying object AM using the position information acquired from the flight support device 200. Further, the flight position management unit 122 registers information regarding the specified current position in the operation management information 112.

[0041] More specifically, the flight position management unit 122 identifies the space block ID corresponding to the current position of the flying object based on the coordinate position indicating the latitude, longitude, and altitude included in the position information acquired from the flight support device 200. Further, the flight position management unit updates the operation management information 112 by registering the coordinate position included in the position information and the identified space block ID in association with the identification information (flying object ID) of the flying object AM from which the position information was acquired in the operation management information 112.

[0042] The flight route calculation unit 123 is a functional unit that calculates the flight route of the flying object AM. Specifically, when the flight route calculation unit 123 acquires information regarding the departure point and destination point of the flying object AM (for example, coordinate information of latitude and longitude indicating the departure point and destination point, or spot information where takeoff and landing are possible), it calculates the flight route connecting the departure point and the destination point. Note that the flight route calculation unit 123 calculates the flight route using a known route calculation method, such as a flight route with the minimum number of space blocks to pass through and the minimum number of right and left turns. Further, the flight route calculation unit 123 may calculate the flight route of the target flying object AM in consideration of the flight routes and flight altitude bands of other flying objects AM.

[0043] The guidance information generation unit 124 is a functional unit that generates guidance information 113 for supporting the flight of the flying object AM. Specifically, as shown in FIG. 7, the guidance information generation unit generates the guidance information 113, which is AR image information for visualizing the route direction and traffic lane for each space block included in the flight route and can be overlaid on the video information captured by the camera of the flying object AM by the flight support device 200 and displayed.

[0044] Further, when the guidance information generation unit 124 generates the guidance information 113 corresponding to the space blocks that are the departure point and the destination point, it generates AR image information including image information or character information indicating that these space blocks are the departure point or the destination point.

[0045] Note that the guidance information generation unit 124 may generate AR image information including the boundary line 320 between the space block where the flying object AM is located and other space blocks.

[0046] In addition, the guidance information generation unit 124, via the communication unit 130, sets the AR image information from the space block where the flying object AM is currently located to a certain number of spaces (for example, 3 to 10 spaces) in each of the front, back, left, and right directions as one set, and associates the flying object ID of the flying object AM to be transmitted with this, and transmits the guidance information 113 to the flight support device 200.

[0047] The communication unit 130 is a functional unit that performs information communication with an external device. Specifically, the communication unit 130 acquires position information indicating the current position of the flying object AM from the flight support device 200. In addition, the communication unit 130 acquires an execution instruction for flight support processing from the flight support device 200. In addition, the communication unit 130 transmits the guidance information 113 to the flight support device 200.

[0048] Note that the communication unit 130 may directly perform wireless communication with the communication unit 130 of the flight support device 200, or may perform wireless communication with the flight support device 200 via a ground relay base station (radio tower) connected via a predetermined network N such as the Internet.

[0049] Next, an example of the functional configuration of the flight support device 200 will be described. As shown in FIG. 2, the flight support device 200 includes a storage unit 210, a processing unit 220, and a communication unit 230.

[0050] The storage unit 210 is a functional unit that stores various information used for the processing of the flight support device 200. Specifically, the storage unit 210 stores the guidance information 113 acquired from the flying object operation management device 100 via the communication unit 230.

[0051] The processing unit 220 is a functional unit that performs various processes executed by the flying object AM. Specifically, the processing unit 220 includes an input reception unit 221, a position identification unit 222, a guidance information output unit 223, and a guidance information analysis unit 224.

[0052] The input reception unit 221 is a functional unit that receives instructions or information input from a user who is a passenger of the aircraft AM via an input device provided in the aircraft AM. Specifically, the input reception unit 221 receives, via the input device, input of information indicating a departure point and a destination point. Note that the departure point may be coordinate information indicating the current position of the aircraft AM, or may be the name of the nearest spot point where takeoff is possible. Similarly, the destination point may be coordinate information or the name of the nearest spot point where landing is possible near the destination.

[0053] In addition, the input reception unit 221 receives an execution instruction for flight support processing from the user via the input device. Further, the input reception unit 221 associates its own aircraft ID with an execution instruction for flight support processing including the information of the departure point and the destination point for which the input has been received, and transmits the same to the aircraft operation management device 100 via the communication unit 230.

[0054] The position identification unit 222 is a functional unit that identifies the current position of the aircraft AM. Specifically, the position identification unit 222 periodically (for example, every second) identifies the coordinate positions of latitude, longitude, and altitude indicating the current position of the aircraft AM using output information from a GPS reception device and an altimeter mounted on the aircraft AM. Further, the position identification unit 222 transmits, via the communication unit 230, position information including its own aircraft ID of the aircraft AM and the identified coordinate positions to the aircraft operation management device 100.

[0055] The guidance information output unit 223 is a functional unit that outputs guidance information 113. Specifically, when the guidance information output unit 223 acquires the guidance information 113 via the communication unit 230, it determines whether the guidance information 113 is the guidance information 113 for its own aircraft based on the aircraft ID included in the guidance information 113. Further, when the guidance information output unit 223 determines that the guidance information 113 is for its own aircraft, it superimposes the guidance information 113 (AR image information) on the video captured by a camera mounted on the aircraft AM and displays the same on the display device of the aircraft AM.

[0056] Further, after displaying the guidance information 113, the guidance information output unit 223 transmits a request for acquiring the guidance information 113 to be displayed when moving to the next space block on the flight route via the communication unit 230, associated with its own aircraft ID, to the aircraft operation management device 100.

[0057] The guidance information analysis unit 224 is a functional unit that analyzes the content of the guidance information 113 and performs processing according to the analysis result. Specifically, the guidance information analysis unit 224 analyzes the AR image information, which is the guidance information 113, and determines whether the image information or character information indicating the destination is included.

[0058] In addition, when the aircraft AM is flying by automatic pilot (for example, when the automatic pilot mode is set in the aircraft AM), the guidance information analysis unit 224 outputs an instruction signal to a control device (not shown) that controls the flight so that the aircraft AM flies inside the traffic lane and automatic pilot is performed according to the course direction, based on the image analysis result of the AR image information.

[0059] The communication unit 230 is a functional unit that performs information communication with an external device. Specifically, the communication unit 230 transmits an instruction to execute flight support processing, the position information of the aircraft AM, and a request for acquiring the guidance information 113 to the aircraft operation management device 100. In addition, the communication unit 230 acquires the guidance information 113 from the aircraft operation management device 100.

[0060] Note that the communication unit 230 may directly perform wireless communication with the communication unit 130 of the aircraft operation management device 100, or may perform wireless communication with the aircraft operation management device 100 via a ground relay base station (radio tower) connected via a predetermined network N such as the Internet.

[0061] The above is an example of the functional configuration of the aircraft operation management device 100 and the flight support device 200.

[0062] [Description of Operations] FIG. 8 is a flowchart showing an example of flight support processing. Such processing starts when the aircraft operation management device 100 acquires an execution instruction for flight support processing from the flight support device 200.

[0063] When the processing starts, the flight route calculation unit 123 calculates a flight route (step S001). Specifically, the flight route calculation unit 123 calculates a flight route connecting the departure point and the destination point included in the execution instruction for flight support processing. Further, the flight route calculation unit 123 specifies a record of the operation management information 112 associated with the aircraft ID included in the acquired execution instruction, and registers a space block ID indicating the calculated flight route in the operation management information 112.

[0064] Next, the guidance information generation unit 124 determines whether the aircraft AM has reached the flight start point (step S002). Specifically, the guidance information generation unit 124 refers to the operation management information 112 and specifies a space block ID corresponding to the current position of the aircraft AM. Further, the guidance information generation unit 124 determines whether the specified space block ID matches the first space block ID registered in the flight route. If it is determined that they do not match (No in step S002), the guidance information generation unit 124 executes the processing of step S002 again. On the other hand, if it is determined that they match (Yes in step S002), the guidance information generation unit 124 proceeds to step S003.

[0065] In step S003, the guidance information generation unit 124 generates guidance information 113. Specifically, the guidance information generation unit 124 generates AR image information for visualizing the route direction and the traffic lane for each space block included in the flight route.

[0066] Next, the guidance information generation unit 124 transmits the guidance information 113 (step S004). Specifically, the guidance information generation unit 124 generates, as the guidance information 113, AR image information for visualizing the route direction and the traffic lane up to a predetermined number of space blocks ahead, starting from the space block where the flying object AM on the flight route is currently located, and transmits it with the flying object ID of the transmission destination associated therewith.

[0067] Next, the communication unit 230 of the flight support device 200 acquires the guidance information 113 transmitted from the flying object operation management device 100 (step S005). Also, the guidance information output unit 223 outputs the guidance information 113 (step S006). Specifically, the guidance information output unit 223 of the flight support device 200 determines whether the guidance information 113 is for its own flying object based on the flying object ID included in the guidance information 113. Further, when the guidance information output unit 223 determines that the guidance information 113 is for its own flying object, it acquires the video imaged by the camera mounted on the flying object, and overlays the AR image information indicating the route direction and the traffic lane indicating the flight route on this video and displays it on the display device of the flying object AM.

[0068] FIG. 9 is a diagram showing an example of a screen displayed on the display device of the flying object AM. As shown in the figure, on the display device, the AR image information in which the route direction 300 and the traffic lane 310 indicating the flight route are visualized is overlaid and displayed on the video of the scenery seen from above, such as the building 330 imaged by the camera.

[0069] In this way, the flight support device 200 visualizes the route direction and the traffic lane indicating the flight route and overlays and displays them on the video showing the scenery seen from above. Thereby, the crew (user) performing manual operation can operate the flying object AM with reference to the video including the displayed guidance information 113.

[0070] Next, the guidance information analysis unit 224 determines whether the flight is by manual operation (step S007). For example, the guidance information analysis unit 224 determines whether the flight is by manual operation according to the mode setting of manual operation or automatic operation. And when it is determined that the flight is by manual operation (Yes in step S007), the guidance information analysis unit 224 proceeds to step S008. On the other hand, when it is determined that the flight is not by manual operation (No in step S007), the guidance information analysis unit 224 proceeds to step S011.

[0071] In step S008 where it proceeds when it is determined that the flight is by manual operation (Yes in step S007), the guidance information analysis unit 224 determines whether the flying object AM has reached the destination. Specifically, the guidance information analysis unit 224 performs image analysis on the output guidance information 113, and determines that the destination has been reached when the image information or character information indicating the destination is included in the space block where the flying object AM is currently located.

[0072] And when it is determined that the flying object AM has reached the destination (Yes in step S008), the guidance information analysis unit 224 ends the processing of this flow. On the other hand, when it is determined that the destination has not been reached (No in step S008), the guidance information analysis unit 224 proceeds to step S009.

[0073] In step S009, the guidance information output unit 223 sends a request to acquire the guidance information 113. Specifically, the guidance information output unit 223 sends a request to acquire the guidance information 113 to be displayed when moving to the next space block on the flight route to the flying object operation management device 100 via the communication unit 230.

[0074] When the guidance information generation unit 124 of the aircraft operation management device 100 acquires a request to acquire the guidance information 113 via the communication unit 130, it determines whether the aircraft AM is near the next space block (step S010). Specifically, the guidance information generation unit 124 calculates the distance from the aircraft AM to the next space block on the flight route based on the coordinate position indicating the current position registered in the operation management information 112, and determines whether such distance is within a predetermined distance (for example, within several tens of meters).

[0075] And when it is determined that the distance is not within the predetermined distance (No in step S010), the guidance information generation unit 124 executes the process of step S010 again. On the other hand, when it is determined that the distance is within the predetermined distance (Yes in step S010), the guidance information generation unit 124 shifts the process to step S003 and generates the guidance information 113 to be output when the aircraft AM moves to the next space block.

[0076] In addition, in the process of step S011 where the process proceeds when it is determined that the flight is not by the above-described manual operation (No in step S007), the guidance information analysis unit 224 analyzes the output guidance information 113 by image analysis and specifies the route direction and the position of the traffic lane in the space block where the aircraft AM is located. Further, the guidance information analysis unit 224 outputs an instruction signal for controlling the flight based on the analysis result of the guidance information 113 (step S012). Specifically, the guidance information analysis unit 224 outputs an instruction signal based on the analysis result to a control device (not shown) that controls the flight so that the aircraft AM flies inside the traffic lane and automatic flight is performed according to the route direction. Also, when outputting an instruction signal for automatic flight, the guidance information analysis unit 224 shifts the process to step S008.

[0077] The flight support process by the aircraft operation support system has been described above. According to such an aircraft operation management device and flight support device, it is possible to provide a more simplified system for operation management and support regarding the aircraft AM. In particular, since the flight space is managed in units of space blocks and information for flight support can be shared regardless of whether it is manual operation or automatic operation, it is possible to provide a more simplified aircraft operation support system.

[0078] <Second Embodiment> In the first embodiment, AR image information indicating the route direction and passing zone of the flight route was generated as the guidance information 113, and flight was supported using such guidance information 113. However, the present invention is not limited to this. The aircraft operation support system 1000 of the second embodiment generates voice information indicating the route direction and passing zone of the flight route as the guidance information 113. Further, the flight support device 200 outputs the acquired voice information as the guidance information 113.

[0079] The characteristic processing of each functional unit according to this embodiment will be described in detail with reference to FIG. 8. Note that the description of the same processing as in the first embodiment will be omitted.

[0080] In step S003, the guidance information generation unit 124 generates voice information indicating the route direction and passing zone in the space block where the aircraft AM on the flight route is currently located as the guidance information 113. Specifically, the guidance information generation unit 124 generates voice information indicating the route direction, such as "Please go straight" or "Please turn right (left)". Further, the guidance information generation unit 124 generates voice information indicating the passing zone, such as "Please fly a little more on the right (left) side".

[0081] Note that when the aircraft reaches the space blocks that are the departure point and the destination point, the guidance information generation unit 124 generates the guidance information 113 including voice information (such as "Arrived at the departure point (destination point)") indicating that those space blocks are the departure point or the destination point respectively.

[0082] Also, in step S006, the guidance information output unit 223 outputs the voice information, which is the guidance information 113 acquired from the aircraft operation management device 100, to an output device such as a speaker that the aircraft AM has. Since the route direction indicating the flight route and the traffic lane can be recognized based on such voice information, the crew (user) performing manual operation can operate the aircraft AM with reference to the output guidance information 113.

[0083] Also, in step S011, the guidance information analysis unit 224 analyzes the output voice information by voice recognition. Further, in step S012, the guidance information analysis unit 224 outputs an instruction signal for controlling the automatic operation of the aircraft AM according to the analysis result of the guidance information 113, that is, the result of voice recognition.

[0084] Also, in step S008, the guidance information analysis unit 224 performs voice recognition using the output guidance information 113, and determines that the aircraft has reached the destination when the voice information indicating that the space block where the aircraft AM is currently located is the destination is included.

[0085] Also, in step S003 that shifts via step S010, the guidance information generation unit 124 generates the voice information output when the aircraft AM moves to the next space block as the guidance information 113.

[0086] In this way, also by the aircraft operation support system according to the present embodiment, the flight space can be managed in units of space blocks, and information for flight support can be shared regardless of whether it is manual operation or automatic operation, so that a simpler system for operation management and support related to the aircraft can be provided.

[0087] Note that the aircraft operation support system 1000 may generate the guidance information 113 including both the AR image information and the voice information as the guidance information 113, and the flight support device 200 may output both the AR image information and the voice information.

[0088] Also, in a form in which both AR image information and voice information are output as guidance information 113, the guidance information analysis unit 224 may perform an error check as to whether the route directions indicated by the image analysis result of the AR image information and the voice recognition result of the voice information match. According to such an error check, since it is possible to detect an error in which the route direction indicated by the AR image information and the route direction indicated by the voice information do not match, it becomes possible to perform control such as stopping the flying object AM at the time of error detection, and the flying object AM can be operated more safely.

[0089] Also, in a form in which both AR image information and voice information are output as guidance information 113, the voice information may be a beep sound for which a predetermined meaning is defined. The guidance information analysis unit 224 outputs an instruction signal for controlling the flying object AM based on the defined content for each type of beep sound.

[0090] Also, in the above-described embodiment, AR image information indicating the route direction and the traffic lane of the flight route is generated. However, in addition to these, for example, AR image information including at least any one of the flight speed, altitude band, advertisement, or cautionary matter (for example, speed limit, etc.) may be generated.

[0091] Also, in the above-described first embodiment, an example in which AR image information that is guidance information 113 is displayed on the display device included in the flying object AM has been described. However, the present invention is not limited to this, and the guidance information 113 may be displayed on goggles worn by the crew (user) of the flying object AM, or projected and displayed on the front glass. In any case, the guidance information 113 is displayed superimposed on the scenery visible through the goggles or the front glass.

[0092] Specifically, the flight support device 200 and the goggles are communicably connected, and the guidance information output unit 223 outputs AR image information that is guidance information 113 to the goggles. Also, when the guidance information 113 is projected and displayed on the front glass, the guidance information output unit 223 outputs the guidance information 113 to a predetermined device for realizing, for example, a head-up display.

[0093] In addition, the guidance information 113 may be displayed on the display device of the aircraft AM by superimposing the image (video) information obtained by processing the scenery seen from above a building or the like captured by the camera of the aircraft AM by a functional unit (not shown) of the flight support device 200 into an augmented reality (AR) image.

[0094] The present invention can also be applied to flight support of a small unmanned aircraft such as a drone. For example, when operating a drone using a control terminal such as a smartphone, a tablet terminal, or a dedicated controller, by outputting AR image information to the display unit of these terminals or outputting voice information to the speaker provided in the terminals, the same effects as those of the aircraft operation support system 1000 described above can be achieved. Note that in the control terminal, the same processing as that of each functional unit of the flight support device 200 may be realized by dedicated application software installed in advance.

[0095] Next, the hardware configurations of the aircraft operation management device 100 and the flight support device 200 will be described.

[0096] FIG. 10 is a diagram showing an example of the hardware configuration of the aircraft operation management device 100. The aircraft operation management device 100 is realized by a high-performance information processing device.

[0097] As shown in the figure, the aircraft operation management device 100 includes a processing device 410, a main storage device 420, an auxiliary storage device 430, a communication device 440, and a bus 450 that electrically interconnects these devices.

[0098] The processing device 410 is, for example, a CPU (Central Processing Unit). The main storage device 420 is a memory device such as a RAM (Random Access Memory) or a ROM (Read Only Memory).

[0099] The auxiliary storage device 430 is a non-volatile storage device such as a so-called hard disk drive (HDD), solid state drive (SSD), or flash memory that can store digital information.

[0100] The communication device 440 is a communication unit that performs wireless communication with an external device.

[0101] FIG. 11 is a diagram showing an example of the hardware configuration of the flight support device 200. The flight support device 200 is realized by a high-performance information processing device. Note that the flight support device 200 may be incorporated into a control device (not shown) that controls the flight of the aircraft AM, or may be mounted on the aircraft AM as a separate device different from the control device.

[0102] As shown in the figure, the flight support device 200 includes an input device 510, an output device 520, a processing device 530, a main storage device 540, an auxiliary storage device 550, a communication device 560, and a bus 570 that electrically interconnects these devices.

[0103] The input device 510 is an input device such as a touch panel or hard switch keys. The output device 520 is a display device such as a display or an audio output device such as a speaker.

[0104] The processing device 530 is, for example, a CPU. The main storage device 540 is a memory device such as a RAM or ROM. The auxiliary storage device 550 is a non-volatile storage device such as a so-called hard disk, SSD, or flash memory that can store digital information.

[0105] The communication device 560 is a communication unit that performs wireless communication with an external device.

[0106] The hardware configurations of the aircraft operation management device 100 and the flight support device 200 have been described above.

[0107] The processing unit 120 of such an aircraft operation management device 100 is realized by a program that causes the processing device 410 to perform processing. This program is stored in the main storage device 420 or the auxiliary storage device 430, loaded onto the main storage device 420 when the program is executed, and executed by the processing device 410. Note that the storage unit 110 is realized by the main storage device 420, the auxiliary storage device 430, or a combination thereof. Also, the communication unit 130 is realized by the communication device 440.

[0108] Similarly, the processing unit 220 of the flight support device 200 is realized by a program that causes the processing device 530 to perform processing. This program is stored in the main storage device 540 or the auxiliary storage device 550, loaded onto the main storage device 540 when the program is executed, and executed by the processing device 530. Note that the storage unit 210 is realized by the main storage device 540, the auxiliary storage device 550, or a combination thereof. Also, the communication unit 230 is realized by the communication device 560.

[0109] Also, the above-described respective configurations, functions, processing units, processing means, etc. of the aircraft operation management device 100 and the flight support device 200 may be realized in hardware by designing a part or all of them, for example, by using an integrated circuit. Further, the above configurations and functions may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD, or a recording medium such as an IC card, an SD card, or a DVD.

[0110] In addition, each functional block of the aircraft operation management device 100 and the flight support device 200 is classified according to the main processing content in order to facilitate the understanding of each function realized in this embodiment. Therefore, the present invention is not limited by the classification method and the name of each function. In addition, each configuration of the aircraft operation management device 100 and the flight support device 200 can be further classified into more constituent elements according to the processing content. Also, one constituent element can be classified so as to execute more processes.

[0111] In addition, all or part of each functional unit may be constructed by hardware (such as an integrated circuit such as an ASIC) implemented in a computer. Also, the processing of each functional unit may be executed by one piece of hardware or by a plurality of pieces of hardware.

[0112] In addition, the present invention is not limited to the above-described embodiments and modifications, and includes various other embodiments and modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Also, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment or modification, and the configuration of another embodiment can be added to the configuration of one embodiment. Also, for a part of the configuration of each embodiment, it is possible to add, delete, or replace other configurations.

Explanation of Reference Numerals

[0113] 1000···Aircraft operation support system, 100···Aircraft operation management device, 110···Memory unit, 111···Spatial information, 112···Operation management information, 113···Guidance information, 120···Processing unit, 121···Information acquisition unit, 122···Flight position management unit, 123···Flight route calculation unit, 124···Guidance information generation unit, 130···Communication unit, 200···Flight support device, 210···Memory unit, 220···Processing unit, 221···Input reception unit, 222···Position identification unit, 223···Guidance information output unit, 224···Guidance information analysis unit, 230···Communication unit, 410···Processing device, 420···Main memory device, 430···Auxiliary memory device, 440···Communication device, 450···Bus, 510···Input device, 520···Output device, 530···Processing device, 540···Main memory device, 550···Auxiliary memory device, 560···Communication device, 570···Bus, AM···Aircraft, N···Network

Claims

1. A guidance information generation unit that generates guidance information indicating the flight route of a flying object for each space block partitioned by subdividing the flight space; A flight vehicle operation management device comprising a communication unit that transmits the guidance information; A flight support device mounted on the flight vehicle, A guidance information output unit that outputs the guidance information to a predetermined device for outputting the guidance information as information visible to the pilot of the flight vehicle; When the flight vehicle is controlled by automatic pilot, the guidance information output to the predetermined device is analyzed, and an instruction signal regarding control is output so that the flight vehicle flies along the flight route indicated by the guidance information according to the analysis result. A flight support device comprising a guidance information analysis unit; A flight vehicle operation support system characterized by the above.

2. The flight vehicle operation support system according to claim 1, wherein the guidance information generation unit generates image information for visualizing the flight route as the guidance information, and the guidance information output unit displays the image information superimposed on a view from above. A flight vehicle operation support system characterized by the above.

3. The flight vehicle operation support system according to claim 2, wherein the image information output to the predetermined device of the flight vehicle is image information showing the course direction and passage zone for each space block included in the flight route from the first-person perspective of the pilot. A flight vehicle operation support system characterized by the above.

4. The flight vehicle operation support system according to claim 1, wherein the guidance information generation unit generates voice information indicating the flight route as the guidance information, and the guidance information output unit outputs the voice information to the predetermined device of the flight vehicle. A flight vehicle operation support system characterized by the above.

5. The flight vehicle operation support system according to claim 1, wherein the guidance information analysis unit compares different types of the guidance information and performs analysis for detecting discrepancies in the flight route, the guidance information generation unit generates image information for visualizing the flight route and voice information indicating the flight route as the guidance information, the guidance information output unit outputs the guidance information to the predetermined device of the flight vehicle, and the guidance information analysis unit detects discrepancies in the flight route indicated by the image information and the voice information. A flight vehicle operation support system characterized by the above.

6. The flight vehicle operation support system according to claim 1, wherein the guidance information generation unit Generate guidance information by adding at least one piece of information among flight speed, altitude band, advertisements, and cautionary matters to the guidance information A flight vehicle operation support system characterized by the above.

7. A flight vehicle operation support method executed by a flight vehicle operation support system having a flight vehicle operation management device and a flight support device, comprising: The flight vehicle operation management device: A guidance information generation step of generating guidance information indicating a flight route of a flight vehicle for each space block partitioned by subdividing a flight space; A communication step of transmitting the guidance information; and The flight support device mounted on the flight vehicle: A guidance information output step of outputting the guidance information to a predetermined device for outputting the guidance information as information visible to the pilot of the flight vehicle; When the flight vehicle is controlled by automatic piloting, analyzing the guidance information output to the predetermined device, and outputting an instruction signal regarding control so that the flight vehicle flies along the flight route indicated by the guidance information according to the analysis result. A guidance information analysis step is performed A flight vehicle operation support method characterized by the above.

Images