Management device, management method and program
The management device addresses the challenge of managing flying objects by changing destinations to suitable landing sites when events occur, enhancing flight appropriateness and safety.
Patent Information
- Application Number
- JP2023081201
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
AI Technical Summary
Existing technologies fail to effectively manage the flight of flying objects when events occur that make it inappropriate for them to continue to their destination, such as drones or flying cars.
A management device that acquires event information, changes the destination to a suitable landing site, and outputs information to the flying object for safe landing.
Improves the appropriateness of flight by changing the destination to a suitable landing site when events occur, ensuring safe continuation of the flight.
Smart Images

Figure 2024165232000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a management device, a management method, and a program. [Background technology]
[0002] When drones, flying cars and other flying objects fly along routes called corridors set up in airspace, there is a possibility that an incident may occur that disrupts the flight of the flying object while flying along the route from the departure point to the destination.
[0003] Patent Document 1 describes a method for determining a drone flight route based on the degree of danger and congestion. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2019-031164 A Summary of the Invention [Problem to be solved by the invention]
[0005] The technology of Patent Document 1 determines a flight route that avoids an event such as congestion or other events that increase the risk of danger on the route from the departure point to the destination. This allows the drone to fly safely from the departure point to the destination. However, the technology of Patent Document 1 cannot improve the appropriateness of the flight of the flying object when an event occurs that makes it inappropriate for the flying object to continue flying to the destination.
[0006] One of the objectives of the present disclosure is to provide a management device, a management method, and a program that can improve the appropriateness of an aerial vehicle's flight when an event occurs that makes it inappropriate for the aerial vehicle to continue flying to its destination. [Means for solving the problem]
[0007] A management device according to one aspect of the present disclosure includes an information acquisition means for acquiring information on an event that has occurred, a change means for changing the destination of the flying object to a new destination that is a landing location corresponding to the event among landing locations where the flying object can land if the event affects the flight of the flying object to a destination, and an output means for outputting information on the new destination.
[0008] A management method according to one aspect of the present disclosure obtains information about an event that has occurred, and if the event affects the flight of an aerial vehicle to a destination, changes the destination of the aerial vehicle to a new destination that is a landing location corresponding to the event among landing locations where the aerial vehicle can land, and outputs information about the new destination.
[0009] A program according to one aspect of the present disclosure causes a computer to execute an information acquisition process for acquiring information about an event that has occurred; a change process for changing the destination of the flying object, if the event affects the flight of the flying object toward its destination, to a new destination destination that is a landing location among landing locations where the flying object can land, depending on the event; and an output process for outputting information about the new destination destination. Effect of the Invention
[0010] The present disclosure has the advantage of being able to improve the appropriateness of flight of an airborne object when an event occurs that makes it inappropriate for the airborne object to continue flying to its destination. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a block diagram illustrating an example of the configuration of a management device according to a first embodiment of the present disclosure. [Diagram 2] FIG. 2 is a flowchart illustrating an example of the operation of the management device according to the first embodiment of the present disclosure. [Diagram 3] FIG. 3 is a block diagram illustrating an example of the configuration of a management device according to the second embodiment of the present disclosure. [Figure 4]FIG. 4 is a flowchart illustrating an example of the operation of the management device according to the second embodiment of the present disclosure. [Diagram 5] FIG. 5 is a flowchart illustrating an example of an operation of a destination change process of the management device according to the second embodiment of the present disclosure. [Figure 6] FIG. 6 is a flowchart illustrating an example of the operation of a destination change process of the management device according to the second embodiment of the present disclosure. [Figure 7] FIG. 7 is a flowchart illustrating an example of an operation of a route change process of the management device according to the second embodiment of the present disclosure. [Figure 8] FIG. 8 is a block diagram illustrating an example of a configuration of a management device according to a first modified example of the second embodiment of the present disclosure. [Figure 9] FIG. 9 is a block diagram illustrating an example of a configuration of a management device according to a fourth modified example of the second embodiment of the present disclosure. [Figure 10] FIG. 10 is a block diagram illustrating an example of a configuration of a management device according to a fifth modified example of the second embodiment of the present disclosure. [Figure 11] FIG. 11 is a block diagram illustrating an example of a configuration of a management device according to an eighth modification of the second embodiment of the present disclosure. [Figure 12] FIG. 12 is a block diagram illustrating an example of the configuration of a management device according to an eleventh modification of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of a hardware configuration of a computer capable of realizing the management device according to the embodiment of the present disclosure and the management device according to the modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0013] <First embodiment> First, a first embodiment of the present disclosure will be described in detail with reference to the drawings.
[0014] Fig. 1 is a block diagram illustrating an example of a configuration of a management device according to a first embodiment of the present disclosure. In the example illustrated in Fig. 1, the management device 10 of the present embodiment includes an information acquisition unit 110, a change unit 120, and an output unit 130.
[0015] The information acquisition unit 110 acquires information about an event that has occurred.
[0016] When the event affects the flight of the flying object toward its destination, the change unit 120 changes the destination of the flying object to a changed destination that is a landing location corresponding to the event among landing locations where the flying object can land.
[0017] The output unit 130 outputs the information about the changed destination.
[0018] The flying object may be, for example, a drone that does not have a pilot or a passenger on board. The flying object may be, for example, a vertical take-off and landing aircraft called a flying car that can have a passenger (for example, at least one of a pilot and a passenger) on board.
[0019] The event is, for example, an abnormality in the air vehicle. In this case, the air vehicle is equipped with, for example, a detector that detects an abnormality in the air vehicle's air vehicle and a transmitter that transmits information on the abnormality in the air vehicle to the management device 10 as event information when an abnormality in the air vehicle is detected. The abnormality in the air vehicle may include, for example, a state in which the function of the air vehicle has not yet been lost but some measured value indicates an abnormal value. The abnormality in the air vehicle may include, for example, a failure that results in a state in which at least a part of the function of the air vehicle is lost. The abnormality in the air vehicle may include a drop in the charge level of the battery to a predetermined level or less.
[0020] The event is, for example, an abnormality such as a sudden illness of a passenger. In this case, for example, an input device for a passenger to input the abnormality of the passenger is mounted on the flying object. When the passenger inputs the abnormality of the passenger using the input device, the flying object (specifically, for example, the above-mentioned transmitter) transmits information indicating the abnormality of the passenger to the management device 10 as event information. This input device may be implemented as, for example, a button, a lever, a switch, or a key. Then, when the input device is operated, the flying object transmits information indicating the abnormality of the passenger to the management device 10 as event information. The input device may be implemented as, for example, a touch panel. The flying object may be equipped with a sensor that detects the abnormality of the passenger. When the sensor detects the abnormality of the passenger, the flying object may transmit information indicating the abnormality of the passenger to the management device 10 as event information.
[0021] The events are not limited to these examples. Moreover, the event information does not necessarily need to be transmitted from the flying object to the management device 10. The event information may be transmitted to the management device 10 from a device other than the flying object. Other examples of events will be described later.
[0022] The event information may first be notified to the pilot of the air vehicle. In this case, the air vehicle transmits the event information to, for example, a control device used by the pilot to control the air vehicle. When the control device receives the event information, it notifies the pilot of the air vehicle of the event information. When the pilot of the air vehicle is notified of the event information, for example, the pilot inputs an instruction to change the destination into, for example, the control device. When an instruction to change the destination is input, the control device transmits the event information to the management device 10.
[0023] The landing location depending on the event is, for example, a landing location that is determined for each type of event that has occurred and is designated as a landing location in the event that the event has occurred. The landing location depending on the event may be, for example, a landing location that is determined as a landing location that can handle the event that has occurred.
[0024] The landing site according to the event is, for example, a landing site where equipment and personnel are located to inspect and repair the abnormality of the flying object when the event is an abnormality of the flying object. The landing site according to the event may be, for example, a landing site registered as a landing site to which personnel can be dispatched to inspect and repair the abnormality of the flying object when the event is an abnormality of the flying object.
[0025] The landing location according to the event may be, for example, a landing location where at least one of a doctor, a nurse, and a paramedic is stationed when the event is an abnormality of the passenger. The landing location according to the event may be, for example, a landing location registered as a landing location where at least one of a doctor, a nurse, and a paramedic can be dispatched (e.g., quickly dispatched) when the event is an abnormality of the passenger. The landing location according to the event may be, for example, a landing location registered as a landing location where at least one of a doctor, a nurse, and a paramedic can be transported (e.g., quickly transported) to a location where at least one of a doctor, a nurse, and a paramedic is stationed when the event is an abnormality of the passenger. The landing location according to the event may be, for example, a landing location registered as a landing location where at least one of a doctor, a nurse, and a paramedic can be dispatched (e.g., quickly dispatched) ...
[0026] The landing locations depending on the event are not limited to these examples, and other examples of landing locations depending on the event will be described later.
[0027] The output unit 130 outputs the information about the new destination to, for example, a control device used by the pilot of the flying object to control the flying object. In this case, the control device receives the information about the new destination from the output unit 130 of the management device 10. The control device displays the received information about the new destination on, for example, a display device communicably connected to the control device. Examples of the information about the new destination will be described later.
[0028] <Operation> Next, the operation of the management device 10 according to the first embodiment of the present disclosure will be described in detail with reference to the drawings.
[0029] FIG. 2 is a flowchart showing an example of the operation of the management device 10 according to the first embodiment of the present disclosure. In the example shown in FIG. 2, first, the information acquisition unit 110 acquires information on the event that has occurred (step S11). If the event affects the flight of the flying object to the destination (NO in step S12), the change unit 120 changes the destination of the flying object to a new destination, which is a landing place according to the event among the landing places (step S13). The change unit 120 selects, for example, one landing place from the landing places according to the event, and sets the selected landing place as the new destination. Then, the output unit 130 outputs information on the new destination (step S14).
[0030] <Effects> This embodiment has an effect of improving the appropriateness of flight of the flying object when an event occurs that makes it inappropriate for the flying object to continue to the destination, because when an event affects the flight of the flying object to the destination, the change unit 120 changes the destination of the flying object to a changed destination that is a landing place according to the event among landing places where the flying object can land.
[0031] <Second embodiment> Next, a second embodiment of the present disclosure will be described in detail with reference to the drawings.
[0032] FIG. 3 is a block diagram showing an example of the configuration of a management device according to a second embodiment of the present disclosure. In the example shown in FIG. 3, the management device 100 according to the present embodiment includes an information acquisition unit 110, a change unit 120, an output unit 130, and an information storage unit 140. The information acquisition unit 110, the change unit 120, and the output unit 130 of the present embodiment have the same functions as the information acquisition unit 110, the change unit 120, and the output unit 130 of the first embodiment, respectively. The management device 100 is communicatively connected to a communication network. The management device 100 may be mounted on an air vehicle. The management device 100 may be communicatively connected to the air vehicle by communication, including wireless communication, via the communication network.
[0033] The management device 100 is communicatively connected to an information providing device that collects event information and provides the collected event information via a communication network. The management device 100 may further be communicatively connected to other flying objects via the communication network.
[0034] <Information acquisition unit 110> The information acquisition unit 110 acquires information on the event that has occurred. The information acquisition unit 110 acquires information on the event that has occurred from an information processing device such as a server that collects information on the event that has occurred, via a communication network. The information acquisition unit 110 further acquires information on the event that has occurred from the flying object. The information acquisition unit 110 may further acquire information on the event that has occurred from another flying object. The event information includes information on the type of the event and information on the position where the event has occurred (hereinafter also referred to as the position of the event). The position of the event may be represented, for example, by coordinates in a three-dimensional space (for example, a combination of latitude and longitude, or a combination of latitude, longitude, and height). This height may be altitude. This height may be height from the ground surface.
[0035] When an event occurs in an area in three-dimensional space (such as bad weather, which will be described later), the event information (e.g., information on the location of the event) may include information on the area in which the event occurred (hereinafter also referred to as the range in which the event occurred, the range of the event, the event range, etc.). The range of the event represents a range in three-dimensional space. In this case, the location of the event may be, for example, the location of a representative point (e.g., the center of gravity) of the range of the event. For example, when the event is rainfall, and the range of altitude at which the event is occurring is not necessarily clear, the location of the event may be represented by a combination of latitude and longitude.
[0036] The information acquisition unit 110 also acquires information on the position of the flying object, information on the destination, and information on the flight route to the destination from the flying object. The information on the position of the flying object includes information (also referred to as position information) indicating the three-dimensional position of the flying object. The information on the position of the flying object may include information (also referred to as direction information) indicating the direction in which the flying object is facing. The information on the destination includes information on the position of the destination. The information on the flight route to the destination is information that specifies the flight route in the three-dimensional space along which the flying object is scheduled to fly toward the destination. Specifically, the information on the flight route to the destination is information that specifies the shape of the flight route in the three-dimensional space along which the flying object is scheduled to fly toward the destination. More specifically, the information on the flight route to the destination may be expressed by, for example, at least any combination of one or more line segments and one or more curves. The format of the information on the flight route to the destination is not limited to this example. The information acquisition unit 110 acquires information on the remaining battery level from the flying object. The information on the remaining battery capacity may include, for example, a combination of the remaining battery capacity (amount of remaining power) expressed in a predetermined unit and the distance that the flying object can fly per unit capacity of the battery (hereinafter, also referred to as the possible flight distance). The information on the remaining battery capacity may be expressed by the distance that the flying object can fly before the remaining battery capacity becomes zero. The information on the remaining battery capacity may be the remaining battery capacity (amount of remaining power) expressed in a predetermined unit. In this case, for example, the change unit 120 described later holds in advance information on the distance that the flying object can fly per unit capacity of the battery.
[0037] The information acquisition unit 110 further acquires information on landing sites where landing is possible, for example, from a server that provides information on landing sites. The landing sites where landing is possible are landing sites where it is known in advance that the flying object can land. The landing sites where landing is possible are landing sites where there is space where the flying object can land, for example. The landing sites where landing is possible may be, for example, landing sites determined for each flying object manufacturer and where there is space where the flying object can land. The landing sites where landing is possible may be, for example, landing sites determined for each flying object type and where there is space where the flying object can land. In this embodiment, the information on landing sites where landing is possible is obtained in advance.
[0038] <<Examples of events>> The event is, for example, the event exemplified in the description of the first embodiment. The event information may include information on the location where the event occurred. If the event is an abnormality that occurred in the flying object and an abnormality that occurred in the occupant of the flying object, the event information may include information indicating the location of the flying object as the location information of the event.
[0039] The event may be a phenomenon occurring on the flight route, for example, as shown below. The event may be a phenomenon occurring in an area including the flight route. The event may be a phenomenon that may lead to a change in the flight destination and flight route, or a phenomenon that may lead to a change in the flight route, for example, as shown below. The flight route represents the route that the flying object flies.
[0040] The event is, for example, bad weather on the flight route of the flying object to the destination. The event may be, for example, bad weather in an area including the flight route of the flying object to the destination. In this case, the event information includes, for example, information on the area where the bad weather is occurring as information on the location of the event. The event information is transmitted to the management device 10 from an information processing device or the like that has acquired the bad weather information. The bad weather is, for example, weather that is defined as being unsuitable for the flight of the flying object, such as strong winds and heavy rain.
[0041] The event may be, for example, a congestion of flying objects. When the density of flying objects in a space increases, the flying objects use it for communication. The radio communication network may become congested. When the radio communication network is congested, the flying objects may not be able to communicate. When the flying objects cannot communicate, the flying objects cannot exchange information for flight. In such a case, it is not easy for the flying objects to fly safely. When the event is a congestion of flying objects, the information on the event includes, for example, information on the range where the congestion of flying objects is occurring as information on the location of the event. Then, the information on the event is transmitted to the management device 10 from the above-mentioned information collection device or the like.
[0042] The event may be radio waves (hereinafter, referred to as jamming radio waves) that interfere with the communication of the flying object. In an area where such an event occurs, the flying object may not be able to communicate. If the flying object cannot communicate, the flying object cannot exchange information for flight. In such a case, it is not easy for the flying object to fly safely. In this case, the event information includes, as information on the location of the event, a range determined as a range in which jamming radio waves may exist, for example, information on a region within a predetermined range from the point where the jamming radio waves are detected. For example, a flying object may detect jamming radio waves. In this case. The flying object that detects the jamming radio waves transmits information on the point where the jamming radio waves are detected to the above-mentioned information collection device. The flying object that detects the jamming radio waves may transmit information on the point where the jamming radio waves are detected to the management device 100. A detection device installed on the ground may detect the jamming radio waves. In this case, the detection device that detects the jamming radio waves transmits information on the point where the jamming radio waves are detected to the above-mentioned information collection device. The detection device that detects the jamming radio waves may transmit information on the point where the jamming radio waves are detected to the management device 100. For example, information on the location where the jamming radio waves were detected and information on the event are transmitted to the management device 10 from an information processing device or the like that has acquired information on the congestion of flying objects.
[0043] The event may be an anomaly in radio waves from an artificial satellite for a Global Navigation Satellite System (GNSS). In this case, the event information includes, for example, information indicating the entire three-dimensional space as information on the location of the event.
[0044] The event may be a fire that has broken out on the ground. In this case, the event information includes information on the location of the event, that is, information on the area including the location of the fire. The area including the location of the fire is, for example, an area of a predetermined size and a predetermined shape (for example, a circle, etc.) centered on the point where the fire has broken out. The area including the location of the fire may be, for example, an area determined by utilizing topography, etc.
[0045] As described above, the information on the event includes information on the type of the event. The types of the event include, for example, passenger abnormality, aircraft abnormality, aircraft failure, battery shortage, other emergency situations, and non-emergency situations. Other emergency situations include, for example, bad weather at a location within a predetermined distance from the location where the flying object is flying, and radio wave abnormality at a location within a predetermined distance from the location where the flying object is flying. The radio wave abnormality is, for example, congestion of flying objects and jamming radio waves. Non-emergency situations include, for example, bad weather at a location on the flight route of the flying object that is a predetermined distance or more away from the location where the flying object is flying, and radio wave abnormality at a location on the flight route of the flying object that is a predetermined distance or more away from the location where the flying object is flying. The types of the event are not limited to these examples. The information on the event may not include information on the type of the event. In this case, the change unit 120 described later determines the information on the type of the event from the information on the event according to a predetermined rule.
[0046] Furthermore, events are classified into, for example, emergency events and non-emergency events (i.e., non-emergency events). An emergency event is, for example, an event that, when it occurs, is defined as an event for which landing of the flying object is recommended even if the landing location of the flying object is a location other than the destination. In the above example, emergency events are, for example, passenger abnormality, aircraft abnormality, aircraft malfunction, battery shortage, and other emergency situations as described above. An event that is not an emergency event is, for example, the non-emergency situation as described above.
[0047] <Information storage section 140> The information storage unit 140 stores information on landing locations corresponding to events. As described above, the landing locations corresponding to events are, for example, landing locations that are determined for each type of event that has occurred and are designated as landing locations when an event occurs. The information storage unit 140 may store information on a plurality of landing locations. The information on the landing location includes, for example, information on the type of event that can be handled at the landing location and information on the location of the landing location.
[0048] As described above, the types of events include, for example, passenger abnormalities, aircraft abnormalities, aircraft failures, battery shortages, other emergency situations, and non-emergency situations. The types of events are not limited to these examples. Other emergency situations include, for example, bad weather at a location within a predetermined distance from the location where the flying object is flying, and radio wave abnormalities at a location within a predetermined distance from the location where the flying object is flying. The radio wave abnormalities are, for example, congestion of flying objects and jamming radio waves. Non-emergency situations include, for example, bad weather at a location on the flight route of the flying object that is a predetermined distance or more away from the location where the flying object is flying, and radio wave abnormalities at a location on the flight route of the flying object that is a predetermined distance or more away from the location where the flying object is flying.
[0049] <Change section 120> When the event affects the flight of the airborne object toward its destination, the change unit 120 changes the destination of the airborne object to a changed destination that is a landing location according to the event among landing locations where the airborne object can land.
[0050] Specifically, the change unit 120 determines whether or not the occurring event represented by the information received by the information acquisition unit 110 affects the flight of the air vehicle to the destination. For example, when the event is an event that occurred to the air vehicle, an event that occurred to a passenger of the air vehicle, an event that occurred at a location within a predetermined distance from the position of the air vehicle, or an event that occurred at a location within a predetermined distance from the flight route of the air vehicle, the change unit 120 determines that the occurring event affects the flight of the air vehicle to the destination.
[0051] Next, the change unit 120 determines whether or not to change the destination based on the information of the event that occurred. If the change unit 120 determines to change the destination, it determines a new destination that is the destination after the change. Then, the change unit 120 changes the destination of the flying object to the new destination. Furthermore, the change unit 120 changes the flight route of the flying object to a route from the position of the flying object to the new destination. If the change unit 120 determines not to change the destination, the change unit 120 changes the flight route of the flying object using information of the event that occurred.
[0052] Specifically, the change unit 120 determines whether the event is an emergency event. The change unit 120 determines to change the destination when the event that has occurred is an emergency event. For example, when the event is one of the types of events defined as an emergency event, the change unit 120 determines that the event is an emergency event. When the event is not a type of event defined as an emergency event, the change unit 120 determines that the event is not an emergency event. An emergency event is, for example, an event that is defined as an event that, when it occurs, is recommended for the landing of the flying object even if the landing location of the flying object is a location other than the destination. For example, the change unit 120 determines that the event is an emergency event when the event is an event that has occurred to the flying object, an event that has occurred to the occupant of the flying object, or an event that has occurred at a location within a predetermined distance from the location of the flying object. If the event is not one of these events (for example, an event that occurs within a predetermined distance from the flight route of the flying object and at a location that is a predetermined distance or more away from the position of the flying object), the change unit 120 determines that the event is not an emergency event. Note that examples of events that the change unit 120 determines to be an emergency event are not limited to the above examples. Examples of events that the change unit 120 determines to be not an emergency event are not limited to the above examples.
[0053] When the change unit 120 determines that the event that has occurred is not an emergency event, it derives a flight route to fly to the destination while avoiding the event that has occurred. In other words, when the change unit 120 determines that the event that has occurred is not an emergency event, it derives a flight route to fly to the destination without being affected by the event that has occurred. In the following description, the flight route on which the flying object can fly is, for example, a flight route on which the flying object can fly without being affected by the event.
[0054] Specifically, the change unit 120 sets, for example, an area that is a predetermined distance or less from the location of the event as the avoidance area. The avoidance area is an area that is set as an area in which flying objects do not fly.
[0055] If the event occurs in an area in three-dimensional space, the change unit 120 sets an area whose distance from the range of the event is equal to or less than a predetermined distance as the avoidance area. If this predetermined distance is zero, the avoidance area coincides with the location of the event (the range of the event if the event occurs in an area in three-dimensional space). In this case, the flight route that the flying object can fly in the following description is a flight route that does not pass through the avoidance area. That is, in this example, the flight route that the flying object can fly is a flight route whose distance from the location of the event (the range of the event if the event occurs in an area in three-dimensional space) is not equal to or less than a predetermined distance.
[0056] The avoidance area may include a predetermined avoidance area (e.g., an area that is constantly unsuitable for flying objects). In this case, the change unit 120 may hold information on the predetermined avoidance area (e.g., information indicating the range of the avoidance area) in advance.
[0057] Then, the change unit 120 derives a flight route that the flying object can fly from the position of the flying object to the destination without passing through the avoidance area, according to a predetermined method. The change unit 120 may derive, for example, a flight route with the shortest flight distance among flight routes from the position of the flying object to the destination without passing through the avoidance area of the event (i.e., flight routes that the flying object can fly). The change unit 120 may derive, for example, a flight route with the shortest flight distance among flight routes from the position of the flying object to the destination that pass over an area within a predetermined distance from the landing site without passing through the avoidance area of the event.
[0058] If the distance of the shortest flight route from the position of the flying object to the destination without passing through the event avoidance area is longer than the distance that the flying object can fly, the change unit 120 may consider that a new event of battery shortage has occurred. In this case, the change unit 120 determines to change the destination. Then, the change unit 120 performs an operation when the event that has occurred is battery shortage. That is, the change unit 120 selects a destination destination when the event that has occurred is battery shortage. The change unit 120 further changes the destination of the flying object to the destination destination. Then, the change unit 120 changes the flight route of the flying object to a flight route that flies from the position of the flying object to the destination destination.
[0059] If there is no flight route from the position of the flying object to the destination, the change unit 120 determines to change the destination. Then, the change unit 120 selects a new destination from the landing place according to a predetermined selection method. The change unit 120 further changes the destination of the flying object to the new destination. Then, the change unit 120 changes the flight route of the flying object to a flight route from the position of the flying object to the new destination. In this case, the change unit 120 may select, for example, a landing place where the flying object can land and has the shortest flight distance from the position of the flying object as the new destination. The change unit 120 may select, for example, a landing place where the flight route to the destination is the shortest among the landing places where the flying object can fly from the position of the flying object as the new destination. Note that the landing place where the flying object can fly from the position of the flying object is a landing place where the flying object can land and has a flight route from the position of the flying object to the landing place. The change unit 120 may select, as the new destination, a landing location that has the shortest flight route to the destination among landing locations that can be flown from the position of the flying object and can charge the battery. The change unit 120 may select the new destination according to another method. If there is no flight route that the flying object can fly from the position of the flying object to the destination, the change unit 120 may consider that an event of inability to reach the destination has occurred. The change unit 120 selects, as the new destination according to the event of inability to reach the destination, a landing location according to the above-mentioned predetermined selection method.
[0060] <<Example of selecting a new destination>> The following describes the selection of a destination change destination when the occurring event is determined to be an emergency event.
[0061] When the change unit 120 determines that the event that has occurred is an emergency event, it selects a landing site as a new destination from among landing sites within the flight range of the flying object that can handle the event that has occurred. When the change unit 120 determines that the event that has occurred is an emergency event, it selects the closest landing site as a new destination from among landing sites within the flight range of the flying object that can handle the event that has occurred. The closest landing site is the landing site that has the shortest route from the position of the flying object to the landing site that the flying object can fly, among landing sites within the flight range of the flying object that can handle the event that has occurred. The flight range of the flying object is a range in which the distance along the flight route that the flying object can fly is equal to or less than the flight distance of the flying object.
[0062] Specifically, the modification unit 120 estimates the distance the flying object can fly (the above-mentioned possible flight distance) from the information on the remaining battery charge of the flying object. The distance the flying object can fly (i.e., the possible flight distance) is the longest distance the flying object can fly when the remaining battery charge of the flying object is the acquired remaining battery charge. The modification unit 120 may calculate the distance the flying object can fly from the distance the flying object can fly per unit capacity of the battery and the remaining battery charge. When the information on the remaining battery charge is represented by the distance the flying object can fly, the modification unit 120 sets the distance represented by the information on the remaining battery charge as the distance the flying object can fly. The modification unit 120 may estimate the distance the flying object can fly as a value obtained by multiplying the distance the flying object can fly by a coefficient of a predetermined value greater than 0 and less than 1.
[0063] The change unit 120 derives, for each landing site that can handle the occurring event, a flight route with the shortest flight distance among flight routes that the flying object can fly from the position of the flying object to the landing site. A flight route (also called a corridor) along which the flying object flies in the space is determined in advance. The change unit 120 derives, for each landing site that can handle the occurring event, a route with the shortest flight distance among routes from the position of the flying object to the landing site that flies through a portion of the corridor whose distance from the area where the event occurs is not less than a predetermined distance.
[0064] For example, the modification unit 120 may first extract landing locations that can handle the event that has occurred and whose straight-line distance from the position of the flying object is equal to or less than the distance that the flying object can fly. Then, for each of the extracted landing locations, the modification unit 120 may derive a route with the shortest flight distance among flight routes that the flying object can fly from the position of the flying object to the landing location. The modification unit 120 may use, for example, one of various existing methods for calculating the shortest route to a destination to derive the shortest flight route from the position of the flying object through a corridor to the landing location, and calculate the flight distance when flying along the shortest flight route. The flight distance is the distance traveled when flying along the flight route.
[0065] The change unit 120 identifies a landing location with the shortest calculated flight distance among landing locations that can handle the occurring event. If the shortest flight distance to the identified landing location is equal to or less than the distance that the flying object can fly, the change unit 120 selects the identified landing location as a new destination destination. Then, the change unit 120 changes the destination of the flying object's flight to the new destination destination (i.e., the landing location selected as the new destination destination). The new destination destination refers to the destination after the flight of the flying object is changed.
[0066] When the flight distance of the flight route from the position of the flying object to all landing locations that can handle the occurred event is greater than the distance that the flying object can fly, the change unit 120 may select a landing location other than the landing location that can handle the occurred event as the changed destination. In this case, the change unit 120 identifies, for example, the landing location that has the shortest flight distance from the position of the flying object among the landing locations that can land.
[0067] In this case, the change unit 120 derives, for each of the landing locations where the flying object can land, a route with the shortest flight distance among flight routes that the flying object can fly from the flying object's position to the landing location. As described above, a flight route (i.e., a corridor) along which the flying object flies in the space is determined in advance. The change unit 120 derives a route with the shortest flight distance among routes from the flying object's position to the landing location that flies through a portion of the corridor whose distance from the area where the event occurs is not less than a predetermined distance.
[0068] In this case, the change unit 120 may, for example, first extract landing locations where the flying object can land and whose straight-line distance from the position of the flying object is equal to or less than the distance the flying object can fly. Then, for each of the extracted landing locations, the change unit 120 may derive a route with the shortest flight distance among flight routes that the flying object can fly from the position of the flying object to the landing location. The change unit 120 may, for example, use one of various existing methods for calculating the shortest route to a destination to derive the shortest flight route from the position of the flying object to the landing location through a corridor, and calculate the flight distance when flying along the shortest flight route.
[0069] The change unit 120 identifies a landing location with the shortest calculated flight distance among the landing locations where landing is possible. If the shortest flight distance to the identified landing location is equal to or less than the distance that the flying object can fly, the change unit 120 selects the identified landing location as a destination destination. Then, the change unit 120 changes the destination of the flight of the flying object to the destination destination (i.e., the landing location selected as the destination destination).
[0070] If there is no landing site where the calculated shortest flight distance is equal to or shorter than the distance that the flying object can fly among the available landing sites, the change unit 120 does not change the destination.
[0071] <Output unit 130> When the destination of the flying object is changed to the changed destination, the output unit 130 outputs information about the changed destination. When the destination of the flying object is changed to the changed destination, the output unit 130 may output information about the changed destination and information about the shortest flight route to the changed destination.
[0072] If there is no landing site where the calculated shortest flight distance is equal to or shorter than the flight distance of the flying object among the available landing sites, the output unit 130 outputs information indicating that the new destination could not be identified. If there is no landing site where the calculated shortest flight distance is equal to or shorter than the flight distance of the flying object among the available landing sites, the output unit 130 may output information indicating that the new destination could not be identified and an emergency landing instruction.
[0073] The output unit 130 outputs information on the new destination and information on the shortest flight route to the new destination to, for example, a pilot of the flying object (specifically, a control device used by the pilot to control the flying object). In this case, the control device displays information on the new destination and information on the shortest flight route to the new destination on a display device of the control device. The pilot flies the flying object toward the new destination along the flight route for which information is displayed. Then, the pilot lands the flying object at the new destination. Note that, when the control device receives information on the flight route and the destination information, the control device may be configured to control the flying object so that the flying object flies along the flight route toward the new destination. The control device may further be configured to land at the new destination.
[0074] The output unit 130 similarly outputs information indicating that the new destination could not be identified and an emergency landing instruction to the pilot of the flying object (specifically, a control device used by the pilot to control the flying object). In this case, the control device displays the information indicating that the new destination could not be identified and the emergency landing instruction on the display device of the control device. The pilot finds a place where the flying object can land by visual inspection or from an image captured by an imaging device mounted on the flying object. Then, the pilot lands the flying object at the found place where it can land. Note that the control device may be configured to control the flying object so that the flying object flies along its flight route toward the destination upon receiving the destination information. The control device may further be configured to land at the destination.
[0075] The destination information output by the output unit 130 may be represented by at least any combination of, for example, characters, figures, images, maps, etc. The flight route information output by the output unit 130 may be represented by at least any combination of, for example, characters, figures, images, maps, etc.
[0076] <<Resolution of the issue>> The information acquiring unit 110 may acquire information indicating that the event that occurred has been resolved. The information acquiring unit 110 acquires information on the position of the flying object together with the information indicating that the event that occurred has been resolved.
[0077] When information indicating that the event has been resolved is acquired, and if the destination of the flying object has not been changed to a new destination, the change unit 120 extracts a route with the shortest flight distance from the position of the flying object to the destination of the flying object. Then, the change unit 120 changes the flight route of the flying object to the extracted route with the shortest flight distance from the position of the flying object to the destination of the flying object.
[0078] When information indicating that the event that occurred has been resolved is acquired, if the destination of the flying object has been changed to a changed destination, the change unit 120 changes the destination of the flying object to the original destination that is the original destination of the flying object. The change unit 120 extracts a route with the shortest flight distance from the position of the flying object to the original destination of the flying object. Then, the change unit 120 changes the flight route of the flying object to the extracted route with the shortest flight distance from the position of the flying object to the original destination of the flying object.
[0079] Then, the output unit 130 outputs information indicating the destination of the flying object and information indicating the flight route to the destination of the flying object.
[0080] <Operation> Next, the operation of the management device 100 according to the second embodiment of the present disclosure will be described in detail with reference to the drawings.
[0081] Fig. 4 is a flowchart illustrating an example of the operation of the management device 100 according to the second embodiment of the present disclosure. In the example illustrated in Fig. 4, the information acquisition unit 110 acquires information on an event that has occurred, information on the position of the flying object, and information on the remaining battery charge of the flying object (step S101).
[0082] Next, the change unit 120 determines whether the event affects the flight of the flying object to the destination from the event information (step S102). If the event does not affect the flight of the flying object to the destination (NO in step S102), the management device 100 ends the operation shown in FIG.
[0083] If the event affects the flight of the flying object to the destination (YES in step S102), the change unit 120 estimates the flight distance that the flying object can fly from the remaining battery power (step S103). Then, the change unit 120 determines whether or not to change the destination (step S104). If the destination is to be changed (YES in step S105), the management device 100 executes a destination change process (step S106). The destination change process will be described in detail later.
[0084] If the destination is not to be changed (NO in step S105), the management device 100 executes a route change process (step S107). The route change process will be described in detail later. Then, the management device 100 ends the operation shown in FIG.
[0085] 5 and 6 are flowcharts illustrating an example of the operation of the destination change process of the management device 100 according to the second embodiment of the present disclosure.
[0086] 5, the change unit 120 extracts a landing location that can handle the event and has a flight distance equal to or less than the possible flight distance (step S111). The landing location with the flight distance equal to or less than the possible flight distance is a landing location where the flight distance from the position of the flying object to the landing location when the flying object flies along a flight route that the flying object can fly is within a predetermined distance.
[0087] If a landing location that can correspond to the event and whose flight distance is equal to or less than the possible flight distance is extracted (YES in step S112), the change unit 120 sets the extracted landing location as the new destination (step S113). If multiple landing locations are extracted, the change unit 120 selects one landing location from the multiple extracted landing locations. The change unit 120 linearly selects, for example, the landing location with the shortest flight distance from the position of the flying object. The change unit 120 sets the selected landing location as the new destination. Then, the management device 100 next performs the operation of step S117 in FIG. 6.
[0088] If a landing location that can correspond to the event and whose flight distance is equal to or less than the possible flight distance has not been extracted (NO in step S112), the change unit 120 extracts a landing location that can correspond to the event and whose flight distance is equal to or less than the possible flight distance (step S114). In step S114, the change unit 120 selects a landing location other than the landing location that can correspond to the event. Then, the management device 100 next performs the operation of step S115 in FIG. 6.
[0089] If a landing location where the flight distance is equal to or less than the possible flight distance is not extracted (NO in step S115), the output unit 130 outputs information indicating that the changed destination could not be identified (step S120). Then, the management device 100 ends the operations shown in Figs. 5 and 6.
[0090] If a landing location with a flight distance equal to or less than the possible flight distance is extracted (YES in step S115), the change unit 120 sets the extracted landing location as the new destination (step S116). If multiple landing locations are extracted, the change unit 120 selects one landing location from the multiple extracted landing locations. The change unit 120, for example, linearly selects the landing location with the shortest flight distance from the position of the flying object. The change unit 120 sets the selected landing location as the new destination.
[0091] Then, the change unit 120 changes the destination of the flying object to the new destination (step S117). Next, the change unit 120 changes the flight route of the flying object to a flight route from the position of the flying object to a low-lying area (step S118).
[0092] Next, the output unit 130 outputs the information on the changed destination and the information on the flight route (step S119). Then, the management device 100 ends the operations shown in FIG.
[0093] Fig. 7 is a flowchart showing an example of the operation of the route change process of the management device 100 according to the second embodiment of the present disclosure. In the example shown in Fig. 7, the change unit 120 changes the flight route of the flying object to a flight route that the flying object can fly from the position of the flying object to the destination (step S121). Then, the output unit 130 outputs information on the flight route.
[0094] <Effects> The present embodiment described above has the same effects as the first embodiment, for the same reasons as those for the effects of the first embodiment.
[0095] <First Modification of the Second Embodiment> A management device according to a first modified example of the second embodiment of the present disclosure will be described in detail below with reference to the drawings. The management device according to this embodiment combines information on the destination of the flying object (including information on the changed destination) with an image captured by an imaging device mounted on the flying object, and outputs the image combined with the information on the destination of the flying object. The management device according to this embodiment combines information on the flight route to the destination of the flying object (including the changed destination) with an image captured by an imaging device mounted on the flying object, and outputs the image combined with the information on the flight route of the flying object.
[0096] FIG. 8 is a block diagram showing an example of the configuration of a management device according to a first modified example of the second embodiment of the present disclosure. In the example shown in FIG. 8, the management device 101 of this modified example includes an information acquisition unit 110, a change unit 120, an output unit 130, an information storage unit 140, an image acquisition unit 150, and a generation unit 160. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modified example have the same functions as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, except for the differences described below. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modified example perform the same operations as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, except for the differences described below. The following description will focus on the differences between this modified example and the second embodiment.
[0097] <Image Acquisition Unit 150> The image acquisition unit 150 acquires images captured by an imaging device mounted on the flying object (hereinafter, also referred to as captured images) from the flying object. The captured images are, for example, moving images. The captured images may be, for example, a time series of still images.
[0098] <Generation section 160> The generation unit 160 acquires information on the position of the flying object from the information acquisition unit 110. In this modification, the information on the position of the flying object includes information on the three-dimensional position of the flying object (i.e., the above-mentioned position information) and information on the direction in which the flying object is facing (i.e., the above-mentioned direction information).
[0099] The generation unit 160 further acquires information on the destination from the information acquisition unit 110. As described above, the information on the destination includes information on the position of the destination in the three-dimensional space. The generation unit 160 may further acquire information on the flight route to the destination from the information acquisition unit 110. As described above, the information on the flight route is information that specifies the shape of the flight route in the three-dimensional space.
[0100] The generating unit 160 holds in advance the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, and the camera parameters of the imaging device attached to the flying object. The generating unit 160 also regards the position of the flying object as the position of the imaging device.
[0101] The generation unit 160 calculates the position of the destination in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position of the destination in three-dimensional space. The generation unit 160 combines an indication of the destination in the captured image with the captured image. The indication of the destination is represented by, for example, a combination of at least one of characters and figures that indicate the position of the destination in the captured image.
[0102] The information on the destination may include information on the shape of the destination (specifically, the area at the destination where the flying object can land). The generation unit 160 may calculate the area of the destination in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position and shape of the destination in three-dimensional space. The generation unit 160 may synthesize, into the captured image, an indication indicating the above-mentioned destination, including a figure indicating the area of the destination in the captured image.
[0103] In this case, the output unit 130 outputs the captured image onto which an indication indicating the location of the destination (in other words, an indication indicating the location of the destination in the captured image) has been synthesized as information on the destination.
[0104] The generating unit 160 further calculates the shape of the flight route to the destination in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and information on the flight route in the three-dimensional space. The shape of the flight route to the destination in the captured image represents the shape of the flight route in the captured image when the flight route is imaged from the position of the flying object by the imaging device mounted on the flying object, assuming that the flight route itself in the three-dimensional space can be seen with the naked eye. The shape of the flight route may be represented by a figure such as a line. The shape of the flight route may be represented by a thicker line the closer it is to the flying object.
[0105] The generating unit 160 generates a captured image synthesized with a display showing the shape of the flight route. The display showing the shape of the flight route includes a figure such as a line showing the shape of the flight route. The display showing the shape of the flight route may include a combination including at least one of characters and figures showing the flight route.
[0106] In this case, the output unit 130 outputs the captured image onto which an indication of the shape of the flight route (in other words, an indication of the shape of the flight route in the captured image) has been synthesized as information of the destination.
[0107] The output unit 130 may output a captured image in which an indication of the location of the destination and an indication of the shape of the flight route are combined as information about the destination.
[0108] The color of the display indicating the location of the destination may be predetermined. The output unit 130 combines a display indicating the location of the destination in a predetermined color with the captured image. The color of the display indicating the shape of the flight route may also be predetermined. The output unit 130 combines a display indicating the shape of the flight route in a predetermined color with the captured image. The color of the display indicating the location of the destination may be the same as the color of the display indicating the shape of the flight route. The color of the display indicating the location of the destination may be different from the color of the display indicating the shape of the flight route.
[0109] In each modified example of the second embodiment of the present disclosure, the composition of the display with the captured image may be to change the pixel values of pixels included in the display area among the pixels of the captured image according to a predetermined method. For example, the composition of the display with the captured image may be to replace the pixel values of pixels included in the display area among the pixels of the captured image with pixel values representing a specific color. When the pixel values are represented by a combination of values of a plurality of elements, the composition of the display with the captured image may be to replace the value of a specific element of pixels included in the display area among the pixels of the captured image with a predetermined value. In this case, the composition of the display with the captured image may be to add a predetermined value to the value of a specific element of pixels included in the display area among the pixels of the captured image. In this case, the composition of the display with the captured image may be to subtract a predetermined value from the value of a specific element of pixels included in the display area among the pixels of the captured image. In this case, the composition of the display with the captured image may be to multiply the value of a specific element of pixels included in the display area among the pixels of the captured image by a predetermined value. The specific element is one or more predetermined elements. If the value of the combined element is greater than the maximum value of the element, the modification unit 120 replaces the value greater than the maximum value of the element with the maximum value of the element. If the value of the combined element is less than the minimum value of the element, the modification unit 120 replaces the value less than the minimum value of the element with the minimum value of the element. The elements of the pixel value may be red, blue, and green. The pixel value may be expressed in other color systems.
[0110] In this and other modified examples of the second embodiment, if the object represented by the display (e.g., the destination and flight route) is not included in the range captured by the imaging device, the generation unit 160 does not combine the display with the captured image.
[0111] In this and other modified examples of the second embodiment, a captured image whose display is composited is also referred to as a composite image.
[0112] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0113] <Second Modification of the Second Embodiment> Next, a second modified example of the second embodiment of the present disclosure will be described. The configuration of the management device according to this modified example is the same as the configuration of the management device 101 of the first modified example of the second embodiment of the present disclosure. Each unit that is a component of the management device 101 of this modified example has the same function as the unit that is given the same name and the same reference number in the management device 101 of the first modified example, except for the differences described below. Each unit that is a component of the management device 101 of this modified example performs the same operation as the unit that is given the same name and the same reference number in the management device 101 of the first modified example, except for the differences described below.
[0114] The generating unit 160 of this modified example further acquires information on the event that has occurred from the information acquiring unit 110. As described above, the information on the event includes information on the location where the event has occurred (also referred to as information on the location of the event). The information on the location where the event has occurred may be expressed by coordinates (for example, a combination of latitude and longitude, or a combination of latitude, longitude, and altitude) that represent the location where the event has occurred. The information on the location where the event has occurred may include information that represents the range affected by the event that has occurred in three-dimensional space (hereinafter, also referred to as the range of the event). In this case, the information on the location where the event has occurred may be, for example, the coordinates of a representative point (for example, a center of gravity, etc.) of the range of the event. For example, if the event is bad weather, the information on the location where the event has occurred may include information that represents the range where the event that is bad weather is occurring. For example, if the event is a congestion of flying objects, the information on the location where the event has occurred may include information that represents the range where the density of the flying objects is equal to or greater than a predetermined density. For example, if the event is the detection of jamming radio waves, the information on the location where the event has occurred may include information that represents the range within a predetermined distance from the location where the jamming radio waves are detected.
[0115] The range of the event may be represented by a triangular pyramid, a rectangular prism, a rectangular parallelepiped, another polyhedron, a cone, a sphere, a spheroid, or another solid figure in a three-dimensional space. The range of the event may be represented by a combination of a plurality of solid figures in a three-dimensional space. The range of the event may represent a horizontal range in a three-dimensional space. In this case, the generation unit 160 defines the range of the event in the three-dimensional space as the range vertically above the horizontal range on the ground.
[0116] The generation unit 160 further calculates the position at which an event occurred in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position at which the event occurred in three-dimensional space.
[0117] Then, the generating unit 160 generates a captured image with a display indicating the position where the event occurred (i.e., a composite image) synthesized. The display indicating the position where the event occurred is expressed by a combination of at least one of a character and a figure indicating the position where the event occurred in the captured image, for example.
[0118] When the information on the location where the event occurred includes information representing the range of the event, the generating unit 160 calculates the range of the event in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the range of the event in the three-dimensional space. The range of the event in the captured image represents the range of the event in the captured image when the range of the event is captured from the position of the flying object by the imaging device mounted on the flying object, assuming that the range of the event in the three-dimensional space can be visually observed.
[0119] Then, the generating unit 160 generates a captured image with a display representing the range of the event (i.e., a composite image). In this case, the display representing the range of the event includes a graphic representing the range of the event in the captured image. The display representing the range of the event may include a combination including a graphic representing the range of the event in the captured image and at least one of characters and other graphics representing the range of the event.
[0120] The output section 130 may output a captured image onto which an indication showing the range of an event in the captured image has been composited (that is, a composite image).
[0121] Furthermore, when the location where the event occurred is the location of the flying object, for example, when the event is at least one of the above-mentioned abnormality of the flying object and the passenger, the display showing the location where the event occurred may be a display showing the entire captured image. In this case, the change unit 120 may generate an image in which the color of all pixels of the captured image is changed according to a predetermined method, for example, as a captured image (i.e., a composite image) synthesized with the display showing the entire captured image.
[0122] When the position where the event occurred is the position of the flying object, the change unit 120 may set the position of the event that occurred in the captured image to a position that is predetermined in the captured image. The predetermined position in the captured image may be, for example, the center of the captured image. The predetermined position in the captured image may be, for example, a position that is not the center of the captured image. In this case, the display representing the event that occurred may be, for example, a figure of a predetermined shape, such as a polygon, a circle, an ellipse, another figure, or a combination of multiple figures. The display representing the event that occurred may be at least any combination of a character, a character string, and a figure of a predetermined shape that represents the event that occurred.
[0123] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0124] <Third Modification of the Second Embodiment> Next, a third modified example of the second embodiment of the present disclosure will be described. The configuration of the management device according to this modified example is the same as the configuration of the management device 101 of the second modified example of the second embodiment of the present disclosure. Each unit that is a component of the management device 101 of this modified example has the same function as the unit that is given the same name and the same reference numeral, except for the difference described below, in the management device 101 of the second modified example. Each unit that is a component of the management device 101 of this modified example performs the same operation as the unit that is given the same name and the same reference numeral, except for the difference described below, in the management device 101 of the second modified example.
[0125] The information acquisition unit 110 may further acquire information on unsuitable flight areas other than the area where the event occurred. The unsuitable flight area is, for example, an area that is determined as an area that is not suitable for flying a flying object. The unsuitable flight area can also be rephrased as a range in which an event continues to exist. The unsuitable flight area includes, for example, an area where the event occurred and an unsuitable flight area other than the area where the event occurred (for example, an area that is determined in advance as an unsuitable flight area). The unsuitable flight area other than the area where the event occurred is, for example, an area that is not suitable for flying a flying object other than the area where the event occurred. The unsuitable flight area other than the area where the event occurred may include, for example, an area where radio waves for communication are difficult to reach a flying object in flight, such as the shadow of a high-rise building. The unsuitable flight area other than the area where the event occurred may include, for example, an area where strong winds are likely to be blowing, such as near a high-rise building, and an area where air currents are complex. The unsuitable flight area other than the area where the event occurred may include an area including structures that may be an obstacle to the flight of the flying object, such as high-voltage power lines and steel towers, or large suspension bridges. The unsuitable flight area other than the area where the event occurred may be an area including natural objects that are not suitable for the flight of the flying object, such as an area including high rocks or steep cliffs. The information representing the unsuitable flight area other than the area where the event occurred may be information in the same format as the information representing the area where the event occurred.
[0126] The change unit 120 may set an area that is within a predetermined distance from the unsuitable flight area as the above-mentioned avoidance area.
[0127] The generating unit 160 calculates the unsuitable area for flight in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the unsuitable area for flight in the three-dimensional space. Specifically, the generating unit 160 calculates the range of the unsuitable area for flight in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the range of the unsuitable area for flight in the three-dimensional space. The range of the unsuitable area for flight in the captured image represents the range of the unsuitable area for flight in the captured image when the range of the unsuitable area for flight is imaged from the position of the flying object by the imaging device mounted on the flying object, assuming that the range of the unsuitable area for flight in the three-dimensional space can be visually observed.
[0128] The generating unit 160 generates a captured image (i.e., a composite image) onto which a display showing the range of the event is synthesized. The color of the display showing the range of the area where the event occurred may be different from the color of the display showing the range of the unsuitable flight area other than the area where the event occurred.
[0129] The generating unit 160 generates a captured image (i.e., a composite image) with a display showing the range of the unsuitable flight area combined. In this case, the display showing the range of the unsuitable flight area includes a graphic showing the range of the unsuitable flight area in the captured image. The display showing the range of the unsuitable flight area may include a combination including a graphic showing the range of the unsuitable flight area in the captured image and at least one of characters and other graphics showing the range of the unsuitable flight area.
[0130] The output unit 130 may output a captured image combined with a display showing the range of the unsuitable flight area within the captured image.
[0131] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0132] <Fourth Modification of the Second Embodiment> Next, a fourth modified example of the second embodiment of the present disclosure will be described in detail with reference to the drawings.
[0133] FIG. 9 is a block diagram showing an example of the configuration of a management device according to a fourth modified example of the second embodiment of the present disclosure. In the example shown in FIG. 9, the management device 102 according to this modified example includes an information acquisition unit 110, a change unit 120, an output unit 130, an information storage unit 140, and a prediction unit 170. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modified example have the same functions as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, respectively, except for the differences described below. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modified example perform the same operations as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, respectively, except for the differences described below.
[0134] <Information acquisition unit 110> The information acquisition unit 110 of this modified example further acquires a time series of event information. The event information includes information on the location of the event. Therefore, the time series of event information includes a time series of the location of the event. The event information may include information on the range of the event (also referred to as event range information). The time series of event information may include a time series of the location of the event. This time series of event information is a time series of event information that may change over time, such as bad weather, detection of jamming radio waves, and congestion of flying objects.
[0135] The information acquisition unit 110 may further acquire information on the predicted weather (e.g., any one of a wind direction forecast, a pressure distribution forecast, and a weather forecast, etc.) from an information processing device such as a server that provides information on the predicted weather.
[0136] <Prediction Section 170> The prediction unit 170 predicts the location of an event for each predetermined time from the time series of event information. In this case, the prediction unit 170 calculates, for example, the moving speed of the event location and the magnitude of change in the moving speed per unit time from the time series of event information. Then, the prediction unit 170 predicts the location of the event for each predetermined time (in other words, the transition of the location of the event) using the moving speed of the event location and the magnitude of change in the moving speed per unit time.
[0137] When the event information includes information on the range of the event, the prediction unit 170 may further predict the fluctuation of the range of the event from the time series of the event information. The fluctuation of the range of the event is, for example, the range of the event for each predetermined time (in other words, the transition of the range of the event). In this case, the prediction unit 170 calculates, for example, the transition of the amount of change in the size of the range of the event and the magnitude of the change in the amount of change in the size of the range of the event per unit time from the time series of the range of the event. Then, the prediction unit 170 predicts the size of the range of the event for each predetermined time (in other words, the transition of the size of the event) using the transition of the amount of change in the size of the range of the event and the magnitude of the change in the amount of change in the size of the range of the event per unit time. Then, the prediction unit 170 predicts the transition of the range of the event (the range of the event for each predetermined time) from the transition of the position of the event and the transition of the size of the range of the event.
[0138] The prediction unit 170 may predict the variation in the range of the event from the predicted weather information and the acquired range of the event using a pre-trained event prediction model. This event prediction model is a predictor that is pre-trained using an existing machine learning algorithm to predict the variation in the range of the event from the weather information and the range of the event using the relationship between the past weather information and the range of the event.
[0139] In addition, the unsuitable flight areas other than the area where the above-mentioned event occurred may change depending on the weather, for example, if the unsuitable flight area is an area unsuitable for flying objects due to strong winds. The prediction unit 170 may predict the unsuitable flight areas for each predetermined time period using a prediction model trained in advance from predicted weather information for each predetermined time period (for example, a wind speed forecast or a pressure distribution forecast). This prediction model is a predictor trained to predict the range of a certain unsuitable flight area from predicted weather information.
[0140] <Change section 120> The change unit 120 predicts the time when the flying object will fly over each point on the flight route of the flying object. If any point is within a range that is a predetermined distance from the range of the predicted event at the time when the flying object will fly over the point, the change unit 120 changes the flight route of the flying object.
[0141] In this case, specifically, the change unit 120 changes the flight route so that the flying object flying along the flight route does not pass through a point within a range that is a predetermined distance or less from the range of the predicted event at the time when the flying object is predicted to arrive. This corresponds to the change unit 120 setting the range within the predetermined distance from the range of the predicted event as an avoidance area. The range within the predetermined distance from the range of the predicted event is particularly referred to as a predicted avoidance area.
[0142] For example, first, assuming that there is no predicted avoidance area, the change unit 120 sets a flight route candidate that flies from the position of the flying object to the destination without passing through an avoidance area that is not the predicted avoidance area. Then, for each of the flight route candidates, the change unit 120 predicts the time when the flying object will fly at each point on the flight route candidate of the flying object. The points on the flight route candidate of the flying object are, for example, points at predetermined distances along the flight route candidate. If any point on the flight route candidate is included in the predicted avoidance area at the time when the flying object is predicted to fly at that point, the change unit 120 may exclude the flight route candidate from the flight route. The change unit 120 selects a flight route from the remaining flight route candidates. Then, the change unit 120 changes the flight route of the flying object to the selected flight route. When the prediction unit 170 predicts the range of the unsuitable flight area, the change unit 120 may further set a range that is a predetermined distance or less away from the predicted unsuitable flight area as the predicted avoidance range.
[0143] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0144] <Fifth Modification of the Second Embodiment> Next, a fifth modified example of the second embodiment of the present disclosure will be described in detail with reference to the drawings.
[0145] 10 is a block diagram illustrating an example of a configuration of a management device according to a fifth modified example of the second embodiment of the present disclosure. The management device 103 of this modified example includes an information acquisition unit 110, a change unit 120, an output unit 130, an information storage unit 140, an image acquisition unit 150, a generation unit 160, and a prediction unit 170.
[0146] The information acquisition unit 110, the change unit 120, the output unit 130, the information storage unit 140, and the prediction unit 170 of this modification have the same functions as the information acquisition unit 110, the change unit 120, the output unit 130, the information storage unit 140, and the prediction unit 170 of the fourth modification of the second embodiment, respectively, except for the differences described below. The information acquisition unit 110, the change unit 120, the output unit 130, the information storage unit 140, and the prediction unit 170 of this modification perform the same operations as the information acquisition unit 110, the change unit 120, the output unit 130, the information storage unit 140, and the prediction unit 170 of the fourth modification of the second embodiment, respectively, except for the differences described below. The image acquisition unit 150 of this modification has the same functions as the image acquisition unit 150 of the first modification. And, the image acquisition unit 150 of this modification performs the same operations as the image acquisition unit 150 of the first modification.
[0147] <Generation section 160> The generation unit 160 acquires information on the position of the flying object from the information acquisition unit 110. In this modification, the information on the position of the flying object includes information on the three-dimensional position of the flying object (i.e., the above-mentioned position information) and information on the direction in which the flying object is facing (i.e., the above-mentioned direction information).
[0148] The generation unit 160 of this modified example acquires information on the predicted avoidance area from the information acquisition unit 110. The information on the predicted avoidance area includes, for example, a time and information on the range of the predicted avoidance area predicted at that time. The information on the range of the predicted avoidance area may be expressed using coordinates in a three-dimensional space (for example, a combination of latitude and longitude, or a combination of latitude, longitude, and altitude).
[0149] The range of the predicted avoidance area may be represented by a triangular pyramid, a rectangular prism, a rectangular parallelepiped, another polyhedron, a cone, a sphere, a spheroid, or another solid figure in a three-dimensional space. The range of the predicted avoidance area may be represented by a combination of a plurality of solid figures in a three-dimensional space. The range of the predicted avoidance area may represent a horizontal range in a three-dimensional space. In this case, the generation unit 160 sets the range of the predicted avoidance area in the three-dimensional space to a range vertically above the horizontal range on the ground.
[0150] The generating unit 160 further calculates the range of the predicted avoidance area in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position where the event occurred in three-dimensional space. The range of the predicted avoidance area in the captured image represents the range of the predicted avoidance area in the captured image when the range of the event is imaged from the position of the flying object by the imaging device mounted on the flying object, assuming that the range of the predicted avoidance area in three-dimensional space can be visually observed.
[0151] Then, the generating unit 160 generates a captured image (i.e., a composite image) synthesized with a display indicating the range of the predictive avoidance area in the captured image. The display indicating the range of the predictive avoidance area is expressed by, for example, a combination of at least one of characters and figures indicating the range of the predictive avoidance area in the captured image.
[0152] Then, the generating unit 160 generates a captured image (i.e., a composite image) onto which a display showing the range of the predicted avoidance area is synthesized. In this case, the display showing the range of the event includes a graphic showing the range of the predicted avoidance area in the captured image. The display showing the range of the predicted avoidance area may include a combination including a graphic showing the range of the predicted avoidance area in the captured image and at least one of characters and other graphics showing the range of the predicted avoidance area.
[0153] The output section 130 may output a captured image combined with a display showing the range of the predicted avoidance region within the captured image (that is, a combined image).
[0154] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0155] When this modification is applied to a combination including any one of the first modification to the third modification of the second embodiment, the display color indicating the range of the predicted avoidance area may be different from the other display colors. The display colors may be determined for each type.
[0156] The generation unit 160 may combine the display indicating the range of the predicted avoidance area with the captured image in a pattern different from the patterns of other displays. The pattern in this case is, for example, a blinking pattern. For example, the generation unit 160 may combine the display indicating the range of the predicted avoidance area with the captured image so that it blinks. Then, the generation unit 160 may combine the display indicating the range of the predicted avoidance area with the captured image so that the other displays do not blink. These display patterns may be determined for each type of display.
[0157] Sixth Modification of the Second Embodiment Hereinafter, a management device according to a sixth modified example of the second embodiment of the present disclosure will be described in detail with reference to the drawings.
[0158] The configuration of the management device according to this modification is the same as the configuration of the management device 101 according to the first modification of the second embodiment of the present disclosure. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modification have the same functions as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, except for the differences described below. The information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of this modification perform the same operations as the information acquisition unit 110, the change unit 120, the output unit 130, and the information storage unit 140 of the second embodiment, except for the differences described below. The image acquisition unit 150 of this modification has the same functions as the image acquisition unit 150 of the first modification of the second embodiment of the present disclosure. The image acquisition unit 150 of this modification performs the same operations as the image acquisition unit 150 of the first modification of the second embodiment of the present disclosure.
[0159] <Generation section 160> The generation unit 160 acquires information on the position of the flying object from the information acquisition unit 110. In this modification, the information on the position of the flying object includes information on the three-dimensional position of the flying object (i.e., the above-mentioned position information) and information on the direction in which the flying object is facing (i.e., the above-mentioned direction information).
[0160] The generation unit 160 further acquires information on the landing site from the information acquisition unit 110. The landing site information as described above includes information on the position of the landing site in three-dimensional space.
[0161] The generating unit 160 holds in advance the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, and the camera parameters of the imaging device attached to the flying object. The generating unit 160 also regards the position of the flying object as the position of the imaging device.
[0162] The generation unit 160 calculates the position of the landing location in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position of the landing location in three-dimensional space. The generation unit 160 combines an indication of the landing location in the captured image with the captured image. The indication of the landing location is represented by, for example, a combination of at least one of characters and figures that indicate the position of the landing location in the captured image.
[0163] The information on the landing site may include information on the shape of the landing site (specifically, the area in the landing site where the flying object can land). The generation unit 160 may calculate the area of the landing site in the captured image from the position of the flying object, the relationship between the direction of the flying object and the direction of the imaging device attached to the flying object, the camera parameters of the imaging device, and the position and shape of the destination in three-dimensional space. The generation unit 160 may synthesize, into the captured image, an indication indicating the above-mentioned landing site, including a figure indicating the area of the landing site in the captured image.
[0164] In this case, the output unit 130 outputs the captured image onto which an indication of the position of the landing site (in other words, an indication of the position of the landing site in the captured image) has been synthesized.
[0165] The generation unit 160 may combine, in different colors, the display of landing locations where the flying object can land and the display of landing locations where the flying object cannot land on the captured image.
[0166] The information on the landing site may include information indicating the availability of the landing site (also referred to as the capacity). The information indicating the availability of the landing site is, for example, information on the number of flying objects that can newly land at the landing site. The number of flying objects that can newly land at the landing site may be, for example, a number input by an administrator of the landing site, etc., as the number of flying objects of a predetermined size that can newly land. The number of flying objects that can newly land at the landing site may be, for example, a number input by an administrator of the landing site, etc., as the number of flying objects of a specific type that can newly land.
[0167] The generating unit 160 may synthesize, with the captured image, a display of a landing site where the flying object can land, in a color according to the degree of availability of the landing site. The degree of availability of the landing site may be represented, for example, by a range that includes the availability of the landing site among a plurality of predetermined availability ranges. The plurality of availability ranges is, for example, a range of the number of flying objects that can newly land. Specifically, for example, when the number of flying objects that can newly land on the landing site is equal to or greater than a first threshold, the generating unit 160 may synthesize, with the captured image, a display of the landing site in a specific color (for example, green). For example, when the number of flying objects that can newly land on the landing site is less than the first threshold and equal to or greater than a second threshold, the generating unit 160 may synthesize, with the captured image, a display of the landing site in another specific color (for example, yellow). For example, when the number of flying objects that can newly land on the landing site is less than the second threshold, the generating unit 160 may synthesize, with the captured image, a display of the landing site in yet another specific color (for example, red). Examples of the degree of availability are not limited to the above examples. The number of ranges of the degree of vacancy is not limited to the above examples.The examples of colors are not limited to the above examples.
[0168] The landing site information may include information representing the degree of availability as information representing the availability of the landing site. The information representing the degree of availability is, for example, information that represents the degree of availability using multiple values. The multiple values representing the degree of availability may represent, for example, "sufficient," "crowded," "few remaining," and "none," respectively. Examples of the multiple values representing the degree of availability are not limited to these examples.
[0169] In this case, the generation unit 160 may superimpose an indication of a landing site where the flying object can land on the captured image in a color according to the degree of availability of the landing site, which is included in the information on the landing site.
[0170] In addition, when there are multiple landing locations that can be selected as the destination, the change unit 120 may select the destination from the multiple landing locations using information representing the availability of the multiple landing locations. For example, the change unit 120 may select the landing location with the largest availability represented by the information representing the availability of the landing locations from the multiple landing locations as the destination. For example, the change unit 120 may calculate the flight distance when flying a flight route from the position of the flying object to each of the multiple landing locations. The change unit 120 may select the landing location with the largest availability as the destination from the landing location with the shortest flight distance and the landing location with a flight distance whose difference from the shortest flight distance is within a predetermined distance among the multiple landing locations.
[0171] This modification can also be applied to other modifications of the second embodiment and combinations of other modifications of the second embodiment.
[0172] <Seventh Modification of the Second Embodiment> The configuration of the management device 100 according to the seventh modified example of the second embodiment of the present disclosure is the same as the configuration of the management device 100 of the second embodiment. The management device 100 of this modified example is the same as the management device 100 of the second embodiment, except for the differences described below.
[0173] In this modification, the landing site transmits a signal indicative of the availability of the landing site. The availability of the landing site is input, for example, by a landing site manager. Specifically, for example, a transmitter installed at the landing site transmits the signal indicative of the availability of the landing site, for example, by wireless communication.
[0174] The flying object of this modification receives a signal indicating the availability of the landing site transmitted from the landing site. Then, the information acquisition unit 110 acquires from the flying object information indicated by the signal indicating the availability of the landing site received by the flying object. <Eighth Modification of the Second Embodiment> 11 is a block diagram showing an example of the configuration of a management device according to an eighth modified example of the second embodiment of the present disclosure. The management device 104 according to this modified example further includes an image acquisition unit 150 in addition to the units included in the management device 100 of the second embodiment. The image acquisition unit 150 of this modified example is the same as the image acquisition unit 150 of the first modified example of the second embodiment. The management device 104 of this modified example is the same as the management device 100 of the second embodiment, except for the differences described below.
[0175] In this variant, the landing site transmits information indicating the availability of the landing site, set by the landing site manager, by a light pattern. The light pattern differs depending on the availability of the landing site. This light pattern corresponds to a signal indicating the availability of the landing site.
[0176] Specifically, a light-emitting device installed at the landing site may emit a light pattern. The light emitted from the landing site may be, for example, light (including reflected light) emitted from an object (including a human) present at the landing site.
[0177] The light pattern may be, for example, a pattern of wavelengths of light emitted by a light-emitting device installed at the landing site. The light pattern may be, for example, a blinking pattern of light emitted by a light-emitting device installed at the landing site. The light-emitting device may be, for example, a laser, an LED (Light-Emitting Diode), a floodlight, a display, or a lighting device. The light pattern may be, for example, a pattern of gestures made by a staff member at the landing site. The light pattern may be a pattern of a flag hoisted at the landing site.
[0178] The information acquisition unit 110 of this modified example extracts the area of the landing site from the captured image acquired by the image acquisition unit 150, for example, by using information on the position of the flying object, camera parameters of the imaging device mounted on the flying object, and information on the position of the landing site. The information acquisition unit 110 further identifies the landing site from which the area was extracted. The information acquisition unit 110 further detects a light pattern representing the degree of availability of the landing site in the area of the landing site in the captured image. The information acquisition unit 110 determines the degree of availability of the landing site represented by the detected light pattern.
[0179] <Ninth Modification of the Second Embodiment> The configuration of the management device 104 in the ninth modified example of the second embodiment is the same as the configuration of the management device 104 in the eighth modified example of the second embodiment. The management device 104 in this modified example is the same as the management device 104 in the eighth modified example of the second embodiment, except for the differences described below.
[0180] The information acquisition unit 110 of this modification extracts the area of the landing place from the captured image acquired by the image acquisition unit 150, similarly to the information acquisition unit 110 of the eighth modification of the second embodiment. The information acquisition unit 110 further identifies the landing place from which the area is extracted. The information acquisition unit 110 further estimates the area of the possible landing area in a three-dimensional space from the area of the extracted landing place, the position of the flying object, the position of the landing place, and the camera parameters of the imaging device. The information acquisition unit 110 may determine, in the extracted landing place area, a connected area in which the change in pixel value is equal to or less than a predetermined value as the possible landing area. Then, the information acquisition unit 110 may determine, among the connected areas in the image in which the change in pixel value is equal to or less than a predetermined value, an area in the three-dimensional space that is equal to or more than a predetermined value as the possible landing area. The information acquisition unit 110 determines the degree of availability of the landing place from the area of the possible landing area in the three-dimensional space. The information acquisition unit 110 may determine, for example, the number of areas that are included in the possible landing area in the three-dimensional space and are defined as areas necessary for landing of a flying object of a predetermined size, as the degree of availability of the landing site. In this modification, the image acquired by the information acquisition unit 110 from the image acquisition unit 150 corresponds to information representing a signal that indicates the degree of availability of the landing site.
[0181] <Tenth Modification of the Second Embodiment> In a tenth modification of the second embodiment of the present disclosure, the information acquisition unit 110 acquires, from a plurality of flying objects, information on the positions of the flying objects, information on the destinations, and information on the flight routes to the destinations.
[0182] The change unit 120 of this modified example determines which flying object the event that has occurred will affect the flight to the destination. The change unit 120 then changes the flight route, or the destination and flight route, of the flying object whose flight to the destination will be affected by the event that has occurred, in the same manner as the change unit 120 of the second embodiment. When the change destinations of the flying objects whose destinations are changed are determined at the same timing, if the change destinations of the flying objects are the same landing place, the change unit 120 determines whether the flying objects can land at the same landing place. The change unit 120 determines whether the flying objects can land at the same landing place, for example, by using information indicating the degree of availability of the landing place. The degree of availability of the landing place in this case may be represented by, for example, the number of flying objects of a predetermined size that can newly land at the landing place. The change unit 120 may determine that the flying objects cannot land at the landing place when the number of flying objects whose landing place has become the change destination of the flying objects is greater than the number of flying objects that can newly land at the landing place that has become the change destination of the flying objects minus a predetermined number. When it is determined that the multiple flying objects can land at the landing location that has become the changed destination of the multiple flying objects, the change unit 120 changes the destination of the multiple flying objects to the changed destination.
[0183] When it is determined that a plurality of flying objects cannot land at the landing location that has become the new destination of the flying objects, the change unit 120 selects the flying objects using, for example, the severity of the event that has affected the flight to the destination. The above-mentioned severity may be determined in advance for each type of event. The change unit 120 selects flying objects in a number obtained by subtracting a predetermined number from the number of flying objects that can newly land at the landing location that has become the new destination (hereinafter referred to as the landing allowable number) in order of the severity of the event that has affected the flight to the destination. The change unit 120 changes the destination of the selected flying object to the new destination. The change unit 120 selects a new new destination of the flying object that has not been selected from the landing locations other than the new destination.
[0184] When there are a plurality of flying objects whose flying objects have the same severity of an event that has affected the flight to the destination among the flying objects whose flying objects have the same landing location as their new destination destination, the change unit 120 may determine the ranking of the severity among the plurality of flying objects by a predetermined method. The same landing location is hereinafter referred to as a competing landing location. The change unit 120 may determine the ranking of flying objects whose flying objects have the same severity of a competing landing location as their new destination destination, for example, so that the ranking is higher the longer the distance from the position of the flying object to a landing location selected as the new destination destination of the flying object when the flying object cannot land at the competing landing location as the new destination destination. The change unit 120 may determine the ranking of flying objects whose flying objects have the same severity of a competing landing location as their new destination destination, for example, so that the ranking is higher the shorter the distance from the position of the flying object to the competing landing location as the new destination destination. The change unit 120 may randomly determine the ranking of flying objects whose flying objects have the same severity of a competing landing location as their new destination destination. The change unit 120 may use other methods to determine the ranking of flying objects of the same severity whose competing landing sites have become changed destinations.
[0185] For each landing site, there may be a reservation system that accepts landing reservations. The reservation system accepts requests to reserve a flying object, for example on a first-come, first-served basis, until the number of landing sites available is exhausted.
[0186] When the management device 100 has determined the new destination of the air vehicle, it transmits a reservation request for landing of the air vehicle to the reservation system of the landing site determined as the new destination.
[0187] This reservation system receives a reservation request for landing of an air vehicle from, for example, the management device 100. If the allowable number of landing locations is not zero at the time of receiving the reservation request for landing of the air vehicle, the reservation system decreases the allowable number of landing locations by 1. Then, the reservation system notifies the management device 100 that transmitted the reservation request for landing of the air vehicle that the reservation has been accepted. If the allowable number of landing locations is zero at the time of receiving the reservation request for landing of the air vehicle, the reservation system notifies the management device 100 that transmitted the reservation request for landing of the air vehicle that the reservation has been rejected. If the air vehicle has taken off from the landing location, the reservation system increases the allowable number by 1. If information indicating that the air vehicle has taken off from the landing location is input, for example, by the manager of the landing location, the reservation system determines that the air vehicle has taken off from the landing location.
[0188] When the management device 100 is notified that a reservation has been accepted in response to a reservation request for landing of the air vehicle at a landing site that is a new destination, the management device 100 changes the destination of the air vehicle to the new destination. When the management device 100 is notified that a reservation has been rejected in response to a reservation request for landing of the air vehicle at a landing site that is a new destination, the management device 100 selects a new destination from among landing sites other than the new destination.
[0189] <Eleventh Modification of the Second Embodiment> Fig. 12 is a block diagram showing an example of the configuration of a management device according to an eleventh modification of the present disclosure. In the example shown in Fig. 12, the management device 105 of this modification further includes a generating unit 160 in addition to the units of the management device 100 of the second embodiment. The management device 105 of this modification is the same as the management device 100 of the second embodiment, except for the differences described below.
[0190] The generating unit 160 acquires information on the position of the flying object and information on the position of the destination from the information acquiring unit 110. The generating unit 160 generates a composite image by synthesizing a display indicating the position of the destination with a map of an area including the position of the flying object and the position of the destination. The display indicating the position of the destination includes at least one of a figure and a character indicating the position of the destination on the map. The generating unit 160 may hold map information in advance. The generating unit 160 may acquire the map information from the information acquiring unit 110. In this case, the information acquiring unit 110 acquires the map information from, for example, a server that provides the map information. The generating unit 160 may acquire the map information from the changing unit 120. In this case, the map information may be stored in, for example, the information storage unit 140. The changing unit 120 may read out the map information from the information storage unit 140.
[0191] When the destination of the flying object is changed to a new destination, the change unit 120 transmits information about the new destination to the generation unit 160. The generation unit 160 acquires the information about the new destination from the change unit 120. When the information about the new destination is acquired, the generation unit 160 generates a composite image in which an indication indicating the position of the new destination is synthesized with a map of an area including the position of the flying object and the position of the new destination, instead of a composite image in which an indication indicating the position of the destination before the change is synthesized.
[0192] The generating unit 160 may obtain information on the location of the landing site from, for example, the information obtaining unit 110. The generating unit 160 may generate a composite image by combining a map of an area including the location of the flying object with an indication of the location of the landing site. The indication of the location of the landing site includes at least one of a figure and a character that indicates the location of the destination on the map.
[0193] In addition to the information on the location of the landing site, the generation unit 160 may further acquire information on the capacity of the landing site from the information acquisition unit 110. The generation unit 160 may generate a composite image in which a display showing the location of the landing site is combined with a map of an area including the location of the flying object in a color determined according to the capacity of the landing site.
[0194] The generating unit 160 may generate a composite image in which a map including the location of the destination and the location of the flying object is combined with an indication of the location of the destination and an indication of the location of the landing site. In this case, when the destination of the flying object is changed to a new destination, the generating unit 160 generates a composite image in which a map including the location of the new destination and the location of the flying object is combined with an indication of the location of the new destination and an indication of the location of the landing site.
[0195] The generating unit 160 may further generate a composite image in which an indication of the position of the flying object is synthesized.
[0196] The output unit 130 outputs the composite image generated by the generation unit 160.
[0197] <Twelfth Modification of the Second Embodiment> In a twelfth modified example of the second embodiment, the event may be the receipt of a work request. The work request is, for example, a request to perform a specified work at a specified work location. The work location is a location specified in the work request. The specified work may be specified in the work request. The specified work may be determined in advance. The specified work is specifically the transmission of an image captured using an imaging device to a specified destination. The destination may be determined in advance. The destination may be determined in the work request. The work request is, for example, a request to capture an image at a specified location (for example, a location where an accident or incident occurred) and transmit the image to a specified destination.
[0198] If the event that has occurred is a work request, the change unit 120 changes the flight route of the flying object to a flight route that passes through the work site. The change unit 120 further transmits information representing the work request to a control device that the pilot uses to control the flying object.
[0199] <Thirteenth Modification of the Second Embodiment> In the management device 101 and the management device 103 of the above-mentioned modified example, a device including a function of displaying a composite image of the image acquisition unit 150, the generation unit 160, and the output unit 130 and a device including other parts may be implemented as separate devices capable of communicating with each other. Hereinafter, a device including a function of displaying a composite image of the image acquisition unit 150, the generation unit 160, and the output unit 130 is referred to as a composite device. In addition, in the management device 101 and the management device 103, another device including a part other than the composite device and capable of communicating with the composite device is referred to as a management device. In other words, the management device 101 and the management device 103 of the above-mentioned modified example may be implemented as a system including the above-mentioned composite device and management device that can communicate with each other. In this case, a device including a function of displaying a composite image of the image acquisition unit 150, the generation unit 160, and the output unit 130 may be mounted on an air vehicle.
[0200] <Other embodiments> The management device according to the above embodiment and the management device according to the modified example can be realized by a computer including a memory into which a program read from a storage medium is loaded and a processor that executes the program. These management devices can also be realized by dedicated hardware. These management devices can also be realized by a combination of the above computer and dedicated hardware.
[0201] FIG. 13 is a diagram showing an example of a hardware configuration of a computer 1000 that can realize the management device according to the embodiment of the present disclosure and the management device according to the modified example. In the example shown in FIG. 13, the computer 1000 includes a processor 1001, a memory 1002, a storage device 1003, and an I / O (Input / Output) interface 1004. The computer 1000 can also access a storage medium 1005. The memory 1002 and the storage device 1003 are, for example, storage devices such as a RAM (Random Access Memory) and a hard disk. The storage medium 1005 is, for example, a storage device such as a RAM or a hard disk, a ROM (Read Only Memory), or a portable storage medium. The storage device 1003 may be the storage medium 1005. The processor 1001 can read and write data and programs from the memory 1002 and the storage device 1003. The processor 1001 can access other information processing devices such as flying objects and servers via the I / O interface 1004. The processor 1001 can access a storage medium 1005. The storage medium 1005 stores a program that causes the computer 1000 to operate as the above-mentioned management device.
[0202] The processor 1001 loads a program, which is stored in the storage medium 1005 and causes the computer 1000 to operate as the above-mentioned management device, into the memory 1002. Then, the processor 1001 executes the program loaded into the memory 1002, causing the computer 1000 to operate as the above-mentioned management device.
[0203] The information acquisition unit 110, the change unit 120, the output unit 130, the image acquisition unit 150, the generation unit 160, and the prediction unit 170 can be realized, for example, by a processor 1001 that executes a program loaded into a memory 1002. Furthermore, the information storage unit 140 can be realized by a memory 1002 or a storage device 1003 such as a hard disk device included in the computer 1000. Alternatively, some or all of the information acquisition unit 110, the change unit 120, the output unit 130, the information storage unit 140, the image acquisition unit 150, the generation unit 160, and the prediction unit 170 can be realized by a dedicated circuit that realizes the function of each unit.
[0204] Furthermore, some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0205] (Appendix 1) An information acquisition means for acquiring information on an event that has occurred; a change means for changing the destination of the flying object to a landing site corresponding to the event among landing sites where the flying object can land, when the event affects the flight of the flying object to the destination; an output means for outputting information on the changed destination; A management device comprising:
[0206] (Appendix 2) The change means selects the changed destination from the landing locations associated with the type of the event. 2. The management device of claim 1.
[0207] (Appendix 3) The change means, when the event is at least one of an abnormality of the flying object and an abnormality of a passenger of the flying object, selects the changed destination from among the landing sites that can respond to the event. 3. The management device according to claim 2.
[0208] (Appendix 4) The flying object is equipped with an imaging device, the information acquisition means acquires flying object position information representing a position and a direction of the flying object; an image acquisition means for acquiring an image captured by the imaging device; a generating means for generating a composite image in which information on the new destination is synthesized at the position of the new destination in the captured image by using the flying object position information; Equipped with The output means outputs the composite image. 3. The management device according to claim 1 or 2.
[0209] (Appendix 5) The information acquisition means acquires location information representing a state of the landing site, The generating means generates the composite image in which information about the landing site is further synthesized at the position of the landing site in the captured image. 5. The management device according to claim 4.
[0210] (Appendix 6) The information acquisition means acquires information on an allowable amount indicating an amount of flying objects that can newly land on the landing site, The generating means generates the composite image in which the information on the landing site is combined with a color indicating the capacity of the landing site. 6. The management device according to claim 5.
[0211] (Appendix 7) When the color indicating the tolerance changes, the generating means generates the composite image in which the landing site information is combined with a pattern indicating that the tolerance has changed. 7. The management device according to claim 6.
[0212] (Appendix 8) The air vehicle receives a signal transmitted from the landing site that is indicative of the capacity of the landing site; The information acquiring means acquires information of a signal representing the permissible amount as the information of the permissible amount. 7. The management device according to claim 6.
[0213] (Appendix 9) the signal representing the tolerance is light of a pattern representing the tolerance, The information acquisition means receives the image of the landing site as information of the signal, extracts the pattern from the area of the landing site in the image, and estimates the allowable amount from the extracted pattern. 9. The management device according to claim 8.
[0214] (Appendix 10) The pattern is a pattern of the wavelength of the light, a pattern of the blinking of the light, a pattern of gestures of the staff at the landing site, or a pattern of a flag hoisted at the landing site. 10. The management device of claim 9.
[0215] (Appendix 11) The information acquisition means receives event range information which is information indicating an event range which is a range of the event, The generating means generates the composite image in which information indicating the event range is further synthesized in a region of the captured image that represents the event range. 6. The management device according to claim 5.
[0216] (Appendix 12) The change means changes the flight route of the flying object to a changed flight route heading toward the changed destination, The generating means generates the composite image in which information indicating the changed flight route is further synthesized at a position of the changed flight route in the captured image. 5. The management device according to claim 4.
[0217] (Appendix 13) The information acquiring means acquires, as the information of the event, event range information which is information indicating an event range which is a range of the event, The change means changes the flight route to the changed flight route that does not pass through the event area. 13. The management device of claim 12.
[0218] (Appendix 14) When there is no flight route to the destination that does not pass through the event area, the change means selects the changed destination from the landing locations that can be reached without passing through the event area. 14. The management device of claim 13.
[0219] (Appendix 15) The information acquisition means acquires a time series of the event range information, The management device includes a prediction unit that predicts a fluctuation in the event range from the time series, The change means changes the flight route to a flight route that does not pass through a predicted event range, which is a region that is predicted to be in the event range at a time when the flight of the flying object is predicted, based on flight performance of the flying object and fluctuations in the predicted event range. 14. The management device of claim 13.
[0220] (Appendix 16) The information acquisition means acquires a time series of the event range information, The management device includes a prediction unit that predicts a fluctuation in the event range from the time series, The generating means generates the composite image by further combining information on a predicted event range, which is a region that is predicted to be in the event range at a time when the flight of the flying object is predicted, based on the flight performance of the flying object and the predicted fluctuation of the event range. 12. The management device of claim 11.
[0221] (Appendix 17) When the event is a request to observe an event at a place where the event occurs, the change means changes a flight route along which the flying object flies to a changed flight route that passes through the place where the event occurs. 2. The management device of claim 1.
[0222] (Appendix 18) The flying object includes an abnormality receiving means for receiving input of passenger abnormality information indicating an abnormality of a passenger, The information acquisition means receives the passenger abnormality information input by the abnormality receiving means as information on the event. 3. The management device according to claim 1 or 2.
[0223] (Appendix 19) The information acquisition means receives a remaining battery charge of the flying object and a time series of event range information that is information indicating an event range that is a range of the event, a prediction means for predicting a fluctuation in the event range from the time series, The change means selects the changed destination from among the landing sites that are present within a range that can be flown with the remaining charge of the battery without passing through the event range and a predicted event range, which is an area that is predicted to be in the event range at a time when the flight of the flying object is predicted based on the flight performance of the flying object and the predicted fluctuation of the event range. 3. The management device according to claim 1 or 2.
[0224] (Appendix 20) Obtain information about the event that occurred, If the event affects the flight of the aerial vehicle to its destination, change the destination of the aerial vehicle to a landing site where the aerial vehicle can land, the landing site being a landing site according to the event; outputting information on the changed destination; Management method.
[0225] (Appendix 21) An information acquisition process for acquiring information on an event that has occurred; When the event affects the flight of the flying object to the destination, a change process is performed to change the destination of the flying object to a landing site where the flying object can land, the landing site being a landing site according to the event; an output process for outputting information on the changed destination; A program that causes a computer to execute the following.
[0226] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. [Explanation of symbols]
[0227] 10 Management device 100 Management device 101 Management device 102 Management device 103 Management device 104 Management device 105 Management device 110 Information Acquisition Department 120 Changes 130 Output section 140 Information storage section 150 Image acquisition unit 160 Generation part 170 Prediction Department 1000 Computers 1001 Processor 1002 Memory 1003 Storage device 1004 I / O Interface 1005 Storage medium
Claims
1. An information acquisition means for acquiring information on an event that has occurred; a change means for changing the destination of the flying object to a landing site corresponding to the event among landing sites where the flying object can land, when the event affects the flight of the flying object to the destination; an output means for outputting information on the changed destination; A management device comprising:
2. The change means selects the changed destination from the landing locations associated with the type of the event. The management device according to claim 1 .
3. The change means, when the event is at least one of an abnormality of the flying object and an abnormality of a passenger of the flying object, selects the changed destination from among the landing sites that can respond to the event. The management device according to claim 2 .
4. The flying object is equipped with an imaging device, the information acquisition means acquires flying object position information representing a position and a direction of the flying object; an image acquisition means for acquiring an image captured by the imaging device; a generating means for generating a composite image in which information on the new destination is synthesized at the position of the new destination in the captured image by using the flying object position information; Equipped with The output means outputs the composite image. The management device according to claim 1 or 2.
5. The information acquisition means acquires location information representing a state of the landing site, The generating means generates the composite image in which information about the landing site is further synthesized at the position of the landing site in the captured image. The management device according to claim 4.
6. The information acquisition means acquires information on an allowable amount indicating an amount of flying objects that can newly land on the landing site, The generating means generates the composite image in which the information on the landing site is combined with a color indicating the capacity of the landing site. The management device according to claim 5 .
7. The information acquisition means receives event range information which is information indicating an event range which is a range of the event, The generating means generates the composite image in which information indicating the event range is further synthesized in a region of the captured image that represents the event range. The management device according to claim 5 .
8. The information acquisition means acquires a time series of the event range information, The management device includes a prediction unit that predicts a fluctuation in the event range from the time series, The generating means generates the composite image by further combining information on a predicted event range, which is a region that is predicted to be in the event range at a time when the flight of the flying object is predicted, based on the flight performance of the flying object and the predicted fluctuation of the event range. The management device according to claim 7.
9. Obtain information about the event that occurred, If the event affects the flight of the aerial vehicle to its destination, change the destination of the aerial vehicle to a landing site where the aerial vehicle can land, the landing site being a landing site according to the event; outputting information on the changed destination; Management method.
10. An information acquisition process for acquiring information on an event that has occurred; When the event affects the flight of the flying object to the destination, a change process is performed to change the destination of the flying object to a landing site where the flying object can land, the landing site being a landing site according to the event; an output process for outputting information on the changed destination; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Taking-off / landing device, control method of taking-off / landing device, and program
JP2019031164A
Cited By
Operation management device, operation management system, and operation management method
WO2026146610A1
