Information processing device, information display method, and program
The system addresses the lack of integrated base and UAV information in existing monitoring systems by displaying a list of UAVs and their base information, improving operator monitoring efficiency and safety.
Patent Information
- Application Number
- JP2023223104
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-28
- Publication Date
- 2025-07-10
- Estimated Expiration
- 2043-12-28
AI Technical Summary
Existing systems for monitoring multiple unmanned aerial vehicles (UAVs) do not provide sufficient information to operators, as they only display data from the UAVs and lack integration of critical information from the bases where the UAVs take off and land.
An information processing apparatus and method that displays a list of UAVs on an operator's terminal, acquires and integrates aircraft information from selected UAVs and base information from their takeoff/landing bases, and highlights important data points for the operator.
Provides operators with more comprehensive and timely information for effective monitoring of multiple UAVs, enhancing operational efficiency and safety.
Smart Images

Figure 2025104920000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of remote monitoring systems and the like that can remotely monitor unmanned aerial vehicles.
Background Art
[0002] Conventionally, it has been expected to use unmanned aerial vehicles such as drones for delivery services. In order to achieve multi-aircraft operation in a delivery service using an unmanned aerial vehicle, from the perspective of cost reduction and the like, it is necessary for one operator to monitor a plurality of unmanned aerial vehicles. For example, Patent Document 1 discloses a technique for realizing optimization of display of information including a plurality of images transmitted from a plurality of aircraft. According to the technique described in Patent Document 1, the user interface screen of the user terminal has a plurality of display areas 61 and 62A-62E for displaying image / video data transmitted from each aircraft, and among the plurality of aircraft, the image / video data received from the aircraft selected by the user is displayed in the display area 61 having a larger display area than the display areas 62A-62E, so that the user can more easily confirm the image / video data received from the selected aircraft.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, the technique described in Patent Document 1 only displays the information transmitted from each aircraft. However, for an operator who monitors a plurality of unmanned aerial vehicles, not only the information from the unmanned aerial vehicle but also the information from the base where the unmanned aerial vehicle can take off and land is important.
[0005] Therefore, the present invention has been made in view of the above points and the like, and an object of the present invention is to provide an information processing apparatus, an information display method, and a program that can provide more useful information for monitoring to an operator who monitors a plurality of unmanned aerial vehicles.
Means for Solving the Problem
[0006] (Application Example 1) In order to solve the above problem, the information processing apparatus according to the present application example includes: a first display control means for displaying a list showing the plurality of unmanned aerial vehicles on the screen of the operator's terminal that monitors the plurality of unmanned aerial vehicles; a first acquisition means for acquiring aircraft information acquired by the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; a second acquisition means for acquiring base information acquired by equipment at a base where the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land; and a second display control means for displaying the aircraft information acquired by the first acquisition means and the base information acquired by the second acquisition means on the screen of the terminal.
[0007] (Application Example 2) In order to solve the above problem, the information display method according to the present application example is an information display method executed by one or more computers, and includes: a step of displaying a list showing the plurality of unmanned aerial vehicles on the screen of the operator's terminal that monitors the plurality of unmanned aerial vehicles; a step of acquiring aircraft information acquired by the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; a step of acquiring base information acquired by equipment at a base where the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land; and a step of displaying the acquired aircraft information and the acquired base information on the screen of the terminal.
[0008] (Application Example 3) To solve the above problems, the program according to this application example causes a computer included in a terminal used by an operator who monitors a plurality of unmanned aerial vehicles to display a list showing the plurality of unmanned aerial vehicles on the screen of the terminal, and to obtain aircraft information acquired by the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list, and to obtain base information acquired by equipment at a base where the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land, and to display the acquired aircraft information and the acquired base information on the screen of the terminal. It is characterized by executing.
Effect of the Invention
[0009] According to the present invention, it is possible to provide useful information that is more helpful for monitoring to an operator who monitors a plurality of unmanned aerial vehicles.
Brief Explanation of Drawings
[0010]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Embodiments for Carrying Out the Invention
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The following embodiment is an embodiment when the present invention is applied to a remote monitoring system capable of remotely monitoring a drone.
[0012] 1. Configuration and Operational Overview of Remote Monitoring System S First, with reference to FIG. 1, the configuration and operation outline of the remote monitoring system S according to the present embodiment will be described. FIG. 1 is a diagram showing an example of the schematic configuration of the remote monitoring system S. As shown in FIG. 1, the remote monitoring system S includes a plurality of drones Dn (n = 1, 2, 3 ···), a plurality of operator terminals Tm (m = 1, 2 ···), and a management server MS (an example of an information processing device), etc. The drone Dn, the operator terminal Tm, and the management server MS are each connected to the communication network NW. The communication network NW is composed of, for example, the Internet, a mobile communication network, and its radio base stations, etc.
[0013] The drone Dn is an example of an unmanned aerial vehicle and is also called a multicopter or a UAV (Unmanned Aerial Vehicle). The drone Dn can take off according to a takeoff instruction from the GCS (Ground Control Station) and fly autonomously, and is used, for example, for delivery, surveying, photography, monitoring, etc. The GCS is, for example, installed as an application on the operator terminal Tm and is configured to cooperate with the management server MS. Note that the drone Dn can also fly according to remote control from the ground by a control terminal (not shown) equipped with the GCS.
[0014] The drone Dn is under the jurisdiction of (in other words, belongs to) one of the plurality of drone bases Bm. The drone base Bm is a base (such as a facility) where the drone Dn can take off and land. In the example of FIG. 1, the drones D1 to D4 are each under the jurisdiction of (i.e., belong to) the drone base B1, depart from the drone base B1, and return to the drone base B1. Also, the drones D5 to D9 are each under the jurisdiction of the drone base B2, depart from the drone base B2, and return to the drone base B2. However, one drone Dn may be under the jurisdiction of a plurality of drone bases Bm (i.e., may belong to a plurality of drone bases Bm). For example, the drone D11 (not shown) may depart from the drone base B2 and return to the drone base B1. Note that the number of drones Dn under the jurisdiction of one drone base Bm is not particularly limited.
[0015] Also, at the drone base Bm, a port Pm used for the takeoff and landing of the drone Dn and a base device Em (an example of a device) used for monitoring the drone Dn are installed. At the drone base Bm, a pre-flight inspection (aircraft condition check) of the drone Dn is performed by base staff (manually). For example, the base staff visually inspects or touches a predetermined part of the drone Dn for each inspection item of the manual inspection. Then, the manual inspection result information (an example of base information) indicating the result of the inspection by the base staff is transmitted from a terminal (an example of a device) such as the base staff's smartphone to the management server MS via the communication network NW. Also, the drone Dn that has undergone the pre-flight inspection is placed at the port Pm and takes off (departs) from the port Pm according to a predetermined schedule. Also, the drone Dn that has returned to the drone base Bm lands at the port Pm. Note that a plurality of ports Pm may be installed at one drone base Bm.
[0016] The base device Em is connected to the communication network NW, equipped with a base camera (e.g., RGB camera or infrared camera) for monitoring the drone Dn, and stores a base ID (identification information) for identifying the drone base Bm. The base camera is adapted to continuously image the drone Dn placed, for example, at the port Pm or the inspection location. The base image information (an example of base information) representing the image (still image or moving image) captured by the base camera is transmitted from the base device Em to the management server MS together with the base ID. Note that a plurality of base cameras may be installed at one drone base Bm. Further, the base device Em may be equipped with a wind sensor for detecting (measuring) at least one of the wind speed and the wind direction. The measurement information (an example of base information) measured by the wind sensor is transmitted from the base device Em to the management server MS. Furthermore, the base device Em may be equipped with at least one of a temperature sensor, a humidity sensor, a rainfall (snowfall) amount sensor, and an atmospheric pressure sensor. The measurement information (an example of base information) measured by these sensors is transmitted from the base device Em to the management server MS.
[0017] The operator terminal Tm is a terminal used by an operator OPm who remotely monitors a plurality of drones Dn. For example, the operator OP1 monitors the drones D1 to D4 under his / her responsibility while looking at the information displayed on the screen (user interface screen) of the operator terminal T1. Such monitoring includes, for example, confirmation of the pre-flight inspection status of a plurality of drones Dn, monitoring of the pre-flight aircraft state, and monitoring of the in-flight aircraft state. During the period when such monitoring is being performed, there are timings that require particular attention to a specific part within the screen (that is, the operator OPm pays attention to the specific part), and such timings are referred to as key attention timings. Here, a specific part within the screen is referred to as a part that prompts the operator OPm to pay attention. Examples of parts that prompt attention include character strings, items, tabs, and images (videos). The parts that prompt attention are highlighted. Highlighting corresponds to displaying in a prominent display mode (for example, display color, display size, etc.). Note that the key attention timing may be a point in time or may have a certain time duration (time width). Examples of key attention timings include the takeoff time of the drone Dn and the landing time of the drone Dn.
[0018] The management server MS is composed of one or more server computers that manage information regarding the drone base Bm for each drone base Bm. Information regarding the drone base Bm includes, for example, information on the drones Dn under the jurisdiction of the drone base Bm, information on the operator OPm who monitors the drones Dn, and information on the operator terminal Tm used by the operator OPm. The management server MS identifies a plurality of drones Dn that the operator OPm in charge, who has logged in by operating the operator terminal Tm, is responsible for, and causes a list (hereinafter referred to as the "drone list") indicating the identified plurality of drones Dn to be displayed on the operator terminal Tm of the operator OPm. Also, the management server MS periodically or irregularly receives weather information of the drone base Bm from a weather management server (not shown) via the communication network NW. The weather information indicates the weather (clear, rain, snow, cloudy, etc.) of the drone base Bm.
[0019] 1-1. Configuration and Functions of Drone Dn Next, with reference to FIG. 2, the configuration and functions of the drone Dn will be described. FIG. 2 is a diagram showing a schematic configuration example of the drone Dn. As shown in FIG. 2, the drone Dn includes a power supply unit 11, a drive unit 12, a positioning unit 13, a communication unit 14, a sensor unit 15, a memory unit 16, a control unit 17, and the like. Further, the drone Dn includes propellers (rotors) that are horizontal rotating wings, and arm pipes (including arm joints) for attaching the propellers to the drone body (housing), and the like. When the drone Dn is used for delivering an article, the drone Dn is provided with a holding mechanism or the like for holding the article.
[0020] The power supply unit 11 includes a detachable battery (power storage device) or the like. The power supply unit 11 supplies (powers) the electric power stored in the battery to each part of the drone Dn. Further, the power supply unit 11 sequentially measures the remaining battery level. Battery information indicating the remaining battery level measured by the power supply unit 11 is output to the control unit 17. The drive unit 12 includes a motor, a rotating shaft, and the like. The drive unit 12 rotates a plurality of rotors by a motor and a rotating shaft or the like that are driven according to a control signal output from the control unit 17.
[0021] The positioning unit 13 includes a radio wave receiver, an altitude sensor, etc. The positioning unit 13 receives, for example, radio waves transmitted from positioning satellites of GNSS (Global Navigation Satellite System) such as GPS (Global Positioning System) by the radio wave receiver, and sequentially detects the current position of the drone Dn based on the radio waves. The current position of the UAV1 may be represented by the latitude and longitude of the UAV1, or may be represented by the latitude, longitude, and altitude of the UAV1. Here, the positioning satellites may include satellites used by a plurality of satellite positioning systems such as GPS satellites, Michibiki satellites, and Galileo satellites. The position information indicating the current position detected by the positioning unit 13 is continuously output to the control unit 17. At this time, the capture number information indicating the number of captured positioning satellites (satellite capture number) captured by the positioning unit 13 is continuously output to the control unit 17. Note that the positioning unit 13 may detect the altitude of the drone Dn by an altitude sensor. In this case, the position information indicating the current position of the drone Dn includes the altitude detected by the altitude sensor. The communication unit 14 includes an antenna and a wireless communication function, and is responsible for controlling communication performed via the communication network NW.
[0022] The sensor unit 15 includes various sensors used for controlling the drone Dn. The various sensors include, for example, a compass (geomagnetic sensor), a gyro (3-axis angular velocity sensor), a 3-axis acceleration sensor, a barometric pressure sensor, a gimbal, an optical sensor, and a range finder (distance meter), etc. The optical sensor includes an airframe camera (for example, an RGB camera or an infrared camera), etc. The airframe camera is configured to continuously image the surroundings of the drone Dn (for example, in front of or below the drone Dn). Note that the orientation of the airframe camera (in front of or below the drone Dn) can be controlled by the control unit 17. The sensed sensing information of the sensor unit 15 is output to the control unit 17. The storage unit 16 is composed of a non-volatile memory, etc., and stores various programs and data. Further, the storage unit 16 stores an airframe ID (identification information) for identifying the drone Dn.
[0023] The control unit 17 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and controls the drone Dn based on the position information from the positioning unit 13 and the sensing information from the sensor unit 15. Such control includes control of the rotation speed of the propellers, control of the position, attitude, and traveling direction of the drone Dn, etc. The position information of the drone Dn (that is, the position information from the positioning unit 13) is transmitted to the management server MS via the communication network NW together with the aircraft image information (an example of aircraft information) representing the image (still image or moving image) captured by the above-mentioned aircraft camera, the battery information from the power supply unit 11 (an example of aircraft information), the capture count information from the positioning unit 13 (an example of aircraft information), and the aircraft ID of the drone Dn.
[0024] Also, the control unit 17 has a self-diagnosis function and automatically checks whether a predetermined part of the drone Dn (for example, the power supply unit 11, the drive unit 12, the positioning unit 13, the communication unit 14, and the sensor unit 15, etc.) is operating normally. The inspection items for the automatic inspection include, for example, the remaining battery level, battery cell balance, GPS, compass, gyro, acceleration sensor, barometric pressure sensor, gimbal, optical sensor, and range finder, etc. The automatic inspection result information indicating the result of the automatic inspection by the drone Dn (that is, the control unit 17) is transmitted to the management server MS via the communication network NW. Note that the automatic inspection by the drone Dn is executed before the flight of the drone Dn, but some of the inspection items for the automatic inspection are also carried out during the flight of the drone Dn.
[0025] 1-2. Configuration and Functions of Operator Terminal Tm Next, with reference to FIG. 3, the configuration and functions of the operator terminal Tm will be described. FIG. 3 is a diagram showing a schematic configuration example of the operator terminal Tm. The operator terminal Tm includes an operation / display unit 21, a communication unit 22, a storage unit 23, a control unit 24, and the like. Note that, for example, a personal computer can be applied to the operator terminal Tm. The operator terminal Tm may be provided with an audio processing unit and a speaker. The operation / display unit 21 has, for example, an input function for receiving an input (selection) by a finger, a pen, or a mouse of the operator OPm, and a display function for displaying various screens on a display.
[0026] The communication unit 22 is responsible for controlling communication performed via the communication network NW. The storage unit 23 is composed of a non-volatile memory or the like, and stores various programs (program code groups) and data. The various programs include an operating system (OS), a monitoring application, GCS, and a web browser. The monitoring application is mainly a program for obtaining and displaying a drone list or the like indicating a plurality of drones Dn in charge of the operator OPm from the management server MS. Note that the monitoring application may be downloaded to the operator terminal Tm from a predetermined server.
[0027] The control unit 24 (an example of a computer) includes a CPU, a ROM, a RAM, and the like, and executes processing according to the monitoring application stored in the ROM (or the storage unit 23). When the monitoring application is started in response to an instruction from the operator OPm, the control unit 24 causes a login screen to be displayed on the display. Then, when a user ID and a password are input by the operator OPm through the login screen, the control unit 24 transmits a login request including the user ID and the password to the management server MS via the communication unit 22 and the communication network NW. The user ID is identification information for identifying the operator OPm.
[0028] When the operator OPm logs in in response to a login request, display control data for displaying a list of drones Dn assigned to the logged-in operator OPm is transmitted from the management server MS. As a result, the control unit 24 causes a drone monitoring screen including the drone list to be displayed on the display. Here, the plurality of drones Dn shown in the drone list may be under the jurisdiction of the same drone base Bm or may be under the jurisdiction of different drone bases Bm. In the latter case, the drone list shows the drones Dn (for example, drones D1 to D4 and drones D5 to D9) belonging to each of the plurality of drone bases Bm (for example, drone base B1 and drone base B2). As a result, the operator can monitor each drone Dn under the jurisdiction of the plurality of drone bases Bm. Note that the display control data may be data of a web page displayed by a web browser. The display control data of the drone monitoring screen may be incorporated in a monitoring application.
[0029] FIGS. 4 and 5 are diagrams showing display examples of a drone monitoring screen displayed on the operator terminal T1 of the operator OP1. As shown in FIGS. 4 and 5, on the drone monitoring screen, as an example, a drone list L showing drones D1 to D4 under the jurisdiction of the drone base B1 is displayed, and further, a drone basic information display area A1, a drone detailed information display area A2, an airframe camera display area A3, and a base camera display area A4 are provided. The drone list L is composed of simple information display areas LA1 to LA4 corresponding to each of the drones D1 to D4 assigned to the operator OP1. The simple information display areas LA1 to LA4 are scrollable. In the simple information display areas LA1 to LA4, the names (drone names) of the drones D1 to D4 are displayed. Note that the drone list L may include simple information display areas corresponding to each of the drones D5 to D9 assigned to the operator OP1.
[0030] In addition, the simple information display areas LA1 to LA4 can be selected by the operator OP1. In other words, drones D1 to D4 can be selected via the simple information display areas LA1 to LA4. In the display examples of FIGS. 4 and 5, since drone D1 is in a selected state for takeoff determination by the selection (pressing) of the simple information display area LA1 by the operator OP1, monitoring information (appropriately acquired from the management server MS) for monitoring the drone D1 in the selected state is displayed in the drone basic information display area A1, the drone detailed information display area A2, the aircraft camera display area A3, and the base camera display area A4. Here, the monitoring information includes, for example, manual inspection result information, base image information, aircraft data information, aircraft image information, and weather information. In the display example of FIG. 4, drone D1 is placed at port P1 for takeoff at drone base B1 and is waiting for the takeoff decision by the operator OP1. On the other hand, in the display example of FIG. 5, drone D1 is in a state of flying (ascending) above port P1.
[0031] In the drone basic information display area A1, the basic information of the drone D1, the status of the drone D1, the phase of the drone D1, the schedule of the drone D1, the weather information of the drone base B1, and the takeoff decision button B are displayed. Note that the measurement information measured by the sensor included in the base device Em may be displayed in the drone basic information display area A1. In the display examples of FIGS. 4 and 5, the basic information of the drone D1 includes, for example, the name, type, model number, manufacturer, base name (the name of the drone base B1), and port name (the name of the port P1) of the drone D1, but is not particularly limited. The status of the drone D1 (hereinafter referred to as the "drone status") indicates what state the drone D1 is in. In the display example of FIG. 4, the drone status is "immediately before takeoff", while in the display example of FIG. 5, the drone status is "in flight". Such drone statuses include, in addition to immediately before takeoff and in flight, for example, on the ground waiting, before flight (before takeoff), delivery item dropping, immediately before landing, returning, error occurrence, etc. Error occurrence is, for example, the drone status when any abnormality is detected by the automatic inspection by the drone Dn.
[0032] The phase of the drone D1 (hereinafter referred to as the "drone phase") roughly indicates what stage the drone D1 is in. In the display examples of FIGS. 4 and 5, "preparing for delivery", "in flight", and "returning" are displayed in the phase display section A11 as the drone phases. And in the display example of FIG. 4, "preparing for delivery" is displayed in the phase display section A11, while in the display example of FIG. 5, "in flight" is displayed. The display content of the phase display section A11 switches according to the switching of the drone phase. Note that the same expression (for example, in flight, etc.) may be used for the drone status and the drone phase. The schedule of the drone D1 includes, for example, the scheduled times for takeoff, flight, landing, and return of the drone D1.
[0033] In the drone detailed information display area A2, an aircraft status check tab TB1, an aircraft data information tab TB2, and a weather status TB3 are displayed. In the display example of FIG. 4, among the tabs TB1 to TB3, since the aircraft status check tab TB1 is selected and displayed, aircraft status check information is displayed below the tabs TB1 to TB3. In response to the drone status reaching just before takeoff, the tab TB1 is automatically selected, and aircraft status check information is displayed to prompt the operator OP1 to pay attention. The display of such aircraft status check information can also be referred to as the highlighting of aircraft status check information. Thereby, the operator OP1 can quickly grasp at a glance the parts that require attention according to the current drone status of the drone D1. The aircraft status check information is based on the manual inspection result information described above. The "OK" displayed in association with the inspection item "looseness of the arm joint" included in the aircraft status check information indicates that, for example, the result of this manual inspection (aircraft status check) is good.
[0034] On the other hand, in the display example of FIG. 5, among the tabs TB1 to TB3, since the aircraft data tab TB2 is selected and displayed, aircraft data information is displayed below the tabs TB1 to TB3. The display of such aircraft data information can also be referred to as the highlighting of aircraft data information. The aircraft data information is based on the battery information (remaining battery level) and the capture number information (satellite capture number) described above. The check mark displayed in association with the item "remaining battery level" included in the aircraft data information indicates that, for example, the remaining battery level is good. For example, as the drone status changes from "just before takeoff" shown in FIG. 4 to "in flight" shown in FIG. 5, the selected display automatically switches from the aircraft status check tab TB1 to the aircraft data tab TB2. Note that the tabs TB1 to TB3 can each be manually selected by the operator OP1. For example, when the weather status TB3 is selected, weather information of the drone base B1 is displayed below the tabs TB1 to TB3.
[0035] In the aircraft camera display area A3, a moving image captured by the aircraft camera of the drone D1 (hereinafter referred to as the "aircraft camera video") is displayed. On the other hand, in the base camera display area A4, a moving image captured by the base camera of the base device E1 (hereinafter referred to as the "base camera video") is displayed. In the display example of FIG. 4, the drone status is "immediately before takeoff", which corresponds to the timing that requires attention. Therefore, the base camera video is highlighted as a part to prompt attention (for example, the frame A41 of the base camera display area A4 is displayed in red). Thus, when the operator OP1 selects (presses) the takeoff decision button B in the drone basic information display area A1 in a state where the drone status is "immediately before takeoff", a takeoff command is transmitted to the drone D1. As a result, when the drone D1 takes off from the port P1, as shown in FIG. 5, the display of the drone status and the drone phase switches to "in flight". In synchronization with this, the highlighting of the base camera video switches to the highlighting of the aircraft camera video (for example, the frame A31 of the aircraft camera display area A3 is displayed in red). Therefore, the fact that the drone phase has switched can be conveyed to the operator OP1 in a more understandable manner compared to the display of the drone status and the drone phase. At this time, the highlighting of the base camera video is cancelled (that is, it returns to the normal display). After that, when the drone D1 reaches the waypoint above the port P1 and starts flying towards the delivery destination, the highlighting of the aircraft camera video is cancelled.
[0036] 1-3. Configuration and Functions of Management Server MS Next, with reference to FIG. 6, the configuration and functions of the management server MS will be described. FIG. 6 is a diagram showing a schematic configuration example of the management server MS. As shown in FIG. 6, the management server MS includes a communication unit 31, a storage unit 32, a control unit 33, and the like. The communication unit 31 is responsible for controlling communication performed via the communication network NW. Manual inspection result information, base image information, measurement information, and base ID transmitted from the base device E are received by the communication unit 31. Battery information, capture number information, airframe image information, position information of the drone Dn, and airframe ID transmitted from the drone Dn are received by the communication unit 31. The management server MS can recognize the current position of the drone Dn based on the position information of the drone Dn. Also, a login request transmitted from the operator terminal Tm is received by the communication unit 31. Further, weather information transmitted from the weather management server is received by the communication unit 31.
[0037] The storage unit 32 is composed of, for example, a hard disk drive or the like, and stores various programs including an operating system and applications. Here, the application includes a program for executing an information processing method. Further, a base management database (DB) 321, a drone management database (DB) 322, and an operator management database (DB) 323 are constructed in the storage unit 32.
[0038] The base management database 321 is a database for managing information related to the drone base Bm. In the base management database 321, for example, the base ID of the drone base Bm, base image information, measurement information, weather information, and the airframe ID of the drone Dn under the jurisdiction of the drone base Bm are stored in association with each other for each drone base Bm. Note that the base image information, measurement information, and weather information may be appropriately updated each time they are received by the communication unit 31.
[0039] The drone management database 322 is a database for managing information regarding the drone Dn. In the drone management database 322, information such as the airframe ID, location information, basic information, drone status, drone phase, schedule, manual inspection result information, airframe data information, and airframe image information of the drone Dn is stored in association with each drone Dn. The airframe data information includes, for example, battery information and capture count information. Note that the manual inspection result information, airframe data information, and airframe image information may be appropriately updated each time they are received by the communication unit 31. Also, the drone status and drone phase of the drone Dn are appropriately updated based on, for example, various information received by the communication unit 31, the schedule of the drone Dn, and instruction information from the administrator or the like.
[0040] The operator management database 323 is a database for managing information regarding the operator OPm. In the operator management database 323, information such as the user ID, password, login status, airframe ID of each of the multiple drones Dn in charge, and name of the operator OPm is stored in association with each operator OPm. Here, the login status indicates whether the operator OPm is logged in.
[0041] The control unit 33 (an example of a computer) includes a CPU, a ROM, a RAM, and the like. FIG. 7 is a diagram showing an example of a functional block in the control unit 33. The control unit 33 functions as, for example, a login processing unit 33a, a base identification unit 33b (an example of base identification means), a drone list display control unit 33c (an example of first display control means), a drone selection reception unit 33d, a monitoring information acquisition unit 33e (an example of first acquisition means and second acquisition means), a drone status determination unit 33f (an example of first identification means and detection means), a drone phase determination unit 33g (an example of first identification means and detection means), a fixation part identification unit 33h (an example of second identification means), a fixation timing determination unit 33i (an example of determination means), and a monitoring information display control unit 33j (an example of second display control means) as shown in FIG. 7 according to a program (a program code group) stored in, for example, the ROM or the storage unit 32.
[0042] The login processing unit 33a performs the login processing of the operator OPm in response to a login request from the operator terminal Tm. In such login processing, it is determined whether or not the set of user ID and password included in the login request is registered in the operator management database 323. And when the set of user ID and password is registered, the operator OPm who uses the operator terminal Tm that sent the login request is identified (identified by the user ID), and the operator OPm logs in.
[0043] When the operator OPm is identified by the login processing, the base identification unit 33b identifies a plurality of drones Dn in charge of the operator OPm, and identifies the drone base Bm to which the identified drones Dn belong for each drone Dn. For example, in the operator management database 323, the drone Dn identified by the aircraft ID associated with the user ID of the logged-in operator OPm is identified as the drone Dn in charge of the operator OPm. And the drone base Bm identified by the base ID associated with the aircraft ID of the identified drone Dn (that is, the base ID associated with the aircraft ID in the base management database 321) is identified as the drone base Bm to which the drone Dn belongs.
[0044] The drone list display control unit 33c generates a drone list (for example, including the drone name and aircraft ID) indicating the drones Dn in charge of the logged-in operator OPm. Then, the drone list display control unit 33c transmits display control data for displaying the generated drone list to the operator terminal Tm of the logged-in operator OPm, so that, for example, as shown in FIG. 4, the drone list is displayed on the drone monitoring screen of the operator terminal Tm.
[0045] The drone selection reception unit 33d receives, from the operator terminal Tm via the communication unit 22, selection information of any one drone Dn selected by the logged-in operator OPm from among a plurality of drones Dn shown in the drone list displayed on the drone monitoring screen of the operator terminal Tm. Such selection information includes information (for example, drone name or aircraft ID) for specifying the drone Dn selected by the logged-in operator OPm. Thereby, the drone selection reception unit 33d receives the selection of the drone Dn.
[0046] The monitoring information acquisition unit 33e acquires monitoring information for monitoring the drone Dn selected by the logged-in operator OPm (that is, the selection of which is received by the drone selection reception unit 33d). For example, the monitoring information acquisition unit 33e acquires, as monitoring information from the drone management database 322, basic information, drone status, drone phase, schedule, manual inspection result information, aircraft data information, aircraft image information, etc., associated with the aircraft ID of the selected drone Dn. Further, the monitoring information acquisition unit 33e acquires, as monitoring information from the base management database 321, base image information, measurement information, weather information, etc., associated with the base ID of the drone base Bm to which the drone Dn selected by the logged-in operator OPm belongs, among the drone bases Bm (for example, a plurality of drone bases Bm) specified by the base specifying unit 33b. Thereby, it becomes possible to quickly present to the operator OPm the base information of the drone bases Bm to which the plurality of drones Dn in charge of the operator OPm belong.
[0047] The drone status determination unit 33f identifies the current drone status of the drone Dn selected by the logged-in operator OPm from the monitoring information acquired by the monitoring information acquisition unit 33e. Further, even after the drone status determination unit 33f has identified the current drone status of the drone Dn from the monitoring information, it may identify the current drone status of the drone Dn by referring to the drone management database 322 at predetermined time intervals (for example, 1 second to 60 seconds). Then, the drone status determination unit 33f detects a change in the current drone status of the drone Dn selected by the logged-in operator OPm (for example, a change from immediately before takeoff to in-flight).
[0048] The drone phase determination unit 33g identifies the current drone phase of the drone Dn selected by the logged-in operator OPm from the monitoring information acquired by the monitoring information acquisition unit 33e. Further, even after the drone phase determination unit 33g has identified the current drone phase of the drone Dn from the monitoring information, it may identify the current drone phase of the drone Dn by referring to the drone management database 322 at predetermined time intervals. Then, the drone phase determination unit 33g detects a change in the current drone phase of the drone Dn selected by the logged-in operator OPm (for example, a change from delivery preparation to in-flight).
[0049] The attention part specifying unit 33h specifies a part that prompts the logged-in operator OPm to pay attention based on the current drone status specified by the drone status determination unit 33f. For example, when the drone status is just before takeoff, the aircraft status check information shown in FIG. 4 is specified as the part that prompts attention. Also, when the drone status is just before takeoff, the base camera video may be specified as the part that prompts attention. On the other hand, when the drone status is in flight or an error has occurred, the aircraft data information shown in FIG. 5 is specified as the part that prompts attention. Also, when the drone status is in flight and until the drone Dn reaches the waypoint above the port Pm, the aircraft camera video may be specified as the part that prompts attention (furthermore, the orientation of the aircraft camera may be specified as downward). Note that when the drone status is in flight and after the drone Dn reaches the waypoint above the port Pm until the delivery item is dropped, the aircraft camera video may be specified as the part that prompts attention (furthermore, the orientation of the aircraft camera may be specified as forward).
[0050] Also, the attention part specifying unit 33h may specify a part that prompts the logged-in operator OPm to pay attention based on the current drone phase specified by the drone phase determination unit 33g. For example, when the drone phase is delivery preparation, the base camera video shown in FIG. 4 is specified as the part that prompts attention. On the other hand, when the drone phase is in flight, the aircraft camera video shown in FIG. 5 is specified as the part that prompts attention. Note that when the drone phase is return, the base camera video and the aircraft camera video may not be specified as the part that prompts attention. Furthermore, even after the attention part specifying unit 33h has specified the part that prompts attention, it is preferable to specify a part that prompts the logged-in operator OPm to pay attention at a predetermined time interval based on the current drone status or drone phase of the drone Dn selected by the logged-in operator OPm.
[0051] The attention-required timing determination unit 33i determines, at a predetermined time interval, whether or not the timing requiring attention for the logged-in operator OPm has arrived based on the current drone status specified by the drone status determination unit 33f or the current drone phase specified by the drone phase determination unit 33g. For example, it is determined that the timing requiring attention has arrived when the drone status determination unit 33f detects a change in the current drone status. In this case, it is preferably determined that the timing requiring attention has arrived when it is detected that the current drone status has changed immediately before takeoff (or immediately before dropping the delivery, landing, or occurrence of an error). Alternatively, it may be determined that the timing requiring attention has arrived when the drone phase determination unit 33g detects a change in the current drone phase.
[0052] The monitoring information display control unit 33j transmits, to the operator terminal Tm of the logged-in operator OPm, display control data for displaying the monitoring information acquired by the monitoring information acquisition unit 33e, so that, for example, as shown in FIG. 4, the monitoring information is displayed on the drone monitoring screen of the operator terminal Tm. At this time, the monitoring information display control unit 33j transmits, to the operator terminal Tm of the operator OPm, highlighting display control data for highlighting the "part prompting attention" specified by the attention part specifying unit 33h on the drone monitoring screen. Here, the highlighting display control data may be transmitted to the operator terminal Tm together with the display control data for displaying the monitoring information. The highlighting display control data includes information (for example, an identifier of the part or coordinates of the part) for identifying the "part prompting attention" specified by the attention part specifying unit 33h to the operator terminal Tm. Thereby, as described above, on the drone monitoring screen, the part prompting attention to the logged-in operator OPm is highlighted. Therefore, the operator OPm can immediately grasp the part that particularly requires attention on the drone monitoring screen.
[0053] In addition, when the monitoring information display control unit 33j determines that the timing requiring attention has arrived by the timing determination unit 33i while the monitoring information is being displayed on the drone monitoring screen, the highlighting display control data for highlighting the "portion prompting attention" specified by the attention portion specifying unit 33h at the timing requiring attention may be transmitted to the operator terminal Tm of the operator OPm. Thereby, the portion prompting attention can be highlighted at the timing required for the operator OPm. Therefore, the monitoring information display control unit 33j can switch the highlighting display of the portion prompting attention, for example, in response to detecting a change in the current drone status or the switching of the drone phase. That is, in synchronization with the switching of the display of the current drone status or the drone phase, for example, the highlighting display can be switched from the highlighting display of the base camera image to the highlighting display of the aircraft camera image. Therefore, the operator OPm can be made to more quickly and easily grasp the fact that the display of the current drone status or the drone phase has been switched.
[0054] 2. Operation of Remote Monitoring System S Next, with reference to FIGS. 8 and 9, the operation of the remote monitoring system S will be described. FIG. 8 is a sequence diagram showing an example of the monitoring information display process executed by the operator terminal T1 (control unit 24) and the management server MS (control unit 33). FIG. 9 is a sequence diagram showing an example of the highlighting display update process executed by the operator terminal T1 (control unit 24) and the management server MS (control unit 33). In the following description of the operation, the case where the drone Dn in charge of the operator OP1 using the operator terminal T1 is monitored will be described as an example.
[0055] When the monitoring application is started in response to an instruction from the operator OP1 on the operator terminal T1, a login screen is displayed on the display. Then, the operator terminal T1 transmits a login request including the user ID and password input by the operator OP1 through the login screen to the management server MS (step S0).
[0056] Next, when the management server MS receives a login request from the operator terminal T1, in response to the login request, the login processing unit 33a performs login processing (step S1). In such login processing, it is determined whether the combination of the user ID and password included in the login request is registered in the operator management database 323. For example, when the combination of the user ID and password included in the login request is stored in the operator management database 323, it is determined that the combination of the user ID and password is registered, and the operator OP1 using the operator terminal T1 logs in.
[0057] Next, the management server MS identifies a plurality of drones Dn in charge of the logged-in operator OP1 (step S2). For example, in the operator management database 323, the drone Dn is identified by the aircraft ID associated with the user ID of the operator OP1. Next, the management server MS identifies, for each drone Dn identified in step S2, the drone base Bm to which each drone Dn belongs, by the base identification unit 33b (step S3). For example, in the base management database 321, the drone base Bm is identified by the base ID associated with the aircraft ID of the drone Dn identified in step S2. The drone base Bm identified here may be one or a plurality.
[0058] Next, the management server MS generates a drone list indicating the plurality of drones Dn identified in step S2 (step S4). Next, the management server MS transmits a first display control command including display control data for displaying the drone list generated in step S4 to the operator terminal T1 by the drone list display control unit 33c (step S5).
[0059] Next, when the operator terminal T1 receives the first display control command from the management server MS, it causes, for example, as shown in FIG. 4, the drone list L to be displayed on the drone monitoring screen according to the display control data (step S6). When, for example, the drone D1 is selected by the operator OP1 from among the drones Dn shown in the drone list L thus displayed, the operator terminal T1 transmits the selection information of the drone D1 to the management server MS (step S7).
[0060] Next, when the management server MS receives the selection information from the operator terminal T1, it accepts the selection of the drone D1 by the drone selection reception unit 33d (step S8). Next, the management server MS acquires, by the monitoring information acquisition unit 33e, the monitoring information for monitoring the drone D1 selected by the operator OP1 (step S9). Here, the monitoring information includes the basic information, drone status, drone phase, schedule, manual inspection result information, airframe data information, and airframe image information of the drone D1 selected from among the plurality of drones Dn specified in step S2. Further, the monitoring information includes the base image information and measurement information, etc. of the drone base B1 to which the selected drone D1 belongs among the drone bases Bm specified in step S3.
[0061] Next, the management server MS specifies, by the drone status determination unit 33f, the current drone status of the drone D1 selected by the operator OP1 (step S10). Next, the management server MS specifies, by the drone phase determination unit 33g, the current drone phase of the drone D1 selected by the operator OP1 (step S11).
[0062] Next, the management server MS specifies, by means of the attention part specifying unit 33h, the part that prompts the operator OP1 to pay attention based on the drone status specified in step S10 or the drone phase specified in step S11 (step S12). Here, the attention part specifying unit 33h may specify, respectively, the part that prompts attention according to the drone status (for example, an image) and the part that prompts attention according to the drone phase (that is, specify parts that prompt different attentions).
[0063] Next, the management server MS transmits, by means of the monitoring information display control unit 33j, a second display control command including the display control data for displaying the monitoring information acquired in step S9 and the highlighting control data for highlighting the part that prompts attention specified in step S12 to the operator terminal T1 (step S13).
[0064] Next, when the operator terminal T1 receives the second display control command transmitted in step S13 from the management server MS, it displays, for example, as shown in FIG. 4, the monitoring information including the above-described aircraft information and base information on the drone monitoring screen of the operator terminal Tm according to the display control data and the highlighting control data (step S14), and highlights the part that prompts the operator OP1 to pay attention (step S15).
[0065] Next, in FIG. 9, the management server MS determines whether or not an update opportunity has arrived (step S16). For example, when a predetermined time (for example, 1 second to 60 seconds) has elapsed since the transmission of the previous second display control command, it is determined that an update opportunity has arrived. If it is determined that an update opportunity has not arrived (step S16: NO), the process proceeds to step S17. On the other hand, if it is determined that an update opportunity has arrived (step S16: YES), the process proceeds to step S18.
[0066] In step S17, the management server MS determines whether to end the process. For example, when the operator OP1 logs out, it is determined that the process ends (step S17: YES), and the process shown in FIG. 9 ends. On the other hand, when it is determined that the process does not end (step S17: NO), the process returns to step S16.
[0067] In step S18, the management server MS specifies the current drone status of the drone D1 selected by the operator OP1 by the drone status determination unit 33f. Next, the management server MS specifies the current drone phase of the drone D1 selected by the operator OP1 by the drone phase determination unit 33g (step S19).
[0068] Next, the management server MS determines whether to end the highlighting on the drone monitoring screen (step S20). For example, when a predetermined time has elapsed since the start of the previous highlighting, it is determined to end the highlighting. Also, based on the drone status specified in step S18 or the drone phase specified in step S19, it may be determined whether to end the highlighting on the drone monitoring screen. For example, when a change in the current drone status or drone phase is detected, it is determined to end the highlighting. When it is determined to end the highlighting (step S20: YES), the process proceeds to step S21. On the other hand, when it is determined not to end the highlighting (step S20: NO), the process proceeds to step S23.
[0069] In step S21, the management server MS sends a highlighting end command for ending the previous highlighting to the operator terminal T1 and advances the process to step S23. Note that in step S20 above, when it is determined to end the highlighting based on the drone status or drone phase, the highlighting end command may be sent to the operator terminal T1 together with the second display control command in step S25 described later.
[0070] Next, when the operator terminal T1 receives the highlighting end command transmitted from the management server MS in step S21, it ends the highlighting of the part that prompts the operator OP1 to pay attention on the drone monitoring screen (step S22).
[0071] In step S23, the management server MS determines whether the timing to be noted, which requires the operator OP1 to pay attention, has arrived based on the drone status identified in step S18 or the drone phase identified in step S19, by the timing-to-be-noted determination unit 33i. If it is determined that the timing to be noted has not arrived (step S23: NO), the process returns to step S16. On the other hand, if it is determined that the timing to be noted has arrived (step S23: YES), the process proceeds to step S24.
[0072] In step S24, the management server MS identifies the part that prompts the operator OP1 to pay attention based on the drone status identified in step S18 or the drone phase identified in step S19, by the attention part identification unit 33h. Next, the management server MS transmits a second display control command including highlighting control data for highlighting the part that prompts the attention identified in step S24 to the operator terminal T1 by the monitoring information display control unit 33j (step S25). As described above, a highlighting end command may be transmitted to the operator terminal T1 together with the second display control command. Note that after the process of step S25, the process returns to step S16.
[0073] Next, when the operator terminal T1 receives the second display control command transmitted from the management server MS in step S25, it highlights (updates) the part that prompts the operator OP1 to pay attention on the drone monitoring screen according to the above highlighting control data, for example, as shown in FIG. 5 (step S26). As a result, for example, in synchronization with the switching of the display of the current drone phase, the highlighting is switched from the highlighting of the base camera image to the highlighting of the airframe camera image.
[0074] As described above, according to the above embodiment, the management server MS causes the operator terminal Tm of the operator OPm who monitors a plurality of drones Dn to display a drone list on the drone monitoring screen, and the aircraft information acquired by the drone Dn selected by the operator OPm from among the plurality of drones Dn shown in the drone list, and the base information acquired by the base equipment Em at the drone base Bm where the selected drone Dn can take off and land. Since the management server MS is configured to acquire the monitoring information including the above and display the monitoring information on the drone monitoring screen, it is possible to provide useful information that is more helpful for monitoring to the operator OPm who monitors the plurality of drones Dn. Further, since the management server MS is configured to highlight a portion that prompts attention at the timing to be monitored that is necessary for the operator OPm on the drone monitoring screen, it is possible to provide a more convenient remote monitoring system for the operator OPm who monitors the plurality of drones Dn.
[0075] Note that the above embodiment is one embodiment of the present invention, and the present invention is not limited to the above embodiment. Various configurations and the like may be changed from the above embodiment without departing from the gist of the present invention, and in that case, it is also included in the technical scope of the present invention. In the above embodiment, a drone is taken as an example of an unmanned aircraft, but the present invention is also applicable to flying robots other than drones.
[0076] <Appendix> [1] The information processing apparatus according to the present disclosure includes: a first display control means for displaying a list showing the plurality of unmanned aerial vehicles on the screen of the operator's terminal that monitors the plurality of unmanned aerial vehicles; a first acquisition means for acquiring aircraft information acquired by the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; a second acquisition means for acquiring base information acquired by equipment at a base where the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land; and a second display control means for displaying the aircraft information acquired by the first acquisition means and the base information acquired by the second acquisition means on the screen of the terminal. By doing so, useful information that is more helpful for monitoring can be provided to the operator who monitors the plurality of unmanned aerial vehicles.
[0077] [2] In the information processing apparatus according to [1] above, it further includes a base specifying means for specifying, for each of the plurality of unmanned aerial vehicles in charge of the operator, the base to which the unmanned aerial vehicle belongs. The second acquisition means is characterized by acquiring base information acquired by equipment at the base to which the unmanned aerial vehicle selected by the operator belongs, from among the bases specified by the base specifying means. By doing so, the base information acquired by the equipment at the base to which the plurality of unmanned aerial vehicles in charge of the operator belong can be quickly presented to the operator.
[0078] [3] In the information processing apparatus according to [1] or [2] above, the second display control means is characterized by highlighting a portion that prompts the operator to pay attention on the screen where the aircraft information and the base information are displayed. By doing so, the operator can grasp at a glance the portion that particularly requires attention on the screen.
[0079] [4] In the information processing apparatus according to [3] above, a first specifying means for specifying the current status or phase of the unmanned aerial vehicle selected by the operator, and a second specifying means for specifying the portion that prompts the attention based on the current status or phase of the unmanned aerial vehicle are further provided, and the second display control means causes the portion that prompts the attention specified by the second specifying means to be highlighted. Thereby, the operator can immediately grasp the portion that requires attention according to the current status or phase of the unmanned aerial vehicle.
[0080] [5 In the information processing apparatus according to [3] or [4] above, a first specifying means for specifying the current status or phase of the unmanned aerial vehicle selected by the operator, and a determining means for determining whether or not the timing requiring the operator's attention has arrived based on the current status or phase of the unmanned aerial vehicle are further provided, and the second display control means causes the portion that prompts the attention to be highlighted when the determining means determines that the timing requiring the attention has arrived. Thereby, the portion that prompts the attention can be highlighted at the timing required for the operator.
[0081] [6] In the information processing apparatus according to any one of [3] to [5] above, a detecting means for detecting a change in the current status or phase of the unmanned aerial vehicle selected by the operator is further provided, and the second display control means causes the highlighting of the portion that prompts the attention to be switched in response to the detection of the change in the current status or phase of the unmanned aerial vehicle. Thereby, the operator can more quickly grasp that the current status or phase of the unmanned aerial vehicle has changed.
[0082] [7] In the information processing apparatus according to [6] above, the aircraft information includes aircraft image information representing an image captured by a camera provided in the unmanned aircraft, the base information includes base image information representing an image captured by a camera provided in the device, the portion that prompts the attention is an image represented by the aircraft image information or an image to be represented by the base image information, and the second display control means switches the highlighted display of the image in response to detecting a change in the current status or phase of the unmanned aircraft. Thereby, it is possible to make the operator more easily understand that the current status or phase of the unmanned aircraft has changed.
[0083] [8] The information display method according to the present disclosure is an information display method executed by one or more computers, including a step of displaying a list showing the plurality of unmanned aircraft on a screen of a terminal of an operator who monitors the plurality of unmanned aircraft, a step of acquiring aircraft information acquired by the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list, a step of acquiring base information acquired by a device at a base where the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list can take off and land, and a step of displaying the acquired aircraft information and the acquired base information on the screen of the terminal.
[0084] [9] The program according to the present disclosure causes a computer included in a terminal used by an operator who monitors a plurality of unmanned aircraft to execute a step of displaying a list showing the plurality of unmanned aircraft on a screen of the terminal, a step of acquiring aircraft information acquired by the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list, a step of acquiring base information acquired by a device at a base where the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list can take off and land, and a step of displaying the acquired aircraft information and the acquired base information on the screen of the terminal.
Description of Symbols
[0085] 11 Power supply unit 12 Driving unit 13 Position measurement unit 14 Communication unit 15 Sensor unit 16 Memory unit 17 Control unit 21 Operation / display unit 22 Communication unit 23 Memory unit 24 Control unit 31 Communication unit 32 Memory unit 33 Control unit 33a Login processing unit 33b Base location identification unit 33c Drone list display control unit 33d Drone selection reception unit 33e Monitoring information acquisition unit 33f Drone status determination unit 33g Drone phase determination unit 33h Gaze point identification unit 33i Gaze timing determination unit 33j Monitoring information display control unit Dn Drone Tm Operator terminal MS Management server Em Base equipment S Remote monitoring system
Claims
1. First display control means for displaying a list showing the plurality of unmanned aerial vehicles on the screen of the operator's terminal for monitoring the plurality of unmanned aerial vehicles; First acquisition means for acquiring aircraft information acquired by the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; Second acquisition means for acquiring base information acquired by equipment at a base where the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land; Second display control means for displaying the aircraft information acquired by the first acquisition means and the base information acquired by the second acquisition means on the screen of the terminal; An information processing apparatus comprising the same.
2. Further comprising base specifying means for specifying, for each of the plurality of unmanned aerial vehicles for which the operator is in charge, the base to which the unmanned aerial vehicle belongs; The information processing apparatus according to claim 1, wherein the second acquisition means acquires base information acquired by equipment at the base to which the unmanned aerial vehicle selected by the operator belongs, from among the bases specified by the base specifying means.
3. The information processing apparatus according to claim 1, wherein the second display control means highlights a portion that prompts the operator to pay attention on the screen where the aircraft information and the base information are displayed.
4. First specifying means for specifying the current status or phase of the unmanned aerial vehicle selected by the operator; Second specifying means for specifying the portion that prompts the attention based on the current status or phase of the unmanned aerial vehicle; Further comprising: The information processing apparatus according to claim 3, wherein the second display control means highlights the portion that prompts the attention specified by the second specifying means.
5. First specifying means for specifying the current status or phase of the unmanned aerial vehicle selected by the operator; Determination means for determining whether or not the timing requiring the operator's attention has arrived based on the current status or phase of the unmanned aerial vehicle; Further comprising: The information processing apparatus according to claim 3, wherein the second display control means highlights the portion that prompts the attention when the determination means determines that the timing requiring the attention has arrived.
6. The apparatus further includes detection means for detecting a current status or phase change of the unmanned aircraft selected by the operator. The information processing apparatus according to claim 3, wherein the second display control means switches the highlighted display of the portion prompting the attention in response to detection of a current status or phase change of the unmanned aircraft.
7. The aircraft information includes aircraft image information representing an image captured by a camera provided in the unmanned aircraft. The base information includes base image information representing an image captured by a camera provided in the equipment. The portion prompting the attention is an image represented by the aircraft image information or an image represented by the base image information. The information processing apparatus according to claim 6, wherein the second display control means switches the highlighted display of the image in response to detection of a current status or phase change of the unmanned aircraft.
8. An information display method executed by one or more computers, the method comprising: displaying a list showing the plurality of unmanned aircraft on a screen of a terminal of an operator monitoring the plurality of unmanned aircraft; acquiring aircraft information obtained by the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list; acquiring base information obtained by equipment at a base where the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list can take off and land; displaying the acquired aircraft information and the acquired base information on the screen of the terminal. An information display method characterized by including the above steps.
9. On a computer included in a terminal used by an operator monitoring a plurality of unmanned aircraft, causing the computer to display a list showing the plurality of unmanned aircraft on the screen of the terminal; acquiring aircraft information obtained by the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list; acquiring base information obtained by equipment at a base where the unmanned aircraft selected by the operator from among the plurality of unmanned aircraft shown in the list can take off and land; causing the computer to display the acquired aircraft information and the acquired base information on the screen of the terminal. A program characterized by causing the above steps to be executed.
Citation Information
Patent Citations
Region monitoring server, provision terminal and system
JP2016181239A
Drone Landing Systems and Drone Landing Stations
JP2020536780A
Method for displaying information relating to control of flying object
JP2023057120A
Device and system
JP2023073018A
Information display method regarding control of flight vehicle
JP2019195173A