Information processing device, information display method, and program

Abstract

The present invention provides an information processing device, an information display method, and a program capable of providing an operator monitoring multiple unmanned aerial vehicles with more useful information that is useful for monitoring. [Solution] The management server MS displays a list of drones on the drone monitoring screen of the operator terminal Tm of an operator OPm who monitors multiple drones Dn, acquires monitoring information including aircraft information acquired by a drone Dn selected by the operator OPm from the multiple drones Dn shown in the drone list, and base information acquired by a base device Em at a drone base Bm from which the selected drone Dn can take off and land, and displays the monitoring information on the drone monitoring screen.

Description

[Technical field]

[0001] The present invention relates to the technical field of remote monitoring systems capable of remotely monitoring unmanned aerial vehicles. [Background technology]

[0002] Conventionally, it has been expected that unmanned aerial vehicles such as drones will be used for delivery services. In order to realize multiple-aircraft operation in a delivery service using unmanned aerial vehicles, it is necessary for one operator to monitor multiple unmanned aerial vehicles from the viewpoint of cost reduction, etc. For example, Patent Document 1 discloses a technology for optimizing the display of information including multiple images transmitted from multiple aerial vehicles. According to the technology described in Patent Document 1, the user interface screen of the user terminal has multiple display areas 61 and 62A-62E for displaying image and video data transmitted from each aerial vehicle, and by displaying image and video data received from an aerial vehicle selected by a user among the multiple aerial vehicles in the display area 61, which has a larger display area than the display areas 62A-62E, the user can more easily check the image and video data received from the selected aerial vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-195173 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 only displays information transmitted from each drone. However, for an operator who monitors multiple drones, not only information from the drones but also information from bases where the drones can take off and land is important.

[0005] Therefore, the present invention has been made in consideration of the above-mentioned points and the like, and one example of an objective of the present invention is to provide an information processing device, an information display method, and a program that are capable of providing an operator monitoring multiple unmanned aerial vehicles with useful information that will be more useful for monitoring. [Means for solving the problem]

[0006] (Application Example 1) In order to solve the above problem, the information processing device of this application example is characterized in that it comprises a first display control means for displaying a list showing multiple unmanned aerial vehicles on the screen of a terminal of an operator monitoring the multiple unmanned aerial vehicles, a first acquisition means for acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list, a second acquisition means for acquiring base information acquired by equipment at a base from which the unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list can take off and land, and a second display control means for displaying the aircraft information acquired by the first acquisition means and the base information acquired by the second acquisition means on the screen of the terminal.

[0007] (Application Example 2) In order to solve the above problem, the information display method of this application example is an information display method executed by one or more computers, and is characterized in that it includes the steps of: displaying a list showing multiple unmanned aerial vehicles on the screen of a terminal of an operator monitoring the multiple unmanned aerial vehicles; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list; acquiring base information acquired by equipment at a base from which the unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list can take off and land; and displaying the acquired aircraft information and the acquired base information on the screen of the terminal.

[0008] (Application Example 3) In order to solve the above problem, the program of this application example is characterized in that it executes the steps of causing a computer included in a terminal used by an operator who monitors multiple unmanned aerial vehicles to execute the following steps: displaying a list showing the multiple unmanned aerial vehicles on the screen of the terminal; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list; acquiring base information acquired by equipment at a base from which the unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list can take off and land; and displaying the acquired aircraft information and the acquired base information on the screen of the terminal. Effect of the Invention

[0009] According to the present invention, it is possible to provide an operator monitoring multiple unmanned aerial vehicles with more useful information that is more useful for monitoring. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a schematic configuration of a remote monitoring system S. [Diagram 2] FIG. 1 is a diagram illustrating an example of the general configuration of a drone Dn. [Diagram 3] FIG. 2 is a diagram illustrating an example of a schematic configuration of an operator terminal Tm. [Figure 4] FIG. 13 is a diagram showing display example 1 of a drone monitoring screen displayed on the operator terminal T1 of operator OP1. [Diagram 5] FIG. 13 is a diagram showing display example 2 of the drone monitoring screen displayed on the operator terminal T1 of operator OP1. [Figure 6] FIG. 2 is a diagram illustrating an example of a schematic configuration of a management server MS. [Figure 7] FIG. 2 is a diagram illustrating an example of functional blocks in a control unit 33. [Figure 8] FIG. 11 is a sequence diagram showing an example of a monitoring information display process executed by an operator terminal T1 and a management server MS. [Figure 9]FIG. 11 is a sequence diagram showing an example of a highlight display update process executed by the operator terminal T1 and the management server MS. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the following embodiment is an embodiment in which the present invention is applied to a remote monitoring system capable of remotely monitoring a drone.

[0012] [ 1. Overview of the configuration and operation of the remote monitoring system S ] First, referring to Fig. 1, a configuration and an outline of operation of a remote monitoring system S according to this embodiment will be described. Fig. 1 is a diagram showing an example of a schematic configuration of the remote monitoring system S. As shown in Fig. 1, the remote monitoring system S includes a plurality of drones Dn (n = 1, 2, 3, ...), a plurality of operator terminals Tm (m = 1, 2, ...), and a management server MS (an example of an information processing device). The drones Dn, the operator terminals Tm, and the management server MS are each connected to a communication network NW. The communication network NW includes, for example, the Internet, a mobile communication network, and its wireless base stations.

[0013] The drone Dn is an example of an unmanned flying object, and is also called a multicopter or an unmanned aerial vehicle (UAV). The drone Dn is capable of taking off in response to a takeoff command from a ground control station (GCS) and flying autonomously, and is used for, for example, delivery, surveying, photography, and monitoring. The GCS is installed as an application on an operator terminal Tm, for example, and is configured to cooperate with a management server MS. The drone Dn can also fly under remote control from the ground by a control terminal (not shown) equipped with the GCS.

[0014] The drone Dn is under the jurisdiction of any one of the drone bases Bm (in other words, it belongs to any one of the drone bases Bm). The drone base Bm is a base (for example, a facility) where the drone Dn can take off and land. In the example of FIG. 1, the drones D1 to D4 are each under the jurisdiction of (that is, belong to) the drone base B1, depart from the drone base B1, and return to the drone base B1. Also, the drones D5 to D9 are each under the jurisdiction of the drone base B2, depart from the drone base B2, and return to the drone base B2. However, one drone Dn may be under the jurisdiction of multiple drone bases Bm (that is, it may belong to multiple drone bases Bm). For example, the drone D11 (not shown) may depart from the drone base B2 and return to the drone base B1. The number of drones Dn under the jurisdiction of one drone base Bm is not particularly limited.

[0015] In addition, a port Pm used for takeoff and landing of the drone Dn and a base device Em (an example of a device) used for monitoring the drone Dn are installed at the drone base Bm. At the drone base Bm, a base staff member (manually) performs a pre-flight inspection (aircraft condition check) of the drone Dn. For example, the base staff member visually inspects a specific part of the drone Dn for each inspection item of the manual inspection, or inspects the specific part of the drone Dn by touching it. Then, manual inspection result information (an example of base information) showing the result of the inspection by the base staff member is transmitted to the management server MS via the communication network NW from a terminal (an example of a device) such as a smartphone of the base staff member. In addition, the drone Dn that has undergone the pre-flight inspection is placed at the port Pm, and takes off (departs) from the port Pm according to a predetermined schedule. In addition, the drone Dn that has returned to the drone base Bm lands at the port Pm. Note that multiple ports Pm may be installed at one drone base Bm.

[0016] The base device Em is connected to the communication network NW, and includes a base camera (e.g., an RGB camera or an infrared camera) for monitoring the drone Dn, and stores a base ID (identification information) for identifying the drone base Bm. The base camera is configured to continuously capture images of the drone Dn placed at the port Pm or an inspection location, for example. Base image information (an example of base information) representing an image (still image or moving image) captured by the base camera is transmitted from the base device Em to the management server MS together with the base ID. Note that multiple base cameras may be installed at one drone base Bm. The base device Em may also be equipped with a wind sensor that detects (measures) at least one of wind speed and wind direction. Measurement information (an example of base information) measured by the wind sensor is transmitted from the base device Em to the management server MS. Furthermore, the base device Em may be equipped with at least one of a temperature sensor, a humidity sensor, a precipitation (snow) amount sensor, and an air pressure sensor. Measurement information (an example of site information) measured by these sensors is transmitted from the site device Em to the management server MS.

[0017] The operator terminal Tm is a terminal used by an operator OPm who remotely monitors a plurality of drones Dn. For example, the operator OP1 monitors the drones D1 to D4 that he is in charge of while viewing information displayed on the screen (user interface screen) of the operator terminal T1. Such monitoring includes, for example, confirmation of pre-flight inspection status of the plurality of drones Dn, pre-flight aircraft status monitoring, and in-flight aircraft status monitoring. During such a monitoring period, there is a timing that requires particular attention to a specific part in the screen (i.e., the operator OPm to look at the specific part carefully), and such timing is called a "watch-required timing." Here, the specific part in the screen is called a part that prompts the operator OPm to watch. Examples of parts that prompt attention include character strings, items, tabs, and images (video). The part that prompts attention is highlighted. Highlighting corresponds to displaying in a conspicuous display mode (for example, display color, display size, etc.). The watch-required timing may be a time point, or may have a certain time length (time width). Examples of timings requiring attention include when drone Dn takes off and when drone Dn lands.

[0018] The management server MS is composed of one or more server computers that manage information about the drone base Bm for each drone base Bm. The information about the drone base Bm includes, for example, information about the drone Dn under the jurisdiction of the drone base Bm, information about the operator OPm that monitors the drone Dn, and information about the operator terminal Tm used by the operator OPm. The management server MS identifies multiple drones Dn that are managed by the operator OPm who logs in by operating the operator terminal Tm, and displays a list showing the identified multiple drones Dn (hereinafter referred to as a "drone list") on the operator terminal Tm of the operator OPm. In addition, the management server MS receives weather information about the drone base Bm from a weather management server (not shown) periodically or irregularly via the communication network NW. The weather information indicates the weather (sunny, rainy, snowy, cloudy, etc.) of the drone base Bm.

[0019] [ 1-1. Configuration and functions of Drone Dn ] Next, the configuration and functions of the drone Dn will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of a schematic configuration of the drone Dn. As shown in Fig. 2, the drone Dn includes a power supply unit 11, a drive unit 12, a positioning unit 13, a communication unit 14, a sensor unit 15, a memory unit 16, and a control unit 17. Furthermore, the drone Dn includes a propeller (rotor) which is a horizontal rotor, and an arm pipe (including an arm joint) for attaching the propeller to the drone body (housing). When the drone Dn is used for delivering goods, the drone Dn includes a holding mechanism for holding the goods.

[0020] The power supply unit 11 includes a removable battery (power storage device) and the like. The power supply unit 11 supplies (feeds) the power stored in the battery to each part of the drone Dn. The power supply unit 11 also successively measures the remaining battery charge. Battery information indicating the remaining battery charge measured by the power supply unit 11 is output to the control unit 17. The drive unit 12 includes a motor, a rotating shaft, and the like. The drive unit 12 rotates multiple rotors using the motor, the rotating shaft, and the like that are driven in accordance with a control signal output from the control unit 17.

[0021] The positioning unit 13 includes a radio receiver and an altitude sensor. The positioning unit 13 receives radio waves transmitted from a positioning satellite of a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System) by using a radio receiver, and sequentially detects the current position of the drone Dn based on the radio waves. The current position of the UAV1 may be represented by the latitude and longitude of the UAV1, or may be represented by the latitude, longitude, and altitude of the UAV1. Here, the positioning satellite may include satellites used by multiple satellite positioning systems, such as GPS satellites, Michibiki satellites, and Galileo satellites. Position information indicating the current position detected by the positioning unit 13 is continuously output to the control unit 17. At this time, capture number information indicating the capture number (satellite capture number) of the positioning satellites captured by the positioning unit 13 is continuously output to the control unit 17. The positioning unit 13 may detect the altitude of the drone Dn by using an altitude sensor. In this case, the location information indicating the current location of the drone Dn includes the altitude detected by the altitude sensor. The communication unit 14 includes an antenna and a wireless communication function, and is responsible for controlling communication performed via the communication network NW.

[0022] The sensor unit 15 includes various sensors used to control the drone Dn. The various sensors include, for example, a compass (geomagnetic sensor), a gyro (three-axis angular velocity sensor), a three-axis acceleration sensor, an air pressure sensor, a gimbal, an optical sensor, and a range finder. The optical sensor includes an aircraft camera (for example, an RGB camera or an infrared camera). The aircraft camera is configured to continuously capture images of the surroundings of the drone Dn (for example, in front of or below the drone Dn). The direction of the aircraft camera (in front of or below the drone Dn) can be controlled by the control unit 17. The sensing information sensed by the sensor unit 15 is output to the control unit 17. The storage unit 16 is configured from a non-volatile memory and the like, and stores various programs and data. The storage unit 16 also stores an aircraft ID (identification information) for identifying the drone Dn.

[0023] The control unit 17 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and controls the drone Dn based on the position information from the positioning unit 13 and the sensing information from the sensor unit 15. Such control includes control of the propeller rotation speed, and control of the position, attitude, and direction of the drone Dn. The position information of the drone Dn (i.e., the position information from the positioning unit 13) is transmitted to the management server MS via the communication network NW together with aircraft image information (an example of aircraft information) representing an image (still image or moving image) captured by the aircraft camera, battery information (an example of aircraft information) from the power supply unit 11, capture number information (an example of aircraft information) from the positioning unit 13, and the aircraft ID of the drone Dn.

[0024] In addition, the control unit 17 has a self-diagnosis function and performs automatic inspections of whether or not certain parts of the drone Dn (for example, the power supply unit 11, the drive unit 12, the positioning unit 13, the communication unit 14, and the sensor unit 15) are operating normally. Inspection items for the automatic inspection include, for example, the remaining battery level, battery cell balance, GPS, compass, gyro, acceleration sensor, air pressure sensor, gimbal, optical sensor, and range finder. Automatic inspection result information indicating the result of the automatic inspection by the drone Dn (i.e., the control unit 17) is transmitted to the management server MS via the communication network NW. Note that the automatic inspection by the drone Dn is performed before the drone Dn flies, but some inspection items of the automatic inspection are also performed during the flight of the drone Dn.

[0025] [ 1-2. Configuration and functions of operator terminal Tm ] Next, the configuration and functions of the operator terminal Tm will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of a schematic configuration of the operator terminal Tm. The operator terminal Tm includes an operation and display unit 21, a communication unit 22, a storage unit 23, and a control unit 24. For example, a personal computer can be applied to the operator terminal Tm. The operator terminal Tm may include a voice processing unit and a speaker. The operation and display unit 21 has an input function for accepting input (selection) by the operator OPm's finger, pen, or mouse, for example, and a display function for displaying various screens on a display.

[0026] The communication unit 22 is responsible for controlling communication carried out via the communication network NW. The storage unit 23 is composed of a non-volatile memory and the like, and stores various programs (program code groups) and data. The various programs include an operating system (OS), a monitoring application, a GCS, and a web browser. The monitoring application is a program for mainly acquiring and displaying a drone list showing multiple drones Dn managed by an operator OPm from the management server MS. The monitoring application may be downloaded to the operator terminal Tm from a specified server.

[0027] The control unit 24 (an example of a computer) includes a CPU, a ROM, a RAM, etc., and executes processing according to a monitoring application stored in the ROM (or the storage unit 23). When the monitoring application is started in response to an instruction from the operator OPm, the control unit 24 displays a login screen on the display. Then, when the operator OPm inputs a user ID and a password through the login screen, the control unit 24 transmits a login request including the user ID and the password to the management server MS via the communication unit 22 and the communication network NW. The user ID is identification information for identifying the operator OPm.

[0028] Then, when the operator OPm logs in in response to the login request, the management server MS transmits display control data for displaying a drone list showing the drones Dn managed by the logged-in operator OPm. As a result, the control unit 24 displays a drone monitoring screen including the drone list on the display. Here, the drones Dn shown in the drone list may be under the jurisdiction of the same drone base Bm, or may be under the jurisdiction of different drone bases Bm. In the latter case, the drone list shows the drones Dn (e.g., drones D1 to D4 and drones D5 to D9) belonging to each of the drone bases Bm (e.g., drone base B1 and drone base B2). As a result, the operator can monitor each drone Dn under the jurisdiction of the drone bases Bm. The display control data may be data of a web page displayed by a web browser. The display control data of the drone monitoring screen may be incorporated in a monitoring application.

[0029] 4 and 5 are diagrams showing a display example of a drone monitoring screen displayed on the operator terminal T1 of the operator OP1. As shown in FIG. 4 and FIG. 5, the drone monitoring screen displays, as an example, a drone list L showing drones D1 to D4 under the jurisdiction of the drone base B1, and further includes a drone basic information display area A1, a drone detailed information display area A2, an aircraft camera display area A3, and a base camera display area A4. The drone list L is composed of simple information display areas LA1 to LA4 corresponding to the drones D1 to D4 respectively managed by the operator OP1. The simple information display areas LA1 to LA4 are scrollable. The names (drone names) of the drones D1 to D4 are displayed in the simple information display areas LA1 to LA4. The drone list L may include simple information display areas corresponding to the drones D5 to D9 respectively managed by the operator OP1.

[0030] Moreover, the simple information display areas LA1 to LA4 can be selected by the operator OP1. In other words, the drones D1 to D4 can be selected via the simple information display areas LA1 to LA4. In the display example of FIG. 4 and FIG. 5, the drone D1 is in a selected state for takeoff determination by the operator OP1 selecting (pressing) the simple information display area LA1, so that monitoring information (obtained appropriately from the management server MS) for monitoring the drone D1 in the selected state is displayed in the drone basic information display area A1, the drone detailed information display area A2, the aircraft camera display area A3, and the base camera display area A4. Here, the monitoring information includes, for example, manual inspection result information, base image information, aircraft data information, aircraft image information, and weather information. In the display example of FIG. 4, the drone D1 is placed at the port P1 for takeoff at the drone base B1, and is waiting for the takeoff decision by the operator OP1. On the other hand, in the display example of FIG. 5, the drone D1 is in a state of flying (ascending) in the sky above the port P1.

[0031] In the drone basic information display area A1, basic information of the drone D1, the status of the drone D1, the phase of the drone D1, the schedule of the drone D1, weather information of the drone base B1, and the takeoff decision button B are displayed. In addition, the drone basic information display area A1 may display measurement information measured by a sensor equipped in the base device Em. In the display examples of FIG. 4 and FIG. 5, the basic information of the drone D1 includes, for example, the name, type, model number, manufacturer, base name (name of the drone base B1), and port name (name of the port P1) of the drone D1, but is not particularly limited. The status of the drone D1 (hereinafter referred to as "drone status") indicates the state of the drone D1. In the display example of FIG. 4, the drone status is "about to take off", while in the display example of FIG. 5, the drone status is "in flight". In addition to just before takeoff and in flight, such drone statuses include, for example, waiting on the ground, before flight (before takeoff), dropping a delivery, just before landing, returning, and error occurrence. An error has occurred is a drone status that occurs, for example, when some abnormality is detected during automatic inspection by drone Dn.

[0032] The phase of the drone D1 (hereinafter referred to as "drone phase") roughly indicates what stage the drone D1 is in. In the display examples of Figs. 4 and 5, "delivery preparation", "in flight", and "return" are displayed in the phase display section A11 as drone phases. In the display example of Fig. 4, "delivery preparation" is displayed in the phase display section A11, while in the display example of Fig. 5, "in flight" is displayed. The display content of the phase display section A11 changes according to the change in drone phase. Note that the same expression (e.g., in flight) may be used for the drone status and the drone phase. The schedule of the drone D1 includes, for example, the scheduled times of takeoff, flight, landing, return, etc. of the drone D1.

[0033] In the drone detailed information display area A2, an aircraft status check tab TB1, an aircraft data information tab TB2, and a weather status TB3 are displayed. In the display example of FIG. 4, the aircraft status check tab TB1 is selected and displayed among the tabs TB1 to TB3, and therefore the aircraft status check information is displayed below the tabs TB1 to TB3. When the drone status is about to take off, the tab TB1 is automatically selected, and the aircraft status check information is displayed so as to encourage the operator OP1 to pay attention to it. Displaying the aircraft status check information in this manner can also be called highlighting of the aircraft status check information. This allows the operator OP1 to grasp at a glance the parts that require attention according to the current drone status of the drone D1. The aircraft status check information is based on the manual inspection result information described above. "OK" displayed in association with the inspection item "looseness of arm joint" included in the aircraft status check information indicates, for example, that the result of this manual inspection (aircraft status check) is good.

[0034] On the other hand, in the display example of FIG. 5, the aircraft data tab TB2 is selected and displayed among the tabs TB1 to TB3, and therefore the aircraft data information is displayed below the tabs TB1 to TB3. Displaying the aircraft data information in this manner can also be called highlighting of the aircraft data information. The aircraft data information is based on the above-mentioned battery information (battery remaining amount) and acquisition number information (satellite acquisition number), etc. A check mark displayed in association with the item "battery remaining amount" included in the aircraft data information indicates, for example, that the battery remaining amount is good. For example, when the drone status changes from "immediately before takeoff" shown in FIG. 4 to "in flight" shown in FIG. 5, the selection display automatically switches from the aircraft status check tab TB1 to the aircraft data tab TB2. Note that the tabs TB1 to TB3 can each be manually selected by the operator OP1, and when the weather status TB3 is selected, for example, the weather information of the drone base B1 is displayed below the tabs TB1 to TB3.

[0035] The aircraft camera display area A3 displays a video image captured by the aircraft camera equipped in the drone D1 (hereinafter referred to as "aircraft camera video"). Meanwhile, the base camera display area A4 displays a video image captured by the base camera equipped in the base device E1 (hereinafter referred to as "base camera video"). In the display example of FIG. 4, the drone status is "about to take off", which corresponds to a timing to pay attention, so the base camera video is highlighted as a part to encourage attention (for example, the frame A41 of the base camera display area A4 is displayed in red). In this way, when the drone status is "about to take off", if the operator OP1 selects (presses) the takeoff decision button B in the drone basic information display area A1, a takeoff command is transmitted to the drone D1. As a result, when drone D1 takes off from port P1, as shown in FIG. 5, the display of drone status and drone phase switches to "in flight", and in sync with this, the highlighting of the base camera image switches to the highlighting of the aircraft camera image (for example, frame A31 of the aircraft camera display area A3 is displayed in red). Therefore, the change in drone phase can be communicated to operator OP1 more clearly than with the display of drone status and drone phase. At this time, the highlighting of the base camera image is released (i.e., the display returns to normal). After that, when drone D1 reaches the waypoint above port P1 and starts flying toward the delivery destination, the highlighting of the aircraft camera image is released.

[0036] [ 1-3. Configuration and Functions of Management Server MS ] Next, the configuration and functions of the management server MS will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of a schematic configuration of the management server MS. As shown in FIG. 6, the management server MS includes a communication unit 31, a storage unit 32, a control unit 33, and the like. The communication unit 31 is responsible for controlling communication performed via the communication network NW. The manual inspection result information, the base image information, the measurement information, and the base ID transmitted from the base device E are received by the communication unit 31. The battery information, the capture number information, the aircraft image information, the position information of the drone Dn, and the aircraft ID transmitted from the drone Dn are received by the communication unit 31. The management server MS can recognize the current position of the drone Dn based on the position information of the drone Dn. In addition, the login request transmitted from the operator terminal Tm is received by the communication unit 31. In addition, the weather information transmitted from the weather management server is received by the communication unit 31.

[0037] The storage unit 32 is composed of, for example, a hard disk drive, and stores various programs including an operating system and applications. Here, the applications include programs for executing information processing methods. Furthermore, the storage unit 32 has a base management database (DB) 321, a drone management database (DB) 322, and an operator management database (DB) 323 built therein.

[0038] The base management database 321 is a database for managing information related to the drone base Bm. For example, the base ID of the drone base Bm, base image information, measurement information, weather information, and the aircraft ID of the drone Dn under the jurisdiction of the drone base Bm are stored in the base management database 321 in association with each drone base Bm. Note that the base image information, measurement information, and weather information may be appropriately updated each time they are received by the communication unit 31.

[0039] The drone management database 322 is a database for managing information related to the drone Dn. In the drone management database 322, the drone Dn's aircraft ID, location information, basic information, drone status, drone phase, schedule, manual inspection result information, aircraft data information, and aircraft image information are stored in association with each drone Dn. The aircraft data information includes, for example, battery information and capture number information. The manual inspection result information, aircraft data information, and aircraft image information may be appropriately updated each time they are received by the communication unit 31. In addition, the drone status and drone phase of the drone Dn are appropriately updated based on, for example, various information received by the communication unit 31, the schedule of the drone Dn, and instruction information from an administrator, etc.

[0040] The operator management database 323 is a database for managing information about the operator OPm. The operator management database 323 stores the user ID, password, login status, and the aircraft ID and name of each of the drones Dn in charge of the operator OPm in association with each operator OPm. Here, the login status indicates whether the operator OPm is logged in or not.

[0041] The control unit 33 (an example of a computer) includes a CPU, a ROM, and a RAM. FIG. 7 is a diagram showing an example of a functional block in the control unit 33. The control unit 33 functions as a login processing unit 33a, a base identification unit 33b (an example of a base identification means), a drone list display control unit 33c (an example of a first display control means), a drone selection reception unit 33d, a monitoring information acquisition unit 33e (an example of a first acquisition means and a second acquisition means), a drone status determination unit 33f (an example of a first identification means and a detection means), a drone phase determination unit 33g (an example of a first identification means and a detection means), a gaze portion identification unit 33h (an example of a second identification means), a gaze required timing determination unit 33i (an example of a determination means), and a monitoring information display control unit 33j (an example of a second display control means), as shown in FIG. 7, according to a program (a group of program codes) stored in, for example, the ROM or the storage unit 32.

[0042] The login processing unit 33a performs login processing for an operator OPm in response to a login request from an operator terminal Tm. In this login processing, it is determined whether or not a pair of a user ID and a password included in the login request is registered in the operator management database 323. Then, if the pair of the user ID and the password is registered, the operator OPm who uses the operator terminal Tm that has transmitted the login request is identified (identified by the user ID), and the operator OPm logs in.

[0043] When an operator OPm is identified by the login process, the base identification unit 33b identifies multiple drones Dn that the operator OPm is in charge of, and identifies the drone base Bm to which the identified drone Dn belongs for each drone Dn. For example, in the operator management database 323, the drone Dn identified by the aircraft ID associated with the user ID of the logged-in operator OPm is identified as the drone Dn that the operator OPm is in charge of. Then, the drone base Bm identified by the base ID associated with the aircraft ID of the identified drone Dn (i.e., the base ID associated with the aircraft ID in the base management database 321) is identified as the drone base Bm to which the drone Dn belongs.

[0044] The drone list display control unit 33c generates a drone list (including, for example, drone name and aircraft ID) indicating the drones Dn managed by the logged-in operator OPm. Then, the drone list display control unit 33c transmits display control data for displaying the generated drone list to the operator terminal Tm of the logged-in operator OPm, thereby displaying the drone list on the drone monitoring screen of the operator terminal Tm, for example, as shown in FIG.

[0045] The drone selection receiving unit 33d receives selection information of any one drone Dn selected by the logged-in operator OPm from among multiple drones Dn shown in the drone list displayed on the drone monitoring screen of the operator terminal Tm from the operator terminal Tm via the communication unit 22. Such selection information includes information for identifying the drone Dn selected by the logged-in operator OPm (for example, the drone name or aircraft ID). As a result, the drone selection receiving unit 33d receives the selection of the drone Dn.

[0046] The monitoring information acquisition unit 33e acquires monitoring information for monitoring the drone Dn selected by the logged-in operator OPm (i.e., the selection is accepted by the drone selection acceptance unit 33d). For example, the monitoring information acquisition unit 33e acquires basic information, drone status, drone phase, schedule, manual inspection result information, aircraft data information, and aircraft image information associated with the aircraft ID of the selected drone Dn from the drone management database 322 as monitoring information. Furthermore, the monitoring information acquisition unit 33e acquires, as monitoring information, from the base management database 321, base image information, measurement information, and weather information associated with the base ID of the drone base Bm to which the drone Dn selected by the logged-in operator OPm belongs among the drone bases Bm (e.g., multiple drone bases Bm) identified by the base identification unit 33b. This makes it possible to quickly present the base information of the drone bases Bm to which the multiple drones Dn in charge of the operator OPm belong to the operator OPm.

[0047] The drone status determination unit 33f identifies the current drone status of the drone Dn selected by the logged-in operator OPm from the monitoring information acquired by the monitoring information acquisition unit 33e. Furthermore, even after identifying the current drone status of the drone Dn from the monitoring information, the drone status determination unit 33f may identify the current drone status of the drone Dn by referring to the drone management database 322 at predetermined time intervals (for example, 1 second to 60 seconds). Then, the drone status determination unit 33f detects a change in the current drone status of the drone Dn selected by the logged-in operator OPm (for example, a change from immediately before takeoff to in flight).

[0048] The drone phase determination unit 33g identifies the current drone phase of the drone Dn selected by the logged-in operator OPm from the monitoring information acquired by the monitoring information acquisition unit 33e. Furthermore, even after identifying the current drone phase of the drone Dn from the monitoring information, the drone phase determination unit 33g may identify the current drone phase of the drone Dn by referring to the drone management database 322 at a predetermined time interval. Then, the drone phase determination unit 33g detects a change in the current drone phase of the drone Dn selected by the logged-in operator OPm (for example, a change from delivery preparation to flying).

[0049] The gaze portion identification unit 33h identifies a portion that the logged-in operator OPm is prompted to gaze at, based on the current drone status identified by the drone status determination unit 33f. For example, when the drone status is immediately before takeoff, the aircraft status check information shown in FIG. 4 is identified as a portion that prompts gaze. When the drone status is immediately before takeoff, the base camera image may be identified as a portion that prompts gaze. On the other hand, when the drone status is in flight or an error has occurred, the aircraft data information shown in FIG. 5 is identified as a portion that prompts gaze. When the drone status is in flight and the drone Dn reaches a waypoint above the port Pm, the aircraft camera image may be identified as a portion that prompts gaze (further, the direction of the aircraft camera may be identified as downward). When the drone status is in flight and the drone Dn reaches a waypoint above the port Pm until the delivery is dropped, the aircraft camera image may be identified as a portion that prompts gaze (further, the direction of the aircraft camera may be identified as forward).

[0050] In addition, the gaze portion identification unit 33h may identify a portion that the logged-in operator OPm is prompted to gaze at based on the current drone phase identified by the drone phase determination unit 33g. For example, when the drone phase is delivery preparation, the base camera image shown in FIG. 4 is identified as a portion that prompts gaze. On the other hand, when the drone phase is flying, the aircraft camera image shown in FIG. 5 is identified as a portion that prompts gaze. Note that, when the drone phase is return, the base camera image and the aircraft camera image do not have to be identified as portions that prompt gaze. Furthermore, even after identifying a portion that prompts gaze, the gaze portion identification unit 33h may identify a portion that prompts the logged-in operator OPm to gaze at at a predetermined time interval based on the current drone status or drone phase of the drone Dn selected by the logged-in operator OPm.

[0051] The attention-required timing determination unit 33i determines whether or not a timing for attention-required for the logged-in operator OPm has arrived at a predetermined time interval based on the current drone status identified by the drone status determination unit 33f or the current drone phase identified by the drone phase determination unit 33g. For example, it is determined that the attention-required timing has arrived when the drone status determination unit 33f detects a change in the current drone status. In this case, it is preferable that the attention-required timing has arrived when it is detected that the current drone status has been changed immediately before takeoff (or immediately before dropping a delivery, landing, or an error has occurred). Alternatively, it may be determined that the attention-required timing has arrived when the drone phase determination unit 33g detects a change in the current drone phase.

[0052] The monitoring information display control unit 33j transmits display control data for displaying the monitoring information acquired by the monitoring information acquisition unit 33e to the operator terminal Tm of the logged-in operator OPm, thereby displaying the monitoring information on the drone monitoring screen of the operator terminal Tm, for example, as shown in FIG. 4. At this time, the monitoring information display control unit 33j transmits highlighting control data for highlighting the "part requiring attention" identified by the gaze part identification unit 33h on the drone monitoring screen to the operator terminal Tm of the operator OPm. Here, the highlighting control data may be transmitted to the operator terminal Tm together with the display control data for displaying the monitoring information. The highlighting control data includes information for allowing the operator terminal Tm to identify the "part requiring attention" identified by the gaze part identification unit 33h (for example, an identifier of the part, coordinates of the part, etc.). As a result, as described above, the part requiring attention of the logged-in operator OPm is highlighted on the drone monitoring screen. Therefore, the operator OPm can grasp at a glance the part on the drone monitoring screen that requires particular attention.

[0053] In addition, when the monitoring information is displayed on the drone monitoring screen and the attention-required timing determination unit 33i determines that the attention-required timing has arrived, the monitoring information display control unit 33j may transmit highlighting control data for highlighting the "part that encourages attention" identified by the attention part identification unit 33h at the attention-required timing to the operator terminal Tm of the operator OPm. This allows the part that encourages attention to be highlighted at a timing required by the operator OPm. Therefore, the monitoring information display control unit 33j can switch the highlighting of the part that encourages attention, for example, in response to detection of a switch in the current drone status or drone phase. That is, in synchronization with the switch in the display of the current drone status or drone phase, for example, the highlighting of the base camera image can be switched to the highlighting of the aircraft camera image. Therefore, the operator OPm can more quickly and easily understand that the display of the current drone status or drone phase has been switched.

[0054] [ 2. Operation of remote monitoring system S ] Next, the operation of the remote monitoring system S will be described with reference to Fig. 8 and Fig. 9. Fig. 8 is a sequence diagram showing an example of a monitoring information display process executed by the operator terminal T1 (controller 24) and the management server MS (controller 33). Fig. 9 is a sequence diagram showing an example of a highlighting update process executed by the operator terminal T1 (controller 24) and the management server MS (controller 33). Note that in the following explanation of the operation, a case where a drone Dn in charge of an operator OP1 using the operator terminal T1 is monitored will be described as an example.

[0055] When the monitoring application is started in the operator terminal T1 in response to an instruction from the operator OP1, a login screen is displayed on the display. Then, the operator terminal T1 transmits a login request including the user ID and password input by the operator OP1 through the login screen to the management server MS (step S0).

[0056] Next, when the management server MS receives a login request from the operator terminal T1, the login processing unit 33a performs login processing in response to the login request (step S1). In this login processing, it is determined whether or not a pair of a user ID and a password included in the login request is registered in the operator management database 323. For example, if a pair of a user ID and a password included in the login request is stored in the operator management database 323, it is determined that the pair of a user ID and a password is registered, and the operator OP1 using the operator terminal T1 logs in.

[0057] Next, the management server MS identifies multiple drones Dn that are managed by the logged-in operator OP1 (step S2). For example, in the operator management database 323, the drone Dn is identified by the aircraft ID associated with the user ID of the operator OP1. Next, the management server MS identifies the drone base Bm to which each drone Dn belongs for each drone Dn identified in step S2 by the base identification unit 33b (step S3). For example, in the base management database 321, the drone base Bm is identified by the base ID associated with the aircraft ID of the drone Dn identified in step S2. There may be one drone base Bm identified here, or there may be multiple drone bases Bm identified here.

[0058] Next, the management server MS generates a drone list showing the drones Dn identified in step S2 (step S4). Next, the management server MS transmits a first display control command including display control data for displaying the drone list generated in step S4 to the operator terminal T1 via the drone list display control unit 33c (step S5).

[0059] Next, when the operator terminal T1 receives the first display control command from the management server MS, it displays the drone list L on the drone monitoring screen in accordance with the display control data, for example, as shown in Fig. 4 (step S6). When the operator OP1 selects the drone D1 from among the drones Dn shown in the drone list L thus displayed, the operator terminal T1 transmits the selection information of the drone D1 to the management server MS (step S7).

[0060] Next, when the management server MS receives the selection information from the operator terminal T1, the drone selection receiving unit 33d receives the selection of the drone D1 (step S8). Next, the management server MS acquires monitoring information for monitoring the drone D1 selected by the operator OP1 by the monitoring information acquiring unit 33e (step S9). Here, the monitoring information includes basic information, drone status, drone phase, schedule, manual inspection result information, aircraft data information, and aircraft image information of the drone D1 selected from the multiple drones Dn identified in step S2. Furthermore, the monitoring information includes base image information and measurement information of the drone base B1 to which the selected drone D1 belongs, among the drone bases Bm identified in step S3.

[0061] Next, the management server MS identifies the current drone status of the drone D1 selected by the operator OP1 by the drone status determination unit 33f (step S10). Next, the management server MS identifies the current drone phase of the drone D1 selected by the operator OP1 by the drone phase determination unit 33g (step S11).

[0062] Next, the management server MS uses the gaze part specifying unit 33h to specify a part to be gazed at by the operator OP1 based on the drone status specified in step S10 or the drone phase specified in step S11 (step S12). Here, the gaze part specifying unit 33h may specify a part to be gazed at according to the drone status (e.g., an image) and a part to be gazed at according to the drone phase (i.e., specify parts to be gazed at that are different from each other).

[0063] Next, the management server MS transmits a second display control command, which includes display control data for displaying the monitoring information acquired in step S9 and highlighting control data for highlighting the portion that encourages attention identified in step S12, to the operator terminal T1 via the monitoring information display control unit 33j (step S13).

[0064] Next, when the operator terminal T1 receives the second display control command transmitted from the management server MS in step S13, it displays monitoring information including the above-mentioned aircraft information and base information on the drone monitoring screen of the operator terminal Tm in accordance with the above-mentioned display control data and highlighting control data, for example, as shown in FIG. 4 (step S14), and highlights the part that the operator OP1 is encouraged to pay attention to (step S15).

[0065] Next, in Fig. 9, the management server MS determines whether or not an update opportunity has arrived (step S16). For example, if a predetermined time (for example, 1 to 60 seconds) has elapsed since the previous transmission of the second display control command, it is determined that an update opportunity has arrived. If it is determined that an update opportunity has not arrived (step S16: NO), the process proceeds to step S17. On the other hand, if it is determined that an update opportunity has arrived (step S16: YES), the process proceeds to step S18.

[0066] In step S17, the management server MS judges whether or not to end the process. For example, if the operator OP1 logs out, it is judged that the process is to be ended (step S17: YES), and the process shown in Fig. 9 is ended. On the other hand, if it is judged that the process is not to be ended (step S17: NO), the process returns to step S16.

[0067] In step S18, the management server MS determines the current drone status of the drone D1 selected by the operator OP1 by the drone status determination unit 33f. Next, the management server MS determines the current drone phase of the drone D1 selected by the operator OP1 by the drone phase determination unit 33g (step S19).

[0068] Next, the management server MS determines whether or not to end the highlighting on the drone monitoring screen (step S20). For example, when a predetermined time has elapsed since the start of the previous highlighting, it is determined that the highlighting is to be ended. In addition, it may be determined whether or not to end the highlighting on the drone monitoring screen based on the drone status identified in step S18 or the drone phase identified in step S19. For example, when a switch of the current drone status or drone phase is detected, it is determined that the highlighting is to be ended. When it is determined that the highlighting is to be ended (step S20: YES), the process proceeds to step S21. On the other hand, when it is determined that the highlighting is not to be ended (step S20: NO), the process proceeds to step S23.

[0069] In step S21, the management server MS transmits a highlighting end command to the operator terminal T1 to end the previous highlighting, and proceeds to step S23. If it is determined in step S20 that the highlighting is to be ended based on the drone status or drone phase, the highlighting end command may be transmitted to the operator terminal T1 together with a second display control command in step S25 described later.

[0070] Next, when the operator terminal T1 receives the highlighting end command transmitted from the management server MS in step S21, it ends the highlighting of the portion on the drone monitoring screen that the operator OP1 is encouraged to look at (step S22).

[0071] In step S23, the management server MS determines whether or not the timing for the operator OP1 to pay attention has arrived based on the drone status identified in step S18 or the drone phase identified in step S19, by the attention timing determination unit 33i. If it is determined that the timing for the operator OP1 to pay attention has not arrived (step S23: NO), the process returns to step S16. On the other hand, if it is determined that the timing for the operator OP1 to pay attention has arrived (step S23: YES), the process proceeds to step S24.

[0072] In step S24, the management server MS uses the gaze part specification unit 33h to specify a part to be gazed at by the operator OP1 based on the drone status specified in step S18 or the drone phase specified in step S19. Next, the management server MS transmits a second display control command including highlight control data for highlighting the part to be gazed at specified in step S24 to the operator terminal T1 using the monitoring information display control unit 33j (step S25). As described above, a highlight end command may be transmitted to the operator terminal T1 together with the second display control command. After the process of step S25, the process returns to step S16.

[0073] Next, when the operator terminal T1 receives the second display control command transmitted from the management server MS in step S25, it highlights (updates) the portion on the drone monitoring screen that the operator OP1 should pay attention to in accordance with the above-mentioned highlight control data (step S26), for example, as shown in Fig. 5. As a result, for example, in synchronization with the switching of the display of the current drone phase, the highlighting of the base camera image is switched to the highlighting of the aircraft camera image.

[0074] As described above, according to the above embodiment, the management server MS displays a drone list on the drone monitoring screen of the operator terminal Tm of the operator OPm who monitors multiple drones Dn, acquires monitoring information including aircraft information acquired by a drone Dn selected by the operator OPm from the multiple drones Dn shown in the drone list, and base information acquired by a base device Em at a drone base Bm where the selected drone Dn can take off and land, and displays the monitoring information on the drone monitoring screen, so that the operator OPm who monitors multiple drones Dn can be provided with more useful information that is useful for monitoring. Furthermore, the management server MS is configured to highlight a part on the drone monitoring screen that prompts the operator OPm to pay attention at the necessary monitoring timing, so that a more convenient remote monitoring system can be provided for the operator OPm who monitors multiple drones Dn.

[0075] The above embodiment is one embodiment of the present invention, and the present invention is not limited to the above embodiment. Various changes to the configuration of the above embodiment may be made without departing from the gist of the present invention, and such changes are also included in the technical scope of the present invention. In the above embodiment, a drone is used as an example of an unmanned flying object, but the present invention is also applicable to flying robots other than drones.

[0076] <Additional Notes> [1] The information processing device according to the present disclosure is characterized by comprising: a first display control means for displaying a list showing a plurality of unmanned aerial vehicles on the screen of a terminal of an operator who monitors the plurality of unmanned aerial vehicles; a first acquisition means for acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; a second acquisition means for acquiring base information acquired by an apparatus at a base from which the unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list can take off and land; and a second display control means for displaying the aircraft information acquired by the first acquisition means and the base information acquired by the second acquisition means on the screen of the terminal. This makes it possible to provide the operator who monitors the plurality of unmanned aerial vehicles with more useful information for monitoring.

[0077] [2] The information processing device described in [1] above further comprises a base identification means for identifying the base to which the unmanned aerial vehicles managed by the operator belong for each unmanned aerial vehicle, and the second acquisition means acquires base information acquired by a device at the base to which the unmanned aerial vehicle selected by the operator belongs among the bases identified by the base identification means. This makes it possible to quickly present to the operator the base information acquired by a device at the base to which the unmanned aerial vehicles managed by the operator belong.

[0078] [3] In the information processing device described in [1] or [2] above, the second display control means highlights a portion of the screen on which the aircraft information and the base information are displayed that the operator is encouraged to pay attention to, thereby allowing the operator to at a glance grasp the portion of the screen that requires particular attention.

[0079] [4] The information processing device described in [3] above further comprises a first identification means for identifying a current status or phase of the unmanned aerial vehicle selected by the operator, and a second identification means for identifying a portion for which attention is encouraged based on the current status or phase of the unmanned aerial vehicle, and the second display control means highlights the portion for which attention is encouraged identified by the second identification means. This allows the operator to grasp at a glance the portion for which attention is needed based on the current status or phase of the unmanned aerial vehicle.

[0080] [5] The information processing device described in [3] or [4] above further comprises a first identification means for identifying a current status or phase of the unmanned aerial vehicle selected by the operator, and a judgment means for judging whether or not the timing requiring the operator's attention has arrived based on the current status or phase of the unmanned aerial vehicle, and the second display control means is characterized in that when the judgment means judges that the timing requiring the operator's attention has arrived, it highlights the part that encourages the operator to gaze upon it. This makes it possible to highlight the part that encourages the operator to gaze upon it at the timing required by the operator.

[0081] [6] The information processing device according to any one of [3] to [5] above further comprises a detection means for detecting a change in the current status or phase of the unmanned aerial vehicle selected by the operator, and the second display control means switches the highlighting of the portion that prompts the operator to pay attention in response to the detection of a change in the current status or phase of the unmanned aerial vehicle. This allows the operator to more quickly understand that the current status or phase of the unmanned aerial vehicle has changed.

[0082] [7] In the information processing device described in [6] above, the aircraft information includes aircraft image information representing an image captured by a camera equipped on the unmanned aerial vehicle, the base information includes base image information representing an image captured by a camera equipped on the device, the portion that prompts attention is an image represented by the aircraft image information or an image represented by the base image information, and the second display control means switches the highlighting of the image in response to detection of a change in the current status or phase of the unmanned aerial vehicle. This allows the operator to more easily understand that the current status or phase of the unmanned aerial vehicle has changed.

[0083] [8] The information display method of the present disclosure is an information display method executed by one or more computers, and includes the steps of: displaying a list indicating a plurality of unmanned aerial vehicles on a screen of a terminal of an operator monitoring the plurality of unmanned aerial vehicles; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from the plurality of unmanned aerial vehicles shown in the list; acquiring base information acquired by equipment at a base from which the unmanned aerial vehicle selected by the operator from the plurality of unmanned aerial vehicles shown in the list can take off and land; and displaying the acquired aircraft information and the acquired base information on the screen of the terminal.

[0084] [9] The program disclosed herein is characterized in that it executes the steps of causing a computer included in a terminal used by an operator monitoring multiple unmanned aerial vehicles to execute the steps of: displaying a list showing the multiple unmanned aerial vehicles on a screen of the terminal; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list; acquiring base information acquired by equipment at a base from which the unmanned aerial vehicle selected by the operator from the multiple unmanned aerial vehicles shown in the list can take off and land; and displaying the acquired aircraft information and the acquired base information on the screen of the terminal. [Explanation of symbols]

[0085] 11 Power supply section 12 Drive unit 13 Positioning unit 14 Communications Department 15 Sensor section 16 Memory section 17 Control Unit 21 Operation / display section 22 Communications Department 23 Memory section 24 Control Unit 31 Communications Department 32 Storage section 33 Control Unit 33a Login processing section 33b Base Identification Department 33c Drone list display control unit 33d Drone Selection Reception 33e Monitoring information acquisition unit 33f Drone Status Judgment Section 33g Drone phase determination section 33h Gaze area identification part 33i Attention Timing Judgment Section 33j Monitoring information display control section Dn Drone Tm Operator Terminal MS Management Server EM base equipment S Remote monitoring system

Claims

1. A first display control means for displaying a list showing the plurality of unmanned aerial vehicles on a screen of a terminal of an operator who monitors the plurality of unmanned aerial vehicles; A first acquisition means for acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; a second acquisition means for acquiring base image information representing an image of an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list, captured by a camera installed at a base from which the unmanned aerial vehicle can take off and land, or an image of a port used for takeoff and landing of the unmanned aerial vehicle, captured by the camera; a second display control means for displaying the aircraft information acquired by the first acquisition means and the base image information acquired by the second acquisition means on the same screen of the terminal; An information processing device comprising:

2. The system further includes a base identification means for identifying a base to which the plurality of unmanned aerial vehicles under the control of the operator belong for each of the unmanned aerial vehicles, The information processing device described in claim 1, characterized in that the second acquisition means acquires base image information representing an image of the unmanned aerial vehicle captured by a camera installed at a base to which the unmanned aerial vehicle selected by the operator belongs, among the bases identified by the base identification means, or an image of a port used for takeoff and landing of the unmanned aerial vehicle, captured by the camera.

3. The information processing apparatus according to claim 1 , wherein the second display control means highlights a portion of the screen on which the machine information and the base image information are displayed, the portion being urged to be focused on by the operator.

4. a first identification means for identifying a current status or phase of an unmanned aerial vehicle selected by the operator; A second identification means for identifying the portion that prompts the user to look at based on a current status or phase of the unmanned aerial vehicle; Further comprising: The information processing apparatus according to claim 3 , wherein the second display control means highlights the portion that is identified by the second identification means and that is to be gazed at.

5. a first identification means for identifying a current status or phase of an unmanned aerial vehicle selected by the operator; A determination means for determining whether or not a timing has come that requires the operator's attention based on a current status or phase of the unmanned aerial vehicle; Further comprising: The information processing device according to claim 3 , wherein the second display control means highlights the portion that prompts the user to gaze when the determination means determines that the timing requiring the user to gaze has arrived.

6. A detection means for detecting a change in a current status or phase of the unmanned aerial vehicle selected by the operator, The information processing device described in claim 3, characterized in that the second display control means switches the highlighted display of the portion that encourages attention in response to detection of a change in the current status or phase of the unmanned aerial vehicle.

7. The aircraft information includes aircraft image information representing an image captured by a camera equipped on the unmanned aerial vehicle, The portion that prompts the user to look at the image is an image represented by the aircraft image information or an image represented by the base image information, The information processing device according to claim 6, characterized in that the second display control means switches the highlighted display of the image in response to detection of a change in the current status or phase of the unmanned aerial vehicle.

8. 1. A method for displaying information executed by one or more computers, comprising: A step of displaying a list showing the plurality of unmanned aerial vehicles on a screen of a terminal of an operator who monitors the plurality of unmanned aerial vehicles; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; acquiring base image information representing an image of an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list, captured by a camera installed at a base from which the unmanned aerial vehicle can take off and land, or an image of a port used for takeoff and landing of the unmanned aerial vehicle, captured by the camera; A step of displaying the acquired machine information and the acquired base image information on the same screen of the terminal; 13. An information display method comprising:

9. A computer included in a terminal used by an operator who monitors multiple unmanned aerial vehicles Displaying a list showing the plurality of unmanned aerial vehicles on a screen of the terminal; acquiring aircraft information acquired by an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list; acquiring base image information representing an image of an unmanned aerial vehicle selected by the operator from among the plurality of unmanned aerial vehicles shown in the list, captured by a camera installed on equipment at a base from which the unmanned aerial vehicle can take off and land, or an image of a port used for takeoff and landing of the unmanned aerial vehicle, captured by the camera; A step of displaying the acquired machine information and the acquired base image information on the same screen of the terminal; A program characterized by executing the above.

Images