Information processing device, display control method, and program

Abstract

To provide an information processing device, a display control method, and a program that enable an operator for remotely monitoring a plurality of unmanned aircraft to quickly grasp the unmanned aircraft that requires priority monitoring.SOLUTION: A control server MS is configured to: cause an operator terminal Tm to display a drone list L1 containing drone simple information for each of a plurality of drones Dn that require monitoring by an operator OPm; specify a drone status for each of the plurality of drones Dn; specify a monitoring priority for each drone Dn based on the specified drone status; and control the display of the drone list L1 according to the specified monitoring priority of each drone.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to technical fields such as systems that allow an operator to remotely monitor multiple unmanned aerial vehicles. [Background technology]

[0002] Conventionally, systems that allow an operator to monitor and operate multiple unmanned aerial vehicles have been known. For example, Patent Document 1 discloses a system in which at least one operator monitors each of multiple UAVs (Unmanned Aerial Vehicles) using a computing device that can communicate with each of the UAVs and controls the takeoff, ascent, descent, landing, etc. of the UAVs. Patent Document 1 describes an example in which 10 operators monitor 500 UAVs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2022-529507 Summary of the Invention [Problem to be solved by the invention]

[0004] However, for example, if one operator is to remotely monitor multiple unmanned aerial vehicles, the operator's monitoring burden increases, and it may take the operator time to identify which aircraft require priority monitoring, such as when the unmanned aerial vehicles are taking off or landing, which could delay the operator's response.

[0005] Therefore, the present invention has been made in consideration of the above points, and one example of its objective is to provide an information processing device, a display control method, and a program that enable an operator remotely monitoring multiple unmanned aerial vehicles to quickly identify unmanned aerial vehicles that require priority monitoring. [Means for solving the problem]

[0006] (Application Example 1) In order to solve the above problem, the information processing device of this application example is characterized by comprising a first display control means for displaying on the operator's terminal a list of aircraft including information regarding each of a plurality of unmanned aircraft that require monitoring by the operator, a first identification means for identifying the status of each of the unmanned aircraft, and a second display control means for controlling the display of the list of aircraft based on the status of each of the unmanned aircraft.

[0007] (Application Example 2) In order to solve the above problem, the display control method of this application example is a display control method executed by one or more computers, and is characterized by including the steps of displaying a list of aircraft on an operator's terminal, the list including information regarding each of a plurality of unmanned aircraft that require monitoring by the operator, identifying the status of each of the unmanned aircraft, and controlling the display of the list of aircraft based on the status of each of the unmanned aircraft.

[0008] (Application Example 3) In order to solve the above problem, the program of this application example is characterized by causing a computer included in a terminal used by an operator to execute the steps of: displaying on the terminal a list of aircraft including information regarding each of multiple unmanned aircraft that require monitoring by the operator; obtaining the status of each of the unmanned aircraft from a specified server; and controlling the display of the list of aircraft based on the status of each of the unmanned aircraft. [Effects of the Invention]

[0009] According to the present invention, an operator remotely monitoring a plurality of unmanned aerial vehicles can quickly identify unmanned aerial vehicles that require priority monitoring. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a schematic configuration of a remote monitoring system S. [Figure 2] FIG. 1 is a diagram illustrating an example of the general configuration of a drone Dn. [Figure 3] FIG. 2 is a diagram illustrating an example of a schematic configuration of an operator terminal Tm. [Figure 4] FIG. 10 is a diagram showing an example of a drone monitoring screen displayed on the operator terminal T1 of the operator OP1. [Figure 5] FIG. 2 is a diagram illustrating an example of a schematic configuration of a management server MS. [Figure 6] FIG. 10 is a diagram illustrating an example of a monitoring priority master table. [Figure 7] FIG. 2 is a diagram illustrating an example of functional blocks in a control unit 33. [Figure 8] FIG. 10 is a diagram showing an example of a drone monitoring screen displayed on the operator terminal T1 when the operator OP1 selects drone D1, which has a lower monitoring priority than drone D3, first. [Figure 9] 10 is a flowchart showing a display control process executed by a control unit 33 of a management server MS. DETAILED DESCRIPTION OF THE INVENTION

[0011] An embodiment of the present invention will be described below with reference to the drawings. The following embodiment is an embodiment in which the present invention is applied to a remote monitoring system capable of remotely monitoring drones. Note that in this embodiment, a drone will be used as an example of an unmanned aerial vehicle, but the present invention can also be applied to flying robots other than drones.

[0012] [ 1. Overview of the configuration and operation of the remote monitoring system S ] First, with reference to Fig. 1, an overview of the configuration and operation of a remote monitoring system S according to this embodiment will be described. Fig. 1 is a diagram showing an example of the schematic configuration of the remote monitoring system S. As shown in Fig. 1, the remote monitoring system S is configured to include a plurality of drones Dn (n = 1, 2, 3, etc.), a plurality of operator terminals Tm (m = 1, 2, etc.), and a management server MS (an example of an information processing device and a predetermined server). The drones Dn, the operator terminals Tm, and the management server MS are each connected to a communication network NW. The communication network NW is configured, for example, by the Internet, a mobile communication network, its wireless base stations, etc.

[0013] The drone Dn is an example of an unmanned aerial vehicle, also known as a multicopter or UAV. The drone Dn takes off in response to a takeoff command from a GCS (Ground Control Station) and is capable of flying autonomously, and is used for, for example, delivery, surveying, photography, and monitoring. The GCS is installed as an application on, for example, an operator terminal Tm, and is configured to link with a management server MS. The drone Dn can also fly under remote control from the ground using a control terminal (equipped with a GCS) used by the operator.

[0014] Drone Dn is under the jurisdiction of one of multiple drone bases Bm (in other words, it belongs to one of the drone bases Bm). Drone base Bm is a base (e.g., a facility) from which drone Dn can take off and land. In the example of FIG. 1, drones D1 to D4 are each under the jurisdiction of drone base B1, and are configured to depart from and return to drone base B1. Drones D5 to D9 are each under the jurisdiction of drone base B2, and are configured to depart from and return to drone base B2. However, one drone Dn may be under the jurisdiction of multiple drone bases Bm. For example, drone D11 (not shown) may depart from drone base B2 and return to drone base B1. The number of drones Dn under the jurisdiction of one drone base Bm is not particularly limited.

[0015] Furthermore, at the drone base Bm, a port Pm used for takeoff and landing of the drone Dn and a base device Em used for monitoring the drone Dn are installed. At the drone base Bm, base staff (manually) perform a pre-flight inspection (aircraft condition check) of the drone Dn. For example, the base staff visually inspects a predetermined part of the drone Dn for each inspection item in the manual inspection, or inspects the drone Dn by touching a predetermined part of the drone Dn. Then, manual inspection result information indicating the results of the inspection by the base staff is transmitted from the base staff's terminal, such as a smartphone, to the management server MS via the communication network NW. Furthermore, the drone Dn that has undergone the pre-flight inspection is placed at the port Pm and takes off (departs) from the port Pm according to a predetermined drone schedule. Furthermore, the drone Dn that returns to the drone base Bm lands at the port Pm. Note that multiple ports Pm may be installed at one drone base Bm.

[0016] The base device Em is connected to the communication network NW and includes a base camera (e.g., an RGB camera or an infrared camera) for monitoring the drone Dn. The base camera stores a base ID (identification information) for identifying the drone base Bm. The base camera is configured to continuously capture images of the drone Dn placed at the port Pm, for example. Base image information representing base images (still images or video images) captured by the base camera is transmitted from the base device Em to the management server MS along with the base ID. Note that multiple base cameras may be installed at one drone base Bm. The base device Em may also be equipped with a wind sensor that detects (measures) at least one of wind speed and wind direction. The measurement information measured by the wind sensor is transmitted from the base device Em to the management server MS. The base device Em may also be equipped with at least one of a temperature sensor, a humidity sensor, a precipitation (snow) amount sensor, and an air pressure sensor. The measurement information measured by these sensors is transmitted from the base device Em to the management server MS.

[0017] The operator terminal Tm is a terminal used by an operator OPm who remotely monitors multiple drones Dn. The operator terminal Tm displays a list of drones (hereinafter referred to as a "drone list") including simplified drone information (an example of information related to the drones Dn) for each of the multiple drones Dn that require monitoring by the operator OPm. The operator OPm can monitor a drone Dn selected from the drone list by viewing the information displayed on the screen (user interface screen) of the operator terminal Tm. Such monitoring includes, for example, checking the pre-flight inspection status of the drone Dn, monitoring the aircraft status before flight, and monitoring the aircraft status during flight. The monitoring may also include actions accompanying the monitoring (such as instructions from the operator OPm). The management server MS is composed of one or more server computers that manage information related to each drone base Bm for each drone base Bm. The management server MS also receives detailed weather information for the drone base Bm from a weather management server (not shown) regularly or irregularly via a communication network NW.

[0018] [ 1-1. Drone Dn configuration and functions ] Next, the configuration and functions of the drone Dn will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the schematic configuration of the drone Dn. As shown in Fig. 2, the drone Dn includes a power supply unit 11, a drive unit 12, a positioning unit 13, a communication unit 14, a sensor unit 15, a memory unit 16, and a control unit 17. Furthermore, the drone Dn includes a propeller (rotor) which is a horizontal rotor, and an arm pipe (including an arm joint) for attaching the propeller to the drone body (housing). When the drone Dn is used to deliver goods, the drone Dn is provided with a holding mechanism for holding the goods.

[0019] The power supply unit 11 includes a detachable battery (power storage device) and the like. The power supply unit 11 supplies (feeds) the power stored in the battery to each part of the drone Dn. The power supply unit 11 also continuously measures the remaining battery charge. Battery information indicating the remaining battery charge measured by the power supply unit 11 is output to the control unit 17. The drive unit 12 includes a motor, a rotating shaft, and the like. The drive unit 12 rotates multiple rotors using the motor, rotating shaft, and the like that are driven in accordance with control signals output from the control unit 17.

[0020] The positioning unit 13 includes a radio wave receiver, an altitude sensor, and the like. The positioning unit 13 receives radio waves transmitted from positioning satellites of a Global Navigation Satellite System (GNSS), such as a Global Positioning System (GPS), using the radio wave receiver, and sequentially detects the current position of the drone Dn based on the radio waves. The current position of the UAV 1 may be represented by the latitude and longitude of the UAV 1, or by the latitude, longitude, and altitude of the UAV 1. Here, the positioning satellites may include satellites used by multiple satellite positioning systems, such as GPS satellites, Michibiki satellites, and Galileo satellites. Position information indicating the current position detected by the positioning unit 13 is continuously output to the control unit 17. At this time, acquisition number information indicating the number of acquisitions of positioning satellites (satellite acquisition number) acquired by the positioning unit 13 is continuously output to the control unit 17. The positioning unit 13 may also detect the altitude of the drone Dn using an altitude sensor. In this case, the location information indicating the current location of the drone Dn includes the altitude detected by the altitude sensor. The communication unit 14 has an antenna and a wireless communication function, and controls communication performed via the communication network NW.

[0021] The sensor unit 15 includes various sensors used to control the drone Dn. The various sensors include, for example, a compass (geomagnetic sensor), a gyro (three-axis angular velocity sensor), a three-axis acceleration sensor, a barometric pressure sensor, a gimbal, an optical sensor, and a rangefinder. The optical sensor includes an on-board camera (for example, an RGB camera or an infrared camera). The on-board camera is configured to, for example, continuously capture images of the surroundings of the drone Dn (for example, in front of or below the drone Dn). The orientation of the on-board camera (in front of or below the drone Dn) can be controlled by the control unit 17. Sensing information sensed by the sensor unit 15 is output to the control unit 17. The storage unit 16 is configured with a non-volatile memory or the like and stores various programs and data. The storage unit 16 also stores an on-board ID (identification information) for identifying the drone Dn.

[0022] The control unit 17 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and controls the drone Dn based on position information from the positioning unit 13 and sensing information from the sensor unit 15. Such control includes control of the propeller rotation speed, and control of the position, attitude, and direction of travel of the drone Dn. The position information of the drone Dn (i.e., the position information from the positioning unit 13) is transmitted to the management server MS via the communication network NW together with aircraft image information representing an aircraft image (still image or video image) captured by the aircraft camera, battery information from the power supply unit 11, capture number information from the positioning unit 13, and the aircraft ID of the drone Dn.

[0023] The control unit 17 also has a self-diagnosis function and a fail-safe function, and is configured to automatically check whether certain parts of the drone Dn (e.g., the power supply unit 11, the drive unit 12, the positioning unit 13, the communication unit 14, the sensor unit 15, etc.) are operating normally. Items inspected in the automatic inspection include, for example, the remaining battery power, the motor, the compass, the gyro, the acceleration sensor, the air pressure sensor, the gimbal, the optical sensor, and the range finder. Automatic inspection result information indicating the results of the automatic inspection by the drone Dn (i.e., the control unit 17) is transmitted to the management server MS via the communication network NW. The automatic inspection by the drone Dn is performed before and during the flight of the drone Dn.

[0024] [ 1-2.Configuration and functions of operator terminal Tm ] Next, the configuration and functions of the operator terminal Tm will be described with reference to FIG. 3. FIG. 3 is a diagram illustrating an example of a schematic configuration of the operator terminal Tm. The operator terminal Tm includes an operation and display unit 21, a communication unit 22, a storage unit 23, and a control unit 24. For example, a personal computer can be used as the operator terminal Tm. The operator terminal Tm may also include a sound processing unit and a speaker. The operation and display unit 21 has an input function for accepting instruction input (selection) by the operator OPm using, for example, a finger, a pen, or a mouse, and a display function for displaying various screens on a display. Operation information indicating instructions input by the operator OPm from the operation and display unit 21 is transmitted to the management server MS. The operator terminal Tm may be provided with multiple displays. The various screens include a login screen for the operator OPm to log in, a drone monitoring screen for the operator OPm to remotely monitor the drone Dn, and an action request notification screen for notifying the operator OPm of a request for a specific action. The drone monitoring screen and the action request notification screen may be simultaneously displayed on separate displays.

[0025] The communication unit 22 is responsible for controlling communications carried out via the communication network NW. The storage unit 23 is composed of non-volatile memory and the like, and stores various programs (program code groups) and data. The various programs include an operating system (OS), a monitoring application, a GCS, and a web browser. The monitoring application is a program that mainly acquires and displays information about multiple drones Dn managed by an operator OPm from the management server MS. The monitoring application may be downloaded to the operator terminal Tm from a specified server.

[0026] The control unit 24 (an example of a computer) includes a CPU, a ROM, a RAM, etc., and executes processing in accordance with a monitoring application stored in the ROM (or the storage unit 23). When the monitoring application is started in response to an instruction from the operator OPm, the control unit 24 displays a login screen on the display. Then, when the operator OPm inputs a user ID and a password through the login screen, the control unit 24 transmits a login request including the user ID and the password to the management server MS via the communication unit 22 and the communication network NW. The user ID is identification information for identifying the operator OPm.

[0027] Then, the management server MS performs login processing in response to the login request, and when the operator OPm logs in, the management server MS transmits display control data for displaying a drone list showing the multiple drones Dn managed by the logged-in operator OPm. As a result, the control unit 24 displays a drone monitoring screen including the drone list on the display. Note that in the login processing, it is determined whether or not the pair of user ID and password included in the login request has been registered. Then, if the pair of user ID and password has been registered, the operator OPm using the operator terminal Tm that transmitted the login request is identified, and the operator OPm logs in.

[0028] Here, the multiple drones Dn shown in the drone list may be under the jurisdiction of the same drone base Bm, or may be under the jurisdiction of different drone bases Bm. In the latter case, the drone list shows the drones Dn belonging to each of the multiple drone bases Bm (e.g., drone base B1 and drone base B2). This allows the operator OPm to remotely monitor each drone Dn under the jurisdiction of the multiple drone bases Bm that he or she is responsible for. Note that the display control data may be data for a web page displayed by a web browser. The display data for the drone monitoring screen may be incorporated into the monitoring application.

[0029] FIG. 4 is a diagram showing an example of a drone monitoring screen displayed on the operator terminal T1 of the operator OP1. As shown in FIG. 4, the drone monitoring screen displays (side by side) drone lists L1 and L2, each containing simplified drone information for a plurality of drones Dn (D1 to D7) that require monitoring by the operator OP1. The plurality of drones Dn shown in the drone list L1 and the plurality of drones Dn shown in the drone list L2 are basically the same. The display order of the plurality of drone simplified information in the drone list L1 (in the example of FIG. 4, the order of the drone simplified information display areas 1a to 1g in which each drone simplified information is displayed) is controlled according to the monitoring priority (hereinafter referred to as "monitoring priority") of each drone Dn (for example, the display order changes in real time). Here, the monitoring priority indicates, for example, the priority order in which the operator OP1 is to monitor. The monitoring priority is determined based on the status of the drone Dn (hereinafter referred to as "drone status"). The monitoring priority can change according to changes in the drone status.

[0030] On the other hand, the display order of the multiple drone simplified information items in the drone list L2 (in the example of FIG. 4, the order of the drone simplified information display areas 2a-2g in which each drone simplified information item is displayed) is not controlled according to the monitoring priority. The multiple drone simplified information items in the drone list L2 are displayed, for example, in order based on the drone name (the name of the drone Dn) or drone type (for example, in alphabetical order), and the display order is basically fixed (in other words, it does not change frequently compared to the drone list L1). In the example of FIG. 4, the drone names of drones D1-D7 are represented as Drone A-G, respectively. Note that the drone list L2 may be provided with separate display areas for displaying the drone simplified information items for drones D1, D3, and D7 that are currently in flight, for displaying the drone simplified information items for drones D2, D4, and D5 that are on the ground (i.e., currently landing), and for displaying the drone simplified information item for drone D6 that is prohibited from flying.

[0031] In the drone list L1, the drone simple information display areas 1a-1f can be selected by the operator OP1. In other words, one of the drones Dn is selected via the drone simple information display areas 1a-1f. In the example of FIG. 4, the drone D3 is selected by the operator OP1 selecting (pressing) the drone simple information display area 1a. Therefore, the monitoring information used to monitor the selected drone D3 (i.e., the monitoring information for drone D3) is displayed in the drone monitoring information display area MA. Here, the monitoring information includes, for example, manual inspection result information, aircraft data information, aircraft image information, base image information, measurement information, and detailed weather information (in the example of FIG. 4, the weather at drone base B1 over which drone D3 is located). The monitoring information display area MA includes a drone basic information display area MA1, a drone detailed information display area MA2, an aircraft camera display area MA3, and a base camera display area MA4. The drone simple information display area 1g, which is located at the bottom of the drone list L1, is grayed out, but can be selected by the operator OP1. When the drone simple information display area 1g is selected by the operator OP1, the reason why drone D6 is not allowed to fly is displayed on the drone monitoring screen. This allows the operator OP1 to confirm the reason why it is not allowed to fly.

[0032] In the drone list L1, the simplified drone information includes the drone name (which may be the aircraft ID) of the drone Dn, the base name of the drone base Bm over which the drone Dn is located, the drone status of the drone Dn, and drone status details. Here, the simplified drone information only needs to include at least the drone name (which may be the aircraft ID) of the drone Dn, and preferably includes the drone status. The simplified drone information may also include the port name of the port Pm where the drone Dn is landing. Meanwhile, in the drone list L2, the simplified drone information includes the drone name (which may be the aircraft ID) of the drone Dn and the base name of the drone base Bm over which the drone Dn is located, but does not include the drone status or drone status details of the drone Dn. The display content of the drone list L2 is simplified compared to the display content of the drone list L1.

[0033] Furthermore, in the drone list L1, the drone simple information displayed in the drone simple information display area 1a includes "flight error" as the drone status of drone D3 (drone name: "Drone C") and "motor stopped" as the drone status details (flight error details) of drone D3. Here, "flight error" indicates that some kind of error (abnormality) has occurred in drone D3 while in flight, and the error details are "motor stopped." Furthermore, the drone simple information displayed in the drone simple information display area 1b arranged below the drone simple information display area 1a includes "flight error" as the drone status of drone D1 (drone name: "Drone A") and "low battery" as the drone status details of drone D1. In addition to "flight error," the drone status of drone D3 while in flight also includes "flight action," although this is not shown. The "flight action" indicates that some kind of action (e.g., a landing permission instruction or an instruction to drop an item) is required by operator OP1 for drone D3 while in flight.

[0034] Furthermore, the drone simplified information displayed in the drone simplified information display area 1c, which is arranged below the drone simplified information display area 1b, includes "ground action" as the drone status of drone D4 (drone name: "Drone D") and "takeoff decision" as the drone status details (ground action details) of drone D4. Here, "ground action" indicates that some action (e.g., a takeoff permission command) by operator OP1 is required for drone D4 on the ground (e.g., placed at port P1), and the details of such action are "takeoff decision." Note that the action related to takeoff decision corresponds to pressing a takeoff decision button (not shown). Similarly, the drone simplified information displayed in the drone simplified information display area 1d, which is arranged below the drone simplified information display area 1c, includes "ground action" as the drone status of drone D2 (drone name: "Drone B") and "takeoff decision" as the drone status details of drone D2.

[0035] Additionally, the drone simple information displayed in drone simple information display area 1e, which is positioned below drone simple information display area 1d, includes "flying" as the drone status for drone D7 (drone name: "Drone G"). Here, "flying" indicates that drone D7, which is in flight, is not experiencing any errors. Additionally, the drone simple information displayed in drone simple information display area 1f, which is positioned below drone simple information display area 1e, includes "ground error" as the drone status for drone D5 (drone name: "Drone E"), and "abnormal attitude" as the drone status details for drone D5. Here, "ground error" indicates that some kind of error has occurred with drone D5, which is on the ground, and the details of the error are "abnormal attitude."

[0036] Furthermore, the drone simple information displayed in drone simple information display area 1g, located at the bottom of drone list L1, includes "Not allowed to fly" as the drone status for drone D6 (drone name: "Drone F"). Here, "Not allowed to fly" indicates that drone D6 on the ground cannot fly because the results (inspection results) of its pre-flight inspection (aircraft condition check by base staff) were not good. For this reason, as mentioned above, drone simple information display area 1g is grayed out. Note that in drone list L1, there is a limit to the number of drone simple information display areas that can fit on the drone monitoring screen, so drone simple information display areas that do not fit on one screen can be displayed by scrolling using operator OP1.

[0037] Furthermore, the drone basic information display area MA1 displays basic information about drone D3, the drone status of drone D3, the drone schedule of drone D3, and the weather status of drone base B1. Here, the basic information about drone D3 includes, for example, the drone name, drone type (e.g., type or model number), manufacturer, and the base name of drone base B1. The drone schedule of drone D3 includes, for example, the scheduled times for drone D3 to arrive at the base, take off, and arrive at the destination (e.g., arrival at the delivery destination of the package). The weather status is based on detailed weather information. Note that measurement information measured by a sensor provided in base device Em may also be displayed in drone basic information display area MA1.

[0038] The drone detailed information display area MA2 displays an aircraft status check tab TB1, an aircraft data tab TB2, and a weather status tab TB3. In the display example of Figure 4, the aircraft status check tab TB1 is selected, so aircraft status check information is displayed below tabs TB1 to TB3. The aircraft status check information is based on the manual inspection result information described above. The "OK" displayed in association with the inspection item "arm joint looseness" included in the aircraft status check information indicates that the results of this pre-flight inspection were good. When the aircraft data tab TB2 is selected, aircraft data information is displayed below tabs TB1 to TB3. The aircraft data information is based on the battery information and acquisition count information described above. When the weather status tab TB3 is selected, detailed weather information for drone base B1 is displayed below tabs TB1 to TB3.

[0039] The on-board camera display area MA3 displays a video captured by the on-board camera of the drone D3 (i.e., on-board camera video based on the on-board image information). On the other hand, the base camera display area MA4 displays a video captured by the base camera of the base device E1 (i.e., base camera video based on the base image information).

[0040] [ 1-3.Configuration and Functions of Management Server MS ] Next, the configuration and functions of the management server MS will be described with reference to FIG. 5. FIG. 5 is a diagram illustrating an example of a schematic configuration of the management server MS. As illustrated in FIG. 5, the management server MS includes a communication unit 31, a storage unit 32, a control unit 33, and the like. The communication unit 31 controls communications via the communication network NW. The communication unit 31 receives manual inspection result information, base image information, measurement information, and base ID transmitted from the base device E. The communication unit 31 receives battery information, capture number information, aircraft image information, position information of the drone Dn, automatic inspection result information, and aircraft ID transmitted from the drone Dn. The management server MS can recognize the current position of the drone Dn based on the position information of the drone Dn. The communication unit 31 also receives operation information and login requests transmitted from the operator terminal Tm. The communication unit 31 also receives detailed weather information transmitted from the weather management server.

[0041] The storage unit 32 is configured, for example, with a hard disk drive or the like, and stores various programs including an operating system and applications. Here, the applications include a program for executing a display control method. The storage unit 32 also stores a monitoring priority master table. The monitoring priority master table is a table that registers monitoring priorities in association with each drone status. FIG. 6 is a diagram showing an example of the monitoring priority master table. In the example of FIG. 6, a monitoring priority of "1" (the highest monitoring priority) is associated with a "flight error," a monitoring priority of "2" (the second highest monitoring priority) is associated with a "flight action," and a monitoring priority of "3" (the third highest monitoring priority) is associated with a "ground action."

[0042] Here, flight errors may be classified into multiple categories (multiple types) depending on the degree of the error (in other words, the importance). This allows for different monitoring priorities when there are multiple drones Dn whose drone status indicates a flight error. Examples of the degree of the error include most important (highest degree of error) and minor. For example, if the drone Dn's situation is unknown or if the drone Dn is unable to take a safe landing, the degree of the error is determined to be most important. Examples of cases where a safe landing is not possible include when the return-to-home (RtH) function does not work or when the drone Dn cannot land at an emergency landing zone (ELZ). In other words, if the drone Dn is at risk of making an emergency landing or if the drone Dn has no choice but to land on the spot, the degree of the error is determined to be most important. On the other hand, if the drone Dn's failsafe is activated or if the drone Dn is able to take a safe landing with the intervention of an operator OPm or the like, the degree of the error is determined to be minor.

[0043] The degree of error may be registered in association with the drone status in the monitoring priority master table. In the example of FIG. 6, the degree of error is divided into two types, most important and minor, but may be divided into three or more types. Furthermore, the degree of error may be registered in association with not only flight errors but also ground errors. In the example of FIG. 6, different monitoring priorities are associated with different drone statuses (e.g., a monitoring priority of "3" for "ground action" and a monitoring priority of "4" for "flight"), but the same monitoring priority may be associated with different drone statuses (e.g., a monitoring priority of "3" for "ground action" and "flight").

[0044] Furthermore, the storage unit 32 has constructed therein a base management database (DB) 321, a drone management database (DB) 322, and an operator management database (DB) 323. The base management database 321 is a database for managing information related to drone bases Bm. The base management database 321 stores, for example, the base ID of the drone base Bm, base image information, measurement information, detailed weather information, weather status, and the aircraft ID of the drone Dn under the jurisdiction of the drone base Bm, all associated with each drone base Bm. Note that the base image information, measurement information, and detailed weather information may be updated as appropriate each time they are received by the communication unit 31.

[0045] The drone management database 322 is a database for managing information related to drones Dn. The drone management database 322 stores the drone Dn's aircraft ID, location information, basic information, drone status, drone schedule, manual inspection result information, aircraft data information, and aircraft image information, etc., in association with each drone Dn. The aircraft data information includes, for example, battery information and capture count information. The manual inspection result information, aircraft data information, and aircraft image information may be updated as appropriate each time they are received by the communication unit 31.

[0046] Furthermore, the drone status is updated as appropriate, for example, in accordance with various information (including information from drone Dn) received by the communication unit 31, the drone schedule, or instruction information from an administrator or the like. The time at which the drone status is switched (i.e., changed) may be registered in the drone management database 322. Here, the drone status may be switched, for example, from "ground action" to "flying" or from "flying" to "flying error." The switching time registered in the drone management database 322 may be the most recent switching time. In this case, the switching time is overwritten and updated each time the drone status is switched.

[0047] The operator management database 323 is a database for managing information related to the operator OPm. The operator management database 323 stores the user ID, password, login status, and the aircraft ID and name of each of the multiple drones Dn that the operator OPm is in charge of, in association with each operator OPm. Here, the login status indicates whether the operator OPm is logged in or not.

[0048] The control unit 33 (an example of a computer) includes a CPU, a ROM, a RAM, etc. FIG. 7 is a diagram illustrating an example of functional blocks in the control unit 33. The CPU may be a general-purpose processor, a special-purpose processor, or a processor including transistors and other integrated circuits (electrical circuits or electronic circuits). The control unit 33 functions as a status identification unit 331 (an example of a first identification unit), a monitoring priority identification unit 332 (an example of a second identification unit), a display control unit 333 (an example of first to third display control units), and a warning output control unit 334 (an example of a warning output control unit), for example, in accordance with a program (a group of program codes) stored in the ROM or the storage unit 32, as shown in FIG. 7.

[0049] The status identification unit 331 identifies, for example, the current drone status of each of the multiple drones Dn managed by the logged-in operator OPm, for example, from the drone management database 322. The monitoring priority identification unit 332 identifies a monitoring priority for each drone Dn based on the drone status identified by the status identification unit 331. That is, the monitoring priority is identified for use in controlling the display of the drone list L1. This simplifies and speeds up the process of controlling the display of the drone list L1, while allowing the operator OPm, who remotely monitors the multiple drones Dn, to quickly identify the drones Dn that require priority monitoring. For example, the monitoring priority identification unit 332 may identify, from a monitoring priority master table, the monitoring priority associated with the drone status identified by the status identification unit 331. The monitoring priority identified for each drone Dn may be recorded in association with the drone ID in a drone list table that registers the drone ID of each drone Dn.

[0050] The display control unit 333 transmits display control data to the operator terminal Tm for displaying drone lists L1 and L2, each containing simplified drone information for each of the multiple drones Dn managed by the operator OPm. As a result, the display control unit 333 displays the drone list L2 along with the drone list L1 on the drone monitoring screen of the operator terminal Tm, as shown in FIG. 4, for example. By displaying both the drone list L1, whose display is controlled based on the drone status of the drone Dn, and the drone list L2, which is ordered based on the drone name or drone type, in this manner, it is possible to improve the ease of identifying drones Dn that require priority monitoring. In other words, even if the operator OPm frequently moves his or her line of sight due to frequent changes in the order of the drones Dn in the drone list L1, the drone list L2, in which the order of the drones Dn remains essentially unchanged, is displayed next to the drone list L1, thereby improving the ease of identifying drones Dn that require priority monitoring.

[0051] That is, the display control unit 333 controls the display of the drone list L1 according to the monitoring priority identified by the monitoring priority identification unit 332. For example, the display control unit 333 may control at least one of the display order and display mode of the drone simplified information in the drone list L1 according to the monitoring priority identified by the monitoring priority identification unit 332. This allows the operator OPm, who remotely monitors multiple drones Dn, to quickly and easily identify at a glance the drones Dn that require priority monitoring. Here, the display control unit 333 may update (including change) at least one of the display order and display mode of the drone simplified information in the drone list L1 in response to a change in the drone status of any of the drones Dn. This allows the display of the drone list L1 to be updated efficiently. For example, display control data including the respective monitoring priorities of the multiple drones Dn in the drone list L1 may be transmitted to the operator terminal Tm in response to a change in the drone status.

[0052] In controlling the display order of the drone simplified information, the display control unit 333 displays the drone simplified information of a drone Dn higher in the drone list L1 (i.e., in a display position that is more visible to the operator OPm) for a drone Dn with a higher monitoring priority. This allows the operator OPm to quickly grasp at a glance which drones Dn require priority monitoring. When multiple drones Dn have the same drone status (e.g., the same monitoring priority), the display control unit 333 displays the drone simplified information of the drone Dn whose drone status has been changed most recently (i.e., closest to the current time) higher in the drone list L1. This allows the operator OPm, who remotely monitors multiple drones Dn, to quickly grasp which drones Dn require priority monitoring. In other words, the monitoring priority of multiple drones Dn with the same drone status is adjusted.

[0053] Alternatively, when the drone statuses of multiple drones Dn are the same (for example, the monitoring priorities are the same) and the drone status indicates that an error has occurred in the drone Dn (for example, when a flight error is indicated), the display control unit 333 may adjust the monitoring priority and display the drone simplified information of the drone Dn with the highest degree of error (that is, the most important degree of error) higher up in the drone list L1. This also allows the operator OPm remotely monitoring multiple drones Dn to quickly grasp the drones Dn that require higher priority monitoring.

[0054] In the example of FIG. 4, the drone statuses of drone D4 and drone D2 both indicate ground actions, so the same monitoring priority of "3" is assigned to drone D4 and drone D2. Therefore, the display control unit 333 identifies the most recent change time of the drone status of each of drone D4 and drone D2, and adjusts the monitoring priority so that drone D4, which has had its drone status changed most recently (i.e., the drone whose most recent change time is closer to the current time), is given a higher priority. As a result, the display control unit 333 displays the simplified drone information of drone D4, which has had its drone status changed most recently, higher than the simplified drone information of drone D2. Note that even when three or more drones Dn have the same drone status, the most recent change time of the drone status of each drone Dn is identified, and the monitoring priority is adjusted so that the most recent change time is given to the drone whose drone status is changed most recently.

[0055] 4, the drone statuses of drone D3 and drone D1 both indicate a flight error, and therefore the same monitoring priority of "1" is assigned to drone D3 and drone D1. Therefore, the display control unit 333 determines the degree of error of drone D3 as the most important based on the drone status details of drone D3 (motor stopped), and determines the degree of error of drone D1 as minor based on the drone status details of drone D1 (low battery level), and adjusts the monitoring priority of drone D3, which has the highest degree of flight error, to be higher. As a result, the display control unit 333 displays the simplified drone information of drone D3, which has the most important degree of error, higher than the simplified drone information of drone D1, which has the minor error.

[0056] In addition, when the drone statuses of multiple drones Dn are the same and the drone status indicates that an error has occurred in the drone Dn, the display control unit 333 may display the drone simple information of the drone Dn whose drone status has been changed most recently higher in the drone list L1 without determining the extent of the error.

[0057] Meanwhile, in controlling the display mode of the drone simplified information, the display control unit 333 displays the drone simplified information of the drone Dn in a more conspicuous display mode (i.e., a display mode that attracts the operator OPm's attention) in the drone list L1 for drones Dn with a higher monitoring priority. Examples of a more conspicuous display mode include making the size of the text, etc., related to the drone simplified information larger than the standard setting, making the color of the text, etc., related to the drone simplified information brighter (e.g., red) than the standard setting, or making the lines of the text, etc., related to the drone simplified information thicker than the standard setting. The text, etc., may be at least one of characters, symbols, pictures, and figures. Other examples of displaying the text, etc., related to the drone simplified information in a more conspicuous display mode may include transitioning the text, etc., related to the drone simplified information from a non-blinking state to a blinking state, or making the area (background) in which the text, etc., related to the drone simplified information is displayed or the frame of that area brighter than the standard setting, or making the frame thicker than the standard setting.

[0058] Note that, when the drone statuses of the multiple drones Dn are the same, the display control unit 333 may adjust the monitoring priority and display the drone simplified information of the drone Dn whose drone status has been switched most recently among the multiple drones Dn in a prominent display mode. Alternatively, when the drone statuses of the multiple drones Dn are the same and the drone status indicates that an error has occurred in the drone Dn (for example, a flight error), the display control unit 333 may adjust the monitoring priority and display the drone simplified information of the drone Dn with the highest degree of error in a prominent display mode.

[0059] Furthermore, in response to the operator OPm's selection of one of the drones Dn in the drone list L1, the display control unit 333 transmits display control data to the operator terminal Tm for displaying monitoring information for the selected drone Dn. Note that selection information including the aircraft ID of the drone Dn selected by the operator OPm is transmitted from the operator terminal Tm to the management server MS. As a result, for example, in FIG. 4, the drone simplified information display area 1a for the drone D3 selected in the drone list L1 is selected, and the monitoring information for the drone D3 is displayed in the monitoring information display area MA on the drone monitoring screen of the operator terminal T1.

[0060] For example, operator OP1 will take appropriate action against the flight error while looking at the monitoring information for drone D3. As a result, when the drone status of drone D3 switches from flight error to flight, the monitoring priority of drone D3 will be lowered. Therefore, the display control unit 333 shifts the drone simplified information for drone D3 from the top to a lower position in the drone list L1, and shifts the drone simplified information for other drones Dn (for example, drone D1) to the top.

[0061] The warning output control unit 334 outputs a warning message to the operator terminal Tm when the monitoring priority of the drone Dn selected by the operator OPm in the drone list L1 is lower than the monitoring priority of the drones Dn not selected among the multiple drones Dn in the drone list L1. This effectively prevents the operator OPm from delaying their response. The warning message may be displayed or output as audio on the operator terminal Tm. FIG. 8 is a diagram showing an example of a drone monitoring screen displayed on the operator terminal T1 when the operator OP1 first selects a drone D1 with a lower monitoring priority than the drone D3. In the example of FIG. 8, the drone D1 with a lower monitoring priority than the drone D3 is selected by the operator OP1 even though the drone D3 has not yet been addressed (e.g., issued an instruction such as a predetermined action) (i.e., the operator OP1 has not yet completed its response to the drone D3). Therefore, a warning message M is displayed on the drone monitoring screen of the operator terminal T1.

[0062] A flag indicating that a drone Dn has been selected in the drone list L1 may be recorded in the drone list table in association with the aircraft ID and monitoring priority of the selected drone Dn. In this case, whether a drone Dn with a lower monitoring priority than a drone Dn that has not yet been selected is determined by referring to the drone list table. However, the flag indicating that a drone Dn has been selected does not have to be recorded in association with the aircraft ID of the selected drone Dn. This is because the display order of the drone simplified information is updated as the drone status of the drone Dn changes. In this case, the warning output control unit 334 outputs a warning message to the operator terminal Tm when the monitoring priority of the drone Dn selected by the operator OPm is not the highest among the multiple drones Dn in the drone list L1 (i.e., the priority is not first). This reduces the server load for recording the flag indicating the selection and accurately prevents delays in the operator OPm's response.

[0063] [ 2. Operation of the remote monitoring system S ] Next, an operation example of the remote monitoring system S will be described with reference to Fig. 9. Fig. 9 is a flowchart showing a display control process executed by the control unit 33 of the management server MS. Note that in the operation example described below, it is assumed that an operator OP1 of the operator terminal T1 is logged in, and that multiple drones Dn that are in charge of the logged-in operator OP1 have been identified.

[0064] The display control process shown in Fig. 9 is started, for example, when a drone monitoring screen is displayed on the operator terminal T1. When the process in Fig. 9 is started, the control unit 33 identifies the drone status of each of the multiple drones Dn managed by the operator OP1 by the status identification unit 331, for example, from the drone management database 322 (step S1). Note that in the subsequent process, the status identification unit 331 may identify the drone status of each of the multiple drones Dn managed by the operator OP1 at predetermined time intervals.

[0065] Next, the control unit 33 uses the monitoring priority identification unit 332 to identify (for example, acquire from the monitoring priority master table) a monitoring priority for each drone Dn based on the drone status identified in step S1 and the monitoring priority master table (step S2). Each monitoring priority identified in this way is associated with the aircraft ID of the corresponding drone Dn and stored in an adjustable (updatable) manner, as described below.

[0066] Next, the control unit 33 determines whether there are multiple drones Dn with the same drone status identified in step S1 (step S3). If it is determined that there are multiple drones Dn with the same drone status (step S3: YES), the process proceeds to step S4. On the other hand, if it is determined that there are not multiple drones Dn with the same drone status (step S3: NO), the process proceeds to step S10.

[0067] In step S4, the control unit 33 determines whether the same drone statuses each indicate an error (e.g., a flight error). If it is determined that the same drone statuses each indicate an error (step S4: YES), the process proceeds to step S5. On the other hand, if it is determined that the same drone statuses each do not indicate an error (step S4: NO), the process proceeds to step S8.

[0068] In step S5, the control unit 33 determines the degree of error for each of the same drone statuses, for example, by referring to the monitoring priority master table. Next, the control unit 33 attempts to adjust the monitoring priority of each of the drones Dn having the same drone status (indicating an error) based on the degree of each error determined in step S5 (step S6). For example, if the monitoring priority of each of drones D3 and D1 is "1," the monitoring priority of drone D3 is adjusted to "1-1" and the monitoring priority of drone D1 is adjusted to "1-2," thereby achieving adjustment between drones D3 and D1, whose monitoring priority is "1."

[0069] Next, the control unit 33 determines whether or not a difference in monitoring priority has occurred in step S6 (step S7). If it is determined that no difference in monitoring priority has occurred (step S7: NO), the process proceeds to step S8. Note that if there are three or more identical monitoring priorities, and no difference has occurred among all of the monitoring priorities, the process proceeds to step S8. On the other hand, if it is determined that a difference in monitoring priority has occurred (step S7: YES), the process proceeds to step S10.

[0070] In step S8, the control unit 33 identifies the most recent change time of the drone status of each drone Dn (the same drone status). Next, the control unit 33 adjusts the monitoring priority of each drone Dn with the same drone status based on the change time identified in step S8 (step S9). In other words, the monitoring priority is adjusted so that the more recent the change time, the higher the monitoring priority. Note that if the most recent change times of the drone status of each drone Dn are the same, it is preferable to adjust the monitoring priority so that there is a difference in the order based on the drone name of the drone Dn.

[0071] In step S10, the control unit 33 transmits display control data for displaying drone lists L1 and L2 of the multiple drones Dn whose monitoring priorities have been specified (including the above adjustment) in the above process to the operator terminal T1 via the display control unit 333, thereby displaying the drone lists L1 and L2 on the drone monitoring screen. The display control data preferably includes simplified drone information and monitoring priorities for each of the multiple drones Dn. As a result, the drone list L1 displayed on the operator terminal T1 displays the simplified drone information for each drone Dn in a display order (or display format) according to each monitoring priority. Furthermore, the drone list L2 displayed on the operator terminal T1 displays the simplified drone information for each drone Dn in an order based on the drone name. The display control data may be data (e.g., webpage data) in which the simplified drone information for each drone Dn is arranged (layed out) in a display order (or display format) according to each monitoring priority. In this case, the display control data does not necessarily include each monitoring priority.

[0072] Next, the control unit 33 determines whether any drone Dn has been selected by the operator OP1 from among the multiple drones Dn in the drone list L1 (step S11). For example, it is determined that the drone Dn has been selected by the operator OP1 when selection information including the aircraft ID of the drone Dn selected by the operator OP1 is received by the communication unit 31. If it is determined that the drone Dn has been selected (step S11: YES), the process proceeds to step S12. On the other hand, if it is determined that the drone Dn has not been selected (step S11: NO), the process proceeds to step S15.

[0073] In step S12, the control unit 33 determines whether the monitoring priority of the drone Dn selected by the operator OP1 is lower than the monitoring priority of a drone Dn for which response has not yet been completed among the multiple drones Dn in the drone list L1. If it is determined that the monitoring priority of the selected drone Dn is lower than the monitoring priority of a drone Dn for which response has not yet been completed (step S12: YES), the process proceeds to step S13. On the other hand, if it is determined that the monitoring priority of the selected drone Dn is not lower (i.e., higher) than the monitoring priority of a drone Dn for which response has not yet been completed (step S12: NO), the process proceeds to step S14. Note that whether response has been completed for the drone Dn is determined by the control unit 33 based on operation information from the operator terminal T1, etc.

[0074] In step S12, the control unit 33 may determine whether the monitoring priority of the drone Dn selected by the operator OP1 is the highest among the multiple drones Dn in the drone list L1. If it is determined that the monitoring priority of the drone Dn selected by the operator OP1 is not the highest among the multiple drones Dn in the drone list L1 (step S12: YES), the process proceeds to step S13. On the other hand, if it is determined that the monitoring priority of the drone Dn selected by the operator OP1 is the highest among the multiple drones Dn in the drone list L1 (step S12: NO), the process proceeds to step S14.

[0075] In step S13, the control unit 33 transmits a warning message to the operator terminal T1 via the warning output control unit 334. As a result, the warning message is output from the operator terminal T1. In step S14, the control unit 33 transmits display control data for displaying the monitoring information of the drone Dn selected by the operator OP1 to the operator terminal T1. As a result, the monitoring information of the drone Dn selected in the drone list L1 is displayed in the monitoring information display area MA.

[0076] In step S15, the control unit 33 determines whether or not it is time to update the drone list. This update timing is set, for example, by a timer so that it occurs at predetermined time intervals. If it is determined that it is time to update the drone list (step S15: YES), the process returns to step S1. This updates the display of the drone lists L1 and L2. Note that it may also be determined that it is time to update the drone list when the drone status of any one of the multiple drones Dn managed by the operator OP1 is switched.

[0077] On the other hand, if it is determined that the timing for updating the drone list has arrived (step S15: NO), the process proceeds to step S16. In step S16, the control unit 33 determines whether to end the display control process. For example, when the control unit 33 receives a screen transition request from the operator terminal T1 in response to an instruction from the operator OP1 to transition to another screen, the control unit 33 determines to end the display control process (step S16: YES) and proceeds to other processes. On the other hand, if it is determined not to end the display control process (step S16: NO), the process returns to step S11.

[0078] As described above, according to the above embodiment, the management server MS is configured to display on the operator terminal Tm a drone list L1 including simplified drone information for each of the multiple drones Dn that require monitoring by the operator OPm, identify the drone status of each of the multiple drones Dn, identify a monitoring priority for each drone Dn based on the identified drone status, and control the display of the drone list L1 according to the identified monitoring priority. This allows the operator OPm, who remotely monitors the multiple drones Dn, to quickly identify the drones Dn that require priority monitoring, thereby preventing delays in the operator OPm's response. In other words, the operator OPm can quickly determine which of the multiple drones Dn that he or she is responsible for monitoring should focus on and prioritize in response.

[0079] The above embodiment is one embodiment of the present invention, and the present invention is not limited to the above embodiment. Various configurations and other changes may be made to the above embodiment without departing from the spirit and scope of the present invention, and such changes are still within the technical scope of the present invention. In the above embodiment, the monitoring priority determined based on the drone status of each drone Dn can be used to simplify and speed up the process of controlling the display of the drone list L1. However, the display of the drone list L1 may be controlled based on the drone status of each drone Dn without using such monitoring priority. In this case, the management server MS may pre-store reference information that determines, for example, which of multiple drone statuses corresponds to which drone simplified information should be displayed in a higher display order (or which drone simplified information corresponding to which drone status should be displayed in a more prominent display mode). When the drone status of each drone Dn is determined, the management server MS may control the display of the drone list L1 by referencing the reference information.

[0080] Furthermore, in the above embodiment, the operator terminal Tm (control unit 24) may be configured to acquire and display a drone list L1 including simplified drone information for each of a plurality of drones Dn that require monitoring by the operator OPm according to a monitoring application from the management server MS, acquire the drone status of each of the plurality of drones Dn from the management server MS, identify a monitoring priority for each drone Dn based on the respective drone statuses, and control the display of the drone list L1 according to the identified monitoring priorities. In this case, the storage unit 23 of the operator terminal Tm may store the above-mentioned monitoring priority master table. Furthermore, the operator terminal Tm may store the above-mentioned reference information in advance, similar to the management server MS, and, when acquiring the drone status of each drone Dn, control the display of the drone list L1 by referring to the reference information.

[0081] <Additional Notes> [1] The information processing device according to the present disclosure is characterized by comprising: a first display control means for displaying, on an operator's terminal, a list of unmanned aerial vehicles including information about each of the unmanned aerial vehicles that require monitoring by the operator; a first identification means for identifying the status of each of the unmanned aerial vehicles; and a second display control means for controlling the display of the list of unmanned aerial vehicles based on the status of each of the unmanned aerial vehicles. This allows an operator remotely monitoring multiple unmanned aerial vehicles to quickly identify unmanned aerial vehicles that require priority monitoring.

[0082] [2] The information processing device described in [1] above further comprises a second identification means for identifying the monitoring priority for each unmanned aerial vehicle based on the status of each unmanned aerial vehicle, and the second display control means controls the display of the aircraft list according to the monitoring priority. This simplifies and speeds up the process of controlling the display of the aircraft list, and enables an operator remotely monitoring multiple unmanned aerial vehicles to quickly identify unmanned aerial vehicles that require priority monitoring.

[0083] [3] In the information processing device described in [2] above, the second display control means controls at least one of the display order and display mode of the information about the unmanned aerial vehicle in the aircraft list according to the monitoring priority, thereby enabling an operator remotely monitoring multiple unmanned aerial vehicles to quickly and easily grasp at a glance which unmanned aerial vehicles require priority monitoring.

[0084] [4] In the information processing device described in any one of [1] to [3] above, the second display control means is characterized in that, in response to a change in the status of any one of the unmanned aerial vehicles, at least one of the display order and the display mode of the information relating to that unmanned aerial vehicle in the aircraft list is updated, thereby enabling the display of the aircraft list to be updated efficiently.

[0085] [5] In the information processing device described in any one of [2] to [4] above, the second display control means is characterized in that the higher the monitoring priority of an unmanned aircraft, the higher the position of information about that unmanned aircraft in the aircraft list is displayed. This allows an operator remotely monitoring multiple unmanned aircraft to quickly and easily grasp at a glance which unmanned aircraft require priority monitoring.

[0086] [6] The information processing device according to any one of [2] to [5] above further comprises a third display control means for displaying on the terminal, in response to the operator's selection of any one of the plurality of unmanned aerial vehicles in the aircraft list, monitoring information used to monitor the selected unmanned aerial vehicle, and a warning output control means for outputting a warning message to the terminal when the priority of the selected unmanned aerial vehicle is lower than the priority of an unmanned aerial vehicle among the plurality of unmanned aerial vehicles in the aircraft list that has not yet been addressed. This makes it possible to reliably prevent delays in the operator's response.

[0087] [7] The information processing device according to any one of [2] to [5] above further comprises a third display control means for displaying on the terminal, in response to the operator's selection of one of the plurality of unmanned aerial vehicles in the aircraft list, monitoring information used to monitor the selected unmanned aerial vehicle, and a warning output control means for outputting a warning message to the terminal when the priority of the selected unmanned aerial vehicle is not the highest among the plurality of unmanned aerial vehicles in the aircraft list. This makes it possible to reliably prevent delays in the response of the operator OPm.

[0088] [8] In the information processing device described in any one of [1] to [7] above, the first display control means is characterized in that, together with the aircraft list, the first display control means displays on the operator's terminal an aircraft list in which the display order of information about each of the plurality of unmanned aerial vehicles is based on the name or type of each of the plurality of unmanned aerial vehicles. By displaying both the aircraft list whose display is controlled based on the status of the unmanned aerial vehicle and the aircraft list whose display order is based on the name of the unmanned aerial vehicle, it is possible to improve the ease of identifying unmanned aerial vehicles that require priority monitoring.

[0089] [9] In the information processing device described in any one of [1] to [8] above, the second display control means is characterized in that, when the statuses of the plurality of unmanned aerial vehicles are the same, information about the unmanned aerial vehicle whose status has been changed most recently is displayed higher in the aircraft list, thereby enabling an operator remotely monitoring the plurality of unmanned aerial vehicles to quickly identify the unmanned aerial vehicle that requires higher priority monitoring.

[0090]

[10] In the information processing device described in any one of [1] to [9] above, the second display control means is characterized in that, when the statuses of the plurality of unmanned aerial vehicles are the same and the statuses indicate that an abnormality has occurred in the unmanned aerial vehicles, the information about the unmanned aerial vehicle with the highest degree of abnormality is displayed higher in the aircraft list, thereby enabling an operator remotely monitoring the plurality of unmanned aerial vehicles to quickly identify the unmanned aerial vehicle that requires monitoring with a higher priority.

[0091]

[11] The display control method of the present disclosure is a display control method executed by one or more computers, and is characterized by including the steps of displaying a list of aircraft on an operator's terminal, the list including information regarding each of a plurality of unmanned aircraft that require monitoring by the operator, identifying the status of each of the unmanned aircraft, and controlling the display of the list of aircraft based on the status of each of the unmanned aircraft.

[0092]

[12] The program disclosed herein is characterized by causing a computer included in a terminal used by an operator to execute the steps of: displaying on the terminal a list of aircraft including information regarding each of a plurality of unmanned aircraft that require monitoring by the operator; obtaining the status of each of the unmanned aircraft from a predetermined server; and controlling the display of the list of aircraft based on the status of each of the unmanned aircraft. [Explanation of symbols]

[0093] 11 Power supply section 12 Drive unit 13 Positioning unit 14 Communications Department 15 Sensor section 16 Memory section 17 Control Unit 21 Operation / display section 22 Communications Department 23 Memory section 24 Control Unit 31 Communications Department 32 Storage section 33 Control Unit 331 Status Identification Section 332 Monitoring priority identification section 333 Display control unit 334 Warning output control unit Dn Drone Tm Operator Terminal MS Management Server OPm Operator S Remote Monitoring System

Claims

1. a first display control means for displaying, on a terminal of the operator, a list of unmanned aerial vehicles including information about each of the unmanned aerial vehicles that require monitoring by the operator; a first identification means for identifying a status of each of the unmanned aerial vehicles; a second identification means for identifying a monitoring priority for each of the unmanned aerial vehicles based on the status of each of the unmanned aerial vehicles; a second display control means for controlling the display of the list of aircraft in accordance with the priority of the monitoring; a third display control means for displaying, on the terminal, monitoring information used to monitor a selected unmanned aerial vehicle from among the plurality of unmanned aerial vehicles in the list of vehicles, in response to the operator's selection of the selected unmanned aerial vehicle; a warning output control means for outputting a warning message to the terminal when the priority of the selected unmanned aerial vehicle is lower than the priority of an unmanned aerial vehicle among the plurality of unmanned aerial vehicles in the aircraft list that has not yet been dealt with, or when the priority of the selected unmanned aerial vehicle is not the highest among the plurality of unmanned aerial vehicles in the aircraft list; An information processing device comprising:

2. The information processing device described in claim 1, characterized in that the second display control means controls at least one of the display order and display mode of information regarding the unmanned aerial vehicle in the aircraft list according to the monitoring priority.

3. The information processing device described in claim 2, characterized in that the second display control means updates at least one of the display order and display mode of information regarding the unmanned aerial vehicle in the aircraft list in response to a change in the status of any of the unmanned aerial vehicles.

4. The information processing device according to claim 1, characterized in that the second display control means displays information about an unmanned aircraft higher in the aircraft list, the higher the monitoring priority of the unmanned aircraft.

5. A first display control means for displaying on the operator's terminal a list of unmanned aerial vehicles including information about each of the unmanned aerial vehicles that require monitoring by the operator; a first identification means for identifying a status of each of the unmanned aerial vehicles; a second display control means for controlling the display of the list of aircraft based on the status of each of the unmanned aerial vehicles; Equipped with The information processing device is characterized in that the first display control means displays, together with the aircraft list, an aircraft list on the operator's terminal in which the display order of information regarding each of the plurality of unmanned aircraft is based on the name or type of each of the plurality of unmanned aircraft.

6. The information processing device described in any one of claims 1 to 5, characterized in that when the statuses of the multiple unmanned aerial vehicles are the same, the second display control means displays information about the unmanned aerial vehicle whose status has been changed most recently among the multiple unmanned aerial vehicles higher in the aircraft list.

7. The information processing device described in any one of claims 1 to 5, characterized in that when the statuses of the multiple unmanned aerial vehicles are the same and the status indicates that an abnormality has occurred in the unmanned aerial vehicle, the second display control means displays information about the unmanned aerial vehicle with the highest degree of abnormality higher in the aircraft list.

8. 1. A display control method executed by one or more computers, comprising: displaying, on a terminal of the operator, a list of unmanned aerial vehicles including information about each of the plurality of unmanned aerial vehicles requiring monitoring by the operator; determining a status of each of the unmanned aerial vehicles; identifying a monitoring priority for each unmanned aerial vehicle based on a respective status of the unmanned aerial vehicle; controlling display of the list of aircraft in accordance with the monitoring priority; a step of displaying, on the terminal, monitoring information used to monitor a selected unmanned aerial vehicle from among the plurality of unmanned aerial vehicles in the list of vehicles, in response to the operator selecting the selected unmanned aerial vehicle; outputting a warning message to the terminal when the priority of the selected unmanned aerial vehicle is lower than the priority of an unmanned aerial vehicle among the plurality of unmanned aerial vehicles in the aircraft list that has not yet been addressed, or when the priority of the selected unmanned aerial vehicle is not the highest among the plurality of unmanned aerial vehicles in the aircraft list; A display control method comprising:

9. A display control method executed by one or more computers, comprising: displaying, on a terminal of the operator, a list of unmanned aerial vehicles including information about each of the plurality of unmanned aerial vehicles requiring monitoring by the operator; determining a status of each of the unmanned aerial vehicles; a display control step of controlling the display of the list of aircraft based on the status of each of the unmanned aerial vehicles; Including, A display control method characterized in that in the display control step, a list of aircraft is displayed on the operator's terminal together with the list of aircraft, in which the display order of information regarding each of the plurality of unmanned aircraft is based on the name or type of each of the plurality of unmanned aircraft.

10. The computer included in the terminal used by the operator displaying on the terminal a list of unmanned aerial vehicles including information about each of the plurality of unmanned aerial vehicles requiring monitoring by the operator; obtaining a status of each of the unmanned aerial vehicles from a predetermined server; identifying a monitoring priority for each unmanned aerial vehicle based on a respective status of the unmanned aerial vehicle; controlling display of the list of aircraft in accordance with the monitoring priority; a step of displaying, on the terminal, monitoring information used to monitor a selected unmanned aerial vehicle from among the plurality of unmanned aerial vehicles in the list of vehicles, in response to the operator selecting the selected unmanned aerial vehicle; outputting a warning message to the terminal when the priority of the selected unmanned aerial vehicle is lower than the priority of an unmanned aerial vehicle among the plurality of unmanned aerial vehicles in the aircraft list that has not yet been addressed, or when the priority of the selected unmanned aerial vehicle is not the highest among the plurality of unmanned aerial vehicles in the aircraft list; A program characterized by executing the following.

11. A computer included in a terminal used by an operator, displaying on the terminal a list of unmanned aerial vehicles including information about each of the plurality of unmanned aerial vehicles requiring monitoring by the operator; obtaining a status of each of the unmanned aerial vehicles from a predetermined server; a display control step of controlling the display of the list of aircraft based on the status of each of the unmanned aerial vehicles; A program for executing In the display control step, the program displays on the operator's terminal, together with the aircraft list, an aircraft list in which the display order of information regarding each of the plurality of unmanned aircraft is based on the name or type of each of the plurality of unmanned aircraft.

Images