Terminal program
Patent Information
- Application Number
- JP2024061378
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-04-05
- Publication Date
- 2026-09-01
- Estimated Expiration
- 2042-12-22
Smart Images

Figure 0007914157000001 
Figure 0007914157000002 
Figure 0007914157000003
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of systems and the like that can efficiently inspect unmanned aerial vehicles.
Background Art
[0002] Conventionally, a technique for performing automatic inspection before takeoff of an unmanned aerial vehicle such as a drone is known. For example, the drone disclosed in Patent Document 1 includes, as a configuration for diagnosing whether conditions for safe flight and chemical spraying are satisfied before takeoff, an airframe position confirmation unit, a nose confirmation unit, a surrounding confirmation unit, and the like. Furthermore, the drone includes an airframe visual confirmation unit that functions to instruct a user on points for visual confirmation through a controller. This allows the user to efficiently inspect the drone.
Prior Art Literature
Patent Literature
[0003]
Patent Literature 1
Summary of the Invention
[0004] By the way, at a base where a plurality of unmanned aerial vehicles can take off and land, for example, in order for a worker to efficiently inspect a plurality of unmanned aerial vehicles, it is necessary to grasp the current state such as the implementation status of inspections of the unmanned aerial vehicles under the jurisdiction of the base. However, when the number of unmanned aerial vehicles under the jurisdiction of the base increases, there has been a problem that the worker cannot fully grasp the current state of each unmanned aerial vehicle, and the efficiency of inspection of each unmanned aerial vehicle decreases.
[0005] Accordingly, the present invention has been made in view of the above problems and the like, and an example of the object thereof is to provide a program capable of improving the efficiency of inspection of a plurality of unmanned aerial vehicles under the jurisdiction of a base.
Means for Solving the Problems
[0006] (Application Example 1) In order to solve the above problem, the program according to this application example is characterized by causing a computer included in a terminal used by a worker who inspects an unmanned aerial vehicle at a base where the unmanned aerial vehicle can take off and land to send a login request to a predetermined server; sending the inspection results entered from the terminal by the worker who logged in in response to the login request to the server; and obtaining and displaying a list from the server of the current status of each of the multiple unmanned aerial vehicles under the jurisdiction of the base that the worker who logged in in response to the login request is in charge of, including the status related to the inspection. [Effects of the Invention]
[0007] According to the present invention, it is possible to improve the efficiency of inspecting multiple unmanned aerial vehicles under the jurisdiction of a base. [Brief explanation of the drawing]
[0008] [Figure 1] This diagram shows an example of the overview configuration of the drone base system S. [Figure 2] This figure shows an example of the overview configuration of the drone Dn. [Figure 3] This figure shows an example of the general configuration of the worker terminal Tm. [Figure 4] This figure shows an example of a drone list screen. [Figure 5] This figure shows an example of a pre-flight check screen for the D3 drone. [Figure 6] This figure shows an example of a pre-flight check screen for the D4 drone. [Figure 7] This diagram shows an example of the overview configuration of the branch management server MS. [Figure 8] This figure shows an example of a functional block in the control unit 33. [Figure 9] This sequence diagram shows an example of the drone list display process executed by the worker terminal T1 and the base management server MS. [Figure 10]This flowchart shows an example of the evacuation notification process performed by the site management server MS. [Modes for carrying out the invention]
[0009] One embodiment of the present invention will be described below with reference to the drawings. The following embodiment is an example in which the present invention is applied to a drone base system used at a base where multiple drones can take off and land (hereinafter referred to as a "drone base").
[0010] [ 1. Configuration and Operation Overview of Drone Base System S ] First, with reference to Figure 1, the configuration and operation overview of the drone base station system S according to this embodiment will be described. Figure 1 is a diagram showing an example of the overview configuration of the drone base station system S. As shown in Figure 1, the drone base station system S is composed of multiple drones Dn (n=1,2,3...), multiple worker terminals Tm (m=1,2...), and a base station management server MS (an example of an information processing device), etc. The drones Dn, worker terminals Tm, and base station management server MS are each connected to a communication network NW. The communication network NW consists of, for example, the internet, a mobile communication network and its wireless base stations, etc.
[0011] A drone Dn is an example of an unmanned aerial vehicle, also known as a multicopter or UAV (Unmanned Aerial Vehicle). Drone Dns are remotely controlled by an operator from the ground. Therefore, it is capable of flying or flying autonomously, and can be used for purposes such as delivery, surveying, photography, and surveillance. The drone Dn is managed by a GCS (Ground Control Station) connected to a communication network NW. The GCS may be installed as an application on a piloting terminal, for example, or it may be composed of one or more servers.
[0012] Furthermore, each drone Dn is under the jurisdiction of one of the multiple drone bases Bm. In the example in Figure 1, drones D1 to D4 are each under the jurisdiction of drone base B1, and are scheduled to depart (take off) from drone base B1 and return (land) to drone base B1. Drones D5 to D9 are each under the jurisdiction of drone base B2, and are scheduled to depart from drone base B2 and return to drone base B2. Note that there is no particular limit to the number of drones Dn under the jurisdiction of a single drone base Bm.
[0013] The worker terminal Tm is used by worker (base staff) Wm who inspect the drone Dn at the drone base Bm. For example, worker Wm visually inspects a designated part of the drone Dn, or inspects a designated part of the drone Dn by touch. This inspection of the drone Dn performed by worker Wm is hereinafter referred to as "manual inspection". In the example in Figure 1, worker terminal T1 is used by worker W1 who performs manual inspection at the drone base B1. Also, worker terminal T2 is used by worker W2 who performs manual inspection at the drone base B2. Note that multiple workers Wm may be stationed (belong to) a single drone base Bm and perform work including the manual inspection described above.
[0014] The site management server MS consists of one or more server computers that manage information about each drone site Bm. Information about drone sites Bm includes, for example, information about drones Dn under the jurisdiction of drone site Bm, worker terminals Tm used at drone site Bm, and information about workers Wm who use the worker terminals Tm. The site management server MS can identify the drone site Bm (assigned site) that a worker Wm who has logged in by operating the worker terminal Tm is responsible for, and can display a list (hereinafter referred to as the "drone list") on the worker terminal Tm that includes the current status of each of the multiple drones Dn under the jurisdiction of the identified drone site Bm (for example, inspection status, hereinafter referred to as "inspection status").
[0015] 1-1. Configuration and Function of Drone Dn Next, the configuration and functions of the drone Dn will be described with reference to FIG. 2. FIG. 2 is a diagram showing an example of a schematic configuration of the drone Dn. As shown in FIG. 2, the drone Dn includes a power supply unit 11, a drive unit 12, a positioning unit 13, a communication unit 14, a sensor unit 15, a storage unit 16, a control unit 17, and the like. Furthermore, the drone Dn includes propellers (rotors), which are horizontal rotary wings, and arm pipes (including arm joints) for attaching the propellers to the drone main body (housing), and the like. Note that when the drone Dn is used for delivering articles, the drone Dn is provided with a holding mechanism or the like for holding the article.
[0016] The power supply unit 11 includes a detachable battery (power storage device) and the like. The power supply unit 11 supplies (feeds) the electric power stored in the battery to each unit of the drone Dn. The power supply unit 11 also sequentially measures the remaining battery level. Battery information indicating the remaining battery level measured by the power supply unit 11 is output to the control unit 17. The drive unit 12 includes a motor, a rotating shaft, and the like. The drive unit 12 rotates the plurality of rotors by means of the motor, the rotating shaft, and the like driven in accordance with a control signal output from the control unit 17.
[0017] The positioning unit 13 includes a radio wave receiver, an altitude sensor, and the like. The positioning unit 13, for example, receives radio waves transmitted from satellites of a GNSS (Global Navigation Satellite System) such as GPS (Global Positioning System) by the radio wave receiver, and sequentially detects the current horizontal position (latitude and longitude) of the drone Dn based on the radio waves. Position information indicating the current position detected by the positioning unit 13 is output to the control unit 17. Furthermore, the positioning unit 13 may detect the current vertical position (altitude) of the drone Dn by means of the altitude sensor. In this case, the position information includes altitude information indicating the altitude of the drone Dn.
[0018] The communication unit 14 is equipped with an antenna and wireless communication functions and is responsible for controlling communications conducted via the communication network NW. The sensor unit 15 is equipped with various sensors used to control the drone Dn. These sensors include, for example, a compass (geomagnetic sensor), a gyroscope (3-axis angular velocity sensor), a 3-axis accelerometer, a barometric pressure sensor, a gimbal, optical sensors, and a rangefinder. The optical sensors include cameras (for example, RGB cameras, IR (Infrared rays) cameras), etc. The sensing information sensed by the sensor unit 15 is output to the control unit 17. The storage unit 16 is composed of non-volatile memory and stores various programs and data. The storage unit 16 also stores the aircraft ID (identification information) for identifying the drone Dn.
[0019] The control unit 17 includes a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and controls the drone Dn based on position information from the positioning unit 13 and sensing information from the sensor unit 15. This control includes controlling the propeller rotation speed, the position, attitude, and direction of travel of the drone Dn. The position information of the drone Dn (i.e., the position information from the positioning unit 13) is transmitted to the GCS via the communication network NW along with the drone Dn's aircraft ID. The drone Dn's position information and aircraft ID are then transmitted from the GCS to the base management server MS. Alternatively, the drone Dn's position information and aircraft ID may be transmitted from the drone Dn to the base management server MS.
[0020] Furthermore, the control unit 17 has a self-diagnostic function and is configured to perform checks on items (inspection items) for each predetermined part of the drone Dn (e.g., power supply unit 11, drive unit 12, positioning unit 13, communication unit 14, and sensor unit 15, etc.) to ensure that they are functioning correctly. This inspection of the drone Dn performed by the drone Dn itself (i.e., the control unit 17) will be referred to as "automatic inspection" below. Items for automatic inspection include, for example, battery level, battery cell balance, GPS, compass, gyroscope, accelerometer, barometric pressure sensor, gimbal, optical sensor, and rangefinder. In the following description, manual inspection and automatic inspection may be collectively referred to simply as "inspection." The results of the automatic inspection (e.g., results for each item) and the automatic inspection result information, including the aircraft ID of the drone Dn that performed the automatic inspection, are transmitted to the GCS via the communication network NW. The automatic inspection result information is then transmitted from the GCS to the base management server MS. The automatic inspection result information may also be transmitted from the drone Dn to the base management server MS.
[0021] [ 1-2. Configuration and Function of the Worker Terminal Tm ] Next, the configuration and functions of the worker terminal Tm will be described with reference to Figure 3. Figure 3 is a diagram showing an example of the general configuration of the worker terminal Tm. The worker terminal Tm includes an operation / display unit 21, a GPS receiver 22, a communication unit 23, a storage unit 24, and a control unit 25, etc. The worker terminal Tm can be, for example, a mobile terminal such as a smartphone or tablet, or a notebook personal computer. The worker terminal Tm may also be equipped with an audio processing unit and a speaker. The operation / display unit 21 has an input function that accepts instructions (such as input instructions or selection instructions) from the worker's finger or pen, and a display function that displays various screens on the display. The GPS receiver 22 receives radio waves transmitted from GPS satellites, for example, and detects the current location of the worker terminal Tm. The location information (latitude and longitude) indicating the location detected by the GPS receiver 22 is output to the control unit 25.
[0022] The communication unit 23 is equipped with wireless communication capabilities and is responsible for controlling communications conducted via the communication network NW. The storage unit 24 consists of non-volatile memory and other components and stores various programs and data. These programs include an operating system (OS), worker applications, and a web browser. The worker application is primarily a program for obtaining and displaying a list of drones, including the inspection status of each of the multiple drones Dn under the jurisdiction of the drone base Bm managed by worker Wm, from the base management server MS. The worker application is preferably downloaded from a designated server to the worker terminal Tm.
[0023] The control unit 25 (an example of a computer) includes a CPU, ROM, RAM, etc. The system executes processing according to the worker application stored in (or in the memory unit 24). When the worker application is started in response to instructions from worker Wm, the control unit 25 displays a login screen on the display. When worker Wm enters a user ID and password through the login screen, the control unit 25 sends a login request including the user ID and password to the site management server MS via the communication unit 23 and the communication network NW. The user ID is identification information for identifying worker Wm. The login request may also include location information of the worker terminal Tm (i.e., location information from the GPS receiver 22). The location information of the worker terminal Tm may be sent to the site management server MS along with worker Wm's user ID even after worker Wm has logged in.
[0024] When worker Wm logs in in response to a login request, the base management server MS sends display data to display a drone list, including the inspection status of each of the multiple drones Dn under the jurisdiction of the drone base Bm that the logged-in worker Wm is responsible for. As a result, the control unit 25 displays the drone list screen on the display and also displays the drone list received by the communication unit 23 on the drone list screen. The above display data may include notification messages to worker Wm regarding drone Dn. The above display data may also be data from a web page displayed by a web browser.
[0025] Figure 4 shows an example of a drone list screen. As shown in Figure 4, the drone list screen SC0 displays a drone list L1 including the names (or aircraft IDs) NA1-NA4, inspection status ST1-ST4, and detail display buttons BT1-BT4 for each drone D1-D4 under the jurisdiction of drone base B1, which is managed by the logged-in worker W1. Furthermore, the drone list screen SC0 displays notification messages M3 for drone D3 and M4 for drone D4 for worker W1. These notification messages M3 and M4 allow for quick alerting of worker W1. Note that notification messages M3 and M4 may be displayed on a different notification screen than the drone list screen.
[0026] In the example in Figure 4, inspection status ST1 is "Waiting for inspection" (preparing for inspection). "Waiting for inspection" means, for example, the state before worker W1 starts a manual inspection. "Waiting for inspection" may also include waiting for an automatic inspection by drone D3. Inspection status ST2 is "In inspection". "In inspection" means, for example, the state during a manual inspection by worker W1. "In inspection" may also include an automatic inspection by drone D3. "Waiting for inspection" and "In inspection" are examples of the inspection status of drone Dn. This allows worker W1 to easily grasp the inspection status of drone D3 at a glance.
[0027] On the other hand, inspection status ST3 is set to "Flightable". "Flightable" means that, for example, no abnormalities were found during a manual inspection by worker W1, and therefore drone D3 is in a flightable (takeoff) state. It would be good if the absence of such abnormalities also included the absence of abnormalities found during the automatic inspection by drone D3. Also, inspection status ST4 is set to "Not Flightable". "Not Flightable" means that, for example, an abnormality was found during the automatic inspection by drone D4, and therefore drone D4 is in a flight-immobile state. "Flightable" and "Not Flightable" are determined based on the results of the inspection of drone Dn. This allows worker W1 to easily grasp the results of the inspection of drone D4 at a glance. Note that "Inspection Complete (Successfully Completed)" and "Error Occurred" may be used instead of "Flightable" and "Not Flightable".
[0028] The detail display buttons BT1 to BT4 are used to display detailed information for drones D1 to D4. For example, when the detail display button BT3 is selected by worker W1 on the drone list screen SC0, the detailed information for drone D3, including the scheduled departure time DT3, scheduled return time RT3, and drone status ST31, is displayed as shown on the drone list screen SC3. In addition, the screen display button BT31 for pre-flight (pre-takeoff) checks of drone D3 is displayed. Here, drone status ST31 shows, for example, detailed information about inspection status ST3 (in this example, "Waiting for takeoff"). Pre-flight checks include, for example, inputting and confirming the results of manual inspections and confirming the results of automatic inspections.
[0029] On the other hand, in the drone list screen SC0 shown in Figure 4, when the detailed display button BT4 is selected by worker W1, the drone status ST41 is displayed as detailed information for drone D4, as shown in the drone list screen SC4, and the screen display button BT41 for pre-flight check of drone D4 is displayed. Here, the drone status ST41 shows, for example, detailed information about the inspection status ST4 (in this example, "Error occurred"). The drone status may show something other than detailed information about the inspection status. For example, examples of drone statuses include flight start, flying towards destination such as delivery address, handing over goods at destination, goods dropped at destination, returning from destination, and delivery completed. Note that the scheduled departure time and scheduled return time for drone D4 are not displayed because they have not been determined (due to an error).
[0030] Figure 5 shows an example of a pre-flight check screen for drone D3. For example, when the screen display button BT31 is selected by worker W1 on the drone list screen SC3, the pre-flight check screen SC31 is displayed on the display as shown in Figure 5. The pre-flight check screen SC31 displays a list of manual inspection items L31a and a list of automatic inspection items L31b. Note that areas of the pre-flight check screen SC31 that do not fit within the display range will be scrolled. The list of manual inspection items L31a displays the manual inspection items (inspection items) I31a and manual inspection result input buttons BT31a to BT31c for each manual inspection item. In this case, the manual inspection is the inspection performed before drone D3 takes off from drone base B1.
[0031] In the example in Figure 5, the number of manual inspection items is 25, but it is not limited to this. "OK" displayed on inspection result input button BT31a indicates no abnormalities, "RE" displayed on inspection result input button BT31b indicates inspection pending, and "NG" displayed on inspection result input button BT31c indicates abnormalities. Worker W1 can input and confirm the results of the manual inspection by selecting one of the inspection result input buttons BT31a to BT31c for each manual inspection item. The manual inspection result information, including the results of the manual inspection (e.g., results for each item) and the aircraft ID of the manually inspected drone Dn, entered by worker W1 through the operation / display unit 21, is transmitted to the base management server MS via the communication network NW along with the user ID upon confirmation of check completion (e.g., designation of check completion button BT31d). In the example in Figure 5, the white-displayed inspection result input button indicates that it is selected, and the black-displayed inspection result input button indicates that it is not selected. In the example in Figure 5, the inspection result input button BT31a is selected for all items (25 items) of the manual inspection, so the results for all items of the manual inspection show no abnormalities. Note that the list of manual inspection items L31a may also be displayed as part of the drone list L1 mentioned above.
[0032] On the other hand, the automatic inspection item list L31b displays the automatic inspection item I31b and the automatic inspection result display mark M31 for each automatic inspection item. This allows worker W1 to check the results of the automatic inspection performed by drone D3. In this case, the automatic inspection is performed before drone D3 takes off from drone base B1. In the example in Figure 5, there are 25 automatic inspection items, but this is not limited to them. The automatic inspection result display mark M31 is displayed by the control unit 25 based on the automatic inspection result information obtained from the base management server MS. The automatic inspection result information includes the result for each automatic inspection item and the aircraft ID of the drone Dn that performed the automatic inspection. In the example in Figure 5, the inspection result mark M31 for all automatic inspection items (25 items) indicates no abnormalities. Note that the automatic inspection item list L31b may be included in and displayed in the drone list L1 described above.
[0033] Figure 6 shows an example of a pre-flight check screen for drone D4. For example, when the screen display button BT41 is selected by worker W1 on the drone list screen SC4, the pre-flight check screen SC41 is displayed on the screen as shown in Figure 6. The pre-flight check screen SC41 displays a list of manual inspection items L41a and a list of automatic inspection items L41b. The list of manual inspection items L41a displays the manual inspection item I41a and the manual inspection result input buttons BT41a to BT41c for each manual inspection item. In the example in Figure 6, the third inspection result input button from the top, BT41c-3, is selected, indicating that the manual inspection result is abnormal. On the other hand, the list of automatic inspection items L41b displays the automatic inspection item I41b and the automatic inspection result mark M41 for each automatic inspection item. In the example in Figure 6, the first and second inspection result marks from the top, M41-1 and M41-2, indicate an abnormality among all items in the automated inspection.
[0034] [ 1-3. Configuration and Functions of the Site Management Server MS ] Next, the configuration and functions of the base management server MS will be described with reference to Figure 7. Figure 7 is a diagram showing an example of the overview configuration of the base management server MS. As shown in Figure 7, the base management server MS includes a communication unit 31, a storage unit 32, and a control unit 33, etc. The communication unit 31 is responsible for controlling communications conducted via the communication network NW. Automatic inspection result information, drone Dn location information, and aircraft ID transmitted from GCS or drone Dn are received by the communication unit 31. The base management server MS can recognize the current location of drone Dn based on the drone Dn location information. Login requests transmitted from worker terminal Tm are received by the communication unit 31. In addition, manual inspection result information, worker terminal Tm location information, and worker Wm user ID transmitted from worker terminal Tm after worker Wm has logged in are received by the communication unit 31. The base management server MS can recognize the current location of worker Wm using worker terminal Tm based on the worker terminal Tm location information.
[0035] The storage unit 32 is composed of, for example, a hard disk drive and stores the operating system and various programs including applications. Here, applications include programs for executing information processing methods. Furthermore, the storage unit 32 contains a site management database (DB) 321, a drone management database (DB) 322, and a worker management database (DB) 323.
[0036] The base management database 321 is a database for managing information related to drone base stations Bm. The base management database 321 stores, for example, the base ID of drone base station Bm, location information of the installation area of drone base station Bm, and the aircraft IDs of drones Dn under the jurisdiction of drone base station Bm, all associated with each drone base station Bm. Here, the base ID is identification information for identifying drone base station Bm. The location information of the installation area of drone base station Bm is represented, for example, by the latitude and longitude within the installation area of drone base station Bm.
[0037] The drone management database 322 is a database for managing information about drones Dn. The drone management database 322 stores information such as the drone ID, name, location information, inspection results, and inspection status for each drone Dn, with these information associated with each drone Dn. The inspection results include the latest results for each manual inspection item and the latest results for each automatic inspection item. The inspection results are updated, for example, whenever manual or automatic inspection results are received by the communication unit 31. The inspection status may include detailed information about the drone Dn (e.g., scheduled departure time, scheduled return time), as described above. The drone Dn's location information and inspection status are updated as needed.
[0038] The worker management database 323 is a database for managing information about worker Wm. The worker management database 323 stores the user ID, password, login status, and name of each worker Wm, associated with their respective user ID. Here, the login status indicates whether or not the worker Wm is logged in. If the worker Wm is logged in, the location information of the worker terminal Tm used by the worker Wm is associated with the worker Wm's user ID and stored in the worker management database 323. Furthermore, if a drone base Bm assigned to a worker Wm has been determined, the base ID of that drone base Bm is associated with the worker Wm's user ID and stored in the worker management database 323.
[0039] The control unit 33 (an example of a computer) includes a CPU, ROM, RAM, etc. Figure 8 shows an example of a functional block in the control unit 33. The control unit 33 functions, for example, according to a program (program code group) stored in the ROM or storage unit 32, as shown in Figure 8, as a login processing unit 331 (an example of login processing means), a base location identification unit 332 (an example of base location identification means), a display control unit 333 (an example of display control means), an inspection result acquisition unit 334 (an example of first acquisition means and second acquisition means), a status update unit 335 (an example of first update means and second update means), a drone position identification unit 336 (an example of first position identification means), a worker position identification unit 337 (an example of second position identification means), a proximity determination unit 338 (an example of determination means), and an evacuation notification unit 339 (an example of notification means).
[0040] The login processing unit 331 performs login processing for worker Wm in response to a login request from worker terminal Tm. In this login processing, it is determined whether or not the user ID and password combination included in the login request is registered. If the user ID and password combination is registered, the worker Wm using the worker terminal Tm that sent the login request is identified (identified by the user ID), and the worker Wm logs in.
[0041] The assigned base identification unit 332 identifies the drone base Bm that worker Wm is responsible for when worker Wm is identified through the login process. For example, in the worker management database 323, the drone base Bm identified by the base ID stored in association with the user ID of the logged-in worker Wm is identified as the drone base Bm that worker Wm is responsible for.
[0042] The display control unit 333 sends display data to the worker terminal Tm that sent the login request, which includes the inspection status of each of the multiple drones Dn under the jurisdiction of the drone base Bm identified by the assigned base identification unit 332, thereby displaying the drone list as shown in Figure 4, for example. This allows the worker Wm to easily grasp the inspection status of each drone Dn under the jurisdiction of the drone base Bm that they are responsible for at a glance.
[0043] If the base ID of the drone base Bm that the logged-in worker Wm is in charge of is not associated with the worker Wm's user ID and stored in the worker management database 323, the assigned base identification unit 332 should identify the location where the worker Wm logged in. For example, if the login request includes location information of the worker terminal Tm, the assigned base identification unit 332 identifies the location indicated in the location information as the location where the worker Wm logged in. On the other hand, if the login request does not include location information of the worker terminal Tm, the assigned base identification unit 332 should request location information from the worker terminal Tm of the worker Wm when the worker Wm logs in. In this case, the assigned base identification unit 332 obtains the location information transmitted from the worker terminal Tm in response to the location information request and identifies the location indicated in the location information as the location where the worker Wm logged in.
[0044] The assigned base identification unit 332 then identifies the drone base Bm that worker Wm is responsible for, based on the identified location (i.e., the location of the logged-in worker Wm) and location information indicating the installation area of each drone base Bm managed in the base management database 321. For example, the drone base Bm corresponding to the installation area including the location of the logged-in worker Wm is identified. As a result, even if worker Wm is working at a different drone base Bm than usual, simply by logging in at the drone base Bm where the work is scheduled, worker Wm can grasp a list of drones Dn under the jurisdiction of that drone base Bm, along with their inspection status.
[0045] The inspection result acquisition unit 334 acquires the results of the manual inspection (for example, results for each item) and the aircraft ID of the drone Dn that was manually inspected, as entered by the worker Wm as described above, via the communication unit 31 at the worker terminal Tm. The inspection result acquisition unit 334 also acquires the results of the automatic inspection performed by the drone Dn (for example, results for each item) and the automatic inspection result information, including the aircraft ID of the drone Dn that performed the automatic inspection, via the communication unit 31.
[0046] The status update unit 335 updates the inspection status of drone Dn, identified by the aircraft ID included in the manual inspection result information acquired by the inspection result acquisition unit 334 (i.e., updates the inspection status of drone Dn in the drone management database 322). For example, the inspection status is updated from "waiting for inspection" to "inspection in progress" or "inspection completed". In addition, the inspection status of drone Dn, identified by the aircraft ID included in the automatic inspection result information acquired by the inspection result acquisition unit 334, is updated based on the results included in the automatic inspection result information acquired by the inspection result acquisition unit 334.
[0047] When the status update unit 335 updates the inspection status, the display control unit 333 displays the drone list by sending display data, including the updated inspection status, to the worker terminal Tm that sent the login request. This allows worker Wm to easily grasp at a glance the latest inspection status of drone Dn, which is updated based on the results of the manual inspection performed by the worker. In addition, worker Wm can easily grasp at a glance the latest inspection status of drone Dn, which is updated based on the results of the automatic inspection performed by drone Dn.
[0048] The drone positioning unit 336 identifies the drone position (an example of a first position) of drone Dn after the inspection (manual inspection, or manual and automatic inspection) has been completed. This drone position is determined based on position information acquired from drone Dn. The worker positioning unit 337 identifies the worker position (an example of a second position) of worker Wm after the inspection (manual inspection, or manual and automatic inspection) has been completed. This worker position is determined based on position information acquired from the worker terminal Tm.
[0049] The proximity determination unit 338 determines whether the distance between the drone position determined by the drone position determination unit 336 and the worker position determined by the worker position determination unit 337 is below a threshold (i.e., whether they are approaching) when it is a predetermined time before the scheduled departure time of the drone Dn after the inspection (manual inspection, or manual and automatic inspection) has been completed.
[0050] The evacuation notification unit 339, when the proximity determination unit 338 determines that the distance between the worker's position and the drone's position is below a threshold, sends information to the worker's terminal Tm prompting the worker to evacuate, thereby notifying the worker Wm to evacuate. As a result, since the worker Wm is using the worker's terminal Tm, after the manual inspection is completed, the base management server MS can acquire location information from the worker's terminal Tm and send an evacuation notification via the worker's terminal Tm without using another device (e.g., an alarm device), thereby enhancing the safety of the worker Wm.
[0051] [ 2. Operation of the drone base system S ] Next, we will explain the operation of the drone base system S. For the following explanation of operation, we will use the example of worker W1 using worker terminal T1 working at drone base B1.
[0052] (2-1. Drone list display processing) First, with reference to Figure 9, the operation when the drone list is displayed on the worker terminal T1 will be explained. Figure 9 is a sequence diagram showing an example of the drone list display process executed by the worker terminal T1 (control unit 25) and the base management server MS (control unit 33). When the worker application is launched on the worker terminal T1 in response to instructions from worker W1, the login screen is displayed on the display. The worker terminal T1 then sends a login request to the base management server MS, including the user ID and password entered by worker W1 through the login screen (step S1).
[0053] Next, when the site management server MS receives a login request from the worker terminal T1, the login processing unit 331 performs the login process in response to the login request (step S2). In this login process, it is determined whether or not the user ID and password set included in the login request is registered. For example, if the user ID and password set included in the login request is stored in the worker management database 323, it is determined that the user ID and password set is registered, and worker W1 using the worker terminal T1 logs in.
[0054] Next, the site management server MS refers to the worker management database 323 to determine whether a site ID is associated with the user ID of the logged-in worker W1 (step S3). If it is determined that a site ID is associated with the user ID of worker W1 (step S3: YES), the process proceeds to step S4. On the other hand, if it is determined that a site ID is not associated with the user ID of worker W1 (step S3: NO), the process proceeds to step S5.
[0055] In step S4, the base management server MS uses the base identification unit 332 to identify the drone base B1 that worker W1 is responsible for, based on the base ID associated with the user ID of worker W1. Meanwhile, in step S5, as described above, the base management server MS uses the base identification unit 332 to identify the location where worker W1 logged in, based on the location information obtained from the worker terminal T1. Next, the base management server MS uses the base identification unit 332 to identify the drone base B1 that worker W1 is responsible for, as described above, based on the location identified in step S4 and the location information indicating the installation area of each drone base B1 managed in the base management database 321 (step S6).
[0056] Next, the base management server MS retrieves the inspection status of each of the drones D1 to D4 under the jurisdiction of the drone base B1 identified in step S4 or step S6 from the drone management database 322 (step S7). At this time, the inspection result information for each of the drones D1 to D4 may also be retrieved from the drone management database 322. Next, the base management server MS transmits display data for displaying a list of drones, including the inspection status and aircraft ID obtained in step S7, to the worker terminal T1 via the display control unit 333 (step S8). The display data may also include the inspection result information for each of the drones D1 to D4.
[0057] Next, when the worker terminal T1 receives display data from the base management server MS to display a list of drones, it displays the drone list on the drone list screen, for example, as shown in Figure 4 (step S9). Then, the worker terminal T1 processes the instructions received from worker W1 via the operation / display unit 21 (step S10). In this process, for example, as shown in Figure 4, detailed information of drone D3 is displayed on the drone list screen. Alternatively, as shown in Figure 5, a pre-flight check screen for drone D3 is displayed. Worker W1 inputs the results of the manual inspection by selecting the inspection result input button for each item of the manual inspection he performed. The results of the manual inspection thus entered are temporarily stored in RAM. Worker W1 also checks the results of the automatic inspection performed by drone D3.
[0058] Next, the worker terminal T1 determines whether or not it has received a check completion instruction from worker W1 via the operation / display unit 21 (step S11). If it is determined that a check completion instruction (for example, the specification of the check completion button BT31d shown in Figure 5) has been received (step S11: YES), the process proceeds to step S12. On the other hand, if it is determined that a check completion instruction has not been received (step S11: NO), the process returns to step S10. In step S12, the worker terminal T1 transmits the manual inspection result information, including the results of the manual inspection entered by worker W1 and temporarily stored, and the aircraft ID of the manually inspected drone D4, along with the user ID, to the base management server MS.
[0059] Next, when the base management server MS receives manual inspection result information from the worker terminal T1, the inspection result acquisition unit 334 acquires the manual inspection result and the aircraft ID from the manual inspection result information (step S13). Next, based on the manual inspection result and aircraft ID acquired in step S13, the base management server MS updates the inspection status of the drone D4 identified by the aircraft ID using the status update unit 335 (step S14). Next, the base management server MS transmits display data for displaying the drone list (i.e., the updated drone list) including the inspection status updated in step S14 to the worker terminal T1 using the display control unit 333 (step S15).
[0060] Next, when the worker terminal T1 receives display data from the base management server MS to display the drone list, it displays the updated drone list, including the inspection status, on the drone list screen (step S16). After that, the process returns to step S10, where worker W1 performs a manual inspection of, for example, drone D4 and inputs the results.
[0061] (2-2. Evacuation Notification Processing) Next, with reference to Figure 10, the operation when a notification prompting worker Wm to evacuate is issued will be explained. Figure 10 is a flowchart showing an example of the evacuation notification process executed by the base management server MS (control unit 33). As a prerequisite for this operation, for example, a departure time monitoring list is referenced, which registers the aircraft ID and departure time of drones Dn whose inspection has been completed and whose departure time has been determined. Here, drones Dn whose inspection has been completed are, for example, drones Dn for which automatic inspection result information and manual inspection result information have been received.
[0062] The process shown in Figure 10 is executed by the site management server MS at predetermined time intervals (e.g., 1 minute). When the process shown in Figure 10 is started, the site management server MS compares the current time with the scheduled departure time registered in the scheduled departure time monitoring list and determines whether there is a drone Dn that is a predetermined time away from its scheduled departure time (step S21). If it is determined that there is a drone Dn that is a predetermined time away from its scheduled departure time (step S21: YES), the drone Dn is identified and the process proceeds to step S22. For example, if the predetermined time is 5 minutes and the current time is "9:55", then a drone Dn with a scheduled departure time of "10:00" will be identified. On the other hand, if it is determined that there is no drone Dn that is a predetermined time away from its scheduled departure time (step S21: NO), the process ends.
[0063] In step S22, the base management server MS uses the drone positioning unit 336 to determine the drone position of drone Dn, which was identified in step S21. For example, the drone positioning unit 336 obtains the drone Dn's position information by requesting it from the drone Dn. Then, the drone positioning unit 336 determines the drone position of drone Dn based on the acquired position information.
[0064] Next, the base management server MS uses the worker location identification unit 337 to identify the worker Wm who performed the manual inspection of the drone Dn identified in step S21 (step S23). For example, the worker location identification unit 337 obtains the location information of the worker terminal T1 used by worker W1 (i.e., the worker terminal T1 that transmitted the manual inspection result information of the drone D3) by requesting location information from the worker terminal T1. Then, the worker location identification unit 337 identifies the worker Wm's location based on the acquired location information.
[0065] Next, the base management server MS calculates the distance between the drone position identified in step S22 and the worker position identified in step S23 (step S24). Next, the base management server MS uses the proximity determination unit 338 to determine whether the distance calculated in step S24 is below a threshold (for example, 50 cm to 2 m) (step S25). If it is determined that the calculated distance is not below the threshold (step S25: NO), the process returns to step S21. On the other hand, if it is determined that the calculated distance is below the threshold (step S25: YES), the base management server MS notifies worker Wm to evacuate by sending information to the worker terminal T1 prompting him to evacuate from his position (step S26), and the process returns to step S21. Returning to step S21, it is determined whether there are other drones Dn that are a predetermined time away from their scheduled departure time, and the same process as above is performed.
[0066] As described above, according to the above embodiment, the base management server MS performs login processing for worker Wm in response to a login request from the worker terminal Tm used by worker Wm. When worker Wm logs in through the login process, the server MS identifies the drone base Bm (assigned base) that worker Wm is in charge of, and displays a list of drones, including the inspection status of each drone Dn under the jurisdiction of the identified drone base Bm, on the worker terminal Tm. Therefore, worker Wm can easily grasp the inspection status of each drone Dn under the jurisdiction of the drone base Bm that they are in charge of, and consequently, the efficiency of inspections of each drone Dn under the jurisdiction of the drone base Bm can be improved.
[0067] It should be noted that the above embodiment is one embodiment of the present invention, and the present invention is not limited to the above embodiment. Various modifications to the above embodiment may be made without departing from the spirit of the present invention, and even in that case, the invention is still within the technical scope of the present invention. In the above embodiment, an example was described in which a list of drones is displayed on a worker terminal Tm used by worker Wm who performs inspections before drone Dn takes off. However, the list of drones may also be displayed on a worker terminal Tm used by worker Wm who performs inspections when drone Dn returns to drone base Bm and lands, or when drone Dn is being maintained at drone base Bm. In addition, in the above embodiment, a drone was used as an example of an unmanned aerial vehicle, but the present invention is also applicable to flying robots other than drones. Furthermore, in the above embodiment, it was determined whether or not a base ID is associated with the user ID of logged-in worker W1, and if it was determined that there was no association, the assigned base was identified based on the location information of worker W1. However, the invention is not limited to this, and the assigned base may be identified based on the location information of worker W1 without determining whether or not a base ID is associated with the user ID of logged-in worker W1.
[0068] <Note> [1] The information processing device according to the present disclosure is characterized by comprising: login processing means for performing login processing for a worker in response to a login request from a terminal used by a worker who inspects an unmanned aerial vehicle at a base where the unmanned aerial vehicle can take off and land; base identification means for identifying the base to which the worker is responsible when the worker logs in as a result of the login processing; and display control means for displaying a list on the terminal including the current status of each of the multiple unmanned aerial vehicles under the jurisdiction of the base identified by the base identification means. This allows the worker to easily grasp the current status of each unmanned aerial vehicle under the jurisdiction of the base to which they are responsible, and thereby improve the efficiency of inspection of each unmanned aerial vehicle under the jurisdiction of the base.
[0069] [2] The information processing device described in [1] above further comprises a location identification means for identifying the location where the worker logged in, and the base identification means identifies the base to which the worker is responsible based on the location identified by the location identification means. As a result, even if the worker is working at a different base than usual, the worker can simply log in at the base where they are scheduled to work and will be able to see a list of unmanned aircraft under the base's jurisdiction along with their current status.
[0070] [3] The information processing device described in [1] or [2] above further comprises: a first position identification means for identifying the first position of the unmanned aerial vehicle after the inspection has been completed; a second position identification means for identifying the second position of the worker after the inspection has been completed; a determination means for determining whether the distance between the first position and the second position is below a threshold when it is a predetermined time before the scheduled departure time of the unmanned aerial vehicle after the inspection has been completed; and a notification means for notifying the worker to evacuate from the first position when the determination means determines that the distance is below a threshold. As a result, since the worker is using a terminal, the worker's safety can be enhanced after the worker has completed the inspection without the need for another device.
[0071] [4] In the information processing device described in any one of [1] to [3] above, the current state of the unmanned aerial vehicle is characterized in that it includes at least one of the status of the inspection of the unmanned aerial vehicle and the results of the inspection of the unmanned aerial vehicle. This allows workers to easily grasp at a glance at at least one of the status of the inspection of each unmanned aerial vehicle and the results of the inspection.
[0072] [5] The information processing device described in [4] above is characterized in that the inspection includes at least one of the inspection of the unmanned aerial vehicle performed by the worker and the automated inspection performed by the unmanned aerial vehicle. This allows the worker to easily grasp at a glance at at least one of the status and results of the inspection performed by himself and at least one of the status and results of the automated inspection performed by the unmanned aerial vehicle.
[0073] [6] In the information processing device described in any one of [1] to [5] above, the inspection is characterized in that the inspection is performed before the unmanned aircraft takes off from the base. This allows the worker to easily grasp the latest status of each unmanned aircraft before takeoff at a glance.
[0074] [7] An information processing device according to any one of [1] to [6] above, further comprising: a first acquisition means for acquiring the results of the inspection entered by the worker at the terminal; and a first update means for updating the current state of the unmanned aerial vehicle based on the results of the inspection acquired by the first acquisition means, wherein the display control means causes the terminal to display a list including the current state of the unmanned aerial vehicle updated by the first update means. This allows the worker to easily grasp at a glance the latest state of the unmanned aerial vehicle, which is updated based on the results of the inspection they performed.
[0075] [8] An information processing device according to any one of [1] to [7] above, further comprising: a second acquisition means for acquiring the results of an automatic inspection performed by the unmanned aerial vehicle; and a second update means for updating the current state of the unmanned aerial vehicle based on the results of the automatic inspection acquired by the second acquisition means, wherein the display control means causes the terminal to display a list including the current state of the unmanned aerial vehicle updated by the second update means. This allows an operator to easily grasp the latest state of the unmanned aerial vehicle, which is updated based on the results of an automatic inspection performed by the unmanned aerial vehicle, at a glance.
[0076] [9] The information processing method relating to the present disclosure is an information processing method performed by one or more computers, characterized in that the computer performs a login process for a worker in response to a login request from a terminal used by a worker who inspects an unmanned aerial vehicle at a base where the unmanned aerial vehicle can take off and land; the computer identifies the base to which the worker is responsible when the worker logs in as a result of the login process; and the computer displays a list on the terminal including the current status of each of the multiple unmanned aerial vehicles under the jurisdiction of the identified base.
[0077]
[10] The program relating to the present disclosure is characterized by causing a computer included in a terminal used by a worker who inspects an unmanned aerial vehicle at a base where the unmanned aerial vehicle can take off and land to send a login request to a predetermined server, and for the worker who has logged in in response to the login request to retrieve from the server a list including the current status of each of the multiple unmanned aerial vehicles under the jurisdiction of the base that the worker is in charge of, and display it. [Explanation of Symbols]
[0078] 11 Power supply section 12 Drive unit 13 Positioning Unit 14 Communications Department 15 Sensor section 16 Memory section 17 Control Unit 21 Operation / display section 22 GPS receivers 23 Communications Department 24 Memory section 25 Control Unit 31 Communications Department 32 Storage section 33 Control Unit 331 Login Processing Unit 332 Department for Designating Responsible Locations 333 Display Control Unit 334 Inspection Result Acquisition Unit 335 Status Update Section 336 Drone positioning unit 337 Worker location identification section 338 Approach Judgment Unit 339 Evacuation Notification Department Dn Drone Tm Worker Terminal MS Site Management Server S Drone base system
Claims
[Claim 1] At a base where an unmanned aerial vehicle (UAV) with a self-diagnostic function capable of performing automatic inspections for multiple automatic inspection items can take off and land, the computer included in the terminal used by a worker who performs manual inspections for multiple manual inspection items of the UAV is: The steps include sending a login request to a designated server, Steps include obtaining and displaying a list from the server which is a list of the current status of each of the multiple unmanned aerial vehicles under the jurisdiction of the base that the worker who logged in in response to the login request is responsible for, and which includes the status of the manual inspection and the automatic inspection, and which includes a detailed display button corresponding to each of the multiple unmanned aerial vehicles under the jurisdiction of the base; The step of displaying, in accordance with the designation of the detailed display button, a first screen including a list of the multiple manual inspection items of the unmanned aerial vehicle corresponding to the designated detailed display button, and a manual inspection result input button provided for each manual inspection item, and a second screen including a list of the multiple automatic inspection items of the unmanned aerial vehicle corresponding to the designated detailed display button, and an automatic inspection result display mark provided for each automatic inspection item, wherein the first screen and the second screen are displayed on the same display in a scrollable manner. The steps include: The worker who logged in in response to the login request inputs the results of the manual inspection for each manual inspection item via the manual inspection result input button; The steps include sending the results of the manual inspections, which are entered for each of the aforementioned multiple manual inspection items, to the server, A program characterized by causing the execution of [something].
Citation Information
Patent Citations
Unmanned aerial vehicle group maintenance method, device and system and readable storage medium
CN113222194A
Maintenance support system
JP1999353332A
Mobile terminal for gas facility security check and gas facility security check system
JP2010165317A
Operation assist device
JP2014206880A
Inspection support system
JP2015125772A