Unmanned system controller, unmanned system control method, and unmanned system control program

Abstract

To appropriately take control of multiple unmanned systems to be controlled in cooperation.SOLUTION: The present invention relates to an unmanned system controller for taking control of multiple unmanned systems to be controlled in cooperation by a remote controller. The unmanned system controller acquires task information, which shows a task performed by each of the multiple unmanned systems, and operational conditions of the multiple unmanned systems. The acquired task information and operational conditions are used for creating display data to display a first screen which can have a bird's-view of an implementation status of the task for each of the multiple unmanned systems.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an unmanned system control device, an unmanned system control method, and an unmanned system control program. [Background technology]

[0002] In recent years, with the advancement of technology related to unmanned systems such as drones and ground-based sensors, the application of unmanned systems to various fields of OT (Operation Technology) has progressed. For example, Patent Document 1 mentioned above discloses a technology for automatically controlling multiple unmanned systems controlled separately by different owners so that their flight paths do not interfere with each other (do not overlap, cross, or touch). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7195626 Summary of the Invention [Problem to be solved by the invention]

[0004] Although an unmanned system may carry out a given mission by itself, using multiple unmanned systems makes it possible to carry out larger missions (for example, formation flight using multiple unmanned systems, wide-area surveillance, etc.). In this case, each of the multiple unmanned systems takes turns carrying out tasks assigned to it according to the mission, and the multiple unmanned systems are controlled cooperatively to carry out a common mission.

[0005] When controlling multiple unmanned systems to carry out a mission using such systems, the operator (controller) is required to monitor the behavior of each unmanned system and quickly make appropriate decisions depending on the situation. However, when multiple unmanned systems are controlled in cooperation to carry out a common mission, it is not easy for the operator to make such decisions while considering the balance between the unmanned systems. Although the technology disclosed in Patent Document 1 targets the control of multiple unmanned systems, these unmanned systems are controlled by different owners, making it difficult to respond to such situations.

[0006] At least one embodiment of the present disclosure has been developed in consideration of the above-mentioned circumstances, and aims to provide an unmanned system control device, an unmanned system control method, and an unmanned system control program that can suitably control multiple unmanned systems that are controlled in collaboration. [Means for solving the problem]

[0007] In order to solve the above problem, an unmanned system control device according to at least one embodiment of the present disclosure: An unmanned system control device for controlling a plurality of unmanned systems controlled in cooperation by at least one remote control device, a task information acquisition unit for acquiring task information indicating a task to be performed in each of the plurality of unmanned systems; an operation status acquisition unit for acquiring operation statuses of the plurality of unmanned systems; a display data creation unit for creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; Equipped with.

[0008] In order to solve the above problem, an unmanned system control method according to at least one embodiment of the present disclosure includes: 1. An unmanned system control method for controlling a plurality of unmanned systems cooperatively controlled by at least one remote control device, comprising: acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; Equipped with.

[0009] In order to solve the above problem, an unmanned system control program according to at least one embodiment of the present disclosure includes: An unmanned system control program for controlling a plurality of unmanned systems controlled in cooperation by at least one remote control device, comprising: To the computer device, acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data capable of displaying a first screen that provides an overview of the implementation status of the tasks for each of the plurality of unmanned systems based on the task information and the operation status; is possible. [Effects of the Invention]

[0010] According to at least one embodiment of the present disclosure, it is possible to provide an unmanned system control device, an unmanned system control method, and an unmanned system control program that are capable of suitably controlling multiple unmanned systems that are controlled in cooperation with one another. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is an overall configuration diagram illustrating a control system according to at least one embodiment of the present disclosure. [Figure 2] FIG. 2 is a schematic diagram of the unmanned system control device of FIG. 1. [Figure 3] 3 is an example of a first screen displayed on the display unit of FIG. 2. [Figure 4] 3 is an example of a second screen displayed on the display unit of FIG. 2. [Figure 5] 3 is an example of a third screen displayed on the display unit of FIG. 2. [Figure 6] 10 is another example of the screen displayed on the display unit of FIG. 2. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, several embodiments of the present invention will be described with reference to the accompanying drawings. However, the configurations described as the embodiments or shown in the drawings are merely illustrative examples and are not intended to limit the scope of the present invention.

[0013] First, the overall configuration of a control system 1 including an unmanned system control device 100 according to at least one embodiment of the present disclosure will be described. Fig. 1 is an overall configuration diagram that schematically shows the control system 1 according to at least one embodiment of the present disclosure.

[0014] The control system 1 comprises a plurality of remote control devices 2 and an unmanned system control device 100. Each of the plurality of remote control devices 2 is a controller for cooperatively controlling a plurality of unmanned systems 4 under a predetermined mission, and each is operated by a different operator (hereinafter referred to as "first operator" as appropriate). FIG. 1 illustrates a case in which the control system 1 has, as the plurality of remote control devices 2, three remote control devices 2X, 2Y, and 2Z operated by first operators X, Y, and Z, respectively.

[0015] Each remote control device 2 controls a plurality of unmanned systems 4. These unmanned systems 4 are, for example, mobile objects that can move in a field (including the air, outer space, land, water, or underwater), and may be unmanned aircraft such as remotely operated drones whose operational state can be controlled in response to control signals from the remote control devices 2 in an unmanned state without a pilot on board, or may include ground-based sensors such as radars and cameras. Control signals can be transmitted and received between the remote control devices 2 and the unmanned systems 4 via wireless communication, but the transmission and reception of control signals may also be performed via wired communication.

[0016] Each remote control device 2X, 2Y, 2Z controls a plurality of unmanned systems 4 that do not overlap with one another (i.e., each unmanned system 4 is controlled based on a control signal received from one of the plurality of remote control devices 2X, 2Y, 2Z). In this way, the unmanned systems 4 that each remote control device 2 controls are assigned so that they do not overlap with one another, but as will be described later, the unmanned systems 4 assigned to each remote control device 2 may be interchangeable as needed.

[0017] Each remote control device 2 is operated by a first operator X, Y, or Z for the purpose of accomplishing a predetermined mission, and is capable of transmitting and receiving control signals to and from multiple unmanned systems 4. The first operators X, Y, and Z may operate each remote control device 2 according to a common mission, or may operate each remote control device 2 according to mutually different missions. The content of these missions is not limited, and may include, for example, formation flight by multiple unmanned systems 4, area monitoring, plant patrol and inspection, and various other actions.

[0018] The unmanned system control device 100 is a device for comprehensively controlling a plurality of remote control devices 2X, 2Y, 2Z operated by first operators X, Y, Z, and is operated by an operator (hereinafter referred to as "second operator" as appropriate) S who is a superior supervisor of the first operators X, Y, Z. The unmanned system control device 100 is connected to the plurality of remote control devices 2X, 2Y, 2Z via a communication network 200, thereby enabling comprehensive control of the plurality of remote control devices 2X, 2Y, 2Z operated by the first operators X, Y, Z.

[0019] FIG. 2 is a schematic diagram of the unmanned system control device 100 of FIG. 1. The unmanned system control device 100 is composed of, for example, a central processing unit (CPU), random access memory (RAM), read-only memory (ROM), and a computer-readable storage medium. A series of processes for realizing various functions is stored in a storage medium or the like in the form of a program (unmanned system control program), for example. The CPU reads this program into the RAM or the like and executes information processing and arithmetic operations to realize various functions. The program may be pre-installed in a ROM or other storage medium, provided in a state stored in a computer-readable storage medium, or distributed via wired or wireless communication means. Examples of computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0020] As shown in Figure 2, the unmanned system control device 100 is configured to realize specified functions by executing the above-mentioned program, and its functional configuration includes at least a task information acquisition unit 102, an operation status acquisition unit 104, a display data creation unit 106, and a display unit 108.

[0021] The task information acquisition unit 102 is configured to acquire task information TI related to tasks performed by multiple unmanned systems 4 controlled by each remote control device 2. As described above, the remote control device 2 cooperatively controls multiple unmanned systems 4 under the execution of a common mission. In this case, the remote control device 2 assigns tasks for executing the mission to each unmanned system 4 to be controlled, and the assigned tasks are executed in order by each unmanned system 4. Such assignment of tasks to each unmanned system 4 by the remote control device 2 may be performed manually by an operator based on a given mission, or may be performed automatically. The task information acquisition unit 102 can acquire task information related to tasks assigned to each unmanned system 4 by each remote control device 2 by accessing each remote control device 2.

[0022] The operating status acquisition unit 104 is configured to acquire the operating status of the multiple unmanned systems 4 to be controlled. The operating status of the multiple unmanned systems 4 is, for example, information detected by the operating status of the unmanned aircraft or sensors not mounted on the unmanned aircraft, such as stationary sensors required for controlling the unmanned aircraft. The operating status of these unmanned aircraft 4 can be acquired based on detection signals from sensors attached to each unmanned system 4 or control signals transmitted and received between each unmanned system 4 and each remote control device 2. The operating status of the unmanned systems 4 may be, for example, parameters indicating the dynamic status of the unmanned systems 4, such as the speed, altitude, and position information of each unmanned system 4, or parameters indicating static status, such as the temperature, pressure, or remaining amount of battery or fuel at each part of the unmanned system 4.

[0023] The display data creation unit 106 is configured to create display data for realizing a screen display that can be viewed by the second operator on the display unit 108. The display data is created by determining the task implementation status of each unmanned system 4 based on the task information acquired by the task information acquisition unit 102 and the operating status acquired by the operating status acquisition unit 104, and using the results to provide an overview of the task implementation status for each unmanned system 4.

[0024] The display unit 108 is a user interface (UI) component for displaying a screen viewable by the second operator based on the display data created by the display data creation unit 106, and is, for example, a display.

[0025] 2 is an example, and may be expandable to perform other functions as needed. For example, the unmanned system control device 100 may be added with a function for setting or changing a task identified from the task information acquired by the task information acquisition unit, a function for notifying the second operator S when a specified event occurs, or a function for autonomously controlling the unmanned system 4 based on a determination using artificial intelligence.

[0026] Next, a specific description will be given of the display mode of the display data on the display unit 108. Fig. 3 shows an example of the first screen G1 displayed on the display unit 108 in Fig. 2.

[0027] The first screen G1 displays, in order of execution, tasks assigned to each unmanned system 4. Fig. 3 shows how tasks assigned to each unmanned system 4 to be controlled by the remote control device 2X operated by the first operator X are displayed, in order of execution, for each unmanned system 4.

[0028] Area R1 located on the left side of first screen G1 displays simplified information about each unmanned system 4 that is the control target of the remote control device 2X. In this example, icons corresponding to two unmanned systems 4 that are the control targets of the remote control device 2X are displayed.

[0029] Furthermore, in area R2 located in the center of first screen G1, the tasks assigned to each unmanned system 4 are displayed in the order of their execution. In this embodiment, in area R2, the tasks assigned to each unmanned system 4 are displayed in the order of their execution at a position corresponding to the simplified display of each unmanned system 4 in area R1 described above. Specifically, for the unmanned system 4 with unmanned system ID "#1", multiple tasks T1-1, T1-2, ... are displayed in the order of their execution, and for the unmanned system 4 with unmanned system ID "#2", multiple tasks T2-1, T2-2, ... are displayed in the order of their execution.

[0030] Each task displayed in region R2 may be displayed in a manner that allows the execution state (status) of each task to be distinguished. For example, if the execution state of each task can be "Done" (completed in the past), "In Progress" (currently being executed), or "Not yet executed" (scheduled for execution in the future), the display mode (e.g., the thickness or color of the border) of the task can be changed for each of these execution states. This allows the second operator S viewing the first screen G1 to easily grasp the execution state of each task executed by the multiple unmanned systems 4 controlled by each remote control device 2.

[0031] Additionally, in the area R3 located on the right side of the first screen G1, operation buttons B1 for controlling the implementation status of the task selected in the area R2 are displayed. In this embodiment, "play," "pause," and "stop" are shown as examples of the operation buttons, but these are merely examples and are not limiting.

[0032] Additionally, in area R4 of the first screen G1, located below area R3, detailed information DI about the task selected in area R2 is displayed. This task can be selected, for example, by clicking on any task in area R2 (in FIG. 3, the task selected in area R2 is highlighted with a bold frame so that it can be distinguished).

[0033] In addition, area R4 shows detailed information such as "unmanned system ID" and "task name" for the task selected in area R2, but the displayed items in the detailed information are only examples and are not limited to these.

[0034] Additionally, a region R5 located at the top of the first screen G1 displays a collective operation button B2 and a task sorting button B3. The collective operation button B2 is a button for collectively operating the tasks corresponding to each unmanned system 4 displayed in region R2, and examples of the button include a "play button," a "pause button," and a "stop button." The task sorting button B3 is a button for realizing a so-called sorting function, which rearranges the tasks displayed in region R2 in a predetermined order, and examples of the button include a "first button" for rearranging the tasks so that the task to be performed first in each unmanned system 4 is at the beginning, and an "in progress button" for rearranging the tasks so that the task in the currently being performed status in each unmanned system 4 is at the beginning.

[0035] In addition, if an abnormality occurs in the operating state of the unmanned system 4 or the execution state of a task, a warning display may be displayed on the first screen G1 as appropriate to notify the user of the abnormality. In this case, the display corresponding to the unmanned system 4 or task in which the abnormality has occurred may be highlighted by, for example, changing color or blinking.

[0036] Next, another example of display on the display unit 108 will be described with reference to Fig. 4. Fig. 4 shows an example of the second screen G2 displayed on the display unit 108 of Fig. 2.

[0037] In area R6 located toward the center of second screen G2, a plurality of first icons A1 corresponding to each of the plurality of unmanned systems 4 are superimposed on a map M corresponding to the field in which the plurality of unmanned systems 4 operate. In FIG. 4, two first icons A1 corresponding to two unmanned systems 4 that are the control targets of remote control device X are shown. Each first icon A1 has the unmanned system ID of the corresponding unmanned system 4 simply displayed as a subscript. This allows second operator S viewing second screen G2 to easily grasp the deployment status of each unmanned system 4 on the field.

[0038] Each first icon A1 displayed on the second screen G2 also displays, as additional information, a schematic representation of the field of view of the imaging device mounted on the unmanned system 4. The display of such additional information is not limited, and for example, the past travel path or the predicted future course of the unmanned system 4 may also be displayed.

[0039] Each first icon A1 displayed on the second screen G2 may be linked to a display related to each unmanned system 4 displayed in each area of the first screen G1 described above. For example, when a specific first icon A1 is clicked and selected on the second screen G2, a display related to the unmanned system 4 corresponding to that icon A1 may be selected in conjunction on the first screen G1.

[0040] In addition, second icons A2 corresponding to targets related to the mission followed by each remote control device 2 may be superimposed and displayed in area R6 of the second screen G2. In the example of Fig. 4, in a mission to monitor a specific target, second icons A2 corresponding to each target to be monitored are superimposed and displayed. In this embodiment, two second icons A2 corresponding to ships as targets are displayed, and the past movement routes of the targets are also displayed as additional information.

[0041] The target related to the mission may be, for example, another moving object such as an aircraft or a vehicle, or a fixed object such as a specific building. The second icon A2 may be highlighted depending on the importance of the target in the mission. In particular, if the importance is set in stages, the second icon A2 may be displayed in a manner that allows distinction depending on the importance.

[0042] When the second icon A2 displayed in the region R6 in this way is selected, for example, with a mouse pointer, the unmanned system 4 and tasks related to the target corresponding to the second icon A2 may be displayed on the first screen G1 or the second screen G2 in a manner that allows them to be distinguished from others. In other words, by making it possible to identify related unmanned systems 4 and tasks in a reverse-lookup manner starting from a target related to the mission, it is possible to effectively support control in complex missions involving a multitude of unmanned systems 4 and targets.

[0043] Additionally, in area R7 located at the top of second screen G2, simplified information about the unmanned systems 4 corresponding to the first icon A1 and second icon A2 displayed in area R6 is displayed side by side. This allows the second operator S viewing area R7 to easily grasp the unmanned systems 4 on the field.

[0044] Furthermore, by selecting the simplified information displayed in area R7, it may also be possible to access information about the selected unmanned system 4 or target on the first screen G1 and second screen G2.

[0045] Furthermore, in area R8 located on the right side of second screen G2, a request is displayed from the first operator X, who operates each remote control device 2, to the second operator S. When approval from the second operator S is required for each unmanned system 4 controlled by the first operator X using the remote control device 2X to execute a specific action, the request from the first operator X is displayed in area R8. This request display simply displays information about the unmanned system ID of the unmanned system 4 that is the subject of the request, and the second operator S can confirm the details and approve the request by clicking on this request display. By displaying these request displays in area R8 sorted by request from the first operator X, the second operator S viewing second screen G2 can easily manage and understand the status of all applications.

[0046] Furthermore, in an area R9 located at the bottom of the second screen G2, a switching button B4 for switching the second screen G2 for each remote control device 2 is displayed. In this embodiment, switching buttons B4 corresponding to first operators X, Y, and Z who operate the respective remote control devices 2X, 2Y, and 2Z are displayed. In FIG. 4, by selecting the switching button B4 corresponding to first operator X among these switching buttons B4, a display related to the remote control device 2X operated by first operator X is displayed on the second screen G2. However, by selecting other switching buttons B4, displays related to the other remote control devices 2Y and 2Z are similarly displayed. In this way, the second operator S can suitably manage the remote control devices 2X, 2Y, and 2Z operated by the multiple first operators X, Y, and Z, respectively, by operating the switching buttons B4 displayed in area R9.

[0047] In addition, if an abnormality occurs in the operating state of the unmanned system 4 or the execution state of a task, a warning display may be displayed on the second screen G2 as appropriate to notify the user of the abnormality. In this case, the display corresponding to the unmanned system 4 or task in which the abnormality has occurred may be highlighted by, for example, changing color or blinking.

[0048] Next, another example of display on the display unit 108 will be described with reference to Fig. 5. Fig. 5 shows an example of the third screen G3 displayed on the display unit 108 in Fig. 2 .

[0049] In area R10 located on the left side of the third screen G3, all unmanned systems 4 that are under the control of the control system 1 are displayed side by side, with the "unmanned system ID," "unmanned system category," "unmanned system name," "mission name," "user," and "status" shown, respectively. In Figure 5, the unmanned system 4 displayed at the top is shown selected, and the display related to the selected unmanned system 4 is highlighted with hatching compared to the displays related to the other unmanned systems 4.

[0050] In addition, area R11 located on the right side of the third screen G3 shows detailed information corresponding to the unmanned system 4 selected in area R10. The detailed information shown in area R11 in Figure 5 is merely an example and is not limited to this.

[0051] Also, below region R11, an allocation change button B5 is displayed. The multiple unmanned systems 4 that are the control targets of the control system 1 are assigned to each remote control device 2 as described above with reference to FIG. 1. This allows each unmanned system 4 to be controlled based on a control signal from any one remote control device 2, and prevents interference between control signals from multiple remote control devices 2 at the same time. Clicking the allocation change button B5 makes it possible to set changes to the allocation of unmanned systems 4 to each remote control device 2 (for example, sharing unmanned systems 4 between remote control devices 2, allocating additional spare units, etc.).

[0052] In addition, if an abnormality occurs in the operating state of the unmanned system 4 or the execution state of a task, a warning display may be displayed on the third screen G3 as appropriate to notify the user of the abnormality. In this case, the display corresponding to the unmanned system 4 or task in which the abnormality has occurred may be highlighted by, for example, changing color or blinking.

[0053] Next, another example of display on the display unit 108 will be described with reference to Fig. 6. Fig. 6 shows another example of a screen displayed on the display unit 108 of Fig. 2.

[0054] In the aspect shown in Fig. 6, the first screen G1 to the third screen G3 described above with reference to Fig. 3 to Fig. 5 are displayed together on one screen. In particular, by linking the displays in each area of the first screen G1 to the third screen G3 with each other as described above, it is possible to suitably manage the status of task execution in each unmanned system 4 controlled by each remote control device 2.

[0055] The layout of the first screen G1 to the third screen G3 in Fig. 6 is merely an example and is not limited to this. For example, the display position or size of each screen may be changed, other screens may be added, or some screens may be omitted. Furthermore, each of these screens may be displayed on a separate display. Furthermore, it is not necessary to use all of these screens, and only at least a portion of each screen may be used.

[0056] As described above, according to each of the above embodiments, display data for screen display is created so that the task execution status can be overlooked for each unmanned system 4 controlled in cooperation with the remote control device 2. The display data created in this way is displayed on the display unit 108, allowing the second operator S to appropriately grasp the task execution status of each unmanned system 4 and quickly make appropriate decisions.

[0057] In addition, within the scope of the present disclosure, the components in the above-described embodiments may be replaced with well-known components as appropriate, and the above-described embodiments may be combined as appropriate.

[0058] The contents described in each of the above embodiments can be understood, for example, as follows.

[0059] (1) An unmanned system control device according to one aspect includes: An unmanned system control device for controlling a plurality of unmanned systems controlled in cooperation by at least one remote control device, a task information acquisition unit for acquiring task information indicating a task to be performed in each of the plurality of unmanned systems; an operation status acquisition unit for acquiring operation statuses of the plurality of unmanned systems; a display data creation unit for creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; Equipped with.

[0060] According to the above aspect (1), for a plurality of unmanned systems controlled in cooperation by a remote control device, task information regarding tasks assigned to each unmanned system and the operating status of each unmanned system are acquired. Then, based on the acquired task information and operating status, display data is created for displaying a first screen that provides an overview of the task execution status of each unmanned system. The display data created in this manner is displayed on the control screen, allowing the operator to easily grasp the task execution status of each unmanned system and quickly make appropriate decisions.

[0061] (2) In another embodiment, in the above embodiment (1), The first screen displays the tasks for each unmanned system in the order in which they will be performed.

[0062] According to the above aspect (2), the first screen displays the multiple tasks assigned to each unmanned system in the order in which they are to be performed, allowing the operator to easily grasp the progress of the tasks in each unmanned system by viewing the first screen.

[0063] (3) In another embodiment, in the above embodiment (2), The first screen includes a task sorting button for sorting the display order of the tasks.

[0064] According to the above aspect (3), by operating the task sorting button displayed on the first screen, it is possible to implement a so-called sorting function, which arranges the display order of the tasks. By arranging the tasks in a predetermined display order, it is possible to suitably control each of the multiple unmanned systems to be controlled.

[0065] (4) In another embodiment, in any one of the above (1) to (3), The first screen displays the implementation status of the task in a distinguishable manner.

[0066] According to the above aspect (4), the tasks are displayed on the first screen in a manner that allows the implementation status (for example, completed, in progress, or not yet implemented) to be distinguished. This allows the operator viewing the first screen to easily grasp the implementation status of each task in multiple unmanned systems.

[0067] (5) In another embodiment, in any one of the above (1) to (4), The display data is created so that a switching button for switching the display can be displayed for each remote control device.

[0068] According to the above aspect (5), when there are multiple remote control devices that issue control commands to multiple unmanned systems, the unmanned systems that are the control targets of each remote control device can be controlled appropriately by operating the switch button on the screen to switch the screen display for each remote control device.

[0069] (6) In another embodiment, in any one of the above (1) to (5), The display data is created to display a second screen in which a plurality of first icons corresponding to each of the plurality of unmanned systems are superimposed on a map corresponding to the field in which the plurality of unmanned systems operate.

[0070] According to the above aspect (6), the display data is created so that the plurality of unmanned systems to be controlled are displayed as first icons on a map corresponding to the field on the second screen. This makes it possible to easily grasp the deployment status on the field of each unmanned system whose task is displayed on the first screen.

[0071] (7) In another embodiment, in the above embodiment (6), the second screen displays, in an overlaid manner, a second icon corresponding to at least one target associated with a mission to be followed by the at least one remote control device; The display data is created so as to be able to identify the unmanned system or the task related to the target corresponding to the second icon selected on the second screen.

[0072] According to the above aspect (7), the second screen displays a target related to the mission being performed by the remote control device as a superimposed second icon, allowing the operator to efficiently collect information necessary for making decisions to carry out the mission. In particular, by selecting a displayed second icon, the operator can identify the unmanned system or task related to the target corresponding to the second icon.

[0073] (8) In another embodiment, in any one of the above (1) to (7), The display data is generated to display a third screen showing detailed information about the unmanned system.

[0074] According to the above aspect (8), the third screen displays detailed information about each unmanned system, making it possible to refer to the status of each unmanned system to be controlled in detail as needed.

[0075] (9) In another embodiment, in any one of the above (1) to (8), The display data is created to display an alarm according to the operating state of the unmanned system or the execution state of the task.

[0076] According to the above aspect (9), a warning can be displayed on the display screen according to the operating state of each unmanned system to be controlled and the execution state of the task.

[0077] (10) In another embodiment, in any one of the above (1) to (9), The display data is generated to display a request on the at least one remote control device for requesting permission required for the unmanned system to perform a predetermined action.

[0078] According to the above aspect (10), the display data is created so that the remote control device displays an application display on the screen to request permission from the operator for the unmanned system to perform a predetermined action, thereby enabling the application displays from each remote control device to be managed appropriately.

[0079] (11) In another embodiment, in any one of the above (1) to (10), The display device further includes a display unit for displaying the display data.

[0080] According to the above aspect (11), by displaying the display data according to each of the above aspects on the display unit, it becomes possible to suitably control the control states of a plurality of unmanned systems.

[0081] (12) An unmanned system control method according to one aspect includes: 1. An unmanned system control method for controlling a plurality of unmanned systems cooperatively controlled by at least one remote control device, comprising: acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; Equipped with.

[0082] According to the aspect (12) above, for a plurality of unmanned systems controlled in cooperation by a remote control device, task information regarding tasks assigned to each unmanned system and the operating status of each unmanned system are acquired. Then, based on the acquired task information and operating status, display data is created for displaying a first screen that provides an overview of the task execution status of each unmanned system. The display data created in this manner is displayed on the control screen, allowing the operator to easily grasp the task execution status of each unmanned system and quickly make appropriate decisions.

[0083] (13) An unmanned system control program according to one aspect of the present invention includes: An unmanned system control program for controlling a plurality of unmanned systems controlled in cooperation by at least one remote control device, comprising: To the computer device, acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data capable of displaying a first screen that provides an overview of the implementation status of the tasks for each of the plurality of unmanned systems based on the task information and the operation status; is possible.

[0084] According to the aspect (13) above, for a plurality of unmanned systems controlled in cooperation by a remote control device, task information relating to tasks assigned to each unmanned system and the operating status of each unmanned system are acquired. Then, based on the acquired task information and operating status, display data for displaying a first screen that provides an overview of the task execution status of each unmanned system is created. The display data created in this manner is displayed on the control screen, allowing the operator to easily grasp the task execution status of each unmanned system and quickly make appropriate decisions. [Explanation of symbols]

[0085] 1. Control System 2 Remote control device 4. Unmanned Systems 100 Unmanned System Control Device 102 Task information acquisition unit 104 Operation status acquisition unit 106 Display data creation unit 108 Display section 200 Communication Network X, Y, Z first operator S Second Operator G1 1st screen G2 2nd screen G3 3rd screen

Claims

1. An unmanned system control device for controlling a plurality of unmanned systems cooperatively controlled by at least one remote control device, comprising: a task information acquisition unit for acquiring task information indicating a task to be performed in each of the plurality of unmanned systems; an operation status acquisition unit for acquiring operation statuses of the plurality of unmanned systems; a display data creation unit for creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; An unmanned system control device comprising:

2. The unmanned system control device according to claim 1 , wherein the first screen displays the tasks for each unmanned system in an order of execution.

3. The unmanned system control device according to claim 2 , wherein the first screen includes a task sort button for sorting the display order of the tasks.

4. The unmanned system control device according to claim 1 or 2, wherein the first screen displays the execution status of the task in a distinguishable manner.

5. The unmanned system control device according to claim 1 or 2, wherein the display data is created so as to be able to display a switching button for switching the display for each remote control device.

6. The unmanned system control device according to claim 1 or 2, wherein the display data is created to display a second screen in which a plurality of first icons corresponding to each of the plurality of unmanned systems are superimposed on a map corresponding to the field in which the plurality of unmanned systems operate.

7. the second screen displays, in an overlaid manner, a second icon corresponding to at least one target related to a mission to be followed by the at least one remote control device; The unmanned system control device of claim 6, wherein the display data is created to identify the unmanned system or the task related to the target corresponding to the second icon selected on the second screen.

8. The unmanned system control device according to claim 1 or 2, wherein the display data is created to display a third screen showing detailed information about the unmanned system.

9. The unmanned system control device according to claim 1 or 2, wherein the display data is created to display an alarm according to the operating state of the unmanned system or the execution state of the task.

10. The unmanned system control device according to claim 1 or 2, wherein the display data is created to display an application for requesting permission required for the unmanned system to perform a predetermined action on the at least one remote control device.

11. The unmanned system control device according to claim 1 or 2, further comprising a display unit for displaying the display data.

12. 1. An unmanned system control method for controlling a plurality of unmanned systems cooperatively controlled by at least one remote control device, comprising: acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data for displaying a first screen that allows an overview of the implementation status of the task for each of the plurality of unmanned systems based on the task information and the operation status; An unmanned system control method comprising:

13. An unmanned system control program for controlling a plurality of unmanned systems cooperatively controlled by at least one remote control device, comprising: To the computer device, acquiring task information indicative of a task to be performed by each of the plurality of unmanned systems; acquiring operational statuses of the plurality of unmanned systems; creating display data capable of displaying a first screen that provides an overview of the implementation status of the tasks for each of the plurality of unmanned systems based on the task information and the operation status; An unmanned system control program capable of executing the above.

Images