Control device, control system, method, and program

Abstract

To provide a remote monitoring control device, a system, a method which can improve monitoring efficiency when a mobile object is remotely monitored and controlled, and a non-temporal computer readable medium in which a program is stored.SOLUTION: A remote monitoring control device (11) comprises: determination result acquisition means (111) for acquiring a determination result obtained by determining propriety of autonomous driving of a mobile object; display means (112) for displaying at least one of a monitoring screen (112a) for displaying video data obtained by photographing an external direction from the mobile object for each of a plurality of mobile objects, and a remote control screen (112b) for displaying video data of a remote control mobile object selected from among the plurality of mobile objects; and control means (113) for selecting a predetermined mobile object, displaying video data of the predetermined mobile object on the remote control screen (112b) and displaying the remote control screen (112b) more emphatically than the monitoring screen (112a) when it is determined that the autonomous driving of the predetermined mobile object is impossible.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a remote monitoring control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored, and in particular to a remote monitoring control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a mobile object. [Background technology]

[0002] In recent years, autonomous vehicle technology has been actively developed. At autonomous driving level 4 and above, the driver who operates the vehicle is not inside the vehicle. As a result, if an incident occurs with the vehicle, there is nothing that can be done. To avoid such situations, it is desirable for autonomous driving systems to be equipped with functions for remote monitoring of vehicles and autonomous driving control (remote monitoring and control). In remote monitoring and control of vehicles, one monitor may monitor multiple vehicles, but it is necessary to improve the monitoring efficiency of monitoring and control by focusing on and managing vehicles in which an incident has occurred, for example.

[0003] Patent Document 1 discloses a vehicle remote operation support system including a vehicle having an autonomous driving system that performs autonomous driving and a control center having an operator, the vehicle including peripheral sensors that acquire information about the vehicle's surroundings and a calling unit that transmits peripheral information and calls the operator when autonomous driving is difficult, and the control center including a remote operation unit that the operator remotely controls the vehicle, an input unit that the operator inputs parameters for selecting a driving pattern for remotely controlling the vehicle according to the peripheral information, and a route generation unit that selects a driving pattern for remotely controlling the vehicle from a plurality of driving patterns using the parameters and generates a route for the vehicle using the selected driving pattern and the peripheral information. Patent Document 1 does not disclose improving monitoring efficiency when remotely monitoring and controlling a vehicle.

[0004] Patent Document 2 discloses a danger zone determination unit that determines a danger zone around an autonomously driven vehicle based on a danger level received from an autonomous driving control device. Patent Document 2 also discloses that a frame image with a danger zone object superimposed thereon is displayed on a display unit of a remote control device, allowing the user to intuitively grasp the danger level. Patent Document 2 does not disclose improving the monitoring efficiency when remotely monitoring and controlling a vehicle. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2019-191982 [Patent Document 2] International Publication No. 2018 / 155159 Summary of the Invention [Problem to be solved by the invention]

[0006] As described above, in remote monitoring and control of vehicles, one monitor must monitor multiple vehicles and remotely control any vehicle that has difficulty in autonomous driving. However, there is a problem in that it is difficult for one monitor to monitor multiple vehicles and determine whether a specific vehicle among the multiple vehicles needs to be remotely controlled.

[0007] The object of the present disclosure has been made to solve the above-mentioned problems, and in particular to provide a remote monitoring and control device, system, method, and non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a mobile object. [Means for solving the problem]

[0008] The remote monitoring and control device according to the present disclosure includes: a determination result acquisition means for acquiring a determination result of whether the moving body is capable of autonomous driving; a display means for displaying at least one of a monitoring screen for displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body, and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; a control means for selecting the predetermined moving object as the remote-controlled moving object when it is determined that the predetermined moving object is not capable of autonomous driving, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with.

[0009] The system according to the present disclosure comprises: The system includes an information acquisition device, a determination device, and a remote monitoring and control device, The information acquisition device is a sensor for acquiring sensor data indicating information on the traveling state of a moving object; a camera that acquires video data captured in an external direction from the moving body, The determination device is a data acquisition means for acquiring the sensor data and the video data from the information acquisition device; an autonomous driving determination means for determining whether the moving object is capable of autonomous driving based on the sensor data; a communication means for transmitting the determination result to the remote monitoring control device, The remote monitoring and control device includes: a determination result acquisition means for acquiring the determination result from the determination device; a display means for displaying at least one of a monitoring screen for displaying the video data for each of the plurality of moving bodies and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; The system has a control means for, when it is determined that a specified mobile body cannot be driven autonomously, selecting the specified mobile body as the remotely controlled mobile body, displaying the video data of the specified mobile body on the remote control screen, and displaying the remote control screen more prominently than the monitoring screen.

[0010] The method according to the present disclosure comprises: Obtaining a determination result of whether or not the moving body is capable of autonomous driving; performing at least one of displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body on a monitoring screen, and displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies on a remote control screen; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with.

[0011] The non-transitory computer-readable medium according to the present disclosure includes: Obtaining a determination result of whether or not the moving body is capable of autonomous driving; performing at least one of displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body on a monitoring screen, and displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies on a remote control screen; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A program that causes a computer to execute the above is stored. [Effects of the Invention]

[0012] According to the present disclosure, it is possible to provide a remote monitoring control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a mobile object. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a block diagram illustrating a remote monitoring and control device according to a first embodiment. [Figure 2A]1 is a block diagram illustrating a system according to a first embodiment. [Figure 2B] 1 is a block diagram illustrating a system according to a first embodiment. [Figure 3] 4 is a flowchart illustrating an operation of the monitoring center according to the first embodiment. [Figure 4] FIG. 10 is a block diagram illustrating a system according to a second embodiment. [Figure 5] FIG. 10 is a block diagram illustrating a system according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0015] [Embodiment 1] The configuration of the remote monitoring and control device and system according to the first embodiment will be described. FIG. 1 is a block diagram illustrating a remote monitoring and control device according to the first embodiment. FIG. 2A is a block diagram illustrating a system according to the first embodiment. FIG. 2B is a block diagram illustrating a system according to the first embodiment.

[0016] In the first embodiment, the technology of the present disclosure will be described using an example of autonomous driving of a vehicle. Also, in the first embodiment, a remote monitoring and control device installed in a monitoring center remotely monitors and controls a vehicle, which is a moving body, but in the following description, it will be described as if the monitoring center remotely monitors and controls the vehicle. Note that the moving body includes at least one of vehicles, including automobiles and trains, aircraft, and ships, for example. Also, the monitoring center may be referred to as a control center.

[0017] 1, 2A, and 2B, a system 10 according to the first embodiment includes an information acquisition device 12, a determination device 13, and a monitoring center 11C. A remote monitoring and control device 11 is installed in the monitoring center 11C.

[0018] 2A, information acquisition device 12 includes sensor 121 and camera 122. Sensor 121 acquires sensor data indicating information about the vehicle's traveling state. Camera 122 acquires video data obtained by capturing an image of the outside from the vehicle.

[0019] The determination device 13 has a data acquisition means 131, an autonomous driving determination means 132, and a communication means 133. The determination device 13 may realize the functions of the data acquisition means 131, the autonomous driving determination means 132, and the communication means 133 using a cloud connected to a communication network.

[0020] The data acquisition means 131 may acquire sensor data, image data, etc. obtained by a sensor such as a camera installed at or near a traffic light via a communication means installed at or near the traffic light. The data acquisition means 131 may also acquire sensor data and video data using a communication means such as 5G (5th Generation), LTE (Long Term Evolution), or Wi-Fi (registered trademark). Video data may also be referred to as video data.

[0021] The autonomous driving determination means 132 determines whether the vehicle is capable of autonomous driving based on the sensor data acquired from the information acquisition device 12. The determination of whether the vehicle is capable of autonomous driving may be made using artificial intelligence (AI). Alternatively, the determination of whether the vehicle is capable of autonomous driving may be made for each vehicle by installing artificial intelligence in the vehicle.

[0022] Furthermore, whether a vehicle is capable of autonomous driving may be determined by dividing it into three classes: autonomous driving not possible, autonomous driving not likely possible, and autonomous driving possible.

[0023] In addition, whether the vehicle can be driven autonomously may be determined based on the type of danger to the vehicle and the possibility that a danger has occurred to the vehicle, based on sensor data indicating information regarding the vehicle's driving state.

[0024] The communication means 133 transmits the determination result of the vehicle determined by the autonomous driving determination means 132 to the monitoring center 11C.

[0025] As shown in FIGS. 1 and 2B, the monitoring center 11C includes a determination result acquisition means 111, a display means 112, and a control means 113.

[0026] The determination result acquisition means 111 acquires from the determination device 13 the determination result determined by the autonomous driving determination means 132 of the determination device 13, which indicates whether the vehicle is capable of autonomous driving.

[0027] The display means 112 is capable of displaying a monitoring screen 112a and a remote control screen 112b. The monitoring screen 112a displays video data captured by the camera 122 for each of a plurality of vehicles. The monitoring screen 112a is a screen used by a monitor to monitor the vehicles. In other words, the monitor uses the monitoring screen 112a to monitor the vehicles.

[0028] The video data displayed on the monitoring screen 112a and the remote control screen 112b is not limited to video data captured by the camera 122. The video data displayed on the monitoring screen 112a and the remote control screen 112b may be video data (images) obtained by processing video data of the vehicle and its surroundings captured by the camera 122.

[0029] The remote control screen 112b displays video data of a remotely controlled vehicle selected from multiple vehicles. The remote control screen 112b is a screen used by the monitor to remotely control the vehicle. In other words, the monitor uses the remote control screen 112b to remotely control (automatically drive) the vehicle. The display means 112 displays at least one of the monitoring screen 112a and the remote control screen 112b. The remote control screen may also be referred to as a remote driving screen or a remote operation screen. The display means 112 may also display both the monitoring screen 112a and the remote control screen 112b.

[0030] When it is determined that a predetermined vehicle among the plurality of vehicles is not capable of autonomous driving, the control means 113 selects the predetermined vehicle as a remotely controlled vehicle. Then, the control means 113 displays video data of the predetermined vehicle on the remote control screen 112b. At this time, the remote control screen 112b is displayed more emphasized than the monitoring screen 112a. The control means may also be referred to as a display change means.

[0031] The control means 113 may, for example, make the size of the remote control screen 112b larger than the size of the monitoring screen 112a, thereby displaying the remote control screen 112b in a more emphasized manner than the monitoring screen 112a.

[0032] The control means 113 may increase the size of the remote control screen 112b to be larger than the size of the monitoring screen 112a in response to a predetermined trigger.

[0033] When the determination device 13 determines that the predetermined vehicle is not capable of autonomous driving, an observer remotely controls the vehicle using the remote control screen 112b, and therefore an image of the front of the predetermined vehicle is required. Therefore, the image data includes at least the image data of the direction in which the vehicle is traveling, i.e., the front direction of the vehicle.

[0034] The operation of the monitoring center according to the first embodiment will be described. FIG. 3 is a flowchart illustrating the operation of the monitoring center according to the first embodiment.

[0035] As shown in FIG. 3, the monitoring center 11C acquires the determination result of whether or not the vehicle is capable of autonomous driving (step S101).

[0036] If it is determined that a predetermined vehicle among the plurality of vehicles is not capable of autonomous driving (step S102: Yes), the monitoring center 11C selects the predetermined vehicle as a remotely controlled vehicle (step S103).

[0037] The monitoring center 11C displays the video data of the selected predetermined vehicle on the remote control screen 112b, and at this time, the remote control screen 112b is displayed more emphasized than the monitoring screen 112a (step S104).

[0038] If it is not determined in step S102 that the predetermined vehicle is not capable of autonomous driving (step S102: No), the monitoring center 11C checks whether or not there is a high possibility that the predetermined vehicle is not capable of autonomous driving (step S105).

[0039] If it is determined that the predetermined vehicle is highly likely to be incapable of autonomous driving (step S105: Yes), the monitoring center 11C executes step S103.

[0040] If it is determined in step S105 that the predetermined vehicle is not highly likely to be unable to be driven autonomously (step S105: No), the monitoring center 11C displays a monitoring screen 112a of multiple vehicles on the display means (step S106).

[0041] After steps S104 and S106, the monitoring center 11C checks whether or not to end the remote control or autonomous operation (step S107).

[0042] If the monitoring center 11C does not terminate the remote control or the autonomous operation (step S107: No), the process returns to step S102. The monitoring center 11C controls the display means 212 in the manner from step S101 to step S107.

[0043] When the monitoring center 11C according to the first embodiment determines that a predetermined vehicle is not capable of autonomous driving, it displays video data captured in the external direction from the predetermined vehicle on the remote control screen 112b. At this time, the monitoring center 11C displays the remote control screen 112b more emphatically than the monitoring screen 112a. As a result, the video data of the predetermined vehicle that has been determined to be not capable of autonomous driving and that requires automatic driving is displayed more emphatically, so that the monitor can check the video data of the predetermined vehicle on the remote control screen 112b without performing any operation. The monitor (remote driver) can then focus on remotely controlling the predetermined vehicle. In this way, the monitor can easily remotely control a predetermined vehicle that requires remote control while monitoring multiple vehicles.

[0044] As a result, according to embodiment 1, it is possible to provide a remote monitoring control device, system, method, and non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a moving body (vehicle).

[0045] In the first embodiment, the operation when determination device 13 determines that autonomous driving is not possible has been described, but the same operation may be performed when there is a high possibility that autonomous driving is not possible. That is, control means 113 may highlight and display video data of a vehicle that is highly likely to be unable to drive autonomously on remote control screen 112b.

[0046] Furthermore, among the monitoring screens 112a of a plurality of vehicles, the monitoring screen 112a that displays the video data of a vehicle that has been determined to be incapable of autonomous driving or highly likely to be incapable of autonomous driving may be highlighted.

[0047] In the first embodiment, the autonomous driving determination means 132 of the determination device 13 is described on the assumption that it is provided outside the monitoring center 11C, but this is not limited to this. The autonomous driving determination means 132 may be provided inside the monitoring center 11C. In other words, the monitoring center 11C may include autonomous driving determination means that determines whether the vehicle is capable of autonomous driving based on sensor data that indicates information about the vehicle's driving state.

[0048] Furthermore, in the first embodiment, a case where a vehicle is monitored and automatically driven has been described as an example, but the present disclosure is not limited to this. In addition to the case where a vehicle is automatically driven, the technology of the present disclosure may also be applied to, for example, monitoring of road conditions on expressways, operation management of Shinkansen bullet trains, etc.

[0049] In addition, in the first embodiment, the display means 112 has been described as having a monitoring display for displaying the monitoring screen 112a and a remote control display for displaying the remote control screen 112b, but this is not limiting. The display means 112 may have one display, and the monitoring screen 112a and the remote control screen 112b may be displayed on this display. Furthermore, the display means 112 may have three or more displays.

[0050] [Embodiment 2] FIG. 4 is a block diagram illustrating a system according to the second embodiment. In FIG. 4, the autonomous driving determination means 232 is provided inside the monitoring center 21C.

[0051] As shown in FIG. 4, the system 20 according to the second embodiment differs from the system 10 according to the first embodiment in that an autonomous driving determination means 232 is provided inside a monitoring center 21C.

[0052] When the autonomous driving determination means 232 determines that a predetermined vehicle among the plurality of vehicles is not capable of autonomous driving, the control means 213 of the monitoring center 21C according to the second embodiment switches the display means 212 from the monitoring screen 212a displaying the video data of the plurality of vehicles to the remote control screen 212b displaying the video data of the predetermined vehicle. This allows the remote control screen 212b to be displayed more emphasized than the monitoring screen 212a.

[0053] Furthermore, the control means 213 may switch between the monitoring screen 212a and the remote control screen 212b in response to a predetermined trigger. The control means may also be referred to as a display switching means.

[0054] In the second embodiment, the autonomous driving determination means 232 is assumed to be provided inside the monitoring center 11C, but this is not limitative. The autonomous driving determination means 132 may be provided inside the vehicle (shown by the dotted line in FIG. 4) instead of being provided inside the monitoring center 11C.

[0055] FIG. 5 is a block diagram illustrating a system according to the second embodiment. FIG. 5 shows details of the system 20 according to the second embodiment.

[0056] 5, when the autonomous driving determination means 232 determines that a predetermined vehicle among a plurality of monitored vehicles is not capable of autonomous driving, the control means 213 switches the display means 212 from the monitoring screen 212a to the remote control screen 212b (remote driving screen) of the predetermined vehicle. At this time, the switching occurs on the same display means (same screen), as indicated by arrow Y1 in FIG.

[0057] In addition, when the autonomous driving determination means 232 determines that a specific vehicle from among multiple monitored vehicles is not capable of autonomous driving, the control means 213 may display video data of the specific vehicle on a remote control display for displaying the remote control screen 212b, which is a screen separate from the monitoring display for displaying the monitoring screen 212a, as shown by arrow Y2 in Figure 5.

[0058] Furthermore, when the autonomous driving determination means 232 determines that a specific vehicle out of multiple monitored vehicles is not capable of autonomous driving, the control means 213 may display video data of the specific vehicle on a part of the display area of ​​the display means 212 as a remote control screen 212b and on another part as a monitoring screen 212a, as shown by arrow Y3 in Fig. 5. In this case, the control means 213 makes the remote control screen 212b a larger screen than the monitoring screen 212a. Furthermore, the monitoring screen 212a may display video data of multiple vehicles side by side.

[0059] Furthermore, when the autonomous driving determination means 232 determines that a specific vehicle among the multiple monitored vehicles is highly likely to be unable to drive autonomously, the control means 213 may change the display manner of the multiple monitored vehicles on the monitoring screen 212a, as indicated by arrow Y3 in Fig. 5. The control means 213 may, for example, enlarge or highlight the monitoring screen 212a1 of the specific vehicle. In other words, when the control means 213 determines that a specific vehicle among the multiple vehicles is highly likely to be unable to drive autonomously, the control means 213 may display video data of the specific vehicle on the monitoring screen 212a, and may display the video data of the specific vehicle larger than the video data of the other vehicles.

[0060] In the above embodiment, the present invention has been described as being configured as hardware, but the present invention is not limited to this. The present invention can also be realized by having a CPU (Central Processing Unit) execute a computer program to perform the processing of each component.

[0061] Specifically, each device in the image processing system may be realized using a combination of hardware and software. In a form that combines hardware and software, an image processing program is loaded into RAM (Random Access Memory), and hardware such as a control unit (CPU (Central Processing Unit)) is operated based on the program, thereby realizing each unit as various means. The program may also be recorded on a recording medium and distributed. The program recorded on the recording medium is read into memory via a wired or wireless connection, or via the recording medium itself, and operates the control unit, etc. Examples of recording media include optical disks, magnetic disks, semiconductor memory devices, and hard disks.

[0062] In the above embodiments, the program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (specifically, flexible disks, magnetic tapes, and hard disk drives), magneto-optical recording media (specifically, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (specifically, mask ROMs, PROMs (Programmable ROMs), and EPROMs (Erasable PROMs)), flash ROMs, and RAMs (Random Access Memory). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.

[0063] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0064] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention.

[0065] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) a determination result acquisition means for acquiring a determination result of whether the moving body is capable of autonomous driving; a display means for displaying at least one of a monitoring screen for displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body, and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; a control means for selecting the predetermined moving object as the remote-controlled moving object when it is determined that the predetermined moving object is not capable of autonomous driving, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with Remote monitoring and control equipment. (Appendix 2) the control means makes the size of the remote control screen larger than the size of the monitoring screen, thereby emphasizing the remote control screen more than the monitoring screen. 2. The remote monitoring and control device according to claim 1. (Appendix 3) the control means, in response to a predetermined trigger, makes the size of the remote control screen larger than the size of the monitoring screen; 3. The remote monitoring and control device according to claim 2. (Appendix 4) the control means switches the display from the monitoring screen to the remote control screen, thereby highlighting the remote control screen more than the monitoring screen. 2. The remote monitoring and control device according to claim 1. (Appendix 5) the control means switches between the monitoring screen and the remote control screen in response to a predetermined trigger; 5. The remote monitoring and control device according to claim 4. (Appendix 6) the display means includes a monitoring display for displaying the monitoring screen and a remote control display for displaying the remote control screen. 6. A remote monitoring and control device according to any one of appendices 1 to 5. (Appendix 7) the video data captured in the external direction from the moving body includes at least the video data in the direction in which the moving body is traveling; 7. A remote monitoring and control device according to any one of appendices 1 to 6. (Appendix 8) The feasibility of autonomous driving of the moving body is determined based on a type of danger to the moving body and a possibility that a danger has occurred to the moving body, based on sensor data indicating information about a traveling state of the moving body. 8. A remote monitoring and control device according to any one of appendices 1 to 7. (Appendix 9) The method further includes an autonomous driving determination means for determining whether the autonomous driving of the mobile body is possible based on sensor data indicating information on the traveling state of the mobile body. 9. A remote monitoring and control device according to any one of appendices 1 to 8. (Appendix 10) The moving object includes at least one of a vehicle, an aircraft, and a ship. 10. A remote monitoring and control device according to any one of appendices 1 to 9. (Appendix 11) When it is determined that the autonomous driving of a predetermined moving body is highly unlikely, the control means displays the video data of the predetermined moving body on the monitoring screen, and displays the video data of the predetermined moving body larger than the video data of other moving bodies. 11. A remote monitoring and control device according to any one of appendices 1 to 10. (Appendix 12) The system includes an information acquisition device, a determination device, and a remote monitoring and control device, The information acquisition device is a sensor for acquiring sensor data indicating information on the traveling state of a moving object; a camera that acquires video data captured in an external direction from the moving body, The determination device is a data acquisition means for acquiring the sensor data and the video data from the information acquisition device; an autonomous driving determination means for determining whether the moving object is capable of autonomous driving based on the sensor data; a communication means for transmitting the determination result to the remote monitoring control device, The remote monitoring and control device includes: a determination result acquisition means for acquiring the determination result from the determination device; a display means for displaying at least one of a monitoring screen for displaying the video data for each of the plurality of moving bodies and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; and a control means for, when it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen. system. (Appendix 13) Obtaining a determination result of whether or not the moving body is capable of autonomous driving; performing at least one of displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body on a monitoring screen, and displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies on a remote control screen; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A method for providing the above. (Appendix 14) Obtaining a determination result of whether or not the moving body is capable of autonomous driving; performing at least one of displaying video data of each of the plurality of moving bodies taken in an external direction from the moving body on a monitoring screen, and displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies on a remote control screen; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A non-transitory computer-readable medium on which a program for causing a computer to execute the program is stored. [Explanation of symbols]

[0066] 10, 20: System 11: Remote monitoring and control device 111: Judgment result acquisition means 112, 212: Display means 112a, 212a, 212a1: Monitoring screen 112b, 212b: Remote control screen 113, 213: Control means 11C, 21C: Monitoring Center 12: Information acquisition equipment 121: Sensor 122: Camera 13: Judgment equipment 131: Data acquisition method 132, 232: Autonomous driving determination means Y1, Y2, Y3: arrows

Claims

1. an acquisition unit that acquires data indicating the state of a moving body having an autonomous driving function; a control unit that generates a monitoring screen for monitoring the mobile object, the monitoring screen displaying the statuses of the mobile object in an arranged manner, based on the data indicating the status of the mobile object, and displays the monitoring screen on a monitoring display; Equipped with When it is determined that a predetermined moving body among the plurality of moving bodies is highly likely to be unable to be driven autonomously, the control unit generates a remote control screen for remotely controlling the predetermined moving body based on data indicating a state of the predetermined moving body, and displays the screen on a remote control display different from the monitoring display. Control device.

2. the control unit generates the monitoring screen highlighting the predetermined moving object determined to be highly likely to be incapable of autonomous driving among the plurality of moving objects, and displays the generated monitoring screen on the monitoring display; The control device according to claim 1 .

3. a determination unit that determines whether autonomous driving of the moving body is impossible based on data indicating the state of the moving body; The control device according to claim 1 or 2.

4. The data indicating the state of the moving object includes video data of the surroundings of the moving object captured by a camera provided on the moving object. The control device according to any one of claims 1 to 3.

5. the control unit generates the remote control screen including video data obtained by processing video data of the surroundings of the moving object, and displays the generated remote control screen on the remote control display. The control device according to claim 4.

6. A control system having a mobile body having an autonomous driving function, a control device capable of communicating with the mobile body, a monitoring display, and a remote control display different from the monitoring display, The moving body is a communication unit that transmits data indicating the state of the moving object; The control device an acquisition unit that acquires data indicating a state of the moving object; a control unit that generates a monitoring screen for monitoring the moving objects, the monitoring screen displaying the states of the plurality of moving objects in an arranged manner, based on data indicating the states of the moving objects, and displays the monitoring screen on the monitoring display; When it is determined that a predetermined moving body among the plurality of moving bodies is highly likely to be unable to be driven autonomously, the control unit generates a remote control screen for remotely controlling the predetermined moving body based on data indicating a state of the predetermined moving body, and displays the generated remote control screen on the remote control display. Control system.

7. The moving body is a determination unit that determines whether autonomous driving of the moving body is impossible, The communication unit transmits a result of the determination by the determination unit. The control system of claim 6.

8. Acquiring data indicating the state of a mobile body having an autonomous driving function; generating a monitoring screen for monitoring the mobile object based on the data indicating the state of the mobile object, the monitoring screen displaying the states of the mobile object in an arranged manner, and displaying the monitoring screen on a monitoring display; When it is determined that a predetermined moving body among the plurality of moving bodies is highly likely to be unable to be driven autonomously, a remote control screen for remotely controlling the predetermined moving body is generated based on data indicating the state of the predetermined moving body, and the remote control screen is displayed on a remote control display different from the monitoring display; A method for providing the above.

9. Acquiring data indicating the state of a mobile body having an autonomous driving function; generating a monitoring screen for monitoring the mobile object based on the data indicating the state of the mobile object, the monitoring screen displaying the states of the mobile object in an arranged manner, and displaying the monitoring screen on a monitoring display; When it is determined that a predetermined moving body among the plurality of moving bodies is highly likely to be unable to be driven autonomously, a remote control screen for remotely controlling the predetermined moving body is generated based on data indicating the state of the predetermined moving body, and the remote control screen is displayed on a remote control display different from the monitoring display; A program that causes a computer to execute the following.

Images