CONTROL DEVICE, CONTROL SYSTEM, METHOD, AND PROGRAM
Patent Information
- Application Number
- JP2024177065
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-10-09
- Publication Date
- 2025-04-21
- Estimated Expiration
- 2040-03-31
AI Technical Summary
Existing remote vehicle monitoring and control systems face challenges in efficiently managing multiple vehicles, as it is difficult for a single supervisor to determine which vehicles require remote control due to autonomous driving issues.
A remote monitoring and control device and system that includes a determination device to assess autonomous driving capability, displaying vehicle data on monitoring and remote control screens, with the remote control screen emphasized for vehicles unable to operate autonomously, allowing supervisors to focus on necessary remote controls.
Enhances monitoring efficiency by highlighting vehicles requiring remote control, enabling supervisors to manage multiple vehicles effectively and ensure timely intervention.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to remote monitoring and control devices, systems, methods, and non-transitory computer-readable media on which programs are stored, and in particular to remote monitoring and control devices, systems, methods, and non-transitory computer-readable media on which programs are stored that can improve monitoring efficiency when remotely monitoring and controlling a mobile object. [Background technology]
[0002] In recent years, autonomous vehicle technology has been actively developed. At autonomous driving level 4 and above, the driver who drives the vehicle is not in the vehicle. As a result, if some kind of incident occurs with the vehicle, nothing can be done. Since such a situation should be avoided, it is desirable for autonomous driving systems to be equipped with functions for remote monitoring of vehicles and autonomous driving control (remote monitoring and control). In remote monitoring and control of vehicles, one monitor may monitor multiple vehicles, but it is necessary to improve the monitoring efficiency when controlling monitoring, for example by focusing on and managing vehicles where incidents have occurred.
[0003] Patent Document 1 discloses a vehicle remote operation support system including a vehicle having an automatic driving system that performs automatic driving, and a control center having an operator, the vehicle including a peripheral sensor that acquires peripheral information of the vehicle, and a calling unit that transmits peripheral information and calls the operator when automatic driving is difficult, and the control center including a remote operation unit that allows the operator to remotely control the vehicle, an input unit that allows the operator to input parameters for selecting a driving pattern for remotely controlling the vehicle according to the peripheral information, and a route generation unit that selects a driving pattern for remotely controlling the vehicle from a plurality of driving patterns using the parameters, and generates a route for the vehicle using the selected driving pattern and the peripheral information. Patent Document 1 does not disclose improving monitoring efficiency when remotely monitoring and controlling a vehicle.
[0004] Patent Document 2 discloses a danger zone determination unit that determines a danger zone around an autonomous vehicle based on a danger level received from an autonomous driving control device. Patent Document 2 also discloses that a frame image with a danger zone object superimposed thereon is displayed on a display unit of a remote control device, allowing the user to intuitively grasp the danger level. Patent Document 2 does not disclose improving the monitoring efficiency when remotely monitoring and controlling a vehicle. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2019-191982 A [Patent Document 2] International Publication No. 2018 / 155159 Summary of the Invention [Problem to be solved by the invention]
[0006] As described above, in the remote monitoring and control of vehicles, one monitor must monitor multiple vehicles and remotely control a vehicle that has difficulty in autonomous driving among the multiple vehicles. However, there is a problem in that it is difficult for one monitor to determine whether or not a specific vehicle among the multiple vehicles needs to be remotely operated while monitoring multiple vehicles.
[0007] The object of the present disclosure has been made to solve the above-mentioned problems, and in particular to provide a remote monitoring and control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a mobile object. [Means for solving the problem]
[0008] The remote monitoring and control device according to the present disclosure includes: A determination result acquisition means for acquiring a determination result of whether or not the moving body is capable of autonomous driving; A display means for displaying at least one of a monitoring screen for displaying video data captured from each of the plurality of moving bodies in an external direction from the moving body, and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; a control means for selecting the predetermined moving object as the remote-controlled moving object when it is determined that the predetermined moving object is not capable of autonomous driving, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with.
[0009] The system according to the present disclosure comprises: The system includes an information acquisition device, a determination device, and a remote monitoring and control device, The information acquisition device includes: A sensor for acquiring sensor data indicating information on a traveling state of a moving object; a camera for acquiring image data captured in an external direction from the moving body; The determination device is a data acquisition means for acquiring the sensor data and the video data from the information acquisition device; an autonomous driving determination means for determining whether the moving object is capable of autonomous driving based on the sensor data; A communication means for transmitting the determination result to the remote monitoring control device, The remote monitoring and control device includes: a judgment result acquisition means for acquiring the judgment result from the judgment device; a display means for displaying at least one of a monitoring screen for displaying the video data for each of the plurality of moving objects and a remote control screen for displaying the video data of a remote-controlled moving object selected from the plurality of moving objects; The system has a control means for, when it is determined that a specified moving body is not capable of autonomous driving, selecting the specified moving body as the remote-controlled moving body, displaying the video data of the specified moving body on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen.
[0010] The method according to the present disclosure comprises: Obtaining a determination result of whether or not the moving object is capable of autonomous driving; performing at least one of displaying on a monitoring screen image data captured from each of the plurality of moving bodies in an external direction from the moving body, and displaying on a remote control screen the image data of a remote-controlled moving body selected from the plurality of moving bodies; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with.
[0011] The non-transitory computer readable medium according to the present disclosure includes: Obtaining a determination result of whether or not the moving object is capable of autonomous driving; performing at least one of displaying on a monitoring screen image data captured from each of the plurality of moving bodies in an external direction from the moving body, and displaying on a remote control screen the image data of a remote-controlled moving body selected from the plurality of moving bodies; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A program that causes a computer to execute the above is stored. Effect of the Invention
[0012] According to the present disclosure, it is possible to provide a remote monitoring and control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored, which can improve monitoring efficiency when remotely monitoring and controlling a moving object. [Brief description of the drawings]
[0013] [Figure 1] 1 is a block diagram illustrating a remote monitoring and control device according to a first embodiment. [Figure 2A]1 is a block diagram illustrating a system according to a first embodiment. [Figure 2B] 1 is a block diagram illustrating a system according to a first embodiment. [Diagram 3] 4 is a flowchart illustrating an operation of the monitoring center according to the first embodiment. [Figure 4] FIG. 11 is a block diagram illustrating a system according to a second embodiment. [Diagram 5] FIG. 11 is a block diagram illustrating a system according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each drawing, the same or corresponding elements are given the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.
[0015] [Embodiment 1] The configurations of the remote monitoring and control device and the system according to the first embodiment will be described. FIG. 1 is a block diagram illustrating a remote monitoring and control device according to the first embodiment. FIG. 2A is a block diagram illustrating a system according to the first embodiment. FIG. 2B is a block diagram illustrating a system according to the first embodiment.
[0016] In the first embodiment, the technology of the present disclosure will be described taking an example of an automatic driving of a vehicle. In the first embodiment, a remote monitoring and control device installed in a monitoring center remotely monitors and controls a vehicle, which is a moving body, but in the following description, the monitoring center will be described as remotely monitoring and controlling the vehicle. Note that the moving body includes at least one of vehicles, including automobiles and trains, aircraft, and ships, for example. The monitoring center may also be referred to as a control center.
[0017] 1, 2A, and 2B, a system 10 according to the first embodiment includes an information acquisition device 12, a determination device 13, and a monitoring center 11C. A remote monitoring and control device 11 is installed in the monitoring center 11C.
[0018] 2A, the information acquisition device 12 includes a sensor 121 and a camera 122. The sensor 121 acquires sensor data indicating information on the traveling state of the vehicle. The camera 122 acquires video data obtained by capturing an image of the outside from the vehicle.
[0019] The determination device 13 has a data acquisition means 131, an autonomous driving determination means 132, and a communication means 133. The determination device 13 may realize the functions of the data acquisition means 131, the autonomous driving determination means 132, and the communication means 133 by using a cloud connected to a communication network.
[0020] The data acquisition means 131 may acquire sensor data or image data obtained by a sensor such as a camera installed at or near a traffic light via a communication means installed at or near the traffic light. The data acquisition means 131 may acquire sensor data or video data using a communication means such as 5G (5th Generation), LTE (Long Term Evolution), or Wi-Fi (registered trademark). Video data may also be referred to as video data.
[0021] The autonomous driving determination means 132 determines whether the vehicle can be driven autonomously based on the sensor data acquired from the information acquisition device 12. The determination of whether the vehicle can be driven autonomously may be performed using artificial intelligence (AI). In addition, the determination of whether the vehicle can be driven autonomously may be performed for each vehicle by installing artificial intelligence in the vehicle.
[0022] In addition, the autonomous driving capability of a vehicle may be determined by dividing the vehicle into three classes: autonomous driving not possible, autonomous driving not likely possible, and autonomous driving possible.
[0023] In addition, whether or not the vehicle can be driven autonomously may be determined based on sensor data indicating information regarding the vehicle's driving state, the type of danger to the vehicle, and the possibility that a danger has occurred to the vehicle.
[0024] The communication means 133 transmits the vehicle determination result determined by the autonomous driving determination means 132 to the monitoring center 11C.
[0025] As shown in FIGS. 1 and 2B, the monitoring center 11C includes a determination result acquisition means 111, a display means 112, and a control means 113.
[0026] The determination result acquisition means 111 acquires from the determination device 13 a determination result indicating whether or not the vehicle is capable of autonomous driving, as determined by the autonomous driving determination means 132 of the determination device 13 .
[0027] The display means 112 is capable of displaying a monitoring screen 112a and a remote control screen 112b. The monitoring screen 112a displays video data captured by the camera 122 for each of a plurality of vehicles. The monitoring screen 112a is a screen for an observer to observe the vehicles. That is, the observer observes the vehicles using the monitoring screen 112a.
[0028] The video data displayed on the monitoring screen 112a and the remote control screen 112b is not limited to the video data captured by the camera 122. The video data displayed on the monitoring screen 112a and the remote control screen 112b may be video data (images) obtained by processing the video data of the vehicle and the surroundings of the vehicle captured by the camera 122.
[0029] The remote control screen 112b displays video data of a remote-controlled vehicle selected from a plurality of vehicles. The remote control screen 112b is a screen for a monitor to remotely control a vehicle. That is, the monitor uses the remote control screen 112b to remotely control (automatically drive) the vehicle. The display means 112 displays at least one of the monitoring screen 112a and the remote control screen 112b. The remote control screen may also be referred to as a remote driving screen or a remote operation screen. The display means 112 may also display both the monitoring screen 112a and the remote control screen 112b.
[0030] When a predetermined vehicle among the multiple vehicles is determined to be incapable of autonomous driving, the control means 113 selects the predetermined vehicle as a remote-controlled vehicle. Then, the control means 113 displays video data of the predetermined vehicle on the remote control screen 112b. At this time, the remote control screen 112b is displayed more emphasized than the monitoring screen 112a. The control means may also be referred to as a display change means.
[0031] The control means 113 may, for example, make the size of the remote control screen 112b larger than the size of the monitoring screen 112a, thereby emphasizing the remote control screen 112b more than the monitoring screen 112a.
[0032] The control means 113 may make the size of the remote control screen 112b larger than the size of the monitoring screen 112a in response to a predetermined trigger.
[0033] When the determination device 13 determines that the predetermined vehicle is not capable of autonomous driving, an image of the front of the predetermined vehicle is required in order for the monitor to remotely control the vehicle using the remote control screen 112b. Therefore, the image data includes at least the image data of the direction in which the vehicle is traveling, that is, the forward direction of the vehicle.
[0034] The operation of the monitoring center according to the first embodiment will be described. FIG. 3 is a flowchart illustrating an operation of the monitoring center according to the first embodiment.
[0035] As shown in FIG. 3, the monitoring center 11C acquires a determination result as to whether or not the vehicle is capable of autonomous driving (step S101).
[0036] When it is determined that a predetermined vehicle among the multiple vehicles is not capable of autonomous driving (step S102: Yes), the monitoring center 11C selects the predetermined vehicle as a remote-controlled vehicle (step S103).
[0037] The monitoring center 11C displays the image data of the selected predetermined vehicle on the remote control screen 112b. At this time, the remote control screen 112b is displayed in a more emphasized manner than the monitoring screen 112a (step S104).
[0038] When it is not determined in step S102 that the predetermined vehicle is not capable of autonomous driving (step S102: No), the monitoring center 11C checks whether or not there is a high possibility that the predetermined vehicle is not capable of autonomous driving (step S105).
[0039] When it is determined that the predetermined vehicle is highly likely not capable of autonomous driving (step S105: Yes), the monitoring center 11C executes step S103.
[0040] If it is determined in step S105 that the predetermined vehicle is not highly likely to be unable to be driven autonomously (step S105: No), the monitoring center 11C displays a monitoring screen 112a of a plurality of vehicles on the display means (step S106).
[0041] After steps S104 and S106, the monitoring center 11C checks whether or not to end the remote control or the autonomous operation (step S107).
[0042] If the monitoring center 11C does not end the remote control or the autonomous operation (step S107: No), the process returns to step S102. The monitoring center 11C controls the display means 212 in the manner as in steps S101 to S107.
[0043] When the monitoring center 11C according to the first embodiment determines that the predetermined vehicle is not capable of autonomous driving, the monitoring center 11C displays the video data captured in the external direction from the predetermined vehicle on the remote control screen 112b. At this time, the monitoring center 11C displays the remote control screen 112b in a more emphasized manner than the monitoring screen 112a. As a result, the video data of the predetermined vehicle that has been determined to be not capable of autonomous driving and requires automatic driving is displayed in a more emphasized manner, so that the monitor can check the video data of the predetermined vehicle on the remote control screen 112b without performing any operation. Then, the monitor (remote driver) can focus on remotely controlling the predetermined vehicle. In this way, the monitor can easily remotely control the predetermined vehicle that requires remote control while monitoring multiple vehicles.
[0044] As a result, according to embodiment 1, it is possible to provide a remote monitoring and control device, a system, a method, and a non-transitory computer-readable medium on which a program is stored that can improve monitoring efficiency when remotely monitoring and controlling a moving body (vehicle).
[0045] In the first embodiment, the operation when the determination device 13 determines that autonomous driving is not possible has been described, but the same operation may be performed when there is a high possibility that autonomous driving is not possible. That is, the control means 113 may highlight and display the video data of the vehicle that is highly likely to be unable to drive autonomously on the remote control screen 112b.
[0046] Furthermore, among the monitoring screens 112a of a plurality of vehicles, the monitoring screen 112a on which the video data of a vehicle that has been determined to be incapable of autonomous driving or highly likely to be incapable of autonomous driving is displayed may be highlighted.
[0047] In the first embodiment, the autonomous driving determination means 132 of the determination device 13 is described on the assumption that it is provided outside the monitoring center 11C, but this is not limited to the above. The autonomous driving determination means 132 may be provided inside the monitoring center 11C. In other words, the monitoring center 11C may include an autonomous driving determination means that determines whether or not the vehicle can be driven autonomously based on sensor data indicating information about the vehicle's driving state.
[0048] In addition, in the first embodiment, a case where a vehicle is monitored and automatically driven is described as an example, but the present disclosure is not limited thereto. In addition to the case where a vehicle is automatically driven, the technology of the present disclosure may be applied to, for example, monitoring of road conditions on a highway, operation management of a bullet train, and the like.
[0049] In addition, in the first embodiment, the display means 112 has been described as having a monitoring display for displaying the monitoring screen 112a and a remote control display for displaying the remote control screen 112b, but is not limited to this. The display means 112 may have one display, and display the monitoring screen 112a and the remote control screen 112b on this display. Also, the display means 112 may have three or more displays.
[0050] [Embodiment 2] FIG. 4 is a block diagram illustrating a system according to the second embodiment. In FIG. 4, the autonomous driving determination means 232 is provided inside the monitoring center 21C.
[0051] As shown in FIG. 4, the system 20 according to the second embodiment differs from the system 10 according to the first embodiment in that an autonomous driving determination means 232 is provided inside a monitoring center 21C.
[0052] When the autonomous driving determination means 232 determines that a specific vehicle among the multiple vehicles is not capable of autonomous driving, the control means 213 of the monitoring center 21C according to the second embodiment switches the display means 212 from the monitoring screen 212a on which the video data of the multiple vehicles is displayed to the remote control screen 212b on which the video data of the specific vehicle is displayed. This makes it possible to display the remote control screen 212b more emphasized than the monitoring screen 212a.
[0053] Furthermore, the control means 213 may switch between the monitoring screen 212a and the remote control screen 212b in response to a predetermined trigger. The control means may also be referred to as a display switching means.
[0054] In the second embodiment, the autonomous driving determination means 232 is assumed to be provided inside the monitoring center 11C, but this is not limited to the above. The autonomous driving determination means 132 may be provided inside the vehicle (indicated by the dotted line in FIG. 4) instead of inside the monitoring center 11C.
[0055] FIG. 5 is a block diagram illustrating a system according to the second embodiment. FIG. 5 shows details of a system 20 according to the second embodiment.
[0056] 5, when the autonomous driving determination means 232 determines that a specific vehicle among a plurality of monitored vehicles is not capable of autonomous driving, the control means 213 switches the display means 212 from the monitoring screen 212a to a remote control screen 212b (remote driving screen) of the specific vehicle. At this time, as shown by the arrow Y1 in FIG. 5, the switching is performed on the same display means (same screen).
[0057] In addition, when the autonomous driving determination means 232 determines that a specific vehicle among a plurality of monitored vehicles is not capable of autonomous driving, the control means 213 may display video data of the specific vehicle on a remote control display for displaying the remote control screen 212b, which is a screen separate from the monitoring display for displaying the monitoring screen 212a, as shown by arrow Y2 in Figure 5.
[0058] Furthermore, when the autonomous driving determination means 232 determines that a specific vehicle among the multiple monitored vehicles is not capable of autonomous driving, the control means 213 may display video data of the specific vehicle as a remote control screen 212b on a part of the display area of the display means 212 and as a monitoring screen 212a on the other part, as shown by an arrow Y3 in Fig. 5. At this time, the control means 213 makes the remote control screen 212b a screen larger than the monitoring screen 212a. Furthermore, the monitoring screen 212a may display video data of multiple vehicles side by side.
[0059] Furthermore, when the autonomous driving determination means 232 determines that a specific vehicle among the multiple monitored vehicles is highly likely not capable of autonomous driving, the control means 213 may change the display manner of the multiple monitored vehicles on the monitoring screen 212a, as shown by arrow Y3 in Fig. 5. The control means 213 may, for example, enlarge or highlight the monitoring screen 212a1 of the specific vehicle. That is, when the control means 213 determines that a specific vehicle among the multiple vehicles is highly likely not capable of autonomous driving, the control means 213 may display video data of the specific vehicle on the monitoring screen 212a, and display the video data of the specific vehicle larger than the video data of the other vehicles.
[0060] In the above embodiment, the present invention has been described as being configured as hardware, but the present invention is not limited to this. The present invention can also be realized by having a CPU (Central Processing Unit) execute a computer program to process each component.
[0061] Specifically, each device of the image processing system may be realized by using a combination of hardware and software. In a form in which hardware and software are combined, an image processing program is loaded into a RAM (Random Access Memory), and hardware such as a control unit (CPU (Central Processing Unit)) is operated based on the program to realize each unit as various means. The program may be recorded on a recording medium and distributed. The program recorded on the recording medium is read into memory via a wired or wireless connection, or via the recording medium itself, and causes the control unit and the like to operate. Examples of recording media include optical disks, magnetic disks, semiconductor memory devices, hard disks, etc.
[0062] In the above embodiment, the program can be stored and supplied to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (specifically, flexible disks, magnetic tapes, and hard disk drives), magneto-optical recording media (specifically, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (specifically, mask ROMs, PROMs (Programmable ROMs), and EPROMs (Erasable PROMs)), flash ROMs, and RAMs (Random Access Memory). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.
[0063] Although the present invention has been described above with reference to the embodiment, the present invention is not limited to the above embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.
[0064] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present invention.
[0065] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) A determination result acquisition means for acquiring a determination result of whether or not the moving body is capable of autonomous driving; A display means for displaying at least one of a monitoring screen for displaying video data captured from each of the plurality of moving bodies in an external direction from the moving body, and a remote control screen for displaying the video data of a remote-controlled moving body selected from the plurality of moving bodies; a control means for selecting the predetermined moving object as the remote-controlled moving object when it is determined that the predetermined moving object is not capable of autonomous driving, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; Equipped with Remote monitoring and control equipment. (Appendix 2) the control means displays the remote control screen in a more emphasized manner than the monitoring screen by making the size of the remote control screen larger than the size of the monitoring screen. 2. The remote monitoring and control device according to claim 1. (Appendix 3) the control means, in response to a predetermined trigger, makes the size of the remote control screen larger than the size of the monitoring screen; 3. The remote monitoring and control device according to claim 2. (Appendix 4) the control means switches from the monitoring screen to the remote control screen, thereby highlighting the remote control screen more than the monitoring screen. 2. The remote monitoring and control device according to claim 1. (Appendix 5) The control means switches between the monitoring screen and the remote control screen in response to a predetermined trigger. 5. The remote monitoring and control device according to claim 4. (Appendix 6) the display means includes a monitoring display for displaying the monitoring screen, and a remote control display for displaying the remote control screen. 6. A remote monitoring and control device according to any one of claims 1 to 5. (Appendix 7) The image data captured in the external direction from the moving body includes at least the image data in the direction in which the moving body travels. 7. A remote monitoring and control device according to any one of claims 1 to 6. (Appendix 8) The autonomous driving capability of the moving body is determined based on a type of danger to the moving body and a possibility that a danger has occurred to the moving body, based on sensor data indicating information regarding a traveling state of the moving body. 8. A remote monitoring and control device according to any one of claims 1 to 7. (Appendix 9) The autonomous driving determination means further includes an autonomous driving determination means for determining whether the autonomous driving of the moving body is possible based on sensor data indicating information on a traveling state of the moving body. 9. A remote monitoring and control device according to any one of appendix 1 to 8. (Appendix 10) The moving object includes at least one of a vehicle, an aircraft, and a ship. 10. A remote monitoring and control device according to any one of claims 1 to 9. (Appendix 11) When it is determined that the autonomous driving of a predetermined moving body is highly unlikely, the control means displays the video data of the predetermined moving body on the monitoring screen, and displays the video data of the predetermined moving body larger than the video data of other moving bodies. 11. A remote monitoring and control device according to any one of claims 1 to 10. (Appendix 12) The system includes an information acquisition device, a determination device, and a remote monitoring and control device, The information acquisition device includes: A sensor for acquiring sensor data indicating information on a traveling state of a moving object; a camera for acquiring image data captured in an external direction from the moving body; The determination device is a data acquisition means for acquiring the sensor data and the video data from the information acquisition device; an autonomous driving determination means for determining whether the moving object is capable of autonomous driving based on the sensor data; A communication means for transmitting the determination result to the remote monitoring control device, The remote monitoring and control device includes: a judgment result acquisition means for acquiring the judgment result from the judgment device; a display means for displaying at least one of a monitoring screen for displaying the video data for each of the plurality of moving objects and a remote control screen for displaying the video data of a remote-controlled moving object selected from the plurality of moving objects; and a control means for, when it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen. system. (Appendix 13) Obtaining a determination result of whether or not the moving object is capable of autonomous driving; performing at least one of displaying on a monitoring screen image data captured from each of the plurality of moving bodies in an external direction from the moving body, and displaying on a remote control screen the image data of a remote-controlled moving body selected from the plurality of moving bodies; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A method for providing the above. (Appendix 14) Obtaining a determination result of whether or not the moving object is capable of autonomous driving; performing at least one of displaying on a monitoring screen image data captured from each of the plurality of moving bodies in an external direction from the moving body, and displaying on a remote control screen the image data of a remote-controlled moving body selected from the plurality of moving bodies; When it is determined that a predetermined moving object is not capable of autonomous driving, selecting the predetermined moving object as the remote-controlled moving object, displaying the video data of the predetermined moving object on the remote control screen, and displaying the remote control screen in a more emphasized manner than the monitoring screen; A non-transitory computer-readable medium on which a program for causing a computer to execute the program is stored. [Explanation of symbols]
[0066] 10, 20: System 11: Remote monitoring and control device 111: Judgment result acquisition means 112, 212: Display means 112a, 212a, 212a1: Monitoring screen 112b, 212b: Remote control screen 113, 213: Control means 11C, 21C: Monitoring Center 12: Information acquisition equipment 121: Sensor 122: Camera 13: Judgment equipment 131: Data acquisition method 132, 232: autonomous driving determination means Y1, Y2, Y3: Arrows
Claims
1. An acquisition unit that acquires data indicating a state of a moving object having an autonomous driving function; a control unit that generates a monitoring screen for monitoring the moving objects, the monitoring screen showing the states of the moving objects in an arranged manner, based on the data showing the states of the moving objects, and displays the generated monitoring screen on a monitoring display; Equipped with When it is determined that a predetermined moving object among the plurality of moving objects is highly likely to be unable to be autonomously driven, the control unit generates a remote control screen for remotely controlling the predetermined moving object based on data indicating a state of the predetermined moving object, and displays the remote control screen on a remote control display different from the monitoring display. Control device.
2. The control unit generates the monitoring screen in which the predetermined moving body determined to be highly likely to be incapable of autonomous driving among the plurality of moving bodies is highlighted, and displays the generated monitoring screen on the monitoring display. The control device according to claim 1 .
3. Further comprising a determination unit that determines a possibility that the moving body is unable to be driven autonomously based on data indicating a state of the moving body. The control device according to claim 1 or 2.
4. The data indicating the state of the moving object includes image data of the surroundings of the moving object captured by a camera equipped on the moving object. A control device according to any one of claims 1 to 3.
5. The control unit generates the remote control screen including video data obtained by processing the video data around the moving object, and displays the remote control screen on the remote control display. The control device according to claim 4.
6. A control system having a mobile object having an autonomous driving function, a control device capable of communicating with the mobile object, a monitoring display, and a remote control display, The moving body is a communication unit for transmitting data indicating a state of the moving object, The control device includes: An acquisition unit that acquires data indicating a state of the moving object; a control unit that generates a monitoring screen for monitoring the moving object, the monitoring screen showing the statuses of the moving objects in an arranged manner, based on the data showing the statuses of the moving objects, and displays the monitoring screen on the monitoring display; When it is determined that a predetermined moving object among the plurality of moving objects is highly likely to be unable to be driven autonomously, the control unit generates a remote control screen for remotely controlling the predetermined moving object based on data indicating a state of the predetermined moving object, and displays the remote control screen on the remote control display. Control system.
7. The moving body is A determination unit that determines whether the moving object is unable to be driven autonomously, The communication unit transmits a result of the determination by the determination unit.
7. The control system of claim 6.
8. Acquiring data indicating a state of a moving object having an autonomous driving function; generating a monitoring screen for monitoring the moving objects, the monitoring screen showing the states of the moving objects arranged side by side, based on the data showing the states of the moving objects, and displaying the monitoring screen on a monitoring display; When it is determined that a predetermined moving object among the plurality of moving objects is highly likely to be incapable of autonomous driving, a remote control screen for remotely controlling the predetermined moving object is generated based on data indicating a state of the predetermined moving object, and the remote control screen is displayed on a remote control display different from the monitoring display; A method for providing the above.
9. Acquiring data indicating a state of a moving object having an autonomous driving function; generating a monitoring screen for monitoring the moving objects, the monitoring screen showing the states of the moving objects arranged side by side, based on the data showing the states of the moving objects, and displaying the monitoring screen on a monitoring display; When it is determined that a predetermined moving object among the plurality of moving objects is highly likely to be incapable of autonomous driving, a remote control screen for remotely controlling the predetermined moving object is generated based on data indicating a state of the predetermined moving object, and the remote control screen is displayed on a remote control display different from the monitoring display; A program that causes a computer to execute the following.