Information processing device, information processing method, and computer program
The information processing device adjusts autonomous vehicle operations to avoid simultaneous remote assistance demands, reducing supervisor workload and maintaining efficient vehicle operation by minimizing speed changes and delays.
Patent Information
- Application Number
- JP2020122842
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-07-17
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2040-07-17
AI Technical Summary
The burden on supervisors providing remote assistance to multiple autonomous vehicles or mobile objects increases when assistance is concentrated at specific times, leading to inefficiencies and potential impacts on autonomous operations.
An information processing device that adjusts the movement operations of selected autonomous vehicles to prevent overlapping assistance times, using a coordination system to select and instruct adjustments based on preset rules, such as speed changes or route alterations, to minimize the need for simultaneous remote assistance.
This approach reduces the supervisor's burden by preventing simultaneous remote assistance requests, minimizing operational disruptions, and maintaining efficient autonomous vehicle operation while reducing speed changes and delays.
Smart Images

Figure 0007587780000001 
Figure 0007587780000002 
Figure 0007587780000003
Abstract
Description
[Technical field]
[0001] The technology disclosed in this specification relates to an information processing device, an information processing method, and a computer program for remote assistance for a plurality of autonomous moving bodies. [Background technology]
[0002] In recent years, autonomous vehicles (also called "self-driving vehicles") that run autonomously without the need for human driving operation have been developed. For example, autonomous vehicles set a planned driving route based on commands issued by an administrator, and detect and recognize the status (position, direction, speed, shape, color, etc.) of the autonomous vehicle itself and surrounding objects (other vehicles, pedestrians, traffic lights, road trees, lanes, etc.) based on signals output from various sensors equipped in the autonomous vehicle and information acquired through external communications, and run autonomously along the set planned driving route while avoiding collisions with surrounding objects.
[0003] Also, in order to realize smoother and safer driving of an autonomous vehicle, a technology is known in which an autonomous vehicle is remotely monitored at a remote monitoring and assistance center, and remote assistance is provided to the autonomous vehicle as necessary (for example, see Patent Document 1). Examples of remote assistance for an autonomous vehicle include assistance in detecting and recognizing the state of the autonomous vehicle itself and objects around the autonomous vehicle, and remote control of the autonomous vehicle. More specifically, examples include a mode in which, when a pedestrian is detected as a surrounding object but it is difficult to determine whether the pedestrian will cross the road, an administrator makes the determination on behalf of the autonomous vehicle, and a mode in which an administrator remotely controls the autonomous vehicle on behalf of the autonomous vehicle when passing through a street with a large number of pedestrians or traveling on a road different from the map information. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-140755 A Summary of the Invention [Problem to be solved by the invention]
[0005] In general, when an autonomous vehicle is driving autonomously, remote assistance is not often required. In particular, if the autonomous driving performance of the autonomous vehicle is high, the frequency with which remote assistance is required is low. Therefore, from the viewpoint of efficiency, it is desirable for each monitor to perform remote monitoring and assistance for multiple autonomous vehicles. However, when remote assistance for multiple autonomous vehicles is concentrated at a specific time, there is an issue that the burden on the monitor providing remote assistance becomes large.
[0006] Note that this issue is not limited to remote monitoring of autonomous vehicles, but is also a common issue in remote monitoring of moving bodies other than autonomously traveling vehicles, such as autonomous robots.
[0007] This specification discloses a technique that can solve the above-mentioned problems. [Means for solving the problem]
[0008] The technology disclosed in this specification can be realized, for example, in the following forms.
[0009] (1) The information processing device disclosed in this specification is an information processing device for remote assistance to a plurality of autonomous moving bodies, and includes an assistance schedule information acquisition unit, an adjustment processing unit, and an assistance execution instruction unit. The assistance schedule information acquisition unit acquires assistance schedule information indicating an execution schedule of the remote assistance for each of the autonomous moving bodies. When the execution schedule times of the plurality of remote assistances specified by the assistance schedule information overlap with each other at a specific time, the adjustment processing unit performs an adjustment process to make the remote assistance unnecessary for the selected autonomous moving body at the specific time by adjusting a movement operation of at least one of the autonomous moving bodies selected from the autonomous moving bodies that are targets of the remote assistance whose execution schedule times overlap with each other. The assistance execution instruction unit instructs a remote assistance device to execute the remote assistance according to the execution schedule of the remote assistance after the adjustment process.
[0010] In this way, according to the present information processing device, when the times at which multiple remote assistances are scheduled to be performed overlap with each other at a specific time, the movement operation of at least one selected autonomous moving body is adjusted, thereby executing an adjustment process that makes remote assistance unnecessary for the selected autonomous moving body at the specific time. Therefore, according to the present information processing device, it is possible to prevent multiple remote assistances from concentrating at a specific time, and as a result, it is possible to reduce the burden on a single monitor when the monitor provides remote assistance to multiple autonomous moving bodies.
[0011] (2) The information processing device may further include a selection unit that selects the autonomous moving body to be the target of the movement adjustment in accordance with a preset rule. According to the information processing device, an appropriate autonomous moving body can be selected as the target of the movement adjustment in accordance with a preset rule. Therefore, according to the information processing device, it is possible to reduce the impact on the autonomous traveling of each autonomous moving body while reducing the burden on a monitor when one monitor remotely assists multiple autonomous moving bodies by suppressing the concentration of multiple remote assistance at a specific time.
[0012] (3) The information processing device may further include a vehicle information acquisition unit that acquires vehicle information indicating a state including at least the speed of each of the autonomous moving bodies, and the adjustment of the movement operation may include decelerating or accelerating the selected autonomous moving body, and the rule may include a rule that preferentially selects an autonomous moving body that has a relatively small speed change associated with the adjustment of the movement operation. According to this information processing device, it is possible to prevent the speed change of the autonomous moving body from becoming excessive due to the adjustment of the movement operation. Therefore, according to this information processing device, it is possible to effectively reduce the impact on the autonomous traveling of each autonomous moving body while reducing the burden on a monitor when one monitor remotely assists multiple autonomous moving bodies by suppressing the concentration of multiple remote assistance at a specific time.
[0013] (4) The information processing device may further include a delay information acquisition unit that acquires delay information indicating a delay from a scheduled operation time of each of the autonomous moving bodies, and the adjustment of the movement operation includes decelerating or changing the route of the selected autonomous moving body, and the rule may include a rule that preferentially selects the autonomous moving body with a relatively small delay specified by the delay information. According to this information processing device, it is possible to prevent the delay from the scheduled operation time of the autonomous moving body from becoming excessive due to the adjustment of the movement operation. Therefore, according to this information processing device, it is possible to effectively reduce the impact on the autonomous traveling of each autonomous moving body while reducing the burden on a monitor when one monitor remotely assists multiple autonomous moving bodies by suppressing the concentration of multiple remote assistance at a specific time.
[0014] The technology disclosed in this specification can be realized in various forms, such as an information processing device, an information processing method, a computer program for realizing those methods, a non-transitory recording medium on which that computer program is recorded, etc. [Brief description of the drawings]
[0015] [Figure 1]FIG. 1 is an explanatory diagram showing a schematic configuration of a remote monitoring and assistance system 10 according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an explanatory diagram showing a schematic configuration of the remote monitoring and auxiliary management server 20. [Diagram 3] 1 is a flowchart showing a remote monitoring and assistance management process executed by the remote monitoring and assistance management server 20 of this embodiment. [Figure 4] FIG. 2 is an explanatory diagram showing an overview of a remote monitoring and assistance management process executed by the remote monitoring and assistance management server 20 of this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] A. Embodiment: A-1. Configuration of remote monitoring and support system 10: 1 is an explanatory diagram showing a schematic configuration of a remote monitoring and assistance system 10 according to this embodiment. The remote monitoring and assistance system 10 is a system for remotely monitoring a plurality of autonomous vehicles 60, for example, at a remote monitoring and assistance center, and for providing remote assistance to the autonomous vehicles 60 as necessary.
[0017] The autonomous vehicle 60 that is the target of remote monitoring and assistance by the remote monitoring and assistance system 10 is a vehicle that travels autonomously without the need for human driving operation. The autonomous vehicle 60 may be a private vehicle or a commercial vehicle such as a taxi, bus, or truck. The autonomous vehicle 60 is an example of an autonomous moving body in the claims.
[0018] The autonomous vehicle 60 includes a sensor 66, a communication unit 64, a drive unit 68, and an autonomous driving control unit 62. The sensor 66 includes, for example, a camera, a millimeter wave radar, a LIDAR, an ultrasonic sensor, a GPS, a vehicle speed sensor, an acceleration sensor, and the like, and detects the state (position, direction, speed, shape, color, and the like) of the autonomous vehicle 60 itself and surrounding objects (other vehicles, pedestrians, traffic lights, road trees, lanes, and the like). The communication unit 64 is a communication interface that communicates with other devices (for example, the remote monitoring and assistance management server 20 and the remote monitoring and assistance device 30, which are described later and which constitute the remote monitoring and assistance system 10) using a predetermined communication method. The drive unit 68 includes, for example, an engine, a motor, a steering wheel, a brake, and the like, and performs the driving operation (acceleration, steering, braking, and the like) of the autonomous vehicle 60. The autonomous driving control unit 62 is configured by, for example, a computer including a CPU and a memory, and controls the autonomous driving of the autonomous vehicle 60. For example, the autonomous driving control unit 62 sets a planned driving route based on instructions issued by an administrator (e.g., an administrator of the remote monitoring and assistance system 10), detects and recognizes the state of the autonomous driving vehicle 60 itself and surrounding objects based on various signals output from the sensor 66 and information obtained by communication with the outside via the communication unit 64 (e.g., a high-precision three-dimensional map or information on surrounding objects detected by other autonomous driving vehicles 60), and controls the driving operation by the drive unit 68 to cause the autonomous driving vehicle 60 to autonomously drive along the set planned driving route while avoiding collisions with surrounding objects.
[0019] However, during the autonomous driving of the autonomous vehicle 60, due to problems with the detection accuracy of the sensor 66, problems with the driving environment, etc., the autonomous vehicle 60 may not be able to reliably detect and recognize the state of the autonomous vehicle 60 itself or surrounding objects. For example, when a pedestrian is detected as a surrounding object, but it is not possible to determine whether the pedestrian is crossing the road, when a surrounding object is detected but the surrounding object is an object that does not interfere with the driving of the autonomous vehicle 60 (for example, an obviously light flying object), when passing through a street with a large number of pedestrians nearby, when driving through a tunnel, when driving in heavy rain or thick fog, when driving on a road different from the map information, etc. In such cases, it may be difficult for the autonomous vehicle 60 to drive autonomously smoothly, or the possibility of collision with surrounding objects may increase. In preparation for such cases, the remote monitoring and assistance system 10 remotely monitors the autonomous vehicle 60, and provides remote assistance to the autonomous vehicle 60 (i.e., intervenes in the control of the autonomous vehicle 60) either spontaneously or in response to a request from the autonomous vehicle 60. Examples of remote assistance provided to the autonomous vehicle 60 by the remote monitoring and assistance system 10 include assistance with detection and recognition of the state of the autonomous vehicle 60 itself and objects surrounding the autonomous vehicle 60, and remote control of the autonomous vehicle 60. This allows the autonomous vehicle 60 to travel smoothly, comfortably, and safely.
[0020] As shown in FIG. 1, the remote monitoring and assistance system 10 includes a remote monitoring and assistance management server 20, a plurality of remote monitoring and assistance devices 30, and a network communication device 40 such as a router. Although three remote monitoring and assistance devices 30 are shown in FIG. 1, the number of remote monitoring and assistance devices 30 included in the remote monitoring and assistance system 10 may be two or less, or may be four or more. The devices constituting the remote monitoring and assistance system 10 are connected to each other so as to be able to communicate with each other via an internal network 82 such as a LAN. In addition, the remote monitoring and assistance management server 20 and the plurality of remote monitoring and assistance devices 30 are connected to each autonomous vehicle 60 so as to be able to communicate with each other via the network communication device 40 and an external network 84 such as the Internet.
[0021] The remote monitoring and assistance device 30 is a terminal device used for remote monitoring and assistance of the autonomous vehicle 60 by the monitor MO, and is configured by, for example, a PC. The remote monitoring and assistance device 30 includes a display device 32 such as a liquid crystal display. The monitor MO performs remote monitoring and assistance of the autonomous vehicle 60 by referring to, for example, images displayed on the display device 32 of the remote monitoring and assistance device 30 (for example, images showing the state and planned driving route of each autonomous vehicle 60, the state of objects around each autonomous vehicle 60, etc.). The remote monitoring and assistance device 30 includes a user interface (for example, a keyboard, a mouse, a touch panel, a joystick, etc.) for performing remote monitoring and assistance of the autonomous vehicle 60. In this embodiment, each monitor MO (each remote monitoring and assistance device 30) performs remote monitoring and assistance of multiple (for example, 10) autonomous vehicles 60 simultaneously. The autonomous vehicles 60 that are the targets of remote monitoring and assistance by one monitor MO (remote monitoring and assistance device 30) may be the same as the autonomous vehicles 60 that are the targets of remote monitoring and assistance by another monitor MO (remote monitoring and assistance device 30), or the two may overlap partially, or the two may be different with no overlap. The remote monitoring and assistance device 30 is an example of a remote assistance device in the claims.
[0022] The remote monitoring and assistance management server 20 is a server device for managing remote monitoring and assistance by each monitor MO using the remote monitoring and assistance device 30. FIG. 2 is an explanatory diagram showing a schematic configuration of the remote monitoring and assistance management server 20. The remote monitoring and assistance management server 20 includes a control unit 210, a storage unit 220, a display unit 230, an operation input unit 240, and an interface unit 250. These units are connected to each other via a bus 290 so as to be able to communicate with each other. The remote monitoring and assistance management server 20 is an example of an information processing device in the claims.
[0023] The display unit 230 of the remote monitoring and auxiliary management server 20 is, for example, configured with a liquid crystal display or the like, and displays various images and information. The operation input unit 240 is, for example, configured with a keyboard, mouse, buttons, microphone, etc., and accepts operations and instructions from the administrator. The display unit 230 may be equipped with a touch panel so as to function as the operation input unit 240. The interface unit 250 is, for example, configured with a LAN interface, USB interface, etc., and communicates with other devices via wired or wireless means.
[0024] The storage unit 220 of the remote monitoring and assistance management server 20 is configured, for example, with a ROM, RAM, a hard disk drive (HDD), etc., and is used to store various programs and data, and as a work area when executing various programs, and as a temporary storage area for data. For example, the storage unit 220 stores a remote monitoring and assistance management program CP, which is a computer program for executing the remote monitoring and assistance management process described below. The remote monitoring and assistance management program CP is provided in a state stored in a computer-readable recording medium (not shown), such as a CD-ROM, DVD-ROM, or USB memory, and is stored in the storage unit 220 by installing it in the remote monitoring and assistance management server 20.
[0025] Furthermore, map information 221 is stored in the memory unit 220 of the remote monitoring and auxiliary management server 20. The map information 221 is, for example, highly accurate three-dimensional map information, and includes information on the positions and shapes of traffic signals, road signs, road trees, guardrails, buildings, etc. in addition to information on the positions and shapes of roads.
[0026] The control unit 210 of the remote monitoring and assistance management server 20 is configured with, for example, a CPU, and controls the operation of the remote monitoring and assistance management server 20 by executing a computer program read from the storage unit 220. For example, the control unit 210 functions as a remote monitoring and assistance management unit 211 that executes a remote monitoring and assistance management process described below by reading and executing a remote monitoring and assistance management program CP from the storage unit 220. The remote monitoring and assistance management unit 211 includes, as functional modules, a vehicle information acquisition unit 212, an assistance schedule information acquisition unit 213, a delay information acquisition unit 214, an adjustment processing unit 215, a selection unit 216, and an assistance execution instruction unit 217. The functions of each of these units will be described in conjunction with the description of the remote monitoring and assistance management process described below.
[0027] A-2. Remote monitoring and support management process: Fig. 3 is a flowchart showing the remote monitoring and assistance management process executed by the remote monitoring and assistance management server 20 of this embodiment. Also, Fig. 4 is an explanatory diagram showing an overview of the remote monitoring and assistance management process executed by the remote monitoring and assistance management server 20 of this embodiment.
[0028] The remote monitoring and assistance management process of this embodiment is a process for managing remote monitoring and assistance of the autonomous vehicle 60 by each monitor MO using the remote monitoring and assistance device 30, and includes, for example, a process for coordinating the execution schedule of remote assistance for a plurality of autonomous vehicles 60. The remote monitoring and assistance management process is started in response to an administrator inputting a start instruction by operating the operation input unit 240 of the remote monitoring and assistance management server 20. Note that, in this embodiment, the remote monitoring and assistance management process is executed for each remote monitoring and assistance device 30 (monitoring person MO). The remote monitoring and assistance management process executed for one remote monitoring and assistance device 30 will be described below.
[0029] As described above, each autonomous vehicle 60 sets a planned driving route based on instructions issued by the administrator, detects and recognizes the state of the autonomous vehicle 60 itself and surrounding objects using sensors 66, etc., and drives autonomously along the set planned driving route while avoiding collisions with surrounding objects. At that time, the autonomous driving control unit 62 of each autonomous vehicle 60 monitors whether remote assistance from the remote monitoring and assistance device 30 is required now or in the future based on its own current position, the planned driving route, the state of surrounding objects, etc., and if remote assistance is required, performs processing to transmit information regarding the remote assistance (information indicating the content of the remote assistance required and the time when remote assistance is required) to the remote monitoring and assistance management server 20.
[0030] First, the vehicle information acquisition unit 212 (FIG. 2) of the remote monitoring and assistance management server 20 acquires vehicle information Iv indicating the state of each of a plurality of (e.g., 10) autonomous vehicles 60 that are targets of monitoring by the remote monitoring and assistance device 30 (S100). In this embodiment, the state of the autonomous vehicle 60 indicated by the vehicle information Iv includes the current position, planned travel route, and speed of the autonomous vehicle 60. The vehicle information acquisition unit 212 may directly acquire the vehicle information Iv indicating the state of the autonomous vehicle 60 detected by the sensor 66 or the like of each autonomous vehicle 60 from each autonomous vehicle 60. In addition, when the vehicle information Iv is stored in a storage unit of a device other than the autonomous vehicle 60 (e.g., the remote monitoring and assistance device 30), the vehicle information acquisition unit 212 may acquire the stored vehicle information Iv.
[0031] In addition, the delay information acquisition unit 214 (FIG. 2) of the remote monitoring and assistance management server 20 acquires delay information Id indicating a delay from the scheduled operating time of each autonomous vehicle 60 (S110). For example, if the autonomous vehicle 60 is a commercial vehicle (such as a bus) that operates according to a predetermined timetable, the delay from the arrival time (or departure time) of each stop specified in the timetable can be used as the delay from the scheduled operating time of the autonomous vehicle 60, and if the autonomous vehicle 60 is a commercial vehicle (such as a truck or delivery vehicle) that operates to arrive at the destination by the target arrival time, the delay of the expected arrival time from the target arrival time can be used. The delay information acquisition unit 214 may directly acquire the delay information Id indicating the delay from the scheduled operating time held by the autonomous driving control unit 62 of each autonomous vehicle 60 from each autonomous vehicle 60. Furthermore, if the delay information Id is stored in a storage unit of a device (for example, remote monitoring and assistance device 30) other than the autonomous vehicle 60, the delay information acquisition unit 214 may acquire the stored delay information Id. Note that the order of execution of the process for acquiring the vehicle information Iv (S100) and the process for acquiring the delay information Id (S110) may be set arbitrarily, and the two processes may be executed simultaneously.
[0032] Next, the assistance schedule information acquisition unit 213 (FIG. 2) of the remote monitoring and assistance management server 20 acquires assistance schedule information Ia indicating the execution schedule of remote assistance for each autonomous vehicle 60 (S120). The execution schedule of remote assistance indicated by the assistance schedule information Ia includes the content and time of the remote assistance (assistance start time and assistance end time). In this embodiment, the execution schedule time of the remote assistance includes the time required for the monitor MO to confirm and understand the status of the autonomous vehicle 60 that is the target of the remote assistance, in addition to the time required for the actual remote assistance by the remote monitoring and assistance device 30. The assistance schedule information acquisition unit 213 acquires information on the remote assistance described above (information indicating the content of the remote assistance required and the time when the remote assistance is required) from the autonomous driving control unit 62 of each autonomous vehicle 60, and generates and acquires assistance schedule information Ia indicating the execution schedule (content and time) of remote assistance for each autonomous vehicle 60, taking into account the time required for the monitor MO to confirm and understand. In addition, the assistance schedule information acquisition unit 213 may refer to the current position, planned driving route, and speed of each autonomous vehicle 60 identified by the vehicle information Iv acquired in S100, and the map information 221 stored in the memory unit 220, to predict remote assistance that will be required for each autonomous vehicle 60, and generate and acquire assistance schedule information Ia that indicates the schedule for executing the predicted remote assistance.
[0033] FIG. 4 conceptually illustrates the execution schedule of remote assistance for each of the three autonomous vehicles 60 (60a, 60b, 60c) that are targets of remote monitoring and assistance. The left side of FIG. 4 conceptually illustrates the time transition of the necessity of remote assistance for each autonomous vehicle 60 before the adjustment process described later, and the time AT for the remote assistance execution schedule set based on the transition. In the example shown in FIG. 4, one remote assistance is scheduled to be executed for each autonomous vehicle 60, but the times AT for the remote assistance execution schedule overlap with each other. More specifically, at a specific time t1, a part of the time AT for the remote assistance execution schedule for the autonomous vehicle 60a overlaps with a part of the time AT for the remote assistance execution schedule for the autonomous vehicle 60b. Also, at a specific time t2, a part of the time AT for the remote assistance execution schedule for each of the three autonomous vehicles 60a, 60b, 60c overlap with each other.
[0034] The adjustment processing unit 215 (FIG. 2) of the remote monitoring and assistance management server 20 judges whether or not the times AT at which multiple remote assistances are scheduled to be executed overlap, as specified by the assistance schedule information Ia (S130). If it is judged that the times AT at which multiple remote assistances are scheduled to be executed overlap (S130: YES), the selection unit 216 of the remote monitoring and assistance management server 20 selects at least one autonomous vehicle 60 to be the target of adjustment of the movement operation from among the autonomous vehicles 60 that are targets of remote assistance and whose scheduled execution times AT overlap, in accordance with a preset rule (S140). Examples of adjustment of the movement operation of the autonomous vehicle 60 include deceleration (including stopping), acceleration, and route change of the autonomous vehicle 60.
[0035] Then, the adjustment processing unit 215 of the remote monitoring and assistance management server 20 performs an adjustment process (S150) to adjust the movement operation of the autonomous vehicle 60 selected in S140 to make remote assistance unnecessary for the selected autonomous vehicle 60 at specific times t1 and t2 where the times AT for the execution of a plurality of remote assistances overlap. The right side of FIG. 4 conceptually shows the time transition of the necessity of remote assistance for each autonomous vehicle 60 after the adjustment process and the time AT for the execution of remote assistance that is set based on the adjustment process. As described above, in the example shown in FIG. 4, the times AT for the execution of remote assistance for each of the three autonomous vehicles 60 overlap with each other. Therefore, two autonomous vehicles 60 (60b, 60c) are selected from the three autonomous vehicles 60 as targets for adjustment of the movement operation. Then, the time AT for the execution of remote assistance for the autonomous vehicle 60b is delayed by decelerating one of the autonomous vehicles 60b, making remote assistance unnecessary for the autonomous vehicle 60b at specific times t1 and t2. In addition, the route of the other autonomous vehicle 60c is changed so that it travels along a route that does not pass through the point for which remote assistance was required before the route change, making remote assistance unnecessary for the autonomous vehicle 60c for the time being, including the specific times t1 and t2. As a result, the only remote assistance required at the specific times t1 and t2 is remote assistance for the autonomous vehicle 60a. Although not shown in the example of FIG. 4, if the autonomous vehicle 60 accelerates as an adjustment to its travel operation, the scheduled time AT for performing remote assistance for the autonomous vehicle 60 will be brought forward.
[0036] Adjustment of the movement operation of the autonomous vehicle 60 can be achieved by the adjustment processing unit 215 of the remote monitoring and assistance management server 20 sending an adjustment instruction to the autonomous driving control unit 62 of the autonomous vehicle 60, and the autonomous driving control unit 62 controlling the drive unit 68 in accordance with the instruction.
[0037] The rule for selecting the autonomous vehicle 60 to be adjusted in the above-mentioned movement operation (S140) may include, for example, a rule that preferentially selects an autonomous vehicle 60 with a relatively small speed change associated with the adjustment of the movement operation. For example, when deceleration is performed as an adjustment of the movement operation of the autonomous vehicle 60, an autonomous vehicle 60 with a relatively slow speed specified by the vehicle information Iv may be preferentially selected, and conversely, when acceleration is performed as an adjustment of the movement operation of the autonomous vehicle 60, an autonomous vehicle 60 with a relatively fast speed specified by the vehicle information Iv may be preferentially selected. In addition, the rule may include, for example, a rule that preferentially selects an autonomous vehicle 60 with a relatively small delay from the scheduled travel time specified by the delay information Id. For example, when deceleration or route change is performed as an adjustment of the movement operation of the autonomous vehicle 60, the arrival time at the destination is delayed accordingly, so that an autonomous vehicle 60 with a relatively small delay from the scheduled travel time may be preferentially selected.
[0038] After the adjustment process (S150), the assistance execution instruction unit 217 (FIG. 2) of the remote monitoring and assistance management server 20 instructs the remote monitoring and assistance device 30 to execute remote assistance according to the execution schedule of each remote assistance after the adjustment process (S160). In response to this, the remote monitoring and assistance device 30 acquires information required for remote assistance (e.g., information detected by the sensor 66) from the autonomous vehicle 60 that is the target of the execution instruction, and performs remote assistance for the autonomous vehicle 60 (assistance in detecting and recognizing the state of surrounding objects, remote control of the autonomous vehicle 60, etc.) by referring to the information. In the example shown in FIG. 4, remote assistance for the autonomous vehicle 60a and remote assistance for the autonomous vehicle 60b are executed one by one in order according to the execution schedule of each remote assistance shown on the right side of FIG. 4. In addition, if it is determined in S130 that there is no overlap in the times AT for which multiple remote assistance is scheduled to be executed (S130: NO), then there is no need to execute the selection of the autonomous vehicle 60 (S140) and the adjustment process (S150), so both processes are skipped and an instruction to execute remote assistance in accordance with the execution schedule for each remote assistance (S160) is similarly issued.
[0039] Thereafter, the remote monitoring and assistance management unit 211 (FIG. 2) of the remote monitoring and assistance management server 20 judges whether an instruction to end the remote monitoring and assistance management process has been given (S170). If it is judged in S170 that an instruction to end the remote monitoring and assistance management process has not been given (S170: NO), the above-mentioned processes from S100 onwards are repeatedly executed. On the other hand, if it is judged in S170 that an instruction to end the remote monitoring and assistance management process has been given (S170: YES), the remote monitoring and assistance management unit 211 of the remote monitoring and assistance management server 20 ends the remote monitoring and assistance management process.
[0040] A-3. Advantages of this embodiment: As described above, the remote monitoring and assistance management server 20 of this embodiment is an information processing device for remote assistance for a plurality of autonomous vehicles 60. The remote monitoring and assistance management server 20 includes an assistance schedule information acquisition unit 213, an adjustment processing unit 215, and an assistance execution instruction unit 217. The assistance schedule information acquisition unit 213 acquires assistance schedule information Ia indicating the execution schedule of remote assistance for each autonomous vehicle 60. When the execution schedule times AT of a plurality of remote assistances specified by the assistance schedule information Ia overlap with each other at a specific time, the adjustment processing unit 215 performs an adjustment process to eliminate the need for remote assistance for the selected autonomous vehicle 60 at the specific time by adjusting the movement operation of at least one autonomous vehicle 60 selected from the autonomous vehicles 60 that are targets of remote assistance whose execution schedule times overlap with each other. The assistance execution instruction unit 217 instructs the remote monitoring and assistance device 30 to execute remote assistance according to the execution schedule of remote assistance after the adjustment process.
[0041] In this way, according to the remote monitoring and assistance management server 20 of this embodiment, when the times AT when multiple remote assistances are scheduled to be performed overlap with each other at a specific time, an adjustment process is executed to make remote assistance unnecessary for the selected autonomous vehicle 60 at the specific time by adjusting the movement operation of at least one selected autonomous vehicle 60. Therefore, according to the remote monitoring and assistance management server 20 of this embodiment, it is possible to prevent multiple remote assistances from being concentrated at a specific time, and as a result, it is possible to reduce the burden on a single observer MO when the observer MO provides remote assistance to multiple autonomous vehicles 60.
[0042] Moreover, the remote monitoring and assistance management server 20 of this embodiment further includes a selection unit 216 that selects the autonomous vehicle 60 to be the target of movement operation adjustment in accordance with preset rules. Therefore, the remote monitoring and assistance management server 20 of this embodiment can select an appropriate autonomous vehicle 60 as the target of movement operation adjustment in accordance with preset rules. Therefore, the remote monitoring and assistance management server 20 of this embodiment can reduce the impact on the autonomous driving of each autonomous vehicle 60 while reducing the burden on the observer MO when one observer MO remotely assists multiple autonomous vehicles 60 by preventing multiple remote assistance from being concentrated at a specific time.
[0043] The remote monitoring and assistance management server 20 of this embodiment further includes a vehicle information acquisition unit 212 that acquires vehicle information Iv indicating the state of each autonomous vehicle 60 including at least the speed. The adjustment of the movement operation includes decelerating or accelerating the selected autonomous vehicle 60. The rule includes a rule that preferentially selects an autonomous vehicle 60 that has a relatively small speed change associated with the adjustment of the movement operation. Therefore, the remote monitoring and assistance management server 20 of this embodiment can prevent the speed change of the autonomous vehicle 60 from becoming excessive due to the adjustment of the movement operation. Therefore, the remote monitoring and assistance management server 20 of this embodiment can effectively reduce the impact on the autonomous driving of each autonomous vehicle 60 by reducing the burden on the monitor MO when one monitor MO remotely assists multiple autonomous vehicles 60 by suppressing the concentration of multiple remote assistance at a specific time.
[0044] The remote monitoring and assistance management server 20 of this embodiment further includes a delay information acquisition unit 214 that acquires delay information Id indicating a delay from the scheduled travel time of each autonomous vehicle 60. The adjustment of the travel operation includes decelerating or changing the route of the selected autonomous vehicle 60. The rule includes a rule that preferentially selects an autonomous vehicle 60 with a relatively small delay specified by the delay information Id. Therefore, the remote monitoring and assistance management server 20 of this embodiment can prevent the delay from becoming excessive from the scheduled travel time of the autonomous vehicle 60 due to the adjustment of the travel operation. Therefore, the remote monitoring and assistance management server 20 of this embodiment can effectively reduce the impact on the autonomous travel of each autonomous vehicle 60 by reducing the burden on the monitor MO when one monitor MO remotely assists multiple autonomous vehicles 60 by preventing multiple remote assistance from being concentrated at a specific time.
[0045] B. Variations: The technology disclosed in this specification is not limited to the above-described embodiments, and can be modified in various forms without departing from the spirit of the invention. For example, the following modifications are also possible.
[0046] The configuration of the remote monitoring and assistance system 10 in the above embodiment is merely an example and can be modified in various ways. For example, in the above embodiment, the remote monitoring and assistance management server 20 and each remote monitoring and assistance device 30 are connected to be able to communicate with each other via the internal network 82, but the remote monitoring and assistance management server 20 and each remote monitoring and assistance device 30 may be connected to be able to communicate with each other via an external network such as the Internet. In addition, the remote monitoring and assistance management server 20 may have a function as a remote monitoring and assistance device, and the monitor MO may use the remote monitoring and assistance management server 20 to remotely monitor and assist the autonomous vehicle 60.
[0047] In each of the above embodiments, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware.
[0048] The contents of the remote monitoring and assistance management process in the above embodiment are merely examples and can be modified in various ways. For example, in the above embodiment, the vehicle information Iv indicating the state of each autonomous vehicle 60 includes information indicating the current position, planned driving route, and speed of the autonomous vehicle 60, but the vehicle information Iv only needs to include information indicating at least the position of the autonomous vehicle 60, and may not include information indicating at least one of the current position and planned driving route of the autonomous vehicle 60, or may include information indicating other states of the autonomous vehicle 60.
[0049] In the above embodiment, a process for acquiring vehicle information Iv (S100) and a process for acquiring delay information Id (S110) are executed, but if that information is not used, for example, to select an autonomous vehicle 60 whose movement operation is to be adjusted, then the above processes do not need to be executed.
[0050] The method of selecting the autonomous vehicles 60 whose movement operations are to be adjusted in the above embodiment is merely an example, and various modifications are possible. For example, each of the autonomous vehicles 60 that are targets of remote monitoring and assistance may be ranked in advance, and the autonomous vehicles 60 whose movement operations are to be adjusted may be selected according to the ranking. Also, no rules may be set in advance, and the autonomous vehicles 60 whose movement operations are to be adjusted may be selected randomly.
[0051] In the above embodiment, the adjustment process (S150 in FIG. 3) is performed so that only one remote assistance is executed at the same time, but the aspect of the adjustment process is not limited to this. In other words, if the number of remote assistances executed at the same time can be reduced by the adjustment process, the number of remote assistances executed at the same time after the adjustment process does not necessarily have to be one. For example, as in the example shown in FIG. 4, if three remote assistances were to be executed at the same time in an overlapping manner before the adjustment process, an adjustment process may be performed to shift the time of one remote assistance or to make it unnecessary to execute it. Even in this way, the number of remote assistances executed at the same time can be reduced to two, and the burden on the supervisor MO can be reduced.
[0052] In addition, while the above embodiment has been described using remote assistance for multiple autonomous vehicles 60 as an example, the technology disclosed in this specification is similarly applicable to remote assistance for moving bodies other than autonomously traveling vehicles, such as autonomously traveling robots. [Explanation of symbols]
[0053] 10: Remote monitoring and assistance system 20: Remote monitoring and assistance management server 30: Remote monitoring and assistance device 32: Display device 40: Network communication device 60: Autonomous driving vehicle 62: Autonomous driving control unit 64: Communication unit 66: Sensor 68: Driving unit 82: Internal network 84: External network 210: Control unit 211: Remote monitoring and assistance management unit 212: Vehicle information acquisition unit 213: Assistance schedule information acquisition unit 214: Delay information acquisition unit 215: Adjustment processing unit 216: Selection unit 217: Assistance execution instruction unit 220: Memory unit 221: Map information 230: Display unit 240: Operation input unit 250: Interface unit 290: Bus CP: Remote monitoring and assistance management program MO: Monitor
Claims
1. An information processing device for remote assistance to a plurality of autonomous moving objects monitored by a single monitor, comprising: an assistance schedule information acquisition unit that acquires assistance schedule information indicating an execution schedule of the remote assistance for each of the autonomous moving bodies; an adjustment processing unit that performs, when the execution schedule times of the plurality of remote assistances specified by the assistance schedule information overlap with each other at a specific time, an adjustment process that adjusts a movement operation of at least one of the autonomous moving bodies selected from among the autonomous moving bodies that are targets of the remote assistances whose execution schedule times overlap with each other, thereby making the remote assistance unnecessary for the selected autonomous moving body at the specific time; an assistance execution instruction unit that instructs a remote assistance device to execute the remote assistance according to the execution schedule of the remote assistance after the adjustment process; a selection unit that selects the autonomous moving body that is to be a target of the adjustment of the moving operation in accordance with a preset rule; a vehicle information acquisition unit that acquires vehicle information indicating a state including at least a speed of each of the autonomous moving bodies; Equipped with The adjustment of the movement operation includes slowing down or accelerating the selected autonomous moving body; The information processing device, wherein the rules include a rule that preferentially selects the autonomous moving body that has a relatively small change in speed due to the adjustment of the moving operation.
2. The information processing device according to claim 1, further comprising: a delay information acquisition unit that acquires delay information indicating a delay from a scheduled operation time of each of the autonomous moving bodies, Adjusting the movement operation includes slowing down or rerouting the selected autonomous moving body; The information processing device, wherein the rule includes a rule that the autonomous moving body having a relatively small delay specified by the delay information is preferentially selected.
3. An information processing method for remote assistance for a plurality of autonomous moving objects monitored by a same monitor, comprising: acquiring assistance schedule information indicating an execution schedule of the remote assistance for each of the autonomous moving bodies; performing an adjustment process for making the remote assistance unnecessary for the selected autonomous moving body at the specific time by adjusting a movement operation of at least one of the autonomous moving bodies that are targets of the remote assistance whose execution scheduled times overlap each other, when the execution scheduled times of the multiple remote assistances specified by the assistance schedule information overlap each other at the specific time; instructing a remote assistance device to execute the remote assistance according to the execution schedule of the remote assistance after the adjustment process; selecting the autonomous moving body to be a target of the adjustment of the moving operation in accordance with a preset rule; acquiring vehicle information indicating a state including at least a speed of each of the autonomous moving bodies; Equipped with The adjustment of the movement operation includes slowing down or accelerating the selected autonomous moving body; The information processing method, wherein the rule includes a rule that preferentially selects the autonomous moving body that experiences a relatively small change in speed due to the adjustment of the moving operation.
4. A computer program for remote assistance for a plurality of autonomous moving objects monitored by a same monitor, comprising: On the computer, A process of acquiring assistance schedule information indicating an execution schedule of the remote assistance for each of the autonomous moving bodies; an adjustment process for making the remote assistance unnecessary for the selected autonomous moving body at the specific time by adjusting a movement operation of at least one of the autonomous moving bodies that are targets of the remote assistance whose execution planned times overlap each other, when the execution planned times of the multiple remote assistances specified by the assistance schedule information overlap each other at the specific time; a process of instructing a remote assistance device to execute the remote assistance according to the execution schedule of the remote assistance after the adjustment process; A process of selecting the autonomous moving body to be a target of the adjustment of the moving operation in accordance with a preset rule; A process of acquiring vehicle information indicating a state including at least a speed of each of the autonomous moving bodies; Run the command, The adjustment of the movement operation includes slowing down or accelerating the selected autonomous moving body; The computer program, wherein the rule includes a rule that preferentially selects the autonomous moving body that experiences a relatively small change in speed due to the adjustment of the moving operation.
Citation Information
Patent Citations
Remote control device, remote control method, and remote control program
JP2018140755A
Control device, control method, control program and control system
JP2019021200A
Remote driving management device and program
JP2019168893A
Vehicle remote control system, vehicle control device, vehicle, and method for notifying start timing of remote control
JP2020005123A
Information processing method, information processor and information processing system
JP2020021453A
