Travel assistance device, autonomous vehicle, travel assistance method, and recording medium
The driving support device addresses high monitoring loads in control centers by allowing autonomous vehicles to execute manual operations detected on preceding vehicles, thereby reducing the need for continuous central oversight.
Patent Information
- Application Number
- PCT/JP2025/017708
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-15
- Publication Date
- 2026-11-19
AI Technical Summary
Existing systems for managing autonomous driving vehicles face high monitoring loads at control centers due to restrictions on route changes for vehicles like buses or service vehicles, which cannot effectively reduce this load without altering routes.
A driving support device that detects manual operations on autonomous vehicles, stores the operation details, and transmits them to subsequent vehicles to perform equivalent actions, reducing the need for central control center intervention.
This approach reduces the monitoring load on control centers by enabling autonomous vehicles to handle manual operations independently, thus minimizing the need for continuous central oversight.
Smart Images

Figure JP2025017708_19112026_PF_FP_ABST
Abstract
Description
Driving support device, autonomous driving vehicle, driving support method, and recording medium
[0001] The present disclosure relates to a driving support device, an autonomous driving vehicle, a driving support method, and a recording medium.
[0002] A control center that monitors a plurality of autonomous driving vehicles and provides driving support by an operator as needed is known. For example, Patent Document 1 discloses a vehicle travel route control system that can reduce the system monitoring load by calculating a route that improves the travel reliability of the travel route when a plurality of dispatched vehicles are centrally managed. This vehicle travel route control system creates a travel route map indicating the driving mode switching position where the mode is switched to the manual driving mode during travel in the autonomous driving mode. Then, this vehicle travel route control system calculates a travel route that avoids the driving mode switching position from among a plurality of routes along which candidate dispatched vehicles travel to the destination, and sets the route for the dispatched vehicle.
[0003] International Publication No. 2020 / 194062
[0004] In the above-described vehicle travel route control system, the monitoring load is reduced by causing the autonomous driving vehicle to avoid the driving mode switching position. However, when the autonomous driving vehicle is a route bus or various service vehicles, there is a problem that the monitoring load of the control center cannot be reduced because there are restrictions on route changes.
[0005] An object of the present disclosure is to provide a driving support device, a driving support method, and a recording medium that can reduce the monitoring load of a control center without relying on route changes.
[0006] According to a first aspect, there is provided a driving support device comprising: a detection unit that detects that a manual operation has been performed on an autonomous driving vehicle; a storage unit that acquires and stores the content and execution position of the manual operation; and an instruction unit that transmits the content and execution position of the manual operation to a second autonomous driving vehicle scheduled to travel in a section including the execution position, and causes the second autonomous driving vehicle to execute content equivalent to the manual operation at the execution location.
[0007] From a second perspective, an autonomous vehicle is provided that includes detection means for detecting when a manual operation is performed on the vehicle, and storage means for storing the content and location of the manual operation in a predetermined driving support device.
[0008] From a third perspective, an autonomous vehicle is provided that receives the content and location of the manual operation from the aforementioned driving support device and is capable of performing the manual operation at the location.
[0009] From a fourth perspective, a driving assistance method is provided that detects when a manual operation is performed on an autonomous vehicle, acquires and saves the content and location of the manual operation, transmits the content and location of the manual operation to a second autonomous vehicle scheduled to travel in the section including the location of the operation, and causes the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation.
[0010] From a fifth perspective, a recording medium is provided that records a program that performs the following: a process for detecting when a manual operation is performed on an autonomous vehicle; a process for acquiring and saving the content and location of the manual operation; and a process for transmitting the content of the manual operation to a second autonomous vehicle scheduled to travel in the section including the location of the operation, causing the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation.
[0011] According to this disclosure, it is possible to provide a driving assistance device, an autonomous vehicle, a driving assistance method, and a recording medium that can reduce the monitoring load on the control center without relying on route changes.
[0012] This figure shows one configuration of the present disclosure. This is a flowchart illustrating the operation of the present disclosure. This is a diagram for explaining the operation of the present disclosure. This figure shows another configuration of the present disclosure. This figure shows an example of data stored by the driver assistance system of the present disclosure. This is a sequence diagram illustrating the operation of the present disclosure. This is another sequence diagram illustrating the operation of the present disclosure. This is another sequence diagram illustrating the operation of the present disclosure. This figure shows another configuration of the present disclosure. This figure shows the configuration of the autonomous vehicle of the present disclosure. This is another sequence diagram illustrating the operation of the present disclosure. This is another sequence diagram illustrating the operation of the present disclosure. This figure shows another configuration of the present disclosure. This is another sequence diagram illustrating the operation of the present disclosure. This figure shows the configuration of the computer constituting the driver assistance system or autonomous vehicle of the present disclosure.
[0013] First, an overview of one embodiment of this disclosure will be described with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. The reference numerals in the drawings appended to this overview are provided for convenience as examples to aid understanding and are not intended to limit this disclosure to the illustrated embodiments. In addition, the connecting lines between blocks in the drawings and other references referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as needed. This computer device is also configured to communicate with devices (including computers) inside or outside the device via the communication interface, whether wired or wireless. In addition, there are ports or interfaces at the input / output connection points of each block in the figures, but these are omitted from the illustration.
[0014] In one embodiment, this disclosure can be realized by a driving support device 10 comprising a detection means 11, a storage means 12, and an instruction means 13, as shown in Figure 1. More specifically, the detection means 11 detects when a manual operation is performed on an autonomous vehicle. Whether or not a manual operation has been performed on the autonomous vehicle can be detected, for example, based on vehicle information received from the autonomous vehicle or information received from a control center that controls the autonomous vehicle.
[0015] The storage means 12 acquires and stores the content and location of the manual operation. The instruction means 13 transmits the content and location of the manual operation to the second autonomous vehicle, which is scheduled to travel in the section including the location of the operation, and instructs it to perform the content equivalent to the manual operation at the location of the operation.
[0016] The driving support device 10 configured as described above operates as follows. First, the driving support device 10 collects vehicle information, including the operating status of the autonomous vehicle V1 (step S01 in Figure 2).
[0017] Next, the driving support system 10 checks whether a manual operation (hereinafter also referred to as "manual intervention") has been performed (step S02 in Figure 2). If the check determines that a manual intervention has been performed, the driving support system 10 saves the details of the operation performed and the location where it was performed in the autonomous vehicle V1 (step S03 in Figure 2). If no manual intervention has been performed (No. in step S02 in Figure 2), the driving support system 10 does not save the details of the operation and the location where it was performed.
[0018] Once the saving of the operation details and execution location is complete, the driving support device 10 transmits the saved operation details and execution location to the target vehicle, i.e., the second autonomous vehicle scheduled to travel in the section including the execution location (step S04 in Figure 2).
[0019] Figure 3 is a diagram illustrating the operation of the present disclosure. For example, suppose a broken-down vehicle V0 is in the path of an autonomous vehicle V1, and manual intervention occurs at the control center CC. When the driving support device 10 detects the occurrence of manual intervention, it saves the operation details and the execution location P1. The driving support device 10 then transmits the saved operation details and execution location P1 to the autonomous vehicle V2, which is scheduled to travel through the section including the execution location P1. Upon receiving the operation details and execution location P1, the autonomous vehicle V2 executes the operation details received from the driving support device 10 when it reaches the execution location P1. As a result, the autonomous vehicle V2 can avoid the broken-down vehicle V0 without assistance from the control center CC. Consequently, according to the present disclosure, the monitoring load on the control center CC can also be reduced.
[0020] [First Embodiment] Next, a first embodiment in which a function is added to determine whether or not to perform a manual operation based on the cause of manual intervention in the autonomous vehicle V1 will be described in detail with reference to the drawings. Figure 4 is a diagram showing one configuration of the present disclosure. Referring to Figure 4, a driver assistance device 100 that can communicate with autonomous vehicles V1 and V2 is shown. Hereinafter, autonomous vehicle V2 will be described as an autonomous vehicle traveling in a section that overlaps with the preceding autonomous vehicle V1.
[0021] Autonomous vehicles V1 and V2 are equipped with a function to transmit vehicle information, including the operating status of autonomous vehicles V1 and V2, to the driver assistance system 100 at predetermined time intervals. This vehicle information includes information indicating that manual intervention has occurred, the details of the operation after the manual intervention, and information indicating the location where the manual intervention occurred. Autonomous vehicles V1 and V2 are also equipped with cameras C capable of photographing the area in front of or around the vehicle, and can provide images from the cameras C to the driver assistance system 100. The communication method between autonomous vehicles V1 and V2 and the driver assistance system 100 is not particularly limited, but communication means for controlling autonomous vehicles can be used. For example, autonomous vehicles V1 and V2 and the driver assistance system 100 can exchange this data via vehicle-to-infrastructure communication or a mobile communication network.
[0022] The driver assistance device 100 comprises a detection unit 101, a storage unit 102, an instruction unit 103, and an estimation unit 104. The driver assistance device 100 may also be equipment located in a control center that controls the autonomous vehicles V1 and V2.
[0023] The detection unit 101 receives vehicle information from the autonomous vehicle V1, and when it detects that manual intervention has occurred in the autonomous vehicle, it sends the vehicle information to the storage unit 102. Also, when the detection unit 101 detects that manual intervention has occurred, it requests the estimation unit 104 to estimate the cause of the manual operation. If the driver assistance device 100 is in cooperation with a control center, the detection unit 101 may receive notification from the control center on behalf of the autonomous vehicle V1 and detect that manual intervention has occurred in the autonomous vehicle. Such a detection unit 101 corresponds to the detection means 11 described above.
[0024] The storage unit 102 extracts and stores the details and location of the manual operation from the vehicle information. Such a storage unit 102 corresponds to the storage means 12 described above.
[0025] The estimation unit (estimation means) 104 estimates the cause of manual intervention based on images captured by the camera C received from the autonomous vehicle V1, and records it in the corresponding data in the storage unit 102. As the estimation unit 104 having such a function, a large-scale language model (LLM) or a VLM (Vision-Language Model) capable of estimating the cause of manual intervention using images as input can be used. Alternatively, instead of LLM or VLM, a lightweight SLM (Small Language Model) optimized for edge devices, or an SLM (Specialized Language Model) specialized for a specific domain or task can be used. Furthermore, the estimation unit 104 may use various scene estimation techniques to estimate scenes from images. In addition to images, the estimation unit 104 may also estimate scenes using vehicle information.
[0026] Figure 5 shows an example of data stored in the storage unit 102. In the example in Figure 5, each time a manual intervention occurs, data including its ID, date and time of occurrence, location, operation details, and estimated cause is stored. It is desirable for the storage unit 102 to delete such data after a predetermined period of time has elapsed. In most cases, the event that caused the manual intervention is not permanent and ends after a certain period of time. The timing of deletion may be set according to the cause of the manual intervention estimated by the estimation unit 104. Conversely, if the event that triggered the manual intervention is a long-term ongoing construction project, then changes to the driving course based on such an event can be incorporated into the regular route of the autonomous vehicle, and in that sense, data storage becomes unnecessary.
[0027] Furthermore, in a more desirable configuration, the storage unit 102 may set a data retention period for each estimated cause and delete the data after that period has elapsed. For example, as shown in Figure 5, if the estimated cause is avoiding a broken-down vehicle, the data for that ID can be deleted after one hour, and if the estimated cause is avoiding a pedestrian, the data for that ID can be deleted after five minutes.
[0028] The instruction unit 103 receives vehicle information and images from camera C from the autonomous vehicle V2. The instruction unit 103 also refers to the data stored in the storage unit 102 and the images from camera C to determine whether the autonomous vehicle V2 is located at a position where manual intervention occurred in the past and whether the event that caused the manual intervention is still ongoing. If, as a result of this determination, the autonomous vehicle V2 is located at a position where manual intervention occurred in the past and the event that caused the manual intervention is still ongoing, the instruction unit 103 determines that an operation equivalent to manual intervention is necessary. The instruction unit 103 then reads the content of the manual operation performed at that position and the location where the manual operation occurred from the storage unit 102 and transmits it to the autonomous vehicle V2. Such an instruction unit 103 corresponds to the instruction means 13 described above.
[0029] The autonomous vehicle V2 has a function that, upon receiving the content of the manual operation and the location where the manual operation occurred from the driver assistance device 100, performs the content of the manual operation at the location where the manual operation occurred.
[0030] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 6 is a sequence diagram showing the operation of this embodiment. In the following description, the autonomous vehicle V1 continues to transmit vehicle information to the driver assistance device 100. Now, let's assume that manual intervention occurs in the autonomous vehicle V1 for some reason (step S001).
[0031] When the driver assistance device 100 receives the vehicle information, it detects that manual intervention has occurred in the autonomous vehicle V1 (step S002), and adds data recording the date and time, operation details, and location of the operation to the storage unit 102 (step S003).
[0032] Furthermore, the driver assistance device 100 estimates the cause of the manual intervention in the autonomous vehicle V1 and records it in the corresponding data in the storage unit 102 (step S004).
[0033] As described above, when manual intervention occurs in the autonomous vehicle V1, the driver assistance system 100 records the estimated cause of the manual intervention along with the details of the manual operation.
[0034] Next, we will explain the operation when the contents of the manual operations recorded as described above are transferred to other autonomous vehicles. Figure 7 is another sequence diagram showing the operation of this embodiment. Referring to Figure 7, the driver assistance device 100 refers to the vehicle information of autonomous vehicle V2 and detects that autonomous vehicle V2 has approached a position where an operation equivalent to manual intervention is required (step S101). Whether or not autonomous vehicle V2 has approached a position where an operation equivalent to manual intervention is required can be determined by whether autonomous vehicle V2 has approached a position where manual intervention was performed in the past and whether the cause of the manual intervention is continuing. Note that even if the autonomous vehicle has approached a position where an operation equivalent to manual intervention is required, if the event that causes manual intervention is not continuing, manual intervention is not required, and the subsequent processing can be omitted.
[0035] If the autonomous vehicle V2 determines that an operation equivalent to manual intervention is required, the driver assistance device 100 reads the content of the manual operation performed at that location and the location where the manual operation occurred from the storage unit 102 and transmits it to the autonomous vehicle V2 (step S102). Upon receiving the content of the manual operation and the location where the manual operation occurred, the autonomous vehicle V2 performs the content of the manual operation at the location specified by the driver assistance device 100 (step S103).
[0036] As a result, it becomes possible to have the autonomous vehicle V2 perform operations equivalent to manual intervention without going through a control center or the like. Consequently, this disclosure can reduce the monitoring workload of the control center.
[0037] Furthermore, if it is determined in step S102 that manual intervention is unnecessary, the driver assistance device 100 may delete the corresponding data from the storage unit 102. Doing so will prevent the transmission of instructions based on that data thereafter.
[0038] Furthermore, depending on the situation in which the autonomous vehicle V2 is located and the nature of the manual driving, it may not be appropriate to perform an operation equivalent to manual intervention. In a more desirable configuration, the driver assistance device 100 may have a function to suggest to the autonomous vehicle V2 a route change that bypasses the location where the manual operation was performed. Figure 8 is another sequence diagram showing the operation of this embodiment. Referring to Figure 8, the driver assistance device 100 refers to the vehicle information of the autonomous vehicle V2 and detects that the autonomous vehicle V2 is approaching a location where a route change (detour) is necessary (step S101a). Whether or not the autonomous vehicle V2 is approaching a location where a route change is necessary can be determined by whether the autonomous vehicle V2 is approaching a location where manual intervention has been performed in the past, but the autonomous vehicle V2 is in a situation where it cannot respond with an operation equivalent to manual intervention.
[0039] If the autonomous vehicle V2 determines that it is approaching a location where a route change is necessary, the driver assistance device 100 transmits a route change instruction to the autonomous vehicle V2 (step S102a). Upon receiving the route change instruction, the autonomous vehicle V2 performs the route change (step S103a).
[0040] As described above, the driving support device 100 of the present disclosure can select a route change and cause the autonomous vehicle V2 to execute the route change depending on the environment in which the autonomous vehicle V2 is placed. As a result, the present disclosure can reduce the monitoring load of the control center.
[0041] [Second Embodiment] In the first embodiment described above, the driving support device 100 determines whether to cause the autonomous vehicle V2 to perform an operation equivalent to manual intervention, but the autonomous vehicle side may be allowed to determine whether to perform an operation equivalent to manual intervention. Hereinafter, a second embodiment in which the autonomous vehicle side is configured to determine whether to perform an operation equivalent to manual intervention will be described. Figure 9 is a diagram showing another configuration of the present disclosure. The first difference from the first embodiment shown in Figure 4 is that the driving support device 100a transmits data at the time of manual intervention occurrence to the autonomous vehicle 200 that has approached the location where the manual intervention occurred. In addition, the second difference from the first embodiment is that the autonomous vehicle 200 is added with a function of determining whether to perform an operation equivalent to manual intervention. Since the other configurations are substantially the same as those of the first embodiment, the following description will focus on the differences.
[0042] The instruction unit 103a of the driving support device 100a refers to the data stored in the storage unit 102, and transmits the data at the time of manual intervention occurrence (manual intervention data) to the autonomous vehicle 200 that has approached the location where the manual intervention occurred. The data at the time of manual intervention occurrence includes the date and time of manual intervention occurrence, the occurrence position, the operation content, the estimated cause, and the like.
[0043] Figure 10 is a diagram showing the configuration of the autonomous vehicle of the present disclosure. Referring to Figure 10, an autonomous vehicle 200 including a transmission / reception unit 201, an analysis unit 202, and an execution unit 203 is shown.
[0044] The transmission / reception unit 201 transmits vehicle information including the operating state of the autonomous vehicle 200 and images captured by the camera C to the driving support device 100a. Further, when the transmission / reception unit 201 receives manual intervention data from the driving support device 100a, it sends the received manual intervention data to the analysis unit 202.
[0045] The analysis unit 202 analyzes the manual intervention data received from the driving support device 100a, determines whether to execute the content of manual intervention that was performed by another vehicle in the past, and sends the result to the execution unit 203. Specifically, the analysis unit 202 determines whether a situation similar to the estimated cause of manual intervention included in the manual intervention data has occurred in the host vehicle. For example, when receiving the first manual intervention data in FIG. 5, the analysis unit 202 determines whether it is necessary to avoid a broken-down vehicle at the position where the manual intervention occurs. Whether it is necessary to avoid a broken-down vehicle can be determined from the image of the camera C, the position and travel path of the vehicle, and the like. For example, when there is no broken-down vehicle at the corresponding position, the analysis unit 202 determines that execution of the first manual intervention data in FIG. 5 is unnecessary. On the other hand, when there is a broken-down vehicle at the corresponding position, the analysis unit 202 determines that the content of the first manual intervention data in FIG. 5 should be executed.
[0046] The execution unit 203 executes the content of the manual intervention according to the determination result from the analysis unit 202 on whether to execute the content of the manual intervention that was performed by another vehicle in the past.
[0047] Subsequently, the operation of the present embodiment will be described in detail with reference to the drawings. FIG. 11 is another sequence diagram illustrating the operation of the present embodiment. Since basic operations such as collection of manual intervention data are the same as those in the first embodiment, the following description will focus on the differences.
[0048] Referring to FIG. 11, first, the driving support device 100a refers to the vehicle information of the autonomous driving vehicle 200 to detect that the autonomous driving vehicle 200 has approached a position where an operation equivalent to manual intervention is required (step S201). Next, the manual intervention data is transmitted to the autonomous driving vehicle 200 (step S202).
[0049] The autonomous driving vehicle 200 that has received the manual intervention data determines whether an operation equivalent to manual intervention is required, that is, whether to execute the content of manual intervention that was performed by another vehicle in the past (step S203). As a result of the determination, when it is determined that an operation equivalent to manual intervention is required, the autonomous driving vehicle 200 executes the operation content equivalent to manual intervention using the received manual intervention data (step S204).
[0050] Regardless of whether or not a vehicle operation equivalent to manual intervention is performed, vehicle information is transmitted from the autonomous vehicle 200 to the driver assistance device 100a. Therefore, the driver assistance device 100a can confirm from the vehicle information whether or not a vehicle operation equivalent to manual intervention was performed in the autonomous vehicle 200. If no vehicle operation equivalent to manual intervention was performed in the autonomous vehicle 200, the driver assistance device 100a may delete the corresponding manual intervention data from the storage unit 102. By doing so, it becomes possible to suppress the transmission of the manual intervention data thereafter.
[0051] Furthermore, in this embodiment as well, depending on the circumstances in which the autonomous vehicle 200 is located and the nature of the manual driving, it may not be appropriate to perform an operation equivalent to manual intervention. Figure 12 is another sequence diagram showing the operation of this embodiment. In this case, the autonomous vehicle 200 determines whether a route change (detour) is necessary based on the manual intervention data and the status of its own vehicle (step S203a). If the determination results in a route change (detour) being deemed necessary, the autonomous vehicle 200 performs a route change (detour) (step S204a).
[0052] As described above, the driver assistance device 100a of this disclosure can cause the autonomous vehicle 200 to determine whether or not a route change is necessary, and to carry out a route change according to the result.
[0053] [Third Embodiment] In the first embodiment described above, the manual intervention detection function was located on the driver assistance device side, but the manual intervention detection function can also be located on the autonomous vehicle side. Figure 13 shows another configuration of the present disclosure. The difference from the first embodiment shown in Figure 4 is that the detection unit 301 and the estimation unit 304 are located on the autonomous vehicle 300 side. The other configurations are almost the same as in the first embodiment, so the differences will be explained below.
[0054] When the detection unit 101 of the autonomous vehicle 300 detects that manual intervention has occurred in the vehicle, it requests the estimation unit 304 to estimate the cause of the manual operation. Upon receiving the cause of the manual operation from the estimation unit 304, the detection unit 101 transmits the details of the manual operation, the location where it was performed, and the cause of the manual operation to the transmission / reception unit 302.
[0055] Similar to the estimation unit 104, the estimation unit 304 estimates the cause of manual intervention based on images captured by the camera C mounted on the autonomous vehicle 300, and sends the estimation result to the detection unit 101.
[0056] The transmitting / receiving unit 302 transmits the details of the manual operation, the location where it was performed, and the reason why the manual operation was performed to the driving support device 100b, and stores this information in the storage unit 102 of the driving support device 100b.
[0057] When the implementation unit 303 receives the content of the manual operation and the location where the manual operation occurred from the driving support device 100b, it performs the content of the manual operation at the location where the manual operation occurred.
[0058] The operation of the driver assistance device 100b is the same as in the first embodiment, and the driver assistance device 100b transmits the content of the manual operation and the location where the manual operation occurred to the autonomous vehicle V2 at an appropriate timing.
[0059] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 14 is another sequence diagram showing the operation of this embodiment. Referring to Figure 14, first, the autonomous vehicle 300 detects that manual intervention has occurred in its own vehicle (step S301). Then, the autonomous vehicle 300 transmits data to the driver assistance device 100b that records the date and time, the operation content, and the location where it was performed (step S302).
[0060] Furthermore, the autonomous vehicle 300 estimates the cause of the manual intervention that occurred in its own vehicle (step S303) and transmits this information to the driver assistance device 100b (step S304). The subsequent operations are the same as in the first embodiment (see Figure 7), so the explanation is omitted.
[0061] As explained above, this disclosure can be implemented without any problems even when the detection unit 301 is located on the autonomous vehicle side. In particular, in this embodiment, since the manual intervention data collection function is located on the autonomous vehicle side, there is an advantage that the driver assistance device 100b can concentrate on distributing the manual intervention data.
[0062] While the embodiments of this disclosure have been described above, this disclosure is not limited to the embodiments described above, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of this disclosure. For example, the network configurations, element configurations, and data representations shown in the drawings are examples to aid in understanding this disclosure and are not limited to the configurations shown in these drawings.
[0063] For example, in the first and second embodiments described above, the autonomous vehicle V2 was described as an autonomous vehicle that travels in a section that overlaps with that of autonomous vehicle V1. However, autonomous vehicles V1 and V2 may be route buses or shuttle buses that travel on the same route. In the case of route buses or shuttle buses, basically all services travel on the same route. If manual intervention occurs for any reason, it is highly likely that the immediately following service will also be affected by the same event. By using this disclosure, it is possible to automatically apply the content of the manual intervention to subsequent services. In particular, when the interval between services is short, the load on the control center tends to increase. This disclosure can greatly reduce the load on the control center in such cases. Also, autonomous vehicles V1 and V2 may be the same route bus or shuttle bus that circulates on a predetermined route. In this case, autonomous vehicle V1, which is performing the nth circulating service, may perform the (n+1)th service or later, and in that case, autonomous vehicle V1 may become a second autonomous vehicle V2 that is scheduled to travel in the section including the implementation location.
[0064] The autonomous vehicle 300 of the third embodiment described above may be further enhanced with a function equivalent to the analysis unit 202 of the second embodiment. In this case, the driver assistance device 100b will transmit manual intervention data to the autonomous vehicle 300, and the autonomous vehicle 300 will determine whether or not to perform an operation equivalent to manual intervention.
[0065] (Regarding Hardware Configuration) In each embodiment of this disclosure, each component of each device represents a functional unit block. Some or all of each component of each device is realized by any combination of an information processing device 900 and a program, for example, as shown in Figure 15. Figure 15 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: ・CPU (Central Processing Unit) 901 ・ROM (Read Only Memory) 902 ・RAM (Random Access Memory) 903 ・Program 904 loaded into RAM 903 ・Storage device 905 that stores the program 904 ・Drive device 907 that reads and writes to the recording medium 906 ・Communication interface 908 that connects to a communication network 909 ・Input / output interface 910 that performs data input and output ・Bus 911 that connects each component
[0066] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes these functions. That is, the CPU 901 in Figure 15 executes a manual intervention data collection program and a manual intervention data expansion program, and performs update processing of each calculation parameter held in RAM 903, storage device 905, etc. The program 904 that realizes the functions of each component of each device is, for example, stored in storage device 905 or ROM 902 in advance and read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via a communication network 909, or it may be stored in a recording medium 906 in advance, and the drive device 907 may read the program and supply it to the CPU 901.
[0067] There are various variations in how each device is implemented. For example, each device may be implemented by any combination of a separate information processing device 900 and a program for each component. Alternatively, multiple components of each device may be implemented by any combination of a single information processing device 900 and a program. In other words, each part (processing means, function) of the above-described driving support device can be implemented by a computer program that causes a processor mounted on the device to execute the above-described processes using its hardware.
[0068] Furthermore, some or all of the components of each device are realized by other general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be made up of a single chip or multiple chips connected via a bus.
[0069] Some or all of the components of each device may be realized by a combination of the circuits and programs described above.
[0070] When some or all of the components of each device are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-and-server system or a cloud computing system.
[0071] The embodiments described above are preferred embodiments of this disclosure and do not limit the scope of this disclosure to these embodiments alone. That is, a person skilled in the art can modify or substitute the embodiments described above to construct various modified forms without departing from the gist of this disclosure.
[0072] Some or all of the above embodiments may also be described as follows, but are not limited to these.
[0073] [Note 1] A driving support device comprising: detection means for detecting when a manual operation is performed on an autonomous vehicle; storage means for acquiring and saving the content and location of the manual operation; and instruction means for transmitting the content and location of the manual operation to a second autonomous vehicle scheduled to travel in a section including the location of the operation, and causing the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation. [Note 2] The detection means of the above-described driving support device may be configured to detect when a manual operation is performed on the autonomous vehicle based on vehicle information received from the autonomous vehicle or information received from a control center that controls the autonomous vehicle. [Note 3] The above-described driving support device further comprises estimation means for estimating the cause of the manual operation, and the instruction means may be configured to determine whether or not to transmit the content of the manual operation to the second autonomous vehicle based on the cause of the manual operation. [Note 4] If the instruction means of the above-described driving support device determines not to transmit the content of the manual operation, it may be configured to delete the content and location of the manual operation stored in the storage means. [Note 5] The instruction means of the above-described driving support device may further be configured to instruct the second autonomous vehicle to change to a route that bypasses the location where the manual operation was performed, based on the cause of the manual operation or the content of the manual operation. [Note 6] The above-described driving support device may further be equipped with an estimation means for estimating the cause of the manual operation, and the instruction means may be configured to transmit the cause of the manual operation to the second autonomous vehicle and cause the second autonomous vehicle to decide whether or not to perform the content of the manual operation. [Note 7] If the content of the manual operation is not performed by the second autonomous vehicle, the above-described driving support device may be configured to delete the content of the manual operation and the location where it was performed stored in the storage means. [Note 8] The above-described driving support device may be configured to cause the second autonomous vehicle to decide whether or not to bypass the location where the manual operation was performed, based on the cause of the manual operation or the content of the manual operation.[Note 9] The storage means of the above-described driving support device may be configured to delete data after a predetermined time has elapsed since storage. [Note 10] An autonomous vehicle comprising: detection means for detecting that a manual operation has been performed on the vehicle itself; and storage means for storing the content and location of the manual operation in a predetermined driving support device. [Note 11] An autonomous vehicle that receives the content and location of the manual operation from the above-described driving support device and is capable of performing the content of the manual operation at the location. [Note 12] An autonomous vehicle comprising: a transmitting and receiving unit for receiving the content of the manual operation, the location of the operation and the cause of the manual operation from the above-described driving support device; an analysis unit for determining whether or not to perform the content of the manual operation based on whether or not the event that caused the manual operation is continuing; and an implementation unit for performing the content of the manual operation at the location. [Note 13] A driving assistance method that detects when a manual operation is performed on an autonomous vehicle, acquires and saves the content and location of the manual operation, transmits the content and location of the manual operation to a second autonomous vehicle scheduled to travel in a section including the location of the operation, and causes the second autonomous vehicle to perform an action equivalent to the manual operation at the location of the operation. [Note 14] A recording medium that records a program that performs the following: a process for detecting when a manual operation is performed on an autonomous vehicle, a process for acquiring and saving the content and location of the manual operation, and a process for transmitting the content and location of the manual operation to a second autonomous vehicle scheduled to travel in a section including the location of the operation, and causes the second autonomous vehicle to perform an action equivalent to the manual operation at the location of the operation. The forms described in each of the above notes can be combined with each other after making the necessary modifications. For example, a configuration that combines the content described in Note 2 and the content described in Note 3 is also included in the scope of disclosure of this specification. In this case, the driving support system detects that manual operation has been performed on the autonomous vehicle based on information received from the control center, and decides whether or not to send an instruction to the second autonomous vehicle based on the estimated cause of the manual operation. The forms described in appendices 11 to 12 above can be expanded to the forms described in appendices 2 to 8, similar to appendice 1.
[0074] Furthermore, each disclosure in the above-mentioned patent documents is incorporated into this document by reference and may be used as the basis or part of this disclosure as necessary. Within the framework of this disclosure (including the claims), further modifications and adjustments to the embodiments or examples are possible based on their fundamental technical concept. Also, within the framework of this disclosure, various combinations or selections (including partial deletions) of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, this disclosure naturally includes the entire disclosure, including the claims, and various modifications and alterations that a person skilled in the art could make in accordance with the technical concept. In particular, with respect to the numerical ranges described in this document, any numerical value or sub-range included within that range should be interpreted as being specifically described, even if not otherwise stated. Furthermore, each disclosure item of the above-mentioned cited documents may, as necessary, be used in part or in whole as part of this disclosure, in accordance with the spirit of this disclosure, and this is also considered to be included in the disclosure items of this application.
[0075] 10, 100, 100a, 100b Driving support device 11 Detection means 12 Storage means 13 Instruction means 101, 302 Detection unit 102 Storage unit 103, 103a Instruction unit 104, 304 Estimation unit 200, 300, V1, V2 Autonomous vehicle 201, 302 Transmit / receive unit 202 Analysis unit 203, 303 Implementation unit 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / Output interface 911 Bus C Camera CC Control center V0 Broken down vehicle
Claims
1. A driving support device comprising: detection means for detecting when a manual operation is performed on an autonomous vehicle; storage means for acquiring and saving the content and location of the manual operation; and instruction means for transmitting the content and location of the manual operation to a second autonomous vehicle scheduled to travel in a section including the location of the operation, and causing the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation.
2. The driving support device according to claim 1, wherein the detection means detects that a manual operation has been performed on the autonomous vehicle based on vehicle information received from the autonomous vehicle or information received from a control center that controls the autonomous vehicle.
3. The driving support device according to claim 1 or 2, further comprising estimation means for estimating the cause of the manual operation, wherein the instruction means determines whether or not to transmit the content of the manual operation to the second autonomous vehicle based on the cause of the manual operation.
4. The driving support device according to claim 3, wherein if the instruction means determines that it is not to transmit the content of the manual operation, it deletes the content of the manual operation and the execution position stored in the storage means.
5. The driving support device according to claim 3 or 4, wherein the instruction means further instructs the second autonomous vehicle to change to a route that bypasses the location where the manual operation was performed, based on the cause of the manual operation or the content of the manual operation.
6. The driving support device according to claim 1 or 2, further comprising estimation means for estimating the cause of the manual operation, wherein the instruction means transmits the cause of the manual operation to the second autonomous vehicle and causes the second autonomous vehicle to decide whether or not to perform the manual operation.
7. The driving support device according to claim 6, wherein if the contents of the manual operation are not performed by the second autonomous vehicle, the contents of the manual operation and the location in which it was performed stored in the storage means are deleted.
8. The driving support device according to claim 6 or 7, which causes the second autonomous vehicle to determine whether or not to bypass the location where the manual operation was performed, based on the cause of the manual operation or the content of the manual operation.
9. The driving support device according to any one of claims 1 to 8, wherein the storage means deletes data after a predetermined time has elapsed since storage.
10. An autonomous vehicle comprising: detection means for detecting when a manual operation is performed on the vehicle itself; and storage means for storing the content and location of the manual operation in a predetermined driving support device.
11. An autonomous vehicle that receives the content and location of the manual operation from a driving support device according to any one of claims 1 to 9, and is capable of performing the content of the manual operation at the location.
12. An autonomous vehicle comprising: a transmitting and receiving unit that receives the content of the manual operation, the location where it was performed, and the cause of the manual operation from a driving support device according to any one of claims 6 to 9; an analysis unit that determines whether or not to perform the content of the manual operation based on whether or not the event that caused the manual operation is continuing; and an implementation unit that performs the content of the manual operation at the implementation location.
13. A driving assistance method that detects when a manual operation is performed on an autonomous vehicle, acquires and saves the content and location of the manual operation, transmits the content and location of the manual operation to a second autonomous vehicle scheduled to travel in the section including the location of the operation, and causes the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation.
14. A recording medium that records a program that performs the following: a process for detecting when a manual operation is performed on an autonomous vehicle; a process for acquiring and saving the content and location of the manual operation; and a process for transmitting the content and location of the manual operation to a second autonomous vehicle scheduled to travel in the section including the location of the operation, and causing the second autonomous vehicle to perform an operation equivalent to the manual operation at the location of the operation.
