Autonomous driving proposal device, autonomous driving proposal method, and computer program for autonomous driving proposal

JP7639778B2Active Publication Date: 2025-03-05TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022099780
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-06-21
Publication Date
2025-03-05
Estimated Expiration
2042-06-21

AI Technical Summary

Benefits of technology

【0012】 本開示による自動運転提案装置は、ドライバに対して自動運転制御の適用を提案するか否かを適切に決定することができるという効果を奏する。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007639778000001
    Figure 0007639778000001
  • Figure 0007639778000002
    Figure 0007639778000002
  • Figure 0007639778000003
    Figure 0007639778000003
Patent Text Reader

Abstract

To provide an automatic driving proposal device which can properly determine whether or not to propose application of automatic drive control to a driver.SOLUTION: An automatic driving proposal device comprises: a specification unit 31 which specifies an automatic driving possible section in which a vehicle 10 can travel by automatic drive control; a proposal unit 32 which proposes travel by the automatic drive control to a driver of the vehicle 10 via a notification unit 4 when a proposal determination value corresponding to the length of the specified automatic driving possible section satisfies a first proposal reference, and stops proposal of the travel by the automatic drive control in the automatic driving possible section to the driver when the proposal determination value corresponding to the length of the specified automatic driving possible section does not satisfy the first proposal reference; and an update unit 33 which adds a prescribed addition value to the proposal determination value corresponding to the length of the specified automatic driving possible section when the operation of the driver who agrees with the proposal of the travel by the automatic drive control to the driver is not detected.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an autonomous driving suggestion device, an autonomous driving suggestion method, and a computer program for autonomous driving suggestions, which suggest the application of autonomous driving control to a driver in a vehicle to which autonomous driving control can be applied. [Background technology]

[0002] A technology has been proposed for appropriately switching the subject of vehicle driving control in a vehicle in which autonomous driving control can be applied when certain conditions are met (see Patent Document 1).

[0003] The driving mode switching device described in Patent Document 1 controls so as not to switch between the automatic driving mode and the manual driving mode when the predicted passing time for the automatic driving recommended section or the manual driving recommended section is less than twice the driving mode switching time plus a margin value. This reduces the burden on the driver associated with frequent switching. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-65515 A Summary of the Invention [Problem to be solved by the invention]

[0005] Whether or not a driver desires the application of automatic driving control depends on the driver's preference. If the vehicle control device proposes the application of automatic driving control to a driver who does not desire the application of automatic driving control, the driver may feel bothered. Therefore, even when the vehicle travels in a section where automatic driving control is possible, it is preferable that whether or not to propose the application of automatic driving control is appropriately determined according to the driver's preference.

[0006] Therefore, an object of the present invention is to provide an autonomous driving suggestion device that can appropriately determine whether or not to suggest the application of autonomous driving control to a driver. [Means for solving the problem]

[0007] According to one embodiment, an automatic driving proposal device is provided. The automatic driving proposal device includes a specification unit that specifies an automatic driving possible section in a forward direction of a vehicle path where the vehicle can travel under automatic driving control, a proposal unit that proposes traveling under automatic driving control to a driver of the vehicle via a notification unit when a proposal judgment value corresponding to the length of the specified automatic driving possible section among proposal judgment values ​​set for each length of the automatic driving possible section satisfies a first proposal criterion, and stops proposing to the driver traveling under automatic driving control in the automatic driving possible section when the proposal judgment value corresponding to the length of the specified automatic driving possible section does not satisfy the first proposal criterion, and an update unit that adds a predetermined additional value to the proposal judgment value corresponding to the length of the specified automatic driving possible section when a driver's behavior agreeing to the proposal to the driver of traveling under automatic driving control is not detected.

[0008] In this autonomous driving proposal device, it is preferable that the update unit subtracts a predetermined subtraction value from the proposal judgment value corresponding to the length of the autonomous driving possible section each time the proposal of traveling by autonomous driving control in the identified autonomous driving possible section is stopped. Then, it is preferable that the proposal unit stops proposing to the driver traveling by autonomous driving control in the identified autonomous driving possible section when the proposal judgment value corresponding to the length of the identified autonomous driving possible section does not satisfy a second proposal criterion that is stricter than the first proposal criterion after the proposal judgment value corresponding to the length of the identified autonomous driving possible section no longer satisfies the first proposal criterion, and proposes traveling by autonomous driving control in the identified autonomous driving possible section to the driver via the notification unit when the proposal judgment value corresponding to the length of the identified autonomous driving possible section satisfies the second proposal criterion.

[0009] It is preferable that this automated driving suggestion device further has a vehicle control unit that controls the automated driving of the vehicle when a driver's action agreeing with the suggestion is detected.

[0010] According to another embodiment, there is provided an autonomous driving proposal method. The autonomous driving proposal method includes: identifying an autonomous driving possible section in a forward direction of a vehicle path where the vehicle can travel under autonomous driving control; if a proposal judgment value corresponding to the length of the identified autonomous driving possible section among proposal judgment values ​​set for each length of the autonomous driving possible section satisfies a first proposal criterion, proposing autonomous driving control to a driver of the vehicle via a notification unit; if the proposal judgment value corresponding to the length of the identified autonomous driving possible section does not satisfy the first proposal criterion, stopping the proposal to the driver of autonomous driving control to travel in the autonomous driving possible section; and if no driver's behavior agreeing to the proposal to the driver of autonomous driving control to travel is detected, adding a predetermined additional value to the proposal judgment value corresponding to the length of the identified autonomous driving possible section.

[0011] According to yet another embodiment, a computer program for proposing autonomous driving is provided. The computer program for proposing autonomous driving specifies an autonomous driving possible section in front of the vehicle's path where the vehicle can travel under autonomous driving control, and if the proposal judgment value corresponding to the length of the specified autonomous driving possible section among the proposal judgment values ​​set for each length of the autonomous driving possible section satisfies a first proposal criterion, the program proposes traveling under autonomous driving control to the driver of the vehicle via the notification unit, and if the proposal judgment value corresponding to the length of the specified autonomous driving possible section does not satisfy the first proposal criterion, the program stops proposing to the driver traveling under autonomous driving control in the autonomous driving possible section, and if the driver's behavior agreeing to the proposal to the driver of traveling under autonomous driving control is not detected, adds a predetermined additional value to the proposal judgment value corresponding to the length of the specified autonomous driving possible section. Effect of the Invention

[0012] The autonomous driving suggestion device according to the present disclosure has the effect of being able to appropriately decide whether or not to suggest the application of autonomous driving control to a driver. [Brief description of the drawings]

[0013] [Figure 1] 1 is a schematic configuration diagram of a vehicle control system in which an autonomous driving proposal device is implemented. [Diagram 2] FIG. 2 is a hardware configuration diagram of an electronic control device which is one embodiment of an autonomous driving proposal device. [Diagram 3] FIG. 2 is a functional block diagram of a processor of an electronic control device related to an autonomous driving proposal process. [Figure 4] A figure showing an example of the relationship between a change in the proposal determination value and whether or not an autonomous driving proposal can be implemented. [Diagram 5] A figure showing another example of the relationship between the change in the proposal determination value and the feasibility of implementing an autonomous driving proposal. [Figure 6] FIG. 13 is a diagram illustrating an example of a proposed determination value for each length of an autonomous driving possible section. [Figure 7] 13 is an operation flowchart of an autonomous driving proposal process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an automatic driving proposal device, an automatic driving proposal method executed by the automatic driving proposal device, and a computer program for automatic driving proposal will be described with reference to the drawings. The automatic driving proposal device identifies a section in front of the vehicle's path where the vehicle can travel under automatic driving control (hereinafter, may be referred to as an automatic driving possible section). Then, when the proposal judgment value corresponding to the length of the identified automatic driving possible section among the proposal judgment values ​​set for each length of the automatic driving possible section is equal to or less than a predetermined inhibition threshold, the automatic driving proposal device determines that the first proposal criterion regarding the automatic driving proposal is satisfied. Then, the automatic driving proposal device proposes traveling under automatic driving control to the driver of the vehicle. On the other hand, when the proposal judgment value corresponding to the length of the identified automatic driving possible section is greater than the predetermined inhibition threshold, the automatic driving proposal device determines that the first proposal criterion is not satisfied and stops proposing to the driver traveling under automatic driving control in the automatic driving possible section. Furthermore, when the automatic driving proposal device proposes traveling under automatic driving control but does not detect the behavior of the driver agreeing with the proposal, it adds a predetermined additional value to the proposal judgment value corresponding to the length of the identified automatic driving possible section. In this way, the autonomous driving suggestion device adjusts the proposal judgment value, which is an index for determining whether or not to propose autonomous driving, according to the driver's response to the autonomous driving proposal for each length of the autonomous driving possible section. Therefore, the autonomous driving suggestion device can appropriately determine whether or not to propose the application of autonomous driving control to the driver according to the length of the autonomous driving possible section.

[0015] In this embodiment, the level of autonomous driving control applied to the vehicle may be a driving control level that does not require the driver to operate the accelerator, brake, and steering. In other words, the level of autonomous driving control may be a level that requires the driver to monitor the surroundings of the vehicle or to hold the steering wheel, or may be a level that does not require this. For example, the level of autonomous driving control applied to the vehicle may be level 2 autonomous driving control or level 3 autonomous driving control as defined by the Society of Automotive Engineers (SAE).

[0016] FIG. 1 is a schematic diagram of a vehicle control system in which an automatic driving proposal device is implemented. FIG. 2 is a hardware configuration diagram of an electronic control device which is one embodiment of the automatic driving proposal device. The vehicle control system 1 is mounted on a vehicle 10 and controls the vehicle 10. To this end, the vehicle control system 1 has a GPS receiver 2, a camera 3, a user interface 4, a storage device 5, and an electronic control unit (ECU) 6 which is an example of the automatic driving proposal device. The GPS receiver 2, the camera 3, the user interface 4, the storage device 5, and the ECU 6 are communicatively connected via an in-vehicle network conforming to a standard such as a controller area network. The vehicle control system 1 may further have any of a navigation device (not shown) which searches for a planned driving route to a destination, a wireless communication terminal (not shown) for wireless communication with other devices, and a distance sensor (not shown) such as a LiDAR sensor or a radar.

[0017] The GPS receiver 2 is an example of a positioning device, and receives GPS signals from GPS satellites at predetermined intervals and measures the vehicle's own position based on the received GPS signals. The GPS receiver 2 outputs positioning information representing the measurement result of the vehicle's own position based on the GPS signals to the ECU 6 via the in-vehicle network at predetermined intervals. The vehicle 10 may have a receiver that complies with a satellite positioning system other than the GPS receiver 2. In this case, the receiver measures the vehicle's own position.

[0018] The camera 3 is an example of a sensor capable of detecting objects around the vehicle 10. The camera 3 has a two-dimensional detector configured with an array of photoelectric conversion elements sensitive to visible light, such as a CCD or C-MOS, and an imaging optical system that forms an image of the area to be photographed on the two-dimensional detector. The camera 3 is attached, for example, in the passenger compartment of the vehicle 10 so as to face the front of the vehicle 10. The camera 3 photographs the area in front of the vehicle 10 at every predetermined photographing period, and generates an image showing the area in front of the vehicle 10. The image obtained by the camera 3 is an example of a sensor signal, and may be a color image or a gray image. The vehicle 10 may be provided with two or more cameras with different photographing directions or focal lengths.

[0019] Every time the camera 3 generates an image, it outputs the generated image to the ECU 6 via the in-vehicle network.

[0020] The user interface 4 is an example of a notification unit, and has, for example, a display device such as a liquid crystal display or a touch panel display. The user interface 4 is installed in the vehicle interior of the vehicle 10, for example, near the instrument panel, facing the driver. The user interface 4 notifies the driver of the predetermined information received from the ECU 6 via the in-vehicle network by displaying the information as an icon or as text information. The user interface 4 may have one or more light sources provided on the instrument panel, a speaker provided in the vehicle interior, or a vibration device provided on the steering wheel or the driver's seat. In this case, the user interface 4 notifies the driver of the predetermined information by outputting the predetermined information received from the ECU 6 via the in-vehicle network as a sound signal. Alternatively, the user interface 4 may vibrate the vibration device in response to a signal received from the ECU 6 via the in-vehicle network, thereby notifying the driver of the predetermined information by the vibration. Alternatively, the user interface 4 may notify the driver of the predetermined information by turning on or blinking a light source in response to a signal received from the ECU 6 via the in-vehicle network.

[0021] Furthermore, the user interface 4 accepts a predetermined operation by the driver. For example, if the user interface 4 has a touch panel, it outputs a signal indicating an area on the touch panel touched by the driver to the ECU 6. The user interface 4 may also have one or more switches for accepting a predetermined operation. In this case, when any of the one or more switches is operated, the user interface 4 outputs a signal indicating the operated switch and the state of the switch after the operation to the ECU 6. The user interface 4 may also have a microphone. In this case, the user interface 4 outputs an audio signal indicating the driver's voice collected via the microphone to the ECU 6.

[0022] The storage device 5 is an example of a storage unit, and includes, for example, a hard disk device, a non-volatile semiconductor memory, or an optical recording medium and an access device therefor. The storage device 5 stores a high-precision map, which is an example of map information. The high-precision map includes information indicating an area where automatic driving control is applicable (hereinafter, sometimes referred to as an automatic driving possible area), and information used for automatic driving control for each road section within the automatic driving possible area. The information used for automatic driving control includes, for example, information representing road markings such as lane markings or stop lines for each road section included in the automatic driving possible area shown on the high-precision map, information representing road signs, and information representing features around the road.

[0023] Furthermore, the storage device 5 may have a processor for executing an update process of the high-precision map, a process related to a read request of the high-precision map from the ECU 6, and the like. In this case, the storage device 5 transmits a request to acquire a high-precision map together with the current position of the vehicle 10 to a map server via a wireless communication terminal (not shown) every time the vehicle 10 moves a predetermined distance, for example. Then, the storage device 5 receives a high-precision map of a predetermined area around the current position of the vehicle 10 from the map server via the wireless communication terminal. Furthermore, when the storage device 5 receives a read request of the high-precision map from the ECU 6, the storage device 5 extracts an area that includes the current position of the vehicle 10 and is relatively narrower than the above-mentioned predetermined area from the stored high-precision map, and outputs the area to the ECU 6 via the in-vehicle network.

[0024] When autonomous driving control is applicable to the vehicle 10, the ECU 6 determines whether or not to propose application of autonomous driving control to the driver of the vehicle 10. Furthermore, when the driver performs an action agreeing to the proposal for application of autonomous driving control, the ECU 6 performs autonomous driving control of the vehicle 10. Furthermore, when the driver does not perform an action agreeing to the proposal for application of autonomous driving control, the ECU 6 adjusts a proposal determination value that is a determination index for whether or not to make the proposal.

[0025] 2, the ECU 6 has a communication interface 21, a memory 22, and a processor 23. The communication interface 21, the memory 22, and the processor 23 may each be configured as a separate circuit, or may be integrated into a single integrated circuit.

[0026] The communication interface 21 has an interface circuit for connecting the ECU 6 to the in-vehicle network. The communication interface 21 passes the positioning information to the processor 23 every time it receives positioning information from the GPS receiver 2. The communication interface 21 passes the received image to the processor 23 every time it receives an image from the camera 3. The communication interface 21 also passes the high-precision map read from the storage device 5 to the processor 23. The communication interface 21 also outputs information or a signal to the user interface 4 received from the processor 23 to the user interface 4 via the in-vehicle network. The communication interface 21 also passes the signal to the processor 23 every time it receives a signal indicating a predetermined operation by the driver from the user interface 4.

[0027] The memory 22 is another example of a storage unit, and includes, for example, a volatile semiconductor memory and a non-volatile semiconductor memory. The memory 22 stores various data used in the autonomous driving proposal process executed by the processor 23 of the ECU 6. For example, the memory 22 stores a suppression threshold, a re-proposal threshold, a proposal determination value for each length of the autonomous driving possible section, and a flag indicating the proposal status for each length of the autonomous driving possible section. The memory 22 also stores a high-precision map read from the storage device 5. The memory 22 also temporarily stores an image received from the camera 3 and positioning information received from the GPS receiver 2. The memory 22 also temporarily stores various data generated during the autonomous driving proposal process.

[0028] The processor 23 has one or more central processing units (CPUs) and their peripheral circuits. The processor 23 may further have other arithmetic circuits such as a logic arithmetic unit, a numerical arithmetic unit, or a graphic processing unit. The processor 23 executes vehicle control processing for the vehicle 10, including autonomous driving proposal processing.

[0029] 3 is a functional block diagram of the processor 23 related to the autonomous driving proposal process. The processor 23 has a specification unit 31, a proposal unit 32, an update unit 33, and a vehicle control unit 34. Each of these units in the processor 23 is, for example, a functional module realized by a computer program that runs on the processor 23. Alternatively, each of these units in the processor 23 may be a dedicated arithmetic circuit provided in the processor 23.

[0030] The identification unit 31 identifies an autonomous driving possible section in which the vehicle 10 can travel under autonomous driving control ahead of the path of the vehicle 10 while the vehicle 10 is being manually driven by the driver. To this end, the identification unit 31 identifies the road on which the vehicle 10 is traveling by referring to the current position of the vehicle 10 indicated by the latest positioning information and a high-precision map. Then, the identification unit 31 identifies, among the identified roads in the traveling direction of the vehicle 10 measured by a direction sensor (not shown) mounted on the vehicle 10, a road section included in an autonomous driving possible area indicated on the high-precision map as an autonomous driving possible section. Furthermore, the identification unit 31 determines the length of the road section included in the autonomous driving possible area as the length of the autonomous driving possible section.

[0031] The identification unit 31 notifies the proposal unit 32 of both end points of the identified autonomous driving section, i.e., the start point on the near side and the end point on the far side along the traveling direction of the vehicle 10, and its length.

[0032] When the proposal judgment condition for the identified section where automatic driving is possible is satisfied, the proposal unit 32 judges whether or not to make an automatic driving proposal based on the proposal judgment value corresponding to the length of the section where automatic driving is possible. For example, when the vehicle 10 enters the identified section where automatic driving is possible, the proposal unit 32 judges that the proposal judgment condition is satisfied, and reads from the memory 22 a proposal judgment value corresponding to the length of the section where automatic driving is possible and a flag indicating the proposal status. Then, when the value of the flag indicating the proposal status indicates that the proposal is allowed, the proposal unit 32 compares the proposal judgment value with the inhibition threshold. When the proposal judgment value is equal to or less than the inhibition threshold, the proposal unit 32 judges that the first proposal criterion is satisfied, and proposes to the driver via the user interface 4 that the vehicle 10 travels under automatic driving control. On the other hand, when the read proposal judgment value is greater than the inhibition threshold, the proposal unit 32 judges that the first proposal criterion is not satisfied, and stops the proposal of traveling under automatic driving control of the vehicle 10. In addition, the proposal unit 32 rewrites the value of the flag indicating the proposal status to a value indicating that the proposal is stopped. Hereinafter, the proposal for driving the vehicle 10 under automatic driving control may be referred to as an automatic driving proposal.

[0033] To determine whether the vehicle 10 has entered an area where autonomous driving is possible, the proposing unit 32 refers to the current position of the vehicle 10 indicated by the latest positioning information and the range of the area where autonomous driving is possible indicated on the high-precision map. If the current position of the vehicle 10 is included in the area where autonomous driving is possible, the proposing unit 32 determines that the vehicle 10 has entered the area where autonomous driving is possible.

[0034] Furthermore, the proposing unit 32 may determine that the proposal determination condition is satisfied when the distance from the current position of the vehicle 10 to the identified autonomous driving possible section becomes equal to or shorter than a predetermined distance. In this case, the proposing unit 32 may also obtain the distance to the start point of the identified autonomous driving possible section by referring to the current position of the vehicle 10 indicated by the latest positioning information.

[0035] When making an autonomous driving proposal, the proposal unit 32 displays a message or icon indicating that autonomous driving control is applicable, such as "Do you want to start autonomous driving?", on the display device or touch panel of the user interface 4. In this way, the proposal unit 32 notifies the driver of the autonomous driving proposal. Alternatively, the proposal unit 32 may output an audio signal indicating such a message from a speaker of the user interface 4. Alternatively, the proposal unit 32 may turn on or blink one or more light sources of the user interface 4 in a manner indicating that autonomous driving control is applicable. Alternatively, the proposal unit 32 may vibrate a vibration device of the user interface 4 in a manner indicating that autonomous driving control is applicable. Furthermore, the proposal unit 32 may notify the driver of the autonomous driving proposal by executing two or more operations of the above-mentioned user interface 4.

[0036] After making an automatic driving proposal to the driver, the proposal unit 32 determines whether the driver has performed an action of agreeing to the automatic driving proposal. Hereinafter, the action of agreeing to the automatic driving proposal by the driver may be simply referred to as an agreement action. For example, when the ECU 6 receives a signal from the touch panel of the user interface 4 indicating that an area corresponding to the automatic driving proposal has been touched, the proposal unit 32 determines that the driver has performed the agreement action. Alternatively, when the ECU 6 receives a signal indicating that a switch corresponding to the automatic driving proposal among one or more switches of the user interface 4 has become a predetermined switch position, the proposal unit 32 may determine that the driver has performed the agreement action. Alternatively, the proposal unit 32 may execute a voice recognition process on a voice signal received by the ECU 6 from a microphone of the user interface 4 to determine whether a keyword (e.g., "yes", etc.) indicating agreement with the automatic driving proposal can be detected. Then, when the proposal unit 32 detects such a keyword, it may determine that the driver has performed the agreement action. In addition, the proposal unit 32 can use, as the speech recognition processing, for example, a GMM-HMM type speech recognition processing that uses a Gaussian mixture model (GMM) and a hidden Markov model (HMM), or a DNN-HMM type speech recognition processing that uses a deep neural network (DNN) and an HMM.

[0037] When the proposal unit 32 determines that the driver has performed the consent action, it notifies the vehicle control unit 34 that the consent action has been performed. On the other hand, when the consent action is not detected even after a predetermined period has elapsed since the autonomous driving proposal was made, the proposal unit 32 determines that the driver has not performed the consent action. In this case, even if the vehicle 10 is traveling in an autonomous driving possible section, the ECU 6 does not perform the autonomous driving control of the vehicle 10, and continues the manual driving control by the driver. In addition, the proposal unit 32 notifies the update unit 33 that the consent action by the driver has not been detected and the length of the identified autonomous driving possible section. Note that the predetermined period can be, for example, a period having a preset time length. Alternatively, the predetermined period may be a period from the autonomous driving proposal to the time when the vehicle 10 reaches a position that is a predetermined distance from the end point of the autonomous driving possible section in which the vehicle 10 is traveling. In this case, the proposal unit 32 may refer to the position of the vehicle 10 indicated by the latest positioning information and determine whether the vehicle 10 has reached a position that is a predetermined distance from the end point of the autonomous driving possible section.

[0038] For an autonomous driving possible section having a length in which the proposal judgment value has once become greater than the inhibition threshold, the proposal unit 32 applies the re-proposal threshold instead of the inhibition threshold as a threshold for determining whether or not to make an autonomous driving proposal. This re-proposal threshold is set to a value lower than the inhibition threshold. That is, the proposal unit 32 does not make an autonomous driving proposal unless the proposal judgment value satisfies a second proposal criterion that is stricter than the first proposal criterion. Therefore, even if the proposal judgment condition is satisfied for an autonomous driving possible section having a length in which the value of the flag representing the proposal status indicates that the proposal is stopped, the proposal unit 32 does not make an autonomous driving proposal until the proposal judgment value becomes lower than the re-proposal threshold. That is, while the proposal judgment value is equal to or greater than the re-proposal threshold, the proposal unit 32 determines that the second proposal criterion is not satisfied and stops the autonomous driving proposal. Then, the proposal unit 32 notifies the update unit 33 that the autonomous driving proposal has been stopped and the length of the identified autonomous driving possible section. On the other hand, when the proposal judgment value for the section where autonomous driving is possible of that length becomes lower than the re-proposal threshold value, the proposal unit 32 determines that the second proposal criterion is satisfied and makes an autonomous driving proposal via the user interface 4.

[0039] In this case, for the autonomous driving possible section whose length has the proposal judgment value lower than the re-proposal threshold, the proposal unit 32 applies the inhibition threshold again instead of the re-proposal threshold as a threshold for determining whether to make an autonomous driving proposal. That is, the first proposal criterion is applied again instead of the second proposal criterion. Therefore, the proposal unit 32 rewrites the value of the flag representing the proposal status to a value representing that the proposal is being permitted. In this way, by providing hysteresis to the threshold for determining whether to make an autonomous driving proposal, frequent switching between whether or not an autonomous driving proposal is made is prevented. Therefore, the proposal unit 32 can prevent the driver from being confused.

[0040] Each time the update unit 33 is notified by the proposal unit 32 that the consent action has not been detected and the length of the identified autonomous driving possible section, the update unit 33 adds a predetermined additional value (for example, 0.1) to the proposal judgment value corresponding to that length. Therefore, the more times the driver does not perform the consent action for an autonomous driving possible section of a certain length, the more the proposal judgment value corresponding to that length increases, and at a certain point in time, the proposal judgment value exceeds the inhibition threshold. As a result, autonomous driving proposals are not made for autonomous driving possible sections of that length. Therefore, whether or not autonomous driving proposals are made is optimized for each length of an autonomous driving possible section according to the driver's preferences.

[0041] It is preferable that the initial value of the proposal judgment value is set to a value smaller than the inhibition threshold value, so that in the initial setting, autonomous driving proposals are made when the proposal judgment condition is satisfied, regardless of the length of the identified autonomous driving possible section.

[0042] In addition, each time the update unit 33 is notified by the proposal unit 32 that the autonomous driving proposal has been stopped and the length of the identified autonomous driving possible section, the update unit 33 subtracts a predetermined subtraction value (for example, 0.01) from the proposal judgment value corresponding to that length. Therefore, after the autonomous driving proposal is no longer made for an autonomous driving possible section of a certain length, the proposal judgment value gradually decreases. Then, at a certain point, the proposal judgment value falls below the re-proposal threshold, and the autonomous driving proposal is made again. This prevents the autonomous driving proposal from being permanently stopped for the autonomous driving possible section of a length for which the autonomous driving proposal has been stopped. Therefore, for an autonomous driving possible section of a length for which the driver did not want the autonomous driving control applied in the past, if the driver's preference changes and the driver now wants the autonomous driving control to be applied, it becomes possible to apply the autonomous driving control. Note that it is preferable that the absolute value of the predetermined subtraction value is smaller than the absolute value of the predetermined addition value. As a result, the autonomous driving proposal is not immediately resumed for the autonomous driving possible section of a length for which the autonomous driving proposal was stopped, so that the meaning of stopping the autonomous driving proposal is suppressed.

[0043] FIG. 4 is a diagram illustrating an example of the relationship between a change in the proposal determination value and whether or not an autonomous driving proposal can be implemented.

[0044] The upper part of Fig. 4 shows, from the left, whether or not the autonomous driving proposal can be implemented when the vehicle 10 enters an autonomous driving possible section of length L at time points t0 to t2. The lower part of Fig. 4 shows an example of the transition of the proposal judgment value corresponding to the autonomous driving possible section of length L. That is, in the lower part of Fig. 4, the horizontal axis represents the travel distance or travel time of the vehicle 10, and the vertical axis represents the magnitude of the proposal judgment value. Graph 400 shows an example of the transition of the proposal judgment value.

[0045] At time t0 before the proposal judgment value is updated, the proposal judgment value SL is smaller than the inhibition threshold value Th1. Therefore, as shown in the upper left of FIG. 4, when the vehicle 10 enters the autonomous driving possible section 401 of length L, an autonomous driving proposal is made. Then, every time the vehicle 10 enters the autonomous driving possible section of length L, the proposal judgment value SL gradually increases because the driver's consent action is not detected. Then, at time t1, the proposal judgment value SL becomes equal to or greater than the inhibition threshold value Th1. Therefore, at time t1, even if the vehicle 10 enters the autonomous driving possible section 401 of length L, an autonomous driving proposal is not made, as shown in the upper center of FIG. 4. Thereafter, every time the vehicle 10 enters the autonomous driving possible section of length L, the autonomous driving proposal is stopped, and the proposal judgment value SL gradually decreases. Then, at time t2, the proposal judgment value SL becomes lower than the re-proposal threshold value Th2. Therefore, at time t2, as shown in the upper right of FIG. 4, when the vehicle 10 enters an autonomous driving possible section 401 of length L, an autonomous driving suggestion is made again.

[0046] FIG. 5 is a diagram illustrating another example of the relationship between the change in the proposal determination value and whether or not the autonomous driving proposal can be implemented.

[0047] The upper part of Fig. 5 shows, from the left, whether or not the autonomous driving proposal can be executed when the vehicle 10 enters an autonomous driving possible section of length L at time t0 and time t1, respectively. The lower part of Fig. 5 shows an example of the transition of the proposal judgment value corresponding to the autonomous driving possible section of length L. That is, in the lower part of Fig. 5, the horizontal axis represents the travel distance or travel time of the vehicle 10, and the vertical axis represents the magnitude of the proposal judgment value. Graph 500 shows an example of the transition of the proposal judgment value.

[0048] At time t0 before the update of the proposal judgment value, the proposal judgment value SL is smaller than the inhibition threshold value Th1. Therefore, in this example, as shown in the upper left of FIG. 5, when the vehicle 10 enters the autonomous driving possible section 501 of length L, an autonomous driving proposal is made. In this example, every time the vehicle 10 enters the autonomous driving possible section of length L, the driver performs an agreement action, and autonomous driving control is applied to the vehicle 10. Therefore, the proposal judgment value SL does not increase but is kept constant. As a result, even at time t1, the proposal judgment value SL remains below the inhibition threshold value Th1. Therefore, even at time t1, as shown in the upper right of FIG. 5, when the vehicle 10 enters the autonomous driving possible section 501 of length L, an autonomous driving proposal is made.

[0049] FIG. 6 is a diagram showing an example of a proposal judgment value for each length of an autonomous driving possible section. In this example, a proposal judgment value is set for each section with a length of less than 200 m, 200 m or more and less than 400 m, 400 m or more and less than 600 m, 600 m or more and less than 800 m, 800 m or more and less than 1000 m, and 1000 m or more. In this example, the inhibition threshold Th1 is set to 0. In the initial setting, as shown in the table 600, the proposal judgment value SL of each section is set to 0. Therefore, an autonomous driving proposal is made for any length of an autonomous driving possible section. At a later time t1, as shown in the table 610, the proposal judgment value SL is 0.8 for the section with a length of less than 200 m and the section with a length of 200 m or more and less than 400 m, exceeding the inhibition threshold Th1. Therefore, even if the vehicle 10 enters an autonomous driving possible section with a length of less than 200 m or an autonomous driving possible section with a length of 200 m or more and less than 400 m, an autonomous driving proposal is not made. In contrast, the proposal judgment value SL for each section with a length of 400 m or more is equal to or less than the inhibition threshold value Th1. Therefore, autonomous driving proposals are made for sections with a length of 400 m or more where autonomous driving is possible.

[0050] In this way, the feasibility of implementing the autonomous driving proposal is appropriately adjusted according to the driver's preference for each length of the autonomous driving possible section. Therefore, for example, for a driver who does not want to apply the autonomous driving control as the autonomous driving possible section is shorter, when the autonomous driving possible section and the section to which the autonomous driving control is not applied alternate over a relatively short distance, the autonomous driving proposal is suppressed. As a result, the driver's annoyance is reduced.

[0051] When the vehicle control unit 34 is notified by the proposal unit 32 that the consent operation has been performed, the vehicle control unit 34 performs automatic driving control of the vehicle 10. For example, the vehicle control unit 34 controls each unit of the vehicle 10 so that the vehicle 10 continues to travel along the lane in which the vehicle 10 is traveling (hereinafter, sometimes referred to as the own lane). To this end, the vehicle control unit 34 detects detection objects including lane markings and other vehicles traveling around the vehicle 10 by inputting each of a series of images in time series generated by the camera 3 to a classifier. Then, the vehicle control unit 34 specifies the area between the lane marking closest to the left side of the vehicle 10 and the lane marking closest to the right side of the vehicle 10 as the own lane. Note that the vehicle control unit 34 can use a DNN having a convolutional neural network type architecture as such a classifier. Alternatively, the vehicle control unit 34 can use a DNN having a self attention network type architecture as such a classifier. The classifier is trained in advance according to a predetermined learning method such as an error backpropagation method using a large number of teacher images in which the detection objects are represented.

[0052] The vehicle control unit 34 controls the steering so that the vehicle 10 travels along the detected center line of the own lane.

[0053] Furthermore, the vehicle control unit 34 controls each part of the vehicle 10 so that the vehicle 10 does not collide with other vehicles traveling around the vehicle 10, which are detected by inputting a series of images to a classifier. For example, the vehicle control unit 34 identifies other vehicles included in the area in which the vehicle's lane is represented on the image as preceding vehicles that precede the vehicle 10. The vehicle control unit 34 then controls the accelerator and brake of the vehicle 10 so that the inter-vehicle distance between the preceding vehicle and the vehicle 10 is maintained at a predetermined distance or more. It is assumed that the position of the bottom end of the object area in which the preceding vehicle is represented on the image represents the position where the preceding vehicle is in contact with the road surface. In addition, the position of each pixel on the image corresponds one-to-one to the orientation as seen from the camera 3. Therefore, the vehicle control unit 34 can estimate the distance from the vehicle 10 to the preceding vehicle based on the parameters of the camera 3, such as the installation height, focal length, and shooting direction of the camera 3, and the position of the bottom end of the object area on the image. Furthermore, if the vehicle 10 is equipped with a distance sensor (not shown), the vehicle control unit 34 may consider the distance to an object in front of the vehicle 10 measured by the distance sensor to be the distance from the vehicle 10 to the preceding vehicle.

[0054] When there is no preceding vehicle, or when the distance from the vehicle 10 to the preceding vehicle is equal to or greater than a predetermined distance, the vehicle control unit 34 may control the accelerator and brake so that the vehicle 10 travels at a predetermined target speed. The target speed may be, for example, a speed limit or a legal speed set for the road on which the vehicle 10 is traveling. In this case, the vehicle control unit 34 may refer to the current position of the vehicle 10 and a high-precision map, and specify the speed limit or the legal speed set for the road on which the vehicle 10 is traveling as the target speed. Alternatively, the target speed may be set by the driver via a switch on the user interface 4.

[0055] Furthermore, the vehicle control unit 34 may control the steering of the vehicle 10 to change lanes to an adjacent lane when the speed of the preceding vehicle is slower than a predetermined speed and no other vehicle is detected traveling in an adjacent lane adjacent to the own lane.

[0056] When the distance from the current position of the vehicle 10 to the end point of the section where automatic driving is possible becomes equal to or shorter than a predetermined distance, the vehicle control unit 34 notifies the driver of a switch to manual driving control, that is, a request for a driver to take over driving, via the user interface 4. At that time, the vehicle control unit 34 displays a message or icon representing the driver's request for a driver's driver to take over driving on a display device or touch panel of the user interface 4, or lights or blinks a light source corresponding to the message. Alternatively, the vehicle control unit 34 outputs an audio signal representing the message to a speaker of the user interface 4. Alternatively, the vehicle control unit 34 vibrates a vibration device of the user interface 4 according to a vibration method corresponding to the message. Note that, when the user interface 4 has two or more of the above devices, the vehicle control unit 34 may notify the driver of the driver's driver's driver-taking-over request message via each or any of the two or more devices. Then, when the vehicle 10 leaves the section where automatic driving is possible, the vehicle control unit 34 ends the automatic driving control and hands over the control of the vehicle 10 to the driver.

[0057] 7 is an operational flowchart of the autonomous driving suggestion process executed by the processor 23. The processor 23 executes the vehicle control process in accordance with the following operational flowchart.

[0058] The identification unit 31 of the processor 23 identifies an automatic driving possible section ahead on the path of the vehicle 10 while the vehicle 10 is being manually driven by the driver (step S101).

[0059] The proposal unit 32 of the processor 23 determines whether or not the proposal of automatic driving is permitted for the length of the identified automatic driving possible section (step S102). If the proposal is permitted (step S102-Yes), the proposal unit 32 determines whether or not the proposal judgment value SL corresponding to the length of the identified automatic driving possible section is equal to or less than the inhibition threshold value Th1 when the proposal judgment condition is satisfied (step S103). If the proposal judgment value SL is equal to or less than the inhibition threshold value Th1 (step S103-Yes), the proposal unit 32 notifies the driver of the automatic driving proposal via the user interface 4 (step S104). After that, the proposal unit 32 determines whether or not the consent action by the driver has been detected (step S105). If the consent action by the driver is detected (step S105-Yes), the vehicle control unit 34 of the processor 23 controls the vehicle 10 to be automatic while the vehicle 10 is traveling in the automatic driving possible section (step S106).

[0060] On the other hand, if the driver's consent action is not detected (step S105-No), the update unit 33 of the processor 23 updates the proposal determination value SL by adding a predetermined additional value to the proposal determination value SL corresponding to the length of the identified automatic driving possible section (step S107). Also, the ECU 6 continues the manual driving control by the driver.

[0061] On the other hand, in step S103, if the proposal judgment value SL is greater than the inhibition threshold value Th1 (step S103-No), the proposal unit 32 stops the autonomous driving proposal, and the ECU 6 continues the manual driving control by the driver (step S108). That is, even if the proposal judgment condition is satisfied, the proposal unit 32 does not make an autonomous driving proposal. In addition, the proposal unit 32 rewrites the value of the flag indicating the autonomous driving proposal status for the identified length of the autonomous driving possible section to a value indicating that the proposal is stopped.

[0062] In addition, in step S102, if the proposal of the autonomous driving is stopped for the length of the identified autonomous driving possible section (step S102-No), the proposal unit 32 judges whether or not the proposal judgment condition is satisfied. Then, when the proposal judgment condition is satisfied, the proposal unit 32 judges whether or not the proposal judgment value SL corresponding to the length of the identified autonomous driving possible section is equal to or greater than the re-proposal threshold Th2 (step S109). If the proposal judgment value SL is equal to or greater than the re-proposal threshold Th2 (step S109-Yes), the proposal unit 32 stops the autonomous driving proposal, and the ECU 6 continues the manual driving control by the driver (step S110). Then, the update unit 33 updates the proposal judgment value SL by subtracting a predetermined subtraction value from the proposal judgment value SL corresponding to the length of the identified autonomous driving possible section (step S111).

[0063] On the other hand, if the proposal determination value SL is less than the re-proposal threshold value Th2 (step S109-No), the proposal unit 32 rewrites the value of the flag indicating the proposal status of the autonomous driving for the identified length of the autonomous driving possible section to a value indicating that the proposal is being permitted. Furthermore, the processor 23 executes the processes from step S104 onwards.

[0064] After steps S106, S107, S108, or S111, the processor 23 ends the vehicle control process.

[0065] As described above, the automatic driving proposal device identifies an automatic driving possible section in front of the vehicle's path where the vehicle can travel under automatic driving control. Then, when the proposal judgment value corresponding to the length of the identified automatic driving possible section is equal to or less than a predetermined inhibition threshold, the automatic driving proposal device proposes traveling under automatic driving control to the driver of the vehicle. On the other hand, when the proposal judgment value is greater than the predetermined inhibition threshold, the automatic driving proposal device stops proposing to the driver traveling under automatic driving control in the automatic driving possible section. Furthermore, when the driver's action agreeing with the proposal is not detected, the automatic driving proposal device adds a predetermined additional value to the proposal judgment value corresponding to the identified length of the automatic driving possible section. In this way, the automatic driving proposal device adjusts the proposal judgment value for determining whether or not to propose automatic driving for each length of the automatic driving possible section according to the driver's reaction to the proposal of automatic driving. Therefore, the automatic driving proposal device can appropriately determine whether or not to propose the application of automatic driving control to the driver according to the length of the automatic driving possible section.

[0066] According to a modified example, the proposed determination conditions may include conditions other than the position of the vehicle 10. For example, the proposed determination conditions may include at least one of the following conditions: The location of vehicle 10 has been identified. -Lane markings can be detected The shift position of vehicle 10 is in the drive position. The driver is holding the steering wheel of the vehicle 10. The driver must wear a seat belt. The doors of vehicle 10 are properly closed. Among these conditions, with regard to the identification of the position of the vehicle 10, the suggestion unit 32 may determine that the position of the vehicle 10 can be identified if the GPS receiver 2 can receive a GPS signal. With regard to the detection of lane markings, the suggestion unit 32 may determine that the lane markings have been detected if the lane markings that divide the vehicle's own lane are detected by inputting an image obtained by the camera 3 to a discriminator as described in the vehicle control unit 34. Furthermore, with regard to the shift position, holding the steering wheel, fastening the seat belt, and opening and closing of the door, the suggestion unit 32 may determine whether or not the conditions are satisfied based on sensor signals from sensors provided in those devices. For example, if the ECU 6 receives a signal indicating that the driver is touching the steering wheel from a touch sensor (not shown) provided on the steering wheel, the suggestion unit 32 determines that the driver is holding the steering wheel.

[0067] When any of the above conditions is included in the proposed judgment conditions, the proposing unit 32 may reset the length of the autonomously driving possible section to the length from the current position of the vehicle 10 at the time when the proposed judgment conditions are satisfied to the end point of the identified autonomously driving possible section. Then, the proposing unit 32 and the updating unit 33 may execute the processing in the above embodiment based on the reset length of the autonomously driving possible section.

[0068] According to another modified example, the addition value and the subtraction value used to update the proposal judgment value may be negative values. In this case, the proposal judgment value becomes smaller each time the driver repeats not agreeing to the autonomous driving proposal. Therefore, when the value of the flag representing the autonomous driving proposal status indicates that the proposal is allowed, the proposal unit 32 determines that the first proposal criterion is satisfied if the proposal judgment value is equal to or greater than the inhibition threshold, and executes the autonomous driving proposal. On the other hand, when the proposal judgment value is less than the inhibition threshold, the proposal unit 32 determines that the first proposal criterion is not satisfied and stops the autonomous driving proposal. Also, each time the autonomous driving proposal is stopped, the proposal judgment value becomes larger. Therefore, in this example, the re-proposal threshold is set to a value greater than the inhibition threshold. Also, when the value of the flag representing the autonomous driving proposal status indicates that the proposal is stopped, the proposal unit 32 determines that the second proposal criterion, which is stricter than the first proposal criterion, is satisfied if the proposal judgment value is greater than the re-proposal threshold, and executes the autonomous driving proposal. On the other hand, if the proposal judgment value is equal to or less than the re-proposal threshold, the proposal unit 32 determines that the second proposal criterion is not satisfied and stops the autonomous driving proposal. Even in this modified example, the autonomous driving proposal device can obtain the same effect as the above embodiment.

[0069] A computer program for realizing the functions of the processor 23 of the ECU 6 according to the above embodiment or variant example may be provided in a form recorded on a computer-readable portable recording medium, such as a semiconductor memory, a magnetic recording medium or an optical recording medium.

[0070] As described above, those skilled in the art can make various modifications to the embodiments within the scope of the present invention. [Explanation of symbols]

[0071] 1 Vehicle Control System 10 Vehicles 2 GPS receiver 3. Camera 4 User Interface 5. Storage Devices 6 Electronic Control Unit (ECU) 21 Communication Interface 22 Memory 23 Processors 31 Specific section 32 Proposal Department 33 Update section 34 Vehicle control unit

Claims

1. A determination unit that determines an automatic driving possible section in a forward direction of a vehicle path in which the vehicle can travel under automatic driving control; a proposal unit that proposes traveling under autonomous driving control to a driver of the vehicle via a notification unit when a proposal judgment value corresponding to the identified length of the autonomous driving possible section, among proposal judgment values ​​set for each length of the autonomous driving possible section, is equal to or less than a deterrence threshold, and on the other hand, stops proposing to the driver traveling under autonomous driving control in the autonomous driving possible section when the proposal judgment value corresponding to the identified length of the autonomous driving possible section is greater than the deterrence threshold; an update unit that adds a predetermined additional value to the proposal determination value corresponding to the length of the identified autonomous driving possible section when a behavior of the driver agreeing with the proposal is not detected; An autonomous driving proposal device having the above-mentioned.

2. The update unit subtracts a predetermined subtraction value from the proposal determination value corresponding to the length of the autonomous driving possible section each time a proposal for traveling by autonomous driving control in the identified autonomous driving possible section is stopped, The autonomous driving proposal device of claim 1, wherein, after the proposal judgment value corresponding to the identified length of the autonomous driving possible section becomes greater than the inhibit threshold, if the proposal judgment value is equal to or greater than a re-proposal threshold that is lower than the inhibit threshold, the proposal unit stops proposing to the driver traveling under autonomous driving control in the identified autonomous driving possible section, and if the proposal judgment value corresponding to the identified length of the autonomous driving possible section is lower than the re-proposal threshold, the proposal unit proposes traveling under autonomous driving control in the identified autonomous driving possible section to the driver via the notification unit.

3. The automatic driving suggestion device according to claim 1 or 2, further comprising a vehicle control unit that controls the automatic driving of the vehicle when an action of the driver agreeing with the suggestion is detected.

4. Identifying an automatic driving possible section in a forward direction of the vehicle's route in which the vehicle can travel under automatic driving control; When the proposal judgment value corresponding to the identified length of the autonomous driving possible section among the proposal judgment values ​​set for each length of the autonomous driving possible section is equal to or less than a suppression threshold, the proposal judgment value is set to propose traveling under autonomous driving control to a driver of the vehicle via a notification unit; On the other hand, when the proposal determination value corresponding to the length of the identified autonomous driving possible section is greater than the inhibition threshold value, the proposal to the driver of traveling by autonomous driving control in the autonomous driving possible section is stopped, If no action of the driver agreeing with the proposal is detected, a predetermined additional value is added to the proposal determination value corresponding to the length of the identified autonomous driving possible section. The proposed method for autonomous driving includes the steps of:

5. Identifying an automatic driving possible section in a forward direction of the vehicle's route in which the vehicle can travel under automatic driving control; When the proposal judgment value corresponding to the identified length of the autonomous driving possible section among the proposal judgment values ​​set for each length of the autonomous driving possible section is equal to or less than a suppression threshold, the proposal judgment value is set to propose traveling under autonomous driving control to a driver of the vehicle via a notification unit; On the other hand, when the proposal determination value corresponding to the length of the identified autonomous driving possible section is greater than the inhibition threshold value, the proposal to the driver of traveling by autonomous driving control in the autonomous driving possible section is stopped, If no action of the driver agreeing with the proposal is detected, a predetermined additional value is added to the proposal determination value corresponding to the length of the identified autonomous driving possible section. A computer program for proposing autonomous driving, which causes a processor installed in the vehicle to execute the above steps.

6. A determination unit that determines an automatic driving possible section ahead of a vehicle's path in which the vehicle can travel under automatic driving control; a proposal unit that proposes traveling under autonomous driving control to a driver of the vehicle via a notification unit when a proposal judgment value corresponding to the identified length of the autonomous driving possible section, among proposal judgment values ​​set for each length of the autonomous driving possible section, is equal to or greater than a deterrence threshold, and on the other hand, stops proposing to the driver traveling under autonomous driving control in the autonomous driving possible section when the proposal judgment value corresponding to the identified length of the autonomous driving possible section is smaller than the deterrence threshold; an update unit that subtracts a predetermined value from the proposal determination value corresponding to the identified length of the autonomous driving possible section when a behavior of the driver agreeing with the proposal is not detected; An autonomous driving proposal device having the above-mentioned.

Citation Information

Patent Citations

  • Vehicle control system, vehicle control method, and vehicle control program

    JP2017197011A

  • Vehicular automatic drive system

    JP2017199187A

  • Operation switching device

    JP2018065515A

  • Automatic driving suggestion device and automatic driving suggestion method

    JP2019073107A