Driving support device
The driving support device adjusts operation requests based on driver awareness by monitoring reactions and automating vehicle control, ensuring timely and appropriate driver engagement during automated driving.
Patent Information
- Application Number
- JP2023079984
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-15
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2043-05-15
AI Technical Summary
Existing driving support devices fail to differentiate between drivers with high driving awareness and those whose awareness is declining, leading to inappropriate timing for requesting driver operations.
A driving support device that includes a detection unit to monitor driver reactions, a control unit to manage vehicle automation, and a notification unit to request multiple operations, adjusting the timing of these requests based on the number of operations successfully completed by the driver.
The device effectively tailors operation requests to the driver's awareness level, reducing inconvenience and maintaining focus during automated driving by varying the timing of requests based on the number of operations completed.
Smart Images

Figure 2024164481000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a driving assistance device. [Background technology]
[0002] Patent Document 1 discloses a device for maintaining a driver's wakefulness. This device requests the driver to perform some kind of action to maintain the driver's wakefulness. When the device is unable to recognize the body part related to the driver's action, it shortens the period for requesting the driver to perform the action, and when the driver's state is clear, it lengthens the period for requesting the driver to perform the action compared to when the driver's state is unclear. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2015-095162 A Summary of the Invention [Problem to be solved by the invention]
[0004] The device described in Patent Document 1 changes the cycle of requesting the driver to perform an action without distinguishing between a driver who has a high driving awareness and can easily perform a required action and a driver whose driving awareness has started to decline but who somehow manages to perform a required action. Therefore, the cycle of requesting an action may not be appropriate. The present disclosure provides a technology for requesting an action from a driver at a timing according to the driver's driving awareness. [Means for solving the problem]
[0005] A driving assistance device according to an aspect of the present disclosure includes a notification unit that notifies a driver of a vehicle, a detection unit that detects a response of the driver, and a control unit that is connected to the notification unit and the detection unit and drives the vehicle in an autonomous driving mode. The control unit causes the notification unit to execute a request process that requests the driver to perform multiple operations while the vehicle is being driven in an autonomous driving mode. The control unit continues the autonomous driving of the vehicle when it is determined based on the detection result of the detection unit that the driver has responded to the request process. The control unit determines the execution timing of the next request process so that the time interval from the execution timing of the request process to the execution timing of the next request process corresponds to the number of operations whose requests have been satisfied by the driver.
[0006] In this driving assistance device, a request process is executed to request a driver to perform multiple operations while the vehicle is being driven in an automatic driving mode. When it is determined that the driver has responded to the request process based on the detection result of the detection unit, the automatic driving of the vehicle is continued. Then, the execution timing of the next request process is determined so that the time interval from the execution timing of the request process to the execution timing of the next request process corresponds to the number of operations whose requests have been satisfied by the driver. In this way, by introducing a new parameter, the number of operations whose requests have been satisfied, the driving assistance device can, for example, set the execution timing of the next request process to be different between a driver who has a high driving consciousness and a driver who has a sign of a decrease in driving consciousness. Therefore, the driving assistance device can request the driver to perform an operation at a timing that corresponds to the driving consciousness of the driver.
[0007] In one embodiment, the plurality of operations may be operations other than steering wheel operations. In this case, the driving assistance device can reduce the inconvenience caused to the driver of the vehicle during automatic driving.
[0008] In one embodiment, the control unit may delay the execution timing of the next request process as the number of operations that have been satisfied by the driver increases. In this case, the driving support device can appropriately achieve both reduction in annoyance to the driver and maintenance of driving awareness.
[0009] In one embodiment, the driving assistance device may further include a storage unit that stores the degree of difficulty of each of the multiple operations. The control unit may be connected to the storage unit and determine the execution timing of the next request process so that the time interval from the execution timing of the request process to the execution timing of the next request process corresponds to the number of operations whose requests are satisfied by the driver and the degree of difficulty of the operations whose requests are satisfied by the driver. In this case, the driving assistance device can request the driver to perform an action at a timing that more accurately reflects the driver's driving consciousness. Effect of the Invention
[0010] According to the present disclosure, a technique is provided for requesting an action from a driver at a timing according to the driver's driving awareness. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a vehicle equipped with a driving assistance device according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a time interval for request processing. [Diagram 3] FIG. 3 is a graph showing an example of the number of satisfied operations versus time interval. [Figure 4] FIG. 4 is a flowchart showing the operation of the driving support device. [Diagram 5] FIG. 5 is a table illustrating the difficulty of request processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0013] FIG. 1 is a block diagram showing an example of a configuration of a vehicle equipped with a driving assistance device according to an embodiment. As shown in FIG. 1, the driving assistance device 1 is mounted on a vehicle 2 as an example. The vehicle 2 is, for example, an autonomous vehicle that drives autonomously. Autonomous driving is a driving in which some or all of a plurality of types of driving operations required for driving a vehicle are automatically performed based on surrounding information. As an example, levels are defined for autonomous driving. The level of autonomous driving is defined by, for example, the number of functions selected from a lane keeping function, a vehicle distance control function, an automatic starting function, an automatic stopping function, a lane changing function, a right / left turn control function, a collision suppression function, and a parking function. The autonomous driving to which the present disclosure is directed is not limited to a specific level of autonomous driving.
[0014] [Configuration of driving support device] The driving support device 1 includes, for example, a detection unit 3, a storage unit 4, an ECU (Electronic Control Unit) 5, and a notification unit 6. The detection unit 3 is configured to detect the driver's reaction. The detection unit 3 is, for example, a sensor device. In the example of FIG. 1, the detection unit 3 includes a driver monitoring sensor 31, a pedal sensor 32, and a switch 33. The driver monitoring sensor 31 is a sensor that detects the state of the driver. The driver monitoring sensor 31 is, for example, a camera that captures an image of the driver. Based on the detection result of the driver monitoring sensor 31, the driver's posture, face, line of sight, hand movement, and the like are detected. The pedal sensor 32 is a sensor that detects the amount of operation of the accelerator operation or the brake operation. The switch 33 is a sensor that detects the driver's operation on a button, a touch panel, or the like. The detection unit 3 is not limited to the example, and may be configured to detect the driver's reaction.
[0015] The storage unit 4 is a storage device that stores information necessary for controlling the ECU 5 (an example of a control unit). The notification unit 6 is a device that provides information to the driver, and is, for example, a display or a speaker.
[0016] The ECU 5 is connected to the detection unit 3, the storage unit 4, and the notification unit 6. The ECU is an electronic control unit having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a CAN (Controller Area Network) communication circuit, etc. The ECU 5 may be an ECU in which a plurality of ECUs are integrated.
[0017] The ECU 5 has a function of driving the vehicle in an autonomous driving mode. The ECU 5 grasps the situation of the vehicle 2 based on the detection results of a sensor (not shown) that detects the surrounding environment of the vehicle 2 and the detection results of a sensor that detects the driving state of the vehicle 2. Then, the ECU 5 operates each actuator of the vehicle 2 to achieve a target content based on the situation of the vehicle 2. The ECU 5 can start and end the autonomous driving of the vehicle 2. Ending the autonomous driving not only means switching from the autonomous driving to the manual driving, but also means ending the autonomous driving of the relevant level. In other words, ending the autonomous driving also includes ending the autonomous driving of the current level and starting the autonomous driving of a lower level.
[0018] The driver is required to constantly monitor the surroundings and, when necessary, operate the driving devices such as steering, braking, and accelerating to avoid obstacles. However, when relying on the automatic driving for a certain period of time or more, the driver tends to become overconfident in the automatic driving and lose consciousness of driving. In order to direct the driver's consciousness to driving, the ECU 5 causes the notification unit 6 to execute a request process that requests the driver to perform multiple operations while the vehicle 2 is running in automatic driving mode.
[0019] The multiple operations are two or more operations that the driver can perform. The multiple operations are, for example, operations other than steering wheel operation. Steering wheel operation means steering the steering wheel or touching the steering wheel. Operations other than steering wheel include pedal operation of the brake pedal or accelerator pedal, touch operation of a touch panel, pressing a button, fastening a seat belt, gestures, etc. The notification unit 6 requests the driver to perform, for example, two operations, a pedal operation and a button operation, as the requested processing. The notification unit 6 requests, for example, three operations, a pedal operation, a button operation, and a gesture, as the requested processing. The notification unit 6 may request multiple operations consecutively within a predetermined period, or may request that multiple operations be performed simultaneously.
[0020] The ECU 5 judges whether the driver has responded to the request process based on the detection result of the detection unit 3. For example, the ECU 5 judges whether the detection unit 3 has detected an operation of the driver that satisfies the request within a predetermined period after the notification unit 6 has requested a plurality of operations. An operation that satisfies the request is, for example, a button press operation performed by the driver in response to a request to operate a button, or a pedal depression operation performed by the driver in response to a request to operate an accelerator pedal. If the ECU 5 detects an operation of the driver that satisfies the request within the predetermined period, the ECU 5 judges that the driver has responded to the request process. If the detection unit 3 does not detect an operation of the driver that satisfies the request even after the predetermined period has elapsed, the ECU 5 judges that the driver has not responded to the request process.
[0021] When it is determined that the driver has responded to the request process, the ECU 5 continues the automatic driving of the vehicle 2. That is, the ECU 5 continues the automatic driving that is being performed when it is determined whether or not the driver has responded.
[0022] The ECU 5 periodically performs the above-mentioned request process in order to direct the driver's attention to driving. The ECU 5 then makes the time interval of the request process variable. FIG. 2 is a diagram for explaining the time interval of the request process. As shown in FIG. 2, the request process is periodically performed. In the following, the execution timing of the current request process is t1, the execution timing of the next request process is t2, and the time interval between the execution timings t1 and t2 is E1. The ECU 5 changes the execution timing t2 of the next request process according to the number of operations whose requests are satisfied by the driver. Specifically, the ECU 5 determines the execution timing t2 of the next request process so that the time interval E1 is a time interval according to the number of operations whose requests are satisfied by the driver.
[0023] The ECU 5 may make the time interval E1 longer as the number of operations whose requests are satisfied increases. In other words, the ECU 5 delays the execution timing t2 of the next requested process as the number of operations whose requests are satisfied increases. Alternatively, the ECU 5 may make the time interval E1 shorter as the number of operations whose requests are satisfied decreases. In other words, the ECU 5 advances the execution timing t2 of the next requested process as the number of operations whose requests are satisfied decreases. Note that "in response" means that there is a correlation, and does not necessarily have to be a monotonous increase or decrease, but also includes a gradual increase or decrease.
[0024] FIG. 3 is a graph showing an example of the relationship between the number of operations that satisfy the request and the time interval. The horizontal axis is the number of operations that satisfy the request, and the vertical axis is the time interval E1. As shown in FIG. 3, the time interval E1 is set to a time interval T1 as an initial setting value. As shown by the open data points, the time interval E1 may be increased each time the number of operations that satisfy the request increases to two, three, four, and so on. Alternatively, as shown by the black data points, the time interval E1 may be increased only when the number of operations that satisfy the request is three, and when the number of operations that satisfy the request is four, the time interval E1 when the number of operations that satisfy the request is three may be maintained. In this way, the increase may be gradual.
[0025] 1, the storage unit 4 stores the above-mentioned time interval T1 in advance. The ECU 5 may store in the storage unit 4 the determined execution timing t2 of the next requested process, and the like.
[0026] [Operation of driving support device] Fig. 4 is a flowchart showing the operation of the driving assistance device 1. The flowchart shown in Fig. 4 starts when the driving assistance device 1 receives an instruction to start driving assistance.
[0027] As shown in Fig. 4, first, the ECU 5 of the driving support device 1 judges whether or not the execution timing of the requested process has passed (step S10). If the execution timing t1 has passed (step S10: YES), the ECU 5 causes the notification unit 6 to execute the requested process (step S12). Next, the ECU 5 judges whether or not there is a reaction from the driver (step S14). If it is judged that there is a reaction from the driver (step S14: YES), the ECU 5 continues the automatic driving (step S16). Then, the ECU 5 determines the execution timing t2 of the next requested process according to the number of operations by the driver that satisfy the request (step S18).
[0028] If it is determined that there is no reaction from the driver (step S14: NO), the ECU 5 ends the automatic driving (step S20).
[0029] If the execution timing t1 has not passed (step S10: NO), if the execution timing t2 of the next requested process has been determined (step S18 completed), or if automatic driving has ended (step S20 completed), the flowchart shown in FIG. 4 ends.
[0030] [Summary of the embodiment] In the driving assistance device 1, a request process is executed to request the driver to perform multiple operations while the vehicle 2 is being driven in an automatic driving mode. When it is determined that the driver has responded to the request process based on the detection result of the detection unit 3, the automatic driving of the vehicle 2 is continued. Then, the execution timing t2 of the next request process is determined so that the time interval E1 from the execution timing t1 of the request process to the execution timing t2 of the next request process is a time interval corresponding to the number of operations whose requests have been satisfied by the driver. In this way, the driving assistance device 1 can set the execution timing t2 of the next request process to be different between a driver who has a high driving consciousness and a driver who has a sign of a decrease in driving consciousness, for example, by introducing a new parameter, that is, the number of operations whose requests have been satisfied. Thus, the driving assistance device 1 can request the driver to perform an operation at a timing corresponding to the driver's driving consciousness.
[0031] Although exemplary embodiments have been described above, various omissions, substitutions, and modifications may be made without being limited to the above-described exemplary embodiments.
[0032] [Variations] The driving assistance device 1 may introduce the concept of difficulty of operations in addition to the number of operations for which the driver has satisfied the requests. FIG. 5 is a table for explaining the difficulty of request processing. The table shown in FIG. 5 is stored in, for example, the storage unit 4, and is in a state in which the ECU 5 can refer to it as appropriate. As shown in FIG. 5, a difficulty level is associated with each request content. For example, a difficulty level of "low" is associated with an "accelerator operation" of request number "R1". A difficulty level of "slightly low" is associated with a "button operation" of request number "R2". A difficulty level of "slightly high" is associated with a "gesture" of request number "R3". In this way, a difficulty level is set for each operation.
[0033] The difficulty of a plurality of operations may be evaluated by adding up the difficulty of each of the individual operations, or may be evaluated by taking into consideration the fact that the operations are difficult when combined. In the example of FIG. 5, the difficulty level "medium" is associated with the "accelerator operation + button operation" of the request number "C1", and the difficulty level "high" is associated with the "accelerator operation + gesture" of the request number "C2". In this way, even if the number of operations is the same, different levels of difficulty can be set. The ECU 5 may adjust the time interval E1 according to the difference in difficulty even if the number of operations that satisfy the request is the same. For example, the ECU 5 may set the time interval E1 to be longer as the difficulty level of the operation that satisfies the request becomes higher. Such a setting can be realized, for example, by providing a gain that changes according to the difficulty level.
[0034] Furthermore, when it is determined that there is no reaction from the driver (step S14: NO), the ECU 5 may execute a requested process or give a warning before ending the autonomous driving.
[0035] Furthermore, the ECU 5 may adjust the time interval E1 by replacing the time required to satisfy the request with the number of operations or by considering the time required to satisfy the request together with the number of operations. For example, the ECU 5 may set the time interval E1 to be longer as the time required to satisfy the request becomes shorter.
[0036] This disclosure also includes the following provisions: [Clause 1] a notification unit that notifies a driver of the vehicle; A detection unit that detects a reaction of the driver; A control unit connected to the notification unit and the detection unit and configured to drive the vehicle in an autonomous driving mode; Equipped with The control unit is causing the notification unit to execute a request process for requesting a plurality of operations from the driver while the vehicle is being driven in an autonomous driving mode; continuing automatic driving of the vehicle when it is determined based on the detection result of the detection unit that the driver has responded to the request process; determining an execution timing of the next request process such that a time interval from the execution timing of the request process to the execution timing of the next request process corresponds to a number of operations whose requests have been satisfied by the driver; Driving assistance device. [Clause 2] 2. The driving assistance device according to claim 1, wherein the plurality of operations are operations other than steering wheel operation. [Clause 3] The driving assistance device according to claim 1 or 2, wherein the control unit delays the execution timing of the next request process as the number of operations for which requests have been fulfilled by the driver increases. [Article 4] A storage unit that stores the difficulty level of each of the plurality of operations, the control unit is connected to the storage unit, and determines the execution timing of the next request process such that a time interval from the execution timing of the request process to the execution timing of the next request process corresponds to a number of operations whose requests have been satisfied by the driver and a difficulty level of the operations whose requests have been satisfied by the driver. A driving assistance device according to any one of claims 1 to 3. [Explanation of symbols]
[0037] 1...driving assistance device, 2...vehicle, 3...detection unit, 4...storage unit, 5...ECU (an example of a control unit), 6...notification unit.
Claims
1. a notification unit that notifies a driver of the vehicle; A detection unit that detects a reaction of the driver; A control unit connected to the notification unit and the detection unit and configured to drive the vehicle in an autonomous driving mode; Equipped with The control unit is causing the notification unit to execute a request process for requesting a plurality of operations from the driver while the vehicle is being driven in an autonomous driving mode; continuing automatic driving of the vehicle when it is determined based on the detection result of the detection unit that the driver has responded to the request process; determining an execution timing of the next request process such that a time interval from the execution timing of the request process to the execution timing of the next request process corresponds to a number of operations whose requests have been satisfied by the driver; Driving assistance device.
2. The driving assistance device according to claim 1 , wherein the plurality of operations are operations other than steering wheel operations.
3. The driving support device according to claim 1 , wherein the control unit is configured to delay the execution timing of the next request process as the number of operations whose requests have been satisfied by the driver increases.
4. A storage unit that stores the difficulty level of each of the plurality of operations, the control unit is connected to the storage unit, and determines the execution timing of the next request process such that a time interval from the execution timing of the request process to the execution timing of the next request process corresponds to a number of operations whose requests have been satisfied by the driver and a difficulty level of the operations whose requests have been satisfied by the driver. A driving assistance device according to claim 1 or 2.
Citation Information
Patent Citations
Driver monitoring system
JP2015095162A
Information presentation device and information presentation method
JP2015185085A
Vehicle control device and vehicle control method
JP2017027180A
Driver monitoring system
JP2022012356A
Vehicle control system, vehicle control method, and program
JP2022022350A
