Driving Support Devices

Abstract

To provide a driving support device that reduces the annoyance of driving support for traffic signals to drivers who are not in a state of distracted driving.SOLUTION: A driving support device, which provides driving support to a driver of a vehicle for traffic signals when the traffic signals in front of the vehicle is in a state of prohibiting passing-through is prohibited, includes: a distracted driving determination unit that determines whether or not the driver is a distracted driver; and a driving support unit that controls the driving support for the traffic signals when the driver is determined to be a distracted driver even if the traffic signals in front of the vehicle are in the state of prohibiting the passing-through.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a driving assistance device. [Background technology]

[0002] Conventionally, JP 2021-047565 A is known as a technical document related to a driving assistance device. This publication discloses that when the vehicle speed is higher than a vehicle speed threshold, the display of a display body that indicates to the driver that the red light is on is prohibited. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-047565 Summary of the Invention [Problem to be solved by the invention]

[0004] However, depending on the situation, such as when turning right after entering an intersection, the driver may continue to drive the vehicle even if the traffic light turns red. In such a case, if driving assistance such as a warning to the driver is provided, the driver may feel annoyed. [Means for solving the problem]

[0005] One aspect of the present invention is a driving assistance device that provides driving assistance to a driver of a vehicle regarding a traffic light when the traffic light in front of the vehicle is in a passage prohibition state, and includes a absentminded driving state determination unit that determines whether the driver is in a absentminded driving state based on the driving operation of the driver, and a driving assistance unit that suppresses driving assistance regarding the traffic light when the absentminded driving state determination unit determines that the driver is not in a absentminded driving state even when the traffic light in front of the vehicle is in a passage prohibition state. The absentminded driving state determination unit determines, based on the driving operation of the driver, For traffic lightsWhen it is estimated that there is at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left, For traffic lights It is determined that the driver is not in a distracted driving state, For traffic lights When it is estimated that the driver does not have any intention to accelerate, decelerate, steer, or turn right or left, For traffic lights Determines that the driver is in a distracted driving state death , When it is determined that the driver's accelerator pedal operation amount is equal to or greater than an accelerator operation threshold within a certain time period including the approach determination timing when the vehicle approaches a traffic light, it is determined that the driver has an intention to accelerate with respect to the traffic light; when it is determined that the driver's brake pedal operation amount is equal to or greater than a brake operation threshold within the certain time period, it is determined that the driver has an intention to decelerate with respect to the traffic light; when it is determined that the driver's steering amount is equal to or greater than a steering threshold within the certain time period, it is determined that the driver has an intention to steer with respect to the traffic light; when it is determined that the turn indicator of the vehicle has been operated to turn on within the certain time period, it is determined that the driver has an intention to turn right or left with respect to the traffic light; and when it is determined that the driver's line of sight is directed toward the traffic light based on an image captured by the driver monitor camera of the vehicle, it is determined that the driver is not in a mindless driving state even if it is estimated that the driver does not have an intention to accelerate, decelerate, or turn right or left. .

[0006] According to a driving assistance device of one aspect of the present invention, when it is estimated that at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left is present, it is determined that the driver is not in a mindless driving state, and driving assistance for traffic lights is suppressed even if the traffic light in front of the vehicle is in a no-passage state, thereby reducing the annoyance felt by drivers who are not in a mindless driving state due to the driving assistance.

[0007] In a driving assistance device according to one embodiment of the present invention, the absentminded driving state determination unit determines whether the driver is in an awake state based on an image of the driver captured by a driver monitor camera that captures an image of the driver, and if it is determined that the driver is not in an awake state, it may determine that the driver is in a absentminded driving state regardless of the determination result based on the driver's driving operation. According to this driving assistance device, when the driver is not awake, even if driving operations such as depressing the accelerator pedal are performed, there is a high possibility that the operations are incorrect. Therefore, by determining that the driver is in a distracted driving state, it is possible to avoid erroneously suppressing driving assistance.

[0008] In a driving assistance device according to one embodiment of the present invention, the driving assistance unit determines whether the driver is in an awake state based on an image of the driver captured by a driver monitor camera that captures an image of the driver, and if it is determined that the driver is not in an awake state, the timing of alerting the driver during driving assistance may be made earlier than when it is determined that the driver is in an awake state. According to this driving assistance device, when it is determined that the driver is not awake, the timing of the driver's attention during driving assistance is made earlier than when it is determined that the driver is awake, thereby making it possible to provide an early attention to a driver who is not awake.

[0009] In a driving assistance device according to one aspect of the present invention, when a traffic light ahead of the vehicle is in a no-passing state, if the absentminded driving state determination unit determines that the driver is not in a absentminded driving state, the driving assistance unit may provide driving assistance by both audio output and image display, and if the absentminded driving state determination unit determines that the driver is in a absentminded driving state, the driving assistance unit may provide driving assistance by audio output or image display. According to this driving assistance device, when the driver is not determined to be in a mindless driving state, the driving assistance is provided by both audio output and image display, and when the mindless driving state determination unit determines that the driver is in a mindless driving state, the driving assistance is provided by both audio output and image display, thereby reducing the annoyance felt by drivers who are not in a mindless driving state by the attention alerts provided by both audio output and image display. Effect of the Invention

[0010] According to one aspect of the present invention, it is possible to reduce the annoyance felt by a driver who is not in a mindless driving state due to driving assistance for traffic lights. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a driving assistance device according to an embodiment; [Diagram 2] FIG. 13 is a diagram showing a situation in which a vehicle is approaching a traffic light that is in a no-passing state. [Diagram 3] 11A and 11B are diagrams illustrating a situation in which it is determined that the driver has an intention to turn right or left. [Figure 4] 5 is a flowchart illustrating an example of a driving assistance execution process. [Diagram 5]10 is a flowchart showing an example of a mindless driving state determination process; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] 1 is a device mounted on a vehicle (host vehicle) such as a passenger car to assist the driver in driving the host vehicle. The driving assistance device 100 provides driving assistance to the driver according to the illumination state of a traffic light ahead of the host vehicle.

[0014] [Configuration of driving support device] The configuration of the driving assistance device 100 will be described below with reference to the drawings. As shown in FIG. 1, the driving assistance device 100 includes a driving assistance ECU (Electronic Control Unit) 10 that performs overall management of the device. The driving assistance ECU 10 is an electronic control unit having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. In the driving assistance ECU 10, for example, various functions are realized by the CPU executing a program stored in the ROM. The driving assistance ECU 10 may be composed of multiple electronic units.

[0015] The driving assistance ECU 10 is connected to a forward camera 1 , a vehicle interior sensor 2 , a driving operation detection unit 3 , a driver monitor camera 4 , an actuator 5 , and an HMI [Human Machine Interface] 6 .

[0016] The front camera 1 is a camera for capturing an image of the area in front of the vehicle. The front camera 1 is provided, for example, on the rear side of the windshield of the vehicle. The front camera 1 transmits captured images of the area in front of the vehicle to the driving assistance ECU 10. The front camera 1 may be a monocular camera or a stereo camera.

[0017] The vehicle internal sensor 2 is a detection device that detects the traveling state of the vehicle. The vehicle internal sensor 2 includes a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor. The vehicle speed sensor is a detector that detects the speed of the vehicle. As the vehicle speed sensor, for example, a wheel speed sensor that is provided on the wheels of the vehicle or a drive shaft that rotates integrally with the wheels and detects the rotation speed of the wheels is used. The vehicle speed sensor transmits the detected vehicle speed information (wheel speed information) to the driving assistance ECU 10.

[0018] The acceleration sensor is a detector that detects the acceleration of the host vehicle. The acceleration sensor includes, for example, a longitudinal acceleration sensor that detects the acceleration in the longitudinal direction of the host vehicle, and a lateral acceleration sensor that detects the lateral acceleration of the host vehicle. The acceleration sensor transmits, for example, acceleration information of the host vehicle to the driving assistance ECU 10. The yaw rate sensor is a detector that detects the yaw rate (rotational angular velocity) around the vertical axis of the center of gravity of the host vehicle. For example, a gyro sensor can be used as the yaw rate sensor. The yaw rate sensor transmits the detected yaw rate information of the host vehicle to the driving assistance ECU 10.

[0019] The driving operation detection unit 3 is a detection device that detects driving operations of the vehicle by the driver, and includes at least one of an accelerator pedal sensor, a brake pedal sensor, a steering sensor, and a turn signal sensor.

[0020] The accelerator pedal sensor is provided, for example, on the shaft portion of the accelerator pedal and detects the amount of accelerator pedal operation (pressure or amount of depression) by the driver. The turn signal sensor detects the operation (on / off operation) of the turn signal by the driver. The turn signal sensor can be provided, for example, on the operation lever of the turn signal.

[0021] The brake pedal sensor is provided, for example, on the shaft of the brake pedal and detects the amount of brake pedal operation (pressure or amount of depression) by the driver. The steering sensor is provided, for example, on the steering shaft of the vehicle and detects the steering torque applied to the steering wheel by the driver. The turn signal sensor detects the operation of the turn signal lever of the vehicle by the driver.

[0022] The driver monitor camera 4 is a camera for capturing an image of the driver. The driver monitor camera 4 is provided, for example, on a cover of a steering column in front of the driver, and captures an image of the driver's head including the face. The driver monitor camera 4 transmits the captured image of the driver to the driving assistance ECU 10.

[0023] The actuator 5 is a device used to control the host vehicle. The actuator 5 includes at least a drive actuator and a brake actuator. The actuator 5 may include a steering actuator. The drive actuator controls the amount of air supplied to the engine (throttle opening) in response to a control signal from the driving assistance ECU 10, thereby controlling the driving force of the host vehicle. If the host vehicle is a hybrid vehicle, in addition to the amount of air supplied to the engine, a control signal from the driving assistance ECU 10 is input to a motor serving as a power source to control the driving force. If the host vehicle is an electric vehicle, a control signal from the driving assistance ECU 10 is input to a motor serving as a power source to control the driving force. The motor serving as a power source in these cases constitutes the actuator 5.

[0024] The brake actuator controls a brake system in response to a control signal from the driving assistance ECU 10, and controls the braking force applied to the wheels of the vehicle. For example, a hydraulic brake system can be used as the brake system. The steering actuator controls the drive of an assist motor that controls the steering torque of the electric power steering system in response to a control signal from the driving assistance ECU 10. In this way, the steering actuator controls the steering torque of the vehicle.

[0025] The HMI [Human Machine Interface] 6 is an interface for inputting and outputting information between the driving assistance device 100 and the driver. The HMI 6 includes, for example, a display, a speaker, and the like. The HMI 6 outputs images from the display and sounds from the speaker in response to a control signal from the driving assistance ECU 10. The display may be a HUD [Head Up Display] or a MID [Multi Information Display] provided on an instrument panel.

[0026] Next, a description will be given of the functional configuration of the driving assistance ECU 10. As shown in Fig. 1, the driving assistance ECU 10 has a traffic light recognition unit 11, a traffic light approach determination unit 12, a distracted driving state determination unit 13, and a driving assistance unit 14. Note that some of the functions of the driving assistance ECU 10 described below may be executed by a server capable of communicating with the vehicle.

[0027] The traffic light recognition unit 11 recognizes the lighting status of the traffic light in front of the vehicle based on the image captured by the front camera 1. The lighting status of the traffic light includes a pass permission state (e.g., green light) that allows the vehicle to pass, a pass prohibition state (e.g., red light) that prohibits the vehicle from passing, and a signal transition state (e.g., yellow light) that transitions from a pass permission state to a pass prohibition state. The signal transition state does not necessarily have to be included in the lighting status of the traffic light. The traffic light recognition unit 11 recognizes the traffic light by using well-known image processing methods such as edge extraction, noise removal, pattern matching, and deep learning. The traffic light recognition unit 11 recognizes whether the traffic light is in a pass prohibition state or not.

[0028] When the traffic light recognition unit 11 recognizes that the traffic light is in a no-passing state, the traffic light approach determination unit 12 determines whether the host vehicle has approached the traffic light. For example, based on the image captured by the front camera 1 or the detection result of the on-board radar sensor, the traffic light approach determination unit 12 determines that the host vehicle has approached the traffic light when the distance between the host vehicle and the traffic light is less than the distance threshold. For example, based on the image captured by the front camera 1 or the detection result of the on-board radar sensor, the traffic light approach determination unit 12 may determine that the host vehicle has approached the traffic light when the collision margin time [TTC: Time To Collision] of the host vehicle with respect to the traffic light is less than the TTC threshold. The distance threshold and the TTC threshold are thresholds of preset values. All thresholds used in the following description are thresholds of preset values.

[0029] Fig. 2 is a diagram showing a situation in which the host vehicle is approaching a traffic light in a passage prohibition state. Fig. 2 shows an intersection C, the host vehicle M, a traffic light TL, and a distance L between the host vehicle M and the traffic light TL. In the situation shown in Fig. 2, the traffic light approach determination unit 12 determines that the host vehicle has approached a traffic light, for example, when the distance L between the host vehicle M and the traffic light TL becomes less than a distance threshold value. Note that the traffic light approach determination unit 12 may determine whether the host vehicle has approached a traffic light when the traffic light recognition unit 11 recognizes that the traffic light is in a passage prohibition state or a signal transition state.

[0030] The absentminded driving state determination unit 13 determines whether the driver is in a absentminded driving state. For example, when the traffic light approach determination unit 12 determines that the vehicle is approaching a traffic light, the absentminded driving state determination unit 13 determines whether the driver is in a absentminded driving state with respect to the traffic light.

[0031] The absentminded driving state is a state in which the driver is driving absentmindedly without accurately recognizing the lighting state of the traffic lights. The absentminded driving state determination unit 13 determines that the driver is not in an absentminded driving state when it estimates that at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left is present. The absentminded driving state determination unit 13 determines that the driver is in an absentminded driving state when it determines that all of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left are not present.

[0032] The driver's intention to accelerate is the intention of the driver to accelerate the vehicle in order to pass the traffic light, taking into account the lighting state of the traffic light. For example, based on the detection result of the driving operation detection unit 3, the absentminded driving state determination unit 13 estimates that the driver has the intention to accelerate when it is determined that the driver's operation amount of the accelerator pedal is equal to or greater than the accelerator operation threshold. Based on the detection result of the vehicle interior sensor 2, the absentminded driving state determination unit 13 may estimate that the driver has the intention to accelerate when it is determined that the acceleration of the vehicle is equal to or greater than the acceleration threshold.

[0033] The driver's intention to decelerate is the intention of the driver to decelerate the vehicle in order to stop the vehicle, taking into account the lighting state of the traffic lights. For example, based on the detection result of the driving operation detection unit 3, the absentminded driving state determination unit 13 estimates that the driver has the intention to decelerate when it is determined that the driver's operation amount of the brake pedal is equal to or greater than the brake operation threshold. Based on the detection result of the vehicle interior sensor 2, the absentminded driving state determination unit 13 may estimate that the driver has the intention to decelerate when it is determined that the deceleration of the vehicle is equal to or greater than the deceleration threshold.

[0034] The driver's steering intention is the driver's intention to steer the vehicle based on the lighting state of the traffic lights. For example, based on the detection result of the driving operation detection unit 3, the absentminded driving state determination unit 13 estimates that the driver has the intention to steer when it is determined that the driver's steering amount is equal to or greater than the steering threshold. Based on the detection result of the vehicle interior sensor 2, the absentminded driving state determination unit 13 may estimate that the driver has the intention to decelerate when it is determined that the yaw rate of the vehicle is equal to or greater than the yaw rate threshold.

[0035] The driver's intention to turn right or left is the intention of the driver to steer the vehicle based on the lighting state of the traffic light. For example, based on the detection result of the driving operation detection unit 3, the absentminded driving state determination unit 13 estimates that the driver has the intention to turn right or left when it is determined that the turn indicator of the vehicle is operated to be turned on.

[0036] Fig. 3 is a diagram showing a situation in which it is determined that the driver intends to turn right or left. In Fig. 3, the vehicle M has the right turn signal turned on in order to change lanes to the right lane. The absentminded driving state determination unit 13 estimates that the driver intends to turn right or left because the right turn signal was operated to turn on in the situation shown in Fig. 3.

[0037] The absentminded driving state determination unit 13 may recognize the driver's line of sight and head direction based on the driver's captured image of the driver by the driver monitor camera 4, and may determine whether the driver's line of sight is directed toward a traffic light. When the absentminded driving state determination unit 13 determines that the driver's line of sight is directed toward a traffic light, it may determine that the driver is not in an absentminded driving state even if it cannot be estimated that the driver has an intention to accelerate or decelerate.

[0038] The absentminded driving state determination unit 13 may estimate the driver's intention, taking into consideration the fact that there is a lag between the timing at which the traffic light approach determination unit 12 determines that the vehicle approaches a traffic light (hereinafter, referred to as the approach determination timing) and the timing at which the driver recognizes the traffic light. For example, when the absentminded driving state determination unit 13 determines that the driver's accelerator pedal operation amount is equal to or greater than the accelerator operation threshold during a certain period before and after the approach determination timing, it is considered that the driver has recognized the illumination state of the traffic light and has the intention to accelerate, so that the absentminded driving state determination unit 13 may estimate that the driver has the intention to accelerate even if the driver has not operated the accelerator at the approach determination timing. The same applies to the intention to decelerate, the intention to steer, and the intention to turn right or left. The certain period may be 1 second, 3 seconds, 5 seconds, or 10 seconds or more.

[0039] The absentminded driving state determination unit 13 may determine whether the driver is in an awake state based on the image of the driver captured by the driver monitor camera 4. The awake state is a state in which the driver's driving consciousness is not impaired due to drowsiness or the like.

[0040] The absentminded driving state determination unit 13 may determine whether the driver is in an awake state based on at least one of the driver's eye closing rate per certain time period, the state of eye opening, the blinking frequency, and eye movement. For example, when the driver's eye closing rate per certain time period is equal to or greater than an eye closing rate threshold, the absentminded driving state determination unit 13 determines that the driver is not in an awake state. The method of determining the awake state is not particularly limited, and any well-known method can be adopted.

[0041] The absentminded driving state determination unit 13 may determine whether the driver is in an awake state based on the driver's line of sight and the direction of the driver's head. The absentminded driving state determination unit 13 may determine that the driver is in an awake state when the driver's line of sight is directed toward a traffic light. When the absentminded driving state determination unit 13 determines that the driver is not in an awake state, it may determine that the driver is in an absentminded driving state regardless of the determination result based on the driver's driving operation.

[0042] The driving assistance unit 14 performs driving assistance for the driver at the traffic light when the traffic light approach determination unit 12 determines that the vehicle is approaching a traffic light. The driving assistance may include a warning to the driver, or may include automatic deceleration control of the vehicle.

[0043] The driving support unit 14 issues a warning to inform the driver of the light status of a traffic light, for example. The driving support unit 14 issues the warning by sending a control signal to the HMI 6. The warning may be, for example, a buzzer sound output. The warning may be a voice output or an image display (for example, a predetermined icon display) on the MID of the instrument panel. The warning may be a projected display (icon display or text display) on the windshield of the vehicle by the HUD.

[0044] The driving support unit 14 may perform automatic deceleration control of the host vehicle. The driving support unit 14 executes the automatic deceleration control by transmitting a control signal to a brake actuator of the actuator 5. The driving support unit 14 performs the automatic deceleration control so that the host vehicle's speed becomes equal to or lower than a certain speed before the host vehicle reaches a traffic light.

[0045] When the traffic light approach determination unit 12 determines that the vehicle is approaching a traffic light, and the absentminded driving state determination unit 13 determines that the driver is not in an absentminded driving state, the driving assistance unit 14 suppresses driving assistance for the traffic light. The suppression of driving assistance means changing the driving assistance content to one that has a smaller impact on the driver. The suppression of driving assistance also includes prohibition of driving assistance.

[0046] Specifically, when the distracted driving state determination unit 13 determines that the driver is in a distracted driving state, the driving assistance unit 14 may provide driving assistance by alerting the driver through both audio output and image display, and when the driver is not determined to be in a distracted driving state (when the driver is determined not to be in a distracted driving state), the driving assistance unit 14 may provide driving assistance by alerting the driver through audio output or image display.

[0047] When the absentminded driving state determination unit 13 determines that the driver is in an absentminded driving state, the driving assistance unit 14 performs automatic deceleration control as driving assistance, and when the driver is not determined to be in an absentminded driving state, the driving assistance unit 14 may only provide a warning as driving assistance.

[0048] Furthermore, when the absentminded driving state determination unit 13 determines that the driver is not in an awake state, the driving assistance unit 14 may advance the timing of issuing a warning to the driver in the driving assistance compared to when the driver is determined to be in an awake state. For example, when the driving assistance unit 14 determines that the driver is not in an awake state, the driving assistance unit 14 advances the timing of the warning by advancing the timing of the approach determination by the traffic light approach determination unit 12. The traffic light approach determination unit 12 can advance the timing of the approach determination by changing the above-mentioned distance threshold and TTC threshold to larger values.

[0049] [Driving assistance device processing] Next, the processing of the driving support device 100 will be described with reference to the drawings. Fig. 4 is a flowchart showing an example of the driving support execution processing. The driving support execution processing is executed when the driver has turned on the driving support function.

[0050] As shown in Fig. 4, the driving assistance ECU 10 of the driving assistance device 100 recognizes whether or not the traffic light is in a passage-prohibited state in S10 using the traffic light recognition unit 11. The traffic light recognition unit 11 recognizes the traffic light using well-known image processing methods such as edge extraction, noise removal, pattern matching, and deep learning. If it is determined that the traffic light is in a passage-prohibited state (S10: YES), the driving assistance ECU 10 proceeds to S11. If it is not determined that the traffic light is in a passage-prohibited state (S10: NO), the driving assistance ECU 10 ends the current driving assistance execution process.

[0051] In S11, the driving assistance ECU 10 determines whether the host vehicle has approached a traffic light using the traffic light approach determination unit 12. The traffic light approach determination unit 12 determines that the host vehicle has approached a traffic light when the distance between the host vehicle and the traffic light is less than a distance threshold based on, for example, an image captured by the front camera 1 or a detection result of an on-board radar sensor. If the driving assistance ECU 10 determines that the host vehicle has approached a traffic light (S11: YES), it proceeds to S12. If the driving assistance ECU 10 does not determine that the host vehicle has approached a traffic light (S11: NO), it ends the current driving assistance execution process.

[0052] In S12, the driving assistance ECU 10 judges whether the driver is in an awake state by the absentminded driving state judgment unit 13. The absentminded driving state judgment unit 13 judges the awake state based on the image of the driver captured by the driver monitor camera 4 that captures the driver. If the driving assistance ECU 10 judges that the driver is in an awake state (S12: YES), the process proceeds to S13. If the driving assistance ECU 10 does not judge that the driver is in an awake state (S12: NO), the process proceeds to S14. If the driving assistance ECU 10 does not judge that the driver is in an awake state, the driving assistance ECU 10 considers that the driver is in an absentminded driving state.

[0053] In S13, the driving assistance ECU 10 judges whether the driver is in a mindless driving state by the mindless driving state judgment unit 13. The mindless driving state judgment unit 13 judges that the driver is not in a mindless driving state when it estimates that at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left is present. If it is judged that the driver is in a mindless driving state (S13: YES), the driving assistance ECU 10 proceeds to S14. If it is not judged that the driver is in a mindless driving state (S13: NO), the driving assistance ECU 10 proceeds to S15.

[0054] In S14, the driving assistance ECU 10 executes driving assistance for the traffic light by the driving assistance unit 14. The driving assistance unit 14 performs driving assistance by both audio output and image display via the HMI 6, for example. Thereafter, the driving assistance execution process for this time is terminated.

[0055] In S15, the driving assistance ECU 10 suppresses and executes driving assistance for traffic lights by the driving assistance unit 14. The driving assistance unit 14 issues a warning as driving assistance by either audio output or image display via the HMI 6, for example. Thereafter, the driving assistance execution process for this time ends. Note that the driving assistance ECU 10 may select prohibition of driving assistance as suppression of driving assistance for traffic lights.

[0056] 5 is a flowchart showing an example of the absentminded driving state determination process, which corresponds to the process of S13 in FIG.

[0057] 5, in S20, the driving assistance ECU 10 estimates whether or not the driver has no intention to accelerate using the absentminded driving state determination unit 13. If the driving assistance ECU 10 estimates that the driver has no intention to accelerate (S20: YES), the process proceeds to S21. If the driving assistance ECU 10 does not estimate that the driver has no intention to accelerate (i.e., if the driving assistance ECU 10 estimates that the driver has an intention to accelerate) (S20: NO), the process proceeds to S25.

[0058] In S21, the driving assistance ECU 10 estimates whether or not the driver has no intention to decelerate using the absentminded driving state determination unit 13. If the driving assistance ECU 10 estimates that the driver has no intention to decelerate (S21: YES), the process proceeds to S22. If the driving assistance ECU 10 does not estimate that the driver has no intention to decelerate (i.e., if the driving assistance ECU 10 estimates that the driver has an intention to decelerate) (S21: NO), the process proceeds to S25.

[0059] In S22, the driving assist ECU 10 estimates whether or not the driver has no intention to steer using the absentminded driving state determination unit 13. If the driving assist ECU 10 estimates that the driver has no intention to steer (S22: YES), the process proceeds to S23. If the driving assist ECU 10 does not estimate that the driver has no intention to steer (i.e., if the driving assist ECU 10 estimates that the driver has an intention to steer) (S22: NO), the process proceeds to S25.

[0060] In S23, the driving assist ECU 10 estimates whether or not the driver has no intention to turn right or left using the absentminded driving state determination unit 13. If the driving assist ECU 10 estimates that the driver has no intention to turn right or left (S23: YES), the process proceeds to S24. If the driving assist ECU 10 does not estimate that the driver has no intention to turn right or left (i.e., if the driving assist ECU 10 estimates that the driver has an intention to turn right or left) (S23: NO), the process proceeds to S25.

[0061] In S24, the driving assistance ECU 10 determines that the driver is in a mindless driving state by the mindless driving state determination unit 13. After that, the driving assistance ECU 10 ends the current mindless driving state determination process.

[0062] In S25, the driving assistance ECU 10 determines that the driver is not in a mindless driving state by the mindless driving state determination unit 13. After that, the driving assistance ECU 10 ends the current mindless driving state determination process.

[0063] According to the driving assistance device 100 of this embodiment described above, when it is estimated that there is at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left, it is determined that the driver is not in a mindless driving state, and driving assistance for traffic lights is suppressed even if the traffic light in front of the vehicle is in a no-passing state, thereby reducing the annoyance felt by drivers who are not in a mindless driving state due to the driving assistance.

[0064] In addition, according to the driving assistance device 100, when determining the wakefulness state of the driver, if the driver is not in the wakefulness state, the driver is considered to be in a mindless driving state, so that it is possible to avoid erroneously suppressing driving assistance based on a driving operation such as depressing the accelerator pedal, which is highly likely to be an erroneous operation, even if the driver who is not in the wakefulness state performs a driving operation. Furthermore, according to the driving assistance device 100, when it is determined that the driver is not in the wakefulness state, the timing of the driver's attention in the driving assistance is made earlier than when it is determined that the driver is in the wakefulness state, so that it is possible to provide an early attention call to a driver who is not in the wakefulness state.

[0065] In addition, according to the driving assistance device 100, when it is determined that the driver is not in a mindless driving state, the driving assistance is provided by both audio output and image display, and when it is determined by the mindless driving state determination unit 13 that the driver is in a mindless driving state, the driving assistance is provided by both audio output and image display, thereby reducing the annoyance felt by drivers who are not in a mindless driving state by the attention alerts provided by both audio output and image display.

[0066] Although the embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment. The present invention can be embodied in various forms including the above-mentioned embodiment and various modifications and improvements based on the knowledge of those skilled in the art.

[0067] The driving support device 100 does not necessarily have to include the driver monitor camera 4. In this case, the driving support device 100 does not need to perform processing using the driver monitor camera 4. [Explanation of symbols]

[0068] 1...forward camera, 2...vehicle interior sensor, 3...driving operation detection unit, 4...driver monitor camera, 5...actuator, 6...HMI, 10...driving assistance ECU, 11...traffic light recognition unit, 12...traffic light approach determination unit, 13...distracted driving state determination unit, 14...driving assistance unit, 100...driving assistance device, M...own vehicle, TL...traffic light.

Claims

1. A driving assistance device that provides driving assistance to a driver of a vehicle regarding a traffic light when the traffic light in front of the vehicle is in a no-pass state, comprising: a mindless driving state determination unit that determines whether the driver is in a mindless driving state based on a driving operation of the driver; a driving assistance unit that suppresses driving assistance for a traffic light in front of the vehicle when the absentminded driving state determination unit determines that the driver is not in an absentminded driving state even when the traffic light in front of the vehicle is in a no-pass state; Equipped with The absentminded driving state determination unit determines that the driver is not in an absentminded driving state with respect to the traffic light when it is estimated based on the driver's driving operation that at least one of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left is present, and determines that the driver is in an absentminded driving state with respect to the traffic light when it is estimated that all of the driver's intention to accelerate, the driver's intention to decelerate, the driver's intention to steer, and the driver's intention to turn right or left are not present, When it is determined that the operation amount of the accelerator pedal by the driver is equal to or greater than an accelerator operation threshold within a certain time period including an approach determination timing at which the host vehicle approaches the traffic light, it is determined that the driver has an intention to accelerate toward the traffic light, When it is determined that the amount of operation of the brake pedal by the driver is equal to or greater than a brake operation threshold within the certain period of time, it is determined that the driver has an intention to decelerate with respect to the traffic light; When it is determined that the steering amount of the driver is equal to or greater than a steering threshold within the certain period, it is determined that the driver has an intention to steer the vehicle with respect to the traffic light; When it is determined that a direction indicator of the vehicle is operated to be turned on within the certain period of time, it is determined that the driver has an intention to turn right or left at the traffic light; When it is determined that the driver's gaze is directed toward the traffic light based on an image of the driver captured by a driver monitor camera of the vehicle, the driving support device determines that the driver is not in a mindless driving state even if it is estimated that the driver has no intention of accelerating, decelerating, or turning right or left.

2. 2. The driving support device according to claim 1, wherein the absentminded driving state determination unit determines whether the driver is in an awake state based on a driver captured image by a driver monitor camera that captures an image of the driver, and when it is determined that the driver is not in an awake state, determines that the driver is in the absentminded driving state regardless of the driving operation of the driver.

3. 3. The driving assistance device according to claim 1, wherein the driving assistance unit determines whether the driver is in an awake state based on an image of the driver captured by a driver monitor camera that captures an image of the driver, and when it is determined that the driver is not in an awake state, the timing of issuing a warning to the driver in the driving assistance is made earlier than when it is determined that the driver is in an awake state.

4. The driving assistance device according to any one of claims 1 to 3, wherein when a traffic light in front of the vehicle is in a no-passing state and the absentminded driving state determination unit determines that the driver is in a absentminded driving state, the driving assistance unit provides a warning by both audio output and image display as the driving assistance, and when the absentminded driving state determination unit does not determine that the driver is in a absentminded driving state, the driving assistance unit provides a warning by audio output or image display as the driving assistance.

Images