Driver assistance devices

By acquiring information about the target object, vehicle, and driver, the driver assistance device can determine that the vehicle may leave the lane and skip the alarm after the driver confirms that it is safe, thus solving the problem of drivers unintentionally leaving the lane and improving safety.

CN123104680APending Publication Date: 2026-11-17TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202511988745.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2025-05-15
Filing Date
2025-12-26
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing driver assistance devices may cause the vehicle to unknowingly drift out of its lane when the driver's line of sight is roughly in the same direction as the direction of travel but their attention is reduced, leading to a decrease in safety.

Method used

The system uses surrounding sensors, vehicle sensors, and driver sensors to acquire information about the target object, vehicle, and driver. Based on this information, the processor determines that the vehicle may leave the lane and uses an alarm to prevent it from leaving. The alarm is skipped after the driver confirms that the surrounding area is safe.

Benefits of technology

It improves the safety of the vehicle and its surroundings, avoiding the safety risks caused by alarms interfering with the driver when the vehicle unintentionally leaves the lane.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123104680A_ABST
    Figure CN123104680A_ABST
Patent Text Reader

Abstract

This invention provides a driving assistance device that improves the safety of a vehicle and surrounding pedestrians. The driving assistance device includes a driver sensor for acquiring information related to the driver's line of sight, i.e., line-of-sight information. The processor performs the following processing at a first time point when a first condition is met: acquiring the elapsed time from the last time point when a second condition for determining the vehicle's behavior as unstable was met, based on the history of the target information and / or vehicle information; and performing a skipping alarm processing if the elapsed time exceeds a threshold and a third condition is met based on the history of the line-of-sight information, determining that the driver has visually confirmed the safety of the surroundings within a predetermined period before the first time point.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a driving assistance device with the function of preventing a vehicle from leaving its driving lane. Background Technology

[0002] A driver assistance device with the function of preventing a vehicle from leaving its driving lane has been proposed (for example, see Patent Document 1 below). This device (hereinafter referred to as the "conventional device") includes a camera and a processor. The processor performs the following alarm processing: if it is determined from the image acquired by the camera that the vehicle is likely to leave its driving lane, it controls a notification device to issue a prescribed alarm to the driver of the vehicle.

[0003] However, a scenario is envisioned where the driver intentionally veers off the lane (e.g., changes lanes). In this scenario, the driver might find the aforementioned alarm inconvenient. Therefore, the existing device has the following function: if the deviation between the driver's line of sight and the vehicle's direction of travel is below a threshold, it is considered that the driver intends to veer off the lane, and the alarm is skipped.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2008-269399 Summary of the Invention

[0005] Even if the driver's line of sight is roughly in the same direction as the vehicle's travel, the driver's attention may decrease. The processor in the aforementioned existing device would skip the alarm processing even in this scenario. Therefore, the driver might unknowingly veer off the road, thus reducing the safety of the vehicle and its surroundings (pedestrians).

[0006] One of the objectives of this invention is to provide a driving assistance device that can improve the safety of vehicles and pedestrians in the surrounding area.

[0007] To achieve the above objectives, the driving assistance device 1 of the present invention includes: a peripheral sensor 21 for acquiring information related to a target object located around the vehicle VO, i.e., target object information; vehicle sensors 22 and 23 for acquiring information related to the behavior of the vehicle, i.e., vehicle information; and a processor 10 configured to perform the following alarm processing: when a first condition X, which is used to determine that the vehicle is likely to leave the lane it is traveling in, based on the target object information and the vehicle information, is met, the processor controls the vehicle's notification device 30 to issue a prescribed alarm to the driver of the vehicle.

[0008] The driver assistance device also includes a driver sensor 24 for acquiring information related to the driver's gaze, i.e., gaze information. The processor is configured to perform the following processing at the point when the first condition is met, i.e., at the first time point t0:

[0009] Based on the history of the target object information and / or vehicle information, obtain the elapsed time Δt from the point when the second conditions Y1 and Y2 used to determine the vehicle's behavior as unstable were last met; and

[0010] If the elapsed time exceeds the threshold Δtth and the third condition ZL and ZR, which are determined based on the history of the sight information, are met to indicate that the driver has visually confirmed the safety of the surroundings within a specified period before the first time point, then the alarm processing is skipped.

[0011] The processor of the driving assistance device according to this invention executes an alarm when the vehicle is likely to leave its lane. However, even when the vehicle is likely to leave its lane, the processor will skip the alarm execution if a certain period of time has passed since the vehicle left its unstable state and the driver has confirmed that the surroundings are safe. That is, the processor executes the alarm according to principle when the vehicle is in an unstable state or has just left such a state and the driver has not confirmed that the surroundings are safe. Therefore, according to this invention, a high degree of safety for the vehicle and its surroundings can be maintained when the driver is unlikely to have intentionally caused the vehicle to leave its lane.

[0012] In a driving assistance device according to one aspect of the present invention,

[0013] The processor is configured as follows:

[0014] If a first safety confirmation is made based on the line-of-sight information, and a second safety confirmation is made based on the area that the driver sees directly through the designated rearview mirror of the vehicle (i.e., the blind spot area), the third condition is deemed to be met.

[0015] Simply performing either a first safety confirmation by visually inspecting the vehicle's rearview mirror or a second safety confirmation by visually inspecting the blind spot area of ​​the rearview mirror is insufficient to definitively claim that the safety of the vehicle and its surroundings has been fully confirmed. In the driver assistance device described in this method, the safety of the vehicle and its surroundings is determined to have been confirmed when both the first and second safety confirmations have been performed. Therefore, the safety of the vehicle and its surroundings is highly maintained even when alarm processing is skipped.

[0016] In another aspect of the present invention, a driving assistance device,

[0017] The vehicle sensors include sensors installed on the driving operation device, i.e., driving operation sensors that output values ​​corresponding to driving operations.

[0018] The processor is configured to determine that the second condition is met when the rate of change of the value exceeds a predetermined value, based on the history of the value obtained from the driving operation sensor.

[0019] Therefore, the processor can relatively easily determine whether the vehicle's behavior is unstable.

[0020] In another aspect of the present invention, a driving assistance device,

[0021] The processor is configured as follows:

[0022] Based on the target information and / or the vehicle information, if the number of times the vehicle reverses its lateral movement direction within a specified period prior to the current time exceeds a specified number, the second condition is determined to be met.

[0023] Therefore, for example, in situations where the driver hesitates about choosing a route, or in scenarios where the vehicle is likely to leave its lane due to a decline in driver awareness, an alarm is triggered. This ensures a high level of safety for the vehicle and its surroundings. Attached Figure Description

[0024] Figure 1 This is a block diagram of a driving assistance device according to one embodiment of the present invention.

[0025] Figure 2 This is a top view showing an example of detecting a driver's gaze at the right-side rearview mirror based on images acquired by the driver's sensors.

[0026] Figure 3 This is a top view showing the direction (angle range) of the right-side blind spot area.

[0027] Figure 4 It is a graph showing the change in steering angle.

[0028] Figure 5 This is a flowchart of the first program executed by the CPU to implement the alarm function.

[0029] Figure 6 This is a flowchart of the second program executed by the CPU to implement the alarm function. Detailed Implementation

[0030] (roughly)

[0031] like Figure 1As shown, the driving assistance device 1 according to one embodiment of the present invention is applicable to a vehicle VO. The vehicle VO (hereinafter referred to as "vehicle") has an automatic driving function. The driving assistance device has the following function (alarm function): when the automatic driving function of the vehicle is disabled and the driver performs manual driving operation, and when the vehicle is likely to leave the lane it is traveling in, a prescribed alarm is issued to the driver of the vehicle.

[0032] (Specific structure)

[0033] Next, the structure of the driving assistance device 1 will be described in detail. For example... Figure 1 As shown, the driving assistance device 1 includes an ECU 10, on-board sensors 20, and a notification device 30.

[0034] ECU10 includes a microcomputer with CPU10a, ROM10b, RAM10c, timer 10d, etc. ECU10 is connected to another ECU via CAN (communication network).

[0035] The vehicle-mounted sensor 20 includes a camera 21, which serves as a peripheral sensor for acquiring information related to targets located around the vehicle. Furthermore, the vehicle-mounted sensor 20 includes a speed sensor 22 and a steering angle sensor 23, which serve as vehicle sensors for acquiring information related to the vehicle's behavior. Additionally, the vehicle-mounted sensor 20 includes a driver sensor 24 for detecting the driver's line of sight direction.

[0036] Camera 21 includes an imaging device. The imaging device may incorporate an imaging element such as a charge-coupled device (CCD) or a CMOS image sensor (CIS). Each imaging device may be located, for example, on the front, right, left, and rear surfaces of the vehicle. Each imaging device captures image data of the surrounding area of ​​the vehicle at a predetermined frame rate. Camera 21 also includes an image analysis device. The image analysis device sequentially acquires image data from each imaging device. The image analysis device analyzes the acquired image data and extracts information related to targets located around the vehicle from the image. For example, the image analysis device identifies a pair of white lines dividing the lane the vehicle is traveling in from other lanes and provides the coordinates of the positions of these white lines (e.g., the endpoints of each white line in the image's extension direction (the endpoint closer to the vehicle and the endpoint farther from the vehicle)) as target information to ECU 10.

[0037] Speed ​​sensor 22 detects the rotational speed (wheel speed) of each wheel and calculates the vehicle's speed sp0 (measured value) based on the wheel speed. Speed ​​sensor 22 provides this calculation result to ECU 10.

[0038] Steering angle sensor 23 detects the steering angle of the vehicle's steering wheels and provides the detection result to ECU 10.

[0039] Driver sensor 24 includes an in-vehicle camera. The in-vehicle camera includes a camera device. This camera device, for example... Figure 2 As shown, it is located inside the dashboard and faces rearward (towards the driver's headrest). The camera captures an image G by photographing the driver's head H at a specified frame rate. The camera then provides the captured image G to the ECU10.

[0040] The notification device 30 includes an image display device and an audio device. The image display device receives an image display command from the ECU 10 and displays an image according to the command. The audio device receives a voice playback command from the ECU 10 and plays voice according to the command.

[0041] (Alarm function)

[0042] The ECU10 calculates the lateral position of the vehicle in the lane it is traveling in based on the coordinates of the white line obtained from the camera 21 (for example, the lateral distance ΔDR between the right end of the front face of the vehicle and the right white line, and the lateral distance ΔDL between the left end of the front face and the left white line). The ECU10 then determines whether the following conditions X related to the lateral distances ΔDR and ΔDL are met.

[0043] Condition X... Either the lateral distance ΔDR or the lateral distance ΔDL is below the threshold ΔDth.

[0044] When condition X is met, ECU 10 executes the alarm processing of control notification device 30 to issue a prescribed warning to the driver. That is, ECU 10 sends a display command for a prescribed image indicating that the vehicle is likely to leave lane L to the image display device of notification device 30. In addition, ECU 10 sends a playback command for a prescribed voice indicating that the vehicle is likely to leave lane L to the audio device of notification device 30.

[0045] Here, we envision a scenario where a driver intentionally performs a lane-changing maneuver after confirming that the surrounding environment is safe. In this scenario, the driver might find the aforementioned warning inconvenient. Therefore, in this scenario, it is preferable to skip the warning. However, when the vehicle's behavior is unstable (e.g., after a collision avoidance maneuver, when the driver's level of awareness has decreased (including immediately after regaining awareness), or when the driver neglects to check the surrounding safety before changing lanes), from the perspective of the safety of the vehicle and surrounding pedestrians, it is preferable not to skip the aforementioned warning.

[0046] Therefore, as explained below, ECU 10 performs the following processing: a first determination process, at time t0 when condition X is determined to be met, determining whether sufficient time has elapsed since the driver left the unstable state of the vehicle; and a second determination process, within a predetermined period prior to time t0, determining whether the driver has confirmed the safety of the surroundings. Then, based on the results of these processes, ECU 10 determines whether to execute the aforementioned alarm processing (whether to skip it). Furthermore, there is no restriction on the execution order of the first and second determination processes.

[0047] (Preprocessing for the first decision-making process)

[0048] To determine whether sufficient time has elapsed since the vehicle emerged from an unstable state, ECU 10 performs the following preprocessing: ECU 10 continuously monitors the vehicle's behavior for instability and measures the elapsed time Δt from the point when the vehicle's behavior was last determined to be unstable (the point when the vehicle transitioned from an unstable state to a stable state). Specifically, ECU 10 sequentially acquires the steering angle from steering angle sensor 23 and stores this steering angle as steering angle history data in RAM 10c. Furthermore, ECU 10 sequentially acquires the speed sp0 from speed sensor 22 and stores sp0 as speed history data in RAM 10c. Based on the steering angle history data stored in RAM 10c, ECU 10 obtains the pattern of steering angle changes within a predetermined period T1 prior to the current moment. Also, based on the speed history data, ECU 10 obtains the pattern of speed sp0 changes within period T1. Based on the patterns of steering angle and speed sp0 changes within period T1, ECU 10 sequentially determines whether conditions Y1 and Y2 are met.

[0049] During the period Y1……, the number of times the lateral movement direction of the vehicle reverses N within T1 exceeds the threshold Nth.

[0050] Condition Y2 indicates that the lateral movement speed of the vehicle (spy) exceeds the threshold (spyth).

[0051] For example, the likelihood of condition Y1 being true increases when the driver hesitates about choosing a route or when their level of awareness decreases (drowsy driving). Furthermore, for example, the likelihood of condition Y2 being true increases when, to avoid a collision, the steering wheel is turned sharply if a pedestrian suddenly runs out in front of the vehicle. Alternatively, condition Y1 can also be defined as the number of times, within period T1, the driver transitions from a state with an absolute steering angle below a predetermined value to a state exceeding that predetermined value, exceeding a threshold.

[0052] If at least one of conditions Y1 and Y2 is met, ECU10 determines that the vehicle's behavior is unstable. ECU10 keeps timer 10d active as an up-counting timer, resetting the output of timer 10d (setting it to "0") whenever condition Y1 or Y2 is met. Thus, the elapsed time Δt (= the output of timer 10d) from the last time the vehicle's behavior was determined to be unstable is measured.

[0053] (First judgment and processing)

[0054] At time t0, ECU10 obtains time Δt from timer 10d. If time Δt exceeds a threshold Δtth (e.g., 10 minutes), ECU10 determines that sufficient time has elapsed since the behavior of the detached vehicle became unstable.

[0055] (Preprocessing for the second decision-making process)

[0056] As a preprocessing step to determine whether the driver has checked the safety of the surroundings before changing lanes, ECU 10 performs the following processing: ECU 10 determines the driver's head region in image G and obtains (estimates) head pose (3D information) based on feature points (landmarks) of head H. Here, ECU 10 uses, for example, the Perspective-n-Point (PnP) algorithm for head pose estimation. That is, ECU 10 calculates the rotation angles (pitch, yaw, and roll angles) of head H based on a predefined 3D facial model and corresponding points on image G. Next, ECU 10 determines the pupil region within the driver's eye region in image G and estimates the orientation of the eyeball E relative to head H. Then, ECU 10 synthesizes the head orientation and eye orientation to obtain the gaze direction as a 3D vector (with pitch, yaw, and roll angles as angular components), and stores this data (gaze data) in RAM 10c. Here, in pupil region estimation, ECU10 can use edge detection based on brightness gradients or the Pupil Center Corneal Reflection (PCCR) method using infrared illumination. Additionally, ECU10 can directly estimate the gaze direction from image G using a trained model including convolutional neural networks (CNNs) (e.g., GazeNet, iTracker, etc.).

[0057] However, the placement of the in-vehicle camera constituting the driver sensor 24 and the orientation (optical axis direction) of its lens are fixed. Furthermore, the vehicle is equipped with various rearview mirrors, but their positions are fixed. Therefore, it is possible to determine whether the driver is looking at the rearview mirrors based on data representing the positional relationship between the in-vehicle camera and the various rearview mirrors, and line-of-sight data (three-dimensional vector). Furthermore, the ECU 10 can determine, based on this data, whether the driver is looking at the direction of blind spots (e.g., in the areas to the side and rear of the vehicle that are not reflected in the rearview mirrors). Figure 3 (The angle range is indicated by a slant). Specifically, if the driver's line of sight, as determined by the line-of-sight data (components of a three-dimensional vector), is within the prescribed angle range RMC corresponding to the rearview mirror (interior rearview mirror) MC, the ECU 10 determines that the driver has viewed the rearview mirror MC. Furthermore, if the driver's line of sight, as determined by the line-of-sight data, is within the prescribed angle range RML corresponding to the left rearview mirror (left exterior rearview mirror), the ECU 10 determines that the driver has viewed the left rearview mirror ML. Furthermore, if the driver's line of sight, as determined by the line-of-sight data, is within the prescribed angle range RMR corresponding to the right rearview mirror (right exterior rearview mirror), the ECU 10 determines that the driver has viewed the right rearview mirror MR. Finally, if the driver's line of sight, as determined by the line-of-sight data, is within the prescribed angle range RBL corresponding to the left blind spot area, the ECU 10 determines that the driver has viewed the left blind spot area. Furthermore, if the driver's line of sight, as determined by the vision data, is within the specified angle range RBR corresponding to the right blind spot area, the ECU10 determines that the driver has been looking at the right blind spot area. Additionally, if the driver makes minor adjustments to the orientation of various rearview mirrors, the ECU10 correspondingly changes the preset angle ranges RMC, RML, RMR, RBR, and RBL to the amount of adjustment.

[0058] (Second Judgment Processing)

[0059] At time t0, ECU10, based on the history of gaze data (the trajectory of the gaze), determines whether the driver has confirmed the safety of the surroundings within a predetermined period T2 (e.g., 3 seconds) prior to time t0. Specifically, at time t0, ECU10 determines whether the following condition ZL is met when the lateral distance ΔDL is below the threshold ΔDth (when the vehicle is approaching the left end of lane L). On the other hand, at time t0, ECU10 determines whether the following condition ZR is met when the lateral distance ΔDR is below the threshold ΔDth (when the vehicle is approaching the right end of lane L).

[0060] Condition ZL……During period T2, the driver has performed a first safety check by visually inspecting the rearview mirror and the left rearview mirror, and a second safety check by visually inspecting the left blind spot area.

[0061] Condition ZR……During period T2, the driver has performed a first safety check by visually inspecting the rearview mirror and the right-side rearview mirror, and a second safety check by visually inspecting the right-side blind spot area.

[0062] Additionally, ECU 10 acquires the history of gaze data (changes in the three-dimensional vector) within period T2 based on the gaze data history. Within period T2, ECU 10 determines that condition ZL is met if the driver's gaze is present at least once in each of the angle ranges RMC, RML, and RBL (the order is not restricted). That is, in this case, ECU 10 considers the driver to have confirmed safety to the left and rear. On the other hand, ECU 10 determines that condition ZR is met if the driver's gaze is present at least once in each of the angle ranges RMC, RMR, and RBR (the order is not restricted). That is, in this case, ECU 10 considers the driver to have confirmed safety to the right and rear.

[0063] (Alarm skipped)

[0064] At time t0, if ECU10 determines that the lateral distance ΔDL is below the threshold ΔDth, sufficient time has elapsed since the vehicle has exited its unstable state, and if it determines that the driver has confirmed safety to the left and rear, then it skips the aforementioned alarm processing. Conversely, if ECU10 determines that the lateral distance ΔDR is below the threshold ΔDth, sufficient time has elapsed since the vehicle has exited its unstable state, and if it determines that the driver has confirmed safety to the right and rear, then it skips the aforementioned alarm processing.

[0065] Next, refer to Figures 5 to 6 The procedures PR1 and PR2 executed by the CPU 10a (hereinafter referred to as "CPU") to achieve the aforementioned function of the driver assistance device 1 (the function of skipping the alarm when a specified condition is met) will be described. The CPU begins executing procedure PR1 when the ignition switch of the vehicle is switched from the off state to the on state. Furthermore, the CPU begins executing procedure PR2 when it detects that condition X is met.

[0066] (Program PR1)

[0067] The CPU starts executing program PR1 from step 100 and proceeds to step 101.

[0068] In step 101, the CPU determines whether the vehicle's behavior is unstable (whether at least one of condition Y1 and condition Y2 is true). If the CPU determines that the vehicle's behavior is unstable (S101: Yes), it proceeds to step 102. On the other hand, if the CPU does not determine that the vehicle's behavior is unstable (S101: No), it proceeds to step 103.

[0069] In step 102, the CPU resets the output (time Δt) of timer 10d to "0". Then, the CPU proceeds to step 103.

[0070] In step 103, the CPU activates timer 10d as an up-counting timer. Then, the CPU returns to step 101. Alternatively, if timer 10d is already active as an up-counting timer when the CPU enters step 103, the CPU returns to step 101 while maintaining the active state of timer 10d.

[0071] (Program PR2)

[0072] The CPU starts executing program PR2 from step 200 and then proceeds to step 201.

[0073] In step 201, the CPU acquires the output (time Δt) of timer 10d. Then, the CPU proceeds to step 202.

[0074] In step 202, the CPU determines whether the time Δt exceeds the threshold Δtth. If the CPU determines that the time Δt exceeds the threshold Δtth (S202: Yes), it proceeds to step 203. On the other hand, if the CPU does not determine that the time Δt exceeds the threshold Δtth (S202: No), it proceeds to step 207.

[0075] In step 203, the CPU determines whether the lateral distance ΔDL is below the threshold ΔDth (whether the vehicle is approaching the left end of lane L). If the CPU determines that the lateral distance ΔDL is below the threshold ΔDth (S203: Yes), it proceeds to step 204. On the other hand, if the CPU does not determine that the lateral distance ΔDL is below the threshold ΔDth (S203: No), it proceeds to step 206. Furthermore, as described above, the CPU executes program PR2 when condition X (ΔDL≤ΔDth or ΔDR≤ΔDth) is met. Therefore, in step 203, if the CPU does not determine that the lateral distance ΔDL is below the threshold ΔDth, then the lateral distance ΔDR is below the threshold ΔDth. That is, in this case, the vehicle is approaching the right end of lane L.

[0076] In step 204, the CPU determines whether the driver has confirmed that it is safe to the left and rear. Specifically, within period T2, the CPU determines whether the driver's line of sight, as determined by the line-of-sight data, is contained at least once in each of the angle ranges RMC, RML, and RBL. If the CPU determines that the driver has confirmed that it is safe to the left and rear (S204: Yes), it proceeds to step 208. In this case, the CPU skips the alarm processing described later (step 205). Conversely, if the CPU does not determine that the driver has confirmed that it is safe to the left (S204: No), it proceeds to step 205.

[0077] In step 205, the CPU performs alarm processing. That is, the CPU controls the notification device 30 to provide the driver with prescribed (image and voice) information indicating that the vehicle is likely to leave lane L. Then, the CPU proceeds to step 208.

[0078] In step 206, the CPU determines whether the driver has confirmed that it is safe to the right and rear. Specifically, within period T2, the CPU determines whether the driver's line of sight, as determined by the line-of-sight data, is contained at least once in each of the angle ranges RMC, RMR, and RBR. If the CPU determines that the driver has confirmed that it is safe to the right and rear (S206: Yes), it proceeds to step 208. That is, in this case, the CPU skips the alarm processing described later (step 207). Conversely, if the CPU does not determine that the driver has confirmed that it is safe to the right and rear (S206: No), it proceeds to step 207.

[0079] In step 207, the CPU performs the same alarm processing as in step 205. Then, the CPU proceeds to step 208.

[0080] In step 208, the CPU terminates the execution of program PR2.

[0081] (Effect)

[0082] The ECU 10 of the driving assistance device 1 according to this embodiment performs a warning when the vehicle is likely to leave the lane L it is traveling in. However, even if a certain period of time has passed since the vehicle left the unstable state and the driver has confirmed that the surroundings are safe, the ECU 10 will skip the warning process when the vehicle is likely to leave the lane L. That is, the ECU 10 performs the warning process according to principle when the vehicle is in an unstable state or has just left that state and the driver has not confirmed that the surroundings are safe. Therefore, according to the driving assistance device 1 according to this embodiment, the safety of the vehicle and its surroundings can be maintained to a high degree when the driver is likely not intentionally causing the vehicle to leave the lane.

[0083] (Variation Example 1)

[0084] In the above embodiment, ECU 10 measures the elapsed time since the point in time when the vehicle left the unstable state by resetting timer 10d whenever condition Y1 and / or condition Y2 are determined to be met. Then, at point t0 when condition X is met, ECU 10 determines that sufficient time has elapsed since the vehicle left the unstable state if time Δt exceeds a threshold Δtth. Alternatively, ECU 10 can perform the following process: ECU 10 can perform the following process at point t0 when condition X is met. That is, ECU 10 refers to steering angle history data and extracts the steering angle at each moment within a predetermined length (e.g., 10 minutes) prior to the current moment (i.e., point t0). Then, ECU 10 determines whether condition Y3 and / or condition Y4 are met based on the daily time series of the extracted steering angles.

[0085] Condition Y3……The number of times the lateral movement direction of the vehicle reverses N within the period T3 exceeds the threshold Nth.

[0086] Condition Y4……During period T3, the lateral movement speed of the vehicle exceeds the threshold spyth.

[0087] Then, at time t0, ECU10 determines that sufficient time has elapsed since the vehicle has left the unstable state of behavior when conditions Y3 and Y4 are not met.

[0088] (Variation Example 2)

[0089] In the above embodiment, ECU 10 determines whether the vehicle's behavior is unstable based on the steering angle. Alternatively (or otherwise), ECU 10 can determine whether the vehicle's behavior is unstable based on the yaw rate. Furthermore, ECU 10 can, instead of (or otherwise) using the steering angle, determine whether the vehicle's behavior is unstable based on the vehicle's speed sp0 (the depth of the accelerator pedal and / or brake pedal). For example, ECU 10 can determine that the vehicle's behavior is unstable if, within period T1 (period T3), the speed sp0 exceeds a predetermined upper limit and the number of times the speed changes below a predetermined lower limit exceeds a threshold. Furthermore, for example, ECU 10 can determine that the vehicle's behavior is unstable if, within period T1 (period T3), the rate of change of speed sp0 (acceleration and deceleration) exceeds a threshold.

[0090] (Variation Example 3)

[0091] ECU10 can detect the operating status (flashing / off) of the vehicle's turn indicator lights and use this detection result as one of the conditions for skipping alarm processing. Specifically, at time t0, if ECU10 determines that the left turn indicator light is flashing, the lateral distance ΔDL is below the threshold ΔDth, sufficient time has elapsed since the vehicle left its unstable state, and the driver has confirmed safety to the left and rear, then the alarm processing is skipped. Similarly, at time t0, if ECU10 determines that the right turn indicator light is flashing, the lateral distance ΔDR is below the threshold ΔDth, sufficient time has elapsed since the vehicle left its unstable state, and the driver has confirmed safety to the right and rear (condition ZR is met), then the alarm processing is skipped.

[0092] Symbol Explanation

[0093] 1-Driver assistance device, 10-ECU, 20-Vehicle sensors, 30-Notification device.

Claims

1. A driving assistance device, comprising: Peripheral sensors are used to acquire information about objects located around the vehicle, i.e., object information. Vehicle sensors are used to acquire information related to the behavior of the vehicle, i.e., vehicle information; and The processor is configured to perform the following alarm processing: when a first condition is met, based on the target information and the vehicle information, determining that the vehicle is likely to leave its lane, the processor controls the vehicle's notification device to issue a prescribed alarm to the vehicle's driver. The driving assistance device is characterized in that it further comprises: A driver sensor, used to acquire information related to the driver's gaze, i.e., gaze information. The processor is configured to perform the following processing at the point in time when the first condition is met, i.e., at the first point in time: Based on the history of the target object information and / or vehicle information, obtain the elapsed time from the last time the second condition used to determine the vehicle's behavior as unstable was met; and If the elapsed time exceeds a threshold and the third condition is met, as determined by the history of the sight information, that the driver has visually confirmed the safety of the surroundings within a specified period before the first time point, the alarm skipping process is executed.

2. The driving assistance device according to claim 1, characterized in that, The processor is configured as follows: If a first safety confirmation is made based on the line-of-sight information, and a second safety confirmation is made based on the area that the driver sees directly through the designated rearview mirror of the vehicle (i.e., the blind spot area), the third condition is deemed to be met.

3. The driving assistance device according to claim 1, characterized in that, The vehicle sensors include sensors installed on the driving operation device, namely driving operation sensors that output values ​​corresponding to driving operations. The processor is configured as follows: Based on the history of the values ​​obtained from the driving operation sensor, if the rate of change of the value exceeds a predetermined value, the second condition is determined to be met.

4. The driving assistance device according to claim 1, characterized in that, The processor is configured as follows: Based on the target information and / or the vehicle information, if the number of times the vehicle reverses its lateral movement direction within a specified period prior to the current time exceeds a specified number, the second condition is determined to be met.

Citation Information

Patent Citations

  • Traffic lane departure alarm device for vehicle

    JP2008269399A