Driving assistance systems

Abstract

To provide a driving support device that can perform appropriate driving support in correspondence with variation of driving skills of drivers.SOLUTION: A driving support device is provided with: an environment recognizing part 100 that recognizes an environment around a vehicle 1; travelling state detecting parts 310, 320 and 330 that detect a travelling state of the vehicle; a driving support control part 200 that performs driving support control of supporting driving of the vehicle by a driver D at the time when the vehicle enters a curve road and the like, on the basis of output of the environment recognizing part and of the travelling state detecting parts; and a driving skill estimating part 400 that estimates a driving skill of the driver D. The driving support control part changes contents of the driving support control, depending on the driving skill of the driver estimated by the driving skill estimating part. The driving skill estimating part estimates a driving skill at least once for each driving cycle of the vehicle.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a driving support device that performs driving support control for vehicles such as automobiles.

Background Art

[0002] As a technology related to driving support for vehicles such as automobiles, for example, Patent Document 1 describes that in a curve driving support device, based on the driver's brake operation amount and steering amount during curve driving, the average value of the displacement amount from the target trajectory, the variance value of the vehicle speed, etc., the driver's skill level is judged and driving support according to the level is controlled. Also, it describes performing skill evaluation considering lane keeping and driving support according to the skill. Patent Document 2 describes that in a driving support device that performs driving support in lane keeping driving, it supports steering and braking and sets (weights) the support amount according to the driver's skill estimated in advance. Patent Document 3 describes estimating the driver's ability to return to the lane, and when the ability is low, switching the support from steering torque assist control to vehicle stabilization control. Also, it describes estimating the driving ability according to the correspondence with the driver's driving operation in response to the assist torque. Patent Document 4 describes a driving awareness estimation device that monitors the driver's line of sight area and estimates the level of manual driving ability as spatial awareness ability based on the recorded lateral visual recognition time.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

[0004] Thanks to various driver assistance systems, control devices for the braking and driving forces of each wheel, suspension, and other components, driving a car has become much easier, requiring no particularly advanced skills and allowing drivers to easily perform maneuvers that faithfully reflect their intentions. However, this assumes that, for example, when driving on a curved road, the driver is capable of a series of basic driving operations, such as visually checking the area around the vehicle, controlling speed by braking, applying steering angle by steering, controlling speed by accelerating, and returning the steering angle by steering. For example, in cases where drivers have insufficient driving skills, such as inexperienced drivers or some elderly drivers, it may be necessary to frequently intervene with driver assistance control, and in extreme cases, such as when driving around curves, it may be better to have driver assistance control constantly intervening.

[0005] However, if the same driver assistance control is applied to all drivers, drivers with relatively high driving skills may feel that their freedom of control is diminished. Therefore, it is effective to change the content of driving assistance according to the driver's driving skills, but even for the same person, a driver's driving skills can vary from day to day due to their physical condition, and can also change continuously due to fatigue and emotional changes. In view of the above-mentioned problems, the object of the present invention is to provide a driver assistance device that responds to changes in the driver's driving skills and provides appropriate driving assistance. [Means for solving the problem]

[0006] To solve the above-mentioned problems, the present invention provides a driver assistance device comprising: an environment recognition unit that recognizes the environment around the vehicle; a driving state detection unit that detects the driving state of the vehicle; a driver assistance control unit that performs driver assistance control to support the driver's driving at least when entering a curved road and when driving on a curved road, based on the outputs of the environment recognition unit and the driving state detection unit; and a driver skill estimation unit that estimates the driver's driving skills. The system includes a gaze direction detection unit for detecting the direction of the driver's gaze, and a yaw angle detection unit for detecting the yaw angle of the vehicle with respect to the lane in which the vehicle is traveling. The driving support control unit changes the content of the driving support control according to the driving skills of the driver estimated by the driving skill estimation unit, and the driving skill estimation unit estimates the driving skills at least once for each driving cycle of the vehicle. The driving skill estimation unit estimates the driving skill using the history of the driver's gaze direction detected by the gaze direction detection unit and the yaw angle of the vehicle with respect to the lane direction at least one of the times when entering the curved road and when driving on the curved road. It is characterized by the following: According to this method, by estimating driving skills at least once during each driving cycle (the period from vehicle startup to the end of driving), it is possible to appropriately estimate the driver's driving skills even when there are changes in the driver's driving skills due to daily changes in physical condition, fatigue, emotional changes, etc. Furthermore, by changing the content of the driver's gaze control according to the estimated driving skill, appropriate driving assistance can be provided.

[0007] In the present invention, the driving skill estimation unit can be configured to sequentially repeat the estimation of the driving skill at predetermined intervals during one driving cycle of the vehicle. According to this, changes in driving skills due to changes in the driver's physical condition during the driving cycle can be reflected in the driver assistance control.

[0008] In the present invention, the system includes a gaze direction detection unit for detecting the direction of the driver's gaze and a yaw angle detection unit for detecting the yaw angle of the vehicle with respect to the lane in which the vehicle is traveling. The driving skill estimation unit can be configured to estimate the driving skill using the history of the driver's gaze direction detected by the gaze direction detection unit and the yaw angle of the vehicle with respect to the lane direction at least one of the times when entering a curved road and when traveling on the curved road. This method allows for an accurate estimation of a driver's driving skills when navigating curved roads.

[0009] In the present invention, the vehicle performance detection unit is provided to detect the performance of the vehicle, the driving support control unit changes the content of the driving support control in accordance with the change in the performance of the vehicle detected by the vehicle performance detection unit, and the vehicle performance detection unit is configured to detect the performance of the vehicle at least once for each driving cycle of the vehicle. According to this, appropriate driver assistance control can be implemented that reflects the effects of factors such as the number of occupants, the load of cargo, changes in the environment such as temperature and road surface conditions, and changes in the vehicle over time. In this case, the vehicle performance detection unit can be configured to detect information relating to at least one of the following: the characteristics of the tires, the characteristics of the suspension system, the total weight of the vehicle, and the weight distribution of the vehicle. According to this, it is possible to appropriately understand the vehicle's performance, which is closely correlated with driver assistance control, and to ensure the effects described above. [Effects of the Invention]

[0010] As described above, the present invention provides a driver assistance device that responds to changes in the driver's driving skills and provides appropriate driving assistance. [Brief explanation of the drawing]

[0011] [Figure 1] This figure schematically shows the system configuration of a vehicle having an embodiment of a driver assistance device to which the present invention is applied. [Figure 2] This diagram schematically shows the arrangement of the driver monitoring camera and surface pressure sensor in the driving assistance device of the embodiment. [Figure 3] This figure shows an example of the position history of a driver's central field of vision while a vehicle is traveling on a public road. [Figure 4] This diagram schematically shows the skeletal structure of the crew as viewed from the front. [Figure 5]It is a diagram showing an example of a driving line when a vehicle passes through a curved road. [Figure 6] It is a diagram schematically showing an example of the field of view that a driver visually recognizes when a vehicle enters the curve shown in FIG. 5. [Figure 7] It is a flowchart showing the operation at startup in a vehicle having the driving support device of the embodiment. [Figure 8] It is a flowchart showing the control when entering a curved road in the driving support device of the embodiment. [Figure 9] It is a flowchart showing the driving support control when driving on a curved road when it is determined that the driver is a highly skilled driver in the driving support device of the embodiment. [Figure 10] It is a flowchart showing the driving support control when driving on a curved road when it is determined that the driver is a low-skilled driver in the driving support device of the embodiment.

MODE FOR CARRYING OUT THE INVENTION

[0012] Hereinafter, an embodiment of a driving support device to which the present invention is applied will be described. The driving support device of the embodiment is provided, for example, in a four-wheeled automobile such as a passenger car. FIG. 1 is a diagram schematically showing the system configuration of a vehicle having the driving support device of the embodiment.

[0013] The vehicle 1 includes an environment recognition unit 100, a driving support control unit 200, an electric power steering (EPS) control unit 310, a power unit control unit 320, a brake control unit 330, a vehicle state recognition unit​​​​​​ The environmental recognition unit 100 recognizes the environment around the vehicle based on the outputs of various sensors and the like. The environment surrounding the vehicle that is to be recognized includes, for example, information regarding the lane shape of the road on which vehicle 1 is traveling, and the relative position and relative speed of various obstacles with respect to the vehicle. The environmental recognition sensor 100 is connected to a visible light camera 110, a millimeter-wave radar device 120, a laser scanner device 130, a high-precision map database 140, a positioning device 150, and the like. The environmental recognition unit 100 functions as the environmental recognition unit and the yaw angle detection unit of the present invention.

[0015] The visible light camera device 110 is an imaging device that captures images of the area around the vehicle (front, rear, sides, etc.) using visible light cameras such as stereo cameras and single-lens cameras. The visible light camera device 110 has a function to perform image processing on the captured image and detect the presence or absence of objects around the vehicle, the relative position and relative speed of the objects with respect to the vehicle, the lane shape, and so on. The millimeter-wave radar system 120 is a radar system that uses radio waves in a frequency band of, for example, 30 to 300 GHz, and has the function of detecting the presence or absence of an object and the relative position of the object with respect to the vehicle. The laser scanner device 130 has a function to scan the area around the vehicle by, for example, irradiating it with pulsed near-infrared laser light, and to detect the presence or absence of an object, the relative position of the object to the vehicle, the shape of the object, etc., based on the presence or absence of reflected light and the time difference until the reflected light returns.

[0016] The high-precision map database 140 stores data related to high-precision 3D map data (HD map) within the range where vehicle 1 is expected to travel. This data, for example, includes 3D data of lane markings, shoulder edges, and lane dividers (so-called white lines), with a resolution of, for example, centimeters, and contains information on latitude, longitude, and altitude. The positioning device 150 includes, for example, a receiver for a quasi-zenith satellite system such as GPS, a vehicle-to-infrastructure communication device, a gyro sensor for autonomous navigation, and detects the current position of vehicle 1.

[0017] The driver assistance control unit 200 performs driver assistance control based on the environment around the vehicle recognized by the environment recognition unit 100, the driving state of the vehicle 1 recognized based on the output of each unit and sensor described later, and the driving skills of driver D. Driving assistance control includes, for example, information presentation control that presents information to the driver D through images, sounds, vibrations, etc., and vehicle driving assistance control such as braking force control, power output control of the driving power source, and steering control.

[0018] The driver assistance control unit 200 is connected to an input / output device 210 and a communication device 220. The input / output device 210 includes, for example, an image display device that also serves as an input device such as a touch panel display, an output device such as an audio speaker, and an input device such as a physical switch or an audio microphone. Furthermore, the input / output device 210 includes a head-up display (HUD) that can display images superimposed on the direct view seen by the driver D through the front windshield. Driver D can use the input / output device 210 to make various settings related to driver assistance control and to receive various information. The communication device 220 communicates with a base station located outside the vehicle, for example, using a wireless communication line, and transmits and receives various types of data.

[0019] The electric power steering control unit 310 controls a steering device (not shown) that steers the steering wheels (typically the front wheels) of the vehicle 1, providing assist force in response to the steering operation of driver D, as well as steering force during automatic steering. The electric power steering control unit 310 is connected to a steering angle sensor 311, a torque sensor 312, a motor 313, and the like.

[0020] The steering angle sensor 311 is a sensor (steering angle detection unit) that detects the steering angle in the steering system. The torque sensor 312 is a sensor that detects the torque applied to the steering shaft to which a steering wheel (not shown) is connected, which is operated by the driver D. The electric power steering control unit 310 generates assist force according to the torque detected by the torque sensor 312. Motor 313 is an electric actuator that provides assist force and steering force to the steering system and generates rack thrust. The output of the motor 313 is controlled by the electric power steering control unit 310.

[0021] The power unit control unit 320 comprehensively controls the vehicle 1's power source and its auxiliary equipment. As a power source for driving, for example, an internal combustion engine (ICE), an electric motor, or an engine-electric motor hybrid system can be used. The power unit control unit 320 sets the required torque based on, for example, the amount of accelerator pedal operation (not shown), and controls the driving power source so that the actual torque generated by the driving power source matches the required torque.

[0022] The brake control unit 330 controls the braking force of the brake devices provided on each of the front, rear, left, and right wheels of the vehicle individually (for each wheel). The braking system can be configured, for example, to include a hydraulic disc brake. The brake control unit 330 is connected to the hydraulic control unit 331, vehicle speed sensor 332, acceleration sensor 333, yaw rate sensor 334, and the like.

[0023] The hydraulic control unit 331 is a hydraulic pressure control device that individually adjusts the brake fluid pressure of the wheel cylinders (not shown) of each wheel. The hydraulic control unit 331 includes an electric pump for pressurizing the brake fluid, and pressure boosting valves, pressure reducing valves, and pressure holding valves for controlling the brake fluid pressure in each wheel cylinder.

[0024] The hydraulic control unit 331 is connected to a master cylinder, wheel cylinders, etc. (not shown) via brake fluid piping. The master cylinder pressurizes the brake fluid in response to the driver's operation of the brake pedal (not shown). The brake fluid pressure generated by the master cylinder is transmitted to the wheel cylinder via the hydraulic control unit 331. The hydraulic control unit 331 has the function of overriding the brake fluid pressure generated by the master cylinder to increase or decrease the brake fluid pressure of each wheel cylinder. A wheel cylinder is installed on each wheel and, for example, presses the brake pad against the disc rotor, generating a frictional force (braking force) corresponding to the brake fluid pressure.

[0025] The vehicle speed sensor 332 is installed in the hub portion that rotatably supports each wheel, and is a sensor that generates a vehicle speed signal corresponding to the rotational speed of each wheel. The acceleration sensor 333 is a sensor (acceleration / deceleration detection unit) that detects acceleration acting on the vehicle body in the longitudinal direction and the lateral direction (vehicle width direction). The yaw rate sensor 334 is a sensor that detects the yaw rate, which is the rotational (spinning) angular velocity of the vehicle body around its vertical axis.

[0026] The vehicle state recognition unit 340 recognizes the suspension and tire characteristics of each wheel of the vehicle, as well as the vehicle's load state and weight distribution. The suspension and tire characteristics can be configured to recognize, for example, the spring constant and damping characteristics. For example, if the suspension is a pneumatic suspension using air springs, the spring constant can be estimated based on the internal pressure of the air springs. Also, if metal springs are used as suspension springs, the spring constant is a predetermined value. Furthermore, if the damper (shock absorber), which is a damping element installed in the suspension, is of the damping force adjustment type, the damping force characteristics can be recognized based on the setting state of the variable damping force mechanism. Furthermore, regarding tires, by detecting the air pressure, the spring constant and damping characteristics can be estimated using known tire characteristic data.

[0027] The vehicle's load condition (for example, the total vehicle weight) and the weight distribution of each wheel can be detected, for example, using stroke sensors installed in the suspension system of each wheel. For example, the load condition of each wheel can be detected from the spring constant of the suspension system and the suspension stroke relative to a predetermined reference state.

[0028] The electric power steering control unit 310, power unit control unit 320, brake control unit 330, and vehicle state recognition unit 340 described above work together with the environment recognition unit 100 to function as a driving state detection unit that detects the driving state of vehicle 1.

[0029] The occupant status determination unit 400 determines the conscious state, emotional state, health state, etc., of the occupant (typically driver D). Furthermore, the occupant status determination unit 400 detects the driver's gaze direction. The crew status group unit 400 is connected to a driver monitoring camera 401, a surface pressure sensor 402, and the like.

[0030] Figure 2 is a schematic diagram showing the arrangement of the driver monitoring camera 401 and the surface pressure sensor 402 in the driving assistance device of the embodiment. Vehicle 1 has a seat S in which driver D is seated. The seat S includes a seat cushion S1, a backrest S2, a headrest S3, and the like. The seat cushion S1 is the seat surface on which driver D's thighs, buttocks, etc., rest. The backrest S2 is the part that contacts the back of driver D and supports driver D's upper body. The backrest S2 protrudes upward and diagonally backward from near the rear of the seat cushion S1. The headrest S3 is located behind the driver's head and is the part that holds the head when it is pulled back. The headrest S3 is positioned to protrude upward from the upper edge of the backrest S2.

[0031] The driver monitoring camera 401 is an imaging device that captures images of driver D from the front of the vehicle. The driver monitoring camera 401 is positioned to include the driver D's face and hands, as they are gripping the steering wheel switch, within its imaging field of view. The driver monitoring camera 401 includes, for example, a solid-state image sensor such as a CMOS or CCD, an optical system such as a lens group that forms an image of a subject on the solid-state image sensor, a drive circuit for the solid-state image sensor, and an output processing circuit.

[0032] The surface pressure sensor 402 is provided on the seat cushion S1 and the backrest S2, and measures the distribution of surface pressure received by the driver D on the upper surface of the seat cushion S1 and the front surface of the backrest S2. Furthermore, the occupant status determination unit 400 may also be configured to include sensors other than those mentioned above. For example, sensors may be provided to acquire various biological information (so-called vital signs) such as the crew's heart rate, body temperature, blood pressure, and blood oxygen saturation, as well as breath alcohol concentration.

[0033] The occupant status determination unit 400 has the function of determining the occupant's gaze direction (central field of view position) and driving skills based on information about the environment around the vehicle recognized by the environment recognition unit 100, the vehicle's driving status including information detected by various sensors, and the occupant status detected by the driver monitoring camera 401, surface pressure sensor 402, etc.

[0034] The occupant status determination unit 400 can estimate the quality of an occupant's driving skills, for example, based on changes in their line of sight direction (direction from the eyes to the central field of vision). Figure 3 shows an example of the position history of the driver's central field of vision while the vehicle is traveling on a public road. Figure 3(a) shows data for low-skill drivers with relatively low driving skills, while Figure 3(b) shows data for low-skill drivers with relatively high driving skills. In Figures 3(a) and 3(b), the horizontal axis represents the angle in the left-right direction, and the vertical axis represents the angle in the up-down direction.

[0035] As shown in Figure 3, the gaze direction of low-skill drivers shows greater variation and frequency of variation compared to the gaze direction of high-skill drivers. This can be attributed to several factors, including the inability of less skilled drivers to properly judge what to focus on while driving, their inability to check their surroundings using peripheral vision while maintaining a stable central field of vision, and their tendency to focus too much on areas close to their own vehicle. On the other hand, even highly skilled drivers have been shown to move their eyes from side to side more frequently when visibility is poor (for example, when there is a blind corner where the road curves cannot be seen all the way to the exit, or when there is an intersection with a road where there is a concern about something suddenly appearing).

[0036] Therefore, the occupant status determination unit 400 estimates the occupant's driving skills based on fluctuations in the occupant's vertical line of sight direction (direction of central field of vision). For example, parameters such as the variance and standard deviation of vertical gaze positions, the frequency of vertical gaze movement, and the average value of vertical gaze movement can be used to estimate low driving skill based on an increase in the average value of these parameters within a predetermined period. Furthermore, driving skills may be estimated by using multiple parameters in combination. For example, the weighted sum of multiple parameters may be compared with a predetermined threshold to determine driving skills.

[0037] The occupant status determination unit 400 detects the occupant's vertical line of sight by applying predetermined image processing to the image captured by the driver monitoring camera 401. As an image processing method for detecting the direction of gaze, for example, the central position of the eyeball and the central position of the pupil may be detected from an image of the crew member's eyes, and the direction in which the pupil is pointing may be estimated from the deviation between these positions, and this may be used as the direction of gaze.

[0038] Alternatively, instead of estimating the gaze direction using the pupil position as described above, or by making an estimate of it, the skeletal state of the crew member may be estimated from the image, and the gaze direction may be estimated from the skeletal state. Figure 4 is a schematic diagram showing the skeletal structure of the crew as viewed from the front. When crew members are primarily looking at something close up (their gaze is directed downwards), they tend to be tense, and their shoulders are often raised. Therefore, the state determination unit 400 estimates the distance L1 between the position of the eye area E on the skull B1 and the upper part of the clavicle B2 based on the image captured by the driver monitoring camera 401, and can estimate that the line of sight is decreasing in proportion to the decrease in this distance L1. It should be noted that when estimating the direction of gaze in this manner, the positional relationship between the eye (E) and the clavicle (B2) may change depending on individual differences in the driver, their level of fatigue, tension, etc. In contrast, for example, when vehicle 1 is stopped at a red light or the like, and the occupants' line of sight is elevated to see the traffic light, the system can be configured to initialize each parameter used in the line of sight detection logic.

[0039] Figure 5 shows an example of a driving line when a vehicle is passing through a curved road. Figure 5 shows an example of a right curve in the case of left-hand traffic. When a vehicle V1 (typically vehicle 1) is driven by a highly skilled driver with relatively high driving skills, it often takes what is known as an "out-in-out" driving line in order to suppress the curvature of the vehicle's turning trajectory. In this case, at position P1 just before entering the curve, the vehicle will be positioned to the left (outside) of the lane in preparation for a right-hand curve.

[0040] Subsequently, the vehicle V1 begins to turn by braking as needed and the driver applying a rightward steering angle. Immediately after the start of the turn, at position P2, the vehicle V1 has a yaw angle θ with respect to the direction of travel in the lane, so that the front of the vehicle is facing the clipping point CP (the point where the driving line is furthest inward (inside of the turn)). As vehicle V1 continues moving and reaches the clipping point P3, its driving line becomes as close to the inside of the lane as possible. Around this time, the driver reduces the steering angle while accelerating, causing vehicle V1 to begin transitioning towards exiting the curve. At the exit starting position P4, vehicle V1 accelerates while reducing its steering angle, and its lateral position within the lane gradually shifts towards the outside. Subsequently, at exit point P5 after the curve, the steering angle becomes virtually zero, and vehicle V1 continues to accelerate to the predetermined speed. At this time, the lateral position within the lane will be aligned with the outside of the curve.

[0041] The driving styles of highly skilled drivers and less skilled drivers are thought to have the following characteristics, for example: First, let me explain the changes in your field of vision. Figure 6 schematically shows an example of the field of view a driver sees when a vehicle enters the curve shown in Figure 5. Here, "good visibility" refers to a situation where, for example, a clear view is available all the way to the exit of the curve. Furthermore, poor visibility refers to situations such as blind corners where the exit of the curve is not visible, or situations where there is a concern about vehicles suddenly veering off course.

[0042] In the case of highly skilled drivers, for example, when they identify a curve with good visibility, their central field of vision is, for example, centered in the lane width direction, while they use their peripheral vision to check the surrounding situation. Subsequently, from just before the clipping point CP, where the vehicle's driving line travels closest to the inside of the curve, until it passes the clipping point CP, the central field of vision is located on the inside (inside of the curve). An example of the central field of vision VP1 of a highly skilled driver at this time is shown in Figure 6. After passing the clipping point (CP), as the vehicle exits the curve, the central field of vision shifts outward, often moving to the area near the center of the lane. Furthermore, even in cases of poor visibility, the basic movement of the central field of vision is the same as in cases of good visibility. However, in the case of highly skilled drivers, the movement of the central field of vision is relatively small, and they tend to perceive their surroundings using their peripheral vision.

[0043] In contrast, in the case of less skilled drivers, even on curves with good visibility, their central field of vision may shift outwards, for example, when entering a curve, resulting in insufficient confirmation of their vehicle's driving line. Figure 6 shows an example of variation in the central visual field VP2 of a low-skill driver. Furthermore, drivers often find themselves staring intently at the inside of the curve from just before the clipping point (CP), through the clipping point, and even when exiting the curve. This frequently prevents them from shifting their driving line to the outside and exiting the curve in the ideal state. These characteristics tend to be particularly pronounced on curves where visibility is poor.

[0044] Furthermore, for example, as shown in Figure 5, if there is an oncoming vehicle V2, the driver may focus excessively on the oncoming vehicle V2, resulting in insufficient visibility of other areas. Low-skilled drivers are generally more likely to be distracted by their surroundings than by their own vehicle's driving line, and tend not to adequately gather information about the road ahead. This raises concerns that they may not be able to prepare for subsequent driving actions.

[0045] Furthermore, regarding steering, highly skilled drivers can navigate curves with minimal steering angle and maneuvers depending on the situation by using the aforementioned out-in-out line. On the other hand, less skilled drivers tend to drive along the inside of the lane from entry to exit due to a fear of drifting outwards. As a result, the curvature of the driving line increases, leading to greater lateral acceleration or the need for excessive deceleration. Furthermore, the eagerness to stay on the inside may result in excessive steering speed and angle, raising concerns that the driver may deviate from the lane into the oncoming lane or approach obstacles such as curbs.

[0046] Furthermore, regarding speed control (acceleration and deceleration), highly skilled drivers can decelerate to an appropriate speed before starting to steer when entering a curve, and maintain an appropriate vehicle speed that is suited to the steering angle, road surface conditions, and surrounding environment from entering the curve until passing the clipping point CP. Furthermore, when exiting a curve, the vehicle can be accelerated by performing a moderate acceleration operation that does not cause the vehicle to lose control.

[0047] In contrast, less skilled drivers may have difficulty judging the distance to the curve entrance and the curvature of the curve, resulting in sudden braking just before entering the curve or entering the curve at excessive speed. Furthermore, there is a concern that the vehicle's behavior may become unstable due to unnecessary deceleration and acceleration operations performed between entering a curve and passing the clipping point (CP). Furthermore, there is a concern that when exiting a curve, drivers may rush to accelerate excessively, causing the vehicle's behavior to become unstable.

[0048] In order to ensure stable driving regardless of the driver's skill level when driving on curved roads, the driver assistance system of this embodiment performs different driver assistance controls according to the driver's skill level, as described below. Figure 7 is a flowchart showing the startup operation of a vehicle equipped with the driver assistance device of the embodiment. This process is performed, for example, after the main power of vehicle 1 is turned on (ignition on), for each driving cycle. Here, the driving cycle refers to the period from when the main power of vehicle 1 is turned on, through the journey to the destination, until the main power is turned off. The following explains each step in order.

[0049] <Step S01: Vehicle Calibration> The driver assistance control unit 200 works in cooperation with the vehicle state recognition unit 340 to perform calibration and initialization (vehicle calibration) of parameters related to the performance of the vehicle 1. Vehicle calibration is performed, for example, after the start of a driving cycle, until all of the following conditions are met. (a) Passing through a right-angle intersection that requires stopping in accordance with a signal or stop sign a specified number of times (e.g., 3 times) or more. (b) The distance traveled reaches a predetermined distance (e.g., 4 km) (c) Continuous driving distance at a predetermined speed (e.g., 40 km / h) is greater than or equal to a predetermined distance (e.g., 200 m) Parameters calibrated here include, for example, the suspension of each wheel, the spring constant of the tires, the damping characteristics, the vehicle's load condition (load weight, total vehicle weight), and the load distribution on each wheel. Until calibration is complete, the values ​​obtained in the previous driving cycle will be used. Then, proceed to step S02.

[0050] <Step S02: Crew Calibration> The occupant status determination unit 400 assesses the quality of the occupant's (driver's) driving skills. In this case, the occupant status determination unit 400 may determine whether the driver is in a state unsuitable for driving, such as poor physical condition, unsuitable emotions for driving (distraction, anxiety, impatience, anger, etc.), or intoxication. If the driver is in a state unsuitable for driving, the occupant status determination unit 400 may issue a warning to the occupant or notify another base station via the driver assistance control unit 200. Such occupant calibration can be performed at any time during a driving cycle, for example, at predetermined intervals (e.g., 15 minutes) when the vehicle is traveling at a predetermined speed (e.g., 20 km / h) or higher. Until calibration is complete, the values ​​obtained in the previous driving cycle will be used. Then, proceed to step S03.

[0051] <Step S03: Start matching current location and map information> The environmental recognition unit 100 starts detecting the current position of its own vehicle using the positioning device 150. The environmental recognition unit 100 uses the detected current location to compare it with map data stored in the high-precision map database 140 and obtains information about the road shape (lane shape) and other information around the vehicle. Then proceed to step S04.

[0052] <Step S04: Start acquiring vehicle speed> The driver assistance control unit 200 obtains information regarding the vehicle speed calculated from the output of the vehicle speed sensor 332 from the brake control unit 340. Then, proceed to step S05.

[0053] <Step S05: Start of vehicle position and angle detection> The environmental recognition unit 100 uses the output of each sensor to start detecting the lateral position (position in the vehicle width direction) of the vehicle 1 within the lane in which it is traveling, and the longitudinal deviation (angle) of the vehicle 1 with respect to the direction of travel of the lane. Then, proceed to step S06.

[0054] <Step S06: Start of gaze direction detection> The occupant status determination unit 400 starts detecting the driver's gaze direction (direction of the central field of view) based on the image captured by the driver monitoring camera 401. Then proceed to step S07.

[0055] <Step S07: Start vehicle behavior detection> The brake control unit 330 uses the outputs of the acceleration sensor 333 and the yaw rate sensor 334 to start detecting the longitudinal, transverse, and vertical translational accelerations and yaw rate acting on the vehicle body. Then proceed to step S08.

[0056] <Step S08: Start detecting oncoming vehicles> The environmental recognition unit 100 uses a visible light camera device 110 or the like to start detecting other vehicles (oncoming vehicle V2, etc.) traveling in the direction approaching the vehicle in the oncoming lane adjacent to the vehicle's own lane. After that, the series of startup processes will be terminated.

[0057] After the startup process described above is completed, vehicle 1 will start the following control in response to approaching a curved road. Figure 8 is a flowchart showing the control of the driver assistance system in the embodiment when entering a curved road. The following explains each step in order.

[0058] <Step S11: Curve approach judgment> The environmental recognition unit 100 determines whether or not a curved road is approaching the vehicle based on the position of the vehicle detected by the positioning device 150 and the map data stored in the high-precision map database 140. If the curved road is approaching to the point where the estimated arrival time is less than or equal to a predetermined value, proceed to step S12; otherwise, repeat step S11.

[0059] <Step S12: Start of focused vehicle position and angle management> The environmental recognition unit 100 initiates focused management, detecting the vehicle's lateral position within the lane and its longitudinal angle relative to the direction of lane travel, with higher temporal and spatial resolution than under normal conditions. Then, proceed to step S13.

[0060] <Step S13: Focused monitoring and management of gaze direction> The occupant status determination unit 400 initiates focused management, detecting the driver's gaze direction with higher temporal and spatial resolution than under normal conditions. Then, proceed to step S14.

[0061] <Step S14: Start of focused vehicle behavior management> The driver assistance control unit 200 initiates focused management, detecting longitudinal, transverse, and vertical translational accelerations and yaw rate acting on the vehicle body with higher temporal and spatial resolution than under normal conditions. Then, proceed to step S15.

[0062] <Step S15: Start of focused management of oncoming vehicles> The environmental recognition unit 100 initiates focused management, detecting oncoming vehicles with higher temporal and spatial resolution than under normal conditions. Then, proceed to step S16.

[0063] <Step S16: Estimation of deceleration potential> The driver assistance control unit 200 estimates the deceleration potential, a parameter relating to the likelihood that the vehicle can safely decelerate to a predetermined speed by the time it enters a curve, based on the results of the vehicle calibration described above, the current vehicle speed, and the longitudinal inclination of the vehicle's lane. The deceleration potential is set to decrease in response to an increase in the vehicle's load weight, an increase in the degree of weight distribution bias towards the front or rear wheels, an increase in vehicle speed, and an increase in the downhill gradient of the road surface. The driving support control unit 200 functions as the deceleration potential estimation unit of the present invention. Then, proceed to step S17.

[0064] <Step S17: Driver Skill Assessment> The occupant status determination unit 400 determines whether the driver is a highly skilled driver with relatively high driving skills or a low-skill driver with relatively low driving skills. Driving skills can be assessed, for example, based on vertical eye movement during normal driving, as described above. Furthermore, the driver's skill may be determined based on their previous driving conditions on curved roads. For example, when entering a curved road (initial steering input - position P2 in Figure 5), if the vehicle's yaw angle θ relative to the lane is directed towards the clipping point CP, it can be determined that the driver is highly skilled, while if it is closer to being parallel to the lane, it can be determined that the driver is less skilled. After that, the series of processes will be terminated.

[0065] Next, we will explain the specific details of driver gaze control when driving on curved roads. First, we will explain the process when a high-skill driver is identified in step S17 described above. Figure 9 is a flowchart showing the driver assistance control during curved road driving when the driver is identified as a highly skilled driver in the driver assistance system of the embodiment. The following explains each step in order.

[0066] <Step S21: Determining the outside position upon entry> The environmental recognition unit 100 determines whether the vehicle's lateral position within the lane is within a predetermined out-area set on the outside of the curved road when the vehicle is at a predetermined distance from the entrance of the curved road. If the lateral position within the lane is within the out-of-bounds area, proceed to step S23; otherwise, proceed to step S22.

[0067] <Step S22: Determining the center position upon entry> The environmental recognition unit 100 determines whether the vehicle's lateral position within the lane is within a predetermined center area set in the center of the lane when the vehicle is at a predetermined distance from the entrance of a curved road. If the lateral position within the lane is within the center area, proceed to step S25; otherwise, assume the entry is from the inside and proceed to step S30.

[0068] <Step S23: Steering assist normal control> The electric power steering control unit 310 sets the correlation between the output of the torque sensor 312 and the assist force (output of the motor 313) to the state of normal driving. Then proceed to step S24.

[0069] <Step S24: Normal accelerator control> The power unit control unit 320 sets the correlation between the amount of accelerator pedal operation and the required torque used to control the driving power source to the state of normal driving. After that, the series of processes will be terminated.

[0070] Thus, when a highly skilled driver enters a curve from the outside, they often use an out-in-out line, resulting in a relatively large yaw angle θ (see Figure 5) that directs the vehicle towards the clipping point CP relative to the lane direction when entering the curve. Here, if the yaw angle θ of the vehicle relative to the lane direction is insufficient when entering a curve (for example, at the position corresponding to P2 in Figure 5), it may indicate an error in the estimation of the driver's driving skills or a driving error. In such cases, the system can implement controls such as automatically braking to reduce the vehicle speed, increasing the assist force of the power steering system to facilitate steering in the direction of increasing the steering angle, or generating a yaw moment in the vehicle so that it passes on the inside of the lane when passing the clipping point CP.

[0071] <Step S25: Slow deceleration control upon approach> The driver assistance control unit 200 issues a command to the brake control unit 330 to perform entry deceleration control, which automatically reduces the vehicle speed of vehicle 1 to a predetermined target speed before entering a curve. The target vehicle speed can be set, for example, according to the curvature of the curved road recognized by the environmental recognition unit 100 using the visible light camera device 110 and the high-precision map database 140. In entry deceleration control, the deceleration (braking force) is controlled to be suppressed in accordance with the reduction in the deceleration potential described above. Then proceed to step S26.

[0072] <Step S26: Steering assist suppression control (weak)> The driver assistance control unit 200 issues a command to the electric power steering control unit 310 to perform steering assist suppression control (steering force increase control) which reduces the output of the motor 313 (amount of assist from the electric power steering system) relative to the output of the torque sensor 312. This increases the steering force required when the driver steers in the direction of increasing the steering angle, as well as the steering force required to maintain the steering angle. This prevents excessive steering angle from being applied due to improper steering, which can lead to lane departure towards the inside or dangerously close proximity to oncoming vehicles (V2). Then proceed to step S27.

[0073] <Step S27: Accelerator suppression control> The power unit control unit 320 performs accelerator suppression control, which changes the correlation between the amount of accelerator pedal operation and the required torque in a direction that suppresses the output of the driving power source compared to normal operation, so that the required torque for the same amount of operation decreases. This prevents the vehicle from becoming unstable due to excessive driving force, even if the driver's skill level is lower than initially estimated. Then proceed to step S28.

[0074] <Step S28: Judgment of vehicle inward movement> The driver assistance control unit 200 determines, based on the output of the environment recognition unit 100, whether the driving line of vehicle 1 has moved beyond a predetermined distance towards the inside of the curve. For example, if the yaw angle θ of vehicle 1 is on the inward side (towards the clipping point CP) relative to the lane direction and is greater than or equal to a predetermined threshold, or if the lateral position of vehicle 1 within the lane shifts to the inward side by a predetermined amount or more, the process proceeds to step S29; otherwise, the series of processes ends.

[0075] <Step S29: Steering assist suppression control (strong)> The driver assistance control unit 200 issues a command to the electric power steering control unit 310 to perform steering assist suppression control (steering force increase control) (strong), which further reduces the amount of assist from the electric power steering system compared to the steering assist suppression control (weak) in step S26. This prevents situations where, after the driver has increased the steering angle to shift the driving line towards the inside of the lane due to increased steering force, a misoperation may cause an even greater increase in the steering angle, leading to lane departure or other problems. After that, the series of processes will be terminated.

[0076] <Step S30: Deceleration control during entry> The driver assistance control unit 200 issues a command to the brake control unit 330 to perform entry deceleration control, which automatically reduces the vehicle speed of vehicle 1 to a predetermined target speed before entering a curve. In the entry deceleration control, the deceleration is controlled to be suppressed in accordance with the reduction in the deceleration potential described above, and the target vehicle speed is set lower for the entry gradual deceleration control in step S25. Then proceed to step S31.

[0077] <Step S31: Steering assist suppression control (strong)> The driver assistance control unit 200 issues a command to the electric power steering control unit 310 to perform steering assist suppression control (steering force increase control) (strong), which further reduces the amount of assist from the electric power steering system compared to the steering assist suppression control (weak) in step S26. Then proceed to step S32.

[0078] <Step S32: Accelerator suppression control> The power unit control unit 320 performs accelerator suppression control, which changes the correlation between the amount of accelerator pedal operation and the required torque in a direction that suppresses the output of the driving power source compared to normal operation, so that the required torque decreases for the same amount of operation. After that, the series of processes will be terminated.

[0079] Figure 10 is a flowchart showing the driver assistance control during curved road driving when the driver is identified as a low-skill driver in the driver assistance system of the embodiment. The following explains each step in order.

[0080] <Step S41: Deceleration control during entry> The driver assistance control unit 200 issues a command to the brake control unit 330 to perform entry deceleration control, which automatically reduces the vehicle speed of vehicle 1 to a predetermined target speed before entering a curve. The target vehicle speed here is set even lower than the target vehicle speed in step S30 described above. Then proceed to step S42.

[0081] <Step S42: Steering assist suppression control (weak)> The driver assistance control unit 200 issues a command to the electric power steering control unit 310 to perform steering assist suppression control (steering force increase control) that reduces the amount of assist from the electric power steering system. The amount of reduction in the assist amount at this time can be set to the same amount as, for example, step S26 described above. Then proceed to step S43.

[0082] <Step S43: Vehicle speed maintenance control> The driver assistance control unit 200 works in cooperation with the power unit control unit 320 and the brake control unit 330 to perform speed maintenance control to maintain the vehicle speed of vehicle 1 at a predetermined target speed when passing through a curve. While vehicle speed maintenance control is in operation, the driver's accelerator operation is disabled or suppressed. Then proceed to step S44.

[0083] <Step S44: Judgment on suitability of driving line> The driver assistance control unit 200 uses the recognition results from the environment recognition unit 100 to calculate the amount of deviation in the lane width direction between a predetermined target driving line in which vehicle 1 passes through clipping point CP along the inside of the lane and the driving line in which vehicle 1 is actually driving. Furthermore, if the environmental recognition unit 100 recognizes an oncoming vehicle V2 approaching its own vehicle, the target driving line is set to be offset outwards compared to when no oncoming vehicle is recognized. If the deviation between the target driving line and the actual driving line exceeds a predetermined value, the system proceeds to step S45, indicating that control intervention to change the driving line is necessary. Otherwise, the current control is continued until the system exits the curve, after which the series of processes are terminated.

[0084] <Step S45: Yaw moment generation control> The driver assistance control unit 200 issues a command to the brake control unit 330 and performs yaw moment generation control, which generates a yaw moment in the direction that brings the vehicle 1 closer to the target driving line based on the difference in braking force between the left and right wheels. Alternatively, instead of generating such a braking force difference, a command may be given to the electric power steering control unit 310 to control the steering angle of the steering device using the motor 313, thereby generating a yaw moment in the vehicle 1. Then proceed to step S46.

[0085] <Step S46: Driving line maintenance control> The driver assistance control unit 200 continues to control the yaw moment that was started in step S45 so that the vehicle 1 travels along the target driving line. After vehicle 1 exits the curved road, each driver assistance control is terminated, and the series of processes is completed.

[0086] According to the embodiments described above, the following effects can be obtained. (1) By estimating driving skills at least once per driving cycle, it is possible to appropriately estimate the driver's driving skills even if there are changes in the driver's driving skills due to daily changes in physical condition, fatigue, emotional changes, etc. Furthermore, by changing the content of the driver's gaze control according to the estimated driving skill, appropriate driving assistance can be provided. (2) By repeatedly estimating driving skills at predetermined intervals during a single driving cycle, changes in driving skills due to changes in the driver's physical condition during the driving cycle can be reflected in the driver assistance control. (3) By estimating the driving skill using the history of the driver's gaze direction and the vehicle's yaw angle relative to the lane direction at least one of the following times: when entering a curved road and when driving on a curved road, the driver's driving skill for driving on curved roads can be estimated with high accuracy. (4) By performing vehicle performance detection (vehicle calibration) at least once during each driving cycle, appropriate driving assistance control can be implemented that reflects the effects of the number of occupants, the load of cargo, changes in the environment such as temperature and road surface conditions, and changes in the vehicle over time. (5) In vehicle calibration, by acquiring information on tire characteristics, suspension system characteristics, total vehicle weight, and vehicle weight distribution, it is possible to appropriately understand the vehicle's performance, which is closely correlated with driver assistance control, and to ensure the effects described above.

[0087] (modified version) The present invention is not limited to the embodiments described above, and various modifications and changes are possible, all of which fall within the technical scope of the present invention. (1) The configuration of the driver assistance device and the vehicle on which it is installed, as well as the specific details of the driver assistance control, are not limited to the embodiments described above and can be modified as appropriate. (2) The specific logic for estimating and determining the driver's driving skills is not limited to the configuration of the embodiment described above and can be modified as appropriate. For example, the driver's driving skills may be determined based on the frequency of lane swaying, variations in accelerator and brake operation, and the frequency of intervention by behavior stabilization control and ABS control. (3) In this embodiment, the amount of elevation of the driver's shoulder (clavicle) is detected based on images captured by a driver monitoring camera, but the driver's skeletal state may be detected by other methods. For example, the elevation of the driver's shoulder may be recognized based on the output of a surface pressure sensor provided on the backrest. [Explanation of Symbols]

[0088] 1 Vehicle 100 Environmental Recognition Units 110 Visible light camera system 120 Millimeter-wave radar system 130 Laser scanner equipment 140 High-precision map database 150 Positioning device 200 Driver support control unit 210 Input / Output Devices 220 Communication Devices 310 Electric Power Steering Control Unit 311 Steering angle sensor 312 Steering angle sensor 313 Motor 320 Power Unit Control Unit 330 Brake control unit 331 Hydraulic Control Unit 332 Vehicle speed sensor 333 Acceleration sensor 334 Yaw rate sensor 340 Vehicle state recognition unit 400 Crew Status Identification Unit 401 Driver monitoring camera 402 Surface pressure sensor P Passenger T Thumb SW steering wheel g interval S Seat S1 Seat Cushion S2 Backrest S3 Headrest V1 Vehicle V2 Oncoming vehicle θ Yaw angle B1 Skull B2 Clavicle E Eyes

Claims

1. An environment recognition unit that recognizes the environment around the vehicle, A driving state detection unit for detecting the driving state of the vehicle, A driving support control unit that performs driving support control to assist the driver when entering a curved road and when driving on a curved road, based on the output of the environmental recognition unit and the driving state detection unit, A driving skill estimation unit that estimates the driver's driving skills and A driver assistance device equipped with, A gaze direction detection unit for detecting the driver's gaze direction, A yaw angle detection unit for detecting the yaw angle of the vehicle with respect to the lane in which the vehicle is traveling. Equipped with, The driving support control unit changes the content of the driving support control according to the driving skills of the driver estimated by the driving skill estimation unit. The driving skill estimation unit estimates the driving skills at least once for each driving cycle of the vehicle. The driving skill estimation unit estimates the driving skill using the history of the driver's gaze direction detected by the gaze direction detection unit and the yaw angle of the vehicle with respect to the lane direction at least one of the times when entering the curved road and when driving on the curved road. A driver assistance system characterized by the following.

2. An environment recognition unit that recognizes the environment around the vehicle, A driving state detection unit for detecting the driving state of the vehicle, A driving support control unit that performs driving support control to assist the driver when entering a curved road and when driving on a curved road, based on the output of the environmental recognition unit and the driving state detection unit, A driving skill estimation unit that estimates the driver's driving skills and A driver assistance device equipped with, The vehicle includes a vehicle performance detection unit for detecting the performance of the vehicle, The driving support control unit changes the content of the driving support control according to the driving skills of the driver estimated by the driving skill estimation unit. The driver assistance control unit changes the content of the driver assistance control in accordance with the change in the vehicle's performance detected by the vehicle performance detection unit. The driving skill estimation unit estimates the driving skills at least once for each driving cycle of the vehicle. The vehicle performance detection unit performs a vehicle performance detection at least once during each driving cycle of the vehicle. A driver assistance system characterized by the following.

3. The driving skill estimation unit repeatedly estimates the driving skill at predetermined intervals during a single driving cycle of the vehicle. A driving support device according to claim 1 or claim 2, characterized by the above.

4. The vehicle performance detection unit detects information relating to at least one of the following: the characteristics of the tires, the characteristics of the suspension system, the total weight of the vehicle, and the weight distribution of the vehicle. The driving support device according to claim 2, characterized by the following:

Images