Lane keeping assist and lane centering
The lane keeping assist system addresses passenger notification issues and enhances lane keeping by determining a safety zone and applying discreet corrections, ensuring timely interventions to maintain vehicle position.
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2011-11-17
- Publication Date
- 2026-03-26
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
AREA OF INVENTION
[0001] The present invention relates to lane keeping assistants and lane centering systems for use in vehicles. GENERAL STATE OF THE ART
[0002] Some modern vehicles are equipped with lane departure warning systems that alert the driver if they drift out of their lane. These systems have several drawbacks. Many alert the driver audibly, which can also alert passengers to the apparent error. Some drivers may find the warnings embarrassing and therefore be inclined to deactivate the system if possible.
[0003] Another disadvantage concerns situations where such systems are used to notify the driver. Typically, they only notify the driver once the vehicle has already left its lane. By this point, the vehicle's angle relative to the road may already be too large for the driver to have sufficient time to correct the projected trajectory and avoid leaving the road.
[0004] It would be advantageous to provide a lane keeping assist system that addresses at least one of the disadvantages described above, at least partially.
[0005] Furthermore, in some situations it would be advantageous to equip a vehicle with the ability to autonomously stay in a lane while driving.
[0006] German patent DE 10 2004 026 590 A1 discloses an assistance system for motor vehicles with at least one monitoring unit that detects the area outside the vehicle, particularly in the direction of travel. Within the monitored area, a warning zone is defined on each side of the roadway, bounded by an earliest warning line and a latest warning line encompassing the respective lane marking or boundary. An evaluation unit for the data transmitted by the monitoring unit generates a warning signal for an acoustic, visual, and / or haptic warning and / or steering intervention when the evaluation unit detects that a defined warning threshold within the warning zone has been crossed.
[0007] US 2004 / 0262063A1 discloses a system for steering a vehicle, comprising: an actuator arranged in a vehicle to apply torque to a steerable wheel; a driver input device that is receptive to driver commands to steer the vehicle; and a sensor for determining a driver's intention and generating a signal indicating that intention. The system also includes: a lane-keeping system for detecting a position of the vehicle relative to a lane marking and generating a lane-position signal indicating that intention; and a controller in functional communication with the actuator, the driver input device, the first sensor, and the lane-keeping system. The controller provides a command to the actuator in response to the driver's intention, the current lane position, and a desired lane position.The controller executes a lane keeping algorithm consisting of a single control loop, based on at least one of the lane position and the lane position deviation.
[0008] DE 11 2006 002 558 T5 discloses lane departure warning and avoidance systems suitable for use on a vehicle, and in particular a selection lane departure warning and avoidance system designed to detect a spatial relationship between the vehicle and the boundaries of a lane, and to include operator or vehicle input in the algorithm for making a decision on a warning.
[0009] DE 10 2007 002 206 A1 discloses a lane departure warning and avoidance system which uses data merging to improve alarm timing for curved roads, operator control detection and performance measurement.
[0010] US 2007 / 0091173A1 discloses a lane monitoring system used on a vehicle to monitor the vehicle's position relative to the lane in which it is traveling. The system includes a front camera for capturing image data of the lane ahead, relating to an area essentially in front of the vehicle, and a rear camera for capturing image data of the lane behind, relating to an area essentially behind the vehicle. A processor is coupled to and configured with the front and rear cameras to receive the image data of the lane ahead and the lane behind.The processor is further configured to determine the position of the vehicle relative to the lane boundary from (1) the image data of the front lane when the front camera is operational, and (2) the image data of the rear lane when the front camera is not operational and the rear camera is operational. BRIEF DESCRIPTION OF THE INVENTION
[0011] In a first aspect, the invention relates to a lane keeping assist system for a vehicle. The lane keeping assist system defines a safety zone within which the driver can drive the vehicle. If the system determines that the driver risks leaving the safety zone, the system takes a corrective action, such as notifying the driver or applying a steering correction to the vehicle. The system adjusts the width of the safety zone depending on the driver's ability to remain within the safety zone.
[0012] In a specific embodiment of the first aspect, the lane keeping assist system includes a control unit and a lane marking detection device. The lane marking detection device is positioned to send information to the control unit regarding the positions of a left lane marking on the road on the left side of the vehicle and a right lane marking on the right side of the vehicle. The control unit is programmed or operational to: a) to determine a safety zone with a left safety zone boundary based on the recorded positions of the left lane boundaries and a right safety zone boundary based on the recorded positions of the right lane boundaries, wherein the safety zone has a width between the left and right safety zone boundaries, b) to take a corrective action if the control unit determines that the vehicle risks unintentionally leaving the safety zone, the corrective action being at least one action selected from the group of actions consisting of: notifying the driver that the vehicle risks leaving the safety zone; and applying a steering correction to the vehicle, and c) to adjust the positions of the left safety zone boundary and the right safety zone boundary to adjust the width of the safety zone if the vehicle remains within the safety zone for a selected period of time.
[0013] In a second aspect, the invention relates to a lane keeping assistant for a vehicle, wherein the lane keeping assistant is configured to discreetly notify the driver of the vehicle if the system determines that the vehicle risks unintentionally leaving the lane, so as not to notify any passengers in the vehicle.
[0014] In a specific embodiment of the second aspect, the lane keeping assist system includes a control unit, a lane marking detection device positioned to send information to the control unit regarding the positions of a left lane marking on the road on the left side of the vehicle and a right lane marking on the right side of the vehicle, and an output device configured to send haptic feedback only to the driver of the vehicle. The control unit is programmed or operational to: a) to determine, based on information from the lane departure warning device, whether the vehicle risks unintentionally leaving the lane; and b) to notify the driver, based on the determination made in step a), via the output device, that the vehicle risks leaving the lane.
[0015] In a third aspect, the invention relates to a lane keeping assistant for a vehicle, wherein the lane keeping assistant is configured to further check whether the vehicle risks leaving the lane on one side of the lane, even if the driver of the vehicle has activated the vehicle's turn signal indicator to indicate that the driver intends to leave the lane on the other side of the lane.
[0016] In a specific embodiment of the third aspect, the lane keeping assist system includes a control unit, a lane marking detection device positioned to send information to the control unit regarding the positions of a left lane marking on the road on the left side of the vehicle and a right lane marking on the right side of the vehicle, and an output device configured to send feedback to the driver of the vehicle. The control unit is programmed or operational to: a) to determine whether the vehicle risks unintentionally leaving the lane via a left side of the lane if the control unit determines that the driver of the vehicle intends to leave the lane via a right side of the lane; b) to determine whether the vehicle risks unintentionally leaving the lane via the right side of the lane if the control unit determines that the driver of the vehicle intends to leave the lane via the left side of the lane; and c) to notify the driver, based on the provisions made in steps a) and b), via the output device, that the vehicle is at risk of unintentionally leaving the lane.
[0017] In a fourth aspect, the invention relates to a lane centering system for use in a vehicle. The lane centering system is capable of autonomously steering the vehicle so that it remains within its lane. In one embodiment, the lane centering system includes a control unit that determines a target path for the vehicle based on several parameters. For example, the target path for the vehicle is based, at least in part, on whether the control unit has sufficient information to determine the positions of both lane boundaries or whether the control unit can only determine the position of one of the lane boundaries. The target path can also be selected based, in part, on whether the lane boundaries are parallel to the vehicle or whether one or both of them are not. In one embodiment, the control unit models each of the lane boundaries in a simplified form.This simplifies the determination of one of the target paths (the center line of the track). The simplified form can be a third-degree polynomial equation.
[0018] In a specific embodiment of the fourth aspect, the lane centering system includes a lane-delimiting detection device positioned to send information to the control unit regarding the positions of a left lane-delimiting marker on the road on the left side of the vehicle and a right lane-delimiting marker on the right side of the vehicle; a steering assist device configured to apply steering corrections to the vehicle; and a control unit programmed or operational to determine a target path for the vehicle based on information from the lane-delimiting detection device. The control unit is operationally connected to the steering assist device and instructs the steering assist device to apply selected steering corrections to the vehicle to steer the vehicle toward the target path.The target path is selected at least partially based on whether the control unit has sufficient information to determine the positions of both track boundaries or only one of the track boundaries. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The present invention will now be described by way of example only with reference to the accompanying drawings, in which: Fig. 1 a transparent top view of a vehicle with a lane keeping assist system according to an embodiment of the present invention; Fig. 2 a top view of the in Fig. 1. The vehicle shown is in a lane on a road, illustrating a safety zone determined by the lane keeping assist system, the safety zone having a first width; Fig. 3 a top view of the vehicle as in Fig. 3 is shown, where the safety zone has a second, smaller width; Fig. 4 a top view of the vehicle as in Fig. Figure 2 shows the vehicle currently moving from one lane to another; Fig. 5a a top view of the vehicle as in Fig. Figure 2 illustrates the modeling of the track boundaries; Fig. 5b a top view of the vehicle as in Fig. Figure 2 illustrates the determination of the track's center line and its offset from the vehicle's actual position; Fig. 5c a top view of the vehicle as in Fig. Figure 2 illustrates the determination of the offset of the track's centerline relative to the projected path of the vehicle based on the steering angle and the vehicle's speed; Fig. 6 a top view of the vehicle as in Fig. Figure 2 illustrates the determination of the projected path of the vehicle; Fig. 7 is a flowchart illustrating the programming of the control unit involved in determining a target path for the vehicle and steering the vehicle towards a target path; the Fig. 8a-8f, 9a-9f and 10a-10f Test results for properties of a closed circuit for three variants of the in Fig. 7 illustrated tax schemes show; Fig. 11 is a table illustrating decisions made by the lane centering system based on information determined with respect to lane boundaries; the Fig. 12a-12i are top views, some of which are shown in the table in Fig. 11 situations described illustrate; Fig. 13 is a graph that illustrates the relationships between variables associated with one of the parameters used to meet the criteria in the table. Fig. The 11 decisions shown can be used; and Fig. 14 is a graph that illustrates the relationships between variables associated with one of the other parameters used to meet the requirements in the table in Fig. The 11 decisions shown can be used. DETAILED DESCRIPTION OF THE INVENTION
[0020] Reference is made to Fig. Figure 1 shows a vehicle 10 incorporating a lane keeping assist system 11 according to an embodiment of the present invention. The vehicle 10 has a body 12, a lane departure warning device 13 mounted on the vehicle body 12, several wheels 14 supporting the body 12, a braking system 15 including a brake 16 associated with each wheel 14, a steering system 18 associated with the front wheels 14, and a control unit 19 that controls the operation of the lane keeping assist system 11. The lane keeping assist system 11 helps the driver (reference 20) to keep the vehicle 10 in its lane on a road. The lane has in Fig. 2 the reference sign 22 and the street the reference sign 27.
[0021] Lane 22 is bounded by a first lane boundary 24a on the first side of vehicle 10 (e.g., the left side of vehicle 10) and a second lane boundary 24b on the second side of vehicle 10 (e.g., the right side of vehicle 10). The lane boundaries 24a and 24b can be any suitable boundary type, such as solid painted lines, broken painted lines, raised road marking dots (Bott's dots), or any other suitable boundary type. It is understood that the lane boundaries 24a and 24b need not be the same. Lane 22 has a width W. L on, which is the lateral distance between the first lane boundary 24a and the second lane boundary 24b.
[0022] The lane departure warning device 13 is a camera 26 positioned to have a forward-facing field of view. The camera 26 is positioned behind the windshield of the vehicle 10.
[0023] The camera 26 is connected to the control unit 19 via any suitable means, such as an electrical line, and sends images to it, which the control unit 19 uses to determine the positions of the lane boundaries 24a and 24b.
[0024] The braking system 15 can be a braking system of any suitable type, such as a hydraulic braking system. The brake 16 on each wheel 14 may be a disc brake, as in Fig. Figure 1 shows. Alternatively, the braking system 15 could use disc brakes on the front wheels 14 and drum brakes (not shown) on the rear wheels 14. In the embodiment shown, the braking system 15 further includes a master cylinder 21, which is actuated via a brake pedal (not shown) in the interior, and two slave cylinders 23, which apply hydraulic pressure in respective brake circuits with reference numerals 25a and 25b.
[0025] Steering system 18 can be a steering system of any suitable type, such as a hydraulically driven steering system. For example, steering system 18 includes in Fig. In the example shown, a steering wheel 30 is connected to a steering column 32. The steering column 32 drives a valve element from a rotary valve 36 through which the steering column 32 passes. The steering column 32 terminates at a pinion 38, which engages a rack 40. The rotary valve 36 has two fluid lines connected to a tank / pump 42 and two further fluid lines connected to a first cylinder opening 43a and a second cylinder opening 43b on a cylinder 44. As is known from the prior art, when the steering wheel 30 is turned, the steering column 32 is rotated, which in turn rotates the valve element 34, thereby controlling the pressure of hydraulic oil at the two openings 43a and 43b of the cylinder 44. A piston (not shown) in the cylinder 44, which is connected to the rack 40, moves based on the pressure difference between the two openings.The rack 40 connects to each of the front wheels 14 via a connecting rod and a steering arm (both of which are not shown to conceal other components in . Fig. 1. not to cover).
[0026] The functionality of the Lane Keeping Assist 11 can be described as follows. The Lane Keeping Assist 11 can be activated in any suitable manner. For example, it can be activated by pressing a button on the vehicle's dashboard, or it can be activated automatically when the vehicle reaches a selected activation speed (e.g., 60 km / h) to indicate to the control unit 19 that the vehicle is on a road with lanes (e.g., a highway, a major city street). If the vehicle speed drops below a selected deactivation speed (e.g., 55 km / h), the Lane Keeping Assist 11 can be deactivated automatically.Deactivating System 11 at a lower speed than the speed at which it is activated prevents rapid switching on and off of System 11 when the driver's speed fluctuates around the activation speed. Alternatively, however, System 11 may be programmed or be operational in such a way that it activates and deactivates at the same speed (e.g., 60 km / h).
[0027] Once the system 11 is activated, the control unit 19 receives images from the camera 26, uses them to determine the positions of the lane boundaries 24a and 24b, and determines the lateral distance between each of them and the vehicle 10. The control unit 19 can use an algorithm of any suitable type to detect the lane boundaries 24a and 24b. For example, the control unit 19 can scan selected sections of the images for elements in a specific range of colors that would be representative of the color of typical highway lane markings, or for a series of reflective elements that shine in a specific range of colors that would be representative of the color of raised road marking dots (Bott's dots). The control unit 19 may take ambient brightness conditions into account. For example, it can adjust the ranges of colors it searches for depending on the time of day.
[0028] The control unit 19 also determines the initial positions of a first safety zone boundary 47a and a second safety zone boundary 47b, which define an initial safety zone 48 for the vehicle 10. Safety zone 48 is a zone in which, according to the assumption of the control unit 19, the vehicle 10 does not risk unintentionally leaving lane 22. Safety zone 48 has a width Ws, which is the lateral distance between the first safety zone boundary 47a and the second safety zone boundary 47b. The initial positions of the first safety zone boundary 47a and the second safety zone boundary 47b can be selected in any suitable manner. For example, they can simply be selected at a chosen distance inboard of the first lane boundary 24a and the second lane boundary 24b. This allows the width of safety zone 48 to vary depending on the width of lane 22.Alternatively, the positions of the safety zone boundaries 47a and 47b can be selected by choosing an initial width Ws for safety zone 48 and centering safety zone 48 between lane boundaries 24a and 24b. Alternatively, any other algorithm can be used to determine the initial positions for the safety zone boundaries 47a and 47b.
[0029] If the vehicle 10 leaves the safety zone 48, or if the control unit 19 predicts that it risks leaving the safety zone 48, the control unit 19 may determine that this was an error and that the vehicle 10 is at even greater risk of unintentionally leaving lane 22, and activates an output device 50 to notify the driver 20. The output device 50 can be any suitable type, for example, a haptic output device, such as a vibration motor connected to the steering wheel 30. By causing the steering wheel 30 to vibrate, the lane keeping assist system 11 notifies the driver 20 of the apparent driving error without notifying the passengers (with reference 52) in the vehicle 10.In this way, the driver 20 can correct the vehicle 10's course without the passengers 52 being aware that the driver 20 has required a notification from the system 11. This avoids embarrassing the driver and also spares the passengers 52 any potential stress or anxiety that the driver 20 is currently driving poorly. It should be noted that the vibration motor does not need to be directly connected to the steering wheel 30 to cause it to vibrate. For example, the vibration motor could be connected to the steering column 32, causing the column to vibrate, which in turn would cause the steering wheel 30 to vibrate. Alternatively, a vibration motor could be positioned elsewhere to discreetly notify the driver 20 to adjust the vehicle 20's course.For example, the vibration motor may be positioned in the driver's seat (not shown). Despite the advantages provided by an output device 50 that discreetly notifies the driver 20, it is nevertheless within the scope of the invention to provide an output device 50 that provides an output reaching both the driver 20 and the passengers 52. An example of such an output device 50 would be a loudspeaker that emits audible sounds, messages, or other warning noises.
[0030] If the vehicle 10 leaves the safety zone 48, the control unit 19 may activate an optional steering assist device 54, which applies steering corrections to the vehicle 10 to force it back into the safety zone 48. The steering assist device 54 may have any suitable structure. For example, the steering assist device 54 may include an electric motor 56 with a steering assist pinion 58 on its output shaft. The steering assist pinion 58 engages the main pinion 38.
[0031] When the control unit 19 actuates the steering assist motor 56, the steering assist motor 56 forces the steering assist pinion 58 to drive the main pinion 38 with a selected steering correction torque in a selected direction of rotation. The driver 20 feels the steering correction torque through the steering column 32. If the driver 20 actually wants to leave the lane 22, he / she can apply a torque to the steering wheel (which can be referred to as driver-applied torque) that overcomes the steering correction torque, so that the vehicle 10 moves along any path chosen by him / her.
[0032] The steering assist device 54 could alternatively include something else instead of a steering assist motor 56. For example, the steering assist device 54 could control the hydraulic pressure on the cylinder openings 43a and 43b in order to hydraulically force the rack 40 in a selected direction. By controlling the hydraulic pressure, a selected torque would be applied to the steering column 32, which could be overcome by the driver 20 via the steering wheel 30, if desired.
[0033] Regardless of the means used by system 11 to control the steering system 18, the system is preferably configured such that the driver 20 can overcome the steering correction by applying at least a selected minimum torque to the steering wheel 30. The selected torque can be any suitable torque, for example, 3 Nm. The selected torque can vary depending on the specific situation. For example, the selected torque on a straight road might be 3 Nm, but in a sufficiently sharp curve, the driver 20 might need to apply a torque of 3 Nm just to keep the vehicle 10 in its lane. Therefore, a greater torque than the selected torque could be used, which would mean that the driver 20 intends to change lanes 22 but has not activated the turn signal.In one embodiment, the control unit 19 may be programmed to determine, based on the images from the camera 16, whether the road has a curvature greater than any threshold curvature (e.g., approximately 0.0002 rad / m), and if it is determined that the curvature was at least that large, the control unit 19 would use a second, larger selected torque (e.g., 5 nm) as the minimum input from the driver 20 before the control unit 19 concludes that the driver 20 is currently intentionally steering the vehicle 10 in such a way that it leaves lane 22. In situations where the driver applies sufficient torque to overcome system 11, the control unit 19 may temporarily deactivate system 11 (e.g. for 10 seconds) to allow the driver 20 to complete the steering maneuver (e.g. a lane change) without interference from system 11.
[0034] Another alternative is that the steering assistance device 54 could be a device that applies a selected measure of braking force to the brake 15 on the front wheel 14 on one side of the vehicle 10 in order to steer the vehicle 10 in a selected direction.
[0035] In yet another alternative embodiment for use in vehicles such as electrically powered vehicles, which have a first motor driving at least one of the side wheels of the driver and a second motor driving at least one of the side wheels of the passenger, the steering assistance device 54 could be a device that causes acceleration at one of the motors and deceleration at the other of the motors.
[0036] Part of the programming of control unit 19 with respect to lane keeping is described below. As noted above, control unit 19 may be programmed to select a safety zone 48 located at a selected distance inland from the left lane boundary 24a and the right lane boundary 24b. This has an advantage over a system that selects a specific width for a safety zone and then centers the safety zone within the detected lane. In such a system, it is at least theoretically possible that the system could become confused if it loses sight of one of the lane boundaries during operation. It is possible that, while searching for the missing lane boundary, the system might mistakenly interpret a marking on the road outside the lane as a lane boundary.Under such circumstances, the system could then realign the safety zone within what it considers to be the newly determined lane. Consequently, it is possible that the safety zone could suddenly shift by several feet. As a result, the system might attempt to steer the vehicle toward the new safety zone, which could be undesirable, if not fatal. If, instead, control unit 19 is programmed to define the safety zone 48 as a selected distance onboard from the lane boundaries 24a and 24b, such a scenario is less likely to occur.
[0037] To enable the control unit 19 to determine whether the vehicle 10 risks unintentionally leaving lane 22, the control unit 19 uses the images from the camera 26 to determine the positions of the lane boundaries 24a and 24b at a selected distance in front of the vehicle 10, for example, 20 m in front of the vehicle 10, up to approximately 100 m in front of the vehicle, depending on factors such as visibility, traffic, weather, and time of day. The control unit 19 determines the positions of the safety zone boundaries 47a and 47b at a selected distance in front of the vehicle 10 based on the positions of the lane boundaries 24a and 24b and determines the projected path of the vehicle based on a steering sensor (not shown) and optionally also based on other parameters. In particular, the control unit 19 determines the projected path of one or more selected control points on the vehicle 10. In the Fig. In the embodiment shown in Figure 1, the control unit 19 selects a control point with reference numeral 60, which is located along the longitudinal centerline CL of the vehicle. The control point 60 can, for example, be the position where the camera 16 is mounted in the vehicle (more specifically, the lens of the camera 16). The vehicle 10 then determines whether the vehicle 10 is projected as leaving lane 22 by determining whether the projected path of the control point 60 leaves the safety zone 48. If the control unit 19 determines that the projected path of control point 60 moves control point 60 out of safety zone 48, and if the control unit 19 is not shown that the driver 20 is currently intentionally leaving lane 22 (e.g., by determining that the vehicle's turn signal is on), the control unit 19 may determine that the vehicle 10 risks unintentionally leaving lane 22.Once the control unit 19 reaches this determination, it can take action to correct the problem (e.g., by warning the driver or, for example, by automatically steering the vehicle 10 to move the projected path of the control point 60 towards the center of the safety zone 48). Such actions (e.g., warning the driver 20 or applying a steering correction to the vehicle 10) can be referred to as corrective actions taken by the control unit 19.
[0038] If the control unit 19 determines that the vehicle's turn signal indicator is on, the control unit 19 can temporarily deactivate the lane keeping assist system 11 to allow the driver 20 to complete the lane change without interference. In one embodiment, the control unit 19 reactivates the system 11 ten seconds after the turn signal indicator is switched off. The turn signal indicator has in Fig. 1 the reference number 61.
[0039] Optionally, if the turn signal 61 is activated, the control unit 19 may be programmed to deactivate the activation of system 11 on only one side (the side indicated by the turn signal activation). Consequently, system 11 can continue to operate with the safety zone boundary 47a or 47b on the other side of lane 22. For example, if driver 20 activates the turn signal 61, indicating that they will move into the next lane to the left of vehicle 10, the control unit 19 could deactivate the left safety zone boundary 47b while continuing to monitor whether vehicle 10 risks unintentionally leaving the right side of lane 22 (i.e., by continuing to monitor the projected path of vehicle 10 relative to the right safety zone boundary 47a).If the control unit 19 determines that the vehicle 10 risks unintentionally leaving the right side of lane 22, the control unit 19 may take a corrective action as described above (e.g. by warning the driver or by applying a steering correction to the vehicle 10).
[0040] It is noted that if vehicle 10 passes the lane restriction 24a in the above example (in Fig. (as shown in Figure 4), the control unit 19 will eventually detect lane boundary 24a as the right lane boundary because it will no longer be on the left side of the vehicle 10. Because the control unit 19 continues to monitor the vehicle's distance from the right safety zone boundary, there is at least a theoretical possibility that the control unit 19 could conclude that a corrective action is appropriate, such as notifying the driver 20 or attempting to steer the vehicle 10 more aggressively into the left lane 22. To prevent this, if the control unit 19 detects that the vehicle 10 is currently crossing lane boundary 24a, it can be programmed to suspend system control of the right safety zone boundary for a selected period. (e.g., for 3 seconds) to temporarily deactivate the system to allow the driver 20 time to complete the lane change. After the 3-second period, the control unit 19 can reactivate the system 11. It is understood that the control unit 19 would also be programmed to temporarily deactivate the system control of the left safety zone boundary when crossing the right lane boundary as part of an intended lane change (e.g., when the driver 20 has activated the turn signal 61 to indicate a lane change to the right).
[0041] With reference to Fig. 2. The initial positions of the safety zone boundaries 47a and 47b can be selected as any suitable positions. For example, they can be selected to represent half the vehicle width on either side of the left lane boundary 24a and the right lane boundary 24b. If the control point 60 is on the centerline CL of the vehicle 10, the safety zone 48 is large enough to allow the lateral edges of the vehicle 10 (with references 62a and 62b) to be on the right of the lane boundaries 24a or 24b before the control unit 19 determines that the control point 60 leaves the safety zone 48.
[0042] If the control unit 19 has not had to take any corrective action during driving for a selected period, the control unit 19 could reduce the width of the safety zone 48 by increasing the distances of the safety zone boundaries 47a and 47b on either side of their respective lane boundaries 24a and 24b. As a result, the control unit 19 would take a corrective action (e.g., warning the driver or automatically steering the vehicle) if the vehicle is farther from either lane boundary 24a or 24b than it would have been based on the initial positions of the safety zone boundaries 47a and 47b. For example, the initial positions of the safety zone boundaries 47a and 47b could be selected to be, as noted above, half the vehicle width from the lane boundaries 24a and 24b.Consequently, for a vehicle that is, for example, 72 inches wide, the initial positions of the safety zone boundaries 47a and 47b may be 36 inches to the side of each of the lane boundaries 24a and 24b. After some time of driving, if the driver 20 has not caused the control unit 19 to take a corrective action, the control unit 19 may adjust the positions of the safety zone boundaries 47a and 47b so that they are further to the side. For example, the control unit 19 may move the safety zone boundaries 47a and 47b to the side by 2 mm for each second that the control unit 19 has not needed to take a corrective action (i.e., for each second that the vehicle 10 has not risked leaving lane 22 according to the determination of the control unit 19).The control unit 19 can progressively adjust the lateral safety zone boundaries 47a and 47b until it reaches their maximum lateral positions. These maximum lateral positions can be selected based on any suitable criteria, such as the width of the vehicle 10, the width of the track 22, or any specific acceptable minimum width for the safety zone 48. In one embodiment, the maximum lateral positions of the safety zone boundaries 47a and 47b might be selected to correspond to the wheels 14 of the vehicle 10, namely 75 cm lateral to the track boundaries 24a and 24b, or might correspond to providing a safety zone 48 with a selected alternative width (e.g., 20 cm), whichever is smaller.In other words, for a track 22 that is 350 cm wide and a vehicle that is 170 cm wide, if the maximum lateral positions of the safety zone boundaries 47a and 47b are used to position the wheels 75 cm lateral to the track boundaries 24a and 24b, this would correspond to an initial expected safety zone width of 30 cm. Because 20 cm is less than 30 cm, the control unit 19 allows the safety zone boundaries 47a and 47b to be shifted 80 cm lateral to each of the track boundaries 24a and 24b, so that the safety zone width reaches a minimum width of 20 cm. For a track 22 that is 330 cm wide and a vehicle that is 170 cm wide, if the maximum lateral positions of the safety zone boundaries 47a and 47b are used to position the wheels 75 cm lateral to the track boundaries 24a and 24b, this would correspond to a safety zone width of 10 cm.Because 10 cm is less than 20 cm, the control unit 19 allows the safety zone boundaries 47a and 47b to be shifted 75 cm inwards from each of the lane boundaries 24a and 24b, such that the safety zone width reaches a minimum of 10 cm. The control unit 20, of course, does not allow the safety zone width to be less than zero. In other words, the control unit 19 checks whether the first anticipated safety zone width (based on a selected offset inwards from the left lane boundary 24a and the right lane boundary 24b) represents a safety zone that would allow any lateral movement of the vehicle 10 in lane 22. If the first anticipated safety zone width would not allow any lateral movement of the vehicle 10, the control unit 19 would select the alternative width value as the minimum safety zone width.
[0043] If the safety zone 48 is made wider, the control unit 19 can be programmed to allow the safety zone boundaries to reach a maximum outboard position that is 30 cm behind (i.e. outboard of) the lane boundaries 24a and 24b.
[0044] If, at any time, the control unit 19 determines that the vehicle 10 risks unintentionally leaving lane 22 and takes a corrective action, the control unit 19 can adjust the outward positions of the safety zone boundaries 47a and 47b if they are not already at their maximum outboard positions. For example, the control unit 19 can adjust the safety zone boundaries 47a and 47b outward by any amount each time it needs to take a corrective action. The control unit 19 may be programmed to adjust the safety zone boundaries 47a and 47b outward more quickly than it adjusts them inward.For example, if the operator 20 remains within safety zone 48 and does not cause the control unit 19 to take a corrective action, the control unit 19 can adjust the safety zone boundaries 47a and 47b inwards at a rate that would move them from their maximum outboard positions to their maximum onboard positions within a selected period, for example, 5 minutes. Conversely, if the operator 20 repeatedly leaves safety zone 48 and repeatedly causes the control unit 19 to take a corrective action, the control unit 19 can adjust the safety zone boundaries 47a and 47b outwards at a rate that would move them from their maximum onboard positions to their maximum outboard positions within a selected period, for example, 2 minutes.
[0045] By adjusting the safety zone 48 inwards and outwards based on the driver's performance in remaining within the safety zone 48, the control unit 19 rewards those who remain within the safety zone 48 without relying on corrective actions by the control unit 19 with increased safety by providing them with a narrower safety zone 48, so that the corrective action is executed earlier to prevent the vehicle from leaving lane 22 prematurely, as in Fig. 3 shown. In contrast, those that rely more heavily on corrective actions by system 12 to keep them within safety zone 48 ultimately have a safety zone 48 that is relatively wider, meaning that driver 20 is warned when vehicle 10 is closer to actually leaving lane 22, as shown in Fig. 2 shown. By equipping the control unit 19 with the ability to take corrective actions earlier (as in Fig. (as shown in Figure 3), the driver 20 is warned earlier about the possibility of leaving lane 22, thus giving the driver 20 more time to correct the vehicle 10's path (and the control unit 19 more time to correct the vehicle 10's path in embodiments where the control unit 19 has this capability). Additionally, by taking corrective action earlier (e.g., warning the driver 20 earlier or autonomously performing a steering correction on the vehicle 10 earlier), a smaller steering correction is required to keep the vehicle 10 within lane 22. A smaller steering correction is preferable to a larger one with regard to passenger safety.
[0046] In embodiments where the control unit 19 is programmed to perform steering corrections on the vehicle 10, the driver 20 may be tempted to take their hands off the steering wheel and let the vehicle 10 steer itself. To prevent this, the control unit 19 may be optionally programmed to detect whether the driver 20 has released the steering wheel 30. If it detects this, the control unit 19 temporarily deactivates the lane keeping assist system 11 for a period of time (e.g., 10 seconds) and notifies the driver 20 that the system 11 has been deactivated. When the driver's hands are on the steering wheel 30, the driver 20 will, with some regularity, apply a small but measurable torque to the steering wheel 30 when making minor steering corrections while driving.The lane keeping assist system 11 may include a torque sensor on the steering column 32 to detect this torque. The control unit 19 receives signals from the torque sensor that allow the control unit 19 to detect whether the driver 20 has released the steering wheel 30. In particular, if the torque applied to the steering wheel exceeds any threshold torque, such as 0.3 Nm, the control unit 19 assumes that the torque was applied by the driver 20 and that the driver 20 is actively involved in controlling the vehicle 10. The control unit 19 starts a timer to determine the duration of time elapsed since receiving a signal indicating torque applied by the driver 20. If the elapsed time since the last indication of torque applied by the driver exceeds any threshold (e.g., 0.3 Nm), the control unit 19 then starts a timer to determine the duration of time elapsed since receiving a signal indicating torque applied by the driver 20.If the time limit (8 seconds) is exceeded, the control unit 19 warns the driver 20 and temporarily deactivates the lane keeping assist system 11. If the driver 20 applies torque to the steering wheel 30 before the threshold time expires, the control unit 19 does not deactivate the system 11 and resets the timer to start counting again.
[0047] In addition to the fact that the control unit 19 deactivates the system 11 during activation of the turn signal 61, and when the torque applied by the driver 20 to the steering wheel 30 exceeds a selected value, it can be programmed to deactivate the system 11 under other conditions as well. For example, the control unit 19 may be programmed to deactivate the system 11 when the control unit 19 detects that the driver 20 has applied the brakes 16 (e.g., by detecting a signal from a brake pedal sensor with reference 64 on the brake pedal with reference 66, or, for example, by receiving a signal from a collision mitigation system that a braking event is currently taking place).Additionally, if the vehicle 10 is equipped with an adaptive cruise control system or the like, the control unit 19 may deactivate the system 11 if it detects that a front collision warning signal has been triggered. In each of these two cases (i.e., detection of braking by the driver 20 or triggering of a collision warning), the control unit 19 allows the driver 20 to maneuver the vehicle 10, as necessary to avoid a collision, without interference from the lane keeping assist system 11.
[0048] In situations where the control unit 19 fails to detect either lane marking 24a or 24b for longer than a selected period (e.g., 1 second), the control unit 19 is programmed to gradually reduce the level of assistance (i.e., corrective action) it provides to the driver 20. In a situation where the control unit 19 fails to detect either lane marking 24a or 24b for longer than a second selected period (e.g., 3 seconds), the level of assistance provided by the lane keeping assist system 11 may be reduced to zero (i.e., no assistance). A gradual reduction in the level of assistance can be achieved by shifting the positions of the associated safety zone boundary 47a or 47b outwards by any selected amount.If the control unit 19 detects the missing lane boundary 24a or 24b again, it can restore the position of the associated safety zone boundary 47a or 47b to the position it was in before the lane boundary 24a or 24b could no longer be detected. The control unit 19 can handle each of the lane boundaries 24a and 24b independently with respect to this detection and reduction of assistance.
[0049] In situations where the vehicle 10 passes an on-ramp or off-ramp, one of the lane markings 24a or 24b may temporarily end. In such situations, the lane marking 24a or 24b may reappear after less than one second (depending on the vehicle speed), and it is expected to reappear after less than three seconds in many situations, so that the system 11 remains at least partially operational during the period in which the vehicle 10 passes the on-ramp or off-ramp.
[0050] Reference is made to Fig. 1 taken. Instead of or in addition to the lane keeping assist 11, the vehicle 10 may include a lane centering system 68. The lane centering system 68 is used to steer the vehicle autonomously and keep the vehicle within its lane 22 ( Fig. 2) The lane centering system 68 can be considered a highly advanced lane keeping assist system. The lane centering system 68 may incorporate many of the components of the lane keeping assist system 11, including the lane boundary detection device 13, which may be the camera 26, the control unit 19, and the steering assist device 54. For use in the lane centering system 68, the control unit 19 is programmed to detect the left lane boundary 24a and the right lane boundary 24b using images from the camera 26 in the same manner as described above for the lane keeping assist system 11. The control unit 19 then selects a target path that corresponds to the reference numeral 69 ( Fig. 5b) has, in track 22 based on the information it has gathered regarding the left track boundary 24a and the right track boundary 24b. In situations where the left track boundary 24a and the right track boundary 24b are detectable and meet some other criteria described in more detail below, the target path 69 selected by the control unit 19 generally corresponds to the theoretical center line with reference numeral 70 in track 22.
[0051] The control unit 19 can be programmed in any suitable way to determine the position of the center line 70 for lane 22. In one embodiment, the control unit 19, using the images from the camera 26, may model the left lane boundary 24a and the right lane boundary 24b in the form of third-degree polynomial equations. As shown in Fig. As shown in Figure 5a, an X-axis and a Y-axis are positioned such that the control point 60 on the vehicle 10 is located at the origin. The left lane limit 24a can be stored in the memory of the control unit 19 as an equation in the form Y L = D L X 3 + A L X 2 + B L X + C1 are stored, where D L , A L , B L and C L The control unit 19 can select the curve in any suitable way to form a curve which, when adjusted for the perspective of the camera 26, exactly matches the left track boundary 24a visible in the images sent by the camera 26 to the control unit 19. The right track boundary 24b can be stored in the memory of the control unit 19 as an equation in the form Y R = D R X 3 + A R X 2 + B R X + C R be stored, whereby D R , A R , B Rand C R The control unit 19 selects in any suitable manner to form a curve which, when adjusted for the perspective of the camera 26, exactly coincides with the right lane boundary 24b visible in the images sent by the camera 26 to the control unit 19. The position of the center line 70 can be determined as the intersection of the two polynomial equations. The position of the center line is therefore given by the polynomial Y C = D C X 3 + A C X 2 + B C X + C C determined, where D C = 0.5(D L + D R ), where A C = 0.5(A L + A R ), where B C = 0.5(B L + B R ), and where Cc = 0.5(C L + C R ).
[0052] Reference is made to Fig. 5b is used. After determining the position of the center line 70, the control unit 19 calculates the lateral offset Y. P1 between the actual position of the vehicle and a point on the center line 70 of lane 22, which is located at any distance X1 in front of the vehicle 10 along the X-axis, using the formula Y P1 = D P X1 3 + A P X1 2 + B P X1 + C P The distance X1 can be determined based on the actual forward speed V. F of the vehicle and a selected time period T1 (e.g., 0.6 to 1.2 seconds) during which the control unit 19 is programmed to "predict" in order to safely guide the vehicle 10. In some embodiments, the control unit 19 may also calculate the lateral offset Y. P2between the actual position of the vehicle and a point on the centerline 70 of lane 22, which is located at any second selected distance X2 in front of the vehicle 10 along the X-axis, using the formula Y P2 = D P X2 3 + A P X2 2 + B P X2 + C P This second distance X2 represents a second selected period T2 (e.g., 0.3 to 0.6 seconds) during which the control unit 19 may also be programmed to "predict" in order to guide the vehicle safely. The lateral offsets Y P1 and Y P2 These can be described as target path lateral offsets, as they represent the offsets between the actual position of the vehicle and points on the target path 69 in front of the vehicle 10. If the target path 69 is the center line 70 of lane 20, the lateral offsets Y can be P1 and Y P2 also referred to as centerline cross offsets.
[0053] Reference is made to Fig. 5c taken. The control unit 19 may be further programmed to determine the expected lateral offset of the vehicle 10, which is designated as Y. A1 The selected distance X1 is defined based on the vehicle's current yaw rate, Vs. The vehicle's current angular orientation is represented by its yaw rate, Vs. The expected lateral displacement is Y. A1 = X1 V S T1. The expected lateral displacement of vehicle 10 at the second selected distance X2 is Y. A2 = X2 V S T2.
[0054] As soon as the target path cross offsets Y P1 and Y P2 and the expected cross-offsets Y A1 and Y A2 Once determined, they can be compared with each other so that the control unit 19 can determine a suitable steering input 54 for use in the steering assistance device 54. It is optionally possible for the control unit Y to P2 and Y A2not determined and consequently only with the first offsets Y P1 and Y A1 works to determine an appropriate steering input.
[0055] To determine a suitable steering torque Tc for application to the steering system, the relationship between the accelerator pedal position and the forward speed V is used. F The relationship between the steering torque Tc and the resulting yaw rate Vs is modeled. This modeling can take place before programming the control unit 19. The models can be used to generate a lookup table that the control unit 19 uses when determining a steering torque Tc for application to the vehicle 10.
[0056] The models used may vary for different vehicles. An example model is given below with reference to... Fig. 6 is described based on the vehicle set up with the Ackermann geometry. Vehicle 10 is in Fig. 6 shown. U F is the input from the accelerator pedal. V F is the forward speed of the vehicle 10 in any direction it is currently facing (not necessarily the direction in which the wheels 20 are pointing). On U F A transfer function is applied to V F to derive. The transfer function is: K V / (T V S+1), where S is a Laplace transform and K V and T V These are the parameters of the transfer function.
[0057] Continuing with reference to Fig. 6. As the vehicle 10 rotates, the inner front wheel 14 is rotated at some angle with reference numeral A that differs from the angle of the outer front wheel 14. The wheelbase of the vehicle 10 is L, and the radius from the center C of the rotation to the inner front wheel 14 is R. As an approximation, the distance from the center C to the inner rear wheel is also approximately equal to R. Consequently, TAN(A) is approximately equal to L / R. S =V F / R, which is approximately equal to V F TAN(A) / L is.
[0058] T C is the requested steering torque. A transfer function is applied to a given steering torque Tc to derive A. The transfer function is: K S / (S(T S S+1)), where K S and T S These are the parameters of the transfer function. As shown above, V S for a given angle A approximately equal to V FTAN(A) / L. Using these relationships, a steering torque Tc can be applied based on the difference between the expected lateral displacement Y. A1 of vehicle 10 compared to the target lateral offset Y P1 be selected.
[0059] Control unit 19 may use a closed control system that is in Fig. 7, which has the reference numeral 82, to improve the selected steering torque Tc. The control unit 19 is programmed with a target travel offset module 83 (which can be referred to as the centerline offset module 83 if the target travel 69 is the centerline 70), a compensator module 84, a steering motor module 86, a yaw rate determination module 88, and a module 92 for expected offset. The target travel offset module 83 is used to determine the target travel offset Y. P1 to determine. In this example, if the target path 69 is the center line 70, the target path offset Y is P1Calculated as described above. The control system 82 determines an expected lateral offset Y. A1 as described above. A difference between the two (which are in Fig. The difference e (represented by the letter e) is used as input to the adjustment module 84, where a transfer function is applied to the difference e to determine a value for Tc. The applied transfer function consists of replacing the input with k. A (S+z A ) / (S+p A ) is multiplied, where k A , z A and p A These are the gain, the zero, and the pole of the function. These values can be selected by any suitable means.
[0060] The control system 82 then proceeds to the steering motor module 86, where the steering torque Tc is applied to the steering system 18, resulting in the wheel angle A. The wheel angle A is not measured; however, the vehicle 10 includes a means for measuring the yaw rate Vs, which results from the steering torque Tc. Consequently, the yaw rate Vs is measured at module 88. The measured Vs can be used as input to an optional yaw module 90, where a transfer function is applied to Vs to determine a yaw for the vehicle 10, the value of which can be used by other control units for other purposes within the vehicle 10. The control system 82 then proceeds to module 92 for expected offset, which is used to determine the new expected offset Y. A1 of vehicle 10 based on the new yaw rate Vs, which was determined. As in Fig. Note 7, this module 92 uses the forward speed V FThe vehicle 10 is used as one of its inputs to determine the distance X1. The expected offset is calculated by applying the formula Y. A1 =X1V S T1 is determined. The control system 82 also recalculates the target path offset in module 83 and then again determines the difference between the expected offset Y. A1 and the target path offset Y P1 , to generate the input e again in the compensator module 84 in order to improve the applied steering torque Tc. The control unit 19 selects the gain k to be used in the compensator module 84. A at least partially based on the forward speed of the vehicle V F The control system 82 continues to iterate through these aforementioned steps, recalculates the steering torque Tc to be applied, and then applies it.
[0061] The properties of the control system 82 of a closed circuit depend on the compensator module 84. Fig. Figures 8a-8f, 9a-9f, and 10a-10f show test results for the properties of a closed loop for three different levelers. Each set of figures shows a root locus graph, a Bode plot of the properties of an open loop, the properties of a closed tracking loop, and the properties of a perturbation suppression loop. The suppression response to a jump input is also included. The first set of properties ( Fig. 8a-8f) is shown when a 50 percent overshoot is allowed in the step response. The value for k A 3.3665 × 33 is selected as the value for z. A 25 is selected and used as the value for p. A 50 is selected. The second set of properties ( Fig. 9a-9f) is shown when a 30 percent overshoot is allowed in the step response. The value for k A 6.3184 × 33 is selected as the value for z. A 10 is selected and used as the value for p.A 50 is selected. The third set of properties ( Fig. 10a-10f) is shown when a 10 percent overshoot is allowed in the step response. The value for k A 15.9926 × 33 is selected as the value for z. A 5 is selected and used as the value for p A 50 will be selected.
[0062] It is noted that the torque required to generate a desired yaw rate Vs decreases with increasing vehicle speed. The transmission factor of the control system 82 varies such that the poles are held in approximately the same positions regardless of the vehicle speed.
[0063] The above programming is used to steer vehicle 10 towards a target path 69, which generally corresponds to the center line 70 of lane 22, as shown in Fig. 6b. In some situations, however, the control unit 19 may determine that the target path 69 does not run along the theoretical centerline 70, and instead steers the vehicle 10 towards a target path 69 that is based on one of the lane boundaries 24a or 24b. To determine which type of target path is selected, the control unit 19 first determines values for a set of parameters 94 ( Fig. 11), which is represented by a set of variables 96a-96h. The variables include, for example, variables 96a and 96b, which represent the quality of information available to the control unit 19 based on the images sent by the camera 26 for each of the lane boundaries 24a and 24b. The control unit 19 determines, based on selected criteria, whether the information received from the lane boundary detection device 13 regarding each lane boundary 24a and 24b meets a selected quality threshold (i.e., whether the control unit 19 has received sufficient information from the lane boundary detection device 13 (i.e., the camera 26) to determine the positions of each of the lane boundaries 24a and 24b).For lane boundary 24a, the control unit 19 stores the value "good" (if the information quality is sufficiently good) or "not good" (if the information quality is insufficient) in the information quality variable of the right lane boundary, which has the reference numeral 96a. For lane boundary 24b, the control unit 19 stores the value "good" (if the line quality is sufficiently good) or "not good" (if the line quality is insufficient) in the information quality variable of the left lane, which has the reference numeral 96b. The control unit 19 further determines the offset for each lane boundary 24a and 24b from the vehicle 10 and stores the offset distance to the right lane boundary 24b in an offset variable of the right lane boundary and stores the offset distance to the left lane boundary 24a in an offset variable of the left lane boundary.The control unit 19 further determines the angles of the left lane boundary 24a and the right lane boundary 24b relative to the vehicle 10. If the left lane boundary 24a is parallel to the vehicle 10, the control unit 19 stores the value "straight" in an angle variable 96c of the left lane. If the left lane boundary 24a is not parallel to the vehicle 10, the control unit 19 stores the value "not straight" in the angle variable 96c of the left lane. The control unit 19 performs a similar analysis for the right lane boundary 24b and stores the value "straight" or "not straight" in an angle variable 96d of the right lane boundary. The control unit 19 further determines the magnitude of the curvature of the lane boundaries 24a and 24b and stores their values in units of 1 / m in lane boundary curvature variables. The control unit 19 determines the lane width W. Lbased on the offset values stored in the offset variables of the left lane and right lane boundaries, the control unit 19 determines whether the lane width is within a selected range considered normal. If it is within the selected range, the control unit 19 stores the value "appropriate" in a lane width appropriateness variable 96h. The control unit 19 further determines whether the center of the vehicle 10 is offset to the left or to the right of the center of lane 22 by storing values regarding how close the vehicle 10 is to the left lane boundary 24a and the right lane boundary 24b in variables for "left near" and "right near", which together are identified as variable 96g.
[0064] The control unit 19 further determines the difference in deflection between the lane markings 24a and 24b. The deflection of each lane marking 24 is the lateral displacement of the lane marking 24 at any selected distance in front of the vehicle 10. In the embodiment described herein, the deflection is measured at a distance corresponding to 2 seconds of the vehicle 10's travel time. The deflection can be determined by any suitable means. In this embodiment, it is determined by extrapolating the third-degree curve that matches the lane markings detected by the camera 26, thus utilizing the lane marking position, heading, curvature, and curvature derivative. The control unit 19 determines whether there is a difference in the deflections of the left lane marking 24a and the right lane marking 24b, as a means of detecting exits on a highway.
[0065] With reference to Fig. Figure 11 shows a table that applies a series of “preliminary decisions” based on the values of parameter 94 determined above. The table in Fig. Figure 11 shows ten different situations 120 (individually shown with reference numbers 120a-120j). It is noted that the ten situations are not mutually exclusive. For example, it is possible that a single set of parameters 94 could satisfy the conditions shown in situation 120h and situation 120j. The control unit 19 iterates through the list of situations and determines which situations apply to the values of the parameters 94. For each situation that applies, a specific preliminary decision, which has the reference number 122, is output. The decisions are shown individually with the reference numbers 122a-122j. The three possible target paths 69 available for selection are: a target path along the center of the lane 22, a target path that is an offset from the right lane boundary 24b, or a target path that is an offset from the left lane boundary 24a.It is possible that the parameters 94 could satisfy the conditions in two or more situations 120, resulting in conflicting decisions 122 regarding which type of target path 69 to follow. A hypothetical example is that the control unit 19 might determine that the quality of the left lane boundary and the quality of the right lane boundary are both good, that neither the left nor the right lane boundary is straight (i.e., parallel to the vehicle 10), that the lane width is adequate, and that there is a difference in the deflection of the lane boundaries 24a and 24b to the left. Consequently, the values of the parameters 94 match the values shown in situation 120h, resulting in a preliminary decision 122h to establish a target path 69 along the centerline 70 of lane 22.However, the values of parameter 94 also match the values shown in situation 120j, resulting in a preliminary decision 122j to establish a target path 69 that is an offset from the right lane boundary 24b. Once all preliminary decisions 122 for the ten situations 120 have been received, the control unit 19 determines a final decision based on the results of preliminary decisions 122a-122j. For example, the control unit 19 might implement a weighted average of the decisions to determine the final decision. The value of the weighted average can be a number between 0 and 1. A value of 0 indicates a very strong final decision to follow the left lane boundary 24a. A value of 1 indicates a very strong decision to follow the right lane boundary 24b.A value of 0.5 indicates a very strong decision to follow the center of lane 22. The control unit 19 applies thresholds to determine which final decision outcome to select. In the exemplary embodiment, the control unit 19 follows the center of the lane for a value between 0.4 and 0.6 inclusive. For a value less than 0.4, the control unit 19 follows the left lane boundary 24a. For a value greater than 0.6, the control unit 19 follows the right lane boundary 24b.
[0066] The weighted average can be obtained for each decision 122 using a form of fuzzy logic. For example, each variable 96 may have an associated "raw" variable M, determined by the control unit 19 based on its analysis of the images from the camera 26. The raw variable M is then used as input to a lookup table, formula, or the like to determine the values of two other associated variables, M1 and M2. Consequently, variable 96a, which relates to the quality of the left lane boundary 24a, has an associated raw variable Ma and two other associated variables, Ma1 and Ma2. Variable Ma1 relates to the "strength" of the value stored in the raw variable Ma. Variable Ma2 relates to the "weakness" of the value stored in the raw variable Ma. Consequently, Ma1 and Ma2 are inversely proportional.In this example system, the sum of Ma1 and Ma2 equals the total value 1. One in . Fig. Graph 13 shows the value contained in the raw value variable Ma for the two variables Ma1 and Ma2. Consequently, if the control unit 19 determines that the quality value of the left lane is 1.75, this is the value stored in the raw value variable Ma. This value is used to determine the values of Ma1 and Ma2. In this example, using the value shown in Fig. The graphs shown in Figure 13 yield a Ma1 value of 0.75 and a Ma2 value of 0.25, meaning that the quality of the left lane boundary is rather good. The quality of the right lane boundary (24b) can be determined using a similar procedure, where the raw value variable is Mb and the two associated variables are Mb1 and Mb2.
[0067] Variable 96c, which relates to the "straightness" of the left lane boundary 24a, had an associated raw value variable Mc and two further variables Mc1 and Mc2. The value of Mc is possibly the angle in degrees by which the left lane boundary 24a is deviated from "straight ahead". The values of Mc1 and Mc2 are shown in the example graph, which is in Fig. 14 is shown. A graph that corresponds to the one in Fig. The similarity shown in Figure 14 would be applicable to the variables Md, Md1 and Md2, which are associated with the variable 96d for “straightness” of the right lane.
[0068] The in Fig. The graph shown in Figure 14 would also be applicable (albeit possibly with changes to the actual angles, where the curves change direction) to determining the variables Me, Me1 and Me2 as well as Mf, Mf1 and Mf2, which relate to the curvature of the left lane boundary 24a and the curvature of the right lane boundary 24b, respectively. The graph shown in Fig. The graph shown in Figure 13 would be applicable (albeit with changes to the measurement indicated on the x-axis) to determining the variables Mg, Mg1, and Mg2 with respect to whether the vehicle is closer to one side of the lane or the other. The graph shown in Figure 13 would be applicable (albeit with changes to the measurement indicated on the x-axis) to determining the variables Mg, Mg1, and Mg2 with respect to whether the vehicle is closer to one side of the lane or the other. Fig. The graph shown in point 14 would be applicable (again with changes to the specific measurement indicated on the x-axis) to determining the variables Mh, Mh1, and Mh2 with respect to the appropriateness of the track width. In other words, if the track width is close enough to a certain width, it is considered appropriate. If the measured track width is too small or too large, it is less appropriate.
[0069] Once the values of the variables Ma1, Ma2, Mb1, Mb2, ..., Mh1, and Mh2 are determined, the appropriate values can be inserted into a formula associated with each decision to determine a value for that variable. Consequently, using this fuzzy logic, the first decision, 122a, would not simply return a value for "follow the middle of the lane" if all conditions are met. Instead, a formula would be applied to determine a strength value, Sa, for the first decision, 122a. The formula is a simple multiplication of the values of each of the variables involved in decision 1. For example, according to the formula in Fig. In the table shown in section 11, the value of Sa is Ma1 × Mb1 × Mc1 × Md1 × Mh1. The value of Sb, which relates to the second decision 122b, would be Ma2 × Mb1. The value of Sc, which relates to the third decision 122c, would be Ma1 × Mb2. The value of Sd, which relates to the fourth decision 122d, would be Ma1 × Mb1 × Mc1 × Md2 × Mh1. The other formulas can easily be derived from the table in Fig. 11 will be determined.
[0070] Once the values of Sa..Sj have been determined, the control unit 19 can then use them as inputs into a general decision formula that determines which of the three possible decision outcomes to follow. The three possible decision outcomes are: "drive close to the left lane boundary," "drive close to the right lane boundary," and "follow the center of the lane," and are themselves represented by the variables LEFT, RIGHT, and CENTER. Each outcome variable is assigned a representative value. In this example, the value 0 is assigned to the variable LEFT. The value 1 is assigned to the variable RIGHT, and the value 0.5 is assigned to the variable CENTER. These three values can be equally spaced from each other, as shown in this example, although they do not have to be. The values of Sa....Sj are then applied in a final weighted formula to determine a Final Decision Value (FDV) as follows: FDV=(Sa×CENTER)+(Sb×RIGHT)+(Sc×LEFT)+(Sd×LEFT)…+(Sj×RIGHT)_(Sa+Sb+Sc+Sd…+Sj)
[0071] The value of FDV is then compared with the three result values to determine a final decision. In this example, if FDV is between 0.4 and 0.6, the final decision of control unit 19 is to follow the center of the lane. If FDV is less than 0.4, the final decision of control unit 19 is to drive close to the left lane boundary 24a. If FDV is greater than 0.6, the final decision of control unit 19 is to drive close to the right lane boundary 24b. It is understood that these ranges can be adjusted in any desired way to weight the decisions.
[0072] The Fig. 12a-12i illustrate examples of some of the items in the table in Fig. 8 described situations. Fig. 12a and Fig. Section 12b illustrates situations 120a and 120h, respectively, in which the qualities of the left and right lane boundaries are good. Fig. In 12a, both lane boundaries 24a and 24b are “straight” (i.e., parallel to vehicle 10), which corresponds to situation 120a. Fig. In 12b, both lane boundaries 24a and 24b are “not straight” (i.e., not parallel to vehicle 10), which corresponds to situation 120h. In these two cases, output decision 122 is to establish a target path 69 that runs along the center line 70 of lane 22. Fig. Figure 12c represents situation 120b in which only the right lane boundary 24b is of good quality. In this situation, the output decision 122 is to set a target path 69, which is a selected offset from the right lane boundary 24b. The selected offset can be any selected offset, such as half the measured lane width before the control unit 19 determined that the left lane boundary was not of sufficient quality. In situations where the control unit 19 does not determine a measured lane width for longer than any given period (such as 30 seconds), the control unit 19 may use an offset that is half a standard lane width (i.e., half of 3.6 m, or 1.8 m). Fig. Figure 12d represents situation 120c, in which only the left lane boundary 24a has good quality. In this situation, the output decision 122 is to define a target path 69, which is a selected offset from the left lane boundary 24a. The selected offset can be determined in a similar way to the offset determined above with respect to a right lane boundary 24b with good quality and a left lane boundary 24a with poor quality. Fig. 12e represents situation 120d in which both lane boundaries 24a and 24b are of good quality, but the right lane boundary 24b is not parallel to vehicle 10. Fig. 12f represents situation 120e in which both lane boundaries 24a and 24b are of good quality, but the left lane boundary 24a is not parallel to vehicle 10. Fig. 12g represents situation 120f in which both lane boundaries 24a and 24b are of good quality, but the lane width is outside the appropriate range and the vehicle 10 is closer to the left lane boundary 24a. Fig. 12h represents a Fig. 11 represents an unshown situation, which, however, could be an additional situation that is compared with parameters 94. In Fig. 12h both lane boundaries 24a and 24b are of good quality, but the lane width is outside the appropriate range, and the vehicle 10 is generally aligned centrally between the left lane boundary 24a and the right lane boundary 24b. Fig. 12i represents situation 120g in which both lane boundaries 24a and 24b are of good quality, but the lane width is outside the appropriate range and the vehicle 10 is closer to the right lane boundary 24b.
[0073] The control unit 19 continues to repeat the cycle of determining the parameters 94 and determining a final output decision as to which type of target path 69 is to be taken (e.g. along the center line 70 of the lane or along a path offset from one of the lane boundaries 24a or 24b) when the vehicle 10 is moving.
[0074] The lane centering 68 can be activated by any suitable means, such as an “on” button (not shown) mounted on the dashboard. The lane centering 68 can be deactivated by the control unit 19 in response to a number of events. For example, the lane centering 68 may be deactivated by the control unit 19 if the driver 20 activates the turn signal 61 for vehicle 10, or if the driver 20 applies the brakes 14, or if the control unit 19 receives a signal from, for example, a control unit for an adaptive cruise control system that another vehicle is within a selected distance in front of vehicle 10, or if the driver applies a steering torque exceeding a selected threshold torque.Furthermore, if the control unit 19 receives a warning of an impending collision from a safety system in the vehicle 10, the control unit 19 may be programmed to deactivate the lane centering system 68. The deactivation of the lane centering system 68 as a result of any of the aforementioned events may, under certain circumstances (e.g., for a selected number of seconds), be temporary, or in some cases, permanent, requiring the driver 20 to press the button mounted on the dashboard again to reactivate the system 68. Of course, the driver 20 can also deactivate the system 68 by pressing an 'off' button for the system 68.
[0075] The system and control unit of the present invention may utilize aspects of the vision systems and lane deviation systems and / or lane change aids and / or side object detection systems of the types described in U.S. Patents Nos. 7,914,187; 7,720,580; 7,526,103; 7,038,577; 7,004,606; 6,946,978; 6,882,287; and / or 6,396,397, which are hereby incorporated herein by reference in their entirety.
[0076] The image sensor or camera that acquires the image data for image processing may include any suitable camera or sensor device, such as a grouping of photosensor elements arranged in 640 columns and 480 rows (a 640x480 image grouping), with a lens that focuses images onto respective sections of the grouping. The photosensor grouping may include a plurality of photosensor elements arranged in a row-and-column image grouping. The camera or image sensor and / or the image sensor's logic and control circuitry may operate in any known manner, such as by using aspects of the vision or imaging systems described in U.S. Patents No.6,806,452; 6,690,268; 7,005,974; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454; 6,824,281; 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; and / or 6,396,397, and / or PCT Application No. PCT / US2010 / 028621, filed on March 25, 2010, all of which are hereby incorporated herein by reference in their entirety.
[0077] The imaging device and the control and image processor, and optionally any associated light source, may include any suitable components and may utilize aspects of the cameras and vision systems described in U.S. Patents Nos. 550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454; and 6,824,281, and / or the international publication no. WO 2010 / 099416, published on September 2, 2010, and / or the PCT application no. PCT / US10 / 47256, filed on August 31, 2010, and / or the US patent application no. 12 / 508,840, filed on July 24, 2009 and published on January 28, 2010 as US patent publication no. US 2010-0020170, all of which are hereby incorporated herein by reference in their entirety.The camera or cameras may comprise any suitable cameras or image sensors or camera modules and may utilize aspects of the cameras or sensors described in U.S. Patent Application No. 12 / 091,359, filed on April 24, 2008, and published on October 1, 2009, as U.S. Publication No. US-2009-0244361, and / or U.S. Patents Nos. 7,965,336 and / or 7,480,149, which are incorporated herein by reference in their entirety. The image grouping sensor may comprise any suitable sensor and may utilize various image sensors or image grouping sensors or cameras or the like, such as a CMOS image grouping sensor, a CCD sensor, or other sensors or the like, such as the types described in U.S. Patents Nos.7,965,336; 5,550,677; 5,670,935; 5,760,962; 5,715,093; 5,877,897; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 6,498,620; 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 6,806,452; 6,396,397; 6,822,563; 6,946,978; 7,339,149; 7,038,577; 7,004,606; and / or 7,720,580, and / or PCT Application No. PCT / US2008 / 076022, filed on September 11, 2008, and published on March 19, 2009, as International Publication No. WO / 2009 / 036176, and / or PCT Application No. PCT / US2008 / 078700, filed on October 3, 2008, and published on April 9, 2009, as International Publication No. WO / 2009 / 046268, all of which are hereby incorporated herein by reference in their entirety.
[0078] The camera module and circuit chip or circuit board and imaging sensor may be implemented and operated in conjunction with various vision-based vehicle systems and / or may be operational using the principles of such other vehicle systems, such as a vehicle headlight control system, such as the type disclosed in U.S. Patents Nos. 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 7,004,606; 7,339,149; and / or 7,526,103, all incorporated herein by reference in their entirety, or a rain sensor, such as the types disclosed in the generally assigned U.S. Patents Nos. 6,353,392; 6,313,454; 6,320,176; and / or 7,480,149, which are hereby incorporated herein by reference in their entirety, a vehicle vision system, such as a forward-, side-, or rear-facing vehicle vision system, which uses principles disclosed in U.S. Patents No.5,550,677; 5,670,935; 5,760,962; 5,877,897; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; and / or 7,859,565, all of which are hereby incorporated herein by reference in their entirety, a trailer hitch aid or towing verification system, such as that described in U.S. Patent No. 7,005,974, which is hereby incorporated herein by reference in its entirety, a rear or side imaging system, such as for a lane change assist system or a lane departure warning system, or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Patents No.7,881,496; 7,720,580; 7,038,577; 5,929,786 and / or 5,786,772, which are hereby incorporated herein by reference in their entirety, a video device for indoor surveillance and / or a video telephone function, as disclosed in U.S. Patents Nos. 5,760,962; 5,877,897; 6,690,268; and / or 7,370,983, and / or U.S. Patent Application No. 10 / 538,724, filed on June 13, 2005 and published on March 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entirety, a traffic sign recognition system, a system for determining a distance to a vehicle or object in front or behind, such as a system that uses the principles disclosed in U.S. Patents Nos. 6,396,397 and / or 7,123,168, which are hereby incorporated herein by reference in their entirety, and / or the like.
[0079] Optionally, the printed circuit board or circuit chip may include a circuit for the image grouping sensor and / or other electronic accessories or features, such as by using on-chip compass or on-chip EC driver technology, or aspects as described in U.S. Patent No. 7,255,451 and / or U.S. Patent No. 7,480,149; and / or in U.S. Patent Application No. 11 / 226,628, filed September 14, 2005, and published March 23, 2006, as U.S. Publication No. US-2006-0061008, and / or Application No. 12 / 578,732, filed October 14, 2009 (Attorney File No. DON01 P-1564), which are hereby incorporated herein by reference in their entirety.
[0080] Optionally, the vision system may include a display for showing images captured by one or more of the image sensors for viewing by the driver while operating the vehicle normally. Optionally, the vision system may, for example, include a video display device mounted on or within the vehicle's interior rearview mirror assembly, perhaps by using aspects of the video mirror display systems described in U.S. Patents No.6,690,268; 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460; 6,513,252; 5,530,240; 6,329,925; 7,855,755; 7,626,749; 7,581,859; 7,446,650; 7,446,924; 7,370,983; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 5,724,187; 7,338,177; 5,910,854; 6,420,036; and / or 6,642,851, and / or the European patent application published on October 11, 2000, under publication number EP 0 1043566, and / or PCT application no. PCT / US2011 / 056295, filed on October 14, 2011 (Attorney File No. DON01 FP-1725(PCT)), and / or US patent applications no. 11 / 226,628, filed on September 14, 2005, and published on March 23, 2006, as US Publication No. US-2006-0061008; and / or application no. 10 / 538,724, filed on June 13, 2005, and published on March 9, 2006, as US Publication No.US-2006-0050018, and / or the preliminary US filings, file number 61 / 466,138, filed on March 22, 2011; file number 61 / 452,816, filed on March 15, 2011; and file number 61 / 426,328, filed on December 22, 2010, which are hereby incorporated herein by reference in their entirety. Optionally, the vision system (using the rear-facing camera and other cameras mounted on the vehicle with external fields of view) can provide a top-down view of the vehicle, a bird's-eye view of the vehicle, or a 360-degree view of the vehicle, for example, by using aspects of the vision systems described in PCT Application No. PCT / US10 / 25545, filed on February 26, 2010, and published on September 2, 2010, as International Publication No. WO 2010 / 099416, and / or PCT Application No. PCT / US10 / 47256, filed on August 31, 2010, and published on March 10, 2011, as International Publication No.WO 2011 / 028686, and / or the preliminary US applications file numbers 61 / 540,256, filed on September 28, 2011; 61 / 466,138, filed on March 22, 2011; 61 / 452,816, filed on March 15, 2011; and 61 / 426,328, filed on December 22, 2010, which are hereby incorporated herein by reference in their entirety.
[0081] Optionally, the display or displays and any associated user inputs may be associated with various accessories or systems, for example, a tire pressure monitoring system, a passenger door bag status system, a garage door opening system, a telematics system, or any other accessory or system of the mirror assembly or vehicle, or an accessory module or console of the vehicle, such as an accessory module or console of the types described in U.S. Patents Nos. 7,289,037; 6,877,888; 6,824,281; 6,690,268; 6,672,744; 6,386,742; and 6,124,886, and / or the US patent application file number 10 / 538,724, filed on June 13, 2005 and published on March 9, 2006 as US Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entirety.
[0082] Although the above description presents several embodiments of the present invention, it is understood that the present invention may be subject to further modifications and changes without deviating from the intended meaning of the attached claims.
Claims
[1] Lane Keeping Assistance (11) for use in a vehicle (10) traveling in a lane on a road, the Lane Keeping Assistance (11) comprising: a control unit (19); and a lane limit detection device (13) positioned to send information regarding the positions of a left lane limit (24a) on the road on the left side of the vehicle and a right lane limit (24b) on the right side of the vehicle to the control unit (19), wherein the lane limit detection device (13) is a camera (26) positioned to have a forward-facing field of view and is located behind the windshield of the vehicle (10), wherein the control unit (19) is capable of: a) to determine a safety zone (48) with a left safety zone boundary (47a) based on the recorded positions of the left lane boundaries (24a) and a right safety zone boundary (47b) based on the recorded positions of the right lane boundaries (24b), wherein the safety zone (48) has a width between the left and right safety zone boundaries (47a, 47b), b) to take a corrective action if the control unit (19) determines that the vehicle (10) risks unintentionally leaving the safety zone (48), the corrective action being at least one action selected from the group of actions consisting of: notifying the driver that the vehicle risks leaving the safety zone (48); and applying a steering correction to the vehicle, and c) to adjust the positions of the left safety zone boundary (47a) and the right safety zone boundary (47b) to adjust the width of the safety zone (48) if the vehicle (10) remains within the safety zone (48) for a selected period of time and does not cause the control unit (19) to take a corrective action, and in situations where the control unit (19) cannot detect lane boundaries (241, 24b) for longer than a selected period of time, the control unit (19) gradually reduces the extent of the corrective actions. [2] Lane Keeping Assist (11) according to claim 1, wherein the control unit (19) is capable of progressively reducing the width of the safety zone (48) the longer the vehicle (10) remains within the safety zone (48), and wherein the control unit (19) is capable of increasing the width of the safety zone (48) whenever the driver is notified that the vehicle (10) risks leaving the safety zone (48). [3] Lane Keeping Assist (11) according to claim 1, wherein the vehicle (10) includes a steering wheel (30) and wherein the Lane Keeping Assist (11) further includes a torque sensor positioned to determine a torque applied to the steering wheel (30) by a driver of the vehicle (10), and wherein the control unit (19) is capable of deactivating the Lane Keeping Assist (11) if the torque sensor detects torques applied to the steering wheel (10) that are less than a selected threshold torque for a selected period of time. [4] Lane keeping assist (11) according to claim 1, further comprising a steering assist device (54) controlled by the control unit (19) to apply a steering correction to the vehicle (10) to urge the vehicle (10) to remain within the safety zone (48). [5] Lane keeping assist (11) according to claim 4, wherein the steering correction applied to the vehicle (10) can be overcome by the driver applying a torque applied by the driver to the steering wheel (30), which is at least one selected torque applied by the driver. [6] Lane keeping assist (11) according to claim 1, wherein the control unit (19) is capable of limiting a reduction of the width of the safety zone (48) to a minimum safety zone width. [7] Lane keeping assist (11) according to claim 6, wherein the control unit (19) is capable of: to determine an initial estimated width based on an offset distance on the side of each of the lane boundaries; to select the first expected width as the minimum safety zone width if the first expected width represents a safety zone (48) that would allow some lateral movement of the vehicle (10) in the lane, and if the first expected width is smaller than the selected alternative width value; to select the chosen alternative width value as the minimum safety zone width if the first anticipated width does not represent a safety zone (48) that would allow some lateral movement of the vehicle (10) in the lane; and Select the chosen alternative width value as the minimum safety zone width if the first expected width is greater than the selected alternative width value. [8] Lane keeping assist device (11) according to claim 1, wherein the lane keeping assist device (11) comprises: a control unit (19); an output device configured to send haptic feedback only to the driver of the vehicle (10), wherein the control unit (19) is capable of: a) to determine, based on the information from the lane departure warning device (13), whether the vehicle (10) risks unintentionally leaving the lane; and b) to notify the driver via the output device based on the determination that the vehicle (10) risks unintentionally leaving the lane. [9] Lane keeping assist (11) according to claim 8, wherein the output device includes a vibration mechanism in a driver's seat in the vehicle (10). [10] Lane keeping assist (11) according to claim 8, wherein the output device includes a vibration mechanism positioned to cause vibration in a steering wheel of the vehicle (10). [11] Lane keeping assist device (11) according to claim 8, wherein the lane limit detection device (13) includes a camera with a forward-facing field of view. [12] Lane Keeping Assist (11) according to claim 8, wherein the vehicle (10) includes a steering system (18) which is operationally connected to the front wheels of the vehicle (10) to steer the front wheels, wherein the output device (50) is operationally connected to the steering system (18) to control steering of the front wheels based on the determination that the vehicle (10) risks unintentionally leaving the lane. [13] Lane Keeping Assist (11) according to claim 12, wherein the steering system includes a steering column, and wherein the output device (50) is configured to apply a selected torque to the steering column based on the determination that the vehicle (10) risks unintentionally leaving the lane. [14] Lane keeping assist (11) according to claim 8, wherein the control unit (19) is further capable of determining, based on information regarding an actual steering angle for the vehicle (10), whether the vehicle (10) risks unintentionally leaving the lane. [15] Lane Keeping Assistance (11) for use in a vehicle (10) traveling in a lane on a road, wherein the Lane Keeping Assistance (11) comprises: a control unit (19); a lane limit detection device (13) positioned to send information regarding the positions of a left lane limit on the road on the left side of the vehicle (10) and a right lane limit on the right side of the vehicle (10) to the control unit (19), wherein the lane limit detection device (13) is a camera (26) positioned to have a forward-facing field of view and is located behind the windshield of the vehicle (10), wherein the control unit (19) determines a safety zone (48) with a left safety zone boundary (47a) based on the recorded positions of the left lane boundaries (24a) and a right safety zone boundary (47b) based on the recorded positions of the right lane boundaries (24b), wherein the safety zone (48) has a width between the left and the right safety zone boundaries (47a, 47b), and an output device (50) configured to send feedback to the driver of the vehicle (10), wherein the control unit (19) is capable of: a) to determine whether the vehicle (10) risks unintentionally leaving the lane via a left side of the lane if the control unit (19) determines that the driver of the vehicle (10) intends to leave the lane via a right side of the lane; b) to determine whether the vehicle (10) risks unintentionally leaving the lane via the right side of the lane if the control unit (19) determines that the driver of the vehicle (10) intends to leave the lane via the left side of the lane; and c) to notify the driver, based on the settings made in steps a) and b), via the output device (50), that the vehicle (10) risks unintentionally leaving the safety zone (48), and to adjust the positions of the left safety zone boundary (47a) and the right safety zone boundary (47b) to adjust the width of the safety zone (48) if the vehicle (10) remains within the safety zone (48) for a selected period of time and does not cause the control unit (19) to take a corrective action, and that in situations where the control unit (19) cannot detect lane boundaries (241, 24b) for longer than a selected period of time, the control unit (19) will gradually reduce the extent of the corrective actions.
Citation Information
Patent Citations
Vehicle compass compensation
EP1043566A2
Means to electrically control street-switches.
US1025545A
Baker's pan.
US1047256A
Accessory system for vehicle
US20060050018A1
Mounting assembly for vehicle interior mirror
US20060061008A1