Method and device for lane keeping assistance for a vehicle

A sensor system using infrared or camera technology effectively detects lane markings and calculates vehicle position, addressing the complexity and cost issues of existing lane keeping systems, enabling precise lane maintenance and enhanced vehicle control.

DE102006060892B4Inactive Publication Date: 2024-11-07A D C AUTOMOTIVE DISTANCE CONT
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102006060892
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2006-12-22
Publication Date
2024-11-07
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing lane keeping support systems for vehicles are complex and costly, lacking a simple and cost-effective method and device for detecting lane markings and maintaining vehicle position within the lane.

Method used

A sensor system, preferably using infrared transmitters and receivers or cameras, detects lane markings by measuring pulse transit time or analyzing image data to determine distance and position, and uses geometric calculations to estimate lane width and vehicle position, with a detection threshold to filter noise and irrelevant signals.

Benefits of technology

Enables accurate and efficient lane keeping support by reliably identifying lane markings and maintaining vehicle position, reducing complexity and cost while enhancing vehicle control systems like adaptive cruise control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method for lane keeping assistance for a vehicle comprising a sensor system and a data processing unit, wherein ◯ the sensor system detects a predefined area in front of the vehicle, ◯ for at least one type of road marking, a reference value for the reflectance and / or a characteristic shape of the sensor signal caused by this road marking is stored, and ◯ the current lane is estimated from sensor data recorded from ahead lane markings, ◯ the current lane width is estimated from the sensor data of the currently ahead lane markings, assuming that the width of the ahead lane is the same as the current width.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method and a device for lane keeping assistance for a vehicle. The method and the device are particularly suitable for motor vehicles equipped with adaptive speed control based on an infrared sensor system.

[0002] Methods and devices for lane keeping assistance are known as prior art. For example, patent specification DE 195 07 957 C1 describes a vehicle with an optical scanning device for a lateral roadway area. The scanning device comprises several infrared transmitters and an associated CCD array. The detection range of the scanning device is aligned with potential lane markings to the left and right of the vehicle. The distance and contour of the detected objects are determined. Depending on further parameters, a warning signal is also issued if the vehicle leaves its lane.

[0003] JP 2005 - 332 104 A discloses a device for lane line detection that is capable of recognizing a lane line by image synthesis of photographed images. The images are captured by an imaging device, such as a camera for imaging an area of ​​the road surface. Furthermore, WO 2004 / 021 546 A2 discloses an assistance function with a 3D distance imaging camera for a means of transport, which, in addition to grayscale or color image data, also provides distance data for detecting objects in the vicinity of the means of transport.

[0004] The object of the invention is to present a simple and cost-effective method and a similar device for lane keeping support for a vehicle.

[0005] This problem is solved according to the invention by a method and a device according to the independent claims. Advantageous embodiments are described in the dependent claims.

[0006] A lane keeping assist system according to the invention is described for a vehicle comprising a sensor system and a data processing unit. The sensor system is sensitive to lane markings and detects objects in a predetermined area in the direction of travel ahead of the vehicle. Preferably, the sensor system is arranged in a motor vehicle behind the windshield, near the headlights, or in the radiator grille. A reference value for the reflectance and / or a characteristic shape of the sensor signal generated by at least one type of lane marking is stored. The current lane is estimated from sensor data acquired from ahead lane markings.

[0007] In an advantageous embodiment of the invention, the sensor system is configured to include at least one infrared transmitter and receiver. The distance to objects, in particular lane markings, in front of the vehicle is determined by a suitable measurement method, e.g., pulse time-of-flight measurement.

[0008] In a further embodiment of the invention, the sensor system is configured as a camera system comprising at least one image sensor. The distance to objects, particularly lane markings, is determined directly from the image data, for example, in a stereo camera. In a mono camera, the distance to objects is estimated using geometric considerations.

[0009] In a preferred embodiment of the invention, the current lane width is estimated from the sensor data of the lane markings currently ahead, assuming that the width of the ahead lane corresponds to the current width. The width of the ahead lane is determined, for example, from the spacing of the lane markings and the predetermined detection range, in particular the opening angle, of the sensor system.

[0010] In an advantageous embodiment of the invention, the current position of the vehicle with sensor system on the lane—i.e., whether the vehicle is centered on the lane or closer to the left or right edge—is estimated from the sensor data regarding the lane markings ahead and the predefined detection range of the sensor system. The detection range of the sensor system is, for example, symmetrical to the vehicle's longitudinal axis. If the vehicle is centered on the lane, the lane markings to the left and right of the vehicle are essentially equidistant. This consideration can easily be transferred by a person skilled in the art to predefined detection ranges that are not symmetrical to the vehicle's longitudinal axis.

[0011] In a further embodiment of the invention, the width of the preceding lane is determined. In addition, the vehicle's own movement is recorded. Once the vehicle has reached the aforementioned preceding point, the previously determined lane width is adopted as the current lane width.

[0012] In an advantageous embodiment of the method according to one of the preceding claims, a lane is determined based on the preceding lane markings. For this purpose, a trajectory is calculated that describes the vehicle's movement as it continues along the lane. The calculated trajectory is compared with the vehicle's actual movement. From this comparison, the vehicle's current position on the lane is determined. If the actual movement and the trajectory match, the vehicle's position on the lane is assumed to be centered. Corresponding conclusions are drawn if the actual movement is more to the left or right than predicted by the trajectory.

[0013] In a preferred embodiment of the invention, a detection threshold is provided. The detection threshold serves to separate desired signals from objects from undesired signals, e.g., noise, interference, or signals from irrelevant objects. The detection threshold of the sensor system is set such that road markings are detected with a high probability. It should be noted that the intensity of the signal reflected by a road marking is distance-dependent. For example, in pulse time-of-flight measurement, a detection threshold that decreases with time of flight can be used, since the signal strength of more distant objects is lower than that of objects that are very close to the sensor system.

[0014] The inventive method for lane keeping assistance is, for example, implemented in a motor vehicle with a sensor system and a data processing unit.

[0015] In a preferred embodiment of the motor vehicle with sensor system, lane keeping assistance and adaptive longitudinal speed control, e.g. ACC, are based on the data of one sensor system.

[0016] The invention is explained in more detail below with reference to exemplary embodiments and two figures. Fig. 1: Determining the object distance using a monocular camera system Fig. 2: Schematic representation of a vehicle with a sensor system on a roadway Fig. 3: Angle-dependent sensitivity profile of a seven-channel sensor system Fig. 4: Motor vehicle with sensor system in a typical environment

[0017] All features described here can contribute to the invention individually or in any combination. The sequence of process steps chosen here does not necessarily dictate a specific timeline.

[0018] In one embodiment, the sensor system is designed as a monocular camera system. Fig. Figure 1 shows a method for determining the distance to a point or object d using a monocular camera. The distance to the monocular camera is calculated from h, the camera mounting height, α, the camera tilt angle, y, the image line of the point, η, the pixel size, and f, the camera focal length. d=h⋅1−t⋅tan αt+tan α with t=y⋅ηf The distance d can be determined. If the aforementioned parameters are known by adjusting the camera's viewing direction, the distance d can be calculated. Lane markings, for example, are recognizable in the camera image based on their shape, such as a broken or solid line on the road. Knowing the imaging properties of the camera system and the equation above, the distance between two lane markings, spaced apart in a row y of the image, is calculated. The distance between the lane markings indicates the lane width.

[0019] To detect lane markings, an edge detection method and / or a pattern recognition method is used, for example. Lane markings are usually arranged in a periodically repeating pattern; this characteristic can also be used for detection, e.g., by frequency analysis of the time-dependent signal.

[0020] In one embodiment, the sensor system is designed as an infrared sensor system. The sensor system has a first transmitter-receiver pair that monitors the right half of the total detection range, and a second transmitter-receiver pair that similarly monitors the left half of the total detection range. The distance to objects is determined by pulse time-of-flight measurement. Lane markings, which are designed as broken or solid lines on the road surface, are detected by their signal shape. The reflected signal typically has an extended pulse shape and is thus distinguishable from other objects, e.g., vehicles, which produce a reflected signal with a narrow shape. The same applies to lane markings of any other shape, which likewise have a characteristic pulse shape in the reflected signal and can thus be distinguished from other objects. In many countries, for example,Lane markings are arranged in a periodically recurring pattern; this property can also be used for detection, e.g., by a frequency analysis of the time-dependent signal.

[0021] The reflectivity of the lane markings remains essentially the same, unless the road markings are heavily soiled. Therefore, the value of 1 / x also applies. 4 The scaled amplitude of the reflection signal from lane markings is essentially the same. This criterion can also be used for the reliable detection of lane markings, for example, by only recognizing objects with a predefined distance-scaled amplitude as lane markings.

[0022] In Fig. Figure 2 shows a vehicle 1 equipped with an infrared sensor system. Four separate detection areas 6ad are provided, arranged symmetrically to the longitudinal axis of the vehicle 1, and their opening angles with respect to the vehicle's longitudinal axis are predefined. Area 6a detects the angle range -b...-a, area 6b detects -a...0, 6c detects 0...a, and 6d detects a...b. Lane markings 5 ​​are also shown. The lane width 2 is determined, for example, as follows: in area 6a, lane markings with their associated distance values ​​are detected. Due to the predefined opening angle -b...-a, the smallest distance is assigned to angle -b and the largest distance to angle -a. The same procedure is carried out in detection area 6d. Here, too, a distance value is assigned to angles a and b. In an advantageous embodiment, the distance values ​​of the lane markings 5 ​​are recorded over a predefined period, for example, to...to determine the smallest and / or largest distance value with greater accuracy. If the distance values ​​for angles a and -a or b and -b are equal, vehicle 1 is located in the center of the lane. The lane width 2 can be calculated from the distance of the lane marking at a known first angle (here -a or -b) and the distance of the lane marking at a known second angle (here a or b), since for any given triangle, three pieces of information (sides S or angles W) are sufficient to calculate the three missing pieces of information.

[0023] In one embodiment, the sensor system 3 is designed as an infrared sensor system that determines the distance and position of objects. For this purpose, any combination of several transmitters with overlapping transmission ranges and / or receivers with overlapping reception ranges is provided. By way of example, in Fig. Figure 3 shows an angle-dependent sensitivity curve of a sensor system with seven measurement channels. The sensitivity of each channel is represented by the seven curves. To determine the position of an object, the signal from two overlapping measurement channels is compared. The object's position angle is determined from the ratio of the signal strength in a first measurement channel to the signal strength of the same object in a second, adjacent measurement channel. The lane width is calculated based on geometric considerations, as described above.

[0024] In Fig. Figure 4 shows motor vehicle 1 with a sensor system in a typical environment. The vehicle 1 is moving on a two-lane roadway. Each of the two lanes is delimited by lane markings 5. The motor vehicle 1 includes a sensor system 3. The detection range of the sensor system 3 is shown by the dotted lines in Figure 4. Fig.Figure 4 illustrates this. The sensor system 3 is mounted on the front of vehicle 1. Vehicle 1 moves in the center of the lane. Line 4 indicates the movement of vehicle 1. The width of the preceding lane is determined, e.g., for the position where vehicle 1' is located. The vehicle's movement is recorded, e.g., using a yaw rate and steering angle sensor. At a later time, when vehicle 1 is at the position of vehicle 1', the previously determined lane width is used as the current lane width.

Claims

[1] Method for lane keeping assistance for a vehicle with a sensor system and a data processing unit, wherein ◯ the sensor system detects a specified area in front of the vehicle, ◯ for at least one type of road marking, a reference value for the reflection strength and / or a characteristic shape of the sensor signal caused by this road marking is stored, and ◯ the current lane is estimated from sensor data recorded from lane markings ahead, ◯ the current lane width is estimated from the sensor data of the lane markings currently ahead, assuming that the width of the lane ahead matches the current width. [2] Method according to claim 1, wherein the sensor system comprises at least one infrared transmitter and receiver and the distance of objects, in particular lane markings, in front of the vehicle is determined. [3] Method according to claim 1, wherein the sensor system is a camera system and the distance of objects, in particular lane markings, in front of the vehicle is determined from the image data. [4] Method according to one of the preceding claims, wherein the current position of the vehicle with lane keeping assistance on the lane (center, left edge, right edge) is estimated from the sensor data of lane markings ahead and the predetermined detection range of the sensor system. [5] Method according to one of the preceding claims, ◯ where a movement of the vehicle is recorded with a sensor system, ◯ determines the width of the lane ahead, and ◯ this width at a later time, which depends on the vehicle's own movement, when the current lane width is adopted. [6] Method according to one of the preceding claims, wherein a trajectory is calculated on the basis of the lane ahead, which trajectory describes a movement of the vehicle with the sensor system as it continues to move in the lane, and the calculated trajectory is compared with an actual movement of the vehicle in order to determine the current position of the vehicle in the lane. [7] Method according to one of the preceding claims, wherein a detection threshold is specified such that road markings are detected with a high probability. [8] Motor vehicle with a sensor system and a data processing unit on which a method for lane keeping assistance according to one of the preceding claims is stored. [9] Motor vehicle according to claim 8, wherein the data of the sensor system are used for lane keeping assistance and for adaptive control of the longitudinal speed of the vehicle.

Citation Information

Patent Citations

  • Automatic operating method for automobile trafficator display with evaluation of data for identification of turning or lane changing maneuver

    DE10251357A1

  • device for determining the vehicle distance from a lateral lane marking

    DE19507956A1

  • vehicle with an optical scanning device for a side lane area

    DE19507957C1

  • laser guide

    DE4307408A1

  • Vehicle traffic lane line recognition apparatus

    JP2005332104A