Driving Support Devices
The driving support device corrects detection range inaccuracies using camera-acquired lane and road information, addressing false alarms in millimeter-wave sensor systems by adjusting for vehicle position and road shape.
Patent Information
- Application Number
- JP2020113373
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-06-30
- Publication Date
- 2024-11-20
- Estimated Expiration
- 2040-06-30
AI Technical Summary
Existing vehicle detection systems using millimeter-wave sensors face issues with incorrectly setting the detection range of vehicles in adjacent lanes due to discrepancies between vehicle yaw rate and steering angle and road shape, leading to false alarms.
A driving support device that utilizes a camera to acquire information about the vehicle's position relative to the lane and road shape, correcting the detection range using parameters like distance to the lane edge and road curvature, thereby adjusting the detection range of adjacent lanes.
The device effectively sets the detection range of vehicles in adjacent lanes, reducing false alarms and improving warning performance by accurately detecting vehicles in their correct positions.
Smart Images

Figure 0007587221000001 
Figure 0007587221000002 
Figure 0007587221000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a device for assisting driving of a vehicle. [Background technology]
[0002] One of the functions that assists in safe driving of vehicles such as automobiles is the Blind Spot Monitor (BSM) function, which uses millimeter wave sensors (millimeter wave radar) attached to the left and right rear ends of the vehicle or to the left and right side mirrors to detect other vehicles traveling in adjacent lanes to the lane the vehicle is traveling in and issues an alert to the driver of the vehicle (host vehicle).
[0003] With the BSM function, for example, the detection range of other vehicles using a millimeter wave sensor is set based on the vehicle's lateral (vehicle width) position, yaw rate, and steering angle. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2006-315491 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, if the vehicle is not driving in the center of the lane, or if there is a discrepancy between the vehicle's yaw rate and steering angle and the road shape, the detection range for other vehicles driving in adjacent lanes may be set incorrectly, resulting in a failure to detect other vehicles driving in adjacent lanes and a false alarm being issued due to the detection of an object not in an adjacent lane.
[0006] An object of the present invention is to provide a driving assistance device that can appropriately set a detection range for another vehicle traveling in an adjacent lane to the lane in which the vehicle is currently traveling. [Means for solving the problem]
[0007] In order to achieve the above-mentioned object, the driving assistance device of the present invention includes: another vehicle detection means provided in a vehicle for detecting other vehicles traveling within a detection range rearward and to the side (rear lateral) of the vehicle; a detection range setting means for setting the detection range within an adjacent lane adjacent to the lane in which the vehicle is traveling based on parameters that change due to steering of the vehicle; a camera provided in the vehicle for photographing the outside of the vehicle; and a detection range correction means for correcting the detection range set by the detection range setting means based on information obtained from an image captured by the camera.
[0008] According to this configuration, a detection range is set within an adjacent lane adjacent to the lane in which the vehicle is traveling, based on parameters that change due to steering of the vehicle, and other vehicles traveling within that detection range are detected.
[0009] When the vehicle is traveling in the center of the lane and there is no deviation between the parameters that change due to the steering of the vehicle and the road shape, the detection range is set appropriately within the adjacent lane based on the parameters. However, when the vehicle is not traveling in the center of the lane or when there is a deviation between the parameters that change due to the steering of the vehicle and the road shape, the detection range may not be set within the adjacent range.
[0010] Therefore, information necessary for correcting the detection range is obtained from an image of the outside of the vehicle captured by a camera installed in the vehicle. Then, based on the obtained information, the detection range is corrected so that it is set within the adjacent lane. This makes it possible to appropriately set the detection range for other vehicles traveling in the adjacent lane. As a result, the occurrence of non-alarms due to not detecting other vehicles traveling in the adjacent lane and false alarms due to detecting objects in positions that are not in the adjacent lane are suppressed, thereby improving the alarm performance.
[0011] The information acquired from the image captured by the camera may include the distance between the vehicle and the edge of the lane the vehicle is traveling in. By acquiring the distance between the vehicle and the edge of the lane, the amount of deviation between the center of the vehicle in the vehicle width direction and the center of the lane can be calculated from the distance between the vehicle and the edge of the lane, and the deviation of the detection range caused by the vehicle not traveling in the center of the lane can be appropriately corrected according to the amount of deviation.
[0012] Information acquired from the image captured by the camera may also include the shape of the road behind the vehicle (for example, the radius of curvature of a curved road). By acquiring the shape of the road behind the vehicle, it is possible to obtain the amount of deviation between the parameters that change due to steering of the vehicle and the road shape from the shape of the road behind the vehicle, and the deviation of the detection range caused by the deviation between the parameters and the road shape can be appropriately corrected according to the amount of deviation.
[0013] The information obtained from the image captured by the camera may include both the distance between the vehicle and the edge of the lane the vehicle is traveling in, and the shape of the road behind the vehicle. In this case, even if the vehicle is not traveling in the center of the lane and there is a deviation between the parameters that change due to the steering of the vehicle and the road shape, the deviation of the detection range can be effectively corrected.
[0014] The parameter that changes due to steering of the vehicle may be the yaw rate or steering angle of the vehicle, or may be both. Effect of the Invention
[0015] According to the present invention, it is possible to appropriately set the detection range for another vehicle traveling in an adjacent lane to the lane in which the vehicle is currently traveling. [Brief description of the drawings]
[0016] [Figure 1] 1 is a block diagram showing a configuration of a driving assistance system according to an embodiment of the present invention; [Diagram 2]FIG. 2 is a diagram showing a detection range for detecting a vehicle traveling in the center of a lane on a straight road and other vehicles. [Diagram 3] 1A and 1B are diagrams showing a vehicle traveling off to the right side of a lane on a straight road and a detection range before correction. [Figure 4] 11A and 11B are diagrams showing a vehicle traveling off to the right side of a lane on a straight road and a corrected detection range; [Diagram 5] 1 is a diagram showing a detection range for detecting a vehicle and other vehicles traveling on a curved road with a constant radius of curvature. [Figure 6] 1 is a diagram showing a vehicle traveling on a curved road with a changing radius of curvature and a detection range before correction. [Figure 7] 11 is a diagram showing a vehicle traveling on a curved road with a changing radius of curvature and a corrected detection range; FIG. [Figure 8] FIG. 13 is a diagram showing a detection range for detecting a vehicle traveling in the rightmost lane and other vehicles. [Figure 9] FIG. 13 is a diagram showing a detection range for detecting a vehicle traveling in the leftmost lane and other vehicles. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0018] <Driving assistance system> FIG. 1 is a block diagram showing a configuration of a driving assistance system 1 according to an embodiment of the present invention.
[0019] The driving assistance system 1 is a system that is installed in a vehicle 100 (see FIG. 3) such as an automobile, and assists the driver in driving. As a function for assisting driving, the driving assistance system 1 has a BSM (Blind Spot Monitor) function that detects other vehicles traveling in lanes adjacent to the lane in which the vehicle 100 is traveling (hereinafter referred to as "adjacent lanes") and issues an alarm to the driver of the vehicle (own vehicle) 100. The BSM function can be switched between operation and non-operation, and a BSM switch 2 that is operated for this switching is disposed in a position such as an instrument panel that can be operated by the driver.
[0020] The driving assistance system 1 includes a radar 3 and a camera 4 mounted on a vehicle 100 .
[0021] The radar 3 is installed on the left and right rear of the vehicle 100, and is a sensor for detecting the conditions within irradiation ranges (for example, a range of about 100 m) on the left and right rear of the vehicle 100, respectively. The radar 3 irradiates radar waves into the irradiation range, receives reflected waves from objects present within the irradiation range, and outputs a detection signal according to the reflected waves. The radar 3 may be a millimeter wave radar (millimeter wave sensor) that uses radio waves in the millimeter wave band as radar waves, or may be a laser radar that uses a laser as radar waves.
[0022] The camera 4 is capable of continuously capturing still images at a predetermined frame rate, and may be a monocular camera or a stereo camera. The camera 4 is disposed, for example, at the center of the rear of the vehicle 100 (for example, at the center of the lower surface of the rear spoiler) so as to be able to capture an image of the rear of the vehicle 100 at a wide angle. The camera 4 may be disposed at the front of the vehicle 100 so as to be able to capture an image of the front of the vehicle 100. In this case, a distance L between the vehicle 100 and the edge of the driving lane ahead, which will be described later, may be acquired from an image of the front captured by the camera 4. The camera 4 may also be disposed at the front and rear of the vehicle 100.
[0023] The driving assistance system 1 includes a driving assistance ECU (Electronic Control Unit) 5. The driving assistance ECU 5 is an electronic control unit including a microcontroller unit (microcomputer), and the microcontroller includes, for example, a CPU, a non-volatile memory such as a flash memory, and a volatile memory such as a dynamic random access memory (DRAM). In addition to the driving assistance ECU 5, the vehicle 100 is also equipped with an ECU having a hardware configuration similar to that of the driving assistance ECU 5 in order to control each part, and the multiple ECUs including the driving assistance ECU 5 are connected to enable two-way communication using a controller area network (CAN) communication protocol.
[0024] The driving assistance ECU 5 switches the BSM function on (activated) / off (inactivated) in response to the operation of the BSM switch 2. When the BSM function is on, the driving assistance ECU 5 executes another vehicle detection process, which will be described next, and when the other vehicle detection process detects another vehicle traveling in an adjacent lane, the driving assistance ECU 5 causes the indicator 6 to flash or light up, and also causes the buzzer / speaker 7 to output a voice or an alarm sound.
[0025] <Other vehicle detection processing> 2, 3 and 4 are diagrams showing detection ranges for detecting the vehicle 100 and other vehicles traveling on a straight road.
[0026] In addition, in FIG. 2 and the subsequent figures, the detection range of other vehicles by the radar 3 is indicated by hatching.
[0027] When the BSM function is turned on by operating the BSM switch 2, another vehicle detection process is started. In the another vehicle detection process, first, a coordinate system for identifying the position of the vehicle 100 is set. For example, as shown in Fig. 2, a plane coordinate system is set with the position of the center of gravity of the vehicle 100 as the origin, and including an X axis along the front-rear direction of the vehicle 100 and a Y axis along the width direction of the vehicle 100.
[0028] Next, the yaw rate of the vehicle 100 is acquired. The vehicle 100 is provided with a yaw rate sensor (not shown) for detecting the yaw rate. The yaw rate sensor outputs a detection signal corresponding to a yaw rate that is a rotational angular velocity around a vertical axis passing through the center of gravity of the vehicle 100. The detection signal of the yaw rate sensor may be input to the driving assistance ECU 5, or may be input to an ECU other than the driving assistance ECU 5. When the detection signal of the yaw rate sensor is input to the driving assistance ECU 5, the driving assistance ECU 5 determines the yaw rate from the detection signal of the yaw rate sensor. When the detection signal of the yaw rate sensor is input to an ECU other than the driving assistance ECU 5, the ECU determines the yaw rate from the detection signal of the yaw rate sensor, and the determined yaw rate is input to the driving assistance ECU 5.
[0029] Further, the steering angle of the vehicle 100 is acquired. The vehicle 100 is provided with a steering angle sensor (not shown) for detecting the steering angle. The steering angle sensor outputs a detection signal according to the steering angle with respect to the steering angle midpoint of the steering mechanism of the vehicle 100. The steering angle may be a steering angle (rotational operation angle) from the neutral position of the steering wheel, or a steering angle from the neutral position of the steering wheel. The detection signal of the steering angle sensor may be input to the driving assistance ECU 5, or may be input to an ECU other than the driving assistance ECU 5. When the detection signal of the steering angle sensor is input to the driving assistance ECU 5, the driving assistance ECU 5 determines the steering angle from the detection signal of the steering angle sensor. When the detection signal of the steering angle sensor is input to an ECU other than the driving assistance ECU 5, the ECU determines the steering angle from the detection signal of the steering angle sensor, and the determined steering angle is input to the driving assistance ECU 5.
[0030] When the driving assistance ECU 5 acquires the yaw rate and steering angle of the vehicle 100, the shape of the road on which the vehicle 100 is traveling is estimated from the yaw rate and steering angle, and the detection range of other vehicles by the radar 3 is set according to the road shape.
[0031] For example, as shown in FIG. 2, when the road on which vehicle 100 is traveling is a straight road and vehicle 100 is traveling in the center of the second driving lane, the distance from the center of the second driving lane to the left edge (the distance from the center of the second driving lane to the first driving lane) and the distance to the right edge (the distance from the center of the second driving lane to the passing lane) are both known, so using these distances, the detection range of other vehicles by radar 3 can be set to the first driving lane and the passing lane, which are adjacent lanes behind and to the side of vehicle 100.
[0032] However, as shown in FIG. 3, when vehicle 100 is in the second driving lane of a straight road and is shifted from the center of the second driving lane to the right (the passing lane side), the detection range that is set using the distance from the center of the second driving lane to the left edge and the distance to the right edge will be shifted to the right relative to the first driving lane and the passing lane.
[0033] Therefore, the distance L between the vehicle 100 and the right edge of the second driving lane (the edge of the lane on which the vehicle 100 is traveling) is acquired from the image captured by the camera 4. After that, the distance L is compared with the distance between the center of the second driving lane and the right edge, and the amount of deviation between the center of the vehicle 100 in the vehicle width direction and the center of the second driving lane is obtained. Then, the detection range of other vehicles by the radar 3 is corrected to the left according to the amount of deviation. By this correction, as shown in FIG. 4, the detection range of other vehicles by the radar 3 can be set on the first driving lane and the overtaking lane, which are adjacent lanes behind and to the side of the vehicle 100. Note that the distance L may be the distance between the end of the vehicle 100 in the vehicle width direction and the edge of the driving lane, instead of the center of the vehicle 100 in the vehicle width direction.
[0034] 5, 6 and 7 are diagrams showing detection ranges for detecting the vehicle 100 and other vehicles traveling on a curved road.
[0035] As shown in FIG. 5, the road on which the vehicle 100 is traveling is a curved road that curves to the left with a constant radius of curvature. When the vehicle 100 is traveling in the center of the second driving lane, the radius of curvature R of the curved road can be obtained from the yaw rate and steering angle of the vehicle 100. Since the distances from the center of the second driving lane to the left and right ends are known respectively, using these distances and the radius of curvature R of the curved road, the detection range of other vehicles by the radar 3 can be set on the first driving lane and the overtaking lane, which are adjacent lanes behind and to the side of the vehicle 100.
[0036] However, as shown in FIG. 6, the radius of curvature of the curved road changes in the middle, and in the situation where the vehicle 100 is approaching the change point of the radius of curvature, there is a deviation between the radius of curvature R' obtained from the yaw rate and steering angle of the vehicle 100 and the radius of curvature R of the curved road behind and to the side of the vehicle 100 (for example, R' < R). Therefore, the detection range set using the distances from the center of the second driving lane to the left and right ends and the radius of curvature R' obtained from the yaw rate and steering angle will deviate from the first driving lane and the overtaking lane.
[0037] Therefore, the radius of curvature R of the curved road behind and to the side of the vehicle 100 is obtained from the captured image by the camera 4. Then, according to the radius of curvature R, the road shape (such as the degree of the curved road) behind and to the side of the vehicle 100 is estimated, and the detection range of other vehicles by the radar 3 is corrected by the above-mentioned distance L. By this correction, as shown in FIG. 7, the detection range of other vehicles by the radar 3 can be set on the first driving lane and the overtaking lane, which are adjacent lanes behind and to the side of the vehicle 100.
[0038] <Advantages and effects> As described above, in the configuration for detecting other vehicles traveling in the adjacent lanes behind and to the side of the vehicle 100 by the radar 3, the detection range of other vehicles by the radar 3 can be set appropriately. As a result, the occurrence of non-alarms due to not detecting other vehicles traveling in the adjacent lanes and false alarms due to detecting objects at positions other than the adjacent lanes is suppressed, and the alarm performance is improved.
[0039] <Modification> Although one embodiment of the present invention has been described above, the present invention can be embodied in other forms.
[0040] For example, when the vehicle 100 is not traveling in the center of the lane and the radius of curvature calculated from the yaw rate and steering angle of the vehicle 100 deviates from the radius of curvature of the curved road behind and to the side of the vehicle 100, the deviation of the detection range of other vehicles by the radar 3 can be effectively corrected by combining the correction described with reference to Figures 3 and 4 and the correction described with reference to Figures 6 and 7.
[0041] Since the lane in which the vehicle 100 is traveling can be identified from the image captured by the camera 4, as shown in Fig. 8, when the vehicle 100 is traveling in the rightmost lane (passing lane), the rear and right side of the vehicle 100 may be outside the detection range, and the detection range may be set only to the rear and left side of the vehicle 100. Also, as shown in Fig. 9, when the vehicle 100 is traveling in the leftmost lane (first traveling lane), the rear and left side of the vehicle 100 may be outside the detection range, and the detection range may be set only to the rear and right side of the vehicle 100. This is true not only when the vehicle 100 is traveling on a straight road, but also when the vehicle 100 is traveling on a curved road.
[0042] In addition, various design modifications can be made to the above-described configuration within the scope of the claims. [Explanation of symbols]
[0043] 1: Driving assistance system (driving assistance device) 3: Radar (means for detecting other vehicles) 4: Camera 5: Driving assistance ECU (detection range setting means, detection range correction means) 100:Vehicle
Claims
[Claim 1] Another vehicle detection means is provided in the vehicle and detects another vehicle traveling within a detection range behind and to the sides of the vehicle; a yaw rate sensor for detecting a yaw rate of the vehicle; a steering angle sensor for detecting a steering angle of the vehicle; a detection range setting means for estimating a shape of a road on which the vehicle is traveling based on the yaw rate obtained from a detection signal of the yaw rate sensor and the steering angle obtained from a detection signal of the steering angle sensor, and for setting the detection range within an adjacent lane adjacent to the lane on which the vehicle is traveling, behind and to the side of the vehicle, in accordance with the shape of the road; A camera provided in the vehicle for capturing an image of the outside of the vehicle; a detection range correction means for acquiring a distance between a center of the vehicle in a vehicle width direction and one end of the lane in which the vehicle is traveling from an image captured by the camera, calculating an amount of deviation between the center of the vehicle in the vehicle width direction and the center of the lane in which the vehicle is traveling from the acquired distance and the distance from the center of the lane in which the vehicle is traveling to the one end, and shifting the detection range set by the detection range setting means in accordance with the amount of deviation, thereby correcting the detection range so that it is set within the adjacent lane.
Citation Information
Patent Citations
Obstacle detecting device for vehicle
JP1992258780A
Traveling controller for vehicle
JP2006315491A
Driving support device
JP2012234373A
Obstacle detection device
JP2013242679A
Travel support method and travel support device
JP2018197966A
