Vehicle driving control device

The vehicle control system addresses steering control issues by accurately detecting lane markings and vehicle signals to maintain the desired path during driving support, ensuring the steering wheel does not deviate excessively.

JP7590847B2Active Publication Date: 2024-11-27SUBARU CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020168087
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-02
Publication Date
2024-11-27
Estimated Expiration
2040-10-02

AI Technical Summary

Technical Problem

Existing vehicle driving support systems face issues with steering control when lane marking recognition reliability is low or markings cannot be recognized, leading to steering wheel movement contrary to the desired travel path due to following a preceding vehicle's behavior.

Method used

A vehicle control system that includes an external recognition unit to detect lane markings and other vehicles' brake and turn signal lamps, controlling steering based on reliable detection to prevent steering wheel deviation from the desired path.

Benefits of technology

The system effectively suppresses steering control deviations by accurately recognizing vehicle behaviors and lane markings, preventing the steering wheel from being turned too far from the desired course during preceding vehicle following and lane keeping controls.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590847000001
    Figure 0007590847000001
  • Figure 0007590847000002
    Figure 0007590847000002
  • Figure 0007590847000003
    Figure 0007590847000003
Patent Text Reader

Abstract

To provide a vehicle drive support device which suppresses such steering control that a handle of an own vehicle becomes largely uncontrollable for a behavior of a following preceding vehicle against a desired travel route when executing drive support such as preceding vehicle following control and traffic lane maintaining control.SOLUTION: A vehicle travel control device 10 comprises: outside recognition units 11a, 11b; a travel environment recognition unit 11d which detects traffic lane division lines LL, LR, turn-on of brake lamps 41, 42 and blinking of winker lamps 43, 44 of other vehicles V1 to V3; and a steering control unit 25 which operates a drive source 28 of a steering mechanism. The travel environment recognition unit 11d can detect blinking of the winker lamps 43, 44 of the same vehicles V1 to V3 again after an elapse of a prescribed time after turn-off of blinking in the other vehicles V1 to V3 in which blinking of the winker lamps 43, 44 is detected.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a vehicle navigation system for tracking a vehicle ahead on a target route. Driving control device Regarding. [Background technology]

[0002] Conventionally, in vehicle driving assistance, a preceding vehicle following control is known in which a preceding vehicle is detected on a target route set ahead of the vehicle, and when the distance between the preceding vehicle and the vehicle falls within a set distance, the preceding vehicle is driven along the target route while maintaining a specified distance from the preceding vehicle.

[0003] In such driving assistance technology, a target route is set so that the vehicle travels, for example, in the center of lane markings such as white lines that divide the left and right sides of the driving lane, and various driving controls such as preceding vehicle following control and lane keeping control are performed so that the vehicle travels on the target route based on driving environment information ahead of the vehicle acquired by a driving environment information acquisition means consisting of a camera or radar mounted on the vehicle, or a combination of these, as well as map information and vehicle position information from a car navigation system.

[0004] For example, Patent Document 1 discloses a vehicle cruise control device that can detect an obstacle avoidance action of a preceding vehicle at an early stage and can take obstacle avoidance action of the host vehicle with ample time to spare. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2018-171959 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, during driving assistance such as preceding vehicle following control and lane keeping control, when the reliability of lane marking recognition is low or when the lane markings cannot be recognized and driving control is being performed to follow the preceding vehicle, there is a problem that steering control is performed in such a way that the steering wheel of the vehicle is pulled in response to the behavior of the preceding vehicle that is contrary to the desired course of travel.

[0007] In order to solve the above problems, the present invention provides a vehicle steering control system that suppresses steering control that causes the steering wheel of the vehicle to be pulled in response to the behavior of the preceding vehicle that deviates from the desired traveling path when driving assistance such as preceding vehicle following control and lane keeping control is being performed. Driving control device The purpose is to provide. [Means for solving the problem]

[0008] A vehicle driving control device according to one aspect of the present invention includes an external recognition unit mounted on a host vehicle and acquiring driving environment image information ahead of the host vehicle, a driving environment recognition unit that detects lane markings and the illumination of brake lights and blinker lights of other vehicles from the driving environment image information acquired by the external recognition unit, a steering control unit that operates a drive source of a steering mechanism, and a driving control unit that controls the steering control unit based on the detection results of the driving environment recognition unit to drive and control the host vehicle along a target driving route. Running a control unit, wherein the driving environment recognition unit detects a blinking of the turn signal lamp of the other vehicle and detects a blinking of the turn signal lamp for a predetermined time after the blinking of the turn signal lamp is turned off. but Progress Only if and the detection process of the blinking of the turn signal lamp of the same other vehicle can be executed again. do. Effect of the Invention

[0009] According to the present invention, when driving assistance such as preceding vehicle following control and lane keeping control is being performed, The steering wheel of the vehicle is turned too far in response to the behavior of the vehicle ahead, which is contrary to the desired course of travel. Vehicle steering control that suppresses Driving control device can be provided. [Brief description of the drawings]

[0010] [Figure 1] Overall configuration diagram showing a vehicle driving control system [Diagram 2] An explanatory diagram showing road-to-vehicle communication and vehicle-to-vehicle communication. [Diagram 3] FIG. 1 is an explanatory diagram showing detection areas by a stereo camera and a radar device; [Figure 4] An explanatory diagram showing the recognition of other vehicles and lane markings in the detected forward area image. [Diagram 5] Diagram showing recognition of a vehicle ahead with its tail lights, brake lights on and turn signals not flashing [Figure 6] A diagram showing the recognition of a vehicle ahead with its brake lights on. [Figure 7] A diagram showing the recognition of a preceding vehicle with the left turn signal lamp on. [Figure 8] A diagram showing the recognition of a preceding vehicle with the right turn signal lamp on. [Figure 9] A flowchart showing an example of control for determining whether tail lamps and brake lamps are turned on and whether turn signal lamps are turned on [Figure 10] A diagram showing a state in which a vehicle ahead of the vehicle is turning on its turn signal and leaving the lane to the left. [Figure 11] A diagram showing a situation where a preceding vehicle on the left lane cuts into the vehicle's lane with its turn signal flashing. [Figure 12] A diagram showing a state in which a vehicle ahead of the vehicle has cut into the vehicle's lane and is turning on its turn signal to exit the lane to the right. [Figure 13] Flowchart showing an example of control when a turn signal lamp of a preceding vehicle is detected during driving assistance [Figure 14] Flowchart showing an example of control when a turn signal lamp of a vehicle traveling alongside is detected during driving assistance [Figure 15] A diagram explaining a situation where a vehicle traveling alongside on the right changes lanes from the right lane to the vehicle's own lane and from the own lane to the left lane without blinking its turn signal lamp. [Figure 16] A flow chart showing an example of control when a vehicle traveling alongside changes lanes without blinking its turn signal during driving assistance. [Figure 17] A diagram showing a state during driving control according to trajectory information of a target point of a preceding vehicle. [Figure 18] A diagram showing a state in which a vehicle traveling parallel to the right has cut into the vehicle's lane and is overlapping the vehicle. [Figure 19] A diagram showing the state when the vehicle running alongside on the right that has cut in is switched to the preceding vehicle. [Figure 20] A diagram showing the state in which the vehicle is traveling along the original trajectory information of the preceding vehicle. [Figure 21] A diagram showing a vehicle that has cut in and is leaving its own lane into the left lane [Figure 22] A diagram showing the state in which a vehicle that has cut in is at the limit position of the trajectory information. [Diagram 23] A diagram showing a situation where lane markings cannot be recognized due to tire marks caused by snow when following a vehicle ahead. [Figure 24] A diagram showing a situation where a truck ahead of you crosses a lane marking while changing lanes. [Diagram 25] 6 is a flowchart showing an example of control for suppressing or canceling control to follow the preceding vehicle when lane markings become unrecognizable while following the preceding vehicle. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings, in which: FIG 1 is a diagram showing the overall configuration of a cruise control system according to an embodiment of the present invention;

[0012] 1 and 2, the cruise control system 1 in this embodiment includes cruise control devices 10 mounted on a plurality of vehicles, and a plurality of control devices 100 provided in a network environment NW to which the plurality of cruise control devices 10 are connected via wireless communication. The control device 100 is provided as a server device in a network environment based on cloud computing or edge computing, or a network environment based on a roadside facility network, for example.

[0013] The control device 100 sequentially integrates and updates the road map information transmitted from the cruise control devices 10 of the vehicles, and transmits the updated road map information to the vehicles. For this reason, the control device 100 is configured to include a road map information integration_ECU 101 and a transceiver 102.

[0014] The road map boundary information integration_ECU 101 integrates road map information collected from multiple vehicles through the transceiver 102, and sequentially updates road map information surrounding a vehicle on a road. The road map information is, for example, a dynamic map, and has four layers of information: static information and quasi-static information that mainly constitute road information, and quasi-dynamic information and dynamic information that mainly constitute traffic information.

[0015] Static information consists of information that needs to be updated within one month, such as roads and road structures, lane information, road surface information, permanent traffic regulation information, etc. Semi-static information consists of information that needs to be updated within one hour, such as traffic regulation information due to road construction or events, wide-area weather information, and traffic congestion forecasts.

[0016] Semi-dynamic information consists of information that requires updating, for example, within one minute, such as the actual traffic congestion situation and driving restrictions at the time of observation, temporary driving impairments such as fallen objects and obstacles, actual accident conditions, and narrow-area weather information.

[0017] Dynamic information consists of information that must be updated within one second, such as information transmitted and exchanged between moving objects, information on currently displayed traffic signals, information on pedestrians / motorcycles within an intersection, and information on vehicles traveling straight through an intersection.

[0018] Such road map information is maintained / updated periodically until the next information is received from each vehicle, and the updated road map information is appropriately transmitted to each vehicle via the transceiver 102.

[0019] The vehicle driving control device 10 has a driving environment recognition unit 11 and a locator unit 12 as units for recognizing the driving environment outside the vehicle. The driving control device 10 also includes a driving control unit (hereinafter referred to as "driving_ECU") 22, an engine control unit (hereinafter referred to as "E / G_ECU") 23, a power steering control unit (hereinafter referred to as "PS_ECU") 24 which is a steering control unit, and a brake control unit (hereinafter referred to as "BK_ECU") 25. These control units 22 to 25 are connected to the driving environment recognition unit 11 and the locator unit 12 via an in-vehicle communication line such as a CAN (Controller Area Network).

[0020] The driving environment recognition unit 11 is fixed, for example, to the center of the upper part of the front part of the vehicle interior. The driving environment recognition unit 11 has an on-board camera (stereo camera) that is an external recognition device consisting of a main camera 11a and a sub-camera 11b, an image processing unit (IPU) 11c, and a first driving environment recognition unit 11d.

[0021] The main camera 11a and the sub-camera 11b are, for example, autonomous sensors that sense the real space ahead of the vehicle M. The main camera 11a and the sub-camera 11b are, for example, disposed at symmetrical positions on either side of the center in the vehicle width direction, and capture stereo images of the area Af (see FIG. 3) ahead of the vehicle M from different viewpoints.

[0022] The IPU 11c processes the forward driving environment image information of the area in front of the vehicle M captured by both cameras 11a, 11b in a predetermined manner, and generates forward driving environment image information (distance image information) including distance information calculated from the amount of deviation between the positions of corresponding objects.

[0023] The first driving environment recognition unit 11d obtains lane markings that divide the roads around the host vehicle M based on distance image information received from the IPU 11c.

[0024] The first driving environment recognition unit 11d also obtains the road curvature [1 / m] of the lane markings dividing the left and right sides of the road on which the host vehicle is traveling (host vehicle driving lane), and the width between the left and right lane markings (lane width).

[0025] There are various known methods for calculating the road curvature and lane width. For example, the first driving environment recognition unit 11d recognizes the left and right lane markings by binarizing the road curvature based on the forward driving environment image information using brightness difference, and calculates the curvatures of the left and right lane markings for each specified section using a curve approximation formula based on the least squares method.

[0026] In addition, the first driving environment recognition unit 11d performs a predetermined pattern matching on the distance image information to recognize three-dimensional objects such as guardrails and curbs along the road, and pedestrians, motorcycles, and vehicles other than motorcycles that are on the road around the host vehicle M.

[0027] Here, in the recognition of a three-dimensional object in the first driving environment recognition unit 11d, for example, the type of the three-dimensional object, the distance to the three-dimensional object, the speed of the three-dimensional object, and the relative speed between the three-dimensional object and the vehicle M are recognized. Note that a three-dimensional object recognized in this way based on an image from an on-board camera is referred to as a camera object (camera OBJ).

[0028] Furthermore, a plurality of radar devices (for example, a left front-side radar device 11fl, a right front-side radar device 11fr, a left rear-side radar device 11rl, and a right rear-side radar device 11rr) are connected to the first driving environment recognition unit 11d as autonomous sensors.

[0029] The left front side radar device 11fl and the right front side radar device 11fr are provided, for example, on the left and right sides of the front bumper, respectively. These left front side radar device 11fl and right front side radar device 11fr monitor the areas Afl, Afr (see FIG. 3) diagonally forward and to the left and right of the vehicle M that cannot be monitored by the images from the above-mentioned cameras 11a, 11b. The left front side radar device 11fl and the right front side radar device 11fr are disposed so that a part of each of the areas Afl, Afr overlaps with the area Af captured by the cameras 11a, 11b.

[0030] The left rear side radar device 11rl and the right rear side radar device 11rr are provided, for example, on the left and right sides of a rear bumper, respectively. The left rear side radar device 11rl and the right rear side radar device 11rr monitor areas Arl, Arr (see FIG. 3) extending from the left and right sides to the rear of the host vehicle M, which cannot be monitored by the above-mentioned left front side radar device 11fl and right front side radar device 11fr.

[0031] The left rear-side looking radar device 11rl and the right rear-side looking radar device 11rr are disposed so that a portion of each of the areas Arl and Arr overlaps with each other and also with each of the areas Afl and Afr.

[0032] Each of the radar devices 11fl, 11fr, 11rl, and 11rr is configured to include a millimeter wave radar, a laser radar, a LIDAR (Light Detection and Ranging), etc. Each of the radar devices 11fl, 11fr, 11rl, and 11rr detects a plurality of reflection points on a three-dimensional object existing around the host vehicle M by receiving a reflected wave of a radar wave (such as an electric wave or a laser beam) emitted in a horizontal direction.

[0033] Then, each of the radar devices 11fl, 11fr, 11rl, and 11rr recognizes a three-dimensional object by analyzing the relative positions and moving speeds of the detected reflection points and performing grouping processing. Furthermore, each of the radar devices 11fl, 11fr, 11rl, and 11rr sets the reflection point that is closest in linear distance to the vehicle M among the reflection points on the recognized three-dimensional object as a representative point of the three-dimensional object. Note that the three-dimensional object recognized by each of the radar devices 11fl, 11fr, 11rl, and 11rr in this manner is referred to as a radar object (radar OBJ).

[0034] Information such as the representative point Pr related to the radar OBJ recognized in each of the radar devices 11fl, 11fr, 11rl, and 11rr in this manner is input to the first driving environment recognition unit 11d. This makes it possible for the first driving environment recognition unit 11d to recognize not only preceding vehicles and the like in front of the host vehicle M, but also vehicles running parallel to the sides of the host vehicle M, intersecting vehicles approaching the host vehicle M from a direction intersecting the host vehicle's travel path at an intersection, and following vehicles and the like behind the host vehicle M.

[0035] Here, the first driving environment recognition unit 11d converts the recognized positions of the camera OBJ and radar OBJ into coordinates of, for example, a Cartesian coordinate system with the center of the host vehicle M as the origin O (a coordinate system with the fore-and-aft direction of the host vehicle M as the Z axis and the width direction of the host vehicle M as the X axis).

[0036] Furthermore, the first driving environment recognition unit 11d compares the camera OBJ with the radar OBJ, and recognizes a combination of the camera OBJ and the radar OBJ that matches based on a preset condition as a fusion object (fusion OBJ).

[0037] Locator unit 12 estimates the vehicle's position on a road map, and has a locator calculation unit 13 that estimates the vehicle's position. Connected to the input side of locator calculation unit 13 are sensors required for estimating the position of vehicle M (vehicle position), such as a longitudinal acceleration sensor 14 that detects longitudinal acceleration of vehicle M, wheel speed sensors 15 that detect the rotational speeds of the front, rear, left and right wheels, a gyro sensor 16 that detects the angular velocity or angular acceleration of the vehicle, and a GNSS receiver 17 that receives positioning signals transmitted from a plurality of positioning satellites.

[0038] In addition, a transceiver 18 is connected to the locator calculation unit 13 for transmitting and receiving information with the control device 100 (road-to-vehicle communication: see the dashed line in Figure 2) and for transmitting and receiving information with other vehicles (vehicle-to-vehicle communication: see the dashed line in Figure 2).

[0039] Furthermore, a high-precision road map database 19 is connected to the locator calculation unit 13. The high-precision road map database 19 is a large-capacity storage medium such as an HDD, and stores high-precision road map information (dynamic map).

[0040] This high-precision road map information has, for example, the same information as the road map information that is sequentially updated in the above-mentioned road map information integration_ECU 101, as information required for driving control of the host vehicle M. That is, the high-precision road map information has four layers of information consisting of static information and quasi-static information that mainly constitute road information, and quasi-dynamic information and dynamic information that mainly constitute traffic information.

[0041] The locator calculation unit 13 includes a map information acquisition unit 13a, a vehicle position estimation unit 13b, and a second driving environment recognition unit 13c. The map information acquisition unit 13a acquires route map information from a current location to a destination from map information stored in a high-precision road map database 19, based on a destination set by a driver during automatic driving, for example.

[0042] The map information acquisition unit 13a also transmits the acquired route map information (lane data on the route map) to the vehicle position estimation unit 13b. The vehicle position estimation unit 13b acquires the position coordinates of the vehicle M based on the positioning signal received by the GNSS receiver 17.

[0043] Furthermore, the vehicle position estimation unit 13b map-matches the acquired position coordinates on the route map information to estimate the vehicle position on the road map, recognizes the left and right lane dividing lines that divide the vehicle's driving path (driving lane), and acquires the road curvature at the center of the driving lane stored in the road map data.

[0044] In addition, in an environment where a valid positioning signal from a positioning satellite cannot be received due to reduced sensitivity of the GNSS receiver 17, such as when driving inside a tunnel, the vehicle position estimation unit 13b switches to autonomous navigation, which estimates the vehicle position based on the vehicle speed calculated based on the wheel speed detected by the wheel speed sensor 15, the angular velocity detected by the gyro sensor 16, and the longitudinal acceleration detected by the longitudinal acceleration sensor 14, and estimates the vehicle position on a road map.

[0045] Furthermore, when the vehicle position estimation unit 13b estimates the vehicle position on a road map based on the positioning signal received by the GNSS receiver 17 or information detected by the gyro sensor 16, as described above, it determines the road type of the road on which the vehicle M is traveling, based on the estimated vehicle position on the road map.

[0046] The second driving environment recognition unit 13c updates the road map information stored in the high-precision road map database 19 to the latest state by using road map information acquired by external communication (roadside-to-vehicle communication and vehicle-to-vehicle communication) via the transceiver 18. This information update is performed not only on static information but also on semi-static information, semi-dynamic information, and dynamic information.

[0047] As a result, the road map information includes road information and traffic information acquired through communication with the outside of the vehicle, and information on moving bodies such as vehicles traveling on the roads is updated substantially in real time.

[0048] In addition, the second driving environment recognition unit 13c verifies the road map information based on the driving environment information recognized by the driving environment recognition unit 11, and updates the road map information stored in the high-precision road map database 19 to the latest state. This information update is performed not only on static information, but also on semi-static information, semi-dynamic information, and dynamic information.

[0049] As a result, information on moving objects such as vehicles traveling on the road recognized by the driving environment recognition unit 11 is updated in real time. Then, the road map information thus updated is transmitted to the control device 100 and surrounding vehicles of the vehicle M by road-to-vehicle communication and vehicle-to-vehicle communication via the transceiver 18.

[0050] Furthermore, the second driving environment recognition unit 13c recognizes, from among the updated road map information, road map information of a set range centered on the vehicle position estimated by the vehicle position estimation unit 13b, as second driving environment information.

[0051] Here, the range of the second driving environment information recognized by the second driving environment recognition unit 13c is wider than the first driving environment information recognized by the first driving environment recognition unit 11d, and for example, road map information within a radius of 1 km from the vehicle position is recognized as the second driving environment information.

[0052] The first driving environment information recognized by the first driving environment recognition section 11d of the driving environment recognition unit 11 and the second driving environment information recognized by the second driving environment recognition section 13c of the locator unit 12 are read by the driving_ECU 22.

[0053] In addition, various switches and sensors are connected to the input side of the driving_ECU 22 (none of which are shown in the figure), such as a mode changeover switch that allows the driver to switch automatic driving (driving control) on / off, a steering torque sensor that detects steering torque as an amount of driving operation by the driver, a brake sensor that detects the amount of brake pedal depression as an amount of driving operation by the driver, an accelerator sensor that detects the amount of accelerator pedal depression as an amount of driving operation by the driver, and a yaw rate sensor that detects the yaw rate acting on the host vehicle M.

[0054] The driving modes set in the travel_ECU 22 are a manual driving mode, a first driving control mode and a second driving control mode for driving control, and an evacuation mode. These driving modes can be selectively switched in the travel_ECU 22 based on the operation status of a mode selector switch, etc.

[0055] Here, the manual driving mode is a driving mode that requires the driver to maintain steering, for example, a driving mode in which the host vehicle M is driven according to driving operations such as steering, accelerator, and brake operations by the driver.

[0056] Similarly, the first driving control mode is a driving mode that requires the driver to maintain steering. That is, the first driving control mode is a so-called semi-automatic driving mode in which the host vehicle M is driven along a target driving route by appropriately combining mainly a preceding vehicle following control (ACC: Adaptive Cruise Control), a lane centering control (ALKC: Active Lane Keep Centering) control, and a lane departure suppression control (Active Lane Keep Bouncing) control through control of the E / G_ECU 23, the PS_ECU 24, the BK_ECU 25, etc. while reflecting the driving operation by the driver.

[0057] The second driving control mode is an autonomous driving mode in which the host vehicle M is driven along a target route (route map information) by performing an appropriate combination of preceding vehicle following control, lane center keeping control, and lane departure prevention control, for example, through control of the E / G_ECU23, PS_ECU24, BK_ECU25, etc., without requiring the driver to maintain steering, operate the accelerator, or operate the brakes.

[0058] The evacuation mode is a mode for automatically stopping the vehicle M on a roadside or the like when, for example, while driving in the second driving control mode, driving in that mode cannot be continued and the driver is unable to take over driving operations (i.e., when it is not possible to transition to the manual driving mode or the first driving control mode).

[0059] A throttle actuator 35 is connected to the output side of the E / G_ECU 23. This throttle actuator 35 opens and closes a throttle valve of an electronically controlled throttle provided in a throttle body of the engine, and generates a desired engine output by opening and closing the throttle valve in response to a drive signal from the E / G_ECU 23 to adjust the intake air flow rate.

[0060] An electric power steering motor 28, which is a drive source, is connected to the output side of the PS_ECU 24. This electric power steering motor 28 applies steering torque to a steering mechanism by the rotational force of the motor, and in autonomous driving, lane centering control for maintaining driving in the current driving lane and lane change control for moving the host vehicle M to an adjacent lane (lane change control for overtaking control, etc.) are executed by controlling the operation of the electric power steering motor 28 by a drive signal from the PS_ECU 24.

[0061] A brake actuator 29 is connected to the output side of the BK_ECU 25. This brake actuator 29 adjusts the brake hydraulic pressure supplied to the brake wheel cylinders provided on each wheel, and when the brake actuator 29 is driven by a drive signal from the BK_ECU 25, the brake wheel cylinders generate a braking force of a braking mechanism on each wheel, forcing the wheel to decelerate.

[0062] Here, the image recognition by the driving environment recognition unit 11 of three-dimensional objects such as other vehicles V1, V2, V3 and lane markings LL, LR that divide the road on which the host vehicle M is traveling will be explained based on FIG. 4, here using a road with three lanes on each side as an example.

[0063] As shown in Figure 4, the first driving environment recognition unit 11d detects lane markings LL, LR that separate the left and right sides of the driving lane R1 (host vehicle driving lane) in which the host vehicle M is traveling, based on forward driving environment image information that is imaged in a predetermined manner by the IPU 11c from the forward area Af of the host vehicle M captured by both cameras 11a, 11b.

[0064] At this time, the first driving environment recognition unit 11d recognizes the left and right lane markings LL, LR based on the brightness change from the driving environment image information of the forward area Af. Here, the lane markings LL, LR are recognized by converting a plurality of candidate points extracted from the inside of the lane markings LL, LR into approximate lines A, B. The first driving environment recognition unit 11d also recognizes the lane markings of the left lane R2 and the right lane R3 in the same way as the driving lane R1.

[0065] In this way, based on the lane markings LL, LR of the driving lane R1, which is the driving lane recognized by the first driving environment recognition unit 11d, the driving_ECU 22 determines a target travel path for the host vehicle M in the center between the lane markings LL, LR. A steering target is determined along this target travel path, and the PS_ECU 24 controls the driving of the electric power steering motor 28, thereby executing lane centering control, lane departure suppression control, and the like.

[0066] In addition, the first driving environment recognition unit 11d creates models of frames (also called bounding boxes or windows) W1, W2, W3 for each of the vehicles V1, V2, V3 by performing a perception process based on the driving environment image information of the forward area Af, for example, to recognize the first vehicle V1 ahead traveling in the driving lane R1 as the preceding vehicle P1, the second vehicle V2 traveling in the left lane R2 as the left parallel vehicle P2, and the third vehicle V3 traveling in the right lane R3 as the right parallel vehicle P3.

[0067] Here, the detected objects are tagged (classified) as vehicles, and coordinate information for the host vehicle M is labeled (localized), to detect the vehicle speeds of the recognized preceding vehicle P1, the vehicle P2 running parallel to the left, and the vehicle P3 running parallel to the right, as well as the distance between the vehicles and the host vehicle M.

[0068] That is, the first driving environment recognition unit 11d detects the inter-vehicle distances Am, Bm, and Cm from the recognized frames W1, W2, and W3 to the host vehicle M. Furthermore, the first driving environment recognition unit 11d detects the vehicle speeds of the vehicles V1, V2, and V3 from the relative speeds with respect to the host vehicle M.

[0069] When following a preceding vehicle, steering control is performed based on a target point set at the center of a frame W1 in which the preceding vehicle P1 (here, the first vehicle V1) is recognized, and vehicle speed control is performed according to a predetermined inter-vehicle distance relative to the vehicle speed of the host vehicle M.

[0070] In recent years, LED light sources controlled by PWM (Pulse Width Modulation) dimming signals are used for tail lamps, turn signal lamps, etc. Therefore, when driving assistance such as preceding vehicle following control and lane keeping control is being performed, if other recognized vehicles V1, V2, V3 are equipped with LED light sources such as tail lamps, brake lamps, etc., these tail lamps, brake lamps, etc. are detected as flickering or flashing. In this case, it is not possible to distinguish between tail lamps, brake lamps, etc. and flashing (illuminating) turn signal lamps, and the flashing turn signal lamps are erroneously recognized.

[0071] Conventionally, in order to prevent erroneous recognition of blinking turn signal lights, once the blinking turn signal lights of each vehicle V1, V2, V3 have been recognized, control is exercised to suppress subsequent turn signal light recognition processing for the same vehicles V1, V2, V3 unless each vehicle V1, V2, V3 moves out of the forward driving environment image information in the forward area Af of the host vehicle M.

[0072] However, when the vehicle V1 recognized as the preceding vehicle P1 leaves the lane R1 in which the vehicle M is traveling, or the same vehicle V1 again cuts into the lane R1 in which the vehicle M is traveling from other lanes R2, R3 multiple times (see Figs. 10 to 12 described later), the turn signal lamp recognition process of the vehicle V1 is not performed from the second time onwards, and steering control is performed to follow the behavior of the vehicle V1. This causes the steering wheel of the vehicle M to be turned widely against the desired vehicle travel path.

[0073] In order to improve this phenomenon, the first driving environment recognition unit 11d controls each vehicle V1, V2, V3 to detect the illumination of the brake lights and the flashing of the turn signal lights of the respective vehicles V1, V2, V3 multiple times as long as the respective vehicles do not deviate from the forward driving environment image information of the forward area Af.

[0074] Here, the turn signal lamp recognition process of the vehicle V1 recognized as the preceding vehicle P1 will be described as an example. Note that the turn signal lamp recognition process is also performed multiple times on the vehicle V2 as the left parallel vehicle P2 and the vehicle V3 as the right parallel vehicle P3 traveling ahead of the host vehicle M. In addition, in the following description, the vehicles V1, V2, and V3 may be referred to as the first vehicle V1, the second vehicle V2, and the third vehicle V3 for distinction.

[0075] Fig. 5 shows a state in which the brake lights 41, 42, left blinker light 43 and right blinker light 44 of the first vehicle V1 recognized as the preceding vehicle P1 are not lit. Fig. 6 shows a state in which the brake lights 41, 42 of the first vehicle V1 recognized as the preceding vehicle P1 are lit. Note that, here, a state in which the high mounted stop lamp 45 of the first vehicle V1 recognized as the preceding vehicle P1 is lit is illustrated.

[0076] Figure 7 illustrates a state in which the left turn signal lamp 43 of the first vehicle V1 recognized as the preceding vehicle P1 is turned on, and Figure 8 illustrates a state in which the right turn signal lamp 44 of the first vehicle V1 recognized as the preceding vehicle P1 is turned on.

[0077] The first driving environment recognition unit 11d detects lamps (light emission) that are brighter than a predetermined brightness, and recognizes the illumination of the brake lamps 41, 42, the left turn signal lamp 43, and the right turn signal lamp 44, and determines that the illumination of lamps that are brighter than the predetermined brightness is the illumination of a tail lamp or the like.

[0078] Such recognition of the brake lights 41, 42, left turn signal light 43 and right turn signal light 44 is performed not only by the first vehicle V1, which is the preceding vehicle P1, but also by the second vehicle V2, which is the left parallel vehicle P2, and the third vehicle V3, which is the right parallel vehicle P3, which are traveling in front of the recognized vehicle M.

[0079] Next, a control example when recognizing the lighting / flashing of the brake lights 41, 42, left blinker lamp 43, and right blinker lamp 44 of another vehicle traveling ahead of the host vehicle M will be described with reference to the flowchart in Fig. 9. Note that the following control example is executed for frames W1, W2, and W3 of a first vehicle V1 that is a preceding vehicle P1 traveling ahead of the host vehicle M, a second vehicle V2 that is a left parallel running vehicle P2, and a third vehicle V3 that is a right parallel running vehicle P3.

[0080] First, the first driving environment recognition unit 11d judges whether or not the lamps in the frames W1, W2, and W3 that recognize the vehicles V1, V2, and V3 are turned on (S1). Here, the lighting of any of the lamps is detected by detecting light from a change in luminance in the frames W1, W2, and W3.

[0081] The first driving environment recognition unit 11d determines whether the light detected in step S1 is blinking (S2). If the first driving environment recognition unit 11d determines that the detected light is not blinking, it determines that the brake lamps 41, 42 are on (S3).

[0082] On the other hand, when the first driving environment recognition unit 11d determines that the detected light is blinking, it determines whether the light is blinking in both the left and right predetermined regions in the frames W1, W2, and W3 (S4). When the first driving environment recognition unit 11d determines that the light is blinking in both the left and right predetermined regions in the frames W1, W2, and W3, it determines that the brake lamps 41 and 42 are on (S3). This makes it possible to determine that the vehicles V1, V2, and V3 use LED light sources for the brake lamps 41 and 42.

[0083] On the other hand, if the first driving environment recognition unit 11d determines that light is not flashing in both the specified left and right areas within the frames W1, W2, and W3, it determines whether light is flashing in the specified left area within the frames W1, W2, and W3 (S5).

[0084] Then, when the light is flashing only in one of the predetermined left regions in the frames W1, W2, and W3, the first driving environment recognition unit 11d determines that the left turn signal lamp 43 of the vehicles V1, V2, and V3 is flashing (S6). As a result, it is determined that the left turn signal lamp 43 of the vehicles V1, V2, and V3 is flashing.

[0085] On the other hand, if the light is not flashing in only one of the predetermined left regions in the frames W1, W2, and W3, the first driving environment recognition unit 11d determines that the right turn signal lamp 44 of the preceding vehicle P1 is flashing (S7). As a result, it is determined that the right turn signal lamp 44 of the vehicles V1, V2, and V3 is flashing.

[0086] In step S5, the blinking of the detection light in a specified left area of ​​the frames W1, W2, and W3 is determined, but it may also be the right area of ​​the frames W1, W2, and W3, in which case, control is executed in which the left and right of the above control routine are reversed.

[0087] Then, it is determined whether the blinking of the detected left and right turn signal lamps 43, 44 has been turned off (S8). If it is determined that the blinking of the detected left and right turn signal lamps 43, 44 has been turned off, the first driving environment recognition unit 11d determines whether a predetermined time has elapsed since the turning off of the turn signal lamps 43, 44 of the same vehicles V1, V2, V3 was detected (S9).

[0088] Here, it is determined whether a predetermined time, such as at least 5 seconds, has elapsed since the previous turning-off of the turn signal lamps 43, 44 of the vehicles V1, V2, V3 was detected. In other words, the first driving environment recognition unit 11d determines whether a predetermined time has elapsed since the turning-off of either the left or right turn signal lamp 43, 44 of the same vehicles V1, V2, V3, which was detected to have blinked the previous time (one time before), was detected.

[0089] After a predetermined time has elapsed since the first driving environment recognition unit 11d detected the previous turning-off of the turn signal lamps 43, 44 in the same vehicles V1, V2, V3, the first driving environment recognition unit 11d leaves the routine and returns to step S1.

[0090] That is, the first driving environment recognition unit 11d does not return to step S1 unless a predetermined time has elapsed since it detected the previous turning-off of the turn signal lamps 43, 44 of the same vehicles V1, V2, V3, and therefore performs control not to execute detection processing of blinking of the turn signal lamps 43, 44. Therefore, the first driving environment recognition unit 11d performs control to enable detection processing of blinking of the turn signal lamps 43, 44 of the same vehicles V1, V2, V3 only if a predetermined time has elapsed since it detected the previous turning-off of the turn signal lamps 43, 44.

[0091] As described above, in the driving control device 10 of the driving control system 1 in this embodiment, the first driving environment recognition unit 11d distinguishes and recognizes the illumination of the tail lamps and the left and right brake lamps 41, 42 or the blinking of the left and right turn signal lamps 43, 44 of the vehicles V1, V2, V3, and executes control for the same vehicles V1, V2, V3 that have once detected the blinking of the left and right turn signal lamps 43, 44 as being in a state in which the blinking of the left and right turn signal lamps 43, 44 can be detected again only after a predetermined time has elapsed.

[0092] As a result, the first traveling environment recognition unit 11d can recognize the blinking of the left and right turn signal lamps 43, 44 even if the vehicles V1, V2, V3 traveling ahead of the host vehicle M use LED light sources for the brake lamps 41, 42 and / or the left and right turn signal lamps 43, 44. Note that the determination of whether the brake lamps 41, 42 are on may be made based on whether the high mounted stop lamp 45 is on or off.

[0093] Based on the recognition control of the turn signal lights 43, 44 of other vehicles V1, V2, V3 traveling in front of the host vehicle M by the first driving environment recognition unit 11d, the driving_ECU 22 executes driving assistance such as preceding vehicle following control and lane keeping control.

[0094] Conventionally, when the reliability of the recognition of the lane markings LL, LR is low or the lane markings LL, LR cannot be recognized during the execution of driving assistance such as preceding vehicle following control and lane keeping control, the lane keep assist control is interrupted and a control is executed to follow the first vehicle V1 recognized as the preceding vehicle P1. Therefore, during the preceding vehicle following control, the host vehicle M is subjected to steering control to follow the first vehicle V1 according to the behavior of the first vehicle V1.

[0095] Conventionally, as described above, in order to recognize the turn signal lights 43, 44 of vehicles V1, V2, V3 that use LED light source brake lights 41, 42, control is exercised to suppress subsequent turn signal light recognition processing for the same vehicles V1, V2, V3 once the turn signal lights 43, 44 have been detected.

[0096] Therefore, when lane keeping control is interrupted and preceding vehicle following control is in progress, depending on the behavior of the first vehicle V1, which is the preceding vehicle P1, steering control may be performed on the host vehicle M in a direction opposite to the desired driving route, resulting in the steering wheel being turned too far.

[0097] As a specific example, as shown in Figure 10, the first vehicle V1, which is the preceding vehicle P1, flashes the turn signal lamps 43, 44 and leaves the driving lane R1 to the left lane R2 (changing lanes), and then, as shown in Figure 11, it again cuts into the driving lane R1 in front of the host vehicle M (changing lanes), and further, as shown in Figure 12, it leaves (changes lanes) to the right lane R3 (or the left lane R2, not shown), in a situation where this behavior is repeated, steering control of the host vehicle M may be performed in a manner that is contrary to the desired driving route.

[0098] In such a situation, conventionally, while the host vehicle M is performing the preceding vehicle following control, after detecting the blinking of the turn signal lamps 43, 44 of the first vehicle V1, which is the preceding vehicle P1, once as shown in Fig. 10, the host vehicle M does not recognize the blinking of the turn signal lamps 43, 44 of the first vehicle V1 that has left the front of the driving lane R1 into the left lane R2 and become a vehicle running parallel to the left. Therefore, the host vehicle M cannot perform the deceleration control when the first vehicle V1 cuts in ahead on the driving lane R1 as shown in Fig. 11.

[0099] Furthermore, as shown in FIG. 12, when the first vehicle V1 leaves the driving lane R1 into the right lane R3 (or again into the left lane R2, not shown), if the reliability of the recognition of the lane markings LL, LR is low or the lane markings LL, LR cannot be recognized, steering control is executed so that the host vehicle M follows the first vehicle V1.

[0100] Therefore, in the driving control system 1 of the host vehicle M, based on the other vehicle information recognized by the first driving environment recognition unit 11d, the driving_ECU 22, as a driving assistance device of the vehicle, performs deceleration control and suppresses steering control against the desired path of travel (driving lane R1) to suppress the steering wheel of the host vehicle M from being turned widely, even when the behavior of the first vehicle V1 following as the preceding vehicle P1, for example, as shown in Figures 10 to 12, changes lanes by repeatedly leaving / cutting in and out of the driving lane R1 and the right lane R3 (left lane R2).

[0101] In detail, the driving control device 10 of the driving control system 1 will explain an example of control executed by the driving_ECU 22 based on other vehicle information recognized by the first driving environment recognition unit 11d during preceding vehicle following control of the first vehicle V1 as the preceding vehicle P1, based on the flowcharts shown in Figures 13 and 14.

[0102] First, a control example executed by the travel_ECU 22 when the first vehicle V1 blinks the left blinker lamp 43 and leaves the driving lane R1 into either the left or right lane R2 or R3 as shown in Fig. 13 will be described. Note that here, a control example executed by the travel_ECU 22 will be described in a scene shown in Fig. 10 in which the first vehicle V1, which is the preceding vehicle P1, blinks the left blinker lamp 43 and leaves the driving lane R1 in which the host vehicle M is traveling into the left lane R2.

[0103] 13, the travel_ECU 22 determines whether or not the first travel environment recognition unit 11d has detected blinking of the left blinker lamp 43 of the preceding vehicle P1 (S21). If the first travel environment recognition unit 11d has not detected blinking of the left blinker lamp 43 of the preceding vehicle P1, the process exits the routine and returns to step S21.

[0104] When the first driving environment recognition unit 11d detects the blinking of the left blinker lamp 43 of the preceding vehicle P1, the driving_ECU 22 judges whether the first driving environment recognition unit 11d recognizes the lane markings LL and LR (S22). At this time, if the first driving environment recognition unit 11d recognizes the lane markings LL and LR, the driving_ECU 22 executes a combination of normal preceding vehicle following control and lane keeping control (S23), exits the routine, and returns to step S21.

[0105] In step S22, if the reliability of the recognition of the lane markings LL, LR is low or if the lane markings LL, LR cannot be recognized, the travel_ECU 22 temporarily halts (HALT) the preceding vehicle following control of the preceding vehicle P1 (S24).

[0106] From this state, the travel_ECU 22 judges whether or not a new preceding vehicle P1 has been detected by the first travel environment recognition unit 11d (S25). If a new preceding vehicle P1 has not been detected, the travel_ECU 22 executes travel control based on the set vehicle speed (S26) and returns to step S25. That is, the travel_ECU 22 executes travel control based on the set vehicle speed until a new preceding vehicle P1 is detected and recognized.

[0107] On the other hand, when a new preceding vehicle P1 is detected in step S25, the travel_ECU 22 resumes (REBOOT) the control to follow the preceding vehicle that has been temporarily stopped (HALT) (S27), exits the routine, and returns to step S21. That is, the travel_ECU 22 executes the control to follow the preceding vehicle for the new preceding vehicle P1.

[0108] In addition, in the scene shown in Figure 12 in which the preceding vehicle P1 flashes the right turn signal lamp 44 and leaves the driving lane R1 into the right lane R3, the travel_ECU 22 reverses the above left and right and executes the control routine of Figure 13.

[0109] Next, based on Figure 14, an example of control executed by the traveling_ECU 22 when a second vehicle V1, V3 on the left or right, traveling behind either the left or right parallel vehicles P2, P3, cuts into the traveling lane R1 with its left and right turn signal lamps 43, 44 flashing will be described.

[0110] Here, an example of control executed by the driving_ECU 22 will be described in a situation shown in Figure 11 in which a second vehicle V2 acting as a left parallel vehicle P2 cuts into the driving lane R1 in which the host vehicle M is traveling by flashing the right turn signal lamp 44 from the left lane R2.

[0111] The travel_ECU 22 determines whether or not the first traveling environment recognition unit 11d has detected the blinking of the right blinker lamp 44 of the vehicle P2 traveling parallel to the left (S31). If the first traveling environment recognition unit 11d has not detected the blinking of the right blinker lamp 44, the process exits from the routine and returns to step S31.

[0112] When the first driving environment recognition unit 11d detects the blinking of the right blinker lamp 44, the driving_ECU 22 decelerates the host vehicle M to a predetermined speed (S32). Note that the driving_ECU 22 controls the BK_ECU 25 to drive the brake actuator 29 to decelerate the host vehicle M to the predetermined speed, for example, until a predetermined distance from the left parallel vehicle P2 is reached according to the vehicle speed of the host vehicle M.

[0113] Next, the travel_ECU 22 judges whether the lane markings LL and LR are recognized by the first travel environment recognition unit 11d (S33). At this time, if the lane markings LL and LR are recognized by the first travel environment recognition unit 11d, the travel_ECU 22 executes a combination of normal preceding vehicle following control and lane keeping control (S34), exits the routine, and returns to step S31.

[0114] In step S33, if the reliability of the recognition of the lane markings LL, LR is low or if the lane markings LL, LR cannot be recognized, the driving_ECU 22 determines whether or not a new preceding vehicle P1 has been detected by the first driving environment recognition unit 11d (S35).

[0115] In addition, as shown in Figures 10 and 11, when the first vehicle V1 leaves the driving lane R1 into the left lane R2 and then re-enters the driving lane R1, the first vehicle V1 is recognized as a new preceding vehicle P1.

[0116] In step S35, when a new preceding vehicle P1 is detected, the travel_ECU 22 determines whether the control to follow the preceding vehicle is temporarily suspended (HALT) (S36).

[0117] If the control to follow the preceding vehicle is temporarily suspended (HALT), the travel_ECU 22 resumes (REBOOT) the temporarily suspended (HALT) follow-up control (S37), exits the routine, and returns to step S31. That is, the travel_ECU 22 recognizes the second vehicle V2 as the preceding vehicle P1, and executes the control to follow the preceding vehicle P1.

[0118] If the preceding vehicle following control is not temporarily suspended (HALT), the travel_ECU 22 switches to control for following the new preceding vehicle P1 (S38), exits the routine, and returns to step S31. That is, since the travel_ECU 22 is in a state of performing preceding vehicle following control on another vehicle, the travel_ECU 22 switches the second vehicle V2 that has cut into the driving lane R1 from the left lane R2 to the new preceding vehicle P1, and executes preceding vehicle following control for the second vehicle V2.

[0119] When the vehicle P3 traveling parallel to the right turns on and off the left blinker lamp 43 to switch from the right lane R3 to the driving lane R1, the travel_ECU 22 executes a control routine of FIG. 14 in which the above left and right are reversed.

[0120] As described above, in the driving control device 10 of the driving control system 1, the driving_ECU 22 executes a combination of preceding vehicle following control and lane keeping control based on the detection results of the left and right turn signal lamps 43, 44 of other vehicles V1, V2, V3 by the first driving environment recognition unit 11d.

[0121] In addition, since the first driving environment recognition unit 11d detects the flickering of the tail lamps and the left and right brake lamps 41, 42, which are PWM dimming controlled LED light sources, it is possible to prevent the illumination of the brake lamps 41, 42 from being mistakenly recognized as the flashing of the left and right turn signal lamps 43, 44.

[0122] Then, the first driving environment recognition unit 11d enters a state in which it executes the turn signal lamp determination process for each of the same vehicles V1, V2, V3 again after a predetermined time has elapsed since the previous turn signal lamp detection for each of the same vehicles V1, V2, V3.

[0123] In this way, when the reliability of the recognition of the lane markings LL, LR is low or when the lane markings LL, LR cannot be recognized, during preceding vehicle following control, the first driving environment recognition unit 11d becomes capable of repeatedly executing the turn signal lamp determination process for the same vehicles V1, V2, V3 after a predetermined time has elapsed since the previous turn signal lamp detection.

[0124] Therefore, for example, in a situation where each vehicle V1, V2, V3 repeatedly leaves the driving lane R1 into the left lane R2 or the right lane R3 and cuts into the driving lane R1 from the left lane R2 or the right lane R3, the driving control device 10 can decelerate the vehicle M and suppress steering control that follows the behavior of the preceding vehicle that is contrary to the desired course of travel, thereby preventing the steering wheel of the vehicle M from being jerked significantly.

[0125] However, during control to follow the preceding vehicle when the reliability of recognition of the lane markings LL, LR is low or when the lane markings LL, LR cannot be recognized, the vehicles P2, P3 running parallel to the left and right may change lanes without blinking (turning on) the turn signal lamps 43, 44. Specifically, as shown in Fig. 15, for example, this is a situation in which a third vehicle V3, which is the vehicle P3 running parallel to the right in this case, cuts into the driving lane R1 without blinking the left turn signal lamp 43, and then leaves (changes lanes) into the left lane R2.

[0126] In such a situation, the left turn signal lamp 43 of the third vehicle V3 is not detected, and therefore the vehicle M, which has cut into the driving lane R1, may execute steering control to follow the third vehicle V3, causing the steering wheel to be pulled significantly.

[0127] In such a situation, the cruise control device 10 of the cruise control system 1 executes a control example shown in the flowchart of Fig. 16. Here, a state in which a third vehicle V3 traveling in the right lane R3 is recognized as a vehicle P3 traveling parallel to the right is illustrated.

[0128] As shown in FIG. 16, when the reliability of recognition of the lane markings LL, LR is low or during preceding vehicle following control in which the lane markings LL, LR cannot be recognized, the traveling_ECU 22 of the cruise control device 10 determines, from the traveling environment image information of the first traveling environment recognition unit 11d, whether the overlap ratio of the right-side parallel vehicle P3 of the third vehicle V3 traveling in the right lane R3 relative to the host vehicle M is greater than 0% (S41).

[0129] When the overlap ratio of the parallel vehicle P3 with respect to the host vehicle M is 0% or less, the travel_ECU 22 leaves the routine and returns to step S41. Here, for example, as shown in Fig. 17, the right parallel vehicle P3 is traveling in the right lane R3, and travel control is being executed according to the trajectory of the target point T of the preceding vehicle V1 stored in the host vehicle M.

[0130] On the other hand, when the overlap rate of the recognized parallel running vehicle P3 with respect to the vehicle M becomes 0% or more, the vehicle M is decelerated to a predetermined speed (S43). For example, as shown in Fig. 18, the vehicle P3 running parallel to the right has cut into the driving lane R1 from the right lane R3 without turning on the left blinker lamp 43.

[0131] Then, the travel_ECU 22 controls the BK_ECU 25 to drive the brake actuator 29 to decelerate the host vehicle M to a predetermined speed, for example, until a predetermined distance is reached between the host vehicle M and the vehicle P2 traveling parallel to the left according to the vehicle speed of the host vehicle M.

[0132] Next, the travel_ECU 22 determines whether the overlap ratio of the third vehicle V3 traveling in the right lane R3 with the right parallel vehicle P3 is equal to or greater than a predetermined percentage (e.g., 100% overlap ratio) (S44). If the overlap ratio of the parallel vehicle P3 with respect to the host vehicle M is less than the predetermined percentage, the travel_ECU 22 leaves the routine and returns to step S41.

[0133] On the other hand, when the overlap ratio of the parallel vehicle P3 with respect to the host vehicle M is equal to or greater than the predetermined percentage, the travel_ECU 22 switches the recognition of the third vehicle V3 of the right parallel vehicle P3 to a new preceding vehicle P1 (S45). Here, for example, as shown in FIG. 19, the third vehicle V3 has cut in front of the host vehicle M into the travel lane R1.

[0134] When the third vehicle V3 is recognized as the new preceding vehicle P1, the travel_ECU 22 holds the trajectory of the target point T of the original preceding vehicle P1 (first vehicle V1 that will be the preceding vehicle) stored at the time of switching the preceding vehicle P1, and temporarily suspends (HALT) the preceding vehicle following control of the preceding vehicle P1 (S46). Then, the travel_ECU 22 performs travel control according to the stored trajectory information of the target point T (S47). That is, the travel_ECU 22 holds the trajectory of the target point T stored in the original preceding vehicle P1 (first vehicle V1 that will be the preceding vehicle), and performs travel control based on the trajectory information of the original preceding vehicle P1 (first vehicle V1) instead of the following control of the new preceding vehicle P1 (third vehicle V3). Note that the stored trajectory information may be extended by estimating the trajectory of the target point T of the original preceding vehicle P1 (first vehicle V1).

[0135] Here, no preceding vehicle following control is performed for the third vehicle V3, which is recognized as the preceding vehicle P1, but the trajectory of the target point T of the first vehicle V1, which is the preceding vehicle P1 before the third vehicle V3 cuts into the driving lane R1, is maintained, and driving control is performed in accordance with the trajectory information of this target point T.

[0136] From there, the traveling_ECU 22 determines whether the currently recognized preceding vehicle P1 has reached the last stored target point T (S48), and determines whether the overlap ratio of the preceding vehicle P1 with respect to the host vehicle M has become 0% or less (S49).

[0137] If the overlap ratio of the preceding vehicle P1 with respect to the host vehicle M is not 0% or less, the process returns to step S48, and if the overlap ratio becomes 0% or less, it is determined whether a new preceding vehicle P1 has been detected (S50).

[0138] When the overlap ratio of the preceding vehicle P1 with respect to the host vehicle M is not 0% or less, for example, as shown in Fig. 20, the third vehicle V3 is traveling ahead in the driving lane R1, and when the overlap ratio becomes 0% or less, the third vehicle V3 is in a state of leaving another lane, for example, the left lane R2 as shown in Fig. 21. The same applies to the state in which the third vehicle V3 leaves again into the right lane R3.

[0139] Furthermore, the determination in step S49 is executed until the preceding vehicle P1 in step S48 reaches the target point T, unless the overlap ratio of the preceding vehicle P1 with respect to the host vehicle M becomes 0% or less. If the new preceding vehicle P1 that has cuts in leaves the driving lane R1 and changes lanes to another lane, here the left lane R2, the traveling_ECU 22 executes traveling control according to the trajectory information of the target point T of the first vehicle V1 stored and holds, thereby preventing the steering wheel of the host vehicle M from being jerked.

[0140] Regarding the preceding vehicle P1 reaching the final target point T in step S48, for example, as shown in FIG. 21, a third vehicle V3 is traveling ahead in the driving lane R1, and the driving_ECU 22 determines the limit position at which the first vehicle V1, which is the original preceding vehicle P1, will reach the final target point T.

[0141] In addition, if the traveling_ECU 22 determines in step S48 that the preceding vehicle P1, which is the third vehicle V3, has reached the final target point T, or if it detects a new preceding vehicle P1 that is not the third vehicle V3 in step S50, it resumes (REBOOT) the preceding vehicle following control, which has been temporarily halted (HALT) from the traveling control based on the trajectory information (S51), exits the routine, and returns to step S41.

[0142] That is, the control to follow the preceding vehicle is resumed with the third vehicle V3 of the vehicle P3 running parallel to the right, which has cut in at the limit position of the trajectory information of the target point T of the original preceding vehicle P1 that has been stored, as the preceding vehicle P1. Also, if a new preceding vehicle P1 that is not the third vehicle V3 is detected, the control to follow the preceding vehicle of the new preceding vehicle P1 is resumed.

[0143] Then, in step S50, if a new preceding vehicle P1 has not been detected, the travel_ECU 22 executes travel control based on the set vehicle speed (S52), exits the routine, and returns to step S41.

[0144] In addition, in a situation where the left parallel vehicle P2 traveling in the left lane R2 cuts into the driving lane R1 and then leaves the driving lane R1 into the right lane R3 or back into the left lane R2, the traveling_ECU 22 reverses the above left and right and executes the control routine of Figure 16.

[0145] As described above, during preceding vehicle following control when the reliability of recognition of lane markings LL, LR is low or when the lane markings LL, LR cannot be recognized, even if either of the left and right parallel vehicles P2, P3 changes lanes into the driving lane R1 in which the host vehicle M is traveling without flashing its turn signal lamps 43, 44, the driving control device 10 of the driving control system 1 executes driving control in which the driving_ECU 22 retains the trajectory information of the original target point T of the preceding vehicle P1.

[0146] In other words, when the traveling_ECU 22 switches from the original preceding vehicle P1 to either the left or right parallel vehicles P2 or P3 as the new preceding vehicle P1, it temporarily suspends the preceding vehicle following control until the preceding vehicle P1 reaches the limit position of the last target point T of the trajectory information held, and performs traveling control according to the trajectory information of the target point T of the original preceding vehicle P1.

[0147] The traveling_ECU 22 imposes a limit so as not to follow the new preceding vehicle P1 that has cut in, and executes traveling control so as not to follow the new preceding vehicle P1 up to the limit position of the trajectory information of the target point T of the original preceding vehicle P1, thereby suppressing steering control that goes against the desired course of travel, and preventing the steering wheel of the host vehicle M from being pulled too much.

[0148] When the cutting-in vehicle reaches the limit position of the last target point T in the held trajectory information, the traveling_ECU 22 resumes the control to follow the preceding vehicle. Furthermore, when the cutting-in vehicle leaves the driving lane R1 into another lane before reaching the limit position, the traveling_ECU 22 resumes the temporarily stopped control to follow the preceding vehicle when it newly recognizes the preceding vehicle P1, and executes the travel control at the set vehicle speed when it does not newly recognize the preceding vehicle P1.

[0149] However, when following the preceding vehicle, if the preceding vehicle P1 has not been traveling within the lane markings LL, LR during the most recent specified time, or if the driving environment recognition unit 11d is unable to recognize the lane markings LL, LR, for example, as shown in FIG. 23, in a situation where the first vehicle V1 crosses tire marks (ruts) F on a snow-covered road surface, the first driving environment recognition unit 11d may erroneously recognize the tire marks F as the lane markings LL, LR.

[0150] In this manner, when the preceding vehicle P1 crosses tire marks F that have been mistakenly recognized as lane markings LL, LR, the driving_ECU 22 regards this as the preceding vehicle P1 changing lanes and controls the target point T for following the preceding vehicle P1 so that it does not approach the lane markings LL, LR, or cancels the control for following the preceding vehicle.

[0151] In addition, for example, as shown in FIG. 24, when a preceding vehicle P1, such as a truck TR, crosses lane markings LL, LR while changing lanes, the traveling_ECU 22 similarly cancels the preceding vehicle following control if the reliability of the recognition of the lane markings LL, LR decreases.

[0152] However, if the preceding vehicle P1 has not been traveling within the lane markings LL, LR during the most recent specified time, or if the driving environment recognition unit 11d is unable to recognize the lane markings LL, LR, for example, when the preceding vehicle P1 crosses over tire marks F on a snow-covered road surface, if the driving_ECU 22 controls the target point T for following the preceding vehicle P1 so that it does not approach the lane markings LL, LR, this causes the steering of the host vehicle M to be turned significantly away from the desired host vehicle travel path.

[0153] Therefore, in the driving control system 1 of the host vehicle M, when the reliability of the recognition of the lane markings LL, LR is low during preceding vehicle following control or when the lane markings LL, LR cannot be recognized, the driving_ECU 22 executes a control example shown in the flowchart of Figure 25.

[0154] 25, the travel_ECU 22 determines whether the lane markings LL and LR are recognized by the first travel environment recognition unit 11d (S61). If the lane markings LL and LR are recognized by the first travel environment recognition unit 11d, the travel_ECU 22 executes a combination of normal preceding vehicle following control and lane keeping control (S62), exits the routine, and returns to step S61.

[0155] On the other hand, if the first driving environment recognition unit 11d is unable to recognize the lane markings LL and LR, it is determined whether or not the preceding vehicle P1 has been traveling within the lane markings LL and LR at the most recent specified time based on past driving environment image information (S63).

[0156] Then, if the preceding vehicle P1 is traveling within the lane markings LL, LR, the travel_ECU 22 determines whether or not the host vehicle M was traveling within the lane markings LL, LR at the most recent (immediately preceding) specified time based on past travel environment image information (S64).

[0157] If the host vehicle M is traveling within the lane markings LL, LR, the control for following the preceding vehicle P1 is continued in accordance with the trajectory information of the target point T of the preceding vehicle P1 (S65).

[0158] In step S63, if the preceding vehicle P1 has not been traveling within the lane lines LL, LR within the most recent predetermined time, the travel_ECU 22 cancels (stops) the preceding vehicle following control and ends the control routine.

[0159] Also, in step S64, if the host vehicle M has not been traveling within the lane markings LL, LR during the most recent specified time, the driving_ECU 22 suppresses the lane change assist function (active lane change assist function) of the host vehicle M, exits the routine, and returns to step S61.

[0160] As described above, when the reliability of the recognition of the lane markings LL, LR becomes low or the lane markings LL, LR can no longer be recognized by the driving_ECU 22 during preceding vehicle following control, the driving control device 10 of the driving control system 1 determines whether the preceding vehicle P1 and the host vehicle M are traveling within the lane markings LL, LR at the most recent specified time, and continues or cancels (stops) the preceding vehicle following control.

[0161] As a result, in a situation where the driving environment recognition unit 11d is unable to recognize the lane markings LL, LR, for example, when the preceding vehicle P1 crosses tire marks F on a snow-covered road surface, if the preceding vehicle P1 and the host vehicle M have been traveling within the lane markings LL, LR within a specified period of time in the most recent past, the cruise control device 10 continues the control to follow the preceding vehicle, thereby reducing the steering of the host vehicle M from being significantly affected.

[0162] Furthermore, if the vehicle M has not been traveling within the lane markings LL, LR within a specified period of time in the most recent past, the lane change assist function can be suppressed to prevent the vehicle M from traveling in the wrong lane.

[0163] The driving control system 1 has a processor including a central processing unit (CPU) and storage devices such as a ROM and a RAM in each of the ECUs 22 to 25. All or part of the configuration of the multiple circuits of the processor may be implemented by software. For example, the CPU may read and execute various programs corresponding to the functions stored in the ROM.

[0164] Furthermore, all or part of the functions of the processor may be configured using logic circuits or analog circuits, and the processing of various programs may be realized by electronic circuits such as FPGAs.

[0165] The invention described in the above embodiments is not limited to those embodiments, and various modifications can be made in the implementation stage without departing from the gist of the invention. Furthermore, the above includes inventions at various stages, and various inventions can be extracted by appropriate combinations of the disclosed constituent elements.

[0166] For example, if the stated problem can be solved and the stated effect can be obtained even if some of the constituent elements are deleted from all the disclosed constituent elements, the configuration from which these constituent elements are deleted can be extracted as an invention. [Explanation of symbols]

[0167] 1. Driving control system 10...Drive control device 11...Driving environment recognition unit 11a…Main camera 11b…Sub camera 11d…First driving environment recognition section 22...Drive control unit 23…Engine control unit 24...Power steering control unit 25…Steering control unit 28...Electric power steering motor 29…Brake actuator 41…Left brake light 42…Right brake light 43…Left turn signal lamp 44…Right turn signal lamp 45…High-mounted stop lamp Af…front area LL,LR...Lane markings M…Own vehicle P1: Leading vehicle P2…Left-side vehicle P3…Right side-by-side vehicle R1: Driving lane R2…Left lane R3: Right lane T…Target point V1, V2, V3...Vehicles (1st to 3rd vehicles) W1, W2, W3…frame

Claims

1. An external recognition unit that is mounted on the vehicle and acquires driving environment image information in front of the vehicle; a driving environment recognition unit that detects lane markings and the illumination of brake lights and blinker lights of other vehicles from the driving environment image information acquired by the external recognition unit; a steering control unit that operates a drive source of the steering mechanism; a driving control unit that controls the steering control unit based on a detection result of the driving environment recognition unit, and controls the driving of the host vehicle along a target driving route; Equipped with The driving environment recognition unit of the other vehicle that has detected the blinking of the turn signal lamp is placed in a state in which it can execute the detection process of the blinking of the turn signal lamp of the same other vehicle again only if a predetermined time has elapsed since the blinking of the turn signal lamp of the other vehicle that has detected the blinking of the turn signal lamp has been turned off.

2. a brake control unit controlled by the travel control unit to operate a braking mechanism; 2. The vehicle driving control device according to claim 1, wherein, when detecting a flashing of the turn signal lamp on the host vehicle side of a parallel traveling vehicle, the brake control unit activates the braking mechanism to execute deceleration control of the host vehicle.

3. The driving control unit includes: during control to follow a first preceding vehicle, when detecting an intrusion into the own lane of a parallel running vehicle whose blinker lamp has not been detected by the traveling environment recognition unit, determining whether or not an overlap ratio of the parallel running vehicle with respect to the own vehicle is equal to or greater than a predetermined value; In response to a determination that the overlap ratio has become equal to or greater than the predetermined value, a first control is executed to hold a path of a target point of the first preceding vehicle at the time when the determination is made or an estimated path extending the path, and to control the traveling of the host vehicle using the path or the estimated path as the target traveling route; When the overlap ratio becomes zero before the host vehicle reaches an end of the path or the estimated path during execution of the first control, a second control is executed to make the host vehicle follow the first preceding vehicle.

2. The vehicle driving control device according to claim 1, further comprising: a control unit for controlling a vehicle to follow a parallel running vehicle after the host vehicle reaches an end of the path or the estimated path, the control unit being configured to control the host vehicle so that the host vehicle follows the parallel running vehicle when the host vehicle reaches an end of the path or the estimated path while the first control is being executed and the lap ratio does not become zero.

4. The driving control device for a vehicle as described in Claim 1, characterized in that when the driving control unit is unable to recognize the lane markings while controlling the preceding vehicle to follow the preceding vehicle, it determines whether the preceding vehicle and the vehicle itself are traveling within the lane markings at the most recent specified time, and executes either continuation or stop of control to follow the preceding vehicle.

Citation Information

Patent Citations

  • Vehicle control device

    JP1997272414A

  • Inter-vehicle distance control device

    JP2013177054A

  • Travel control device for vehicle

    JP2017137001A

  • Travel support device for vehicle

    JP2018171959A

  • Vehicle driving support device

    JP2019038314A