Driving assistance method and driving assistance device
Patent Information
- Application Number
- JP2024548819
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-02-03
- Estimated Expiration
- 2042-09-26
AI Technical Summary
Conventional surround view systems for vehicles struggle to accurately recognize the driving state of other vehicles due to distortion in the virtual surround view, leading to unnecessary avoidance maneuvers and disruptions in the vehicle's behavior.
The system employs multiple imaging devices with overlapping detection ranges to integrate and process visual and distance data, using risk countermeasure control to mitigate erroneous recognition of the driving state of other vehicles by predicting their position and movement within a predetermined time frame.
This approach effectively suppresses the influence of erroneous recognition on the vehicle's driving state, ensuring accurate navigation and reducing unnecessary maneuvers by autonomously controlling the vehicle's speed and steering.
Abstract
Description
Driving assistance method and driving assistance device
[0001] The present invention relates to a driving assistance method and a driving assistance device.
[0002] A surround view system for a vehicle is known that generates a three-dimensional model of the vehicle's surrounding environment based on vehicle surrounding environment data and maps visual data to each part of the three-dimensional model, thereby reducing distortion in the generated virtual surround view (Patent Document 1).
[0003] Japanese Patent Application Laid-Open No. 2019-200781
[0004] The process of mapping the visual data onto a 3D model places a heavy load on the processing unit. Therefore, the conventional technology cannot adequately reduce distortion in the virtual surround view in driving scenes where the surrounding conditions of the vehicle change from moment to moment, and therefore cannot accurately recognize the driving conditions of other vehicles around the vehicle. As a result, unnecessary avoidance maneuvers are performed based on the misidentified driving conditions of other vehicles, causing the vehicle's behavior to become unstable.
[0005] The problem to be solved by the present invention is to provide a driving assistance method and a driving assistance device that can suppress the influence of erroneous recognition of the driving state of another vehicle on the driving state of the subject vehicle.
[0006] The present invention solves the above problem by executing risk management control to control the vehicle so as to address the risk of misrecognizing the driving state of another vehicle from the detection results of the multiple imaging devices when it is determined that another vehicle will enter the overlapping area within a specified time period when part of the detection ranges of multiple imaging devices mounted on the vehicle overlap in a lane adjacent to the lane in which the vehicle is traveling.
[0007] According to the present invention, it is possible to suppress the influence of erroneous recognition of the driving state of another vehicle on the driving state of the own vehicle.
[0008] 1 is a block diagram showing an example of a driving assistance system including a driving assistance device of the present invention. FIG. 2 is a plan view showing an example of an imaging device of FIG. 1. FIG. 3 is a plan view showing an example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 1). FIG. 4 is a plan view showing an example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 2). FIG. 5 is a plan view showing an example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 3). FIG. 6 is a plan view showing another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 1). FIG. 7 is a plan view showing another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 2). FIG. 8 is a plan view showing another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 3). FIG. 9 is a plan view showing yet another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 1). FIG. 10 is a plan view showing yet another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 2). FIG. 11 is a plan view showing yet another example of a driving scene in which driving assistance is performed by the driving assistance system shown in FIG. 1 (part 3). FIG. 12 is a flowchart showing an example of a processing procedure in the driving assistance system of FIG. 1 (part 1). 2 is a flowchart showing an example of a processing procedure in the driving assistance system of FIG. 1 (part 2); and FIG. 3 is a flowchart showing an example of a processing procedure in the driving assistance system of FIG.
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The following description is based on the assumption that vehicles are driven on the left side of the road in countries with laws stipulating left-hand traffic. In countries with laws stipulating right-hand traffic, vehicles are driven on the right side of the road, so the terms right and left in the following description should be interpreted as symmetrical.
[0010] [Configuration of Driving Assistance System] FIG. 1 is a block diagram showing a driving assistance system 10 according to the present invention. The driving assistance system 10 is an in-vehicle system that drives a vehicle to a destination set by the vehicle's occupants (including the driver) through autonomous driving control. Autonomous driving control refers to autonomously controlling the vehicle's driving operations using a driving assistance device (described later). These driving operations include all driving operations, such as acceleration, deceleration, starting, stopping, steering to the right or left, changing lanes, and pulling over. Furthermore, autonomously controlling driving operations refers to the driving assistance device controlling the driving operations using a device in the vehicle. The driving assistance device controls these driving operations within a predetermined range, and driving operations not controlled by the driving assistance device are manually operated by the driver.
[0011] 1, the driving assistance system 10 includes an imaging device 11, a distance measuring device 12, a vehicle state detection device 13, map information 14, a vehicle position detection device 15, a navigation device 16, a vehicle control device 17, a display device 18, and a driving assistance device 19. The devices that make up the driving assistance system 10 are connected by a CAN (Controller Area Network) or other in-vehicle LAN, and can exchange information with each other.
[0012] The imaging device 11 is a device that recognizes objects around the vehicle using images, and is, for example, a camera equipped with an imaging element such as a CCD, an ultrasonic camera, an infrared camera, etc. A single vehicle can be provided with multiple imaging devices 11, and they can be located, for example, near the front grille, under the left and right door mirrors, and near the rear bumper. This reduces blind spots when recognizing objects around the vehicle.
[0013] The ranging device 12 is a device for calculating the relative distance and relative speed between the vehicle and an object, and is, for example, a radar device or sonar such as a laser radar, a millimeter-wave radar (LRF, etc.), a LiDAR (light detection and ranging) unit, or an ultrasonic radar. A plurality of ranging devices 12 can be provided on a single vehicle, and can be disposed, for example, at the front, right side, left side, and rear of the vehicle. This allows the relative distance and relative speed between the vehicle and surrounding objects to be accurately calculated.
[0014] The objects detected by the imaging device 11 and the distance measuring device 12 include road lane boundaries, center lines, road markings, medians, guardrails, curbs, highway sidewalls, road signs, traffic lights, crosswalks, construction sites, accident sites, traffic restrictions, etc. The objects also include obstacles that may affect the vehicle's travel, such as automobiles (other vehicles) other than the subject vehicle, motorcycles, bicycles, pedestrians, etc. The detection results of the imaging device 11 and the distance measuring device 12 are acquired by the driving assistance device 19 at predetermined time intervals as needed. The predetermined time interval can be set to an appropriate value depending on the processing capacity of the driving assistance device 19.
[0015] Furthermore, the detection results of the imaging device 11 and the distance measuring device 12 can be integrated or synthesized (so-called sensor fusion) by the driving assistance device 19, thereby supplementing missing information about the detected object. For example, the driving assistance device 19 can calculate the position information of the object based on the vehicle's own position information, which is the position where the vehicle is traveling, acquired by the vehicle position detection device 15, and the relative position (distance and direction) between the vehicle and the object. The calculated position information of the object is integrated by the driving assistance device 19 with multiple pieces of information, such as the detection results of the imaging device 11 and the distance measuring device 12 and the map information 14, to become information about the driving environment around the vehicle. Furthermore, the detection results of the imaging device 11 and the distance measuring device 12 and the map information 14 can be used to recognize objects around the vehicle and predict their movements.
[0016] The vehicle state detection device 13 is a device for detecting the vehicle's running state, and examples thereof include a vehicle speed sensor, an acceleration sensor, a yaw rate sensor (e.g., a gyro sensor), a steering angle sensor, and an inertial measurement unit. These devices are not particularly limited, and known devices can be used. The locations and numbers of these devices can be set appropriately within a range that allows the vehicle's running state to be appropriately detected. The detection results of each device are acquired by the driving assistance device 19 at predetermined time intervals as necessary.
[0017] The map information 14 is information used for generating a driving route, controlling driving operations, etc., and includes road information, facility information, and their attribute information. The road information and road attribute information include information such as road width, road curvature radius, road shoulder structures, road traffic regulations (speed limit, whether lane changes are permitted), road merging and branching points, and locations where the number of lanes increases or decreases. The map information 14 is high-definition map information that allows the movement trajectory of each lane to be grasped, and includes two-dimensional position information and / or three-dimensional position information at each map coordinate, road / lane boundary information at each map coordinate, road attribute information, lane uphill / downhill information, lane identification information, and destination lane information. Note that high-precision maps are also called HD (High-Definition) maps.
[0018] Road / lane boundary information in high-resolution map information is information that indicates the boundaries between the lane on which a vehicle travels and other roads. A lane on which a vehicle travels is a road along which the vehicle travels, and the form of the lane is not particularly limited. Boundaries exist on both the left and right sides of the vehicle's direction of travel, and the form is not particularly limited. Boundaries are, for example, road markings or road structures. Examples of road markings include lane boundaries and center lines, and examples of road structures include medians, guardrails, curbs, tunnels, and highway sidewalls. Note that at points where lane boundaries cannot be clearly identified, such as within intersections, boundaries are set for the lane in advance. These boundaries are imaginary and are not actually existing road markings or road structures.
[0019] The map information 14 is stored in a readable state in a recording medium provided in the driving assistance device 19, an in-vehicle device, or a server on a network. The driving assistance device 19 acquires the map information 14 as needed.
[0020] The vehicle position detection device 15 is a positioning system for detecting the current position of the vehicle, and is not particularly limited, and any known system can be used. The vehicle position detection device 15 calculates the current position of the vehicle, for example, from radio waves received from a satellite for the Global Positioning System (GPS). Alternatively, the vehicle position detection device 15 may estimate the current position of the vehicle from vehicle speed information and acceleration information acquired from the vehicle state detection device 13, which includes a vehicle speed sensor, an acceleration sensor, and a gyro sensor, and compare the estimated current position with the map information 14 to calculate the current position of the vehicle.
[0021] The navigation device 16 is a device that refers to the map information 14 and calculates a driving route from the current position of the vehicle detected by the vehicle position detection device 15 to a destination set by the occupants (including the driver). The navigation device 16 searches for a driving route for the vehicle to reach the destination from the current position using road information, facility information, etc. in the map information 14. The driving route includes at least information on the road on which the vehicle is traveling, the driving lane, and the vehicle's traveling direction, and is displayed, for example, as a linear diagram. There may be multiple driving routes depending on the search conditions. The driving route calculated by the navigation device 16 is output to the driving assistance device 19.
[0022] The vehicle control device 17 is an on-board computer such as an electronic control unit (ECU), and electronically controls on-board devices that govern the driving of the vehicle. The vehicle control device 17 includes a vehicle speed control device 171 that controls the driving speed of the vehicle, and a steering control device 172 that controls the steering operation of the vehicle. The vehicle speed control device 171 and the steering control device 172 autonomously control the operation of these drive devices and steering devices in response to control signals input from the driving assistance device 19. This allows the vehicle to drive autonomously along a set driving route. Information required for autonomous control by the vehicle speed control device 171 and the steering control device 172, such as the vehicle's driving speed, acceleration, steering angle, and attitude, is obtained from the host vehicle state detection device 13.
[0023] Examples of the drive devices controlled by the vehicle speed control device 171 include an electric motor and / or an internal combustion engine as a driving source, a power transmission device including a drive shaft and an automatic transmission that transmits the output from these driving sources to the drive wheels, and a drive device that controls the power transmission device. Furthermore, examples of the braking device controlled by the vehicle speed control device 171 include a braking device that brakes the wheels. A control signal corresponding to a set traveling speed is input to the vehicle speed control device 171 from the driving assistance device 19. The vehicle speed control device 171 generates signals to control these drive devices based on the control signals input from the driving assistance device 19, and transmits the signals to the drive devices, thereby autonomously controlling the traveling speed of the vehicle.
[0024] On the other hand, the steering device controlled by the steering control device 172 is a steering device that controls the steered wheels in accordance with the rotation angle of the steering wheel, and an example of this is a steering actuator such as a motor attached to a steering column shaft. Based on a control signal input from the driving assistance device 19, the steering control device 172 autonomously controls the operation of the steering device so that the vehicle travels while maintaining a predetermined lateral position (position of the vehicle in the left-right direction) with respect to the set travel route. For this control, at least one of the detection results of the imaging device 11 and the distance measuring device 12, the vehicle travel state acquired by the host vehicle state detection device 13, the map information 14, and information on the current position of the vehicle acquired by the host vehicle position detection device 15 is used.
[0025] The display device 18 is a device for providing necessary information to vehicle occupants, and is, for example, a liquid crystal display provided on the instrument panel, a projector such as a head-up display (HUD), etc. The display device 18 may also include an input device for the vehicle occupant to input instructions to the driving assistance device 19. Examples of the input device include a touch panel that receives input by the user's finger or a stylus pen, a microphone that receives instructions by the user's voice, and switches attached to the steering wheel of the vehicle. The display device 18 may also include a speaker as an output device.
[0026] The driving assistance device 19 is a device that controls the driving of the vehicle by controlling and cooperating with the devices that make up the driving assistance system 10, and drives the vehicle to a set destination. The destination is set, for example, by a vehicle occupant. The driving assistance device 19 is, for example, a computer, and includes a CPU (Central Processing Unit) 191 that is a processor, a ROM (Read Only Memory) 192 that stores programs, and a RAM (Random Access Memory) 193 that functions as an accessible storage device. The CPU 191 is an operating circuit that executes the programs stored in the ROM 192 and realizes the functions of the driving assistance device 19.
[0027] The driving assistance device 19 has a driving assistance function of driving the vehicle to a set destination by autonomous driving control. The driving assistance functions of the driving assistance device 19 include a route generation function of generating a driving route, an environment recognition function of recognizing the driving environment around the vehicle, a determination function of making determinations necessary for executing autonomous driving control based on the recognized driving environment, and a driving control function of generating a driving trajectory and driving the vehicle along the driving trajectory. The programs stored in the ROM 192 include programs for realizing these functions, and the CPU 191 executes the programs stored in the ROM 192 to realize these functions. Figure 1 shows functional blocks that realize each function extracted for convenience.
[0028] [Functions of Each Functional Block] Hereinafter, the functions of each functional block of the support unit 20, the recognition unit 21, the determination unit 22, and the control unit 23 shown in FIG. 1 will be described.
[0029] The assistance unit 20 has a driving assistance function that drives the vehicle to a set destination through autonomous driving control. FIG. 2 is a plan view showing an example of a driving scene in which the driving assistance device 19 autonomously controls the driving of the vehicle through the driving assistance function. In the driving scene shown in FIG. 2, a three-lane road extends in the vertical direction of the drawing, and the vehicle travels on the road from the bottom to the top of the drawing. As shown in FIG. 2, the lanes are designated as lanes L1, L2, and L3 in order from the left lane in the driving direction. In the driving scene shown in FIG. 2, the host vehicle V1 is traveling on lane L2 and is heading toward a destination (not shown) ahead that has been set by the occupant of the host vehicle V1.
[0030] The recognition unit 21 has an environment recognition function that recognizes the driving environment around the vehicle. The driving assistance device 19 recognizes the driving environment around the vehicle using the imaging device 11 and the distance measuring device 12 through the environment recognition function of the recognition unit 21. The driving environment is information for determining whether the vehicle can maintain its current driving state or needs to change its driving state, and includes information such as the type and position of an object, the type and position of an obstacle if present, road conditions such as road surface conditions, and weather. The driving assistance device 19 recognizes the driving environment by performing appropriate processing such as pattern matching and sensor fusion on the detection results of the imaging device 11 and the distance measuring device 12.
[0031] The recognition unit 21 of this embodiment has a function of detecting obstacles using multiple image capture devices 11 mounted on the host vehicle V1. For example, as shown in Fig. 2, the host vehicle V1 is equipped with a front camera that detects obstacles present within a detection range A1 in front of the host vehicle V1 and a rear camera that detects obstacles present within a detection range A2 behind the host vehicle V1. In addition, the host vehicle V1 is equipped with a front wide-angle camera that detects obstacles present within a detection range B1 in front of the host vehicle V1, a rear wide-angle camera that detects obstacles present within a detection range B2 behind the host vehicle V1, a left wide-angle camera that detects obstacles present within a detection range B3 to the left of the host vehicle V1, and a right wide-angle camera that detects obstacles present within a detection range B4 to the right of the host vehicle V1.
[0032] The wide-angle camera has a wide-angle lens, which means it has a wider angle of view and a shorter focal length than a normal camera. Therefore, the detection range B1 of the front wide-angle camera is shorter in distance along the lane L2 than the detection range A1 of the front camera, and has a wider angle of view in the width direction of the lane L2. Similarly, the detection range B2 of the rear wide-angle camera is shorter in distance along the lane L2 than the detection range A2 of the rear camera, and has a wider angle of view in the width direction of the lane L2.
[0033] The driving assistance device 19 uses the function of the recognition unit 21 to integrate and process the detection results from the front wide-angle camera, rear wide-angle camera, left side wide-angle camera, and right side wide-angle camera using sensor fusion to thoroughly detect obstacles present around the host vehicle V1. These wide-angle cameras are arranged so that adjacent cameras' detection ranges partially overlap (for example, a range of approximately 10 to 15% of the angle of view from the horizontal end of the detection range) to prevent blind spots around the host vehicle V1 where obstacles cannot be detected. In this embodiment, the detection ranges of multiple image capture devices 11 mounted on the host vehicle V1 are arranged so that they partially overlap in lanes adjacent to the host vehicle V1's own lane. Hereinafter, the overlapping portions of the detection ranges of the image capture devices 11 are referred to as overlapping portions.
[0034] For example, in the driving scene shown in Figure 2, the forward detection range B1 and the left-side detection range B3 overlap in the range indicated by overlapping portion C1, and the rearward detection range B2 and the left-side detection range B3 overlap in the range indicated by overlapping portion C2. Both overlapping portions C1 and C2 are located in the lane L1 adjacent to the lane L2 on which the host vehicle V1 is traveling. Furthermore, the forward detection range B1 and the right-side detection range B4 overlap in the range indicated by overlapping portion C3, and the rearward detection range B2 and the right-side detection range B4 overlap in the range indicated by overlapping portion C4. Both overlapping portions C3 and C4 are located in the lane L3 adjacent to the lane L2 on which the host vehicle V1 is traveling.
[0035] It is known that the state of an obstacle cannot be accurately detected in the overlapping areas C1, C2, C3, and C4 described above in many cases. This is because the overlapping areas are located at the edges of the angle of view of the wide-angle lens, and the shape of the obstacle photographed in the overlapping area is distorted due to the characteristics of the lens. Furthermore, if an obstacle exists in an adjacent lane extending both before and after the overlapping area, no camera can photograph the entire obstacle, and the detection results from multiple cameras mounted on the host vehicle V1 must be integrated to recognize the obstacle. This is because the integration of the detection results may result in an inaccurate estimation of the state of the obstacle.
[0036] The driving scene shown in Figure 3 is a driving scene in which another vehicle V2 is driving on lane L1 in the driving scene shown in Figure 2. The other vehicle V2 is a truck, a large vehicle different from the host vehicle V1, which is a passenger car. In other words, the overall length of the other vehicle V2 is longer than the overall length of the host vehicle V1. In the driving scene shown in Figure 3, the other vehicle V2 is driving on a position on the overlapping portion C1 of lane L1, and the body of the other vehicle V2 is located both in front of and behind the overlapping portion C1.
[0037] For example, in the driving scene shown in FIG. 3 , when the driving state of the other vehicle V2 is recognized by integrating image data acquired from a forward camera and distance data to an obstacle acquired from a distance measuring device, the driving assistance device 19 recognizes that the other vehicle V2 is traveling in the state V2 shown in FIG. 3 . That is, the driving assistance device 19 correctly recognizes that the other vehicle V2 is traveling straight in lane L1. In this case, the driving assistance device 19 uses its driving control function to continue traveling straight in lane L1 by lane keeping control and does not perform a driving operation to avoid the other vehicle V2. Furthermore, for example, if the other vehicle V2 changes lanes toward a position ahead of the host vehicle V1, as indicated by V2x in FIG. 3 , the driving assistance device 19 performs a driving operation to avoid the other vehicle V2 based on the recognized driving state of the other vehicle V2. For example, the driving assistance device 19 decelerates the host vehicle V1 using the vehicle speed control device 171, and instead of or in addition to this, the driving assistance device 19 uses the steering control device 172 to change lanes from lane L2 to lane L3.
[0038] In this way, when the driving state of the other vehicle V2 is recognized using a single imaging device 11 and a detection device such as a distance measuring device 12, erroneous recognition due to overlapping detection ranges of the multiple imaging devices 11 mounted on the host vehicle V1 does not occur. In contrast, in the driving scene shown in FIG. 3 , when the recognition unit 21 recognizes the driving state of the other vehicle V2 by integrating image data acquired from the front wide-angle camera and the left wide-angle camera, the driving assistance device 19 recognizes that the other vehicle V2 is driving in a state such as V2x shown in FIG. 3 . In other words, when the driving state of the other vehicle V2 is recognized by integrating image data from the multiple imaging devices 11 mounted on the host vehicle V1, the other vehicle V2, which is actually traveling straight, is mistakenly recognized as having steered to the right and changed lanes from lane L1 to lane L2. In this case, the driving assistance device 19 uses its driving control function to perform driving operations to avoid the other vehicle V2 based on the erroneously recognized driving state of the other vehicle V2. This avoidance operation is actually an unnecessary driving operation to avoid another vehicle V2 that is traveling straight, and this driving operation disrupts the behavior of the vehicle V1 and causes discomfort to the occupants of the vehicle V1.
[0039] Therefore, the driving assistance device 19 of this embodiment executes autonomous driving control to address the risk of erroneously recognizing the driving state of the other vehicle V2 in order to reduce the impact of an erroneously recognized driving state of the other vehicle V2 on the driving state of the host vehicle V1. This autonomous driving control is controlled mainly by the functions of the determination unit 22 and the control unit 23. The functions of the determination unit 22 and the control unit 23 will be described below with reference to Figures 4A to 4C. In the following description, the overlapping portion of the detection ranges of the multiple image capture devices 11 mounted on the host vehicle V1 will also be simply referred to as the "overlapping portion."
[0040] The determination unit 22 has a determination function of determining whether the other vehicle V2 will enter an overlapping portion of the detection ranges of the multiple imaging devices 11. The driving assistance device 19 determines, by the function of the determination unit 22, based on the driving environment information around the host vehicle V1 acquired by the function of the recognition unit 21, whether the other vehicle V2 will enter an overlapping portion of the detection ranges of the multiple imaging devices 11. This makes it possible to start control to reduce the risk of erroneous detection before the other vehicle V2, which may exceed the overlapping range, enters the overlapping portion where erroneous detection is likely to occur.
[0041] When determining whether the other vehicle V2 is entering an overlapping area of the detection ranges of the multiple imaging devices 11, the driving assistance device 19 recognizes the driving states of the host vehicle V1 and the other vehicle V2, for example, from driving environment information acquired by the function of the recognition unit 21. The driving state of the vehicle refers to the vehicle's traveling direction and driving speed, and includes states such as a state in which the vehicle is traveling straight, a state in which the vehicle is steering to the right or left, a state in which the vehicle is accelerating or decelerating, and a state in which the vehicle is traveling at a constant speed. The driving state of the vehicle also includes the state of the driving operation performed by the vehicle. Examples include a state in which the vehicle's turn signal is flashing, a state in which the vehicle's headlights are on, etc.
[0042] Regarding the traveling state of the host vehicle V1, the driving assistance device 19 recognizes the current traveling state of the host vehicle V1 by using the function of the determination unit 22 to acquire information such as the traveling speed, acceleration, yaw rate, steering angle, and steering wheel rotation angle of the host vehicle V1 from various sensors of the host vehicle state detection device 13. Alternatively or in addition to this, the driving assistance device 19 may acquire road information from the map information 14, acquire the current position of the host vehicle V1 from the host vehicle position detection device 15, acquire the traveling route from the navigation device 16, and recognize the traveling direction and / or traveling speed of the host vehicle V1 from the shape of the road at the current position of the host vehicle V1 and / or the traveling route.
[0043] In response to this, in predicting the driving state of the other vehicle V2, the driving assistance device 19 uses the function of the determination unit 22 to, for example, acquire image data from the imaging device 11, extract and identify obstacles by pattern matching, and recognize the type, position, and state of the obstacle. The driving assistance device 19 also acquires information obtained by scanning the area around the host vehicle V1 from the distance measuring device 12, and recognizes the position and direction of the obstacle from this information. If the driving assistance device 19 recognizes that the obstacle is the other vehicle V2 from the image data acquired from the imaging device 11, it recognizes the degree to which the vehicle body is tilted (i.e., the degree to which it is steered) from the shape of the obstacle. The driving assistance device 19 also acquires the position and relative speed of the other vehicle V2 with respect to the host vehicle V1 from the scan results of the distance measuring device 12. Based on these detection results, the driving assistance device 19 recognizes the driving position, direction of travel, and driving speed of the other vehicle V2.
[0044] The driving assistance device 19 determines whether the other vehicle V2 will enter the overlapping portion based on the recognized driving states of the host vehicle V1 and the other vehicle V2. The driving assistance device 19 determines whether the other vehicle V2 will enter the overlapping portion based on the positional relationship between the host vehicle V1 and the other vehicle V2, the speed difference between the host vehicle V1 and the other vehicle V2, and the traveling directions of the host vehicle V1 and the other vehicle V2.
[0045] For example, when the other vehicle V2 is traveling behind the host vehicle V1, if the traveling speed of the other vehicle V2 is faster than the traveling speed of the host vehicle V1 and the traveling direction of the other vehicle V2 is toward the overlapping portion, it is determined that the other vehicle V2 will enter the overlapping portion. On the other hand, when the other vehicle V2 is traveling behind the host vehicle V1 and the traveling speed of the other vehicle V2 is equal to or lower than the traveling speed of the host vehicle V1, it is determined that the other vehicle V2 will not enter the overlapping portion. Also, when the other vehicle V2 is traveling ahead of the host vehicle V1 and the traveling speed of the other vehicle V2 is equal to or higher than the traveling speed of the host vehicle V1, it is determined that the other vehicle V2 will not enter the overlapping portion. On the other hand, when the other vehicle V2 is traveling ahead of the host vehicle V1 and the traveling speed of the other vehicle V2 is slower than the traveling speed of the host vehicle V1 and the host vehicle V1 (especially the overlapping portion) is toward the other vehicle V2, it is determined that the other vehicle V2 will enter the overlapping portion.
[0046] The method by which the driving assistance device 19 determines whether the other vehicle V2 will enter the overlapping portion is not limited to the above, and other methods may be used. For example, the driving assistance device 19 may predict the traveling states of the host vehicle V1 and the other vehicle V2 after a predetermined time, and determine whether the other vehicle V2 will enter the overlapping portion within the predetermined time based on the predicted traveling states of the host vehicle V1 and the other vehicle V2.
[0047] The predetermined time can be set to an appropriate value within a range in which autonomous driving control that addresses the risk of misrecognition of the driving state can be initiated before the other vehicle V2 actually enters the overlapping portion, for example, 10 to 20 seconds. If the predetermined time is shorter than this, the start of autonomous driving control that addresses the risk of misrecognition of the driving state will be delayed, resulting in greater changes in the behavior of the host vehicle V1. Conversely, if the predetermined time is longer than this, the driving state cannot be accurately predicted, and there is a risk that autonomous driving control that addresses the risk of misrecognition of the driving state will be executed in a driving scene in which such control is not necessary.
[0048] When predicting the driving state of the host vehicle V1 after a predetermined time, the driving assistance device 19 recognizes the current driving state of the host vehicle V1 based on information obtained from the host vehicle state detection device 13. In addition, the driving assistance device 19 obtains control signals output to the drive device and / or steering device from the vehicle control device 17 to recognize how to control (change) the traveling direction and / or traveling speed of the host vehicle V1. Then, based on these, the driving assistance device 19 predicts how the traveling state of the host vehicle V1 will change after a predetermined time. Alternatively, the driving assistance device 19 may obtain road information from the map information 14, the current position of the host vehicle V1 from the host vehicle position detection device 15, and the traveling route from the navigation device 16, and predict the traveling direction and / or traveling speed of the host vehicle V1 after a predetermined time based on the shape of the road ahead of the current position of the host vehicle V1 and / or the traveling route.
[0049] On the other hand, when predicting the traveling state of the other vehicle V2 after a predetermined time, the driving assistance device 19 acquires information obtained by scanning the surroundings of the host vehicle V1 from the distance measuring device 12, and recognizes the position and direction of an obstacle from the information. The driving assistance device 19 repeats the process of recognizing the position and direction of the obstacle from the scan results of the distance measuring device 12 multiple times (for example, three or more times) at time intervals shorter than the predetermined time, recognizes the tendency of changes in the obstacle position, and predicts the state of the obstacle after the predetermined time (i.e., the traveling state of the other vehicle V2) from the tendency.
[0050] Then, the driving assistance device 19 determines whether the other vehicle V2 will enter the overlapping portion within a predetermined time based on the predicted driving states of the host vehicle V1 and the other vehicle V2. Specifically, the driving assistance device 19 determines whether the other vehicle V2 will enter the overlapping portion based on the positional relationship between the host vehicle V1 and the other vehicle V2 after the predetermined time. This makes it possible to determine whether the other vehicle V2 will enter the overlapping portion even if the driving states of both the host vehicle V1 and the other vehicle V2 change.
[0051] The prediction of the driving state will be specifically described with reference to Figure 4A. The driving scene shown in Figure 4A is a driving scene in which another vehicle V2 is present in lane L3 in the driving scene shown in Figure 2. The other vehicle V2 is traveling at position P1 behind the host vehicle V1, and the driving assistance device 19 of the host vehicle V1 recognizes the other vehicle V2 present in the detection range A2 of the rear camera using the function of the recognition unit 21. Furthermore, it is assumed that the host vehicle V1 is traveling at a constant speed using lane keeping control, the other vehicle V2 is traveling straight at a faster speed than the host vehicle V1, and the other vehicle V2 will overtake the host vehicle V1 within a predetermined time.
[0052] In this case, the driving assistance device 19 acquires vehicle speed information of the host vehicle V1 from the vehicle speed sensor (host vehicle state detection device 13) and calculates the traveling position of the host vehicle V1 when constant speed traveling by lane keeping control continues for a predetermined time (10 to 20 seconds). The driving assistance device 19 also acquires image data from the imaging device 11 and recognizes through pattern matching that the obstacle is a truck (other vehicle V2) and that it is traveling in lane L3. In addition, the driving assistance device 19 recognizes from the detection result of the rear camera (imaging device 11) that the other vehicle V2 is traveling straight without turning. Furthermore, the driving assistance device 19 acquires the relative speed of the other vehicle V2 with respect to the host vehicle V1 from the relative speed of the other vehicle V2 with respect to the host vehicle V1 and predicts where the other vehicle V2 traveling straight will be traveling after a predetermined time. In the driving scene shown in Figure 4A, the other vehicle V2 will overtake the host vehicle V1 within a predetermined time, so the driving assistance device 19 determines that the other vehicle V2 will enter the overlapping portions C3 and C4 within the predetermined time based on the relationship between the calculated driving position of the host vehicle V1 and the predicted driving position of the other vehicle V2.
[0053] In addition, predicting the driving state of the subject vehicle V1 and the driving state of the other vehicle V2 after a predetermined time, and determining whether the other vehicle V2 will enter the overlapping portion within the predetermined time based on the predicted driving states of the subject vehicle V1 and the other vehicle V2 are not essential components of the present invention, and may be provided as needed.
[0054] When the control unit 23 determines, through the function of the determination unit 22, that the other vehicle V2 is entering the overlapping portion, the control unit 23 has a function of executing autonomous driving control that addresses the risk of erroneously recognizing the driving state of the other vehicle V2 from the detection results of the multiple imaging devices 11 mounted on the host vehicle V1. The autonomous driving control that addresses the risk of erroneously recognizing the driving state is, for example, autonomous driving control that reduces the possibility of erroneously recognizing the driving state of the other vehicle V2 traveling in the overlapping portion, as shown in FIG. 3, or, even if the driving state is erroneously recognized, reduces the impact that this erroneous recognition has on the driving state of the host vehicle V1. Hereinafter, the autonomous driving control that controls the host vehicle V1 to address the risk of erroneously recognizing the driving state of the other vehicle V2 from the detection results of the imaging devices 11 mounted on the host vehicle V1 will also be referred to as risk response control.
[0055] As risk response control, the driving assistance device 19 autonomously controls the traveling of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion. Alternatively, or in addition, as risk response control, the driving assistance device 19 may autonomously control the traveling of the host vehicle V1 so that the traveling state of the other vehicle V2, which has been erroneously recognized from the detection result of the imaging device 11, does not affect the traveling state of the host vehicle V1.
[0056] Autonomously controlling the traveling of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion includes setting the traveling speed of the host vehicle V1 so that the other vehicle V2 is not included in the detection range (particularly the overlapping portion of the detection ranges) of the imaging device 11, setting the inter-vehicle distance between the host vehicle V1 and the other vehicle V2 so that the other vehicle V2 is not included in the detection range (particularly the overlapping portion of the detection ranges) of the imaging device 11, and changing the host vehicle V1 to an adjacent lane. Furthermore, autonomously controlling the traveling of the host vehicle V1 so that the erroneously recognized traveling state of the other vehicle V2 does not affect the traveling state of the host vehicle V1 includes autonomously controlling the traveling of the host vehicle V1 without using the detection result of the imaging device 11, and autonomously controlling the traveling of the host vehicle V1 by setting a small weight for the detection result of the imaging device 11.
[0057] The driving assistance device 19 executes risk response control according to the driving scene, and may execute an appropriate combination of the above-mentioned multiple risk response controls. Specifically, the driving assistance device 19 executes appropriate risk response control based on the positional relationship between the host vehicle V1 and the other vehicle V2, the speed difference between the host vehicle V1 and the other vehicle V2, the traveling directions of the host vehicle V1 and the other vehicle V2, the driving behavior of the host vehicle V1 and the other vehicle V2, etc.
[0058] As an example, the driving assistance device 19 determines whether another vehicle V2 is traveling behind the host vehicle V1. If it determines that the other vehicle V2 is traveling behind the host vehicle V1, it autonomously controls the traveling of the host vehicle V1 without using the detection result of the imaging device 11 or by reducing the weighting of the detection result. On the other hand, if it determines that the other vehicle V2 is traveling ahead of the host vehicle V1 or that the host vehicle V1 and the other vehicle V2 are traveling side by side, it determines whether the host vehicle V1 will overtake or pass the other vehicle V2. If it determines that the host vehicle V1 will not overtake or pass the other vehicle V2, it autonomously controls the traveling of the host vehicle V1 so that the other vehicle V2 is not included in the overlapping portion. On the other hand, if it determines that the host vehicle V1 will overtake or pass the other vehicle V2, it sets a traveling speed higher than a predetermined traveling speed and performs the overtaking or passing without using the detection result of the imaging device 11 or by reducing the weighting of the detection result.
[0059] In this embodiment, a driving scene in which the host vehicle V1 overtakes another vehicle V2 refers to, for example, a driving scene in which the other vehicle V2 is traveling in the same lane as the host vehicle V1 and is a preceding vehicle of the host vehicle V1, and the traveling speed of the other vehicle V2 is slow, making it impossible to continue autonomous driving control of the host vehicle V1, so the host vehicle V1 changes lanes to an adjacent lane to overtake the other vehicle V2. Also, in the above example, when it is determined that the host vehicle V1 and the other vehicle V2 are traveling side by side, the traveling of the host vehicle V1 may be autonomously controlled without using the detection result of the imaging device 11 or by reducing the weighting of the detection result.
[0060] In the driving scene shown in Figure 4A, the driving assistance device 19 determines that another vehicle V2 has entered the overlapping portion C3, C4 within a predetermined time and that the total length D1 of the other vehicle V2 is longer than the length D2 of the overlapping portion C4 along the lane L3, and therefore executes risk response control using the function of the control unit 23. First, the driving assistance device 19 determines whether the other vehicle V2 is traveling behind the host vehicle V1. In the driving scene shown in Figure 4A, the driving assistance device 19 determines that the other vehicle V2 is traveling behind the host vehicle V1 based on the positional relationship shown in the figure.
[0061] In this case, the driving assistance device 19 autonomously controls the driving of the host vehicle V1 without using the detection results of the imaging device 11, or autonomously controls the driving of the host vehicle V1 by setting a low weighting for the detection results of the imaging device 11. In the driving scene shown in FIG. 4A , the driving assistance device 19 autonomously controls the driving of the host vehicle V1 without using the detection results of the imaging device 11. As shown in FIG. 4B , while the other vehicle V2 travels from position P1 to position P2 along the driving trajectory T1, the driving assistance device 19 performs lane keeping control of the host vehicle V1 without using the detection results of the imaging device 11. Specifically, lane keeping control is performed using the detection results of a ranging device 12, including a radar device, sonar, etc., instead of the imaging device 11. However, the detection results of a normal camera other than a wide-angle camera may also be used among the imaging devices 11. This is because there is no risk of misrecognition due to overlapping portions.
[0062] 4C, after the other vehicle V2 has traveled to position P2, the driving assistance device 19 autonomously controls the travel of the host vehicle V1 as usual using the detection results of the imaging device 11, including the wide-angle camera. At position P2 shown in FIG. 4C, the other vehicle V2 has passed through overlapping portions C3 and C4 and is included in the detection range A1 of the front camera, so there is no risk that the driving assistance device 19 will erroneously recognize the travel state of the other vehicle V2.
[0063] Furthermore, when autonomously controlling the traveling of the host vehicle V1 by setting a small weight on the detection result of the imaging device 11, the weight on the detection result of the imaging device 11 is set relatively small compared to the detection results of other detection devices such as the distance measuring device 12 so that the detection result of the imaging device 11 (particularly the wide-angle camera) does not affect the traveling state of the host vehicle V1 (i.e., traveling speed and steering operation). In other words, the weight on the detection result of the imaging device 11 may be set small, or the weight on the detection result of other detection devices such as the distance measuring device 12 may be set large. The weighting coefficient can be set to an appropriate value within a range in which the detection result of the imaging device 11 does not affect the traveling state of the host vehicle V1.
[0064] Next, risk management control in different driving situations will be described with reference to FIGS. 5A to 5C.
[0065] 5A is a plan view showing an example of a driving scene in which risk response control is executed. The driving scene shown in FIG. 5A is a driving scene in which the host vehicle V1 and other vehicles V2 and V3 are traveling on the road shown in FIG. 2, where the host vehicle V1 is traveling at position P3 in lane L2, and in front of it, the other vehicle V2 is traveling in lane L1, and the other vehicle V3 is traveling in lane L2. In the driving scene shown in FIG. 5A, the host vehicle V1 is traveling at a constant speed by lane keeping control, and the other vehicles V2 and V3 are traveling straight at a slower traveling speed than the host vehicle V1. In other words, the host vehicle V1 is assumed to catch up with the other vehicle V3 within a predetermined time.
[0066] In the driving scene shown in Fig. 5A, the traveling speed of the host vehicle V1 is faster than the traveling speed of the other vehicles V2 and V3, so the inter-vehicle distance between the host vehicle V1 and the other vehicles V2 and V3 decreases over time. Then, when the host vehicle V1 travels to position P4 shown in Fig. 5B, the driving assistance device 19 recognizes the other vehicles V2 and V3 that are within the detection range A1 from the detection results of the front camera using the function of the recognition unit 21.
[0067] Next, the driving assistance device 19, using the function of the determination unit 22, acquires vehicle speed information of the host vehicle V1 from the vehicle speed sensor and calculates the traveling position of the host vehicle V1 when constant-speed traveling using lane keeping control is continued for a predetermined time. The driving assistance device 19 also acquires image data from the imaging device 11 and, through pattern matching, recognizes that the obstacles are a truck (another vehicle V2) and a passenger car (another vehicle V3), that the other vehicle V2 is traveling in lane L1, and that the other vehicle V3 is traveling in lane L2. In addition, based on the detection results of the front camera (imaging device 11), it recognizes that the other vehicles V2 and V3 are traveling straight without turning. Furthermore, based on the scan results of the distance measuring device 12, it acquires the relative speeds of the other vehicles V2 and V3 with respect to the host vehicle V1. Based on this information, the driving assistance device 19 predicts the traveling states of the other vehicles V2 and V3 after a predetermined time.
[0068] In the driving scene shown in Figure 5B, the host vehicle V1 catches up with the other vehicles V2 and V3 within a predetermined time, so the driving assistance device 19 determines that the other vehicle V2 will enter the overlapping portion C1 within the predetermined time based on the relationship between the calculated driving position of the host vehicle V1 and the predicted driving positions of the other vehicles V2 and V3.
[0069] Next, the driving assistance device 19 determines, using the function of the control unit 23, whether or not the other vehicle V2 is traveling ahead of the host vehicle V1. In the driving scene shown in FIG. 5B , it is determined that the other vehicle V2 is traveling ahead of the host vehicle V1 based on the positional relationship shown in the same figure. In this case, the driving assistance device 19 determines whether or not the host vehicle V1 will overtake or be overtaken by the other vehicle V2. For example, the driving assistance device 19 determines whether or not the host vehicle V1 will overtake the other vehicle V2 after a predetermined time based on the traveling states of the host vehicle V1 and the other vehicle V2 predicted by the function of the determination unit 22. Alternatively or additionally, the driving assistance device 19 may determine whether or not it is necessary to overtake the other vehicle V2 in order to continue autonomous driving control of the host vehicle V1.
[0070] In the driving scene shown in Figure 5B, after approaching the other vehicle V3, the host vehicle V1 only needs to follow the other vehicle V3. Since there is no need to overtake the other vehicle V3 in order to continue the autonomous driving control (following control) of the host vehicle V1, the host vehicle V1 determines not to overtake the other vehicle V2. In this case, the driving assistance device 19 autonomously controls the driving of the host vehicle V1 so that the other vehicle V2 is not included in the overlapping portion C1. For example, the driving assistance device 19 sets the distance D3 shown in Figure 5C as the inter-vehicle distance between the host vehicle V1 and the other vehicle V3. In addition (for example, simultaneously), the driving assistance device 19 also sets the distance D4 shown in Figure 5C as the virtual inter-vehicle distance between the position P6 corresponding to the host vehicle V1 in the adjacent lane L1 and the other vehicle V2.
[0071] The distance D3, which is the inter-vehicle distance between the host vehicle V1 and the other vehicle V3, can be set to an appropriate value within a range in which the host vehicle V1 can avoid contact with the other vehicle V3. Furthermore, the distance D4, which is the virtual inter-vehicle distance between the host vehicle V1 and the other vehicle V2, can be set to an appropriate value within a range in which the other vehicle V3 can avoid entering the overlapping portion C1. The driving assistance device 19 can avoid the risk of erroneously recognizing the traveling state of the other vehicle V2 by performing autonomous driving control (following control) that maintains the virtual inter-vehicle distance between the host vehicle V1 and the other vehicle V2 and the inter-vehicle distance between the host vehicle V1 and the other vehicle V3.
[0072] Next, risk management control in different driving situations will be described with reference to FIGS. 6A to 6C.
[0073] 6A is a plan view showing an example of a driving scene in which risk response control is executed. The driving scene shown in FIG. 6A is a driving scene in which a host vehicle V1 and another vehicle V2 are traveling on the road shown in FIG. 2, with the host vehicle V1 traveling at position P7 in lane L2 and the other vehicle V2 traveling in lane L1 ahead of it. In the driving scene shown in FIG. 6A, the host vehicle V1 is traveling at a constant speed by lane keeping control, and the other vehicle V2 is traveling straight at a slower speed than the host vehicle V1. In other words, the host vehicle V1 is expected to overtake the other vehicle V2 within a predetermined time.
[0074] In the driving scene shown in Fig. 6A, the driving assistance device 19 recognizes another vehicle V2 included in the detection range A1 from the detection result of the front camera using the function of the recognition unit 21. Next, the driving assistance device 19 calculates the driving state of the host vehicle V1 after a predetermined time and predicts the driving state of the other vehicle V2 after the predetermined time using the function of the determination unit 22 in the same manner as in the driving scene shown in Fig. 5A.
[0075] In the driving scene shown in Figure 6A, the subject vehicle V1 will overtake the other vehicle V2 within a predetermined time, and the driving assistance device 19 determines that the other vehicle V2 will enter the overlapping portion C1 within the predetermined time based on the relationship between the calculated driving position of the subject vehicle V1 and the predicted driving position of the other vehicle V2.
[0076] Next, the driving assistance device 19 determines, using the function of the control unit 23, whether or not the other vehicle V2 is traveling ahead of the host vehicle V1. In the driving scene shown in Fig. 6A , the other vehicle V2 is traveling ahead of the host vehicle V1, so it is determined that the other vehicle V2 is traveling ahead of the host vehicle V1. In this case, the driving assistance device 19 determines whether or not the host vehicle V1 will overtake or be overtaken by the other vehicle V2. In the driving scene shown in Fig. 6A , the host vehicle V1 will overtake the other vehicle V2 within a predetermined time, so it is determined that the host vehicle V1 will be overtaking the other vehicle V2.
[0077] In this case, the driving assistance device 19 sets a traveling speed higher than a predetermined traveling speed and overtakes the other vehicle V2 without using the detection result of the imaging device 11 or by setting a low weighting for the detection result. The predetermined traveling speed is, for example, a traveling speed set by the occupant of the host vehicle V1, and a traveling speed higher than the predetermined traveling speed is, for example, a traveling speed that is 5 to 25 km / h faster than the traveling speed set by the occupant of the host vehicle V1. By setting an appropriate traveling speed higher than the predetermined traveling speed within a range in which the occupant of the host vehicle V1 does not feel uncomfortable, the driving assistance device 19 can shorten the time during which erroneous recognition of the traveling state of the other vehicle V2 affects the traveling state of the host vehicle V1.
[0078] 6B, the driving assistance device 19 sets a traveling speed higher than that set by the occupant of the vehicle V1, and at the same time, sets a small weighting on the detection result of the image capture device 11. The vehicle V1 is then caused to travel at a constant speed along the travel locus T3 from position P5 to position P6. In this case, the processing of the detection result of the image capture device 11 is the same as in the case of the traveling scenes shown in FIGS. 4A to 4C.
[0079] 6C, when the other vehicle V2 reaches position P9, the driving assistance device 19 autonomously controls the driving of the host vehicle V1 as usual using the detection results of the imaging device 11, including the wide-angle camera. At position P9 shown in FIG. 6C, the other vehicle V2 passes through overlapping portions C1 and C2 and is included in the detection range A2 of the rear camera, so there is no risk that the driving assistance device 19 will erroneously recognize the driving state of the other vehicle V2.
[0080] 4A to 4C, 5A to 5C, and 6A to 6C are merely examples, and risk response control other than the above-described risk response control may be executed in each driving scene. Also, in the driving assistance device 19 of this embodiment, it is not essential to execute risk response control for all of the driving scenes shown in FIGS. 4A to 4C, 5A to 5C, and 6A to 6C, and the driving assistance device 19 may execute risk response control for some of the driving scenes.
[0081] So far, a basic embodiment of the present invention has been described. However, when the driving assistance device 19 determines that the other vehicle V2 is entering the overlapping portion of the detection range, the driving assistance device 19 may calculate the overall length of the other vehicle V2, i.e., the length of the other vehicle V2 in the traveling direction, from the detection results of various cameras (imaging devices 11) and the detection results of the ranging device 12, such as radar, LiDAR, or sonar. Then, the driving assistance device 19 may determine whether the calculated overall length of the other vehicle V2 is longer than the length of the overlapping portion in the direction along the adjacent lane. Furthermore, instead of the length of the overlapping portion in the direction along the adjacent lane, the length of the portion of the overlapping portion that is on the adjacent lane in the direction along the adjacent lane may be used.
[0082] The driving assistance device 19 performs image analysis, including processes such as edge extraction and shape recognition, on image data acquired from the imaging device 11 to calculate the overall length of the other vehicle V2. For example, in the driving scene shown in FIG. 4A , the driving assistance device 19 performs image analysis on image data within the detection range A2 to calculate the overall length D1 of the other vehicle V2. Furthermore, for an overlapping portion C4 existing in the lane L3 adjacent to the lane L2 on which the host vehicle V1 is traveling, a length D2 along the lane L3 is pre-registered in the ROM 192 of the driving assistance device 19. When the driving assistance device 19 compares the overall length D1 of the other vehicle V2 with the length D2 of the overlapping portion C4 along the lane L3, the overall length D1 is found to be longer, and therefore the driving assistance device 19 determines that the overall length D1 is longer than the length D2.
[0083] 5B , the driving assistance device 19 performs image analysis on the image data acquired from the imaging device 11 to calculate the overall length D1 of the other vehicle V2. Furthermore, for an overlapping portion C1 that exists in the lane L1 adjacent to the lane L2 on which the host vehicle V1 is traveling, a length D2a of the portion of the overlapping portion C1 that exists on the lane L1 in the direction along the lane L1 is registered in advance in the ROM 192 of the driving assistance device 19. When the driving assistance device 19 compares the overall length D1 of the other vehicle V2 with the length D2a of the portion of the overlapping portion C1 that exists on the lane L1 in the direction along the lane L1, the overall length D1 is found to be longer, and therefore the driving assistance device 19 determines that the overall length D1 is longer than the length D2a.
[0084] In the driving scene shown in Fig. 6A, the driving assistance device 19 calculates the overall length D1 of the other vehicle V2 in the same manner as in the driving scene shown in Fig. 5B. Furthermore, for an overlapping portion C1 existing in a lane L1 adjacent to the lane L2 on which the host vehicle V1 is traveling, a length D2 of the overlapping portion C1 in the direction along the lane L1 is pre-registered in the ROM 192 of the driving assistance device 19. Therefore, the driving assistance device 19 compares the overall length D1 of the other vehicle V2 with the length D2 of the overlapping portion C1 in the direction along the lane L1. In the driving scene shown in Fig. 6A, the overall length D1 is longer, so the driving assistance device 19 determines that the overall length D1 is longer than the length D2.
[0085] The total length of the other vehicle V2 does not necessarily need to be calculated accurately; it is sufficient that the range of the total length can be calculated. That is, it is sufficient that it is possible to determine whether the total length of the other vehicle V2 is longer or shorter than the length of the overlapping portion along the adjacent lane into which the other vehicle V2 will enter. Furthermore, the length of the overlapping portion along the adjacent lane is set as a fixed value for each overlapping portion when the imaging device 11 (particularly the wide-angle camera) is installed and is registered in advance in the driving assistance device 19. Note that calculating the total length of the other vehicle V2 when it is determined that the other vehicle V2 will enter the overlapping portion of the detection range and determining whether the calculated total length of the other vehicle V2 is longer than the length of the overlapping portion along the adjacent lane are not essential components of the present invention, and may be added or omitted as necessary.
[0086] The driving assistance device 19 may determine the vehicle type of the other vehicle V2 using the function of the determination unit 22, and execute risk response control according to the determined vehicle type. Specifically, the driving assistance device 19 may determine whether the other vehicle V2 is a large vehicle, and if it is determined that the other vehicle V2 is a large vehicle, execute risk response control using the function of the control unit 23. Note that determining whether the other vehicle V2 is a large vehicle and executing risk response control using the function of the control unit 23 if it is determined that the other vehicle V2 is a large vehicle are not essential configurations for the present invention, and may be added or omitted as necessary.
[0087] Examples of vehicle types include private passenger cars such as light cars, small cars (compact cars), and standard cars, as well as manned or unmanned taxis, buses, and trucks. A large vehicle is a vehicle whose overall length is longer than that of the host vehicle V1, for example, a vehicle whose overall length is 1.25 times or more longer than that of the host vehicle V1. Examples of vehicle types that fall under large vehicles include commercial vehicles that transport passengers or cargo, such as buses and trucks. For example, if the other vehicle V2 is a large vehicle such as a bus or truck, the driving assistance device 19 executes risk response control, but does not execute risk response control if the other vehicle V2 is a small private passenger car such as a compact car.
[0088] When the driving assistance device 19 determines that the other vehicle V2 is not a large vehicle, the control unit 23 may determine, using the function of the control unit 23, whether or not a single imaging device 11 capable of detecting the entire other vehicle V2 is present among the multiple imaging devices 11 mounted on the host vehicle V1. Furthermore, when it is determined that a single imaging device 11 capable of detecting the entire other vehicle V2 is not present, risk response control may be executed. This is because detecting the entire body of the other vehicle V2 with a single imaging device 11 can reduce the risk of erroneously recognizing the traveling state of the other vehicle V2. Note that, when it is determined that the other vehicle V2 is not a large vehicle, determining whether or not a single imaging device 11 capable of detecting the entire other vehicle V2 is present among the multiple imaging devices 11 mounted on the host vehicle V1, and executing risk response control when it is determined that a single imaging device 11 capable of detecting the entire other vehicle V2 is not present, are not essential components of the present invention and may be added or omitted as necessary.
[0089] The driving assistance device 19 may use the function of the control unit 23 to acquire the brightness value of each pixel from an image captured using the imaging device 11, divide the sum of the brightness values by the total number of pixels to calculate an average brightness value of the image, and execute risk response control if the average brightness value is equal to or greater than a predetermined value. This is because when a strong light source such as sunlight or reflected light enters the camera, the brightness values of the acquired image saturate, making the entire image bright (white), and making it impossible to accurately recognize the shape of an obstacle from the image contrast. In other words, if the entire image becomes white, it becomes impossible to accurately recognize the driving status of the other vehicle V2. The predetermined value can be set to an appropriate value (e.g., 200 or more) within a range that allows accurate recognition of the driving status of the other vehicle V2. Note that acquiring the brightness value of each pixel from an image captured using the imaging device 11, dividing the sum of the brightness values by the total number of pixels to calculate the average brightness value of the image, and executing risk response control if the average brightness value is equal to or greater than a predetermined value are not essential components of the present invention and may be added or omitted as needed.
[0090] [Processing in the System] The procedure for information processing by the driving assistance device 19 will be described with reference to Figures 7A to 7C. Figures 7A to 7C are an example of a flowchart showing information processing executed in the driving assistance system 10 of this embodiment. The processing described below is executed at predetermined time intervals by the CPU 191, which is the processor of the driving assistance device 19. Note that the flowcharts shown in Figures 7A to 7C are based on the premise that the host vehicle V1 is traveling on a road using lane keeping control.
[0091] First, in step S1 of Fig. 7A, the recognition unit 21 detects another vehicle V2 using the multiple image capture devices 11 mounted on the host vehicle V1. In step S2, it is determined from the detection result whether another vehicle V2 is present around the host vehicle V1. If another vehicle V2 is not present around the host vehicle V1, the process proceeds to step S3, where normal autonomous driving control is executed, and the process proceeds to step S20 of Fig. 7C. On the other hand, if another vehicle V2 is present around the host vehicle V1, the process proceeds to step S4, where the determination unit 22 predicts the driving states of the host vehicle V1 and the other vehicle V2 after a predetermined time.
[0092] If it is determined from the traveling states of the host vehicle V1 and the other vehicle V2 after the predetermined time that the host vehicle V1 and the other vehicle V2 will be traveling in the same lane after the predetermined time, the process proceeds to step S6, where the control unit 23 determines whether the host vehicle V1 will overtake the other vehicle V2. If it is determined that the host vehicle V1 will not overtake the other vehicle V2, the process proceeds to step S3. On the other hand, if it is determined that the host vehicle V1 will overtake the other vehicle V2, the process proceeds to step S18 in FIG. 7C. Note that step S6 is not an essential step for the present invention and may be provided as needed.
[0093] On the other hand, if it is determined in step S5 that the host vehicle V1 and the other vehicle V2 will not be traveling in the same lane after the predetermined time, the process proceeds to step S7, where it is determined whether the other vehicle V2 will enter the overlapping portion within the predetermined time. If it is determined that the other vehicle V2 will not enter the overlapping portion within the predetermined time, the process proceeds to step S3. On the other hand, if it is determined that the other vehicle V2 will enter the overlapping portion within the predetermined time, the process proceeds to step S8, where the function of the determination unit 22 calculates the total length D1 of the other vehicle V2 and the length D2 of the overlapping portion in the direction along the adjacent lane.
[0094] Following step S8, in step S9 of Fig. 7B, the function of the determination unit 22 determines whether the total length D1 of the other vehicle V2 is longer than the length D2 of the overlapping portion. If the total length D1 of the other vehicle V2 is longer than the length D2 of the overlapping portion, the process proceeds to step S14 of Fig. 7C. On the other hand, if the total length D1 of the other vehicle V2 is equal to or shorter than the length D2 of the overlapping portion, the process proceeds to step S10.
[0095] In step S10, the function of the determination unit 22 is used to determine whether or not the other vehicle V2 is a large vehicle. If it is determined that the other vehicle V2 is a large vehicle, the process proceeds to step S14 in FIG. 7C. On the other hand, if it is determined that the other vehicle V2 is not a large vehicle, the process proceeds to step S11. In step S11, the function of the determination unit 22 is used to determine whether or not the other vehicle V2 can be entirely detected by a single imaging device 11. If the other vehicle V2 cannot be entirely detected by a single imaging device 11, the process proceeds to step S14 in FIG. 7C. On the other hand, if the other vehicle V2 can be entirely detected by a single imaging device 11, the process proceeds to step S12.
[0096] In step S12, the average brightness value of the image is calculated using the function of the determination unit 22, and in the following step S13, it is determined whether the average brightness value is equal to or greater than a predetermined value. If the average brightness value is less than the predetermined value, the process proceeds to step S3 in Fig. 7A. On the other hand, if the average brightness value is equal to or greater than the predetermined value, the process proceeds to step S14 in Fig. 7C. Note that steps S9 to S13 are not essential steps for the present invention and may be provided as needed.
[0097] 7C, the control unit 23 determines whether the other vehicle V2 is traveling ahead of the host vehicle V1. If it determines that the other vehicle V2 is not traveling ahead of the host vehicle V1, the control unit 23 proceeds to step S15, where the host vehicle V1 is autonomously controlled without using the detection result of the imaging device 11 or by reducing the weight of the detection result. Then, the control unit 23 proceeds to step S20.
[0098] On the other hand, if it is determined that the other vehicle V2 is traveling ahead of the subject vehicle V1, the process proceeds to step S16, where it is determined whether the subject vehicle V1 will overtake the other vehicle V2. If it is determined that the subject vehicle V1 will not overtake the other vehicle V2, the process proceeds to step S17, where the travel of the subject vehicle V1 is autonomously controlled so that the other vehicle V2 is not included in the overlapping portion of the detection range. On the other hand, if it is determined that the subject vehicle V1 will overtake the other vehicle V2, the process proceeds to step S18, where a travel speed higher than a predetermined travel speed is set, and in the subsequent step S19, the overtaking or passing is performed without using the detection result of the imaging device 11 or by setting a small weight for the detection result. Then, the process proceeds to step S20.
[0099] In step S20, the support unit 20 determines whether the host vehicle V1 has reached the destination. If it is determined that the host vehicle V1 has reached the destination, the routine ends, and the display device 18 prompts the driver of the host vehicle V1 to drive manually. On the other hand, if it is determined that the host vehicle V1 has not reached the destination, the process proceeds to step S1 in FIG. 7A. Note that manual driving refers to the driving support device 19 not performing autonomous driving control of the driving behavior but controlling the vehicle's driving through driver operation. Note that the driving support device 19 and driving support method according to the present invention can be used in any of the following cases: autonomous control of only the vehicle's driving speed; autonomous control of only the vehicle's steering operation; and autonomous control of both the vehicle's driving speed and steering operation. Furthermore, the driving support device 19 and driving support method according to the present invention can be used not only for autonomous driving control but also to support the driver's driving operation during manual driving.
[0100] As described above, according to the present embodiment, there is provided a driving assistance method executed by a processor in which detection ranges of multiple image capture devices 11 mounted on the host vehicle V1 overlap in a lane adjacent to the host vehicle V1 in which the host vehicle V1 is traveling. The driving assistance method includes: determining whether another vehicle V2 will enter the overlapping portion of the detection ranges within a predetermined time; and, if it is determined that the other vehicle V2 will enter the overlapping portion within the predetermined time, executing risk management control to control the host vehicle V1 so as to address the risk of erroneously recognizing the driving state of the other vehicle V2 from the detection results of the multiple image capture devices 11. This reduces the impact of erroneous recognition of the driving state of the other vehicle V2 on the driving state of the host vehicle V1.
[0101] Furthermore, according to the driving assistance method of this embodiment, the risk response control includes at least one of autonomously controlling the traveling of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion, and autonomously controlling the traveling of the host vehicle V1 so that the traveling state of the other vehicle V2, which has been erroneously recognized from the detection result, does not affect the traveling state of the host vehicle V1. This makes it possible to suppress the effect of erroneous recognition of the traveling state of the other vehicle V2 on the traveling state of the host vehicle V1, depending on the traveling scene.
[0102] Furthermore, according to the driving assistance method of this embodiment, autonomously controlling the traveling of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion includes setting the traveling speed of the host vehicle V1 and / or the inter-vehicle distance between the host vehicle V1 and the other vehicle V2 so that the other vehicle V2 is not included in the detection range, and changing the host vehicle V1 to the adjacent lane, and autonomously controlling the traveling of the host vehicle V1 so that the erroneously recognized traveling state of the other vehicle V2 does not affect the traveling state of the host vehicle V1 includes autonomously controlling the traveling of the host vehicle V1 without using the detection result, and autonomously controlling the traveling of the host vehicle V1 by setting a small weight for the detection result. This makes it possible to suppress the impact of erroneous recognition of the traveling state of the other vehicle V2 on the traveling state of the host vehicle V1 depending on the traveling scene.
[0103] According to the driving assistance method of the present embodiment, the processor determines whether the overall length D1 of the other vehicle V2 is longer than the length D2 of the overlapping portion in the direction along the adjacent lane, and if it determines that the overall length D1 is longer than the length D2 of the overlapping portion, executes the risk response control, thereby making it possible to more accurately predict whether the other vehicle V2 will enter the overlapping portion.
[0104] According to the driving assistance method of the present embodiment, the processor determines whether the other vehicle V2 is a large vehicle, and if it determines that the other vehicle V2 is a large vehicle, executes the risk response control. This allows the risk response control to be executed according to the vehicle type of the other vehicle V2.
[0105] Furthermore, according to the driving assistance method of this embodiment, when the processor determines that the other vehicle V2 is not the large vehicle, it determines whether or not there is a single imaging device 11 among the multiple imaging devices 11 that can detect the other vehicle V2 in its entirety, and when it determines that there is no single imaging device 11 that can detect the other vehicle V2 in its entirety, it executes the risk response control. This makes it possible to suppress the execution of risk response control when the risk of erroneously recognizing the traveling state of the other vehicle V2 is low.
[0106] Furthermore, according to the driving assistance method of this embodiment, the processor acquires the brightness value of each pixel from the image captured using the imaging device 11, calculates the average brightness value of the image by dividing the sum of the brightness values by the total number of pixels, and executes the risk response control if the average brightness value is equal to or greater than a predetermined value. This makes it possible to execute risk response control when the shape of an obstacle cannot be accurately recognized from the contrast of the image.
[0107] Furthermore, according to the driving assistance method of this embodiment, the processor determines whether the other vehicle V2 is traveling behind the host vehicle V1, and if it determines that the other vehicle V2 is traveling behind the host vehicle V1, autonomously controls the traveling of the host vehicle V1 without using the detection result or by reducing the weighting of the detection result, thereby enabling risk response control to be performed according to the traveling scene.
[0108] Furthermore, according to the driving assistance method of this embodiment, the processor determines whether the other vehicle V2 is traveling ahead of the host vehicle V1, and if it determines that the other vehicle V2 is traveling ahead of the host vehicle V1, determines whether the host vehicle V1 will overtake or pass the other vehicle V2, and if it determines that the host vehicle V1 will not overtake or pass the other vehicle V2, autonomously controls the traveling of the host vehicle V1 so that the other vehicle V2 is not included in the overlapping portion. This makes it possible to execute risk response control according to the traveling scene.
[0109] Furthermore, according to the driving assistance method of this embodiment, when the processor determines that the host vehicle V1 will overtake or be overtaken, the processor sets a traveling speed higher than a predetermined traveling speed and performs the overtaking or beating without using the detection result or by setting a small weighting on the detection result. This makes it possible to execute risk response control according to the traveling scene.
[0110] Furthermore, according to this embodiment, a driving assistance device 19 is provided, which includes: a plurality of image capture devices 11 mounted on the host vehicle V1, the detection ranges of which partially overlap in a lane adjacent to the host vehicle V1 traveling on the host vehicle V1; a determination unit 22 that determines whether another vehicle V2 will enter the overlapping portion of the detection ranges within a predetermined time; and a control unit 23 that, if it is determined that the other vehicle V2 will enter the overlapping portion within the predetermined time, executes risk response control to control the host vehicle V1 so as to address the risk of erroneously recognizing the traveling state of the other vehicle V2 from the detection results of the plurality of image capture devices 11. This makes it possible to reduce the impact of erroneous recognition of the traveling state of the other vehicle V2 on the traveling state of the host vehicle V1.
[0111] [Combination of Embodiments] The driving assistance method and driving assistance device 19 according to the present invention include the following embodiments (1) to (11).
[0112] Embodiment (1): In a driving assistance method in which the detection ranges of multiple imaging devices 11 mounted on the host vehicle V1 overlap in a lane adjacent to the host vehicle V1 in which the host vehicle V1 is traveling, the method determines whether another vehicle V2 will enter the overlapping portion of the detection ranges within a predetermined time, and if it is determined that the other vehicle V2 will enter the overlapping portion within the predetermined time, executes risk management control to control the host vehicle V1 so as to address the risk of erroneously recognizing the driving state of the other vehicle V2 from the detection results of the multiple imaging devices 11.
[0113] Embodiment (2): The risk response control includes at least one of autonomously controlling the driving of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion, and autonomously controlling the driving of the host vehicle V1 so that the driving state of the other vehicle V2, which has been erroneously recognized from the detection result, does not affect the driving state of the host vehicle V1.
[0114] Embodiment (3): Autonomously controlling the driving of the host vehicle V1 so that the other vehicle V2 does not enter the overlapping portion includes setting the driving speed of the host vehicle V1 and / or the inter-vehicle distance between the host vehicle V1 and the other vehicle V2 so that the other vehicle V2 is not included in the detection range, and changing lanes of the host vehicle V1 to the adjacent lane, and autonomously controlling the driving of the host vehicle V1 so that the erroneously recognized driving state of the other vehicle V2 does not affect the driving state of the host vehicle V1 includes autonomously controlling the driving of the host vehicle V1 without using the detection result, and autonomously controlling the driving of the host vehicle V1 by setting a small weighting for the detection result.
[0115] Embodiment (4): Determine whether the total length D1 of the other vehicle V2 is longer than the length D2 of the overlapping portion in the direction along the adjacent lane, and if it is determined that the total length D1 is longer than the length D2 of the overlapping portion, execute the risk response control.
[0116] Embodiment (5): It is determined whether the other vehicle V2 is a large vehicle, and if it is determined that the other vehicle V2 is a large vehicle, the risk response control is executed.
[0117] Implementation example (6): A determination is made as to whether or not there is a single imaging device 11 among the plurality of imaging devices 11 that can detect the entire other vehicle V2, and when it is determined that there is no single imaging device 11 that can detect the entire other vehicle V2, the risk response control is executed.
[0118] Embodiment (7): The brightness value of each pixel is obtained from an image captured using the imaging device 11, and the sum of the brightness values is divided by the total number of pixels to calculate an average brightness value of the image.If the average brightness value is equal to or greater than a predetermined value, the risk response control is executed.
[0119] Embodiment (8): A determination is made as to whether the other vehicle V2 is traveling behind the host vehicle V1, and if it is determined that the other vehicle V2 is traveling behind the host vehicle V1, the traveling of the host vehicle V1 is autonomously controlled without using the detection result or by reducing the weighting of the detection result.
[0120] Embodiment (9): A determination is made as to whether the other vehicle V2 is traveling ahead of the host vehicle V1, and if it is determined that the other vehicle V2 is traveling ahead of the host vehicle V1, a determination is made as to whether the host vehicle V1 will overtake or pass the other vehicle V2, and if it is determined that the host vehicle V1 will not overtake or pass the other vehicle V2, the traveling of the host vehicle V1 is autonomously controlled so that the other vehicle V2 is not included in the overlapping portion.
[0121] Embodiment (10): Determine whether the other vehicle V2 is traveling ahead of the host vehicle V1, and if it is determined that the other vehicle V2 is traveling ahead of the host vehicle V1, determine whether the host vehicle V1 will overtake or pass the other vehicle V2, and if it is determined that the host vehicle V1 will overtake or pass, set a traveling speed higher than a predetermined traveling speed that has been set in advance, and perform the overtaking or pass without using the detection result or by setting the weighting of the detection result to a small value.
[0122] Embodiment (11): A driving assistance device 19 comprising: a plurality of imaging devices 11 mounted on a host vehicle V1, the detection ranges of which overlap in a lane adjacent to the host vehicle V1 in which the host vehicle V1 is traveling; a determination unit 22 that determines whether another vehicle V2 will enter the overlapping portion of the detection ranges within a predetermined time; and a control unit 23 that, if it is determined that the other vehicle V2 will enter the overlapping portion within the predetermined time, executes risk response control to control the host vehicle V1 so as to address the risk of erroneously recognizing the driving state of the other vehicle V2 from the detection results of the plurality of imaging devices 11.
[0123] The embodiment (1) relates to a driving assistance method, and may be combined with the embodiments (2) to (10). Specific combinations include the following:・A combination of embodiment (1) and any one of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any two of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any three of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any four of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any five of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any six of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and any seven of embodiment (2) and (4) to (10) ・A combination of embodiment (1) and embodiment (2) and (4) to (10) ・A combination of embodiment (1) to (3) and any one of embodiment (4) to (10)・A combination of any two of the embodiments (1) to (3) and (4) to (10) ・A combination of any three of the embodiments (1) to (3) and (4) to (10) ・A combination of any four of the embodiments (1) to (3) and (4) to (10) ・A combination of any five of the embodiments (1) to (3) and (4) to (10) ・A combination of the embodiments (1) to (3) and (6) of the embodiments (4) to (10) ・A combination of the embodiments (1) to (10)
[0124] The embodiment (11) relates to the driving assistance device 19, and may be combined with the embodiments (2) to (10). Specific combinations include the following:・A combination of embodiment (11) and any one of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any two of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any three of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any four of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any five of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any six of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and any seven of embodiment (2) and (4) to (10) ・A combination of embodiment (11) and embodiment (2) and (4) to (10)・A combination of embodiment (11) and (2) to (3) with any one of embodiments (4) to (10) ・A combination of embodiment (11) and (2) to (3) with any two of embodiments (4) to (10) ・A combination of embodiment (11) and (2) to (3) with any three of embodiments (4) to (10) ・A combination of embodiment (11) and (2) to (3) with any four of embodiments (4) to (10) ・A combination of embodiment (11) and (2) to (3) with any five of embodiments (4) to (10) ・A combination of embodiment (11) and (2) to (3) with any six of embodiments (4) to (10) ・A combination of embodiments (2) to (11)
[0125] DESCRIPTION OF SYMBOLS 10... Driving assistance system 11... Imaging device 12... Distance measuring device 13... Vehicle state detection device 14... Map information 15... Vehicle position detection device 16... Navigation device 17... Vehicle control device 171... Vehicle speed control device 172... Steering control device 18... Display device 19... Driving assistance device 191... CPU (processor) 192... ROM 193... RAM 20... Support unit 21... Recognition unit 22... Determination unit 23... Control unit A1, A2... Detection range B1, B2, B3, B4... Detection range C1, C2, C3, C4... Overlapping portion D1... Total length D2, D2a... Length D3, D4... Distance L1, L2, L3... Lane P1, P2, P3, P4, P5, P6, P7, P8, P9... Position T1, T2, T3... Travel trajectory V1...own vehicle V2, V2x, V3...other vehicles
Claims
1. A driving assistance method executed by a processor, in which detection ranges of a plurality of image capture devices mounted on a host vehicle partially overlap in a lane adjacent to a host vehicle lane in which the host vehicle is traveling, The processor, determining whether another vehicle is entering the overlapping portion of the detection range; A driving assistance method, comprising: if it is determined that the other vehicle is entering the overlapping portion, executing risk management control to control the host vehicle so as to address the risk of erroneously recognizing the driving state of the other vehicle from the detection results of the multiple imaging devices.
2. 2. The driving assistance method according to claim 1, wherein the risk response control includes at least one of: autonomously controlling the driving of the host vehicle so that the other vehicle does not enter the overlapping portion; and autonomously controlling the driving of the host vehicle so that the driving state of the other vehicle erroneously recognized from the detection result does not affect the driving state of the host vehicle.
3. Autonomous control of the traveling of the vehicle so that the other vehicle does not enter the overlapping portion is setting a travel speed of the host vehicle and / or a vehicle distance between the host vehicle and the other vehicle so that the other vehicle is not included in the detection range; changing the host vehicle to the adjacent lane; Autonomously controlling the traveling of the vehicle so that the erroneously recognized traveling state of the other vehicle does not affect the traveling state of the vehicle, Autonomously controlling the traveling of the host vehicle without using the detection result; The driving assistance method according to claim 2 , further comprising: autonomously controlling the traveling of the host vehicle by setting a small weighting for the detection result.
4. The processor, determining whether or not a total length of the other vehicle is longer than a length of the overlapping portion in a direction along the adjacent lane; The driving support method according to any one of claims 1 to 3, further comprising the step of: executing the risk treatment control when it is determined that the total length is longer than the length of the overlapping portion.
5. The processor, determining whether the other vehicle is a large vehicle; The driving support method according to any one of claims 1 to 3, further comprising the step of: executing the risk handling control when it is determined that the other vehicle is a large vehicle.
6. The processor, When it is determined that the other vehicle is not the large vehicle, it is determined whether or not there is a single imaging device among the plurality of imaging devices that can detect the other vehicle in its entirety; The driving support method according to claim 5 , further comprising the step of: executing the risk handling control when it is determined that there is no single imaging device capable of detecting the whole of the other vehicle.
7. The processor, Acquire a luminance value of each pixel from an image captured by the imaging device; Calculating an average luminance value of the image by dividing the sum of the luminance values by the total number of pixels; The driving support method according to any one of claims 1 to 3, further comprising the step of: executing the risk handling control when the average luminance value is equal to or greater than a predetermined value.
8. The processor, determining whether the other vehicle is traveling behind the host vehicle; 4. The driving assistance method according to claim 1, wherein, when it is determined that the other vehicle is traveling behind the vehicle, the driving of the vehicle is autonomously controlled without using the detection result or by reducing a weighting of the detection result.
9. The processor, determining whether the other vehicle is traveling ahead of the host vehicle; When it is determined that the other vehicle is traveling ahead of the host vehicle, it is determined whether the host vehicle will overtake or be overtaken by the other vehicle; The driving assistance method according to any one of claims 1 to 3, wherein, when it is determined that the host vehicle will not overtake or be overtaken, the driving of the host vehicle is autonomously controlled so that the other vehicle is not included in the overlapping portion.
10. The processor, 10. The driving assistance method according to claim 9, wherein, when it is determined that the host vehicle will overtake or be overtaken, a travel speed higher than a predetermined travel speed is set, and the host vehicle performs the overtaking or be overtaken without using the detection result or by setting a weighting of the detection result to a small value.
11. A plurality of imaging devices mounted on a vehicle, the imaging devices having detection ranges that partially overlap each other in lanes adjacent to a lane in which the vehicle is traveling; a determination unit that determines whether or not another vehicle is entering the overlapping portion of the detection ranges; a control unit that, when it is determined that the other vehicle is entering the overlapping portion, executes risk management control to control the host vehicle so as to address the risk of erroneously recognizing the driving state of the other vehicle from the detection results of the multiple imaging devices.