Vehicle control device, vehicle control method, and vehicle control computer program
The vehicle control device addresses the challenge of increasing driver involvement in vehicles towing a towed vehicle by using a towing detection unit and sensor signals to assess and notify the driver of participation requirements, effectively enhancing safety and control.
Patent Information
- Application Number
- JP2023034816
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-07
- Publication Date
- 2025-06-03
- Estimated Expiration
- 2043-03-07
AI Technical Summary
Existing vehicle control systems struggle to appropriately increase the degree of driver involvement when automatic driving control is applied to a vehicle towing a towed vehicle, necessitating a solution to set the timing for driver participation effectively.
A vehicle control device that includes a towing detection unit, sensor signals for detecting the vehicle's surroundings and behavior, a determination unit to assess participation requirements, and a notification processing unit to inform the driver when participation is needed, with relaxed participation conditions when towing a towed vehicle.
The system effectively sets the timing for increasing driver participation in vehicles towing a towed vehicle under automatic driving control, enhancing safety and control by adjusting participation requirements based on towing conditions.
Smart Images

Figure 0007687359000001 
Figure 0007687359000002 
Figure 0007687359000003
Abstract
Description
Technical Field
[0001] The present invention relates to a vehicle control device, a vehicle control method, and a computer program for vehicle control.
Background Art
[0002] The behavior of a vehicle towing another vehicle is sometimes different from that of a vehicle not towing. Therefore, in the automatic driving control of a vehicle towing another vehicle, it is required to control the vehicle in consideration of the difference in vehicle behavior depending on whether towing is performed or not. Thus, a technique has been proposed in which different controls are executed for a vehicle depending on whether or not a towed vehicle is connected (see Patent Document 1).
[0003] When the driving support device disclosed in Patent Document 1 detects the connection of a towed vehicle, the driving mode is set to a restricted second driving support mode in which the second driving support mode for performing automatic driving without the condition of holding the steering wheel is applied only during continuous driving in the same lane. And when changing lanes, this driving support device changes the driving mode to the first driving support mode for performing automatic driving on the condition of holding the steering wheel.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] When automatic driving control is applied to a vehicle towing a towed vehicle, it may be required to increase the degree of driver involvement in driving. In such a case, it is required to be able to appropriately set the timing for increasing the degree of driver involvement in driving.
[0006] Therefore, an object of the present invention is to provide a vehicle control device capable of appropriately setting a timing for increasing the degree of a driver's involvement in driving a vehicle that is towing a towed vehicle and to which automatic driving control is applied.
Means for Solving the Problems
[0007] According to one embodiment, a vehicle control device is provided. This vehicle control device includes a towing detection unit that detects that the vehicle is towing a towed vehicle when the vehicle is under automatic driving control, an outside vehicle sensor signal generated by an outside vehicle sensor that detects the situation around the vehicle, an inside vehicle sensor signal generated by an inside vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or based on the position of the vehicle, a determination unit that determines whether a participation requirement condition for requiring the driver of the vehicle to participate in driving is satisfied, and a notification processing unit that notifies a requirement for participation in driving via a notification device provided in the vehicle cabin when it is determined that the participation requirement condition is satisfied. And the determination unit relaxes the participation requirement condition when the vehicle is detected as towing a towed vehicle compared to the participation requirement condition when the vehicle is not detected as towing a towed vehicle.
[0008] In this vehicle control device, the determination unit measures a lateral distance between the vehicle and a lane dividing line that demarcates the own lane in which the vehicle is traveling based on the outside vehicle sensor signal, and determines that the participation requirement condition is satisfied when the lateral distance becomes less than a predetermined distance threshold. It is preferable that the distance threshold when the vehicle is detected as towing a towed vehicle is made larger than the distance threshold when the vehicle is not detected as towing a towed vehicle.
[0009] In this case, it is preferable that the determination unit increases the distance threshold when the vehicle is detected as towing a towed vehicle as the weight or volume of the towed vehicle is larger.
[0010] Further, when the determination unit determines that the involvement request condition is satisfied if the speed of the vehicle represented by the vehicle behavior signal is equal to or higher than a predetermined speed threshold than the speed limit of the road on which the vehicle is traveling, it is preferable to set a lower value for the speed threshold when it is not detected that the vehicle is towing a towed vehicle than the speed threshold when it is detected that the vehicle is towing a towed vehicle.
[0011] Furthermore, when the determination unit determines that the involvement request condition is satisfied if the speed limit of the road on which the vehicle is traveling is less than a predetermined speed, it is preferable to set a higher value for the predetermined speed when it is detected that the vehicle is towing a towed vehicle than the predetermined speed when it is not detected that the vehicle is towing a towed vehicle.
[0012] Furthermore, when the determination unit determines that the involvement request condition is satisfied if the radius of curvature of a curve in which the vehicle is traveling or within a section up to a predetermined distance ahead is less than a predetermined radius of curvature threshold, it is preferable to set a larger value for the radius of curvature threshold when it is detected that the vehicle is towing a towed vehicle than the radius of curvature threshold when it is not detected that the vehicle is towing a towed vehicle.
[0013] Furthermore, when the determination unit determines that the involvement request condition is satisfied if the gradient of the road in which the vehicle is traveling or within a section up to a predetermined distance ahead is equal to or greater than a predetermined gradient threshold, it is preferable to set a smaller value for the gradient threshold when it is detected that the vehicle is towing a towed vehicle than the gradient threshold when it is not detected that the vehicle is towing a towed vehicle.
[0014] According to another embodiment, a vehicle control device is provided. The vehicle control device includes a towing detection unit that detects that the vehicle is towing a towed vehicle when the vehicle is under automatic driving control, a detection unit that detects the relative position and relative speed between the vehicle and another vehicle traveling in an adjacent lane adjacent to the own lane in which the vehicle is traveling, a control unit that executes lane change control of the vehicle so as to change the lane of the vehicle from the own lane to the adjacent lane when a predetermined condition is satisfied, a determination unit that determines whether or not an interruption condition set based on at least one of the change in the relative position and the relative speed between the other vehicle and the vehicle is satisfied during the execution of the lane change control, and an interruption instruction unit that instructs the control unit to interrupt the lane change control when the interruption condition is satisfied. And the determination unit relaxes the interruption condition when it is detected that the vehicle is towing a towed vehicle compared to the interruption condition when it is not detected that the vehicle is towing a towed vehicle.
[0015] According to still another embodiment, a vehicle control method is provided. The vehicle control method includes detecting that the vehicle is towing a towed vehicle when the vehicle is under automatic driving control, and determining whether or not a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle. When it is determined that the participation request condition is satisfied, a request for participation in the driving is notified via a notification device provided in the vehicle cabin. And the determination of whether or not the participation request condition is satisfied includes relaxing the participation request condition when it is detected that the vehicle is towing a towed vehicle compared to the participation request condition when it is not detected that the vehicle is towing a towed vehicle.
[0016] According to yet another embodiment, a vehicle control computer program is provided. When the vehicle is under automatic driving control, this vehicle control computer program detects that the vehicle is towing a towed vehicle, and based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it determines whether a participation requirement condition for requiring the driver of the vehicle to participate in the driving of the vehicle is satisfied. When it is determined that the participation requirement condition is satisfied, it causes the processor mounted on the vehicle to notify a request for participation in driving via a notification device provided inside the vehicle cabin, including instructions for this. The determination of whether the participation requirement condition is satisfied includes relaxing the participation requirement condition when the vehicle is detected to be towing a towed vehicle compared to the participation requirement condition when it is not detected that the vehicle is towing a towed vehicle.
Effect of the Invention
[0017] The vehicle control device according to the present invention has an effect that it can appropriately set the timing to increase the degree of the driver's participation in the driving of a vehicle that is towing a towed vehicle and to which automatic driving control is applied.
Brief Description of the Drawings
[0018]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Embodiments for Carrying Out the Invention
[0019] Hereinafter, with reference to the drawings, a vehicle control device, a vehicle control method executed on the vehicle control device, and a vehicle control computer program will be described. This vehicle control device automatically controls the running of a vehicle capable of towing a towed vehicle. More specifically, this vehicle control device determines whether or not a participation request condition for requesting the driver of the vehicle to participate in driving is satisfied, and when it is determined that the participation request condition is satisfied, it notifies the request for participation in driving via a notification device provided in the vehicle interior. And this vehicle control device relaxes the participation request condition when the vehicle is detected to be towing a towed vehicle compared to the participation request condition when the vehicle is not detected to be towing a towed vehicle.
[0020] FIG. 1 is a schematic configuration diagram of a vehicle control system in which a vehicle control device is implemented. FIG. 2 is a hardware configuration diagram of an electronic control unit which is an embodiment of the vehicle control device. In the present embodiment, a vehicle control system 1 mounted on a vehicle 10 and controlling the vehicle 10 includes a camera 2, a driver monitor camera 3, a GPS receiver 4, a behavior sensor 5, a wireless communication terminal 6, a notification device 7, a storage device 8, and an electronic control unit (ECU) 9 which is an example of the vehicle control device. The camera 2, the driver monitor camera 3, the GPS receiver 4, the wireless communication terminal 6, the notification device 7, the storage device 8, and the ECU 9 are communicably connected via an in-vehicle network conforming to a standard such as a controller area network. Further, the behavior sensor 5 is also communicably connected to the ECU 9. Note that the vehicle control system 1 may further include a distance measuring sensor (not shown) such as a LiDAR or a radar that measures the distance from the vehicle 10 to an object existing around the vehicle 10. Also, the vehicle control system 1 may further include a navigation device (not shown) for searching for a route to a destination.
[0021] Furthermore, the vehicle 10 has a device for towing a towed vehicle 11, such as a tow hook, and is capable of towing the towed vehicle 11.
[0022] The camera 2 is an example of an out-of-vehicle sensor, and includes a two-dimensional detector composed of an array of photoelectric conversion elements sensitive to visible light, such as a CCD or a C-MOS, and an imaging optical system that forms an image of an area to be photographed on the two-dimensional detector. The camera 2 is attached, for example, inside the vehicle compartment of the vehicle 10 so as to face the front of the vehicle 10. The camera 2 photographs the front area of the vehicle 10 at a predetermined photographing cycle (for example, 1 / 30 second to 1 / 10 second), and generates an image in which the front area is shown. The image obtained by the camera 2 is an example of an out-of-vehicle sensor signal representing the situation around the vehicle 10. Note that a plurality of cameras having different photographing directions or focal lengths may be provided on the vehicle 10.
[0023] Each time the camera 2 generates an image, it outputs the generated image to the ECU 9 via the in-vehicle network.
[0024] The driver monitor camera 3 is an example of an in-vehicle sensor. Similar to the camera 2, it is composed of a two-dimensional detector consisting of an array of photoelectric conversion elements sensitive to visible light or infrared light, such as a CCD or a C-MOS, and an imaging optical system that forms an image of the area to be photographed on the two-dimensional detector. The driver monitor camera 3 may further have a light source for illuminating the driver, such as an infrared LED. And the driver monitor camera 3 is attached toward the driver, for example, on the instrument panel or in its vicinity, so that the head of the driver sitting on the driver's seat of the vehicle 10 is included in the photographed area, that is, so that the head of the driver can be photographed. Then, the driver monitor camera 3 photographs the driver at a predetermined photographing cycle (for example, 1 / 30 second to 1 / 10 second) and generates an image of the driver (hereinafter referred to as a driver image). The driver image obtained by the driver monitor camera 3 is an example of an in-vehicle sensor signal representing the situation inside the vehicle compartment of the vehicle 10, and may be a color image or a gray image. Each time the driver monitor camera 3 generates a driver image, it outputs the generated driver image to the ECU 9 via the in-vehicle network.
[0025] The GPS receiver 4 receives GPS signals from GPS satellites at a predetermined cycle and determines the self-position of the vehicle 10 based on the received GPS signals. Then, the GPS receiver 4 outputs positioning information representing the positioning result of the self-position of the vehicle 10 based on the GPS signals to the ECU 9 via the in-vehicle network at a predetermined cycle. Note that the vehicle 10 may have a receiver that receives positioning signals from satellites by another satellite positioning system instead of the GPS receiver to determine the self-position of the vehicle 10.
[0026] The behavior sensor 5 is a sensor for detecting the behavior of the vehicle 10, and includes at least a torque sensor that detects the torque applied to the drive shaft of the drive wheels and an acceleration sensor that detects the acceleration of the vehicle 10. Further, the vehicle control system 1 may have a plurality of different types of behavior sensors 5. For example, the behavior sensor 5 may have a speed sensor or a gyro sensor. And each time the behavior sensor 5 generates a sensor signal representing the behavior of the vehicle 10, the generated sensor signal is output to the ECU 9. Note that the sensor signal generated by the behavior sensor 5 (for example, a signal representing the torque generated by the torque sensor, a signal representing the acceleration / deceleration generated by the acceleration sensor, or a signal representing the speed generated by the speed sensor) is an example of a vehicle behavior signal representing the behavior of the vehicle 10.
[0027] The wireless communication terminal 6 performs wireless communication with a wireless base station in accordance with a predetermined mobile communication standard. The wireless communication terminal 6 receives map information including a high-precision map used for autonomous driving control from a map server via the wireless base station. And the wireless communication terminal 6 outputs the received map information to the storage device 8 via the in-vehicle network.
[0028] The notification device 7 is provided in the passenger compartment of the vehicle 10 and is a device that gives a predetermined notification to the driver by light, voice, vibration, character display, or image display. For this purpose, the notification device 7 has, for example, at least one of a speaker, a light source, a vibrator, or a display device. And when the notification device 7 receives a notification signal representing a predetermined notification to the driver (for example, a hands-on request or a driving change request) from the ECU 9, it executes the notification to the driver by voice from the speaker, emission or blinking of the light source, vibration of the vibrator, or display of a message on the display device. When the notification device 7 has two or more types of devices, the notification may be given to the driver via each of the two or more types of devices.
[0029] The storage device 8 is an example of a storage unit and has, for example, a hard disk device, a non-volatile semiconductor memory, or an optical recording medium and its access device. And the storage device 8 stores a high-precision map.
[0030] Furthermore, the storage device 8 has a processor for executing processes such as update processing of map information and processes related to a request for reading a high-precision map from the ECU 9. For example, every time the vehicle 10 moves a predetermined distance, the storage device 8 transmits a request for acquiring map information to the map server via the wireless communication terminal 6 together with the current position of the vehicle 10. Then, the storage device 8 receives map information including a high-precision map for a predetermined area around the current position of the vehicle 10 from the map server via the wireless communication terminal 6, and stores the high-precision map included in the received map information. Further, when the storage device 8 receives a request for reading a map from the ECU 9, it cuts out a range including the current position of the vehicle 10 and relatively narrower than the above-mentioned predetermined area from the stored high-precision map, and outputs it to the ECU 9 via the in-vehicle network. Note that the high-precision map includes information used for automatic driving control of the vehicle 10, such as the number of lanes for each road section, the width of each lane, the speed limit, road markings such as lane dividing lines, and various road signs.
[0031] The ECU 9 performs automatic driving control of the vehicle 10. Further, when performing automatic driving control of the vehicle 10, the ECU 9 determines whether or not an intervention request condition for requesting an intervention in the driving of the vehicle is satisfied, and when the intervention request condition is satisfied, requests the driver to intervene in the driving via the notification device 7.
[0032] Note that the request for intervention in driving includes a request to hold the steering (hands-on request) and a request to transfer the control subject to the driver (driving handover request).
[0033] As shown in FIG. 2, the ECU 9 includes a communication interface 21, a memory 22, and a processor 23. The communication interface 21, the memory 22, and the processor 23 may each be configured as separate circuits, or may be integrally configured as one integrated circuit.
[0034] The communication interface 21 has an interface circuit for connecting the ECU 9 to other devices. And each time the communication interface 21 receives an image from the camera 2, it transfers the received image to the processor 23. Also, each time the communication interface 21 receives a driver image from the driver monitoring camera 3, it transfers the received driver image to the processor 23. Furthermore, each time the communication interface 21 receives positioning information from the GPS receiver 4, it transfers the positioning information to the processor 23. Additionally, each time the communication interface 21 receives a sensor signal from the behavior sensor 5, it transfers the sensor signal to the processor 23. Moreover, the communication interface 21 transfers the high-precision map read from the storage device 8 to the processor 23. Additionally, the communication interface 21 outputs the notification signal received from the processor 23 to the notification device 7.
[0035] The memory 22 is another example of a storage unit and has, for example, a volatile semiconductor memory and a non-volatile semiconductor memory. And the memory 22 stores various data used in the vehicle control process executed by the processor 23. For example, the memory 22 stores the image around the vehicle 10 received from the camera 2, the driver image received from the driver monitoring camera 3, the positioning information of the vehicle 10 received from the GPS receiver 4, the measured values representing the behavior of the vehicle 10 represented by the sensor signal received from the behavior sensor 5, and the high-precision map read from the storage device 8. Furthermore, the memory 22 stores parameters such as the focal length, shooting direction, and mounting position of the camera 2, and various parameters for identifying the object detector used for detecting features and the like. Additionally, the memory 22 temporarily stores various data generated during the vehicle control process.
[0036] The processor 23 has one or more CPUs (Central Processing Units) and its peripheral circuits. The processor 23 may further have other arithmetic circuits such as a logical arithmetic unit, a numerical arithmetic unit, or a graphic processing unit. And the processor 23 executes vehicle control processing for the vehicle 10 at a predetermined cycle. Further, the processor 23 changes the participation request condition for whether or not to request the driver to increase the degree of participation in driving according to whether or not the vehicle 10 is towing a towed vehicle. Further, after starting the lane change process for the vehicle 10, the processor 23 changes the interruption condition for whether or not to interrupt the lane change process according to whether or not the vehicle 10 is towing a towed vehicle.
[0037] (First Embodiment) FIG. 3 is a functional block diagram of the processor 23 regarding the vehicle control process according to the first embodiment. The processor 23 includes a traction detection unit 31, a control unit 32, a determination unit 33, and a notification processing unit 34. Each of these units included in the processor 23 is, for example, a functional module realized by a computer program operating on the processor 23. Alternatively, each of these units included in the processor 23 may be a dedicated arithmetic circuit provided in the processor 23.
[0038] In the first embodiment, during the execution of the automatic driving control for the vehicle 10, the processor 23 determines whether or not the participation request condition is satisfied, and when the participation request condition is satisfied, a participation request for requesting the driver to participate in the driving of the vehicle 10 is notified via the notification device 7. And the processor 23 changes the participation request condition according to whether or not the towing of the towed vehicle 11 by the vehicle 10 is detected. Hereinafter, the towing of the towed vehicle 11 by the vehicle 10 may be simply referred to as the towing of the towed vehicle 11.
[0039] The traction detection unit 31 detects that the vehicle 10 is towing the towed vehicle 11. It is assumed that whether the vehicle 10 is towing the towed vehicle 11 does not change during the operation of the vehicle 10. Therefore, once the traction detection unit 31 determines the detection of the traction of the towed vehicle 11, it may not perform the determination until the ignition switch of the vehicle 10 is turned off.
[0040] For example, when the vehicle 10 is in a predetermined state, the traction detection unit 31 uses a sensor signal representing the measured values of the acceleration and torque when the vehicle 10 accelerates, which is obtained from the behavior sensor 5, for detecting the traction of the towed vehicle 11. Then, the traction detection unit 31 compares the traction determination threshold value corresponding to the torque with the acceleration. When the acceleration is less than the traction determination threshold value, it detects the traction of the towed vehicle 11. On the other hand, when the acceleration is greater than or equal to the traction determination threshold value, the traction detection unit 31 does not detect the traction of the towed vehicle 11. The traction determination threshold value for each torque is stored in advance in the memory 22.
[0041] Also, the predetermined state can be, for example, a state where the vehicle 10 is stopped at a point without a gradient in its traveling direction, or a state where the vehicle 10 is traveling at a constant speed on a road without a gradient in its traveling direction. Then, the traction detection unit 31 may determine the presence or absence of a gradient in the traveling direction of the vehicle 10 by referring to the position of the vehicle 10 indicated by the latest positioning signal from the GPS receiver 4 and the high-precision map. Further, when there is no gradient in the traveling direction of the vehicle 10, the traction detection unit 31 may determine whether the vehicle 10 is in a predetermined state based on a sensor signal representing the speed of the vehicle 10, which is obtained from a speed sensor that is an example of the behavior sensor 5.
[0042] Furthermore, when the traction detection unit 31 detects the traction of the towed vehicle 11, it may estimate the weight of the towed vehicle 11. In this case, the traction detection unit 31 refers to a reference table representing the relationship between the torque and acceleration and the weight of the towed vehicle 11, specifies the weight corresponding to the measured torque and acceleration, and sets the specified weight as the estimated weight of the towed vehicle 11.
[0043] Further, when a sensor for detecting that the towed vehicle 11 is connected is provided in the equipment for towing the towed vehicle 11, the towing detection unit 31 may detect the towing of the towed vehicle 11 when the sensor signal from the sensor indicates that the towed vehicle 11 is connected.
[0044] The towing detection unit 31 notifies the control unit 32 and the determination unit 33 of the determination result of whether or not the towing of the towed vehicle 11 is detected.
[0045] The control unit 32 controls the running of the vehicle 10 with reference to the high-precision map read from the storage device 8. For example, the control unit 32 controls each part of the vehicle 10 so that the vehicle 10 continues to run within its own lane. At that time, the control unit 32 creates a planned travel route passing within its own lane with reference to the high-precision map used for travel control. For example, the control unit 32 creates a planned travel route so as to pass through the center between two lane dividing lines that demarcate the own lane shown in the high-precision map. Then, the control unit 32 controls each part of the vehicle 10 so that the vehicle 10 runs along the planned travel route.
[0046] Therefore, the control unit 32 detects the position of the vehicle 10 at a predetermined cycle and compares the detected position of the vehicle 10 with the planned driving route. In order to accurately detect the position of the vehicle 10, the control unit 32 collates the image generated by the camera 2 with the high-precision map used for driving control. For example, the control unit 32 projects the features on or around the road detected from the image onto the high-precision map assuming the position and orientation of the vehicle 10, or projects the features on or around the road around the vehicle 10 represented on the high-precision map onto the image. Note that the features on or around the road can be, for example, road markings such as lane dividing lines or stop lines, or curbstones. Then, the control unit 32 detects the position and orientation of the vehicle 10 when the features detected from the image and the features represented on the high-precision map match the most as the accurate position of the vehicle 10. Further, the control unit 32 detects the lane including its own position on the high-precision map as the own lane. Furthermore, the control unit 32 sets the lane dividing line detected at the position closest to the vehicle 10 in the regions corresponding to the left and right sides of the vehicle 10 in the image as the lane dividing line that divides the own lane.
[0047] The control unit 32 may determine the position where the feature is projected on the high-precision map or in the image using the initial values of the assumed position and orientation of the vehicle 10 and the parameters of the camera 2 such as the focal length, installation height, and shooting direction. Note that as the initial values of the position and orientation of the vehicle 10, the latest position of the vehicle 10 measured by the GPS receiver 4, or the position and orientation of the vehicle 10 estimated at the previous self-position detection and corrected using the odometry information are used. Then, the control unit 32 calculates the degree of coincidence (for example, the reciprocal of the sum of the squares of the distances between the corresponding features) between the features on or around the road detected from the image and the corresponding features represented on the high-precision map.
[0048] The control unit 32 repeats the above process while changing the assumed position and orientation of the vehicle 10. Then, the control unit 32 may detect the assumed position and orientation when the degree of coincidence is maximized as the accurate position of the vehicle 10.
[0049] Note that the control unit 32 may detect a feature to be detected, for example, by inputting an image into an identifier pre-trained to detect the feature from an image. As such an identifier, the control unit 32 can use a deep neural network (DNN) having a convolutional neural network (CNN) type architecture such as Single Shot MultiBox Detector or Faster R-CNN. Alternatively, the control unit 32 may use a DNN having a self attention network (SAN) type architecture such as Vision Transformer as such an identifier. Alternatively, the control unit 32 may also use an identifier based on another machine learning method such as an AdaBoost identifier as such an identifier. Such an identifier is pre-trained according to a predetermined learning method such as the error backpropagation method using a large number of teacher images representing the feature so as to detect the feature to be detected from the image.
[0050] Note that the control unit 32 may measure the position of the vehicle 10 without using the high-precision map. In this case, the control unit 32 inputs the image obtained by the camera 2 into the identifier to detect the left and right lane dividing lines that demarcate the own lane represented in the image. Note that the position of the lane dividing line on the image corresponds one-to-one to the azimuth as seen from the camera that generated the image. Therefore, the control unit 32, based on the reference positions in the horizontal direction of the pixels representing the left and right lane dividing lines at the position closest to the bottom end of the image, and parameters such as the focal length, shooting direction, and installation height of the camera 2, estimates the positions of the left and right lane dividing lines corresponding to the reference positions on the image with respect to the camera 2. Further, the control unit 32 may measure the lateral position of the vehicle 10 within the own lane by obtaining the distances from the camera 2 to the left and right lane dividing lines based on the estimation result and the extending direction of the lane dividing lines and the shooting direction of the camera 2.
[0051] If the measured position of the vehicle 10 is on the planned travel route, the control unit 32 determines the steering angle of the vehicle 10 so that the vehicle 10 advances along the planned travel route, and controls the steering of the vehicle 10 so that the determined steering angle is achieved. Further, if the measured position of the vehicle 10 is away from the planned travel route, the control unit 32 determines the steering angle of the vehicle 10 so that the vehicle 10 approaches the planned travel route, and controls the steering of the vehicle 10 so that the determined steering angle is achieved.
[0052] Furthermore, the control unit 32 refers to the current position of the vehicle 10 and the high-precision map, specifies the speed limit of the road on which the vehicle 10 is traveling, and sets the specified speed limit as the target vehicle speed. Then, the control unit 32 controls each part of the vehicle 10 so that the speed of the vehicle 10 approaches the set target vehicle speed. In addition, the control unit 32 controls the acceleration and deceleration of the vehicle 10 so that the distance between the preceding vehicle traveling ahead of the vehicle 10 in the own lane and the vehicle 10 is maintained at a certain interval or more. For this purpose, the control unit 32 inputs the image obtained by the camera 2 into an identifier that has been pre-learned to detect other vehicles, thereby detecting other vehicles traveling around the vehicle 10. As such an identifier, the control unit 32 can use the same identifier as the identifier used for detecting ground features. Alternatively, the identifier used for detecting ground features may be pre-learned to also detect other vehicles. In this case, the control unit 32 can detect not only ground features but also other vehicles by inputting the image into the identifier used for detecting ground features. Then, among the detected other vehicles, the control unit 32 may regard as the preceding vehicle the other vehicle whose lower end is located within the region sandwiched between two lane dividing lines that demarcate the own lane on the image. Furthermore, the control unit 32 may estimate the distance between the vehicle 10 and the preceding vehicle based on the position of the lower end of the object region representing the preceding vehicle on the image and parameters such as the shooting direction, focal length, and installation height of the camera 2. Then, if the estimated distance to the preceding vehicle is less than a certain interval, the control unit 32 sets the acceleration and deceleration of the vehicle 10 so as to decelerate the vehicle 10. On the other hand, if the estimated distance to the preceding vehicle is a certain interval or more, the control unit 32 sets the acceleration and deceleration of the vehicle 10 so that the speed of the vehicle 10 approaches the target speed.
[0053] When the acceleration / deceleration speed is set as described above, the control unit 32 sets the accelerator opening or the brake amount according to the set acceleration / deceleration speed. At this time, the control unit 32 may change the accelerator opening or the brake amount depending on whether the towing of the towed vehicle 11 is detected or not. For example, the control unit 32 may make the accelerator opening or the brake amount when the towing of the towed vehicle 11 is detected larger than the accelerator opening or the brake amount when the towing of the towed vehicle 11 is not detected.
[0054] The control unit 32 obtains the fuel injection amount according to the set accelerator opening, and outputs a control signal corresponding to the fuel injection amount to the fuel injection device of the engine of the vehicle 10. Alternatively, the control unit 32 obtains the amount of electric power supplied to the motor according to the set accelerator opening, and controls the drive circuit of the motor so that the amount of electric power is supplied to the motor. Alternatively, the control unit 32 outputs a control signal corresponding to the set brake amount to the brake of the vehicle 10.
[0055] Note that if the driver does not perform the required participation even after a predetermined period has elapsed since the request for the driver's participation in driving is notified, the control unit 32 may stop the automatic driving control or stop the vehicle 10. For example, if the ECU 9 does not receive a signal indicating that the steering wheel is held from a touch sensor (not shown) provided on the steering wheel even after a predetermined period has elapsed since the hands-on request is notified, the control unit 32 may stop the automatic driving control and transfer the driving control to the driver. Also, if the ECU 9 does not receive a signal indicating that the steering wheel is held from the touch sensor provided on the steering wheel, or a signal indicating that the steering wheel, accelerator, or brake has been operated even after a predetermined period has elapsed since the driving change request is notified, the control unit 32 may stop the vehicle 10.
[0056] The determination unit 33 determines whether the participation requirement condition is satisfied. In the present embodiment, the determination unit 33 compares the distance from the vehicle 10 to each of the left and right lane dividing lines that demarcate the own lane (hereinafter referred to as the lateral distance) with the hands-on requirement threshold value. And if any of the lateral distances on the left and right is less than the hands-on requirement threshold value, the determination unit 33 determines that the participation requirement condition is satisfied. And when the determination unit 33 determines that the participation requirement condition is satisfied, it notifies the determination result to the notification processing unit 34. The hands-on requirement threshold value is an example of a distance threshold value.
[0057] Here, the determination unit 33 sets the hands-on requirement threshold value when the towing of the towed vehicle 11 is detected to a larger value than the hands-on requirement threshold value when the towing of the towed vehicle 11 is not detected. That is, the participation requirement condition when the towing of the towed vehicle 11 is detected is relaxed compared to the participation requirement condition when the towing of the towed vehicle 11 is not detected. For example, the determination unit 33 sets the hands-on requirement threshold value when the towing of the towed vehicle 11 is not detected to 0.2 m to 0.3 m, and sets the hands-on requirement threshold value when the towing of the towed vehicle 11 is detected to 0.4 m to 0.5 m. By setting the hands-on requirement threshold value in this way, even when the vehicle 10 is towing the towed vehicle 11, it becomes possible to request the driver to hold the steering wheel before the vehicle 10 gets too close to the lane dividing line.
[0058] Note that, as described in the control unit 32, the determination unit 33 may estimate the position of the lane dividing line with reference to the camera 2 based on the position of the lane dividing line detected from the image on the image and the parameters of the camera 2. Further, the determination unit 33 may obtain the lateral distance by subtracting the distance from the mounting position of the camera 2 to the side surface of the vehicle 10 for each of the left and right sides of the vehicle 10 from the distance from the camera 2 to the lane dividing line.
[0059] FIG. 4(a) and FIG. 4(b) are diagrams showing an example of the relationship between the hands-on request threshold when the towing of the towed vehicle 11 is not detected and the hands-on request threshold when the towing of the towed vehicle 11 is detected. In the example shown in FIG. 4(a), the vehicle 10 is not towing another vehicle. In contrast, in the example shown in FIG. 4(b), the vehicle 10 is towing the towed vehicle 11.
[0060] As shown in FIG. 4(a), when the towing of the towed vehicle 11 is not detected, a first value HOnTh1 is used as the hands-on request threshold. Therefore, when the towing of the towed vehicle 11 is not detected, if the lateral distance L between either the left or right lane dividing line 401 and the vehicle 10 becomes less than the hands-on request threshold HOnTh1, it is determined that the participation request condition is satisfied, and a hands-on request is notified.
[0061] In contrast, as shown in FIG. 4(b), when the towing of the towed vehicle 11 is detected, a second value HOnTh2 is used as the hands-on request threshold. Therefore, when the towing of the towed vehicle 11 is detected, if the lateral distance L between either the left or right lane dividing line 401 and the vehicle 10 becomes less than the hands-on request threshold HOnTh2, it is determined that the participation request condition is satisfied, and a hands-on request is notified. Also, the second value HOnTh2 is set to a value larger than the first value HOnTh1. Therefore, it is easier for the participation request condition to be satisfied when the towing of the towed vehicle 11 is detected than when the towing of the towed vehicle 11 is not detected. Therefore, even when the vehicle 10 is towing the towed vehicle 11, a hands-on request will be notified before the vehicle 10 gets too close to the lane dividing line 401.
[0062] Further, the determination unit 33 compares the lateral distances to the left and right lane dividing lines with the driving handover request threshold. And if either of the lateral distances to the left and right is less than the driving handover request threshold, the determination unit 33 determines that the participation request condition is satisfied. The driving handover request threshold is another example of a distance threshold.
[0063] When the determination unit 33 does not detect the towing of the towed vehicle 11, it sets the driving handover request threshold value when the towing of the towed vehicle 11 is detected to a larger value than the driving handover request threshold value when the towing of the towed vehicle 11 is not detected. For example, the determination unit 33 sets the driving handover request threshold value when the towing of the towed vehicle 11 is not detected to 0.1 m to 0.2 m, and sets the driving handover request threshold value when the towing of the towed vehicle 11 is detected to 0.2 m to 0.3 m. By setting the driving handover request threshold value in this way, even when the vehicle 10 is towing the towed vehicle 11, the determination unit 33 can transfer the driving control to the driver before the vehicle 10 gets too close to the lane dividing line.
[0064] FIG. 5(a) and FIG. 5(b) are diagrams showing an example of the relationship between the driving handover request threshold value when the towing of the towed vehicle 11 is not detected and the driving handover request threshold value when the towing of the towed vehicle 11 is detected. In the example shown in FIG. 5(a), the towing of the towed vehicle 11 is not detected. On the other hand, in the example shown in FIG. 5(b), the towing of the towed vehicle 11 is detected.
[0065] As shown in FIG. 5(a), when the towing of the towed vehicle 11 is not detected, the first value TDTh1 is used as the driving handover request threshold value. Therefore, when the towing of the towed vehicle 11 is not detected, when the lateral distance L between either the left or right lane dividing line 501 and the vehicle 10 becomes less than the driving handover request threshold value TDTh1, it is determined that the participation request condition is satisfied, and a driving handover request is notified.
[0066] On the other hand, as shown in FIG. 5(b), when the towing of the towed vehicle 11 is detected, the second value TDTh2 is used as the driving change request threshold. Therefore, when the towing of the towed vehicle 11 is detected, if the lateral distance L between the vehicle 10 and any one of the left and right lane dividing lines 501 becomes less than the driving change request threshold TDTh2, it is determined that the participation request condition is satisfied, and a driving change request is notified. Also, the second value TDTh2 is set to a value larger than the first value TDTh1. Therefore, it is easier for the participation request condition to be satisfied when the towing of the towed vehicle 11 is detected than when the towing of the towed vehicle 11 is not detected. Therefore, even when the vehicle 10 is towing the towed vehicle 11, a driving change request will be notified before the vehicle 10 gets too close to the lane dividing line 501.
[0067] When the notification processing unit 34 receives from the determination unit 33 a determination result that the participation request condition is satisfied, it notifies the driver of a request corresponding to the satisfied participation request condition via the notification device 7.
[0068] As described above, when it is determined that the lateral distance has become less than the hands-on request threshold, the notification processing unit 34 notifies the driver of a hands-on request via the notification device 7. Also, when it is determined that the lateral distance has become less than the driving change request threshold, the notification processing unit 34 notifies the driver of a driving change request via the notification device 7.
[0069] FIG. 6 is an operation flowchart of vehicle control processing regarding the change in the degree of driver's driving participation according to the first embodiment. The processor 23 may execute vehicle control processing according to the following operation flowchart at a predetermined cycle.
[0070] The towing detection unit 31 of the processor 23 determines whether or not it has detected the towing of the towed vehicle 11 by the vehicle 10 (step S101).
[0071] When the towing of the towed vehicle 11 is not detected (step S101 - No), the determination unit 33 of the processor 23 sets the participation request conditions relatively strictly (step S102). On the other hand, when the towing of the towed vehicle 11 is detected (step S101 - Yes), the determination unit 33 sets the participation request conditions relatively loosely (step S103).
[0072] The determination unit 33 determines whether the set participation request conditions are satisfied (step S104). When the participation request conditions are satisfied (step S104 - Yes), the notification processing unit 34 of the processor 23 notifies the driver, via the notification device 7, of the request regarding participation in driving corresponding to the satisfied participation request conditions (step S105).
[0073] If the participation request conditions are not satisfied in step S104 (step S104 - No), or after step S105, the processor 23 ends the vehicle control process.
[0074] As described above, this vehicle control device determines whether participation request conditions for requesting the driver of the vehicle to participate in driving are satisfied, and when it is determined that the participation request conditions are satisfied, it notifies the request for participation in driving via a notification device provided in the vehicle interior. And this vehicle control device relaxes the participation request conditions when the towing of the towed vehicle is detected compared to the participation request conditions when the towing of the towed vehicle is not detected. Therefore, when the towing of the towed vehicle is detected, it becomes easier for the participation request conditions to be satisfied. Thus, even when the vehicle is towing a towed vehicle, this vehicle control device can request the driver to participate in driving before the vehicle falls into an unstable situation. As a result, this vehicle control device can appropriately set the timing to increase the degree of the driver's participation in driving of a vehicle that is towing a towed vehicle and to which automatic driving control is applied.
[0075] According to a modification example, when the towing of the towed vehicle 11 is detected, the determination unit 33 may adjust the hands-on request threshold value or the driving change request threshold value according to the weight of the towed vehicle 11. For example, the determination unit 33 may increase the hands-on request threshold value or the driving change request threshold value as the weight of the towed vehicle 11 estimated by the towing detection unit 31 is larger. At this time, as the estimated weight of the towed vehicle 11 increases, the hands-on request threshold value or the driving change request threshold value may also increase continuously. Alternatively, the hands-on request threshold value or the driving change request threshold value may be set step by step. In this case, each time the estimated weight of the towed vehicle 11 increases by a predetermined value, the determination unit 33 increases the hands-on request threshold value or the driving change request threshold value by a predetermined step amount.
[0076] Similarly, when the towing of the towed vehicle 11 is detected, the determination unit 33 may adjust the hands-on request threshold value or the driving change request threshold value according to the volume of the towed vehicle 11. For example, the determination unit 33 may increase the hands-on request threshold value or the driving change request threshold value as the volume of the towed vehicle 11 estimated by the towing detection unit 31 is larger. In this case, the information representing the volume of the towed vehicle 11 may be stored in the memory 22 in advance.
[0077] In this way, by adjusting the hands-on request threshold value or the driving change request threshold value according to the weight or volume of the towed vehicle 11, the determination unit 33 can request the driver to participate in driving at a more appropriate timing before the vehicle 10 gets too close to the lane dividing line.
[0078] Furthermore, when the towing of the towed vehicle 11 is detected, the determination unit 33 may adjust the hands-on request threshold or the driving change request threshold according to the type of load carried on the towed vehicle 11. For example, when the type of load carried on the towed vehicle 11 is an item that requires special handling, such as precision machinery or fragile items, which are relatively vulnerable to vibration or impact, the hands-on request threshold in this case may be set larger than the hands-on request threshold when the type of load is not an item that requires special handling. Similarly, the determination unit 33 may set the driving change request threshold when the type of load carried on the towed vehicle 11 is an item that requires special handling to be larger than the driving change request threshold when the type of load is not an item that requires special handling. Note that the information indicating the type of load on the towed vehicle 11 is input via a user interface provided in the passenger compartment of the vehicle 10 and stored in the memory 22. The determination unit 33 may determine the type of load on the towed vehicle 11 by referring to this information.
[0079] Furthermore, when the towing of the towed vehicle 11 is detected, the lower the certainty of the lane dividing line that demarcates the own lane detected, the determination unit 33 may increase the hands-on request threshold or the driving change request threshold. In this case, the determination unit 33 may use the reliability of the lane dividing line output by the identifier used for detecting the lane dividing line as the above-mentioned certainty.
[0080] According to another modification, instead of the lateral distance, the determination unit 33 may determine whether the participation request condition is satisfied based on the behavior of the vehicle 10, the state of the driver, or the situation around the vehicle 10. Also in this case, it is preferable that the determination unit 33 relaxes the participation request condition when the towing of the towed vehicle 11 is detected compared to the participation request condition when the towing of the towed vehicle 11 is not detected. By thus relaxing the participation request condition when the towing of the towed vehicle 11 is detected, the determination unit 33 can request the driver to participate in driving before the vehicle 10 falls into an unstable situation due to the behavior of the vehicle 10, the state of the driver, or the situation around the vehicle 10 even when the vehicle 10 is towing the towed vehicle 11.
[0081] For example, when the speed of the vehicle 10 measured by a speed sensor, which is an example of the behavior sensor 5, is equal to or higher than a predetermined speed threshold than the speed limit of the road on which the vehicle 10 is currently traveling, the determination unit 33 determines that the participation requirement condition is satisfied. Then, the notification processing unit 34 notifies the driver of a hands-on requirement via the notification device 7. In this case, the determination unit 33 sets the speed threshold when the towing of the towed vehicle 11 is detected to a value lower than the speed threshold when the towing of the towed vehicle 11 is not detected. Thereby, the determination unit 33 can appropriately request the driver to participate in driving when the speed of the vehicle 10 exceeds the speed limit. Note that the determination unit 33 refers to the high-precision map and identifies the road including the position of the vehicle 10 represented by the latest positioning information by the GPS receiver 4 as the road on which the vehicle 10 is traveling. Then, the determination unit 33 may refer to the high-precision map and identify the speed limit of the road on which the vehicle 10 is traveling. Alternatively, the determination unit 33 may identify the speed limit of the road on which the vehicle 10 is traveling by inputting the image generated by the camera 2 into an identifier that has been pre-learned to detect the speed limit represented by the speed sign. The determination unit 33 can use, as such an identifier, the same identifier as the identifier used for detecting features described in the control unit 32.
[0082] Also, when the vehicle 10 is traveling in a section where the speed limit is less than a predetermined speed, the determination unit 33 determines that the participation requirement condition is satisfied. Then, the notification processing unit 34 notifies the driver of a hands-on requirement via the notification device 7. In this case, the determination unit 33 sets the predetermined speed when the towing of the towed vehicle 11 is detected to a value higher than the predetermined speed when the towing of the towed vehicle 11 is not detected. Thereby, the determination unit 33 can appropriately request the driver to participate in driving when the speed limit of the road on which the vehicle 10 is traveling is low and more careful control of the vehicle 10 is required.
[0083] Alternatively, the determination unit 33 determines that the participation requirement condition is satisfied when the radius of curvature of a curve located within the section where the vehicle 10 is traveling or up to a predetermined distance (for example, several hundred meters to 1 km) ahead is less than a predetermined radius-of-curvature threshold value. When the radius of curvature of the curve is less than the predetermined radius-of-curvature threshold value, the notification processing unit 34 notifies the driver of a hands-on request via the notification device 7. Alternatively, the notification processing unit 34 may notify the driver of a driving change request via the notification device 7. In this case, the determination unit 33 sets the radius-of-curvature threshold value in the case where the towing of the towed vehicle 11 is detected to a value larger than the radius-of-curvature threshold value in the case where the towing of the towed vehicle 11 is not detected. Thereby, the determination unit 33 can appropriately request the driver's involvement in driving according to the radius of curvature of the curve on which the vehicle 10 is traveling or is about to travel. Note that, similar to the above, the determination unit 33 may specify, with reference to the high-precision map, the road including the position of the vehicle 10 represented by the latest positioning information from the GPS receiver 4 as the road on which the vehicle 10 is traveling. Further, the determination unit 33 may specify the radius of curvature of a curve included in the section from the current position of the vehicle 10 to a predetermined distance ahead on the road on which the vehicle 10 is traveling, with reference to the traveling direction of the vehicle 10 indicated by an azimuth sensor (not shown) mounted on the vehicle 10 and the high-precision map being used for travel control.
[0084] Alternatively, when the vehicle is in motion or the slope of the road in the section up to a predetermined distance ahead is equal to or greater than a predetermined slope threshold value, the determination unit 33 determines that the participation requirement condition is satisfied. Then, the notification processing unit 34 notifies the driver of a hands-on requirement via the notification device 7. Alternatively, the notification processing unit 34 may notify the driver of a driving change requirement via the notification device 7. In this case, the determination unit 33 sets the slope threshold value in the case where the towing of the towed vehicle 11 is detected to a value smaller than the slope threshold value in the case where the towing of the towed vehicle 11 is not detected. Thereby, the determination unit 33 can appropriately request the driver's participation in driving according to the slope of the road section on which the vehicle 10 is traveling or is scheduled to travel. Note that, similar to the above, the determination unit 33 may specify, with reference to the high-precision map, the road including the position of the vehicle 10 represented by the latest positioning information by the GPS receiver 4 as the road on which the vehicle 10 is traveling. Further, the determination unit 33 may specify the traveling direction of the vehicle 10 indicated by an azimuth sensor (not shown) mounted on the vehicle 10 and the slope in the section from the current position of the vehicle 10 to a predetermined distance ahead on the road on which the vehicle 10 is traveling with reference to the high-precision map.
[0085] Alternatively, when the non-holding period during which the driver does not hold the steering wheel continues for a period equal to or longer than a predetermined non-holding period threshold value, the determination unit 33 determines that the participation requirement condition is satisfied. Then, the notification processing unit 34 notifies the driver of a hands-on requirement via the notification device 7. In this case, the non-holding period threshold value in the case where the towing of the towed vehicle 11 is detected is set to a value smaller than the non-holding period threshold value in the case where the towing of the towed vehicle 11 is not detected. Note that the determination unit 33 may set the elapsed time since the ECU 9 last received a signal indicating that the steering wheel is being held from a touch sensor provided on the steering wheel as the non-holding period.
[0086] Alternatively, when the period during which the driver ignores any of the face loss warning, sidelong glance warning, eyes-closed warning, or hand-release warning made via the notification device 7 continues for a predetermined time threshold or longer, the determination unit 33 determines that the participation request condition is satisfied. Then, the notification processing unit 34 notifies the driver of a hands-on request via the notification device 7. In this case, the time threshold when the towing of the towed vehicle 11 is detected is set to a value smaller than the time threshold when the towing of the towed vehicle 11 is not detected.
[0087] Note that the determination unit 33 determines whether or not a face region representing the driver's face can be detected on the driver image by inputting the driver image generated by the driver monitoring camera 3 into an identifier that has been pre-learned to detect the driver's face. The determination unit 33 can use, as such an identifier, the same identifier as the identifier used by the control unit 32 for detecting ground features. When the face region is not detected, the determination unit 33 determines that it is a face loss state in which the driver's face cannot be detected. When the face loss state continues for a predetermined period, the determination unit 33 notifies the driver of a face loss warning via the notification device 7. If the driver's face is detected from the driver image generated after the notification of the face loss warning, or if the driver performs a response operation corresponding to the face loss warning provided in the passenger compartment, the determination unit 33 determines that the driver has responded to the face loss warning. On the other hand, if the driver's face is not detected from the driver image even after the notification of the face loss warning and no response operation to the face loss warning is performed, the determination unit 33 may determine that the driver has ignored the face loss warning. The response operation may be performed, for example, by operating a predetermined switch provided in the passenger compartment or by the driver making a predetermined utterance. The voice uttered by the driver is collected by a speaker provided in the passenger compartment and output as a voice signal to the ECU 9. The processor 23 may determine whether or not the driver has made a predetermined utterance by performing predetermined voice recognition processing such as GMM-HMM or DNN-HMM on the voice signal.
[0088] Further, the determination unit 33 determines the orientation of the driver's face by matching the face region with a three-dimensional face model. When the orientation of the driver's face deviates from a predetermined angular range centered on the traveling direction of the vehicle 10, the determination unit 33 determines that the driver is in a side-looking state of looking sideways. Alternatively, the determination unit 33 may detect the line-of-sight direction of the driver and, when the detected line-of-sight direction deviates from the above angular range, determine that it is a side-looking state. In this case, the determination unit 33 applies an edge detection filter to the face region to detect edges continuous in the horizontal direction, or inputs the face region into a discriminator to detect the upper and lower eyelids of either the left or right eye of the driver. Further, the determination unit 33 performs template matching on the region surrounded by the upper and lower eyelids to detect the pupil center of gravity and the corneal reflection image of the light source. Then, the determination unit 33 may detect the line-of-sight direction based on the positional relationship between the pupil center of gravity and the corneal reflection image of the light source. When the side-looking state continues for a predetermined period, the determination unit 33 notifies the driver of a side-looking warning via the notification device 7. When the orientation of the driver's face or the line-of-sight direction detected after the notification of the side-looking warning is included in the above angular range, that is, when the side-looking state is resolved, the determination unit 33 determines that the driver has responded to the side-looking warning. On the other hand, if the side-looking state is not resolved even after the notification of the side-looking warning, the determination unit 33 may determine that the driver has ignored the side-looking warning.
[0089] Furthermore, the determination unit 33 calculates the ratio of the detected distance between the upper eyelid and the lower eyelid to the reference distance between the upper eyelid and the lower eyelid when the driver has the eyes fully open as the degree of eye closure. The reference distance is pre-stored in the memory 22. And when the degree of eye closure is equal to or less than a predetermined eye closure threshold value, the determination unit 33 determines that the driver is in a closed-eye state with the eyes closed. When the closed-eye state continues for a predetermined period, the determination unit 33 notifies the driver of a closed-eye warning via the notification device 7. When the degree of eye closure of the driver detected after the notification of the closed-eye warning becomes greater than the eye closure threshold value, that is, when the closed-eye state is resolved, the determination unit 33 determines that the driver has responded to the closed-eye warning. On the other hand, if the closed-eye state is not resolved even after the notification of the closed-eye warning, the determination unit 33 may determine that the driver has ignored the closed-eye warning.
[0090] Also, when the ECU 9 receives a signal indicating that the steering wheel is not being held from a touch sensor provided on the steering wheel, the determination unit 33 determines that the driver is in a released state where the steering wheel is not being held. And when the released state continues for a predetermined time or more in a state where the ECU 9 is performing automatic driving control of the vehicle 10 at a level where holding of the steering wheel by the driver is required, the determination unit 33 notifies the driver of a released warning via the notification device 7. When the ECU 9 receives a signal indicating that the steering wheel is being held from the touch sensor after the notification of the released warning, the determination unit 33 determines that the released state has been resolved. On the other hand, if the ECU 9 does not receive a signal indicating that the steering wheel is being held from the touch sensor even after the notification of the released warning, the determination unit 33 may determine that the driver has ignored the released warning.
[0091] The determination unit 33 may determine whether all of the participation requirement conditions in the above-described embodiment or modification are satisfied, or may determine whether any one or two or more of those participation requirement conditions are satisfied.
[0092] (Second Embodiment) Next, a second embodiment will be described. In the second embodiment, after the processor 23 starts the lane change process for the vehicle 10, the interruption condition as to whether or not to interrupt the lane change process is changed according to whether or not the vehicle 10 is towing a towed vehicle.
[0093] FIG. 7 is a functional block diagram of the processor 23 regarding the vehicle control process according to the second embodiment. The processor 23 includes a towing detection unit 31, a lane change determination unit 35, an other vehicle detection unit 36, a lane change control unit 37, a determination unit 38, and an interruption instruction unit 39. Each of these units included in the processor 23 is, for example, a functional module realized by a computer program operating on the processor 23. Alternatively, each of these units included in the processor 23 may be a dedicated arithmetic circuit provided in the processor 23. Also, for those performing the same processing in the first embodiment and the second embodiment, the same reference numerals are assigned in the first embodiment and the second embodiment. Further, for the details of those corresponding among these units in the second embodiment although there are corresponding ones in the first embodiment, refer to the description of the first embodiment.
[0094] The towing detection unit 31 detects, in the same manner as in the first embodiment, that the vehicle 10 is towing the towed vehicle 11. Then, the towing detection unit 31 notifies the lane change control unit 37 and the determination unit 38 of the detection result of the towing.
[0095] The lane change determination unit 35 determines whether or not a predetermined condition for applying lane change control to the vehicle 10 is satisfied. For example, when the driver operates the turn signal, the lane change determination unit 35 determines that the predetermined condition is satisfied. Then, the lane change determination unit 35 determines to apply lane change control to an adjacent lane adjacent to the direction indicated by the turn signal with respect to the own lane. Alternatively, the lane change determination unit 35 may determine that the predetermined condition is satisfied and determine to apply lane change control when the own lane and the lane leading to the destination of the vehicle 10 are different, when overtaking a preceding vehicle, or when returning from the overtaking lane to the driving lane.
[0096] In order to determine whether the own lane is different from the lane toward the destination of the vehicle 10, the lane change determination unit 35 refers to the driving route to the destination of the vehicle 10, the current position of the vehicle 10, and the high-precision map, which are received by the ECU 9 from a navigation device (not shown). Then, the lane change determination unit 35 determines whether there is a branch point where the lane toward the destination branches from the road on which the vehicle 10 is currently traveling in a section from the current position of the vehicle 10 to a predetermined distance ahead. When there is a branch point, the lane change determination unit 35 determines whether the own lane is different from the lane toward the destination. Then, when the own lane is different from the lane toward the destination, the lane change determination unit 35 determines that lane change control is applied one or more times with the lane toward the destination as the target lane. Note that, as described for the control unit 32 in the first embodiment, the lane change determination unit 35 measures the accurate position of the vehicle 10 by collating the image generated by the camera 2 with the high-precision map, and specifies the lane including the measured position of the vehicle 10 among the lanes represented in the high-precision map as the own lane.
[0097] In addition, when the speed of the vehicle 10 becomes equal to or lower than a predetermined speed threshold value, and a period during which the inter-vehicle distance between the preceding vehicle traveling ahead of the vehicle 10 and the vehicle 10 becomes equal to or shorter than a predetermined distance continues for a predetermined time, the lane change determination unit 35 determines that lane change control is to be applied to overtake the preceding vehicle. Note that the predetermined time can be, for example, several seconds to several tens of seconds. In this case, the lane change determination unit 35 preferably sets an overtaking lane among the lanes adjacent to the own lane as a target lane to be the lane to be changed. The lane change determination unit 35 may identify a surrounding vehicle represented by an object region located within a range corresponding to the front of the vehicle 10 on the image generated by the camera 2 among the surrounding vehicles detected by the other vehicle detection unit 36 as the preceding vehicle. Also, the predetermined speed threshold value is set to a speed obtained by subtracting a predetermined offset value (for example, 10 km / h to 20 km / h) from the legal speed or the speed limit of the road on which the vehicle 10 is traveling. Therefore, the lane change determination unit 35 may set the speed threshold value by identifying the legal speed or the speed limit of the road on which the vehicle 10 is currently traveling with reference to the current position of the vehicle 10 and the high-precision map. Further, the lane change determination unit 35 may obtain the inter-vehicle distance between the vehicle 10 and the preceding vehicle based on the relative positional relationship between the vehicle 10 and the preceding vehicle detected by the other vehicle detection unit 36.
[0098] Furthermore, when the own lane is an overtaking lane and the vehicle 10 has been traveling in the overtaking lane over a recent predetermined period, the lane change determination unit 35 determines that lane change control is to be applied to return the vehicle 10 to the traveling lane. Note that the lane change determination unit 35 may determine whether the own lane is an overtaking lane with reference to the high-precision map. In this case, the lane change determination unit 35 sets any one of the traveling lanes on the road on which the vehicle 10 is traveling as a target lane to be the lane to be changed.
[0099] When the lane change determination unit 35 determines to apply lane change control to the vehicle 10, it notifies the other vehicle detection unit 36, the lane change control unit 37, and the determination unit 38 of the determination result and the direction (right side or left side) of the adjacent lane that is the target to be changed as seen from the road on which the vehicle 10 is traveling.
[0100] The other-vehicle detection unit 36 detects other vehicles (hereinafter referred to as surrounding vehicles for convenience of explanation) traveling around the vehicle 10. Further, the other-vehicle detection unit 36 detects the relative position and relative speed between the surrounding vehicle and the vehicle 10. In particular, the other-vehicle detection unit 36 detects the relative position and relative speed between the vehicle 10 and a surrounding vehicle traveling in an adjacent lane (hereinafter sometimes simply referred to as an adjacent lane) that is the target lane for lane change. For this purpose, the other-vehicle detection unit 36 detects the surrounding vehicle by inputting the image acquired from the camera 2 to the identifier. As such an identifier, the other-vehicle detection unit 36 can use the same identifier as described in the control unit 32 in the first embodiment. The identifier outputs information for specifying an object region including the detected surrounding vehicle on the input image and information representing the vehicle type of the detected surrounding vehicle (for example, a passenger car, a large vehicle, a two-wheeled vehicle, etc.).
[0101] When there is a detected surrounding vehicle, the other-vehicle detection unit 36 determines whether the surrounding vehicle is traveling in the adjacent lane. Here, it is assumed that the position of the lower end of the object region including the surrounding vehicle represents the position where the surrounding vehicle is in contact with the road surface. Also, as described above, the position on the image corresponds one-to-one with the azimuth seen from the camera that generated the image. Therefore, the other-vehicle detection unit 36 can estimate the distance from the camera 2 to the surrounding vehicle and the azimuth from the vehicle 10 to the surrounding vehicle by referring to the position of the lower end of the object region on the image and parameters such as the installation height and shooting direction of the camera 2. Alternatively, the other-vehicle detection unit 36 may estimate the distance from the camera 2 to the surrounding vehicle based on the reference number of pixels on the image when the inter-vehicle distance is the reference distance, which corresponds to the reference vehicle width corresponding to the vehicle type of the surrounding vehicle, and the horizontal width of the object region including the surrounding vehicle.
[0102] Also, when the vehicle 10 is equipped with a ranging sensor (not shown), the other vehicle detection unit 36 may detect surrounding vehicles based on the ranging signal. In this case as well, the other vehicle detection unit 36 may detect surrounding vehicles by inputting the ranging signal into a discriminator that has been pre-trained to detect surrounding vehicles from the ranging signal. As the discriminator for detecting surrounding vehicles from the ranging signal, the other vehicle detection unit 36 can use a DNN having a CNN-type or SAN-type architecture. Alternatively, the other vehicle detection unit 36 may detect surrounding vehicles according to another method for detecting surrounding vehicles from the ranging signal. In this case, the other vehicle detection unit 36 may regard the direction in which a surrounding vehicle is detected on the ranging signal as the direction from the vehicle 10 to the surrounding vehicle. Also, the other vehicle detection unit 36 may regard the distance indicated by the ranging signal for that direction as the estimated distance from the vehicle 10 to the surrounding vehicle.
[0103] Based on the estimated direction and distance, the other vehicle detection unit 36 estimates the distance from the vehicle 10 to the surrounding vehicle along the direction orthogonal to the traveling direction of the vehicle 10 (hereinafter, for convenience of explanation, referred to as the lateral distance between vehicles). When the lateral distance between vehicles is included within a predetermined distance range corresponding to the width of the adjacent lane at the current position of the vehicle 10, and the direction from the vehicle 10 to the surrounding vehicle is the same as the direction of the adjacent lane to which the lane change destination with respect to the own lane, the other vehicle detection unit 36 determines that the surrounding vehicle is traveling in the adjacent lane. Note that the other vehicle detection unit 36 may specify the predetermined distance range at the current position of the vehicle 10 by referring to a high-precision map.
[0104] Alternatively, the other vehicle detection unit 36 may detect lane dividing lines represented in the image together with the surrounding vehicles by inputting the image into a discriminator. In this case, the discriminator is pre-trained so that it can also detect lane dividing lines. Then, the other vehicle detection unit 36 specifies, as the region represented by the adjacent lane in the image, the region sandwiched between two lane dividing lines in order from the one closer to the position of the vehicle 10 in the image in the direction of the merging destination (right or left). When the lower end of the object region representing the surrounding vehicle is included in the region corresponding to the adjacent lane, the other vehicle detection unit 36 may determine that the surrounding vehicle is traveling in the adjacent lane.
[0105] The other vehicle detection unit 36 estimates the relative positions of surrounding vehicles with respect to the vehicle 10 at the time of generating each image or each distance measurement signal by executing the above processing on a series of time-series images generated by the camera 2 or a series of time-series distance measurement signals generated by the distance measurement sensor. Further, the other vehicle detection unit 36 obtains the change in the relative position from the relative positions of the surrounding vehicles with respect to the vehicle 10 at the time of generating individual images or distance measurement signals arranged in time series in a recent fixed period, and estimates the relative speed of the surrounding vehicles with respect to the vehicle 10 based on the change in the relative position.
[0106] When a plurality of surrounding vehicles are detected, the other vehicle detection unit 36 may track individual surrounding vehicles over a series of time-series images or a series of time-series distance measurement signals by applying a predetermined tracking method such as KLT tracking. Then, the other vehicle detection unit 36 may estimate the relative position and relative speed of the surrounding vehicles with respect to the vehicle 10 for each of the surrounding vehicles being tracked.
[0107] The other vehicle detection unit 36 notifies the lane change control unit 37 and the determination unit 38 of the relative position and relative speed of each of the surrounding vehicles determined to be traveling in the adjacent lane of the lane change destination with respect to the vehicle 10.
[0108] When the lane change control unit 37 is notified of the determination result that lane change control is to be applied to the vehicle 10 from the lane change determination unit 35, the lane change control unit 37 executes lane change control to cause the vehicle 10 to enter the adjacent lane. Further, before the lane change control is completed, when the lane change control unit 37 is instructed to interrupt the lane change control from the interruption instruction unit 39, the lane change control unit 37 interrupts the execution of the lane change control. Then, the lane change control unit 37 controls each part of the vehicle 10 so that the vehicle 10 continues to travel in its own lane.
[0109] When the lane change control unit 37 starts executing the lane change control, it sets a planned travel route for the vehicle 10 to move from its own lane to an adjacent lane. After setting the planned travel route, the lane change control unit 37 controls each part of the vehicle 10 so that the vehicle 10 travels along the planned travel route. To do so, the lane change control unit 37 measures the position of the vehicle 10 at a predetermined cycle, and compares the measured position of the vehicle 10 with the planned travel route. Note that, as described for the control unit 32 in the first embodiment, the lane change control unit 37 may measure the accurate position of the vehicle 10 by collating the image obtained by the camera 2 with the high-precision map. And if the measured position of the vehicle 10 is on the planned travel route, the lane change control unit 37 determines the steering angle of the vehicle 10 so that the vehicle 10 advances along the planned travel route, and controls the steering of the vehicle 10 so that it becomes the determined steering angle. Also, if the measured position of the vehicle 10 is away from the planned travel route, the lane change control unit 37 determines the steering angle of the vehicle 10 so that the vehicle 10 approaches the planned travel route, and controls the steering of the vehicle 10 so that it becomes the determined steering angle.
[0110] Furthermore, when there are surrounding vehicles traveling in front of or to the side of the vehicle 10 in the adjacent lane, the lane change control unit 37 sets the acceleration and deceleration of the vehicle 10 so that the distance between the surrounding vehicle and the vehicle 10 becomes equal to or greater than a predetermined distance threshold when the vehicle 10 enters the adjacent lane. At that time, the lane change control unit 37 refers to the relative position and relative speed with the surrounding vehicle detected by the other vehicle detection unit 36. And if the distance between the vehicle 10 and the surrounding vehicle in the traveling direction of the vehicle 10, which is obtained from the relative position between the vehicle 10 and the surrounding vehicle, is less than the distance threshold, the lane change control unit 37 decelerates based on the relative speed so that the speed of the vehicle 10 becomes lower than the speed of the surrounding vehicle. Also, if the distance between the vehicle 10 and the surrounding vehicle in the traveling direction of the vehicle 10 is equal to or greater than the distance threshold, the lane change control unit 37 may set the acceleration and deceleration based on the relative speed so that the speed of the vehicle 10 becomes the same as or lower than the speed of the surrounding vehicle.
[0111] The lane change control unit 37 sets the accelerator opening or the brake amount according to the set acceleration and deceleration. The lane change control unit 37 obtains the fuel injection amount according to the set accelerator opening, and outputs a control signal corresponding to the fuel injection amount to the fuel injection device of the engine of the vehicle 10. Alternatively, the lane change control unit 37 obtains the amount of electric power supplied to the motor according to the set accelerator opening, and controls the drive circuit of the motor so that the amount of electric power is supplied to the motor. Alternatively, the lane change control unit 37 outputs a control signal corresponding to the set brake amount to the brake of the vehicle 10.
[0112] When the vehicle 10 starts to travel completely in the adjacent lane, the lane change control unit 37 ends the lane change control. At this time, the lane change control unit 37 may determine whether the entire vehicle 10 is included in the adjacent lane by referring to the position of the vehicle 10 measured as described above and the high-precision map, or by referring to two lane dividing lines that demarcate the adjacent lane detected from the image. When the entire vehicle 10 is included in the adjacent lane, the lane change control unit 37 determines that the vehicle 10 has started to travel completely in the adjacent lane.
[0113] During the period when the lane change control unit 37 is executing the lane change control, the determination unit 38 determines whether at least one of the relative position and the relative speed between the vehicle 10 and the surrounding vehicle traveling in the adjacent lane of the lane change destination detected by the other vehicle detection unit 36 satisfies a predetermined interruption condition.
[0114] For example, the determination unit 38 obtains the inter-vehicle distance between the host vehicle 10 and a surrounding vehicle traveling behind the host vehicle 10 in an adjacent lane based on the relative position between the surrounding vehicle and the host vehicle 10. Then, when the inter-vehicle distance becomes less than a predetermined distance threshold, the determination unit 38 determines that the interruption condition is satisfied. Further, the determination unit 38 may apply prediction processing such as a Kalman Filter to the change in the relative position between the surrounding vehicle and the host vehicle 10 in the most recent predetermined period, thereby predicting the inter-vehicle distance between the surrounding vehicle and the host vehicle 10 up to a predetermined time in the future. Then, when the inter-vehicle distance between the surrounding vehicle and the host vehicle 10 becomes less than the distance threshold at any of the predicted times, the determination unit 38 may determine that the interruption condition is satisfied. Note that the interruption condition may be set as a combination of the inter-vehicle distance and the relative speed between the surrounding vehicle and the host vehicle 10. For example, the distance threshold may be set to be smaller as the speed of the surrounding vehicle is faster than the speed of the host vehicle 10 and the relative speed between the surrounding vehicle and the host vehicle 10 is larger. Furthermore, when the speed of a surrounding vehicle traveling behind the host vehicle 10 in the adjacent lane is faster than the speed of the host vehicle 10 and the relative speed between the surrounding vehicle and the host vehicle 10 is larger than a predetermined speed threshold, the determination unit 38 may determine that the interruption condition is satisfied regardless of the inter-vehicle distance between the surrounding vehicle and the host vehicle 10. Furthermore, the determination unit 38 may obtain the predicted time until the surrounding vehicle and the host vehicle 10 collide based on the prediction result of the inter-vehicle distance between the surrounding vehicle and the host vehicle 10. Then, when the predicted time becomes less than or equal to a predetermined time threshold, the determination unit 38 may determine that the interruption condition is satisfied.
[0115] Note that when there are a plurality of surrounding vehicles traveling behind the host vehicle 10 in the adjacent lane, the determination unit 38 may determine whether the interruption condition is satisfied by performing the above-described processing on the surrounding vehicle closest to the host vehicle 10.
[0116] Also, during the execution of the lane change control, the inter-vehicle distance between the vehicle 10 and its surrounding vehicles may rapidly decrease due to a sudden deceleration of a surrounding vehicle traveling ahead of the vehicle 10. Therefore, the determination unit 38 may determine whether or not the interruption condition is satisfied for the surrounding vehicles traveling ahead of the vehicle 10 in the same manner as described above. However, regarding the condition related to the relative speed, unlike the condition for the subsequent surrounding vehicles, the determination unit 38 may determine that the interruption condition is satisfied when the relative speed of the surrounding vehicle with respect to the vehicle 10 is lower than a predetermined speed threshold. Also, the interruption condition for the surrounding vehicle traveling ahead of the vehicle 10 and the interruption condition for the surrounding vehicle traveling behind the vehicle 10 may be set separately.
[0117] In the present embodiment, the determination unit 38 relaxes the interruption condition when it is detected that the vehicle 10 is towing the towed vehicle 11 compared to the interruption condition when it is not detected that the vehicle 10 is towing the towed vehicle 11. For example, as described above, when the interruption condition is that the inter-vehicle distance between the vehicle 10 and the surrounding vehicle becomes shorter than the distance threshold, the determination unit 38 sets the distance threshold when it is detected that the vehicle 10 is towing the towed vehicle 11 to be larger than the distance threshold when it is not detected that the vehicle 10 is towing the towed vehicle 11. Also, when the interruption condition is that the relative speed of the surrounding vehicle with respect to the vehicle 10 becomes larger than the speed threshold, the determination unit 38 sets the speed threshold when it is detected that the vehicle 10 is towing the towed vehicle 11 to be smaller than the speed threshold when it is not detected that the vehicle 10 is towing the towed vehicle 11. Further, when the interruption condition is that the predicted time until the vehicle 10 and the surrounding vehicle collide becomes equal to or less than the time threshold, the determination unit 38 sets the time threshold when it is detected that the vehicle 10 is towing the towed vehicle 11 to be larger than the time threshold when it is not detected that the vehicle 10 is towing the towed vehicle 11.
[0118] FIG. 8 is a diagram showing the relationship between the presence or absence of detection of the towing of the towed vehicle 11 and a time threshold which is an example of an interruption condition. In FIG. 8, the horizontal axis represents time, and the vertical axis represents the predicted time to collision (TTC) until the vehicle 10 collides with surrounding vehicles. And the chart 800 represents the change in TTC over time. In this example, it is assumed that surrounding vehicles gradually approach the vehicle 10, and as a result, the TTC becomes shorter as time elapses.
[0119] As shown in FIG. 8, the time threshold Thp when the towing of the towed vehicle 11 is detected is set to a value larger than the time threshold Thn when the towing of the towed vehicle 11 is not detected. Therefore, the timing t1 when the TTC becomes equal to or less than the time threshold Thp is earlier than the timing t2 when the TTC becomes equal to or less than the time threshold Thn. Therefore, the lane change control is interrupted earlier when the towing of the towed vehicle 11 is detected than when it is not detected. Thus, the vehicle control device according to the present embodiment can interrupt the lane change control at a timing earlier by the amount of dullness of the behavior of the vehicle 10 due to the towing of the towed vehicle 11. Therefore, this vehicle control device can appropriately set the timing at which the lane change control is interrupted so as to reduce the possibility of contact between the surrounding vehicles and the vehicle 10 when the towed vehicle 11 is being towed.
[0120] When the determination unit 38 determines that the interruption condition is satisfied, it notifies the determination result to the interruption instruction unit 39.
[0121] When the interruption instruction unit 39 receives the determination result from the determination unit 38 that the interruption condition is satisfied, it notifies the lane change control unit 37 of an instruction to interrupt the lane change control.
[0122] FIG. 9 is an operation flowchart of vehicle control processing according to the second embodiment. When the lane change determination unit 35 determines to apply lane change control, the processor 23 executes vehicle control processing related to lane change control according to the following operation flowchart.
[0123] The towing detection unit 31 of the processor 23 determines whether or not it has detected the towing of the towed vehicle 11 by the vehicle 10 (step S201).
[0124] When the towing of the towed vehicle 11 is not detected (step S201 - No), the determination unit 38 of the processor 23 sets the interruption condition relatively strictly (step S202). On the other hand, when the towing of the towed vehicle 11 is detected (step S201 - Yes), the determination unit 38 sets the interruption condition relatively loosely (step S203).
[0125] The determination unit 38 of the processor 23 determines whether or not the interruption condition has been satisfied while the lane change control unit 37 of the processor 23 is executing lane change control for the vehicle 10 (step S204). If the interruption condition is not satisfied (step S204 - No), the lane change control unit 37 determines whether or not the movement of the vehicle 10 to the adjacent lane of the change destination has been completed (step S205). If the movement of the vehicle 10 to the adjacent lane has been completed (step S205 - Yes), the processor 23 ends the vehicle control process related to the lane change control. On the other hand, if the movement of the vehicle 10 to the adjacent lane has not been completed (step S205 - No), the processor 23 repeats the processes after step S204.
[0126] In step S204, when the interruption condition is satisfied (step S204 - Yes), the lane change control unit 37 interrupts the lane change control and controls the vehicle 10 to continue traveling in its own lane (step S206). After that, the processor 23 ends the vehicle control process related to the lane change control.
[0127] As described above, the vehicle control device according to the second embodiment relaxes the interruption condition of the lane change control when the towing of the towed vehicle is detected compared to the interruption condition of the lane change control when the towing of the towed vehicle is not detected. Therefore, this vehicle control device can interrupt the lane change control earlier by the amount of the sluggishness of the vehicle behavior due to towing, so that it is possible to appropriately set the timing of interrupting the lane change control so as to reduce the possibility of contact between the surrounding vehicles and the vehicle when towing the towed vehicle.
[0128] According to a modification example, similar to the modification example of the first embodiment, interruption conditions may be set for each situation around the vehicle 10. For example, separate interruption conditions may be set depending on whether the surrounding vehicle traveling in the adjacent lane of the destination is a large vehicle or other vehicles. However, even in this case, the determination unit 38 relaxes the interruption condition when it is detected that the vehicle 10 is towing the towed vehicle 11 compared to the interruption condition when it is not detected that the vehicle 10 is towing the towed vehicle 11, regardless of the type of the surrounding vehicle. Then, the determination unit 38 may determine whether to interrupt the lane change control based on the interruption condition corresponding to the vehicle type of the surrounding vehicle traveling in the adjacent lane of the destination detected by the other vehicle detection unit 36. When a plurality of surrounding vehicles traveling in the adjacent lane of the destination are detected, the determination unit 38 may use the interruption condition corresponding to the vehicle type of the surrounding vehicle closest to the vehicle 10.
[0129] Similarly, depending on the speed of the vehicle 10 at the time of executing the lane change control, the speed of the surrounding vehicle, the speed of the following vehicle following the vehicle 10, the lane width of the own lane or the adjacent lane, the type of the adjacent lane (overtaking lane, driving lane, etc.), the time zone or weather including the time of executing the lane change control, the interruption condition may be set individually. In this case, similar to the modification example of the first embodiment, the determination unit 38 may specify the interruption condition to be used by referring to the speed of the vehicle 10 measured by the vehicle speed sensor, the high-precision map or weather information, etc. Further, depending on the event that triggered the lane change (lane change for overtaking the preceding vehicle, lane change for moving to the lane towards the destination, etc.), the interruption condition may be set individually. In this case, the determination unit 38 may receive trigger information representing the event that triggered the lane change from the lane change determination unit 35 and select the interruption condition according to the trigger information. However, even in this case, the determination unit 38 relaxes the interruption condition when it is detected that the vehicle 10 is towing the towed vehicle 11 compared to the interruption condition when it is not detected that the vehicle 10 is towing the towed vehicle 11.
[0130] According to this modification example, the determination unit 38 can appropriately set the interruption condition according to not only the presence or absence of towing but also the situation around the vehicle 10.
[0131] Further, the processor 23 may be configured to execute both the vehicle control process according to the first embodiment or its modification example and the vehicle control process according to the second embodiment or its modification example. That is, the processor 23 may have each part shown in FIG. 3 and each part shown in FIG. 7.
[0132] The computer program for realizing the function of the processor 23 of the ECU 9 according to the above embodiment or modification example may be provided in a form recorded on a computer-readable portable recording medium such as a semiconductor memory, a magnetic recording medium, or an optical recording medium.
[0133] As described above, those skilled in the art can make various changes according to the implemented forms within the scope of the present invention.
Explanation of Signs
[0134] 1 Vehicle control system 10 Vehicle 11 Towed vehicle 2 Camera 3 Driver monitoring camera 4 GPS receiver 5 Behavior sensor 6 Wireless communication terminal 7 Notification device 8 Storage device 9 Electronic control unit (ECU) 21 Communication interface 22 Memory 23 Processor 31 Towing detection unit 32 Control unit 33 Determination unit 34 Notification processing unit 35 Lane change determination unit 36 Other vehicle detection unit 37 Lane change control unit 38 Determination unit 39 Interrupt Indicator Unit
Claims
1. When the vehicle is under automatic driving control, a detection unit that detects that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, a determination unit that determines whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied; A notification processing unit that, when it is determined that the participation requirement condition is satisfied, notifies a request for participation in the driving via a notification device provided in the vehicle cabin, The determination unit, Measures a lateral distance between a lane dividing line that demarcates the own lane in which the vehicle is traveling and the vehicle based on the out-of-vehicle sensor signal, and determines that the participation requirement condition is satisfied when the lateral distance becomes equal to or less than a predetermined distance threshold; A vehicle control device that makes the distance threshold in the case where it is detected that the vehicle is towing the towed vehicle larger than the distance threshold in the case where it is not detected that the vehicle is towing the towed vehicle.
2. The determination unit increases the distance threshold in the case where it is detected that the vehicle is towing the towed vehicle as the weight or volume of the towed vehicle is larger, according to the vehicle control device according to claim 1.
3. When the vehicle is under automatic driving control, a detection unit that detects that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, a determination unit that determines whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied; A notification processing unit that, when it is determined that the participation requirement condition is satisfied, notifies a request for participation in the driving via a notification device provided in the vehicle cabin, The determination unit, Determines that the participation requirement condition is satisfied when the speed of the vehicle represented by the vehicle behavior signal is equal to or higher than a predetermined speed threshold than the speed limit of the road on which the vehicle is traveling. A vehicle control device that sets a lower speed threshold value when it is detected that the vehicle is not towing the towed vehicle than when it is detected that the vehicle is towing the towed vehicle.
4. When the vehicle is under automatic driving control, a detection unit that detects that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, a determination unit that determines whether a participation requirement condition for requiring the driver of the vehicle to participate in the driving of the vehicle is satisfied, A notification processing unit that, when it is determined that the participation requirement condition is satisfied, notifies a requirement to participate in the driving via a notification device provided in the vehicle cabin, The determination unit, Determines that the participation requirement condition is satisfied when the speed limit of the road on which the vehicle is traveling is less than a predetermined speed, A vehicle control device that sets a higher predetermined speed when it is detected that the vehicle is towing the towed vehicle than when it is not detected that the vehicle is towing the towed vehicle.
5. When the vehicle is under automatic driving control, a detection unit that detects that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, a determination unit that determines whether a participation requirement condition for requiring the driver of the vehicle to participate in the driving of the vehicle is satisfied, A notification processing unit that, when it is determined that the participation requirement condition is satisfied, notifies a requirement to participate in the driving via a notification device provided in the vehicle cabin, The determination unit, Determines that the participation requirement condition is satisfied when the vehicle is traveling or the radius of curvature of a curve within a section up to a predetermined distance ahead is less than a predetermined radius-of-curvature threshold value. A vehicle control device that sets a larger value for the radius of curvature threshold when it is detected that the vehicle is towing the towed vehicle than the radius of curvature threshold when it is not detected that the vehicle is towing the towed vehicle.
6. When the vehicle is under automatic driving control, a detection unit that detects that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, a determination unit that determines whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, A notification processing unit that, when it is determined that the participation requirement condition is satisfied, notifies a request for participation in the driving via a notification device provided in the vehicle cabin, The determination unit, Determines that the participation requirement condition is satisfied when the vehicle is traveling or the gradient of the road within a section up to a predetermined distance ahead is equal to or greater than a predetermined gradient threshold, A vehicle control device that sets a smaller value for the gradient threshold when it is detected that the vehicle is towing the towed vehicle than the gradient threshold when it is not detected that the vehicle is towing the towed vehicle.
7. When the vehicle is under automatic driving control, it detects that it is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it determines whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation requirement condition is satisfied, it notifies a request for participation in the driving via a notification device provided in the vehicle cabin, The determination of whether the participation requirement condition is satisfied, Measures the lateral distance between the vehicle and the lane dividing line that demarcates the own lane in which the vehicle is traveling based on the out-of-vehicle sensor signal, and determines that the participation requirement condition is satisfied when the lateral distance becomes equal to or less than a predetermined distance threshold. When it is detected that the vehicle is towing the towed vehicle, make the distance threshold greater than the distance threshold when it is not detected that the vehicle is towing the towed vehicle. A vehicle control method including this.
8. When the vehicle is under automatic driving control, detect that it is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, determine whether a participation requirement condition for requiring the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation requirement condition is satisfied, notify the requirement to participate in the driving via a notification device provided in the vehicle cabin, The determination of whether the participation requirement condition is satisfied is Determine that the participation requirement condition is satisfied when the speed of the vehicle represented by the vehicle behavior signal is faster than a predetermined speed threshold by a predetermined amount or more than the speed limit of the road on which the vehicle is traveling, Set the speed threshold when it is detected that the vehicle is towing the towed vehicle to a lower value than the speed threshold when it is not detected that the vehicle is towing the towed vehicle. A vehicle control method including this.
9. When the vehicle is under automatic driving control, detect that it is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, determine whether a participation requirement condition for requiring the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation requirement condition is satisfied, notify the requirement to participate in the driving via a notification device provided in the vehicle cabin, The determination of whether the participation requirement condition is satisfied is Determine that the participation requirement condition is satisfied when the speed limit of the road on which the vehicle is traveling is less than a predetermined speed. When it is not detected that the vehicle is towing the towed vehicle, set the predetermined speed to a higher value than the predetermined speed when it is detected that the vehicle is towing the towed vehicle. A vehicle control method including this.
10. When the vehicle is under automatic driving control, it is detected that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it is determined whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation requirement condition is satisfied, a request for participation in the driving is notified via a notification device provided in the vehicle cabin, The determination of whether the participation requirement condition is satisfied is It is determined that the participation requirement condition is satisfied when the vehicle is traveling or the radius of curvature of a curve within a section up to a predetermined distance ahead is less than a predetermined radius of curvature threshold value, Set the radius of curvature threshold value when it is detected that the vehicle is towing the towed vehicle to a larger value than the radius of curvature threshold value when it is not detected that the vehicle is towing the towed vehicle. A vehicle control method including this.
11. When the vehicle is under automatic driving control, it is detected that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it is determined whether a participation requirement condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation requirement condition is satisfied, a request for participation in the driving is notified via a notification device provided in the vehicle cabin, The determination of whether the participation requirement condition is satisfied is It is determined that the participation requirement condition is satisfied when the gradient of the road during the vehicle is traveling or within a section up to a predetermined distance ahead is equal to or greater than a predetermined gradient threshold value. When it is detected that the vehicle is not towing the towed vehicle, set the gradient threshold value to a smaller value than the gradient threshold value when it is detected that the vehicle is towing the towed vehicle. A vehicle control method including this.
12. When the vehicle is under automatic driving control, detect that it is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, determine whether a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation request condition is satisfied, notify the request for participation in the driving via a notification device provided in the vehicle cabin. A vehicle control computer program for causing a processor mounted on the vehicle to execute this, The determination of whether the participation request condition is satisfied is Measure the lateral distance between the vehicle and the lane dividing line that divides the own lane in which the vehicle is traveling based on the out-of-vehicle sensor signal, and when the lateral distance is equal to or less than a predetermined distance threshold value, determine that the participation request condition is satisfied. Make the distance threshold value when it is detected that the vehicle is towing the towed vehicle larger than the distance threshold value when it is not detected that the vehicle is towing the towed vehicle. A vehicle control computer program including this.
13. When the vehicle is under automatic driving control, detect that it is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, determine whether a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation request condition is satisfied, notify the request for participation in the driving via a notification device provided in the vehicle cabin. A vehicle control computer program for causing a processor mounted on the vehicle to execute this, The determination of whether the participation request condition is satisfied is When it is determined that the speed of the vehicle represented by the vehicle behavior signal is faster than a predetermined speed threshold by a predetermined amount or more than the speed limit of the road on which the vehicle is traveling, set the speed threshold when it is detected that the vehicle is not towing the towed vehicle to a lower value than the speed threshold when it is detected that the vehicle is towing the towed vehicle. A vehicle control computer program including this.
14. When the vehicle is under automatic driving control, it is detected that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it is determined whether a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation request condition is satisfied, a request for participation in the driving is notified via a notification device provided in the vehicle cabin. A vehicle control computer program for causing a processor mounted on the vehicle to execute this, The determination of whether the participation request condition is satisfied is When the speed limit of the road on which the vehicle is traveling is less than a predetermined speed, it is determined that the participation request condition is satisfied, set the predetermined speed when it is detected that the vehicle is towing the towed vehicle to a higher value than the predetermined speed when it is not detected that the vehicle is towing the towed vehicle. A vehicle control computer program including this.
15. When the vehicle is under automatic driving control, it is detected that the vehicle is towing a towed vehicle, Based on an out-of-vehicle sensor signal generated by an out-of-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, it is determined whether a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied, When it is determined that the participation request condition is satisfied, a request for participation in the driving is notified via a notification device provided in the vehicle cabin. A vehicle control computer program for causing a processor mounted on the vehicle to execute the following: Determining whether the participation request condition is satisfied: Determining that the participation request condition is satisfied when the vehicle is in motion or when the radius of curvature of a curve within a section up to a predetermined distance ahead is less than a predetermined radius-of-curvature threshold; Setting the radius-of-curvature threshold to a larger value when the vehicle is detected to be towing the towed vehicle than when the vehicle is not detected to be towing the towed vehicle. A vehicle control computer program including the above.
16. When the vehicle is under automatic driving control, detecting that the vehicle is towing a towed vehicle, Based on an out-vehicle sensor signal generated by an out-vehicle sensor that detects the situation around the vehicle, an in-vehicle sensor signal generated by an in-vehicle sensor that detects the situation inside the vehicle cabin of the vehicle, a vehicle behavior signal generated by a behavior sensor that detects the behavior of the vehicle, or the position of the vehicle, determining whether a participation request condition for requesting the driver of the vehicle to participate in the driving of the vehicle is satisfied; When it is determined that the participation request condition is satisfied, notifying the request for participation in the driving via a notification device provided inside the vehicle cabin. A vehicle control computer program for causing a processor mounted on the vehicle to execute the following: Determining whether the participation request condition is satisfied: Determining that the participation request condition is satisfied when the vehicle is in motion or when the gradient of the road within a section up to a predetermined distance ahead is equal to or greater than a predetermined gradient threshold; Setting the gradient threshold to a smaller value when the vehicle is detected to be towing the towed vehicle than when the vehicle is not detected to be towing the towed vehicle. A vehicle control computer program including the above.
Citation Information
Patent Citations
Vehicle control system, vehicle control method and vehicle control program
JP2017146653A
Drive support device for traction vehicle
JP2019123299A
Driving assistance device for towing vehicles
JP6951262B2