Control device

The control device adjusts the time for checking surroundings based on lane change direction, addressing the insufficiency in conventional techniques to ensure safe and efficient lane changes.

JP2024165439AActive Publication Date: 2024-11-28HONDA MOTOR CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023081649
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-28
Estimated Expiration
2043-05-17

AI Technical Summary

Technical Problem

Conventional lane changing techniques may not allow sufficient time for the driver to check the vehicle's surroundings, particularly in certain directions, leading to a risk of reduced lane change opportunities.

Method used

A control device that adjusts the time for checking the surroundings based on the direction of lane change, ensuring sufficient time by varying the notification and execution timing of lane change control.

Benefits of technology

Ensures adequate time for checking the surroundings during lane changes in any direction, thereby reducing the decrease in lane change opportunities and enhancing safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165439000001_ABST
    Figure 2024165439000001_ABST
Patent Text Reader

Abstract

To provide a control device capable of sufficiently ensuring a surrounding confirmation time in any direction of a lane change and inhibiting a decrease in opportunity for execution of the lane change.SOLUTION: A control device 100 for a vehicle 1 includes: a recognition unit 111 for recognizing a surrounding situation; a lane change determination unit 113 for determining whether lane change control can be executed, on the basis of the surrounding situation; a travel control unit 130 for executing the lane change control when it is determined that the lane change control can be executed; and a notification control unit 124 for providing notification of a start of the lane change control to an occupant when it is determined that the lane change control can be executed. The travel control unit 130 starts the lane change control after a predetermined time elapses from when the notification by the notification control unit 124 is started. The predetermined time is different depending on a direction of a lane change of the vehicle 1 by the lane change control.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a control device capable of executing lane change control for changing the lane on which a moving object is traveling. [Background technology]

[0002] In recent years, efforts to provide access to sustainable transportation systems that take into consideration vulnerable traffic participants have been gaining momentum. To achieve this, efforts are being focused on research and development to further improve traffic safety and convenience through research and development of driving assistance technology and autonomous driving technology. As an example of driving assistance technology and autonomous driving technology, Patent Documents 1 and 2 disclose Auto Lane Change (ALC) technology that partially or fully automatically controls lane changes of a vehicle.

[0003] In the technology for automobile lane change, a time period (hereinafter also referred to as a surroundings confirmation time) may be provided for the driver to check the surroundings of the vehicle before changing lanes, taking safety into consideration. The autonomous driving system described in Patent Document 1 performs control to delay the actual start timing of the lane change from a reference timing according to the driving environment of the vehicle, and the driver can check the surroundings of the vehicle during the delay time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6576492 [Patent Document 2] Patent No. 5825239 Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional lane change technology, depending on the direction of lane change, the driver may not be able to fully check the surroundings of the vehicle within the surroundings check time. It may be considered to uniformly lengthen the surroundings check time so that the driver can fully check the surroundings of the vehicle regardless of the direction of lane change, but this would reduce the opportunities to execute lane changes.

[0006] The present invention provides a control device that can ensure sufficient time for checking the surroundings in any lane change direction and suppress a decrease in opportunities to change lanes, thereby contributing to the development of a sustainable transportation system. [Means for solving the problem]

[0007] The present invention relates to A control device capable of executing lane change control for changing a lane in which a moving object is traveling, A recognition unit that recognizes a surrounding situation of the moving object; a lane change determination unit that determines whether or not the lane change control can be executed based on the surrounding conditions recognized by the recognition unit; a travel control unit that executes the lane change control when the lane change determination unit determines that the lane change control can be executed; a notification control unit that issues a predetermined notification to a passenger of the moving body via a notification device mounted on the moving body; Equipped with The notification control unit notifies an occupant of the moving body that the lane change control will be started when the lane change determination unit determines that the lane change control can be executed, The traveling control unit starts the lane change control after a predetermined time has elapsed since the notification control unit started to notify the driver, The predetermined time period differs depending on the direction in which the moving object changes lanes due to the lane change control. Effect of the Invention

[0008] According to the present invention, it is possible to ensure sufficient time for checking the surroundings in any direction of lane change, and to suppress a decrease in opportunities to execute lane changes. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 shows a schematic diagram of a vehicle 1 which is an embodiment of a moving object. [Diagram 2] 1 is a block diagram showing an overall configuration of a vehicle system 10 mounted on a vehicle 1. FIG. [Diagram 3] 1 is a diagram illustrating an example of the configuration of a control device 100. FIG. [Figure 4] FIG. 1 shows an example of lane-changing operation of vehicle 1 using lane-changing control, where (A) shows the case where vehicle 1 changes lane to the driver's side, and (B) shows the case where vehicle 1 changes lane to the passenger's side. [Diagram 5] 4 is a flowchart showing an example of a process performed by the control device 100 when the control device 100 executes lane change control. [Figure 6] This is a continuation of the flowchart in Figure 5. [Figure 7] An example of an operation in which the vehicle 1 changes lanes to the driver's seat side when there are many other vehicles M2 traveling around the vehicle 1 on the driver's seat side will be shown. [Figure 8] FIG. 1 is a schematic diagram of a vehicle 1 that is autonomously traveling under fully automated driving with no occupant seated in the driver's seat 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, a control device for a moving body according to an embodiment of the present invention will be described with reference to the accompanying drawings. In this embodiment, the moving body will be described as a four-wheeled vehicle, but it may be a three-wheeled vehicle or the like.

[0011] <Vehicle> 1 is a schematic diagram of a four-wheeled vehicle 1 which is one embodiment of a moving body. The vehicle 1 is, for example, a right-hand drive vehicle, i.e., a driver's seat 2 with a steering wheel 82 provided in front is disposed on the right side. In the vehicle 1, a passenger seat 3 is disposed on the opposite side (i.e., the left side) of the driver's seat 2 in the left-right direction, and a rear seat 4 is disposed behind the driver's seat 2 and the passenger seat 3. Note that the vehicle 1 may be a left-hand drive vehicle, i.e., the driver's seat 2 may be disposed on the left side, and the passenger seat 3 may be disposed on the right side.

[0012] The vehicle 1 is provided with turn signals 5 on both the left side (for example, the front left and rear left) and the right side (for example, the front right and rear right). The turn signals 5 are provided at positions visible from outside the vehicle 1.

[0013] A pair of left and right side mirrors 6 are provided on the sides of the vehicle 1. The side mirrors 6 are provided at positions where an occupant (particularly the driver) of the vehicle 1 can see behind and to the sides of the vehicle 1. The side mirrors 6 are configured so that the angle can be adjusted, for example, by the occupant operating an operating unit (not shown).

[0014] <Overall vehicle system configuration> FIG. 2 is a block diagram showing the overall configuration of a vehicle system 10 mounted on the vehicle 1. As shown in FIG.

[0015] The vehicle system 10 includes, for example, a camera 11, a radar device 12, a LIDAR (Light Detection and Ranging) 14, an object recognition device 16, a communication device 20, an HMI (Human Machine Interface) 30, a vehicle sensor 40, a driver monitor camera 50, a navigation device 60, an MPU (Map Positioning Unit) 70, a driving operator 80, a control device 100, a driving force output device 200, a brake device 210, and a steering device 220. These devices and equipment are connected to each other by multiple communication lines such as a CAN (Controller Area Network) communication line, serial communication lines, a wireless communication network, etc.

[0016] The camera 11 is, for example, a digital camera that uses an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), etc. The camera 11 is attached to the vehicle 1 at a desired position.

[0017] The radar device 12 emits radio waves such as millimeter waves around the vehicle 1 and detects radio waves reflected by an object (reflected waves) to detect at least the position (distance and direction) of the object. The radar device 12 is attached to an arbitrary location of the vehicle 1.

[0018] The LIDAR 14 irradiates light (or electromagnetic waves with a wavelength close to that of light) around the vehicle 1 and measures the scattered light. The LIDAR 14 detects the distance to the target based on the time between emitting and receiving the light. The irradiated light is, for example, a pulsed laser light. The LIDAR 14 is attached to any location on the vehicle 1.

[0019] The object recognition device 16 performs sensor fusion processing on some or all of the detection results of the camera 11, the radar device 12, and the LIDAR 14 to recognize the position, type, speed, etc. of the object. The object recognition device 16 outputs the recognition result to the control device 100. The object recognition device 16 may output the detection results of the camera 11, the radar device 12, and the LIDAR 14 to the control device 100 as they are.

[0020] The communication device 20 communicates with other vehicles in the vicinity of the vehicle 1, for example, using a cellular network, a Wi-Fi (registered trademark) network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), etc., or communicates with various server devices via a wireless base station.

[0021] The HMI 30 presents various information to the occupant of the vehicle 1 and accepts input operations by the occupant. The HMI 30 includes various display devices, a speaker, a buzzer, a touch panel, switches, keys, and the like.

[0022] The vehicle sensor 40 includes a speed sensor that detects the traveling speed (hereinafter also simply referred to as "speed") of the vehicle 1, an acceleration sensor that detects acceleration, a yaw rate sensor that detects the angular velocity around a vertical axis, an orientation sensor that detects the direction of the vehicle 1, and the like.

[0023] The driver monitor camera 50 is, for example, a digital camera using a solid-state imaging element such as a CCD or a CMOS. The driver monitor camera 50 is attached to an arbitrary location on the vehicle 1 in a position and orientation that allows it to capture an image of the head of an occupant (hereinafter also referred to as the "driver") seated in the driver's seat of the vehicle 1 from the front (in an orientation that captures an image of the face). The driver monitor camera 50 may also be attached so as to capture an image of an occupant other than the driver who is riding in the vehicle 1, in addition to the driver.

[0024] The navigation device 60 includes, for example, a Global Navigation Satellite System (GNSS) receiver 61, a navigation HMI 62, and a route determination unit 63. The navigation device 60 holds first map information 64 in a storage device such as a hard disk drive (HDD) or a flash memory.

[0025] The GNSS receiver 61 determines the position of the vehicle 1 based on signals received from GNSS satellites. The position of the vehicle 1 may be determined or supplemented by an Inertial Navigation System (INS) that uses outputs from vehicle sensors 40.

[0026] The navigation HMI 62 includes a display device, a speaker, a touch panel, keys, etc. The navigation HMI 62 may be partially or entirely shared with the HMI 30 described above.

[0027] The route determination unit 63 determines a route (hereinafter also referred to as a "route on the map") from the position of the vehicle 1 specified by the GNSS receiver 61 (or any input position) to a destination input by the occupant using the navigation HMI 62, by referring to the first map information 64. The first map information 64 is, for example, information in which road shapes are expressed by links indicating roads and nodes connected by the links. The first map information 64 may include information such as road curvature and POI (Point Of Interest) information. The route on the map is output to the MPU 70.

[0028] The navigation device 60 may provide route guidance based on the route on the map using the navigation HMI 62. The navigation device 60 may transmit the current position and the destination to a navigation server via the communication device 20, and obtain a route equivalent to the route on the map from the navigation server.

[0029] The MPU 70 includes, for example, a recommended lane determination unit 71, and holds second map information 72 in a storage device such as an HDD or a flash memory. The recommended lane determination unit 71 divides the route on the map provided by the navigation device 60 into a plurality of blocks (for example, divided into 100 m intervals in the vehicle travel direction), and determines a recommended lane for each block by referring to the second map information 72. The recommended lane determination unit 71 determines, for example, which lane from the left the vehicle should travel in. When a branch point is present on the route on the map, the recommended lane determination unit 71 determines a recommended lane so that the vehicle 1 can travel along a reasonable route to proceed to the branch point.

[0030] The second map information 72 is map information with higher accuracy than the first map information 64. The second map information 72 includes, for example, information on the center of lanes or information on boundaries of lanes. The second map information 72 may also include road information, traffic regulation information, address information, facility information, telephone number information, etc. The second map information 72 may be updated as needed by the communication device 20 communicating with another device.

[0031] The driving operators 80 include, for example, an accelerator pedal, a brake pedal, a shift lever, and other operators in addition to a turn signal lever 81 and a steering wheel 82. Sensors are attached to the driving operators 80 to detect the amount of operation or the presence or absence of operation, and the detection results are output to the control device 100 or some or all of the driving force output device 200, the brake device 210, and the steering device 220.

[0032] The winker lever 81 is an operator for turning on (including blinking) or turning off the winker 5. The control device 100 turns on or off the winker 5 in response to an operation on the winker lever 81.

[0033] The steering wheel 82 is an operator that accepts steering operations. The steering wheel 82 does not necessarily have to be annular, and may be in the form of an irregular steering wheel, a joystick, buttons, or the like. A steering grip sensor 84 is attached to the steering wheel 82. The steering grip sensor 84 is realized by a capacitance sensor or the like, and outputs a signal to the control device 100 that can detect whether the driver is gripping the steering wheel 82 or not.

[0034] The control device 100 is a computer that performs overall control of the vehicle 1, and is realized, for example, by a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory of the control device 100. Details of the control device 100 will be described later.

[0035] The driving force output device 200 outputs a driving force (torque) for the vehicle to travel to the driving wheels. The driving force output device 200 includes, for example, a combination of an internal combustion engine, an electric motor, a transmission, etc., and an ECU (Electronic Control Unit) that controls these. The ECU controls the above components according to information input from the control device 100 or information input from the driving operator 80.

[0036] Brake device 210 includes, for example, a brake caliper, a cylinder that transmits hydraulic pressure to the brake caliper, an electric motor that generates hydraulic pressure in the cylinder, and a brake ECU. The brake ECU controls the electric motor according to information input from control device 100 or information input from driving operator 80, so that a brake torque corresponding to a braking operation is output to each wheel.

[0037] The steering device 220 includes, for example, a steering ECU and an electric motor. The electric motor changes the direction of the steered wheels by applying a force to, for example, a rack and pinion mechanism. The steering ECU drives the electric motor in accordance with information input from the control device 100 or information input from the driving operator 80 to change the direction of the steered wheels.

[0038] <Control device> 3 is a diagram showing an example of a configuration of the control device 100. The control device 100 includes a first control unit 110 and a second control unit 120, for example.

[0039] The first control unit 110 includes, for example, a recognition unit 111 and an action plan generation unit 112. The first control unit 110 realizes, for example, a function based on AI (Artificial Intelligence) and a function based on a pre-given model in parallel.

[0040] The recognition unit 111 recognizes the surrounding situation of the vehicle 1 based on information input from the camera 11, the radar device 12, and the LIDAR 14 via the object recognition device 16. Specifically, the recognition unit 111 recognizes the positions of objects (including other vehicles M1 and M2 described later) around the vehicle 1, and the running conditions of the objects, such as their speeds and accelerations.

[0041] The position of the object is recognized as a position on an absolute coordinate system with a representative point (such as the center of gravity or the center of the drive shaft) of the vehicle 1 as the origin, and is used for control. The position of the object may be represented by a representative point such as the center of gravity or a corner of the object, or may be represented by an area.

[0042] The "state" of an object may include the acceleration or jerk of the object, or its "behavioral state" (e.g., whether or not it is changing lanes or about to do so).

[0043] The recognition unit 111 recognizes, for example, the driving environment in which the vehicle 1 is driving. For example, the recognition unit 111 recognizes the driving lane of the vehicle 1 by comparing a pattern of road dividing lines (for example, an arrangement of solid lines and dashed lines) obtained from the second map information 72 with a pattern of road dividing lines around the vehicle 1 recognized from an image captured by the camera 11. Note that the recognition unit 111 may recognize the driving lane by recognizing road boundaries (road boundaries) including not only road dividing lines but also road dividing lines, shoulders, curbs, median strips, guardrails, etc. In this recognition, the position of the vehicle 1 obtained from the navigation device 60 and the processing results by the INS may be taken into consideration. The recognition unit 111 may also recognize stop lines, obstacles, red lights, toll booths, and other road phenomena.

[0044] When recognizing the travel lane, the recognition unit 111 recognizes the position and attitude of the vehicle 1 with respect to the travel lane. For example, the recognition unit 111 may recognize the deviation of the reference point of the vehicle 1 from the center of the lane and the angle with respect to a line connecting the centers of the lanes in the traveling direction of the vehicle 1 as the relative position and attitude of the vehicle 1 with respect to the travel lane. Alternatively, the recognition unit 111 may recognize the position of the reference point of the vehicle 1 with respect to either side end of the travel lane (a road division line or a road boundary) as the relative position of the vehicle 1 with respect to the travel lane.

[0045] The action plan generation unit 112 generates a target trajectory along which the vehicle 1 will travel in the future automatically (i.e., without the driver's operation) so that the vehicle 1 will travel in the recommended lane determined by the recommended lane determination unit 71, and be able to respond to the surrounding conditions of the vehicle 1.

[0046] The target trajectory includes, for example, a speed element. For example, the target trajectory is expressed as a sequence of points (trajectory points) that the vehicle 1 should reach. The trajectory points are points that the vehicle 1 should reach at every predetermined travel distance (for example, about several meters) along a road, and separately, the target speed and target acceleration for every predetermined sampling time (for example, about a few tenths of a second) are generated as part of the target trajectory. The trajectory points may also be positions that the vehicle 1 should reach at the sampling time for each predetermined sampling time. In this case, the information on the target speed and target acceleration is expressed as the intervals between the trajectory points.

[0047] The behavior plan generating unit 112 may set an event for autonomous driving when generating the target trajectory. The autonomous driving events include a constant speed driving event, a low speed following driving event, a lane change event, a branching event, a merging event, a takeover event, etc. The behavior plan generating unit 112 generates a target trajectory according to the activated event.

[0048] For example, the action plan generating unit 112 includes a lane change determining unit 113 as a function for setting a lane change event.

[0049] The lane change determination unit 113 determines whether or not lane change control is executable based on the driving environment of the vehicle 1 recognized by the recognition unit 111. The lane change determination unit 113 determines whether or not lane change control is executable based on the driving environment of the vehicle 1, regardless of, for example, an operation of the driver seated in the driver's seat 2 (for example, an operation of the turn signal lever 81).

[0050] For example, when the distance between the vehicle 1 and another vehicle (also referred to as a leading vehicle) traveling ahead of the vehicle 1 in the traveling lane becomes equal to or less than a predetermined threshold, the lane change determination unit 113 determines whether or not to perform a lane change, which will be described later. In addition, when another vehicle traveling in an adjacent lane adjacent to the traveling lane of the vehicle 1 is detected, the lane change determination unit 113 determines whether or not to execute lane change control, which will be described later, based on, for example, the relative speed and the distance between the vehicle 1 and the detected other vehicle.

[0051] When the lane change determination unit 113 determines that lane change control can be executed, the action plan generation unit 112 sets a lane change event and generates a target trajectory corresponding to the lane change event.

[0052] The second control unit 120 controls the vehicle 1 so that it passes through the target trajectory generated by the action plan generation unit 112 at the scheduled time. The second control unit 120 includes, for example, an acquisition unit 121, a speed control unit 122, a steering control unit 123, and a notification control unit 124.

[0053] The acquisition unit 121 acquires information on the target trajectory (trajectory points) generated by the action plan generation unit 112, and stores it in a memory (not shown).

[0054] The speed control unit 122 controls the traveling driving force output device 200 or the brake device 210 based on the speed element associated with the target trajectory stored in the memory.

[0055] The steering control unit 123 controls the steering device 220 according to the degree of curvature of the target trajectory stored in the memory.

[0056] The processing of the speed control unit 122 and the steering control unit 123 is realized, for example, by a combination of feedforward control and feedback control.

[0057] The notification control unit 124 controls the HMI 30, the navigation HMI 62, etc., and executes various notifications (presents various information) to the occupants (e.g., the driver) of the vehicle 1. For example, the notification control unit 124 notifies the occupants of the start of lane change control, and notifies the occupants when the lane change control is to be stopped midway. The notification of the start of lane change control or the notification of the stop of lane change control is performed, for example, by displaying on a display device such as the HMI 30 or the navigation HMI 62, or by playing audio from a speaker.

[0058] In the control device 100, for example, the action plan generating unit 112 of the first control unit 110 and the acquiring unit 121, the speed control unit 122, and the steering control unit 123 of the second control unit 120 combine to configure the driving control unit 130. For example, when the lane change determining unit 113 determines that lane change control can be performed, the driving control unit 130 performs lane change control.

[0059] <Lane change control> (Lane change action) 4A and 4B show an example of lane change operation of the vehicle 1 by lane change control. Fig. 4A shows a case where the vehicle 1 changes the lane to the driver's seat side, and Fig. 4B shows a case where the vehicle 1 changes the lane to the passenger's seat side.

[0060] Here, a case will be described as an example in which the vehicle 1 is autonomously traveling according to the control by the control device 100, without being operated by a driver seated in the driver's seat 2. At this time, the control device 100 can appropriately execute lane change control for changing the lane in which the vehicle 1 is traveling, depending on the surrounding conditions of the vehicle 1 recognized by the recognition unit 111, etc.

[0061] Road 300 has a left lane 310, a right lane 320, and a dividing line 330 that serves as a road dividing line and is provided at the boundary between left lane 310 and right lane 320. The travel direction of left lane 310 and right lane 320 is from left to right in (A) and (B) of Figure 4.

[0062] Hereinafter, the lane in which the vehicle 1 is traveling is also referred to as the "own lane L1." In addition, the lane adjacent to the own lane L1 is also referred to as the "adjacent lane L2." In FIG. 4A, the vehicle 1 is traveling in the left lane 310, so the own lane L1 is the left lane 310, and the adjacent lane L2 is the right lane 320. On the other hand, in FIG. 4B, the vehicle 1 is traveling in the right lane 320, so the own lane L1 is the right lane 320, and the adjacent lane L2 is the left lane 310.

[0063] 4A will be described first. While the vehicle 1 is traveling in the left lane 310 of the road 300, the control device 100 executes lane change control to overtake a preceding vehicle M1 traveling in the own lane L1 at a slower speed than the vehicle 1.

[0064] Specifically, the lane change determination unit 113 determines whether or not to execute lane change control based on the surrounding conditions recognized by the recognition unit 111.

[0065] When the lane change determination unit 113 determines that lane change control can be executed, the notification control unit 124 notifies the occupant of the vehicle 1 that lane change control will be started via the HMI 30. The notification of the start of lane change control (hereinafter also referred to as a notification of the start of lane change control) is, for example, a notification by display on a display device attached to the vehicle 1 or a notification by voice guidance from a speaker. When notifying the start of lane change control, the notification control unit 124 may notify the occupant of the direction of the lane change, in this case, that the lane will be changed toward the driver's seat side.

[0066] In addition to the notification of the start of lane change control, the notification control unit 124 also notifies the driver to check the surroundings of the vehicle 1. This causes the driver to check the surroundings of the vehicle 1 on the driver's seat side. Specifically, the driver checks the side mirror 6 on the driver's seat side, or directly checks the side (right side) of the vehicle 1 on the driver's seat side.

[0067] After a time t10 has elapsed since the notification control unit 124 started to give a notification (i.e., a notification of the start of lane change control), the control device 100 starts turning on the right winker 5. This notifies the outside of the vehicle 1 of the lane change of the vehicle 1.

[0068] After a time t20 has elapsed since the turn-on of the turn signal 5, the driving control unit 130 starts lane change control to the driver's seat side (right side). As a result, the driving control unit 130 starts steering the vehicle 1, and the vehicle 1 moves laterally.

[0069] The driving control unit 130 performs steering control so as to complete the lateral movement to the adjacent lane L2 after the elapse of time t30 from the start of the lane change control, thereby completing the lane change control.

[0070] The above-mentioned times t10, t20, and t30 are times that are stored in advance in the control device 100 by, for example, the manufacturer of the vehicle 1 or the like.

[0071] Here, the time from when notification by the notification control unit 124 is started to when lane change control is started corresponds to the surroundings check time for the driver to check the surroundings of the vehicle 1. The surroundings check time when changing lanes to the driver's seat side (hereinafter also simply referred to as the surroundings check time on the driver's seat side) is stored in advance in the control device 100 as the total time T1 of time t10 and time t20.

[0072] When the driver monitor camera 50 and / or the steering grip sensor 84 detect that the driver is in a state where he / she can check the surroundings within the surroundings check time, the lane change control starts after the time t20 has elapsed since the turn-on of the turn signal 5, as described above. On the other hand, when it is not detected that the driver is in a state where he / she can check the surroundings within the surroundings check time, the turn signal 5 is turned off and the lane change control is not executed. Note that, for example, the lane change control may be started based on the detection by the driver monitor camera 50 or the like that the driver has checked the surroundings within the surroundings check time.

[0073] As an example, if the time t10 from when the notification control unit 124 starts notifying to when the turn signal 5 starts to light is 1 second, the time t20 from when the turn signal 5 starts to light to when the lane change control starts is 1 second, and the time t30 from when the lane change control starts to when the lane change control is completed is 6 seconds, the lane change time when changing lanes to the driver's seat side as shown in Fig. 4(A) is 8 seconds, which is the total time of times t10, t20, and t30. Also, the surrounding confirmation time on the driver's seat side is 2 seconds, which is the total time T1 of times t10 and t20.

[0074] Next, FIG. 4B will be described. In the case of changing lanes to the passenger seat side, similarly to the case of changing lanes to the driver seat side described above, if the lane change determination unit 113 determines that lane change control can be executed, the notification control unit 124 notifies the occupant of the vehicle 1 of the start of lane change control via the HMI 30. In addition to notifying the driver of the start of lane change control, the notification control unit 124 also notifies the driver to check the surroundings of the vehicle 1.

[0075] Here, the side mirror 6 on the passenger side and the side (left) of the vehicle 1 are located farther away from the driver's seat than the side mirror 6 on the driver's seat and the side (right) of the vehicle 1. Therefore, the driver has poor visibility around the vehicle 1 on the passenger side compared to the periphery of the vehicle 1 on the driver's seat side.

[0076] In this way, when changing lanes to the passenger side, visibility around the passenger side is generally poor, so the driver needs more time to check the surroundings on the passenger side compared to when changing lanes to the driver's side. Therefore, if the surroundings check time when changing lanes to the passenger side (hereinafter also simply referred to as the surroundings check time on the passenger side) is set to T1, which is the same as the surroundings check time on the driver's side, there is a risk that the driver will not check the surroundings sufficiently.

[0077] Therefore, in this embodiment, the surroundings confirmation time differs depending on the direction of lane change of the vehicle 1 by the lane change control. This makes it possible to ensure sufficient surroundings confirmation time even when changing lanes to the passenger seat side where visibility is poor.

[0078] Specifically, in the case of changing lanes to the passenger seat side, the time from when the notification control unit 124 starts notifying to when the turn signal 5 starts turning on is time t11, which is longer than the time t10 in the case of changing lanes to the driver seat side. The time t11 is, for example, a time stored in advance in the control device 100 by the manufacturer of the vehicle 1 or the like. The time from when the turn signal 5 starts turning on to when the lane change control starts is time t20, similar to when changing lanes to the driver seat side.

[0079] The surroundings confirmation time on the passenger side is the sum of times t11 and t20, that is, T2 (>T1), which is longer than the surroundings confirmation time on the driver side. In other words, the timing of starting lane change control on the passenger side is delayed from the timing of starting lane change control on the driver side.

[0080] The surroundings check time on the passenger seat side is also stored in advance in the control device 100 as the total time T2 of the time t11 and the time t20, similar to the surroundings check time on the driver seat side.

[0081] As an example, if the time t11 from when the notification control unit 124 starts notifying to when the turn signal 5 starts to light is 2 seconds, the time t20 from when the turn signal 5 starts to light to when steering starts is 1 second, and the time t30 from when lane change control starts to when lane change control is completed is 6 seconds, the lane change time when changing lanes to the passenger side as shown in Fig. 4(B) is 9 seconds, which is the sum of the times t11, t20, and t30. Also, the time to check the surroundings on the passenger side is 3 seconds, which is the sum T2 of the times t11 and t20.

[0082] However, if the surrounding confirmation time is uniformly increased regardless of the direction of lane change (for example, if the surrounding confirmation time on the driver's side is also set to T2), the lane change time when changing lanes to the driver's side will also be increased. If the lane change time is increased, the number of opportunities to determine that lane change control cannot be performed will increase, and the number of opportunities to execute lane changes will decrease.

[0083] In this embodiment, the periphery confirmation time differs depending on the lane change direction of the vehicle 1, so the opportunities for lane change are increased compared to a case where the periphery confirmation time is uniformly long regardless of the lane change direction.

[0084] (Control Flow) Next, an example of processing (also referred to as a control flow) when the control device 100 executes lane change control will be described with reference to the flowcharts shown in Figures 5 and 6. When the vehicle 1 is autonomously traveling according to the control by the control device 100, the control device 100 repeatedly executes the flowcharts in Figures 5 and 6 at a predetermined cycle, for example.

[0085] First, the control device 100 determines whether a lane change flag indicating the execution state of lane change control is ON (step S10). If it is determined that the lane change flag is ON (step S10: YES), the control device 100 proceeds to the process of step S32 described later.

[0086] When it is determined that the lane change flag is OFF (step S10: NO), the control device 100 determines whether or not to change lanes (step S12). For example, the control device 100 determines to change lanes when the inter-vehicle distance between the vehicle 1 and the preceding vehicle M1 is equal to or less than a predetermined threshold, but is not limited thereto, and may determine to change lanes when a predetermined condition is met regardless of whether the preceding vehicle M1 is present.

[0087] When it is determined that a lane change is not to be performed (step S12: NO), the control device 100 ends the current control flow.

[0088] When it is determined that a lane change is to be performed (step S12: YES), the control device 100 determines whether the direction of the lane change is toward the driver's seat side or the passenger's seat side (step S14).

[0089] When changing lanes to the driver's seat side (step S14: driver's seat side), the surroundings check time becomes the above-mentioned T1 (step S16). When changing lanes to the passenger's seat side (step S14: passenger's seat side), the surroundings check time becomes the above-mentioned T2 (>T1) (step S18). Specifically, the control device 100 refers to the total time T1 of the time t10 and the time t20 or the total time T2 of the time t11 and the time t20 stored in advance in the control device 100, and sets the surroundings check time to T1 or T2.

[0090] Next, the control device 100 determines whether or not to execute lane change control based on the surrounding conditions recognized by the recognition unit 111 (step S20). Specifically, as described above, the control device 100 determines whether or not to execute lane change control based on the surrounding conditions including information on other vehicles existing in the own lane L1 and the adjacent lane L2.

[0091] In addition, when determining whether or not to execute the lane change control, the control device 100 also takes into consideration the lane change time including the surrounding confirmation time determined in step S16 or step S18. Specifically, when the control device 100 determines that the lane change can be completed within the determined lane change time, it determines that the lane change control can be executed.

[0092] If it is determined that the lane change control cannot be executed (step S20: NO), the control device 100 ends the current control flow.

[0093] If it is determined that the lane change control can be executed (step S20: YES), the control device 100 turns on the lane change flag (step S22).

[0094] When the lane change flag is turned ON, the control device 100 notifies the occupant that lane change control will be executed via the HMI 30 (step S24). The control device 100 also notifies the driver to check the surroundings of the vehicle 1.

[0095] After the time t10 or t11 has elapsed since the notification control unit 124 started to give a notification, the control device 100 starts turning on the winker 5 (step S26).

[0096] Next, the control device 100 judges whether or not the driver is in a state where he or she can check the periphery of the vehicle 1 within the periphery check time (step S28).

[0097] If it is determined that the driver is not in a state to check the surroundings of the vehicle 1 within the surroundings check time (step S28: NO), the control device 100 turns off the turn signal 5 (step S29), turns off the lane change flag (step S30), and then ends the current control flow.

[0098] If it is determined that the driver is in a state where he or she can check the surroundings of the vehicle 1 within the surroundings check time (step S28: YES), after the time t20 has elapsed since the turn signal 5 was turned on, the control device 100 determines whether or not to execute lane change control (step S32).

[0099] If it is determined that lane change control cannot be executed (step S32: NO), the control device 100 turns off the turn signal 5 (step S38), sets the lane change flag to OFF (step S40), and ends the current control flow. For example, if the preceding vehicle M1 changes lanes to the adjacent lane L2 after the turn signal 5 is turned on, the control device 100 determines that lane change control cannot be executed.

[0100] If it is determined that the lane change control can be executed (step S32: YES), the control device 100 executes the lane change control (step S34). As a result, the control device 100 starts the steering control of the vehicle 1, and the vehicle 1 moves laterally from the own lane L1 to the adjacent lane L2.

[0101] After starting the lane change control, the control device 100 determines whether or not the lane change is completed (step S36). Specifically, the control device 100 determines whether or not the vehicle 1 has moved laterally to the adjacent lane L2.

[0102] When it is determined that the lane change has not been completed (step S36: NO), the control device 100 ends the current control flow as is, and continues to determine whether or not the lane change has been completed in the next control flow.

[0103] When the lane change is completed (step S36: YES), the control device 100 completes the lane change control. Then, the control device 100 turns off the winker 5 (step S38), turns off the lane change flag (step S40), and ends the current control flow.

[0104] (Periphery check time) The above-mentioned surroundings confirmation time is T1 or T2 stored in advance in the control device 100, but is not limited to this. The surroundings confirmation time may be changed based on at least one of the surrounding conditions of the vehicle 1, the state of the occupants or luggage in the vehicle 1, and the specifications of the vehicle 1.

[0105] The surrounding conditions of the vehicle 1 are, for example, information recognized by the recognition unit 111, and include traffic information such as the number of other vehicles traveling around the vehicle 1, the number of lanes of the road 300 on which the vehicle 1 is traveling, and the curvature of the road 300. For example, when there are a large number of other vehicles traveling around the vehicle 1, when there are a large number of lanes of the road 300 on which the vehicle 1 is traveling, or when the curvature of the road 300 is large, visibility around the vehicle 1 is relatively poor, so the surrounding confirmation time may be set long.

[0106] The surrounding conditions of the vehicle 1 may also include environmental information such as backlighting, weather, time of day, etc. For example, when there is backlighting from the direction of lane change, when there is fog around the vehicle 1, or when it is nighttime, the visibility around the vehicle 1 is relatively poor, so the surroundings check time may be set long.

[0107] The status of the occupants or luggage in the vehicle 1 includes, for example, the riding position and number of occupants other than the driver, and the arrangement and amount of luggage loaded in the vehicle 1. These statuses are detected, for example, by a camera (not shown) provided in the vehicle cabin. For example, when an occupant is seated in the passenger seat 3, when there are many people in the vehicle 1, or when the amount of luggage loaded in the vehicle 1 is large, the visibility around the vehicle 1 is relatively poor, so the surrounding confirmation time may be set long.

[0108] The state of the occupant in the vehicle 1 may also include driving history information of the driver. For example, if the driver has a short driving history, the surroundings check time may be set long.

[0109] The specifications of the vehicle 1 include, for example, information such as the width of the vehicle 1, the position of the seats in the vehicle 1 (for example, the inclination of the passenger seat 3), and the installation state (for example, the angle state) of the side mirror 6. For example, if the width of the vehicle 1 is large, if the passenger seat 3 of the vehicle 1 is in a position that obstructs the driver's field of vision, or if the side mirror 6 faces relatively downward, the visibility around the vehicle 1 is relatively poor, so the surrounding confirmation time may be set long.

[0110] Below, we will explain an example of a configuration in which the surrounding confirmation time changes based on the surrounding conditions of vehicle 1, as a configuration in which the surrounding confirmation time changes based on at least one of the surrounding conditions of vehicle 1, the status of occupants or luggage in vehicle 1, and the specifications of vehicle 1.

[0111] 7 shows an example in which the vehicle 1 changes lanes to the adjacent lane L2 on the driver's side when there are many other vehicles M2 traveling around the vehicle 1 on the driver's side (i.e., there is a large traffic volume). In the example in FIG. 7, there is another lane L3 to the right of the adjacent lane L2 on the driver's side of the vehicle 1, and many other vehicles M2 travel in the adjacent lane L2 and lane L3.

[0112] The periphery confirmation time may vary based on the number of other vehicles M2 traveling around the vehicle 1. Specifically, the periphery confirmation time when the number of other vehicles M2 traveling around the vehicle 1 is large may be set longer than the periphery confirmation time when the number of other vehicles M2 traveling around the vehicle 1 is small.

[0113] In the example of Fig. 7, the control device 100 sets the surroundings confirmation time on the driver's seat side to T3 (> T1), which is a correction that lengthens the previously stored T1. By setting the surroundings confirmation time to be long in this way when the traffic volume is heavy, the driver can adequately check the surroundings on the driver's seat side.

[0114] Here, the surroundings check time on the driver's seat side may be set to be longer than the surroundings check time on the passenger's seat side. In other words, T3 newly set as the surroundings check time on the driver's seat side may be longer than T2 previously stored as the surroundings check time on the passenger's seat side.

[0115] In addition, when there are many other vehicles M2 traveling around the vehicle 1 on the passenger side, the surroundings confirmation time on the passenger side may be set to a time that is corrected to be longer than the previously stored T2.

[0116] <<Variation>> In the above-described embodiment, the surroundings confirmation time on the passenger seat side is set longer than the surroundings confirmation time on the driver seat side, assuming that the driver is seated in the driver's seat 2. However, for example, when the vehicle 1 is autonomously traveling by fully automated driving, it may be possible that no one is seated in the driver's seat 2 when lane change control is executed.

[0117] FIG. 8 is a schematic diagram of a vehicle 1 that is autonomously traveling by fully automatic driving with no occupant seated in the driver's seat 2. The vehicle 1 shown in FIG. 8 is configured so that, for example, an occupant can move between the driver's seat 2 and the rear seat 4 within the vehicle cabin. In addition, an operation unit 9 that can perform a predetermined operation regarding the traveling of the vehicle 1 is provided in front of the left rear seat 4L of the rear seat 4. The occupant is seated in the left rear seat 4L, and can perform an operation to, for example, stop the execution of lane change control by operating the operation unit 9.

[0118] In such a case, when an occupant sitting in the left rear seat 4L checks the periphery of the vehicle 1, the visibility on the opposite side (right side) of the occupant's riding side is worse than the visibility on the occupant's riding side (left side). Therefore, in the modified example, the periphery check time when the vehicle 1 changes lanes in the direction opposite to the occupant's riding side (rightward) by the above-mentioned lane change control is configured to be longer than the periphery check time when the vehicle 1 changes lanes in the direction of the occupant's riding side (leftward). For example, the control device 100 sets the periphery check time when the vehicle 1 changes lanes to the right as T2, and sets the periphery check time when the vehicle 1 changes lanes to the left as T1. This makes it possible to ensure a sufficient periphery check time.

[0119] Then, for example, when it is determined based on the detection result of the driver monitor camera 50 or the like that the occupant is in a state where he / she can check the surroundings within the surroundings check time, the control device 100 starts the lane change control. Also, the control device 100 may be configured to start the lane change control when it is determined based on the detection result of the driver monitor camera 50 or the like that the occupant has checked the surroundings of the vehicle 1. Note that, when the occupant checks the surroundings of the vehicle 1 and determines that the lane change control should be stopped, the occupant operates the operation unit 9 to stop the execution of the lane change control.

[0120] Although an embodiment of the present invention and modifications have been described above with reference to the accompanying drawings, it goes without saying that the present invention is not limited to such an embodiment. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present invention. Furthermore, the components in the above embodiment may be arbitrarily combined within the scope of the invention.

[0121] In the above embodiment, the time t11 when changing lanes to the passenger seat side is set longer than the time t10 when changing lanes to the driver seat side, thereby making the passenger seat side surroundings check time longer than the driver seat side surroundings check time, but this is not limited to this. For example, the passenger seat side surroundings check time may be made longer than the driver seat side surroundings check time by setting the time from when the turn signal 5 starts to be turned on to when changing lanes to the passenger seat side to the start of lane change control longer than the time t20 when changing lanes to the driver seat side.

[0122] In the above embodiment, the time from the notification of the start of lane change control to the start of lane change control is set as the surroundings confirmation time, but this is not limited to this. For example, the surroundings confirmation time may be the time from when the notification control unit 124 starts notification to when the turn signal 5 starts to be turned on.

[0123] In the above-described embodiment, the surrounding check time on the driver's side and the surrounding check time on the passenger's side were T1 and T2, respectively, which were pre-stored in the control device 100, but this is not limited to this and may be variably set according to the wishes of the occupants.

[0124] This specification describes at least the following items. In parentheses, components corresponding to the above-described embodiment are shown as examples, but the present invention is not limited to these.

[0125] (1) A control device (control device 100) capable of executing lane change control to change the lane in which a moving body (vehicle 1) is traveling, A recognition unit (recognition unit 111) that recognizes the surrounding situation of the moving object; A lane change determination unit (lane change determination unit 113) that determines whether or not the lane change control can be executed based on the surrounding conditions recognized by the recognition unit; a driving control unit (driving control unit 130) that executes the lane change control when the lane change determination unit determines that the lane change control can be executed; A notification control unit (notification control unit 124) that performs a predetermined notification to a passenger of the moving body via a notification device (HMI 30, navigation HMI 62) mounted on the moving body; Equipped with The notification control unit notifies an occupant of the moving body that the lane change control will be started when the lane change determination unit determines that the lane change control can be executed, The traveling control unit starts the lane change control after a predetermined time has elapsed since the notification control unit started to notify the driver, The predetermined time period varies depending on a direction of lane change of the moving object due to the lane change control. Control device.

[0126] If the time required for the occupant to check the surroundings is uniform regardless of the direction of lane change of the moving body, the occupant may not be able to check the surroundings sufficiently before starting steering depending on the direction of lane change. According to (1), since the timing of starting lane change control differs depending on the direction of lane change, it is possible to ensure sufficient time for checking the surroundings regardless of the direction of lane change. Furthermore, compared to the case where the time for checking the surroundings is uniformly extended regardless of the direction of lane change, it is possible to suppress a decrease in opportunities to execute lane changes.

[0127] (2) The control device according to (1), The predetermined time when the moving body changes lanes in a first direction, which is one of the left and right directions, is longer than the predetermined time when the moving body changes lanes in a second direction, which is the other of the left and right directions, by the lane change control. Control device.

[0128] According to (2), the timing for starting lane change control in either the left or right direction can be delayed, thereby ensuring sufficient time for checking the surroundings.

[0129] (3) The control device according to (2), When the occupant checks the surroundings of the moving body, the visibility in the first direction is worse than the visibility in the second direction. Control device.

[0130] According to (3), the timing for starting lane change control in a direction with poor visibility can be delayed, so that sufficient time for checking the surroundings can be secured.

[0131] (4) The control device according to (3), The first direction is a direction opposite to a riding side of the occupant who can operate the movement of the movable body in the left-right direction. Control device.

[0132] According to (4), when changing lanes in a direction opposite to the passenger side of the vehicle who can control the movement of the moving body, visibility in the direction of the lane change is relatively poor. Therefore, by delaying the timing of starting lane change control compared to when changing lanes toward the passenger side, sufficient time can be ensured to check the surroundings.

[0133] (5) The control device according to (4), The first direction is a direction opposite to the driver's seat (passenger seat side) of the moving body in the left-right direction. Control device.

[0134] According to (5), when changing lanes in the direction opposite to the driver's side, visibility around the moving body is relatively poor, so by delaying the timing of starting lane change control compared to when changing lanes toward the driver's side, sufficient time can be secured to check the surroundings.

[0135] (6) A control device according to any one of (1) to (5), The predetermined time varies based on at least one of the surrounding conditions, the state of an occupant or luggage in the moving body, and the specifications of the moving body. Control device.

[0136] According to (6), the surrounding confirmation time can be variably set based on the surrounding conditions, the status of the occupants or luggage in the moving body, and the specifications of the moving body.

[0137] (7) A control device according to any one of (1) to (6), when it is determined that the occupant is in a state where he or she can check the surroundings of the moving body within the predetermined time, the lane change control is started. Control device.

[0138] According to (7), lane change control is started when the occupant can check the surroundings of the moving body, so that safer lane change control can be executed.

[0139] (8) A control device according to any one of (1) to (7), The predetermined time is a time from when the notification by the notification control unit is started to when the lane change control is started, or a time from when the notification by the notification control unit is started to when a notification of the execution of the lane change control to the outside of the moving body (turning on of the turn signal 5) is started. Control device.

[0140] According to (8), the specified time can be appropriately determined.

[0141] (9) A control device according to any one of (1) to (8), The predetermined notification by the notification control unit includes at least one of a display by a display device (a display device of the HMI 30 or the navigation HMI 62) mounted on the moving body and a voice guidance by a voice output device (a speaker of the HMI 30 or the navigation HMI 62) mounted on the moving body. Control device.

[0142] According to (9), a predetermined notification (for example, that lane change control is about to begin) can be provided to the occupant by display and / or audio. [Explanation of symbols]

[0143] 1. Vehicle (moving object) 30 HMI (notification device) 62 Navigation HMI (notification device) 100 Control device 111 Recognition part 113 Lane change judgment unit 124 Notification control section 130 Driving control unit

Claims

1. A control device capable of executing lane change control for changing a lane in which a moving object is traveling, A recognition unit that recognizes a surrounding situation of the moving object; a lane change determination unit that determines whether or not the lane change control can be executed based on the surrounding conditions recognized by the recognition unit; a travel control unit that executes the lane change control when the lane change determination unit determines that the lane change control can be executed; a notification control unit that issues a predetermined notification to a passenger of the moving body via a notification device mounted on the moving body; Equipped with The notification control unit notifies an occupant of the moving body that the lane change control will be started when the lane change determination unit determines that the lane change control can be executed, The traveling control unit starts the lane change control after a predetermined time has elapsed since the notification control unit started to notify the driver, The predetermined time period varies depending on a direction of lane change of the moving object due to the lane change control. Control device.

2. The control device according to claim 1 , the predetermined time when the moving body changes lanes in a first direction, which is one of the left and right directions, is longer than the predetermined time when the moving body changes lanes in a second direction, which is the other of the left and right directions, by the lane change control; Control device.

3. The control device according to claim 2, When the occupant checks the surroundings of the moving body, the visibility in the first direction is worse than the visibility in the second direction. Control device.

4. The control device according to claim 3, The first direction is a direction opposite to a riding side of the occupant who can operate the movement of the movable body in the left-right direction. Control device.

5. The control device according to claim 4, The first direction is a direction opposite to a driver's seat of the moving body in the left-right direction. Control device.

6. The control device according to any one of claims 1 to 5, The predetermined time varies based on at least one of the surrounding conditions, the state of an occupant or luggage in the moving body, and the specifications of the moving body. Control device.

7. The control device according to any one of claims 1 to 5, the driving control unit starts the lane change control when it is determined that the occupant is in a state where he or she can check the surroundings of the moving body within the predetermined time. Control device.

8. The control device according to any one of claims 1 to 5, The predetermined time is a time from when the notification by the notification control unit is started to when the lane change control is started, or a time from when the notification by the notification control unit is started to when a notification of the execution of the lane change control to the outside of the moving body is started. Control device.

9. The control device according to any one of claims 1 to 5, The predetermined notification by the notification control unit includes at least one of a display by a display device mounted on the moving body and a voice guidance by a voice output device mounted on the moving body. Control device.

Citation Information

Patent Citations

  • On-vehicle rear confirmation support device and on- vehicle navigation device

    JP2002117496A

  • Room mirror for automobile capable of continuously checking from behind vehicle to side face

    JP2009166588A

  • Image processing system, image processing device, image processing method and program

    JP2014072604A

  • Drive assist system

    JP2017102519A

  • Automatic operation system

    JP2018086966A