Vehicle control device, vehicle control method, and program
The vehicle control device improves autonomous driving by using camera and map data to accurately recognize lane markings and adjust driving controls, addressing recognition challenges and enhancing system reliability.
Patent Information
- Application Number
- JP2022128959
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-08-12
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2042-08-12
AI Technical Summary
Autonomous driving systems face challenges in accurately recognizing road markings due to variations in camera recognition accuracy and map information updates, leading to issues with lane boundary recognition, which hinders continuous driving operations.
A vehicle control device and method that utilizes a first recognition unit to identify lane markings from camera data and a second recognition unit to use map information, allowing for appropriate driving control based on matching or mismatching lane markings, with additional considerations for surrounding vehicles and trajectory analysis.
Enhances driving control accuracy and continuity by ensuring appropriate steering and speed adjustments based on accurate lane recognition, improving the reliability of autonomous driving systems.
Smart Images

Figure 0007592052000001 
Figure 0007592052000002 
Figure 0007592052000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle control device, a vehicle control method, and a program. [Background technology]
[0002] In recent years, efforts to provide access to sustainable transportation systems that take into consideration vulnerable traffic participants have been gaining momentum. To achieve this, efforts are being made to further improve traffic safety and convenience through research and development of autonomous driving technology. In relation to this, a technology is known that sets priorities for multiple lane boundaries on the left and right of the vehicle based on target position data, and estimates the vehicle's own position by matching the target position data of the lane boundary with a high priority with target position information included in map information (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-084960 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, with autonomous driving technology, there have been issues such as the inability to properly recognize road dividing lines that separate driving lanes and the inability to continue autonomous driving depending on the accuracy of recognition of the vehicle's surroundings by cameras, the accuracy of map information, and the timing of updates.
[0005] In order to solve the above-mentioned problems, an object of the present invention is to provide a vehicle control device, a vehicle control method, and a program that can execute more appropriate driving control in accordance with the recognition result of the surroundings of the vehicle, thereby contributing to the development of a sustainable transportation system. [Means for solving the problem]
[0006] A vehicle control device, a vehicle control method, and a program according to the present invention employ the following configuration. (1): A vehicle control device according to one embodiment of the present invention includes a first recognition unit that recognizes the surrounding conditions including a first dividing line that divides the lane of the host vehicle and a vehicle traveling ahead of the host vehicle based on the output of a detection device that detects the surrounding conditions of the host vehicle; a second recognition unit that recognizes a second dividing line that divides the lanes around the host vehicle from map information based on position information of the host vehicle; and a driving control unit that executes driving control to control at least the steering or speed of the host vehicle based on the recognition results of the first recognition unit and the second recognition unit, wherein the driving control unit executes a first driving control based on the matching dividing line when the host vehicle is traveling in a lane change section and the first dividing line recognized by the first recognition unit coincides with the second dividing line, and executes a second driving control based on the first dividing line and the traveling position information of the vehicle traveling ahead when the first dividing line and the second dividing line do not coincide with each other.
[0007] (2): In the above aspect (1), the preceding vehicle includes a first other vehicle traveling in the driving lane of the host vehicle and a second other vehicle traveling in a lane adjacent to the driving lane.
[0008] (3): In the above aspect (2), the driving position information includes a driving trajectory, and the driving control unit acquires the driving trajectories of the first other vehicle and the second other vehicle, and executes the second driving control when the shape of each of the acquired driving trajectories matches the shape of the first dividing line.
[0009] (4): In the above aspect (1), the driving position information includes a driving trajectory, and the driving control unit executes a second driving control when the first dividing line and the driving trajectory of the vehicle traveling ahead match.
[0010] (5): In the above aspect (2), the driving control unit executes the second driving control when the first recognition unit recognizes the first other vehicle and the second other vehicle within a predetermined period of time.
[0011] (6): In the above aspect (1), the driving control unit determines whether or not there is a match between one of two first dividing lines that divide the vehicle's travel lane recognized by the first recognition unit and one of two second dividing lines that divide the vehicle's travel lane recognized from the map information.
[0012] (7): In the above aspect (1), when the first dividing line and the second dividing line coincide after executing the second driving control, the driving control unit continues the second driving control until a predetermined period of time has elapsed or a predetermined distance has been traveled since executing the second driving control.
[0013] (8): In the aspect (1) above, the driving control unit terminates the second driving control after a predetermined period of time has elapsed or a predetermined distance has been traveled since the second driving control was executed.
[0014] (9): In the above aspect (1), the driving control unit executes the first driving control and the second driving control when the vehicle or a user of the vehicle has the authority to execute the driving control.
[0015] (10): A vehicle control method according to one embodiment of the present invention is a vehicle control method in which a computer recognizes the surrounding conditions including a first dividing line that divides the lanes around the host vehicle and a vehicle traveling ahead of the host vehicle based on the output of a detection device that detects the surrounding conditions of the host vehicle, recognizes a second dividing line that divides the lanes around the host vehicle from map information based on position information of the host vehicle, and performs driving control to control at least the steering or speed of the host vehicle based on the recognition result, and when the host vehicle is traveling in a lane change section and the first dividing line and the second dividing line coincide, performs a first driving control based on the coincident dividing line, and when the first dividing line and the second dividing line do not coincide, performs a second driving control based on the first dividing line and the traveling position information of the vehicle traveling ahead.
[0016] (11): A program according to one embodiment of the present invention causes a computer to recognize the surrounding conditions including a first dividing line that divides the lanes around the host vehicle and a vehicle traveling ahead of the host vehicle based on the output of a detection device that detects the surrounding conditions of the host vehicle, recognize a second dividing line that divides the lanes around the host vehicle from map information based on position information of the host vehicle, and execute driving control to control at least the steering or speed of the host vehicle based on the recognition result, execute a first driving control based on the matching dividing line when the host vehicle is traveling in a lane change section and the first dividing line and the second dividing line match, and execute a second driving control based on the first dividing line and the traveling position information of the vehicle traveling ahead when the first dividing line and the second dividing line do not match. Effect of the Invention
[0017] According to the above aspects (1) to (11), more appropriate driving control can be executed in accordance with the recognition result of the surroundings of the vehicle. [Brief description of the drawings]
[0018] [Figure 1]1 is a configuration diagram of a vehicle system 1 including a vehicle control device according to an embodiment. [Diagram 2] 2 is a functional configuration diagram of a first control unit 120 and a second control unit 160. FIG. [Diagram 3] FIG. 2 is a diagram for explaining operation control in a first situation. [Figure 4] FIG. 11 is a diagram for explaining operation control in a second situation. [Diagram 5] FIG. 13 is a diagram for explaining a case where a camera lane line is present within a lane that is separated by map lane lines. [Figure 6] FIG. 13 is a diagram for explaining a case where one of the camera lane lines CL1, CL2 is present within a branch lane L3. [Figure 7] FIG. 11 is a diagram for explaining operation control in a third situation. [Figure 8] 13 is a diagram for explaining the determination of driving control to be performed based on the angle between a camera division line and a map division line. FIG. [Figure 9] 4 is a flowchart showing an example of the flow of an operation control process in the first embodiment. [Figure 10] 10 is a flowchart showing an example of the flow of an operation control process in the second embodiment. [Figure 11] 6 is a flowchart showing an example of the flow of a first control process. [Figure 12] 10 is a flowchart showing an example of the flow of a second control process. [Figure 13] 13 is a flowchart showing an example of a process flow of a modified example of the second control process. [Figure 14] 10 is a flowchart showing an example of the flow of a third control process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] Hereinafter, with reference to the drawings, an embodiment of a vehicle control device, a vehicle control method, and a program of the present invention will be described. Hereinafter, an embodiment in which the vehicle control device is applied to an autonomous vehicle will be described as an example. Autonomous driving means, for example, automatically controlling one or both of the steering and speed of a vehicle to execute driving control. The above-mentioned driving control may include, for example, an Adaptive Cruise Control System (ACC), a Traffic Jam Pilot (TJP), a Lane Keeping Assistance System (LKAS), an Automated Lane Change (ALC), a Collision Mitigation Brake System (CMBS), and other driving controls. In addition, the autonomous vehicle may be driven by manual operation of a user (e.g., a passenger) of the vehicle (so-called manual driving). In addition, the following will describe a case where a law for driving on the left side is applied, but when a law for driving on the right side is applied, the left and right may be read inversely.
[0020] [Overall configuration] 1 is a configuration diagram of a vehicle system 1 including a vehicle control device according to an embodiment. The vehicle (hereinafter referred to as the subject vehicle M) on which the vehicle system 1 is mounted is, for example, a two-wheeled, three-wheeled, or four-wheeled vehicle, and its drive source is an internal combustion engine such as a diesel engine or a gasoline engine, an electric motor, or a combination of these. The electric motor operates using power generated by a generator connected to the internal combustion engine, or discharged power from a battery (storage battery) such as a secondary battery or a fuel cell.
[0021] The vehicle system 1 includes, for example, a camera 10, a radar device 12, a LIDAR (Light Detection and Ranging) 14, an object recognition device 16, a communication device 20, an HMI (Human Machine Interface) 30, a vehicle sensor 40, a navigation device 50, an MPU (Map Positioning Unit) 60, a driving operator 80, an automatic driving control device 100, a driving force output device 200, a brake device 210, and a steering device 220. These devices and devices are connected to each other by a multiple communication line such as a CAN (Controller Area Network) communication line, a serial communication line, a wireless communication network, or the like. Note that the configuration shown in FIG. 1 is merely an example, and a part of the configuration may be omitted, or another configuration may be added. A combination of the camera 10, the radar device 12, the LIDAR 14, and the object recognition device 16 is an example of a "detection device DD". The HMI 30 is an example of an "output device". The automatic driving control device 100 is an example of a "driving control unit".
[0022] The camera 10 is a digital camera using a solid-state imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 10 is attached to an arbitrary location of the host vehicle M in which the vehicle system 1 is mounted. When capturing an image of the front, the camera 10 is attached to the top of the front windshield, the back of the room mirror, the front of the vehicle body, or the like. When capturing an image of the rear, the camera 10 is attached to the top of the rear windshield, the back door, or the like. When capturing an image of the side, the camera 10 is attached to a door mirror or the like. The camera 10 periodically and repeatedly captures images of the surroundings of the host vehicle M, for example. The camera 10 may be a stereo camera.
[0023] The radar device 12 emits radio waves such as millimeter waves around the vehicle M and detects radio waves reflected by surrounding objects (reflected waves) to detect at least the position (distance and direction) of the objects. The radar device 12 is attached to an arbitrary location of the vehicle M. The radar device 12 may detect the position and speed of the objects by an FM-CW (Frequency Modulated Continuous Wave) method.
[0024] The LIDAR 14 irradiates light around the vehicle M and measures the scattered light. The LIDAR 14 detects the distance to the target based on the time from light emission to light reception. The irradiated light is, for example, a pulsed laser light. The LIDAR 14 is attached to an arbitrary position of the vehicle M.
[0025] The object recognition device 16 performs sensor fusion processing on some or all of the detection results from the camera 10, the radar device 12, and the LIDAR 14 to recognize the position, type, speed, etc. of the object. The object recognition device 16 outputs the recognition result to the automatic driving control device 100. The object recognition device 16 may also output the detection results from the camera 10, the radar device 12, and the LIDAR 14 directly to the automatic driving control device 100. In that case, the object recognition device 16 may be omitted from the configuration of the vehicle system 1 (detection device DD).
[0026] The communication device 20 communicates with, for example, other vehicles in the vicinity of the vehicle M, a terminal device of a user using the vehicle M, or various server devices such as a management server SV, using a network such as a cellular network, a Wi-Fi network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), LAN (Local Area Network), WAN (Wide Area Network), or the Internet.
[0027] The HMI 30 outputs various information to an occupant of the vehicle M and receives input operations by the occupant. The HMI 30 includes, for example, various display devices, a speaker, a buzzer, a touch panel, switches, keys, a microphone, and the like.
[0028] The vehicle sensor 40 includes a vehicle speed sensor that detects the speed of the host vehicle M, an acceleration sensor that detects the acceleration, a yaw rate sensor that detects the yaw rate (for example, a rotational angular velocity around a vertical axis passing through the center of gravity of the host vehicle M), and a direction sensor that detects the direction of the host vehicle M. The vehicle sensor 40 may also be provided with a position sensor that detects the position of the vehicle. The position sensor is an example of a "position measurement unit." The position sensor is, for example, a sensor that acquires position information (longitude and latitude information) from a GPS (Global Positioning System) device. The position sensor may also be a sensor that acquires position information using a GNSS (Global Navigation Satellite System) receiver 51 of the navigation device 50. The vehicle sensor 40 may derive the speed of the host vehicle M from the difference (i.e., distance) of the position information at a predetermined time in the position sensor. The result detected by the vehicle sensor 40 is output to the automatic driving control device 100.
[0029] The navigation device 50 includes, for example, a GNSS receiver 51, a navigation HMI 52, and a route determination unit 53. The navigation device 50 holds first map information 54 in a storage device such as a hard disk drive (HDD) or a flash memory. The GNSS receiver 51 identifies the position of the vehicle M based on a signal received from a GNSS satellite. The position of the vehicle M may be identified or complemented by an inertial navigation system (INS) using the output of the vehicle sensor 40. The navigation HMI 52 includes a display device, a speaker, a touch panel, a key, and the like. The GNSS receiver 51 may be provided in the vehicle sensor 40. The navigation HMI 52 may be partially or entirely shared with the HMI 30 described above. The route determination unit 53, for example, determines a route (hereinafter, a route on a map) from the position of the vehicle M identified by the GNSS receiver 51 (or an arbitrary position input) to a destination input by a driver using the navigation HMI 52, with reference to the first map information 54. The first map information 54 is, for example, information in which road shapes are expressed by links indicating roads and nodes connected by the links. The first map information 54 may include POI (Point Of Interest) information and the like. The route on the map is output to the MPU 60. The navigation device 50 may perform route guidance using the navigation HMI 52 based on the route on the map. The navigation device 50 may transmit the current position and the destination to a navigation server via the communication device 20 and obtain a route equivalent to the route on the map from the navigation server. The navigation device 50 outputs the determined route on the map to the MPU 60.
[0030] The MPU 60 includes, for example, a recommended lane determination unit 61, and holds second map information 62 in a storage device such as an HDD or a flash memory. The recommended lane determination unit 61 divides the route on the map provided by the navigation device 50 into a plurality of blocks (for example, by dividing it into 100 m intervals in the vehicle travel direction), and determines a recommended lane for each block by referring to the second map information 62. The recommended lane determination unit 61 determines which lane from the left the vehicle should travel in. When a branch point is present on the route on the map, the recommended lane determination unit 61 determines a recommended lane so that the host vehicle M can travel along a reasonable route to proceed to the branch point.
[0031] The second map information 62 is map information with higher accuracy than the first map information 54. The second map information 62 includes, for example, the number of lanes, the type of road dividing lines (hereinafter referred to as dividing lines), information on the center of lanes, information on road boundaries, and the like. The second map information 62 may include information on whether the road boundaries include structures that vehicles cannot pass through (including crossing and contacting). Examples of the structures include guardrails, curbs, median strips, fences, and the like. The impassability may include the presence of a low step that allows passage if vibrations of the vehicle that do not normally occur are tolerated. The second map information 62 may also include road shape information, traffic regulation information, address information (address and zip code), facility information, parking lot information, telephone number information, and the like. Examples of the road shape information include the radius of curvature (or curvature), width, gradient, and the like of the road. The second map information 62 may be updated at any time by the communication device 20 communicating with an external device. The first map information 54 and the second map information 62 may be provided as an integrated piece of map information. The map information may be stored in the storage unit 190.
[0032] The driving operators 80 include, for example, a steering wheel, an accelerator pedal, and a brake pedal. The driving operators 80 may also include a shift lever, a special steering wheel, a joystick, and other operators. Each operator of the driving operators 80 is fitted with an operation detection unit that detects, for example, the amount of operation of the operator by the occupant or the presence or absence of operation. The operation detection unit detects, for example, the steering angle and steering torque of the steering wheel, the amount of depression of the accelerator pedal and the brake pedal, and the like. The operation detection unit then outputs the detection result to the automatic driving control device 100, or one or both of the driving force output device 200, the brake device 210, and the steering device 220.
[0033] The automatic driving control device 100 executes various driving controls related to automatic driving for the vehicle M. The automatic driving control device 100 includes, for example, an execution feasibility determination unit 110, a first control unit 120, a second control unit 160, an HMI control unit 180, and a storage unit 190. The execution feasibility determination unit 110, the first control unit 120, the second control unit 160, and the HMI control unit 180 are each realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). In addition, some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The above-mentioned program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD or flash memory of the automatic driving control device 100, or may be stored in a removable storage medium such as a DVD, CD-ROM, or memory card, and installed in the storage device of the automatic driving control device 100 by inserting the storage medium (non-transient storage medium) into a drive device, card slot, etc.
[0034] The storage unit 190 may be realized by the above-mentioned various storage devices, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a ROM (Read Only Memory), or a RAM (Random Access Memory). The storage unit 190 stores, for example, authority information 192, various information in the embodiment, programs, and the like. The authority information 192 stores, for example, information indicating whether the vehicle M or a passenger (e.g., the driver) of the vehicle M is permitted to execute the driving control in the present embodiment (e.g., control in the first control unit 120 and the second control unit 160). The authority information may also store a period during which the driving control can be executed (e.g., until December 31, 2022) and the number of times (150 times remaining). The number of times is, for example, the number of times when the operation of the vehicle M is started (ignition on) and ended (ignition off), which is counted as one time.
[0035] Furthermore, the storage unit 190 may store map information (for example, the first map information 54 and the second map information 62).
[0036] The execution possibility determination unit 110 determines whether or not the vehicle M or the occupant has the authority to execute the driving control in this embodiment (hereinafter referred to as execution authority), and permits the execution of driving control in the first control unit 120 and the second control unit 160, etc., if the execution authority is present, and prohibits the execution of the above-mentioned driving control, if the execution authority is not present. Note that the presence or absence of execution authority is managed, for example, by the management server SV, and execution authority is given for a predetermined period or a predetermined number of times according to the amount of charge, etc., by obtaining permission to use by prior registration, etc.
[0037] Here, the execution feasibility determination will be specifically described. For example, the execution feasibility determination unit 110 acquires one or both of identification information for identifying the vehicle M and identification information for identifying the occupant. In this case, the execution feasibility determination unit 110 may acquire the identification information of the vehicle M stored in advance in the storage unit 190, or may acquire the identification information by the HMI 30 accepting input of the identification information from the occupant. In this case, the execution feasibility determination unit 110 may cause the HMI 30 to output information (image, sound) that prompts the HMI control unit 180 to input the identification information of the occupant.
[0038] When the execution possibility determination unit 110 acquires the identification information, it transmits the identification information to a management server SV that manages the use of the driving control in the embodiment via the communication device 20 to inquire about the execution authority. The management server SV receives the identification information transmitted from the host vehicle M, acquires execution authority information for the driving control associated with the received identification information, and transmits the acquired execution authority information to the host vehicle M. The execution possibility determination unit 110 receives the execution authority information transmitted by the management server SV, and when at least one of the host vehicle M or the occupant has the execution authority for the driving control in the embodiment, it permits the execution of the driving control by the first control unit 120 and the second control unit 160 described later, and when the execution authority is not acquired, it prohibits the execution of the driving control.
[0039] When neither the vehicle M nor the occupant has the authority to execute, the execution feasibility determination unit 110 may cause the HMI 30 to output via the HMI control unit 180 a message indicating that advance registration (charging) with the management server SV is required, to notify the occupant. The execution feasibility determination unit 110 may also cause the HMI control unit 180 to provide an interface that enables the HMI 30 to directly perform the registration procedure with the management server SV. The execution feasibility determination unit 110 may permit the execution of all driving controls described below when both the vehicle M and the occupant have the authority to execute, and may limit the types of driving controls that can be executed when only one of them has the authority to execute.
[0040] Furthermore, the execution feasibility determination unit 110 may determine whether or not the management server SV has execution authority when the host vehicle M is in operation (for example, when the ignition is turned on), and store the execution feasibility information acquired from the management server SV in the storage unit 190 as authority information 192. This eliminates the need for the execution feasibility determination unit 110 to inquire of the management server SV every time the host vehicle M is in operation, and allows the execution feasibility determination unit 110 to easily determine whether or not the host vehicle M can execute driving control by referring to the authority information 192 stored in the storage unit 190. In the following description, it is assumed that the execution feasibility determination unit 110 has determined that the host vehicle M or the occupant M has authority to execute the driving control of the embodiment.
[0041] FIG. 2 is a functional configuration diagram of the first control unit 120 and the second control unit 160. The first control unit 120 includes, for example, a recognition unit 130 and a behavior plan generation unit 140. The behavior plan generation unit 140 and the second control unit 160 are an example of a "driving control unit". The first control unit 120, for example, realizes a function based on AI (Artificial Intelligence) and a function based on a pre-given model in parallel. For example, the function of "recognizing an intersection" may be realized by performing recognition of an intersection by deep learning or the like and recognition based on a pre-given condition (there are signals, road markings, etc. that can be pattern matched) in parallel, and scoring and comprehensively evaluating both. This ensures the reliability of the autonomous driving. In addition, the first control unit 120 executes control related to the autonomous driving of the vehicle M based on, for example, instructions from the MPU 60, the HMI control unit 180, etc.
[0042] The recognition unit 130 recognizes the surrounding situation of the vehicle M based on the recognition result of the detection device DD (information input from the camera 10, the radar device 12, and the LIDAR 14 via the object recognition device 16). For example, the recognition unit 130 recognizes the state of the position, speed, acceleration, etc. of the object existing around the vehicle M. The position of the object is recognized as a position on an absolute coordinate system with a representative point of the vehicle M (such as the center of gravity or the center of the drive shaft) as the origin, and is used for control. The position of the object may be represented by a representative point such as the center of gravity or a corner of the object, or may be represented by a represented area. For example, when the object is a moving body such as another vehicle, the "state" of the object may include the acceleration or jerk of the moving body, or the "behavior state" (for example, whether the other vehicle is changing lanes or is about to change lanes).
[0043] Moreover, the recognition unit 130 includes, for example, a first recognition unit 132 and a second recognition unit 134. The functions of these units will be described in detail later.
[0044] The behavior plan generating unit 140 generates a behavior plan for driving the host vehicle M by automatic driving. For example, the behavior plan generating unit 140 generates a target trajectory along which the host vehicle M will automatically (without the driver's operation) travel in the future so that the host vehicle M will be able to respond to the surrounding conditions of the host vehicle M based on the recommended lane determined by the recommended lane determining unit 61 in principle, and further based on the recognition result by the recognition unit 130 or the surrounding road shape based on the current position of the host vehicle M acquired from the map information. The target trajectory includes, for example, a speed element. For example, the target trajectory is expressed as a sequence of points (trajectory points) to be reached by the host vehicle M. The trajectory points are points to be reached by the host vehicle M at each predetermined travel distance (for example, about several [m]) along the road, and separately, the target speed and target acceleration for each predetermined sampling time (for example, about a few tenths [sec]) are generated as part of the target trajectory. The trajectory points may also be positions to be reached by the host vehicle M at each sampling time for each predetermined sampling time. In this case, the information on the target speed and target acceleration is expressed as the interval between the trajectory points.
[0045] The action plan generating unit 140 may set an event of automatic driving when generating the target trajectory. The event may include, for example, a constant speed driving event in which the host vehicle M drives in the same lane at a constant speed, a following driving event in which the host vehicle M follows another vehicle that exists within a predetermined distance (for example, within 100 [m]) in front of the host vehicle M and is closest to the host vehicle M, a lane change event in which the host vehicle M changes lanes from the host vehicle's own lane to an adjacent lane, a branching event in which the host vehicle M branches into a lane on the destination side at a branching point of the road, a merging event in which the host vehicle M merges into a main lane at a merging point, a takeover event for terminating automatic driving and switching to manual driving, and the like. In addition, the event may include, for example, an overtaking event in which the host vehicle M changes lanes to an adjacent lane once, passes a preceding vehicle in the adjacent lane, and then changes lanes back to the original lane, an avoidance event in which the host vehicle M performs at least one of braking and steering to avoid an obstacle present in front of the host vehicle M, and the like.
[0046] Furthermore, the behavior plan generating unit 140 may change an event already determined for the current section to another event or set a new event for the current section, depending on the surrounding conditions of the host vehicle M recognized while the host vehicle M is traveling. Furthermore, the behavior plan generating unit 140 may change an event already set for the current section to another event or set a new event for the current section, depending on the operation of the occupant on the HMI 30. The behavior plan generating unit 140 generates a target trajectory according to the set event.
[0047] Moreover, the behavior plan generating unit 140 includes, for example, a determining unit 142 and an execution control unit 144. The functions of these units will be described in detail later.
[0048] The second control unit 160 controls the traveling driving force output device 200, the braking device 210, and the steering device 220 so that the host vehicle M passes the target trajectory generated by the action plan generating unit 140 at the scheduled time.
[0049] The second control unit 160 includes, for example, a target trajectory acquisition unit 162, a speed control unit 164, and a steering control unit 166. The target trajectory acquisition unit 162 acquires information on the target trajectory (trajectory points) generated by the action plan generation unit 140, and stores it in a memory (not shown). The speed control unit 164 controls the traveling driving force output device 200 or the brake device 210 based on a speed element associated with the target trajectory stored in the memory. The steering control unit 166 controls the steering device 220 according to the degree of curvature of the target trajectory stored in the memory. The processing of the speed control unit 164 and the steering control unit 166 is realized, for example, by a combination of feedforward control and feedback control. As an example, the steering control unit 166 executes a combination of feedforward control according to the radius of curvature (or curvature) of the road ahead of the host vehicle M and feedback control based on the deviation from the target trajectory.
[0050] Returning to FIG. 1, the HMI control unit 180 notifies the occupant of predetermined information through the HMI 30. The predetermined information includes, for example, information related to the traveling of the vehicle M, such as information related to the state of the vehicle M and information related to driving control. The information related to the state of the vehicle M includes, for example, the speed of the vehicle M, the engine speed, the shift position, and the like. The information related to the driving control includes, for example, information inquiring whether or not driving control is performed by automatic driving, information on the driving control status by automatic driving, information on the automation level, information prompting the occupant to drive when switching from automatic driving to manual driving, and the like. The predetermined information may also include information that is not related to the traveling of the vehicle M, such as television programs, content (for example, movies) stored in a storage medium such as a DVD, and the like. The predetermined information may also include, for example, information related to the current position and destination in automatic driving, and the remaining amount of fuel of the vehicle M. The HMI control unit 180 may output the information received by the HMI 30 to the communication device 20, the navigation device 50, the first control unit 120, and the like.
[0051] Furthermore, the HMI control unit 180 may cause the HMI 30 to output inquiry information for the occupant and the determination result by the execution feasibility determination unit 110. Furthermore, the HMI control unit 180 may transmit various information to be output by the HMI 30 via the communication device 20 to a terminal device used by the user of the vehicle M.
[0052] The driving force output device 200 outputs a driving force (torque) for the vehicle to travel to the driving wheels. The driving force output device 200 includes, for example, a combination of an internal combustion engine, an electric motor, a transmission, etc., and an ECU (Electronic Control Unit) that controls these. The ECU controls the above components according to information input from the second control unit 160 or information input from the accelerator pedal of the driving operation device 80.
[0053] The braking device 210 includes, for example, a brake caliper, a cylinder that transmits hydraulic pressure to the brake caliper, an electric motor that generates hydraulic pressure in the cylinder, and a brake ECU. The brake ECU controls the electric motor according to information input from the second control unit 160 or information input from the brake pedal of the driving operation element 80, so that a brake torque corresponding to a braking operation is output to each wheel. The braking device 210 may include a backup mechanism that transmits hydraulic pressure generated by the operation of the brake pedal to the cylinder via a master cylinder. Note that the braking device 210 is not limited to the configuration described above, and may be an electronically controlled hydraulic brake device that controls an actuator according to information input from the second control unit 160 to transmit hydraulic pressure in the master cylinder to the cylinder.
[0054] The steering device 220 includes, for example, a steering ECU and an electric motor. The electric motor changes the direction of the steered wheels by applying a force to, for example, a rack and pinion mechanism. The steering ECU drives the electric motor according to information input from the second control unit 160 or information input from the steering wheel of the driving operation device 80, to change the direction of the steered wheels.
[0055] [Recognition and Action Plan Generation] Next, the functions of the recognition unit 130 (first recognition unit 132, second recognition unit 134) and the action plan generation unit 140 (determination unit 142, execution control unit 144) will be described in detail. Note that, below, the contents of the driving control executed mainly by the execution control unit 144 will be explained by dividing them into several scenes.
[0056] [Scene 1] FIG. 3 is a diagram for explaining driving control in a first scenario. The first scenario is, for example, a case where the host vehicle M is traveling in a lane change section (for example, a section including lane increase and decrease) such as a branch section or a merging section, and there are other vehicles ahead of the host vehicle M (within a predetermined distance) in the lane in which the host vehicle M is traveling and in its adjacent lanes. In the following, a branch section will be used as an example of a lane change section for explanation. In addition, in the first scenario, the host vehicle M is traveling on the main lane in the branch section, and LKAS control is being executed. The same applies to the second and third scenarios described below.
[0057] In the example of FIG. 3, the lane lines CL1 and CL2 recognized by the detection device DD and the lane lines ML1 to ML5 obtained from the map information (for example, the second map information 62) based on the position information of the host vehicle M are shown. In the map information, the lane L1 is divided by the lane lines ML1 and ML2, the lane L2 is divided by the lane lines ML2 and ML3, and the lane L3 is divided by the lane lines ML4 and ML5. The lanes L1 and L2 are allowed to travel in the same direction (X-axis direction), and the lane L3 is a branch lane when the lanes L1 and L2 are the main lanes. In addition, in FIG. 3, the host vehicle M travels on the lane L1 at a speed VM, the other vehicle m1 is ahead of the host vehicle M's travel lane and travels on the lane L1 at a speed Vm1, and the other vehicle m2 is ahead of the host vehicle M and travels on the lane L2, which is an adjacent lane to the lane L1, at a speed Vm2. The demarcation lines CL1 and CL2 are an example of a “first demarcation line.” The demarcation lines ML1 to ML5 are an example of a “second demarcation line.”
[0058] The first recognition unit 132 recognizes the surrounding conditions of the host vehicle M based on the output of the detection device DD that detects the surrounding conditions of the host vehicle. For example, the first recognition unit 132 recognizes the left and right lane markings CL1 and CL2 that divide the lane of the host vehicle M based on an image captured by the camera 10 (hereinafter, camera image). Hereinafter, the lane markings CL1 and CL2 may be referred to as "camera lane markings CL1 and CL2". For example, the first recognition unit 132 analyzes the camera image, extracts edge points in the image that have a large luminance difference with adjacent pixels, and recognizes the camera lane markings CL1 and CL2 in the image plane by connecting the edge points. In addition, the first recognition unit 132 converts the positions of the camera lane markings CL1 and CL2 based on the position of the representative point of the host vehicle M into a vehicle coordinate system (for example, the XY plane coordinates in FIG. 3). In addition, the first recognition unit 132 may recognize, for example, the radius of curvature or the curvature of the camera lane markings CL1 and CL2. The first recognition unit 132 may also recognize the amount of curvature change of the camera lane markings CL1 and CL2. The amount of curvature change is, for example, the time rate of change of the curvature of the camera lane markings CL1 and CL1 recognized by the camera 10 at a distance X [m] forward as viewed from the vehicle M. The first recognition unit 132 may also recognize the radius of curvature, curvature, or amount of curvature change of the lane markings CL1 and CL2 by averaging the radii of curvature, curvature, or amount of curvature change of the camera lane markings CL1 and CL2. The camera lane markings CL1 and CL2 may be recognized or corrected based on the output of a detection device other than the camera 10.
[0059] Further, the first recognition unit 132 recognizes other vehicles present around the host vehicle M. For example, the first recognition unit 132 recognizes other vehicles (vehicles traveling ahead) traveling in front of the host vehicle M and within a predetermined distance from the host vehicle M based on the output of the detection device DD that detects the surrounding situation of the host vehicle M. The vehicle traveling ahead includes, for example, one or both of a preceding vehicle traveling in the same lane as the host vehicle M and a parallel vehicle traveling in an adjacent lane that can travel in the same direction as the traveling direction of the lane of the host vehicle M. When there are multiple preceding vehicles (or parallel vehicles), the preceding vehicle (or parallel vehicle) closest to the host vehicle M may be recognized. The preceding vehicle is an example of a "first other vehicle." The parallel vehicle is an example of a "second other vehicle."
[0060] In the example of FIG. 3, the first recognition unit 132 recognizes other vehicles m1 and m2 as vehicles traveling ahead. The first recognition unit 132 also recognizes the positions (relative positions with respect to the vehicle M) and speeds (relative speeds with respect to the vehicle M) of the other vehicles m1 and m2, and recognizes the travel lanes of the other vehicles m1 and m2. The first recognition unit 132 also recognizes the travel positions of the other vehicles m1 and m2 on the travel lanes. The first recognition unit 132 may also recognize travel position information of the other vehicles m1 and m2. The travel position information is, for example, travel trajectories K1 and K2 based on the positions of the representative points of the other vehicles m1 and m2 at a predetermined time when they are traveling. The first recognition unit 132 may also recognize the radius of curvature, curvature, or curvature change amount of the travel trajectories K1 and K2.
[0061] The second recognition unit 134 recognizes lane markings around (within a predetermined distance from) the host vehicle M from map information based on the position of the host vehicle M detected by, for example, the vehicle sensor 40 or the GNSS receiver 51. For example, the second recognition unit 134 refers to map information based on the position information of the host vehicle M and recognizes the marking lines ML1 to ML5 that exist in the traveling direction of the host vehicle M or in the direction in which the host vehicle M can travel. Hereinafter, the marking lines ML1 to ML5 may be referred to as "map marking lines ML1 to ML5."
[0062] Furthermore, the second recognition unit 134 may recognize map division lines ML1 and ML2, among the recognized map division lines ML1 to ML5, as division lines that divide the driving lane of the host vehicle M. Furthermore, the second recognition unit 134 recognizes the radius of curvature, the curvature, or the amount of curvature change of each of the map division lines ML1 to ML5 from the second map information 62. Furthermore, the second recognition unit 134 may recognize the radius of curvature, the curvature, or the amount of curvature change of the lane divided by the map division lines by averaging the radius of curvature, the curvature, or the amount of curvature change of each of the map division lines ML1 to ML5.
[0063] The determination unit 142 determines whether the camera demarcation lines CL1, CL2 recognized by the first recognition unit 132 match with the map demarcation lines ML1, ML2 recognized by the second recognition unit 134. For example, the determination unit 142 derives the degree of match between the demarcation lines CL1 and ML1 located closest to the left side of the host vehicle M, and the degree of match between the demarcation lines CL2 and ML2 located closest to the right side of the host vehicle M. If the derived degree of match is equal to or greater than a threshold, the determination unit 142 determines that the camera demarcation lines match with the map demarcation lines, and if the derived degree of match is less than the threshold, determines that they do not match. The determination of whether or not there is a match is repeatedly performed at a predetermined timing or period.
[0064] For example, the determination unit 142 superimposes the camera demarcation lines CL1 and CL2 and the map demarcation lines ML1 and ML2 on the plane (XY plane) of the vehicle coordinate system based on the position of the representative point of the vehicle M. Then, when determining the demarcation lines to be compared (the demarcation lines CL1 and ML1, and the demarcation lines CL2 and ML2), for example, the determination unit 142 determines that the demarcation lines match when the degree of match of each demarcation line is equal to or greater than a threshold, and determines that the demarcation lines do not match when the degree of match is less than the threshold. The match means, for example, that the deviation (for example, the amount of deviation of the lateral position) in the lateral position (for example, the Y-axis direction in the figure) is small. The deviation may be, for example, the difference in the amount of change in curvature of the demarcation lines or the angle formed by the two demarcation lines to be compared, or a combination of these. The determination unit 142 may make a determination using only one of the degree of match between the demarcation lines CL1 and ML1 or the degree of match between the demarcation lines CL2 and ML2. By performing a match determination using only one of the methods, the processing load can be reduced compared to when performing a match determination using both of the methods. Also, by determining the degree of match using both of the methods, the accuracy of the determination can be improved.
[0065] The execution control unit 144 determines the driving control to be executed by the driving control unit (the action plan generating unit 140, the second control unit 160) based on the determination result by the determination unit 142, and executes the determined driving control. "Determining the driving control" may include determining the content (type) of the driving control, and determining whether or not to execute (suppress) the driving control. "Executing the driving control" may include continuing the driving control that is already being executed, in addition to switching and executing the driving control. Suppressing the driving control may include not only not executing the driving control, but also lowering the automation level of the driving control.
[0066] Here, in the first scene, the driving control executed by the execution control unit 144 includes at least a first driving control and a second driving control. The first driving control is, for example, a driving control that executes at least steering control of the steering or speed of the host vehicle M based on a lane (for example, a lane line of a portion where the camera lane line and the map lane line match) recognized by the first recognition unit 132 or the second recognition unit 134. For example, the first driving control is a driving control that drives the host vehicle M so that a representative point of the host vehicle M passes through the center of a lane defined by lane lines. The second driving control is, for example, a driving control that executes at least steering control of the steering or speed of the host vehicle M based on a camera lane line recognized by the first recognition unit 132 and driving position information of a vehicle traveling ahead. The second driving control is, for example, a driving control in which the representative point of the vehicle M runs on a trajectory along a camera lane line among multiple camera lane lines whose shape matches the driving trajectories K1 and K2 of other vehicles m1 and m2.
[0067] Furthermore, the driving control may include a third driving control in which at least steering control of the steering or speed of the vehicle M is performed by prioritizing the camera lane lines over the map lane lines, and a fourth driving control in which at least steering control of the steering or speed of the vehicle M is performed by prioritizing the map lane lines over the camera lane lines. Prioritizing the camera lane lines over the map lane lines means, for example, that basically, processing is performed based on the camera lane lines, but when, for example, the recognition accuracy of the camera lane lines becomes lower than a threshold value or the lane lines cannot be recognized, the processing is temporarily switched to processing based on the map lane lines. Prioritizing the map lane lines over the camera lane lines means, for example, that basically, processing is performed based on the map lane lines, but when, for example, the map lane lines cannot be identified or the processing is temporarily switched to processing based on the camera lane lines. The third driving control and the fourth driving control are driving controls when, for example, the camera lane lines and the map lane lines do not match.
[0068] The driving control may include a plurality of driving controls having different automation levels (an example of the degree of automation). The automation levels include, for example, a first level, a second level having a lower degree of automation of the driving control than the first level, and a third level having a lower degree of automation of the driving control than the second level. The automation levels may also include a fourth level (an example of a fourth control degree) having a lower degree of automation of the driving control than the third level. Here, the automation level may be a level determined by standardized information, laws, regulations, etc., or may be an index value set independently of them. Therefore, the types, contents, and number of automation levels are not limited to the following examples. A low degree of automation of the driving control means, for example, that the automation rate in the driving control is low and the tasks imposed on the driver are large (severe). A low degree of automation of the driving control means that the automatic driving control device 100 controls the steering or acceleration / deceleration of the vehicle M to a low degree (the driver has a high degree of need to intervene in the steering or acceleration / deceleration operation). The tasks assigned to the driver include, for example, monitoring the surroundings of the vehicle M and operating the driving controls. The operation of the driving controls includes, for example, the state in which the driver is holding the steering wheel (hereinafter, referred to as a hands-on state). The tasks assigned to the driver include, for example, tasks for the occupant (driver tasks) required to maintain the automatic driving of the vehicle M. Therefore, if the occupant cannot execute the assigned tasks, the automation level will be lowered. For example, the first level of driving control may include, for example, driving controls such as ACC, ALC, LKAS, and TJP. Furthermore, the second or third level of driving control may include, for example, driving controls such as ACC, ALC, and LKAS. The fourth level of driving control may include manual driving. Furthermore, the fourth level of driving control may include, for example, driving controls such as ACC. Of the first to fourth levels, the first level has the highest degree of automation of driving control, and the fourth level has the lowest degree of automation of driving control.
[0069] In addition, in the first level, there is no task assigned to the occupant (the task assigned to the driver is the lightest). In addition, in the second level, the task assigned to the occupant is, for example, monitoring the surroundings (particularly the front) of the vehicle M. In addition, in the third level, the task assigned to the occupant includes, for example, being in a hands-on state in addition to monitoring the surroundings of the vehicle M. In addition, in the fourth level, the task assigned to the occupant (for example, the driver) is, for example, an operation for controlling the steering and speed of the vehicle M by the driving operator 80 in addition to monitoring the surroundings of the vehicle M and being in a hands-on state. In other words, in the case of the fourth level, the occupant is ready to immediately take over driving, and the task assigned to the driver is the heaviest. The contents of the driving control and the tasks assigned to the occupant in each automation level are not limited to the above-mentioned examples. The automatic driving control device 100 executes driving control at any one of the first to fourth levels based on the surrounding situation of the vehicle M and the task being performed by the occupant.
[0070] For example, the execution control unit 144 executes the first driving control when the determination unit 142 determines that the camera lane lines and the map lane lines match, and executes the second driving control when the determination unit 142 determines that the camera lane lines and the map lane lines do not match. The following mainly describes the second driving control in detail.
[0071] When executing the second driving control, the execution control unit 144 judges whether or not the shape of the travel trajectories K1, K2 of the other vehicles m1, m2 matches the shape of the camera lane marking in a predetermined section ahead as seen from the vehicle M. In this case, the execution control unit 144 judges that the shapes of the travel trajectories K1, K2 match the shape of the camera lane marking when the degree of match between them is equal to or greater than a threshold, and judges that they do not match when it is less than the threshold. The degree of shape match is derived, for example, based on the respective radii of curvature (which may be curvature or curvature change amount) and the change amount of distance in the predetermined section of the comparison target, without including the degree of match between the positions of the comparison targets (travel trajectories K1, K2 and camera lane markings C1, C2), and the like, and the degree of shape match is greater as the radii of curvature are closer and / or the change amount of distance is smaller. The degree of shape match may also be derived based on the angle formed by the two lane marks of the comparison target instead of (or in addition to) the radius of curvature or the change amount of distance. In this case, the smaller the angle, the greater the degree of shape match. The execution control unit 144 may make a final decision on whether the shapes match based on the average degree of match (excluding outliers) between comparison objects (e.g., the driving trajectory K1 and the camera lane marking C1, the driving trajectory K2 and the camera lane marking C2) in a predetermined section, a majority vote of the individual match determination results, or the like. In the case of a majority vote, for example, when multiple comparison objects are compared, it is determined that the shapes match if the number of matches is greater than the number of mismatches.
[0072] Then, when it is determined that the travel trajectories K1, K2 and the camera division lines C1, C2 match, the execution control unit 144 determines that the other vehicles m1, m2 are traveling in the travel direction of the lanes L1, L2, and executes a second driving control in which the host vehicle M is driven based on the camera division lines C1, C2. In this way, by using not only the travel trajectory K1 of the other vehicle m1, which is the preceding vehicle, but also the travel trajectory K2 of the other vehicle m2, which is the parallel vehicle, the reliability of the travel lane of the host vehicle M and the reliability of the camera division lines can be improved. In addition, the driving control of the LKAS, etc. can be continued, and the control continuity can be further improved. In addition, since the other vehicles m1, m2 are unlikely to change lanes at the same time, by using the respective travel trajectories K1, K2, it is possible to more appropriately determine whether the recognition of the camera division lines is correct or not, and to more appropriately switch the driving control based on the determination result.
[0073] In the first scene, the execution control unit 144 may suppress the driving control when at least one of the other vehicles m1 and m2 cannot be recognized, or when the other vehicles m1 and m2 can be recognized but at least one of the traveling trajectories K1 and K2 cannot be recognized. Even if the shape matching degree between the traveling trajectories K1 and K2 and the camera division lines C1 and C2 is equal to or greater than a threshold value, the execution control unit 144 may suppress the driving control when the distance between the traveling trajectories K1 and K2 is equal to or greater than a first predetermined distance (too far apart) or is less than a second predetermined distance smaller than the first predetermined distance (too close), since there is a high possibility that at least one of the traveling trajectories K1 and K2 has been erroneously recognized.
[0074] Furthermore, even if the shapes of the travel trajectories K1 and K2 do not match, when the shape of at least one of the travel trajectories K1 and K2 matches the shape of the camera lane markings CL1 and CL2 (when the degree of match is equal to or greater than a threshold), the execution control unit 144 may execute driving control (second driving control) based on the camera lane marking whose shape matches, and suppress driving control when the shapes do not match. This makes it possible to determine whether the lane markings recognized by the first recognition unit 132 are correct using the travel trajectories K1 and K2, and to continue driving control based on the lane markings recognized by the first recognition unit 132, the positions of other vehicles, and the like.
[0075] In addition to the above conditions, the execution control unit 144 may execute the second driving control when the first recognition unit 132 recognizes the other vehicles m1 and m2 (traveling trajectories K1 and K2) within the first predetermined period (that is, when the timing of recognition of each vehicle is within the first predetermined period), and may not execute the second driving control (or execute a control other than the first driving control and the second driving control) when the other vehicles are not recognized within the first predetermined period. This allows the driving control to be continuously executed, so that contact with objects on the road can be avoided more reliably.
[0076] Furthermore, when it is determined that the camera lane lines and the map lane lines do not match, the execution control unit 144 continues the second driving control based on the determination result using the travel routes K1 and K2. However, even if it is determined that they match after that, the execution control unit 144 may continue the second driving control without switching to another driving control until a predetermined time has elapsed since the execution of the second driving control was started. This makes it possible to suppress frequent switching of the driving control and to make the driving control more stable. Furthermore, when it is determined that the camera lane lines and the map lane lines do not match, the execution control unit 144 may end the second driving control when a predetermined time has elapsed since the execution of the second driving control was started based on the determination result using the travel trajectories K1 and K2 (or when the host vehicle M has traveled a predetermined distance). This makes it possible to suppress the driving control from being continued for a long time in a state in which it is determined that the camera lane lines and the map lane lines do not match. In this case, the execution control unit 144 may switch to manual driving, or may execute control to lower the automation level of the driving control below the current level. Note that the execution control unit 144 may set a condition that the host vehicle M travels a predetermined distance or more instead of (or in addition to) the passage of the above-mentioned predetermined time.
[0077] According to the first scenario described above, even if the camera markings and the map markings do not match in a lane change section, the driving control content is determined using the driving trajectory of the vehicle traveling ahead, so that more appropriate driving control can be executed. Therefore, the continuity of driving control (e.g., LKAS control) can be improved. In addition, in the first scenario, the driving trajectories of both the preceding vehicle and the vehicle traveling alongside can be used to more accurately estimate changes in the entire road.
[0078] [Second scene] Next, the second scene will be described. The second scene is, for example, a scene in which, compared to the first scene, a preceding vehicle (first other vehicle) is present among the vehicles traveling ahead, but a parallel vehicle (second other vehicle) is not present. In this case, the execution control unit 144 determines whether or not the second driving control is executable based on the positional relationship between the camera division line and the map division line, and the vehicle width of the preceding vehicle. The following mainly describes the contents different from the first scene, and omits a description of the same processing as the first scene. The same applies to the third scene described below.
[0079] Fig. 4 is a diagram for explaining driving control in the second scene. In the example of Fig. 4, similar to Fig. 3, camera lane lines CL1 and CL2 recognized by the camera 10 included in the detection device DD and map lane lines ML1 to ML5 recognized with reference to map information based on position information of the host vehicle M are shown. In Fig. 4, the host vehicle M is traveling on the lane L1 at a speed VM, and another vehicle m1 is ahead of the host vehicle M and traveling on the lane L1 at a speed Vm1.
[0080] In the second scene, when the camera lane markings and the map lane markings match, the execution control unit 144 executes the first driving control. On the other hand, when it is determined that they do not match, the execution control unit 144 determines the driving control to be executed based on, for example, the positional relationship between the camera lane markings CL1 and CL2 and the travel trajectory K1 of the other vehicle m1.
[0081] For example, the execution control unit 144 determines whether the camera lane markings CL1 and CL2 are parallel to the travel trajectory K1 of the other vehicle m1. For example, the execution control unit 144 determines that the camera lane markings CL1 and CL2 are parallel to the travel trajectory K1 of the other vehicle m1 when a change amount ΔD1 in a distance (shortest distance) D1 between the travel trajectory K1 of the other vehicle m1 and the camera lane marking CL1 is equal to or greater than a threshold value, and determines that the camera lane markings CL1 are not parallel to the travel trajectory K1 when the change amount ΔD1 is less than the threshold value. The change amount ΔD1 is, for example, a change amount in a distance (width) between the travel trajectory K1 and each point plotted at a predetermined interval in the extension direction of the camera lane marking CL1 in a section from the position of the vehicle M to a predetermined process. Note that the execution control unit 144 may use the distance between the travel trajectory K1 and the camera lane marking CL2 instead of (or in addition to) the distance between the travel trajectory K1 and the camera lane marking CL1. Furthermore, the execution control unit 144 may determine that the driving trajectory K1 and the camera lane marking CL1 (or CL2) are parallel when the degree of shape match between them is equal to or greater than a threshold, and may determine that they are not parallel when the degree is less than the threshold. When it is determined that they are parallel, the execution control unit 144 executes a second driving control based on the target camera lane marking that is parallel, or executes a third driving control by prioritizing the camera lane marking over the map lane marking, and suppresses the execution of the driving control when it is determined that they are not parallel. In this way, in the second scene, even if the camera lane marking and the map lane marking do not match, driving control can be executed (continued) when the camera lane markings CL1, CL2 and the driving trajectory K1 are parallel.
[0082] Also, in the second scene, when it is determined that the camera demarcation lines and the map demarcation lines do not match, the execution control unit 144 may determine the driving control to be executed for the positional relationship between the map demarcation lines ML4, ML5 of the branch lane L3 and the camera demarcation lines CL1, CL2 and the position of the other vehicle m1. For example, the execution control unit 144 determines whether the camera demarcation lines CL1, CL2 are included in the branch lane L3. In this case, the execution control unit 144 may determine whether at least one of the demarcation lines CL1, CL2 exists in the lane L3. In the example of FIG. 4, neither of the demarcation lines CL1, CL2 exists in the branch lane L3. In addition, the other vehicle m1 is not traveling in the branch lane L3. In this case, when the execution control unit 144 recognizes the above content, it determines that the district demarcation lines ML4, ML5 are incorrect (or are not of the latest map), and executes the third driving control by prioritizing the camera demarcation lines over the map demarcation lines. In this case, the execution control unit 144 executes, for example, the fourth level driving control in the hands-on state.
[0083] FIG. 5 is a diagram for explaining a case where the camera lane markings exist within a lane marked by map lane markings. The example of FIG. 5 shows a scene where the camera lane markings CL1 and CL2 do not match the map lane markings ML4 and ML5, and both the camera lane markings CL1 and CL2 exist within the branch lane L3. In this case, a lane marked by the camera lane markings CL1 and CL2 exists within the branch lane L3, and there is a possibility that another vehicle m1 is traveling in the branch direction. Therefore, in this case, the execution control unit 144 executes driving control (fourth driving control) by prioritizing the map lane markings over the camera lane markings. In this case, the execution control unit 144 executes, for example, a second level driving control in a state where the driver is not gripping the steering wheel (hereinafter, referred to as a hands-off state).
[0084] FIG. 6 is a diagram for explaining a case where one of the camera lane markings CL1 and CL2 exists in the branch lane L3. In the example of FIG. 6, the lane marking CL1 exists in the branch lane L3. In this case, it is not possible to determine whether the other vehicle m1 is traveling in the branch lane or in the lane divided by the lane markings CL1 and CL2 only from the positional relationship between the branch lane L3 and the lane markings CL1 and CL2. Therefore, the execution control unit 144 determines the driving control to be executed based on the distance Wa between the camera lane marking CL1 in the lane L3 and the map lane marking ML5 on the other vehicle m1 side (on the side overlapping the other vehicle m1) as viewed from the camera lane marking CL1, among the camera lane markings and the map lane markings (more specifically, the map lane markings extending along the traveling direction of the other vehicle m1) recognized by the first recognition unit 132 and the second recognition unit 134, and the vehicle width Wb of the other vehicle m1 acquired by communicating with the other vehicle m1 through the camera image or vehicle-to-vehicle communication. The distance Wa may be the average distance or the shortest distance in a predetermined section when the camera division line CL1 and the map division line CL2 do not extend in the same direction (are not parallel). In addition, the vehicle width Wb may be the actual vehicle width of the other vehicle m1 plus a predetermined margin.
[0085] For example, if it is determined that the distance Wa is not greater than the vehicle width Wb (the distance Wa is equal to or less than the vehicle width Wb (Wa≦Wb)), the executive control unit 144 executes the third driving control by prioritizing the camera lane lines over the map lane lines. In this case, the executive control unit 144 executes, for example, the fourth level driving control in a hands-on state. Also, if the executive control unit 144 determines that the distance Wa is greater than the vehicle width Wb (Wa>Wb), it executes driving control (fourth driving control) by prioritizing the map lane lines over the camera lane lines. In this case, the executive control unit 144 executes, for example, the second level driving control in a hands-off state. Note that the executive control unit 144 may add, to the conditions, the case where the vehicle is in a branch lane L3 in which another vehicle m1 is present, in addition to the case where the executive control unit 144 determines that the distance Wa is greater than the vehicle width Wb.
[0086] In the second scene, when the camera lane line and the map lane line do not match, the executive control unit 144 may determine whether the angle (divergence angle) between the branch lane line and the camera lane line is a predetermined angle or more before determining whether at least one of the camera lane lines CL1 and CL2 is in the branch lane L3. If it is determined that the divergence angle is the predetermined angle or more, the executive control unit 144 executes driving control (third driving control) by prioritizing the camera lane line over the map lane line. In this case, the executive control unit 144 executes, for example, a third or fourth level driving control in a hands-on state. Also, if it is determined that the divergence angle is not the predetermined angle or more, the executive control unit 144 determines driving control according to whether at least one of the camera lane lines CL1 and CL2 is in the branch lane L3, as described above.
[0087] In the second scenario, the execution control unit 144 may suppress driving control when there is no preceding vehicle m1 and only a parallel vehicle is present. The execution control unit 144 may also suppress driving control when the other vehicle m1 changes (moves) from lane L1 to lane L2, thereby changing from a preceding vehicle to a parallel vehicle. This allows the execution control unit 144 to more appropriately execute (or suppress) driving control based on the presence or absence of a vehicle traveling ahead and its behavior.
[0088] In the second situation, when the camera lane line and the map lane line match after the execution of the driving control, the execution control unit 144 may continue the driving control until a predetermined period has elapsed since the execution of the driving control. This can suppress frequent switching of the driving control and make the driving control more stable. In addition, the execution control unit 144 may end the driving control after a predetermined period has elapsed since the execution of the driving control in a state in which it is determined that the camera lane line and the map lane line do not match. This can suppress the driving control from continuing for a long time in a state in which it is determined that the camera lane line and the map lane line do not match. In this case, the execution control unit 144 may switch to manual driving, or may execute control to lower the automation level of the driving control below the current level. Note that the execution control unit 144 may set a condition that the host vehicle M travels a predetermined distance or more instead of (or in addition to) the predetermined time elapses.
[0089] According to the second scenario described above, even if the camera division line and the map division line do not match in a lane change section, if the travel trajectory of the preceding vehicle extends along the camera division line (if the travel trajectory and the camera division line are parallel, or if the change in the distance between the travel trajectory of the preceding vehicle and the camera division line is less than a threshold), driving control (e.g., LKAS control) can be continued, improving the continuity of driving control. Also, more appropriate driving control can be executed based on the deviation amount (including the deviation angle) between the camera division line and the map division line and the relationship with the vehicle width of the preceding vehicle.
[0090] [Scene 3] Next, the third situation will be described. The third situation is, for example, a situation in which the camera lane markings and the map lane markings do not match in a branching section including a branching lane, and no vehicle ahead is present in the vicinity (or only vehicles traveling parallel to the camera lane may be present). In this case, when the camera lane markings and the map lane markings do not match, the execution control unit 144 determines the driving control to be executed based on one or both of the positional relationship and the angle difference (deviation angle) between the camera lane markings and the map lane markings.
[0091] Fig. 7 is a diagram for explaining driving control in scene 3. In the example of Fig. 7, it is assumed that the first recognition unit 132 recognizes the lane lines CL1 to CL3 as camera lane lines, and the second recognition unit 134 recognizes the lane lines ML1 to ML5 as map lane lines.
[0092] In the example of Fig. 7, the determination unit 142 determines whether or not the demarcation lines CL1 and ML1, or the demarcation lines CL2 and ML2, match. If the determination unit 142 determines that they do not match and there is no vehicle traveling ahead, the execution control unit 144 determines whether or not the map demarcation line ML5, of the pair of map demarcation lines ML4 and ML5, which is present at a position away from the host vehicle M, is present in the lane defined by the pair of camera demarcation lines CL1 and CL2 in the branching direction of the traveling lane (left side in the figure). If the map demarcation line ML5 is present in the lane defined by the camera demarcation lines CL1 and CL2, the execution control unit 144 determines whether or not the distances Wc1 and Wc2 between the camera demarcation lines CL1 and CL2 and the map demarcation line ML5, respectively, are equal to or greater than a predetermined distance Dth1. When the distances Wc1 and Wc2 are equal to or greater than the predetermined distance Dth1, and when another camera lane marking CL3 is recognized closer to the vehicle M than the camera lane marking CL1 in the branching direction, the execution control unit 144 executes a third driving control that prioritizes traveling along the lane marked by the camera lane marking. The other camera lane marking CL3 is an example of an "other lane marking." Note that the execution control unit 144 may execute the third driving control when, in addition to the camera lane marking CL3 being recognized, the distance between the camera lane marking CL3 and the map lane marking ML4 that is closest to the camera lane marking CL3 is less than a threshold value.
[0093] Furthermore, when one of the distances Wc1, Wc2 is less than the predetermined distance Dth1 and the camera lane marking CL3 is not recognized, the execution control unit 144 executes a fourth driving control that prioritizes traveling on the lane marked by the map lane marks ML4, ML5. This allows the driving control to be executed (continued) based on the positional relationship and recognition status of the lane marks even when the camera lane marking and the map lane marking do not match and there is no vehicle traveling ahead.
[0094] FIG. 8 is a diagram for explaining the determination of the driving control to be executed based on the angle (deviation angle) between the camera demarcation line and the map demarcation line. In the example of FIG. 8, the determination unit 142 determines whether the demarcation lines CL1 and ML1, or the demarcation lines CL2 and ML2, match. If the determination unit 142 determines that they do not match and there is no vehicle traveling ahead, the execution control unit 144 recognizes the angle difference between the extension directions of the camera demarcation line and the map demarcation line. For example, the execution control unit 144 determines whether the angle formed by the first direction, which is the extension direction of the camera demarcation lines CL1 and CL2, and the second direction, which is the extension direction of the map demarcation lines ML4 and ML5 that demarcate the branch lane L3, is equal to or greater than a predetermined angle θth. In the example of FIG. 8, it is determined whether the angle θ1 formed by the first direction at the camera demarcation line CL1 and the second direction at the map demarcation line ML5 is equal to or greater than a predetermined angle θth, but the angle formed by the camera demarcation line CL2 and the map demarcation line ML4 may be used. However, by using the angle θ1 between the map marking lines ML5, which is farther from the vehicle M, of the map marking lines ML4, ML5 connecting to the branch lane L3, and the marking line CL1 on the branch lane L3 side of the camera marking lines CL1, CL2, a more appropriate judgment can be made using the recognition results of the side where the lane is changing.
[0095] Furthermore, instead of (or in addition to) making the determination based on the angle θ1, the execution control unit 144 may determine whether the angle θ2 between the first direction on the camera lane line CL1 and the second direction on the map lane line ML1 is equal to or greater than a predetermined angle θth. If the execution control unit 144 determines that the angle θ1 (or θ2) is equal to or greater than the predetermined angle θth, it determines that the camera lane line recognized by the first recognition unit 132 is correct, and decides to execute the third driving control.
[0096] In addition, in the third scene, when the camera lane line and the map lane line match after executing the driving control such as the third driving control or the fourth driving control, the execution control unit 144 may continue the driving control until a predetermined period has elapsed since the driving control was executed. This can suppress frequent switching of the driving control and make the driving control more stable. In addition, the execution control unit 144 may end the driving control after a predetermined period has elapsed since the driving control was executed in a state in which it was determined that the camera lane line and the map lane line do not match. This can suppress the driving control from continuing for a long time in a state in which it was determined that the camera lane line and the map lane line do not match. In this case, the execution control unit 144 may switch to manual driving, or may execute control to lower the automation level of the driving control below the current level. Note that the execution control unit 144 may set a condition that the host vehicle M travels a predetermined distance or more instead of (or in addition to) the predetermined time elapses.
[0097] According to the third scenario described above, even if the camera marking lines and the map marking lines do not match in a lane change section and there is no vehicle traveling ahead, more appropriate driving control can be performed based on the relative deviation between the camera marking lines and the map marking lines and the angle formed by each of the marking lines, thereby improving the continuity of driving control (e.g., LKAS control).
[0098] [Processing flow] The following describes the processing executed by the automatic driving control device 100 of the embodiment. The following mainly describes the driving control processing based on the recognition status of the lane markings, etc., among the processing executed by the automatic driving control device 100. The following describes several examples. The processing described below may be repeatedly executed at a predetermined timing or at a predetermined cycle, and may be repeatedly executed while automatic driving by the automatic driving control device 100 is being executed.
[0099] [First Example] FIG. 9 is a flowchart showing an example of the flow of the driving control process in the first embodiment. In the example of FIG. 9, the first recognition unit 132 recognizes the lane markings (camera lane markings) existing around the host vehicle M based on the output of the detection device DD that detects the surrounding situation of the vehicle (step S100). Next, the second recognition unit 134 refers to map information based on the position information of the host vehicle M, and recognizes the lane markings (map lane markings) existing around the host vehicle M from the map information (step S110). Next, the determination unit 142 compares the camera lane markings with the map lane markings (step S120), and determines whether the camera lane markings and the map lane markings match (step S130).
[0100] If it is determined that the camera lane line and the map lane line match, the executive control unit 144 executes driving control (first driving control) based on the matched lane line (camera lane line or map lane line) (step S140). If it is determined that the camera lane line and the map lane line do not match, the executive control unit 144 determines whether or not there is another vehicle (vehicle traveling ahead) traveling ahead of the host vehicle M (step S150). If it is determined that there is a vehicle traveling ahead, the executive control unit 144 executes driving control (second driving control) based on the traveling position information of the vehicle traveling ahead (step S160). If it is determined that there is no vehicle traveling ahead in the processing of step S150, the executive control unit 144 suppresses driving control (step S170). This ends the processing of this flowchart.
[0101] [Second Example] 10 is a flowchart showing an example of the flow of the operation control process in the second embodiment. The second embodiment differs from the above-mentioned first embodiment in that the process of steps S160 to S170 is replaced by the process of steps S200 to S280. Therefore, the following description will be mainly focused on the process of steps S200 to S280.
[0102] In the process of step S150 in FIG. 10, if a vehicle traveling ahead exists, it is determined whether or not a preceding vehicle and a vehicle traveling parallel exist as the vehicle traveling ahead (step S200). If it is determined that a preceding vehicle and a vehicle traveling parallel exist, the execution control unit 144 executes a first control process described later (step S220). The first control process is, for example, a process executed in the first situation described above. If it is determined that a preceding vehicle and a vehicle traveling parallel do not exist, the execution control unit 144 determines whether or not only a preceding vehicle exists (step S240). If it is determined that only a preceding vehicle exists, the execution control unit 144 executes a second control process described later (step S260). The second control process is, for example, a process executed in the second situation described above. If it is determined that only a preceding vehicle does not exist (in other words, if it is determined that a vehicle traveling parallel exists), the execution control unit 144 executes a third control process described later (step S280). Also, when it is determined in step S150 that there is no preceding vehicle, the execution control unit 144 executes the third control process. The third control process is, for example, the process executed in the third scene described above. Then, the process of this flowchart ends.
[0103] [First control process] FIG. 11 is a flowchart showing an example of the flow of the first control process. In the example of FIG. 11, the execution control unit 144 acquires the travel trajectories of the preceding vehicle and the vehicle traveling parallel to each other (step S221). Next, the execution control unit 144 compares each travel trajectory with the camera lane marking (step S222) and determines whether the shapes match in a predetermined section (step S223). In the process of step S223, for example, the execution control unit 144 finally determines whether the shapes match in a predetermined section by averaging the degree of match of the comparison targets (excluding outliers) or by majority vote of individual match determination results. If it is determined that the shapes match, the execution control unit 144 executes driving control (second driving control) based on the camera lane marking (step S224).
[0104] Furthermore, if it is determined in the process of step S223 that the shapes do not match, the executive control unit 144 suppresses the second operational control (step S225), which ends the process of this flowchart.
[0105] [Second control process] FIG. 12 is a flowchart showing an example of the flow of the second control process. In the example of FIG. 12, the execution control unit 144 acquires a travel trajectory of the preceding vehicle (step S261). Next, the execution control unit 144 compares the acquired travel trajectory with the camera lane marking (step S262) and determines whether or not the change in distance is less than the threshold (step S263). If it is determined that the change in distance is less than the threshold, the execution control unit 144 executes driving control based on the camera lane marking (second driving control) or driving control prioritizing the camera lane marking (third driving control) (step S264). Also, if it is determined in step S263 that the change in distance is not less than the threshold (is equal to or greater than the threshold), the execution control unit 144 suppresses the driving control (step S265). This ends the process of this flowchart.
[0106] In the second control process, instead of the process of FIG. 12, the driving control may be switched based on the positional relationship between the camera division line and the map division line and the vehicle width of the preceding vehicle. FIG. 13 is a flowchart showing an example of the process flow of a modified example of the second control process. In the example of FIG. 13, the execution control unit 144 determines whether the angle formed by the extension directions of two division lines (camera division line, map division line) is equal to or greater than a predetermined angle (step S270). If it is determined that the angle is not equal to or greater than the predetermined angle, the execution control unit 144 determines whether the camera division line exists within the lane divided by the map division line (step S271). If it is determined that the camera division line exists within the lane divided by the map division line, the execution control unit 144 determines whether two camera division lines exist within the lane divided by the map division line (step S272).
[0107] If it is determined that there are no two camera lane marks, the execution control unit 144 obtains the distance Wa between the camera lane marking present in the lane and the map lane marking present on the leading vehicle side as viewed from the camera lane marking (step S273), and obtains the vehicle width Wb of the leading vehicle (step S274). The processing order of steps S273 and S274 may be reversed.
[0108] Next, the execution control unit 144 judges whether the distance Wa is greater than the vehicle width Wb (step S275). If it is judged that the distance Wa is not greater than the vehicle width Wb (the distance Wa is equal to or less than the vehicle width Wb), the execution control unit 144 executes driving control (third driving control) by prioritizing the camera lane markings (step S276). In this case, the execution control unit 144 executes driving control of the fourth level in the hands-on state by prioritizing the camera lane markings, for example. Also, if it is judged that the distance Wa is greater than the vehicle width Wb, or if two camera lane markings exist within the lane in the processing of step S272, the execution control unit 144 executes driving control (fourth driving control) by prioritizing the map lane markings (step S277). In this case, the execution control unit 144 executes driving control of the second level in the hands-off state, for example. In addition to the case where the execution control unit 144 judges that the distance Wa is greater than the vehicle width Wb, the execution control unit 144 may add the case where the vehicle m1 exists in the branch lane L3 in which the other vehicle m1 exists to the conditions.
[0109] Also, in the process of step S271, if it is determined that the camera lane marking does not exist within the lane marked by the map lane marking, the executive control unit 144 executes driving control based on the camera lane marking (third driving control) (step S276). In this case, the executive control unit 144 executes driving control of the fourth level in the hands-on state, for example, by prioritizing the camera lane marking. Also, in the process of step S270, if it is determined that the angle is equal to or greater than a predetermined angle, the executive control unit 144 executes driving control based on the camera lane marking (third driving control) (step S276). In this case, the executive control unit 144 executes driving control of the third or fourth level in the hands-on state, for example, by prioritizing the camera lane marking. This ends the process of this flowchart.
[0110] [Third control process] FIG. 14 is a flowchart showing an example of the flow of the third control process. In the example of FIG. 14, the execution control unit 144 compares the positions of the camera lane line and the map lane line and the extension direction of each lane line (step S281). Next, the execution control unit 144 determines whether the distance between the camera lane line and the map lane line is equal to or greater than a predetermined distance (step S282). If it is determined that the distance is equal to or greater than the predetermined distance, the execution control unit 144 determines whether another camera lane line is recognized in the branching direction (step S283). If it is determined that another camera lane line is recognized, the execution control unit 144 executes driving control (third driving control) that causes the host vehicle M to travel with priority given to the camera lane line over the map lane line (step S284). In this case, the execution control unit 144 executes, for example, third or fourth level driving control in a hands-on state with priority given to the camera lane line.
[0111] Furthermore, if it is determined in the process of step S282 that the distance between the camera lane line and the map lane line is not equal to or greater than the predetermined distance, or if it is determined in the process of step S283 that another camera lane line is not recognized in the branching direction, the execution control unit 144 determines whether or not the angle formed by the extension directions of the two lane lines (camera lane line, map lane line) is equal to or greater than a predetermined angle (step S285). The predetermined angle here may be a value different from the predetermined angle in the process of step S270 described above. If it is determined that the angle is equal to or greater than the predetermined angle, the execution control unit 144 executes the process of step S284. If it is determined that the angle is not equal to or greater than the predetermined angle (is less than the predetermined angle), the execution control unit 144 executes driving control by prioritizing the map lane line over the camera lane line (step S286). This ends the process of this flowchart.
[0112] [Variations] The processing of the execution control unit 144 in the first to third scenarios described above is executed, for example, when the vehicle M is traveling through a lane change section or is predicted to travel through it (when traveling within a predetermined distance from a lane change section), and other driving controls may be executed in other road conditions (for example, when traveling through a section that is not a lane change section).
[0113] Furthermore, even in the first scenario (for example, when a preceding vehicle and a vehicle running parallel to the vehicle M exist), the executive control unit 144 may perform processing similar to that described in the second scenario to determine the driving control of the vehicle M, and even in the first and second scenarios when a preceding vehicle exists, the executive control unit 144 may perform processing similar to that described in the third scenario to determine the driving control to be executed by the vehicle M. For example, even in the first scenario, if the recognition accuracy (index value indicating the likelihood of whether the recognized preceding vehicle and the vehicle running parallel to the vehicle M are other vehicles running in the lane in which the vehicle M is running or an adjacent lane) of the recognized preceding vehicle and the vehicle running parallel to the vehicle M is equal to or lower than a threshold value, the executive control unit 144 executes processing for the third scenario.
[0114] Furthermore, when there are multiple preceding vehicles (or vehicles running parallel to one another), the execution control unit 144 uses the preceding vehicle (or vehicle running parallel to one another) that is closest to the vehicle M to determine which driving control to execute. However, if the preceding vehicle (or vehicle running parallel to one another) is a specific vehicle (emergency vehicle) such as a police vehicle or fire engine, it may be excluded from the vehicles to be determined, since it may behave differently from a normal vehicle (general vehicle).
[0115] According to the above-described embodiment, in the vehicle control device, a first recognition unit 132 recognizes the surrounding conditions including a first dividing line that divides the lane of the host vehicle M and a vehicle traveling ahead of the host vehicle M based on the output of a detection device that detects the surrounding conditions of the host vehicle M, a second recognition unit 134 recognizes a second dividing line that divides the lanes around the host vehicle M from map information based on the position information of the host vehicle M, and at least the steering or speed of the host vehicle is controlled based on the recognition results of the first recognition unit 132 and the second recognition unit 134. The driving control unit (action plan generating unit 140, second control unit 160) executes driving control to determine whether the vehicle M is traveling in a lane change section, and when the first and second demarcation lines recognized by the first recognition unit 132 match, the driving control unit executes a first driving control based on the matching demarcation line, and when the first and second demarcation lines do not match, the driving control unit executes a second driving control based on the traveling position information of the vehicle traveling ahead, thereby enabling more appropriate driving control to be executed according to the recognition result of the surroundings of the vehicle. In addition, according to the embodiment, the continuity of the driving control can be further improved. This can ultimately contribute to the development of a sustainable transportation system.
[0116] In addition, according to the embodiment, in lane change sections where the camera division lines and the map division lines are likely to be mismatched, driving control can be executed (continued) using more appropriate information based on the amount of deviation and angle difference between the camera division lines and the map division lines, the driving trajectory when a vehicle is traveling ahead, the width of the preceding vehicle, etc.
[0117] The above-described embodiment can be expressed as follows. a storage medium for storing computer-readable instructions; a processor coupled to the storage medium; The processor executes the computer-readable instructions to: Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead. Operation control device.
[0118] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]
[0119] 1...vehicle system, 10...camera, 12...radar device, 14...LIDAR, 16...object recognition device, 20...communication device, 30...HMI, 40...vehicle sensor, 50...navigation device, 60...MPU, 80...driving operator, 100...automatic driving control device, 110...execution feasibility determination unit, 120...first control unit, 130...recognition unit, 132...first recognition unit, 134...second recognition unit, 140...action plan generation unit, 142...determination unit, 144...execution control unit, 160...second control unit, 162...target trajectory acquisition unit, 164...speed control unit, 166...steering control unit, 180...HMI control unit, 190...memory unit, 200...driving force output device, 210...brake device, 220...steering device, M...own vehicle, SV...management server
Claims
1. A first recognition unit that recognizes a surrounding situation including a first dividing line that divides a lane of the host vehicle and a forward traveling vehicle that is present in front of the host vehicle based on an output of a detection device that detects a surrounding situation of the host vehicle; a second recognition unit that recognizes a second division line that divides a lane around the host vehicle from map information based on position information of the host vehicle; A driving control unit that executes driving control to control at least the steering of the vehicle based on the recognition results of the first recognition unit and the second recognition unit, the driving control unit executes a first driving control based on the matching demarcation line when the host vehicle is traveling in a lane change section and the first demarcation line recognized by the first recognition unit coincides with the second demarcation line, and executes a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead when the first demarcation line does not coincide with the second demarcation line, The preceding vehicle includes a first other vehicle traveling on a driving lane of the host vehicle, and a second other vehicle traveling on a lane adjacent to the driving lane of the host vehicle. Vehicle control device.
2. A first recognition unit that recognizes a surrounding situation including a first dividing line that divides a lane of the host vehicle and a forward traveling vehicle that is present in front of the host vehicle based on an output of a detection device that detects a surrounding situation of the host vehicle; a second recognition unit that recognizes a second division line that divides a lane around the host vehicle from map information based on position information of the host vehicle; A driving control unit that executes driving control to control at least the steering of the vehicle based on the recognition results of the first recognition unit and the second recognition unit, the driving control unit executes a first driving control based on the matching demarcation line when the host vehicle is traveling in a lane change section and the first demarcation line recognized by the first recognition unit coincides with the second demarcation line, and executes a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead when the first demarcation line does not coincide with the second demarcation line, The traveling position information includes a traveling locus, The driving control unit executes a second driving control when the first division line and a driving trajectory of the forward traveling vehicle coincide with each other. Vehicle control device.
3. A first recognition unit that recognizes a surrounding situation including a first dividing line that divides a lane of the host vehicle and a forward traveling vehicle that is present in front of the host vehicle based on an output of a detection device that detects a surrounding situation of the host vehicle; a second recognition unit that recognizes a second division line that divides a lane around the host vehicle from map information based on position information of the host vehicle; A driving control unit that executes driving control to control at least the steering of the vehicle based on the recognition results of the first recognition unit and the second recognition unit, the driving control unit executes a first driving control based on the matching demarcation line when the host vehicle is traveling in a lane change section and the first demarcation line recognized by the first recognition unit coincides with the second demarcation line, and executes a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead when the first demarcation line does not coincide with the second demarcation line, the driving control unit determines whether or not one of two first dividing lines that divide the vehicle's driving lane recognized by the first recognition unit matches one of two second dividing lines that divide the vehicle's driving lane recognized from the map information; Vehicle control device.
4. A first recognition unit that recognizes a surrounding situation including a first dividing line that divides a lane of the host vehicle and a forward traveling vehicle that is present in front of the host vehicle based on an output of a detection device that detects a surrounding situation of the host vehicle; a second recognition unit that recognizes a second division line that divides a lane around the host vehicle from map information based on position information of the host vehicle; A driving control unit that executes driving control to control at least the steering of the vehicle based on the recognition results of the first recognition unit and the second recognition unit, the driving control unit executes a first driving control based on the matching demarcation line when the host vehicle is traveling in a lane change section and the first demarcation line recognized by the first recognition unit coincides with the second demarcation line, and executes a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead when the first demarcation line does not coincide with the second demarcation line, When the first demarcation line and the second demarcation line coincide with each other after the second driving control is executed, the driving control unit continues the second driving control until a predetermined period of time has elapsed or a predetermined distance has been traveled since the second driving control is executed. Vehicle control device.
5. A first recognition unit that recognizes a surrounding situation including a first dividing line that divides a lane of the host vehicle and a forward traveling vehicle that is present in front of the host vehicle based on an output of a detection device that detects a surrounding situation of the host vehicle; a second recognition unit that recognizes a second division line that divides a lane around the host vehicle from map information based on position information of the host vehicle; A driving control unit that executes driving control to control at least the steering of the vehicle based on the recognition results of the first recognition unit and the second recognition unit, the driving control unit executes a first driving control based on the matching demarcation line when the host vehicle is traveling in a lane change section and the first demarcation line recognized by the first recognition unit coincides with the second demarcation line, and executes a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead when the first demarcation line does not coincide with the second demarcation line, The driving control unit ends the second driving control after a predetermined period of time has elapsed or a predetermined distance has been traveled since the second driving control was executed. Vehicle control device.
6. The traveling position information includes a traveling locus, the driving control unit acquires driving trajectories of the first other vehicle and the second other vehicle, and executes the second driving control when a shape of each of the acquired driving trajectories matches a shape of the first division line. The vehicle control device according to claim 1.
7. The driving control unit executes the second driving control when the first recognition unit recognizes the first other vehicle and the second other vehicle within a predetermined period of time. The vehicle control device according to claim 1.
8. The driving control unit executes the first driving control and the second driving control when the host vehicle or a user of the host vehicle has authority to execute the driving control. The vehicle control device according to claim 1.
9. The computer Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead, The preceding vehicle includes a first other vehicle traveling on a driving lane of the host vehicle, and a second other vehicle traveling on a lane adjacent to the driving lane of the host vehicle. A vehicle control method.
10. The computer Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead, The traveling position information includes a traveling locus, executes a second driving control when the first division line coincides with a travel path of the forward traveling vehicle. A vehicle control method.
11. The computer Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead, determining whether or not one of two first dividing lines that divide the lane in which the host vehicle is traveling and that are recognized based on the output of the detection device matches one of two second dividing lines that divide the lane in which the host vehicle is traveling and that are recognized from the map information; A vehicle control method.
12. The computer Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead, When the first demarcation line and the second demarcation line coincide with each other after the second driving control is executed, the second driving control is continued until a predetermined period of time has elapsed or a predetermined distance has been traveled since the second driving control was executed. A vehicle control method.
13. The computer Based on an output from a detection device that detects a surrounding situation of the host vehicle, the surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; Recognizing a second dividing line that divides a lane around the host vehicle from map information based on the position information of the host vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognition result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control is executed based on the coincident demarcation line, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control is executed based on the first demarcation line and traveling position information of the vehicle traveling ahead, After a predetermined period of time has elapsed or a predetermined distance has been traveled since the second operational control was executed, the second operational control is terminated. A vehicle control method.
14. On the computer, Based on an output from a detection device that detects a surrounding situation of the host vehicle, a surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; a second dividing line that divides a lane around the vehicle is recognized from map information based on the position information of the vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognized result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control based on the coincident demarcation line is executed, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead is executed, The preceding vehicle includes a first other vehicle traveling on a driving lane of the host vehicle, and a second other vehicle traveling on a lane adjacent to the driving lane of the host vehicle. program.
15. On the computer, Based on an output from a detection device that detects a surrounding situation of the host vehicle, a surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; a second dividing line that divides a lane around the vehicle is recognized from map information based on the position information of the vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognized result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control based on the coincident demarcation line is executed, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead is executed, The traveling position information includes a traveling locus, executing a second driving control when the first division line and a traveling path of the forward traveling vehicle coincide with each other; program.
16. On the computer, Based on an output from a detection device that detects a surrounding situation of the host vehicle, a surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; a second dividing line that divides a lane around the vehicle is recognized from map information based on the position information of the vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognized result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control based on the coincident demarcation line is executed, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead is executed, determining whether or not one of two first dividing lines that divide the vehicle's travel lane recognized based on the output of the detection device matches one of two second dividing lines that divide the vehicle's travel lane recognized from the map information; program.
17. On the computer, Based on an output from a detection device that detects a surrounding situation of the host vehicle, a surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; a second dividing line that divides a lane around the vehicle is recognized from map information based on the position information of the vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognized result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control based on the coincident demarcation line is executed, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead is executed, When the first demarcation line and the second demarcation line coincide with each other after the second driving control is executed, the second driving control is continued until a predetermined period of time has elapsed or a predetermined distance has been traveled since the second driving control was executed. program.
18. On the computer, Based on an output from a detection device that detects a surrounding situation of the host vehicle, a surrounding situation including a first dividing line that divides a lane around the host vehicle and a forward traveling vehicle that is present in front of the host vehicle is recognized; a second dividing line that divides a lane around the vehicle is recognized from map information based on the position information of the vehicle; Executing a driving control for controlling at least the steering of the vehicle or the speed of the vehicle based on the recognized result; When the host vehicle is traveling in a lane change section and the first demarcation line and the second demarcation line coincide with each other, a first driving control based on the coincident demarcation line is executed, and when the first demarcation line and the second demarcation line do not coincide with each other, a second driving control based on the first demarcation line and traveling position information of the vehicle traveling ahead is executed, After a predetermined period of time has elapsed or a predetermined distance has been traveled since the second operational control was executed, the second operational control is terminated. program.
Citation Information
Patent Citations
Automatic drive control system
JP2004206275A
Road section line recognition device, vehicle control apparatus, road section line recognition method, and road section line recognition program
JP2017084137A
Self-position estimation method and self-position estimation device
JP2018084960A
Lane information output method and lane information output device
JP2018200501A
Travel control device, vehicle, travel control system, travel control method, and program
JP2019156171A
