Vehicle control device, vehicle control method, and program
The vehicle control system accurately estimates position during lane changes by matching camera-recognized road markings with high-precision map data outside the lane change section, enhancing vehicle control accuracy.
Patent Information
- Application Number
- JP2022187200
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-11-24
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-11-24
AI Technical Summary
Conventional vehicle positioning systems fail to accurately estimate the vehicle's position when changing lanes due to challenges in matching lane markers recognized by a camera with map information.
A vehicle control system that recognizes road markings using a camera, matches this information with high-precision map data, and controls vehicle travel by performing matching outside the lane change section, including the front and rear sides of the section, to ensure accurate positioning during lane changes.
Enables accurate estimation of the vehicle's position even when changing lanes, improving the reliability of vehicle control systems.
Smart Images

Figure 0007595628000001 
Figure 0007595628000002 
Figure 0007595628000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle control device, a vehicle control method, and a program. [Background technology]
[0002] Conventionally, there is known a technology that estimates the vehicle's own position by matching road dividing lines recognized by a camera with road dividing lines stored in map information, and utilizes the estimated position for driving control of the vehicle. For example, Patent Document 1 discloses a technology that estimates the vehicle's own position on a high-precision map by matching lane markers recognized by a surrounding recognition sensor with lane markers calculated from a high-precision map, and outputs data on the vehicle's own position on the high-precision map. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-198566 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, with conventional technology, when a vehicle changes lanes, the timing is processed as a characteristic point of the lane marking shape recognized by the camera and map, and there are cases where the vehicle's own position cannot be estimated correctly.
[0005] The present invention has been made in consideration of the above circumstances, and one of its objectives is to provide a vehicle control device, a vehicle control method, and a program that can correctly estimate the vehicle's own position even when the vehicle changes lanes. [Means for solving the problem]
[0006] A vehicle control device, a vehicle control method, and a program according to the present invention employ the following configuration. (1): A vehicle control device according to one embodiment of the present invention includes a recognition unit that recognizes road dividing lines present in front of the vehicle based on an image captured by a camera, a matching unit that matches dividing line information obtained based on the results of the recognition with map information describing the distribution of road dividing lines to identify the position of the vehicle in the direction in which the road extends, and a driving control unit that performs driving control to drive the vehicle based on the matching results, wherein when the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, the matching unit does not match the dividing line information with the map information for a section spanning a predetermined distance in the fore-aft direction of the vehicle, but matches the dividing line information with the map information for a range that is outside the range of the section and includes both the front and rear sides of the section.
[0007] (2): In the above aspect (1), the matching unit performs the matching using map information of the adjacent lane for the front side outside the range of the section, and performs the matching using map information of the driving lane for the rear side outside the range of the section.
[0008] (3): In the above aspect (1), the dividing line information includes forward information representing the road dividing line present in the forward direction, and rearward information representing a sequence of points on the rearward direction calculated based on the forward information and the lateral position of the vehicle.
[0009] (4): In the above aspect (1), the lane marking information includes information generated based on the lateral distance between the lane marking and the center of the vehicle.
[0010] (5) In the above aspect (1), the matching unit acquires the map information by connecting the map information received multiple times from the device that manages the map information.
[0011] (6): In the above aspect (1), the matching unit acquires the lane marking information to be used for the matching as the recognized road lane marking for the front side, and as past lane marking information generated based on the road lane marking and information relating to the vehicle for the rear side.
[0012] (7): In the above aspect (1), the matching unit outputs the lane marking information based on information regarding the road marking line and the vehicle after the lane change is completed and a predetermined distance has been driven.
[0013] (8) In the above aspects (1) to (7), the matching unit and the driving control unit perform the matching and the driving control regardless of the type of lane change.
[0014] (9): A vehicle control method according to one embodiment of the present invention includes a computer that recognizes road dividing lines in front of a vehicle based on an image captured by a camera, matches dividing line information obtained based on the recognition result with map information describing the distribution of road dividing lines, identifies the position of the vehicle in the direction in which the road extends, and performs driving control for driving the vehicle based on the matching result. When the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, the computer does not match the dividing line information with the map information for a section spanning a predetermined distance in the fore-aft direction of the vehicle, but matches the dividing line information with the map information for a range outside the range of the section and including both the front and rear sides of the section.
[0015] (10): A program according to one embodiment of the present invention causes a computer to recognize road dividing lines ahead of a vehicle based on an image captured by a camera, match dividing line information obtained based on the results of the recognition with map information describing the distribution of road dividing lines, identify the position of the vehicle in the direction in which the road extends, and perform driving control for driving the vehicle based on the matching results.When the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, the program does not match the dividing line information with the map information for a section spanning a predetermined distance in the fore-aft direction of the vehicle, but instead matches the dividing line information with the map information for a range outside the range of the section and including both the front and rear sides of the section. Effect of the Invention
[0016] According to aspects (1) to (10), even when the vehicle changes lanes, the vehicle's own position can be estimated correctly. [Brief description of the drawings]
[0017] [Figure 1] 1 is a configuration diagram of a vehicle system 1 that uses a vehicle control device according to an embodiment of the present invention. [Diagram 2] FIG. 13 is a diagram showing an example of matching-use lane line information 152. [Diagram 3] FIG. 13 is a diagram showing an example of matching map information 154. [Figure 4] FIG. 2 is a diagram showing an example of matching performed by a matching unit 120. [Diagram 5] 1 is a diagram showing an example of a camera road dividing line CL and a trajectory point TP acquired when a host vehicle M changes lanes. [Figure 6] 11 is a diagram showing an example of a process executed by a matching unit 120 when the host vehicle M changes lanes. FIG. [Figure 7] 5 is a flowchart showing an example of a flow of processing executed by the vehicle control device according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a vehicle control device, a vehicle control method, and a program according to the present invention will be described with reference to the drawings.
[0019] [Overall configuration] 1 is a configuration diagram of a vehicle system 1 that uses a vehicle control device according to this embodiment. The vehicle on which the vehicle system 1 is mounted is, for example, a two-wheeled, three-wheeled, or four-wheeled vehicle, and its drive source is an internal combustion engine such as a diesel engine or a gasoline engine, an electric motor, or a combination of these. The electric motor operates using power generated by a generator connected to the internal combustion engine, or discharged power from a secondary battery or a fuel cell.
[0020] The vehicle system 1 includes, for example, a camera 10, a radar device 12, a LIDAR (Light Detection and Ranging) 14, an object recognition device 16, a communication device 20, an HMI (Human Machine Interface) 30, a vehicle sensor 40, a navigation device 50, an MPU (Map Positioning Unit) 60, a driving operator 80, an automatic driving control device 100, a driving force output device 200, a brake device 210, and a steering device 220. These devices and equipment are connected to each other by multiple communication lines such as a CAN (Controller Area Network) communication line, a serial communication line, a wireless communication network, etc. Note that the configuration shown in FIG. 1 is merely an example, and some of the configuration may be omitted, or other configuration may be added.
[0021] The camera 10 is, for example, a digital camera using a solid-state imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 10 is attached to an arbitrary location of a vehicle (hereinafter, the vehicle M) in which the vehicle system 1 is mounted. When capturing an image of the front, the camera 10 is attached to the top of the front windshield, the back of the rearview mirror, or the like. The camera 10, for example, periodically and repeatedly captures images of the surroundings of the vehicle M. The camera 10 may be a stereo camera.
[0022] The radar device 12 emits radio waves such as millimeter waves around the vehicle M and detects radio waves reflected by an object (reflected waves) to detect at least the position (distance and direction) of the object. The radar device 12 is attached to an arbitrary location of the vehicle M. The radar device 12 may detect the position and speed of an object by an FM-CW (Frequency Modulated Continuous Wave) method.
[0023] The LIDAR 14 irradiates light (or electromagnetic waves with a wavelength close to that of light) around the vehicle M and measures the scattered light. The LIDAR 14 detects the distance to the target based on the time between light emission and light reception. The irradiated light is, for example, a pulsed laser light. The LIDAR 14 is attached to an arbitrary location of the vehicle M.
[0024] The object recognition device 16 performs sensor fusion processing on some or all of the detection results from the camera 10, the radar device 12, and the LIDAR 14 to recognize the position, type, speed, etc. of the object. The object recognition device 16 outputs the recognition result to the autonomous driving control device 100. The object recognition device 16 may output the detection results from the camera 10, the radar device 12, and the LIDAR 14 to the autonomous driving control device 100 as is.
[0025] The communication device 20 communicates with other vehicles in the vicinity of the vehicle M, for example, using a cellular network, a Wi-Fi network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), etc., or communicates with various server devices via a wireless base station.
[0026] The HMI 30 presents various information to an occupant of the vehicle M and accepts input operations by the occupant. The HMI 30 includes various display devices, a speaker, a buzzer, a touch panel, switches, keys, and the like.
[0027] The vehicle sensor 40 includes a vehicle speed sensor that detects the speed of the host vehicle M, an acceleration sensor that detects acceleration, a yaw rate sensor that detects the angular velocity around a vertical axis, a direction sensor that detects the direction of the host vehicle M, and the like.
[0028] The navigation device 50 includes, for example, a GNSS (Global Navigation Satellite System) receiver 51, a navigation HMI 52, and a route determination unit 53. The navigation device 50 holds first map information 54 in a storage device such as a HDD (Hard Disk Drive) or a flash memory. The GNSS receiver 51 identifies the position of the vehicle M based on a signal received from a GNSS satellite. The position of the vehicle M may be identified or complemented by an INS (Inertial Navigation System) using the output of the vehicle sensor 40. The navigation HMI 52 includes a display device, a speaker, a touch panel, keys, and the like. The navigation HMI 52 may be partially or entirely shared with the above-mentioned HMI 30. The route determination unit 53, for example, determines a route (hereinafter, a route on a map) from the position of the vehicle M identified by the GNSS receiver 51 (or an arbitrary position input) to a destination input by a driver using the navigation HMI 52, with reference to the first map information 54. The first map information 54 is, for example, information in which road shapes are expressed by links indicating roads and nodes connected by the links. The first map information 54 may include road curvature and POI (Point Of Interest) information. The route on the map is output to the MPU 60. The navigation device 50 may perform route guidance using the navigation HMI 52 based on the route on the map. The navigation device 50 may be realized by, for example, a function of a terminal device such as a smartphone or tablet terminal owned by a passenger. The navigation device 50 may transmit a current position and a destination to a navigation server via the communication device 20, and obtain a route equivalent to the route on the map from the navigation server.
[0029] The MPU 60 includes, for example, a recommended lane determination unit 61, and holds second map information 62 in a storage device such as an HDD or a flash memory. The recommended lane determination unit 61 divides the route on the map provided by the navigation device 50 into a plurality of blocks (for example, by dividing it into 100 [m] blocks in the vehicle travel direction), and determines a recommended lane for each block by referring to the second map information 62. The recommended lane determination unit 61 determines which lane from the left the vehicle should travel in. When a branch point is present on the route on the map, the recommended lane determination unit 61 determines a recommended lane so that the vehicle M can travel a reasonable route to proceed to the branch point. The MPU 60 also has a function of extracting a predetermined range of information from the second map information 62 and transmitting it to the automatic driving control device 100 in response to a request from the automatic driving control device 100.
[0030] The second map information 62 is map information with higher accuracy than the first map information 54. The second map information 62 includes, for example, information on the center of lanes or information on boundaries of lanes. The second map information 62 may also include GPS coordinate information, road information, traffic regulation information, address information (address and zip code), facility information, telephone number information, etc. The second map information 62 may be updated as needed by the communication device 20 communicating with another device.
[0031] The driving operators 80 include, for example, an accelerator pedal, a brake pedal, a shift lever, a steering wheel, an irregular steering wheel, a joystick, and other operators. The driving operators 80 are fitted with sensors that detect the amount of operation or the presence or absence of operation, and the detection results are output to the automatic driving control device 100, or some or all of the driving force output device 200, the brake device 210, and the steering device 220.
[0032] The automatic driving control device 100 includes, for example, a recognition unit 110, a matching unit 120, a behavior plan generation unit 130, a driving control unit 140, and a storage unit 150. The recognition unit 110, the matching unit 120, the behavior plan generation unit 130, and the driving control unit 140 are each realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). In addition, some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device (a storage device equipped with a non-transient storage medium) such as the HDD or flash memory of the automatic driving control device 100, or may be stored in a removable storage medium such as a DVD or CD-ROM, and installed in the HDD or flash memory of the automatic driving control device 100 by mounting the storage medium (non-transient storage medium) in a drive device. The storage unit 150 stores, for example, matching lane line information 152 and matching map information 154. The storage unit 150 is realized, for example, by a RAM, a flash memory, an SD card, or the like. The automatic driving control device 100 is an example of a "vehicle control device".
[0033] The recognition unit 110 recognizes the position, speed, acceleration, and other states of objects around the vehicle M based on information input from the camera 10, the radar device 12, and the LIDAR 14 via the object recognition device 16. The position of the object is recognized as a position on an absolute coordinate system with a representative point of the vehicle M (such as the center of gravity or the center of the drive shaft) as the origin, and is used for control. The position of the object may be represented by a representative point such as the center of gravity or a corner of the object, or may be represented by a represented area. The "state" of the object may include the acceleration or jerk of the object, or the "behavior state" (for example, whether or not the object is changing lanes or is about to change lanes).
[0034] Further, the recognition unit 110 recognizes, for example, a lane in which the vehicle M is traveling (road dividing line). For example, the recognition unit 110 recognizes a lane in which the vehicle M is traveling based on an image captured by the camera 10, the lane dividing line included in the image as the lane in which the vehicle M is traveling. When the image captured by the camera 10 is input, the recognition unit 110 can recognize the lane dividing line by using a trained model trained to extract the lane dividing line included in the image. Note that the recognition unit 110 may recognize the lane in which the vehicle M is traveling by recognizing not only lane dividing lines but also road boundaries (road boundaries) including road dividing lines, road shoulders, curbs, median strips, guard rails, etc. In this recognition, the position of the vehicle M acquired from the navigation device 50 and the processing results by the INS may be taken into consideration. Furthermore, the recognition unit 110 recognizes stop lines, obstacles, red lights, toll booths, and other road phenomena.
[0035] When recognizing the driving lane, the recognition unit 110 recognizes the position and attitude of the host vehicle M with respect to the driving lane. For example, the recognition unit 110 may recognize the deviation of the reference point of the host vehicle M from the center of the lane and the angle with respect to a line connecting the centers of the lanes in the traveling direction of the host vehicle M as the relative position and attitude of the host vehicle M with respect to the driving lane. Alternatively, the recognition unit 110 may recognize the position of the reference point of the host vehicle M with respect to either side end of the driving lane (a road dividing line or a road boundary) as the relative position of the host vehicle M with respect to the driving lane. The matching unit 120 will be described later.
[0036] The matching unit 120 performs matching, which will be described later, based on the road dividing line recognized by the recognition unit 110 and the second map information 62, and identifies the position (current position) of the host vehicle M. The matching unit 120 will be described in detail later.
[0037] The action plan generating unit 130 generates a target trajectory along which the host vehicle M will travel in the future automatically (without relying on the driver's operation) so that the host vehicle M will travel in the recommended lane determined by the recommended lane determining unit 61 in principle and can further respond to the surrounding conditions of the host vehicle M. The target trajectory includes, for example, a speed element, and is generated with the position of the host vehicle M specified by the matching unit 120 as the starting point. For example, the target trajectory is expressed as a sequence of points (trajectory points) to be reached by the host vehicle M. The trajectory points are points to be reached by the host vehicle M at each predetermined travel distance (for example, about several [m]) along the road, and separately, the target speed and target acceleration for each predetermined sampling time (for example, about a few tenths [sec]) are generated as part of the target trajectory. The trajectory points may also be positions to be reached by the host vehicle M at each sampling time for each predetermined sampling time. In this case, the information on the target speed and target acceleration is expressed as the interval between the trajectory points.
[0038] The traveling control unit 140 controls the traveling drive force output device 200, the braking device 210, and the steering device 220 so that the host vehicle M passes the target trajectory generated by the action plan generating unit 130 at the scheduled time.
[0039] The driving control unit 140 acquires information on the target trajectory (trajectory points) generated by the action plan generation unit 130 and stores it in a memory (not shown). The driving control unit 140 controls the driving drive force output device 200 or the brake device 210 based on the speed element associated with the target trajectory stored in the memory. The steering control unit 166 controls the steering device 220 according to the curvature of the target trajectory stored in the memory. The processing of the speed control unit 164 and the steering control unit 166 is realized, for example, by a combination of feedforward control and feedback control. As an example, the steering control unit 166 executes a combination of feedforward control according to the curvature of the road ahead of the host vehicle M and feedback control based on the deviation from the target trajectory.
[0040] The driving force output device 200 outputs a driving force (torque) for the vehicle to travel to the driving wheels. The driving force output device 200 includes, for example, a combination of an internal combustion engine, an electric motor, a transmission, and an ECU (Electronic Control Unit) that controls these. The ECU controls the above components according to information input from the travel control unit 140 or information input from the driving operation device 80.
[0041] The brake device 210 includes, for example, a brake caliper, a cylinder that transmits hydraulic pressure to the brake caliper, an electric motor that generates hydraulic pressure in the cylinder, and a brake ECU. The brake ECU controls the electric motor according to information input from the cruise control unit 140 or information input from the driving operation element 80, so that a brake torque corresponding to a braking operation is output to each wheel. The brake device 210 may include a backup mechanism that transmits hydraulic pressure generated by operation of a brake pedal included in the driving operation element 80 to the cylinder via a master cylinder. Note that the brake device 210 is not limited to the configuration described above, and may be an electronically controlled hydraulic brake device that controls an actuator according to information input from the cruise control unit 140 to transmit hydraulic pressure in the master cylinder to the cylinder.
[0042] The steering device 220 includes, for example, a steering ECU and an electric motor. The electric motor changes the direction of the steered wheels by applying a force to, for example, a rack and pinion mechanism. The steering ECU drives the electric motor in accordance with information input from the cruise control unit 140 or information input from the driving operator 80 to change the direction of the steered wheels.
[0043] [Matching processing] The matching unit 120 matches matching lane marking information 152 based on the lane markings recognized by the recognition unit 110 with matching map information 154 extracted from the second map information 62 of the MPU 60, and identifies the position of the vehicle M in the extension direction (longitudinal direction) of the driving lane (more specifically, the position on the second map information 62). Matching is repeatedly executed at a predetermined control cycle (for example, every few milliseconds).
[0044] FIG. 2 is a diagram showing an example of the matching lane marking information 152. FIG. 2 shows a situation in which the host vehicle M is traveling on the lane L1 along a road marking CL (hereinafter referred to as a "camera road marking CL") recognized based on an image captured by the camera 10. The matching unit 120 first acquires the camera road marking CL that exists on the front side of the host vehicle M (for example, the traveling direction side starting from the center of gravity O of the host vehicle M) recognized by the recognition unit 110, and stores it as matching lane marking information 152. The matching unit 120 further acquires an intersection between a reference line RL that is extended laterally based on the center of gravity O of the host vehicle M as a locus point TP and the camera road marking CL, and stores it as matching lane marking information 152 on the rear side of the host vehicle M. More specifically, the matching unit 120 performs coordinate conversion of the lateral position of the host vehicle M relative to the camera road lane marking CL recognized by the recognition unit 110 using the amount of movement of the host vehicle M and performs sampling buffering, thereby extending the trajectory point TP to the rear side of the host vehicle M and storing it as matching lane marking information 152. In this way, the matching unit 120 acquires, as the matching lane marking information 152, the camera road lane marking CL recognized by the recognition unit 110 (an example of "forward information") for the forward side of the host vehicle M, and acquires, as the matching lane marking information 152, the trajectory point TP generated based on the lateral distance of the host vehicle M (an example of "rearward information").
[0045] 2, the matching unit 120 defines the side in the traveling direction of the host vehicle M based on the center of gravity O of the host vehicle M as the front side of the host vehicle M, and acquires the intersection between a reference line RL extending laterally from the center of gravity O of the host vehicle M as a starting point and the camera road dividing line CL as a locus point TP. However, the present invention is not limited to such a configuration, and the matching unit 120 may set an arbitrary position on the host vehicle M as a reference point instead of the center of gravity O of the host vehicle M to define the front side of the host vehicle M and acquire the locus point TP.
[0046] FIG. 3 is a diagram showing an example of the matching map information 154. As in FIG. 2, FIG. 3 shows a situation in which the host vehicle M is traveling on the lane L1. The matching unit 120 requests information (road dividing line information) of a predetermined range from the second map information 62 from the MPU 60, and receives it from the MPU 60. Here, the predetermined range refers to a range that includes at least the current position of the host vehicle M. For example, the matching unit 120 transmits position information of the host vehicle M identified based on a signal received from a GNSS satellite to the MPU 60, and the MPU 60 refers to the second map information 62 using the received position information as a key, acquires information of the predetermined range, and transmits it to the automatic driving control device 100.
[0047] The matching unit 120 acquires the matching map information 154 by connecting information of a predetermined range received multiple times in a predetermined control cycle (which may be the same as the matching control cycle or may be a control cycle that is shorter than the matching control cycle) while the vehicle M is traveling. More specifically, for example, as shown in FIG. 3, when the matching unit 120 acquires the map division line ML(k-2) in the k-2th cycle of the control cycle and then acquires the map division line ML(k-1) in the next k-1th cycle, the matching unit 120 acquires the matching map information 154 by connecting the map division line ML(k-2) and the map division line ML(k-1). When the matching unit 120 acquires the map division line ML(k) in the next kth control cycle, the matching unit 120 updates the matching map information 154 by connecting the matching map information 154 acquired up to the previous cycle with the map division line ML(k). In this way, the matching unit 120 updates the matching map information 154 by connecting the map division lines ML received from the MPU 60. The matching unit 120 holds the matching map information 154 obtained by connecting the map division lines ML for a predetermined distance (e.g., several hundred meters to several kilometers) behind the vehicle M for matching. In this way, by receiving and connecting map division line information of a predetermined range over multiple cycles to obtain the matching map information 154 without receiving the matching map information 154 from the MPU 60 all at once, the communication load between the automatic driving control device 100 and the MPU 60 can be reduced.
[0048] FIG. 4 is a diagram showing an example of matching performed by the matching unit 120. In FIG. 4, the symbol ML represents a map division line obtained by connecting the map division lines ML(k) for a predetermined distance (predetermined cycle) behind the host vehicle M. As shown in FIG. 4, the matching unit 120 calculates the error between the camera road division line CL and the trajectory point TP included in the matching division line information 152 and the map division line ML included in the matching map information 154 by any method, and performs matching so as to minimize the calculated error. For example, the left part of FIG. 4 represents a state in which the error between the camera road division line CL and the trajectory point TP and the map division line ML occurs in the traveling direction of the host vehicle M. For example, the matching unit 120 performs matching taking into account the amount of movement of the host vehicle M in the traveling direction of the host vehicle M, thereby minimizing the error as shown in the right part of FIG. 4. The matching unit 120 specifies the position of the host vehicle M on the second map information 62 at the time when the error is minimized as the current position of the host vehicle M. At this time, the matching unit 120 can also correct the position information of the vehicle M, which is determined based on the signal received from the GNSS satellite, with respect to the longitudinal direction of the vehicle M, using the current position determined by matching. This improves the accuracy of satellite positioning, and can be effectively utilized in controlling autonomous driving.
[0049] [Lane change processing] In this way, while the vehicle M is traveling, the matching unit 120 identifies the position of the vehicle M by matching the matching lane line information 152 and the matching map information 154, the action plan generating unit 130 generates a target trajectory starting from the identified current position of the vehicle M, and the traveling control unit 140 makes the vehicle M travel along the generated target trajectory. However, although such a matching method is effective when the vehicle M is traveling along a single lane, when the vehicle M changes lanes, matching may fail due to, for example, failure to recognize the camera road lane line CL or difficulty in matching the switching timing of the road lane line referenced as a matching target with the actual behavior. Hereinafter, a process executed by the matching unit 120 when the vehicle M changes lanes will be described.
[0050] FIG. 5 is a diagram showing an example of the camera road dividing line CL and the trajectory point TP acquired when the host vehicle M changes lanes. The left part of FIG. 5 shows a situation in which the host vehicle M is changing lanes from the driving lane L1 to the adjacent lane L2, and the right part of FIG. 5 shows the camera road dividing line CL and the trajectory point TP acquired with the lane change from the driving lane L1 to the adjacent lane L2. As shown in the right part of FIG. 5, when the host vehicle M changes lanes, the host vehicle M crosses the road dividing line that is the boundary between the driving lane L1 and the adjacent lane L2. In that case, the crossed road dividing line may not be captured in the camera image, and the recognition unit 110 may fail to recognize the road dividing line. For example, the matching unit 120 may perform matching by assuming that the combination of the trajectory point TP1 and the trajectory point TP1' and the combination of the trajectory point TP2 and the trajectory point TP2' each represent a single lane, and may fail to match.
[0051] In light of these circumstances, when the host vehicle M has completed a lane change, the matching unit 120 does not match the matching lane line information 152 with the matching map information 154 for a section spanning a predetermined distance d in the forward / backward direction of the host vehicle M, but instead matches the matching lane line information 152 with the matching map information 154 outside the range of that section and in a range including the front and rear sides of the host vehicle M. The matching unit 120 determines that the lane change is complete, for example, when the host vehicle M is located at or near the center of the adjacent lane L2.
[0052] FIG. 6 is a diagram showing an example of a process executed by the matching unit 120 when the vehicle M changes lanes. As shown in FIG. 6, when the matching unit 120 determines that the vehicle M has completed a lane change, the matching unit 120 excludes the matching lane line information 152 and the matching map information 154 from the matching target in the forward and backward directions of the vehicle M, the section covering a predetermined distance d based on the determination point (hereinafter, lane change completion point P). In the case of FIG. 6, the matching unit 120 excludes the above-mentioned trajectory points TP1, TP1', TP2, and TP2' from the matching target. This allows the matching unit 120 to perform matching using only the matching lane line information 152 and the matching map information 154 that have been normally acquired. That is, even when the vehicle changes lanes, the vehicle's own position can be correctly estimated.
[0053] In the above description, an example has been described in which the matching unit 120 continuously acquires the matching lane line information 152 and the matching map information 154 while the host vehicle M is traveling. However, the present invention is not limited to such a configuration, and the matching unit 120 may temporarily stop acquiring the matching lane line information 152 when the host vehicle M changes lanes. In this case, the matching unit 120 may resume acquiring and output the matching lane line information 152 after the host vehicle M has completed the lane change and traveled a predetermined distance.
[0054] Further, in the above, as an example, an example in which the present invention is applied when the vehicle M is driven by automatic driving has been described. However, the present invention is not limited to such a configuration, and the present invention can also be applied when an occupant of the vehicle M is driving the vehicle manually. In that case, for example, by displaying the exact position of the vehicle M identified by the matching unit 120 on the navigation HMI 52, the occupant can utilize the position information for his / her own driving. Furthermore, the present invention can identify the position of the vehicle M by matching, regardless of the type of mode in which the lane change is performed, such as the level of automatic driving.
[0055] [Processing flow] Next, the flow of processing executed by the vehicle control device will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the flow of processing executed by the vehicle control device according to the present embodiment. The processing of this flowchart is repeatedly executed while the host vehicle M is traveling.
[0056] First, the recognition unit 110 recognizes the road dividing line CL based on the image captured by the camera 10 (step S100). Next, the matching unit 120 acquires matching-use dividing line information 152 based on the recognized road dividing line CL (step S102). Next, the matching unit 120 refers to the second map information 62 using the position information of the host vehicle M identified based on the signal received from the GNSS satellite as a key, and acquires matching-use map information 154 related to the surroundings of the host vehicle M (step S104).
[0057] Next, the matching unit 120 determines whether or not the vehicle M has changed lanes (step S106). If it is determined that the vehicle M has changed lanes, the matching unit 120 excludes the matching lane line information 152 and the matching map information 154 from the matching targets for a predetermined distance in the forward and backward directions from the point where the lane change is completed (step S108). Next, the matching unit 120 performs matching between the matching lane line information 152 and the matching map information 154 to identify the position of the vehicle M (step S110).
[0058] Next, the behavior plan generating unit 130 generates a target trajectory starting from the specified position of the vehicle M (step S112). Next, the traveling control unit 140 causes the vehicle M to travel along the generated target trajectory. This ends the processing of this flowchart.
[0059] According to the present embodiment described above, when a lane change from the lane in which the vehicle is currently traveling to the adjacent lane is completed, matching between the lane marking information and the map information is not performed for a section over a predetermined distance in the front-rear direction of the vehicle, but the lane marking information and the map information are matched for a range outside the section and including the front and rear sides of the section. This allows the vehicle to correctly estimate its own position even when the vehicle is changing lanes.
[0060] The above-described embodiment can be expressed as follows. a storage medium for storing computer-readable instructions; a processor coupled to the storage medium; The processor executes the computer-readable instructions to: Based on the image captured by the camera, the system recognizes the road markings in front of the vehicle. matching the lane marking information obtained based on the result of the recognition with map information describing the distribution of the lane markings on the road, and identifying the position of the vehicle in the direction in which the road extends; Based on the matching result, a driving control is performed to drive the vehicle. when the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, matching is not performed between the lane marking information and the map information for a section that covers a predetermined distance in the front-rear direction of the vehicle, but matching is performed between the lane marking information and the map information for a range that is outside the range of the section and includes the front side and the rear side of the section. The vehicle control device is configured as follows.
[0061] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]
[0062] 10. Camera 12 Radar equipment 14 LIDAR 16 Object recognition device 20. Communications Equipment 30 Human Machine Interfaces 40 Vehicle Sensors 50 Navigation equipment 60 MPU 80 Driving controls 100 Automatic driving control device 110 Recognition part 120 Matching Department 130 Action Plan Generation Unit 140 Driving control unit 150 Storage section 152 Matching lane line information 154 Matching map information 200 Driving force output device 210 Brake equipment 220 Steering device
Claims
1. a recognition unit that recognizes road dividing lines present ahead of the vehicle based on an image captured by the camera; a matching unit that matches lane marking information obtained based on the result of the recognition with map information describing the distribution of lane markings, and identifies the position of the vehicle in the direction in which the road extends; A driving control unit that performs driving control to drive the vehicle based on the matching result, the matching unit, when the vehicle has completed a lane change from the driving lane in which the vehicle is currently traveling to an adjacent lane, does not match the demarcation line information with the map information for a section that spans a predetermined distance in the forward / rearward direction of the vehicle, but matches the demarcation line information with the map information for a range that is outside the range of the section and includes a front side and a rear side of the section. Vehicle control device.
2. the matching unit performs the matching using map information of the adjacent lane for the front side outside the range of the section, and performs the matching using map information of the driving lane for the rear side outside the range of the section. The vehicle control device according to claim 1.
3. The lane marking information includes forward information representing the road lane marking present on the forward side, and rearward information representing a series of points on the rearward side calculated as intersections between the forward information and a reference line extending laterally based on the center of gravity of the vehicle and the road lane marking. The vehicle control device according to claim 1.
4. The lane marking information includes information generated based on a lateral distance between the lane marking and the center of the vehicle. The vehicle control device according to claim 1.
5. the matching unit acquires the map information used for the matching by connecting map information received multiple times from a device that manages the map information; The vehicle control device according to claim 1.
6. the matching unit acquires the lane marking information used in the matching as the recognized road lane marking for the front side, and acquires the lane marking information used in the matching as past lane marking information generated as an intersection between a reference line extending laterally based on a center of gravity of the vehicle and the road lane marking for the rear side. The vehicle control device according to claim 1.
7. the matching unit stops acquiring the lane line information when the lane change is performed, and after the lane change is completed and the vehicle has traveled a predetermined distance, outputs the lane line information and performs matching with the map information. The vehicle control device according to claim 1.
8. The computer Based on the image captured by the camera, the system recognizes the road markings in front of the vehicle. matching the lane marking information obtained based on the result of the recognition with map information describing the distribution of the lane markings on the road, and identifying the position of the vehicle in the direction in which the road extends; Based on the matching result, a driving control is performed to drive the vehicle. when the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, matching is not performed between the lane marking information and the map information for a section that covers a predetermined distance in the front-rear direction of the vehicle, but matching is performed between the lane marking information and the map information for a range that is outside the range of the section and includes the front side and the rear side of the section. A vehicle control method.
9. On the computer, Based on the image captured by the camera, the system recognizes road markings in front of the vehicle, matching the lane marking information obtained based on the result of the recognition with map information describing the distribution of the lane markings, and identifying the position of the vehicle in the direction in which the road extends; Based on the matching result, a driving control is performed to drive the vehicle; When the vehicle has completed a lane change from the lane in which the vehicle is currently traveling to an adjacent lane, matching between the lane marking information and the map information is not performed for a section that covers a predetermined distance in the front-rear direction of the vehicle, but the lane marking information is matched with the map information for a range that is outside the range of the section and includes the front side and the rear side of the section. program.
Citation Information
Patent Citations
Vehicle-to-vehicle distance measuring instrument
JP1994249653A
On-vehicle navigation device and map matching operation control method
JP2012018132A
Vehicular white-line recognition apparatus
JP2015069339A
Lane marker recognition device and own vehicle position estimation device
JP2017198566A
Navigation device
JP2019045406A
