Vehicle control system and lane recognition method

By introducing the lane identification unit in the vehicle control system, combining the number of lanes and the type of demarcation line for identification, the problem of low recognition accuracy in the prior art is solved, and accurate lane identification and dynamic adjustment in multiple lane environments are achieved , improves recognition accuracy and adaptability.

CN114689076BActive Publication Date: 2024-11-05HONDA MOTOR CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111569954.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-12-28
Filing Date
2021-12-21
Publication Date
2024-11-05
Estimated Expiration
2041-12-21

AI Technical Summary

Technical Problem

The prior art is difficult to effectively identify the lane according to the number of lanes on the map, especially in the case of multiple lanes, the recognition accuracy is low and it is difficult to adapt to lane changes.

Method used

By introducing this lane identification unit in the vehicle control system, the position of the vehicle on the map is estimated, and the number of lanes in a specific area and the type of dividing line is compared, unique or specific lanes are identified as the lane, using road shoulders and adjacent lanes match the boundary line information and dynamically adjust the identification of this lane.

Benefits of technology

Accurate identification is achieved based on the changes in the number of lanes on the map. The accuracy of this lane recognition is improved. This lane can be effectively identified in multiple lane environments and adjusts in time when the vehicle changes lanes to avoid incorrect identification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114689076B_ABST
    Figure CN114689076B_ABST
Patent Text Reader

Abstract

Vehicle control system and own lane recognition method. A vehicle control system includes an imaging device, a map generation unit, and an own lane recognition unit. The own lane recognition unit is configured to: in the case where a lane is the only lane existing in a specific area on a map, recognize the one lane as the own lane on the map; in the case where there are multiple lanes in the specific area on the map, compare the type of the captured boundary line of the own lane with the types of the boundary lines of the multiple lanes on the map; and in the case where the type of the captured boundary line of the own lane matches the type of the boundary line of only one lane among the multiple lanes on the map, recognize the one lane among the multiple lanes on the map as the own lane on the map.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a vehicle control system and a lane recognition method. Background Art

[0002] Conventionally, various methods have been proposed to identify on a map the own lane that a vehicle is traveling in. For example, the technology disclosed in Japanese Patent No. 6666304 identifies the own lane by comparing the pattern of dividing lines acquired from map information with the pattern of dividing lines recognized from an image captured by a camera.

[0003] In the above technology, no matter how many lanes there are on the map, the identification method of the own lane remains unchanged. Therefore, it is difficult to effectively identify the own lane on the map according to the number of lanes on the map. Summary of the invention

[0004] In view of the above background, an object of the present invention is to provide a vehicle control system and a lane identification method that can effectively identify a lane on a map according to the number of lanes on the map.

[0005] To achieve such a purpose, one aspect of the present invention provides a vehicle control system 1, which includes: an imaging device 18, which is configured to capture an image of a driving route on which a vehicle V is traveling; a map generation unit 53, which is configured to generate a map of the surrounding area of ​​the vehicle; and a lane recognition unit 54, which is configured to identify the lane R on which the vehicle is traveling on the map, wherein the lane recognition unit is configured to: estimate the position P of the vehicle on the map; calculate the number of lanes A present in a specific area Y including the position of the vehicle on the map; and when a lane is the specific area on the map, In the case where there are multiple lanes in the specific area on the map, the one lane is identified as the own lane on the map; in the case where there are multiple lanes in the specific area on the map, the type of the dividing line B1 of the captured own lane B is compared with the type of the dividing line A1 of the multiple lanes on the map, and the captured own lane is the own lane identified from the image captured by the imaging device; and in the case where the type of the dividing line of the captured own lane only matches the type of the dividing line of one lane among the multiple lanes on the map, the one lane among the multiple lanes on the map is identified as the own lane on the map.

[0006] According to this aspect, by changing the method of identifying the own lane on the map according to the number of lanes existing in a specific area on the map, the own lane on the map can be efficiently identified.

[0007] In the above aspects, preferably, when the type of the dividing line of the captured own lane matches the type of the dividing lines of the multiple lanes on the map and there is a shoulder D on one lateral side of the captured own lane, the own lane identification unit identifies the end lane as the own lane on the map, and the end lane is arranged at the end of the one lateral side among the multiple lanes on the map.

[0008] According to this aspect, even if the type of the captured boundary line of the own lane matches the types of the boundary lines of multiple lanes on the map, the own lane on the map can be identified based on the presence of the road shoulder. Therefore, the own lane on the map can be identified more effectively.

[0009] In the above aspects, preferably, when the type of the dividing line of the captured own lane matches the type of the dividing lines of the multiple lanes on the map, there are dividing lines on the two lateral sides of the captured own lane and on the two lateral sides of the left and right adjacent lanes F arranged on the two lateral sides of the captured own lane, and when there are three lanes in the specific area on the map, the own lane identification unit identifies the central lane among the three lanes as the own lane on the map.

[0010] According to this aspect, even if the type of the captured boundary line of the own lane matches the types of the boundary lines of multiple lanes on the map, the own lane on the map can be identified based on the presence of the boundary lines on both lateral sides of the captured own lane and its adjacent lanes. Therefore, the own lane on the map can be identified more effectively.

[0011] In the above aspect, preferably, when it is determined that the vehicle has changed lanes on the map after identifying the own lane on the map, the own lane identification unit changes the own lane on the map according to the direction of the lane change.

[0012] According to this aspect, the own lane on the map can be appropriately changed according to the lane change.

[0013] In the above aspects, preferably, when the type of the dividing line identified in the image captured by the imaging device can be identified and the lane number of the newly identified own lane on the map does not match the lane number of the previously identified own lane on the map, the own lane identification unit resets the information about the own lane on the map.

[0014] According to the present aspect, in a case where the own lane on the map may be erroneously identified, it is possible to avoid continued erroneous identification of the own lane on the map by resetting the information on the own lane on the map.

[0015] In the above aspect, preferably, when estimating the position of the vehicle on the map is stopped after the own lane on the map is identified, the own lane identification unit resets information about the own lane on the map.

[0016] According to the present aspect, in a case where the own lane on the map may be erroneously identified, it is possible to avoid continued erroneous identification of the own lane on the map by resetting the information on the own lane on the map.

[0017] In the above aspect, preferably, the vehicle control system further includes a movement amount calculation unit 32, which is configured to calculate the movement amount of the vehicle by using a dead reckoning algorithm, wherein even if the estimation of the position of the vehicle on the map is stopped after the one lane that is the only lane existing in the specific area on the map is identified as the own lane on the map, the own lane identification unit maintains the information about the own lane on the map as long as it is determined that the vehicle does not deviate from the own lane on the map based on the movement amount of the vehicle calculated by the movement amount calculation unit.

[0018] According to the present aspect, by maintaining information on the own lane on the map exceptionally when it is determined that the vehicle does not deviate from the own lane on the map, the own lane on the map can be recognized more efficiently.

[0019] In order to achieve the above objectives, another aspect of the present invention provides a lane identification method, which is used to identify on a map a lane R in which a vehicle V is traveling, and the lane identification method includes: estimating the position P of the vehicle on the map; calculating the number of lanes A existing in a specific area Y including the position of the vehicle on the map; in the case where a lane is the only lane existing in the specific area on the map, identifying the one lane as the lane on the map; in the case where there are multiple lanes in the specific area on the map, comparing the type of the dividing line B1 of the captured lane B with the type of the dividing line A1 of the multiple lanes on the map, the captured lane being the lane identified from the captured image; and in the case where the type of the dividing line of the captured lane only matches the type of the dividing line of one of the multiple lanes on the map, identifying the one of the multiple lanes on the map as the lane on the map.

[0020] According to this aspect, by changing the method of identifying the own lane on the map according to the number of lanes existing in a specific area on the map, the own lane on the map can be efficiently identified.

[0021] Therefore, according to the above aspects, it is possible to provide a vehicle control system and a host lane recognition method that can effectively recognize a host lane on a map according to the number of lanes on the map. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is a block diagram of a vehicle control system according to one embodiment of the present invention;

[0023] Figure 2 is a flowchart showing the own lane recognition control according to an embodiment of the present invention;

[0024] Figure 3 is a plan view showing one embodiment of a local map;

[0025] Figure 4 is a plan view showing one embodiment of a local map;

[0026] Figure 5A is a plan view showing one embodiment of information acquired from a camera image;

[0027] Figure 5B is a plan view showing one embodiment of a local map;

[0028] Figure 5C is a plan view showing one embodiment of a local map;

[0029] Fig. 6A is a plan view showing one embodiment of information acquired from a camera image;

[0030] Figure 6B is a plan view showing one embodiment of a local map;

[0031] Fig. 7A is a plan view showing one embodiment of information acquired from a camera image;

[0032] Figure 7B is a plan view showing one embodiment of a local map;

[0033] Figure 8 is a plan view illustrating one embodiment of a local map; and

[0034] Fig. 9 is a plan view showing one embodiment of a local map. DETAILED DESCRIPTION

[0035] A vehicle control system 1 according to an embodiment of the present invention will be described below with reference to the accompanying drawings. Figure 1As shown in , the vehicle control system 1 includes: a vehicle system 2, which is installed on a vehicle V; and a high-precision map server 3 (hereinafter abbreviated as "map server 3"), which is connected to the vehicle system 2 via a network N. Hereinafter, the term "vehicle V" means a vehicle provided with the vehicle system 2 (i.e., the present vehicle).

[0036] <Vehicle System 2>

[0037] First, the vehicle system 2 will be described. The vehicle system 2 includes a power system 4, a braking device 5, a steering device 6, an external environment sensor 7, a vehicle sensor 8, a communication device 9, a GNSS receiver 10, a navigation device 11, a driving operation member 12, a driving operation sensor 13, a human-machine interface 14, a start switch 15, and a controller 16. Each component of the vehicle system 2 is connected to each other via a communication means such as a controller area network (CAN) so that signals can be transmitted therebetween.

[0038] The power system 4 is a device configured to apply a driving force to the vehicle V. For example, the power system 4 includes at least one of an internal combustion engine (such as a gasoline engine and a diesel engine) and an electric motor. The braking device 5 is a device configured to apply a braking force to the vehicle V. For example, the braking device 5 includes: a brake caliper configured to press a pad against a brake rotor; and an electric cylinder configured to supply oil pressure to the brake caliper. The braking device 5 may further include a parking brake device configured to limit wheel rotation via a cable. The steering device 6 is a device configured to change the steering angle of the wheel. For example, the steering device 6 includes: a rack-and-pinion mechanism configured to steer the wheel; and an electric motor configured to drive the rack-and-pinion mechanism. The power system 4, the braking device 5 and the steering device 6 are controlled by the controller 16.

[0039] The external environment sensor 7 is a sensor configured to detect objects and the like outside the vehicle V by capturing electromagnetic waves, sound waves, and the like from the surrounding environment of the vehicle V. The external environment sensor 7 includes a plurality of sonars 17 and a plurality of external cameras 18 (an embodiment of an imaging device). The external environment sensor 7 may further include a millimeter wave radar and / or a laser radar. The external environment sensor 7 is configured to output a detection result to the controller 16.

[0040] Each sonar 17 is composed of a so-called ultrasonic sensor. The sonar 17 emits ultrasonic waves to the surroundings of the vehicle V and captures its reflected waves, thereby detecting the position (distance and direction) of an object. A plurality of sonars 17 are provided at the rear and front of the vehicle V, respectively.

[0041] Each external camera 18 is a device configured to capture images of the surroundings of the vehicle V. For example, the external camera 18 is a digital camera using solid imaging elements such as CCD and CMOS. The external camera 18 can be composed of a stereo camera or a monocular camera. The multiple external cameras 18 include: a front camera configured to capture images in front of the vehicle V; a rear camera configured to capture images behind the vehicle V; and a pair of side cameras configured to capture images of the two lateral sides of the vehicle V. When the vehicle V is traveling, each external camera 18 captures images of the driving route on which the vehicle V is traveling at specified intervals (for example, at specified spatial intervals or specified time intervals).

[0042] The vehicle sensor 8 is a sensor configured to detect the state of the vehicle V. The vehicle sensor 8 includes: a vehicle speed sensor configured to detect the speed of the vehicle V; an acceleration sensor configured to detect the acceleration of the vehicle V; a yaw rate sensor configured to detect the angular velocity around the vertical axis of the vehicle V; a direction sensor configured to detect the direction of the vehicle V, etc. For example, the yaw rate sensor is composed of a gyro sensor. The vehicle sensor 8 may further include: an inclination sensor configured to detect the inclination of the vehicle body; and a wheel speed sensor configured to detect the rotation speed of each wheel.

[0043] The communication device 9 is configured to mediate communication between the controller 16 and a device (e.g., the map server 3) outside the vehicle V. The communication device 9 includes a router configured to connect the controller 16 to the Internet. The communication device 9 may have a wireless communication function that mediates wireless communication between the controller 16 of the vehicle V and controllers of surrounding vehicles and between the controller 16 of the vehicle V and roadside devices on the road.

[0044] The GNSS receiver 10 is configured to receive a signal (hereinafter referred to as “GNSS signal”) related to the position (latitude and longitude) of the vehicle V from each satellite constituting a global navigation satellite system (GNSS). The GNSS receiver 10 is configured to output the received GNSS signal to the navigation device 11 and the controller 16 .

[0045] The navigation device 11 is constituted by a computer provided with known hardware. The navigation device 11 is configured to identify the position (latitude and longitude) of the vehicle V based on the previous travel history of the vehicle V and the GNSS signal output from the GNSS receiver 10. The navigation device 11 is configured to store data about roads in the region or country where the vehicle V is traveling (hereinafter referred to as "navigation map data"). The navigation device 11 is configured to store the navigation map data in a RAM, HDD, SSD, or the like.

[0046] The navigation device 11 is configured to set a route from the current position of the vehicle V to a destination input by the occupant based on GNSS signals and navigation map data, and output the route to the controller 16. When the vehicle V starts traveling, the navigation device 11 provides the occupant with route guidance to the destination.

[0047] The driving operation components 12 are disposed in the vehicle cabin and are configured to accept input operations performed by an occupant to control the vehicle V. The driving operation components 12 include a steering wheel, an accelerator pedal, and a brake pedal. The driving operation components 12 may further include a shift lever, a parking brake lever, a signal lever, and the like.

[0048] The driving operation sensor 13 is a sensor configured to detect the operation amount of the driving operation member 12. The driving operation sensor 13 includes: a steering angle sensor configured to detect the operation amount of the steering wheel; an accelerator sensor configured to detect the operation amount of the accelerator pedal; and a brake sensor configured to detect the operation amount of the brake pedal. The driving operation sensor 13 is configured to output the detected operation amount to the controller 16. The driving operation sensor 13 may further include a grip sensor configured to detect the situation where the occupant grips the steering wheel. For example, the grip sensor includes at least one capacitive sensor provided on the outer peripheral portion of the steering wheel.

[0049] The human-machine interface 14 is configured to notify the occupants of various information by display and / or voice, and to accept the input operation of the occupants. For example, the human-machine interface 14 includes a touch panel 23 and a sound device 24. The touch panel 23 includes a liquid crystal display, an organic EL display, etc., and is configured to accept the input operation of the occupants. The sound device 24 is composed of a buzzer and / or a speaker. The human-machine interface 14 is configured to display a driving mode switching button on the touch panel 23. The driving mode switching button is a button configured to accept the occupants' switching operation of the driving mode of the vehicle V (for example, autonomous driving mode and manual driving mode).

[0050] The human-machine interface 14 also serves as an interface to mediate input / output to / from the navigation device 11. That is, when the human-machine interface 14 receives an input operation of a destination from the occupant, the navigation device 11 starts setting a route to the destination. In addition, when the navigation device 11 provides route guidance to the destination, the human-machine interface 14 displays the current position of the vehicle V and the route to the destination.

[0051] The start switch 15 is a switch for starting the vehicle system 2. That is, when the occupant sits on the driver's seat and steps on the brake pedal, the occupant presses the start switch 15, thereby starting the vehicle system 2.

[0052] The controller 16 is composed of at least one electronic control unit (ECU) including a CPU, ROM, RAM, etc. The CPU performs operation processing according to a program, so the controller 16 performs various types of vehicle control. The controller 16 may be composed of one hardware, or may be composed of a unit including a plurality of hardware. The functions of the controller 16 may be at least partially performed by hardware such as LSI, ASIC, and FPGA, or may be performed by a combination of software and hardware.

[0053] The controller 16 includes an external environment recognition unit 31 (an embodiment of a dividing line estimation unit), a movement amount calculation unit 32, a driving control unit 33, and a map processing unit 34. These components may be constituted by separate electronic control units or an integrated electronic control unit.

[0054] The external environment recognition unit 31 is configured to recognize objects existing around the vehicle V based on the detection results of the external environment sensor 7, and thus obtain information about the position and size of the object. The objects recognized by the external environment recognition unit 31 include dividing lines, lanes, road ends, shoulders and obstacles existing on the driving route of the vehicle V. Each dividing line is a line shown along the driving direction of the vehicle. Each lane is an area defined by one or more dividing lines. Each road end is the end of the driving route of the vehicle V. Each shoulder is an area between a dividing line at an end arranged in the vehicle width direction (lateral direction) and the road end. Each obstacle can be a barrier (guardrail), a utility pole, surrounding vehicles, pedestrians, etc.

[0055] The external environment recognition unit 31 is configured to recognize the position of a boundary line (hereinafter referred to as a "camera boundary line") in a camera image based on an image captured by each external camera 18 (hereinafter referred to as a "camera image"). For example, the external environment recognition unit 31 is configured to extract points (hereinafter referred to as "candidate points") whose density values ​​change by a threshold value or a greater value in the camera image, and recognize a straight line passing through the candidate points as a camera boundary line. The external environment recognition unit 31 is configured to identify the type of camera boundary line based on the camera image. The types of camera boundary lines include a single solid line, a single broken line, a deceleration promotion line, and a double solid line. The deceleration promotion line is composed of, for example, a broken line having a shorter interval and a larger width than a single broken line.

[0056] The movement amount calculation unit 32 is configured to calculate the movement amount of the vehicle V (movement distance and movement direction of the vehicle V) by using dead reckoning such as odometry and inertial navigation based on the signal from the vehicle sensor 8. For example, the movement amount calculation unit 32 is configured to calculate the movement amount of the vehicle V based on the rotation speed of each wheel detected by the wheel speed sensor, the acceleration of the vehicle V detected by the acceleration sensor, and the angular velocity of the vehicle V detected by the gyro sensor. Hereinafter, the movement amount of the vehicle V calculated by the movement amount calculation unit 32 by using dead reckoning is referred to as "DR movement amount of the vehicle V".

[0057] The driving control unit 33 includes an action planning unit 41 , a travel control unit 42 , and a mode setting unit 43 .

[0058] The action planning unit 41 is configured to create an action plan for causing the vehicle V to travel along the route set by the navigation device 11. The action planning unit 41 is configured to output a travel control signal corresponding to the created action plan to the travel control unit 42.

[0059] The travel control unit 42 is configured to control the power system 4, the brake device 5, and the steering device 6 based on the travel control signal from the action planning unit 41. That is, the travel control unit 42 is configured to make the vehicle V travel according to the action plan created by the action planning unit 41.

[0060] The mode setting unit 43 is configured to switch the driving mode of the vehicle V between a manual driving mode and an autonomous driving mode. In the manual driving mode, the travel control unit 42 controls the power system 4, the brake device 5, and the steering device 6 according to the input operation of the occupant to the driving operation member 12, thereby driving the vehicle V. On the other hand, in the autonomous driving mode, the travel control unit 42 controls the power system 4, the brake device 5, and the steering device 6 regardless of the input operation of the occupant to the driving operation member 12, thereby causing the vehicle V to travel autonomously.

[0061] The map processing unit 34 includes a map acquisition unit 51 , a map storage unit 52 , a local map generation unit 53 (one embodiment of a map generation unit: hereinafter referred to as “LM generation unit 53 ”), and a position recognition unit 54 (one embodiment of a own lane recognition unit).

[0062] The map acquisition unit 51 is configured to access the map server 3 and acquire dynamic map data from the map server 3 (this will be described in detail later). For example, the map acquisition unit 51 is configured to acquire dynamic map data of an area corresponding to a route set by the navigation device 11 from the map server 3.

[0063] The map storage unit 52 is composed of a storage unit such as an HDD and an SSD. The map storage unit 52 is configured to store various information for making the vehicle V autonomously travel in the autonomous driving mode. The map storage unit 52 is configured to store dynamic map data acquired by the map acquisition unit 51 from the map server 3.

[0064] The LM generation unit 53 is configured to generate a detailed map (hereinafter referred to as a "local map") of the surrounding area of ​​the vehicle V based on the dynamic map data stored in the map storage unit 52. The LM generation unit 53 is configured to generate a local map by extracting data related to the surrounding area of ​​the vehicle V from the dynamic map data. Therefore, the local map may include any information included in the dynamic map data. For example, the local map includes information about lanes on the driving route (e.g., the number of lanes and the lane number of each lane) and information about each dividing line on the driving route (e.g., the type of dividing line). In addition, the local map may include information about objects (e.g., obstacles) recognized by the external environment recognition unit 31 based on camera images and information about the past DR movement amount of the vehicle V (i.e., the movement trajectory of the vehicle V). When the vehicle V is driving autonomously in the autonomous driving mode, the LM generation unit 53 can update the local map at any time according to the driving position of the vehicle V.

[0065] The position recognition unit 54 is configured to perform various positioning processes on the local map. For example, the position recognition unit 54 is configured to estimate the position of the vehicle V on the local map based on the GNSS signal output from the GNSS receiver 10, the DR movement amount of the vehicle V, the camera image, etc. In addition, the position recognition unit 54 is configured to recognize the position of the own lane (the lane in which the vehicle V is traveling) on ​​the local map based on the GNSS signal output from the GNSS receiver 10, the camera image, etc. When the vehicle V is traveling autonomously in the autonomous driving mode, the position recognition unit 54 can update the position of the vehicle V and the position of the own lane on the local map at any time according to the driving position of the vehicle V.

[0066] <Map Server 3>

[0067] Next, the map server 3 will be described. Figure 1 As shown in FIG. 1 , the map server 3 is connected to the controller 16 via a network N (the Internet in this embodiment) and a communication device 9. The map server 3 is a computer including a CPU, a ROM, a RAM, and a storage unit such as a HDD and a SSD. The dynamic map data is stored in the storage unit of the map server 3.

[0068] Dynamic map data includes static information, semi-static information, semi-dynamic information and dynamic information. Static information includes 3D map data that is more accurate than navigation map data. Semi-static information includes traffic control information, road construction information and wide-area weather information. Semi-dynamic information includes accident information, traffic congestion information and small-area weather information. Dynamic information includes signal information, surrounding vehicle information and pedestrian information.

[0069] The static information of the dynamic map data includes information about lanes on the driving route (e.g., the number of lanes and the lane number of each lane) and information about each dividing line on the driving route (e.g., the type of dividing line). For example, the dividing line in the static information is represented by nodes arranged at regular intervals and links connecting the nodes.

[0070] <Own lane recognition control>

[0071] Next, refer to Figure 2 , an outline of own lane recognition control (one embodiment of the own lane recognition method) for recognizing the own lane R (hereinafter referred to as “LM own lane R”) in which the vehicle V is traveling on the local map will be described. Figure 2 The "yes" in the code indicates that the LM lane R is recognized, and Figure 2 "No" in LM indicates that the LM own lane R is not recognized.

[0072] When the own lane recognition control starts, the position recognition unit 54 performs a first recognition process (step S1). In the first recognition process, the position recognition unit 54 estimates the position of the vehicle V on the local map, and calculates the number of lanes A (hereinafter referred to as "LM lanes A") existing in the specific area Y including the position of the vehicle V on the local map. In the case where there is only one LM lane A in the specific area Y on the local map, the position recognition unit 54 recognizes the one LM lane A as the LM own lane R, and terminates the own lane recognition control.

[0073] On the other hand, under the premise that the LM own lane R is not recognized in the first recognition process, in the case where there are multiple LM lanes A in the specific area Y on the local map, the position recognition unit 54 performs the second recognition process (step S2). In the second recognition process, the position recognition unit 54 compares the type of the boundary line B1 of the own lane B (one embodiment of the captured own lane: hereinafter referred to as "camera own lane B") recognized from the camera image with the type of the boundary line A1 of the LM lane A. Therefore, in the case where the type of the boundary line B1 of the camera own lane B matches the type of the boundary line A1 of only one LM lane A among the LM lanes A, the position recognition unit 54 recognizes the one LM lane A among the LM lanes A as the LM own lane R, and terminates the own lane recognition control.

[0074] On the other hand, if the LM own lane R is not recognized in the second recognition process, when the type of the boundary line B1 of the camera own lane B matches the type of the boundary lines A1 of the plurality of LM lanes A, the position recognition unit 54 performs the third recognition process (step S3). In the third recognition process, if one of the LM lanes A satisfies the prescribed conditions, the position recognition unit 54 recognizes the LM lane A among the LM lanes A as the LM own lane R and terminates the own lane recognition control. In other cases, if the LM own lane R is not recognized in the third recognition process, the position recognition unit 54 terminates the own lane recognition control.

[0075] <First Recognition Process>

[0076] Next, refer to Figure 3 and Figure 4 The first recognition process (step S1 ) of the own lane recognition control will be described. Figure 3 An embodiment of a local map when a vehicle V is traveling at a certain location is shown. Figure 4 It shows that when the vehicle V is different from Figure 3 An embodiment of a local map while driving at a location.

[0077] When the first recognition process starts, the position recognition unit 54 estimates the position of the vehicle V on the local map based on the GNSS signal output from the GNSS receiver 10. Hereinafter, the position of the vehicle V on the local map estimated based on the GNSS signal will be referred to as "GNSS own vehicle position P".

[0078] Next, the position identification unit 54 calculates the number of LM lanes A present in a specific area Y including the GNSS own vehicle position P on the local map. For example, the specific area Y is an area extending from the rear boundary position Yr to the front boundary position Yf. The rear boundary position Yr is a position offset rearward by a prescribed distance Z from the GNSS own vehicle position P in the vehicle travel direction X. The front boundary position Yf is a position offset forward by a prescribed distance Z from the GNSS own vehicle position P in the vehicle travel direction X. The specific area Y may satisfy not only the above conditions regarding the vehicle travel direction X (front-rear direction) but also the conditions regarding the vehicle width direction (lateral direction).

[0079] like Figure 3 As shown in , when there is only one LM lane A in the specific area Y, the position recognition unit 54 recognizes the LM lane A as the LM own lane R. On the other hand, Figure 4 As shown in , in the case where a plurality of LM lanes A exist in the specific area Y, the position recognition unit 54 terminates the first recognition process without recognizing any of the LM lanes A as the LM own lane R.

[0080] <Second Recognition Process>

[0081] Next, refer to FIG. 5A to FIG. 5C The second recognition process (step S2) of the own lane recognition control will be described. Figure 5A An embodiment of information acquired from a camera image when a vehicle V travels at a certain location is shown. Figure 5B and Figure 5C It shows that when the vehicle V is Figure 5A An example of a local map while driving at the same location is shown.

[0082] When the second recognition processing starts, the position recognition unit 54 determines the type of the boundary line B1 of the camera own lane B, and also determines the type of the boundary line A1 of the LM lane A present in the specific area Y. Next, the position recognition unit 54 compares the type of the boundary line B1 of the camera own lane B with the type of the boundary line A1 of the LM lane A. Therefore, in the case where the type of the boundary line B1 of the camera own lane B matches the type of the boundary line A1 of only one LM lane A, the position recognition unit 54 recognizes the one LM lane A as the LM own lane R. On the other hand, in the case where the type of the boundary line B1 of the camera own lane B matches the type of the boundary line A1 of a plurality of LM lanes A, or in the case where the type of the boundary line B1 of the camera own lane B does not match the type of the boundary line A1 of any LM lane A, the position recognition unit 54 terminates the second recognition processing without recognizing any LM lane A as the LM own lane R.

[0083] For example, in Figure 5A In , the type of the dividing line B1 on the right side of the camera's own lane B is a solid line, and the type of the dividing line B1 on the left side of the camera's own lane B is a broken line. Figure 5B In the example, the type of the dividing line A1 on the right side of the left LM lane A is a broken line, and the type of the dividing line A1 on the left side of the left LM lane A is a solid line. In addition, the type of the dividing line A1 on the left and right sides of the middle LM lane A is a broken line. In addition, the type of the dividing line A1 on the right side of the right LM lane A is a solid line, and the type of the dividing line A1 on the left side of the right LM lane A is a broken line. Therefore, in Figure 5A and 5B , the type of the boundary line B1 on both lateral sides (left and right) of the camera host lane B matches only the type of the boundary line A1 on both lateral sides (left and right) of the right LM lane A. Therefore, the position recognition unit 54 recognizes the right LM lane A as the LM host lane R.

[0084] like Figure 5CAs shown in , the LM lane A may provide the deceleration promotion line C in addition to or instead of the dividing line A1. In this case, even if the type of the dividing line B1 of the camera own lane B matches the type of the dividing line A1 of only one LM lane A, the position recognition unit 54 terminates the second recognition processing without recognizing that one LM lane A as the LM own lane R.

[0085] <Third Recognition Process>

[0086] Next, refer to Fig. 6A , Figure 6B , Fig. 7A and Figure 7B The third recognition process (step S3) of the own lane recognition control is described. Fig. 6A An embodiment of information acquired from a camera image when a vehicle V travels at a certain location is shown. Figure 6B It shows that when the vehicle V is Fig. 6A An embodiment of a local map while driving in the same location is shown. Fig. 7A An embodiment of information acquired from a camera image when a vehicle V travels at a certain location is shown. Figure 7B It shows that when the vehicle V is Fig. 7A An embodiment of a local map while driving in the same location is shown.

[0087] When the third recognition process starts, the position recognition unit 54 determines whether the shoulder D exists on one lateral side (left or right) of the camera own lane B. For example, in the case where at least one object E (e.g., a road end, a structure, or a curb) representing the shoulder D is recognized in the space on the one lateral side of the camera own lane B, the position recognition unit 54 determines that the shoulder D exists on the one lateral side of the camera own lane B. When determining that the shoulder D exists on the one lateral side of the camera own lane B, the position recognition unit 54 recognizes the end LM lane A (the LM lane A arranged at the end of the one lateral side in the LM lane A) as the LM own lane R.

[0088] For example, in Fig. 6A In the example, an object E (a structure such as a guardrail) representing a road shoulder D is recognized in the space to the left of the camera's own lane B, and therefore the position recognition unit 54 determines that there is a road shoulder D to the left of the camera's own lane B. Figure 6B , the position recognition unit 54 recognizes the end LM lane A (the LM lane A arranged at the left end among the LM lanes A) as the LM own lane R.

[0089] On the other hand, when it is determined that the road shoulders D do not exist on both lateral sides of the camera own lane B, the position recognition unit 54 determines whether both of the following conditions 1 and 2 are satisfied.

[0090] <Condition 1> There are dividing lines on both lateral sides of the camera lane B and both lateral sides of the left and right adjacent lanes F arranged on both lateral sides of the camera lane B (hereinafter referred to as "camera adjacent lanes F").

[0091] <Condition 2> There are three LM lanes A in a specific area Y on the local map.

[0092] When both Condition 1 and Condition 2 are satisfied, the position recognition unit 54 recognizes the center LM lane A among the three LM lanes A as the LM own lane R. On the other hand, when at least one of Condition 1 and Condition 2 is not satisfied, the position recognition unit 54 terminates the third recognition processing without recognizing any LM lane A as the LM own lane R.

[0093] For example, in Fig. 7A In the figure, there are boundary lines G (the common boundary line between the camera lane B and the camera adjacent lane F) and boundary line F1 (the boundary line between the camera adjacent lane F) on the two lateral sides of the camera own lane B and the two lateral sides of the left and right camera adjacent lanes F. In addition, Figure 7B In the example, there are three LM lanes A in a specific area Y on the local map. Fig. 7A and Figure 7B In , both conditions 1 and 2 are satisfied. Therefore, in Figure 7B In the example shown in FIG. 1 , the position recognition unit 54 recognizes the center LM lane A among the three LM lanes A as the LM own lane R. As shown in FIG.

[0094] <Lane Change Determination Control>

[0095] Next, refer to Figure 8 and Fig. 9 , a lane change determination control for determining whether the vehicle V has changed lanes on the local map will be described. Figure 8 An embodiment of a local map is shown when a vehicle V is traveling at a certain location. Fig. 9 It shows that when the vehicle V is different from Figure 8 An embodiment of a local map while driving at a location.

[0096] After the position recognition unit 54 recognizes the LM own lane R in the second recognition process or the third recognition process of the own lane recognition control, the lane change determination control is executed. In the lane change determination control, the position recognition unit 54 determines whether the vehicle V has changed lanes on the local map. For example, Figure 8 As shown in the figure, when the center V1 of the vehicle V on the local map has crossed the dividing line I of the LM lane R (hereinafter referred to as "LM dividing line I") and has deviated from the LM dividing line I by a specified length M or more, the position identification unit 54 determines that the vehicle V has crossed the LM dividing line I and changed lanes.

[0097] When it is determined that the vehicle V has crossed the LM lane dividing line I and changed lanes, the position recognition unit 54 changes the LM lane R by switching the lane number of the LM lane R according to the direction of the lane change. Figure 8 , the vehicle V has already made a lane change from the LM own lane R (lane number 1) to the adjacent lane H (lane number 2: hereinafter referred to as "LM adjacent lane H") across the LM own dividing line I. Therefore, the position recognition unit 54 switches the lane number of the LM own lane R from 1 to 2, thereby changing the LM own lane R (lane number 1) before changing to the LM adjacent lane H, and also changing the LM adjacent lane H (lane number 2) before changing to the LM own lane R.

[0098] By the way, if Fig. 9 As shown in FIG. 5 , where a merge lane J on the local map (hereinafter referred to as “LM merge lane J”) merges with a main lane K on the local map (hereinafter referred to as “LM main lane K”), there may be no dividing line between the LM merge lane J and the LM main lane K. In this case, the position recognition unit 54 sets a virtual dividing line L between the LM merge lane J and the LM main lane K. For example, the virtual dividing line L is set so that the distance from the center line J1 of the LM merge lane J to the virtual dividing line L is equal to the distance from the center line K1 of the LM main lane K to the virtual dividing line L. In the case where the center V1 of the vehicle V on the local map has crossed the virtual dividing line L and has shifted from the virtual dividing line L by a prescribed length M or more, the position recognition unit 54 determines that the vehicle V has crossed the virtual dividing line L from the LM merge lane J (i.e., the LM own lane R) to change lanes to the LM main lane K (i.e., the LM adjacent lane H). Incidentally, the position recognition unit 54 may set a virtual dividing line L similar to the above virtual dividing line L for an area where the LM main lane K on the local map branches into a plurality of branch lanes.

[0099] <Lane reset control>

[0100] Next, the own lane resetting control for resetting the lane number of the LM own lane R recognized in the own lane recognition control (one embodiment of the information on the LM own lane R) will be described.

[0101] After recognizing the LM own lane R in the own lane recognition control, the position recognition unit 54 performs the own lane reset control. In the own lane reset control, the position recognition unit 54 resets the lane number of the LM own lane R when at least one of the following conditions 1 to 4 is satisfied.

[0102] <Condition 1> The LM own lane R is incorrectly recognized.

[0103] <Condition 2> The local map is not output from the LM generation unit 53 to the position identification unit 54.

[0104] <Condition 3> There is no information on the boundary line A1 of the LM lane A in front of the vehicle V.

[0105] <Condition 4> The position of the vehicle V on the local map (hereinafter referred to as “LM own vehicle position”) cannot be estimated.

[0106] Regarding Condition 1, when both of the following Conditions 1-1 and 1-2 are satisfied, the position identification unit 54 determines that the LM own lane R is erroneously identified.

[0107] <Condition 1-1> The type of camera boundary line can be identified.

[0108] <Condition 1-2> The lane number of the newly recognized LM own lane R recognized in the current own lane recognition control does not match the lane number of the previously recognized LM own lane R recognized in the previous own lane recognition control (including the lane number switched in the lane change determination control).

[0109] Regarding condition 4, the position recognition unit 54 may stop estimating the LM own vehicle position after recognizing the LM own vehicle lane R in the first recognition process. Even in this case, as long as it is determined that the position of the vehicle V calculated from the last estimated LM own vehicle position based on the DR movement amount of the vehicle V does not deviate from the LM own vehicle lane R, the position recognition unit 54 maintains the lane number of the LM own lane R without resetting it.

[0110] <Effect>

[0111] According to the present embodiment, in the case where one LM lane A is the only lane existing in the specific area Y on the local map, the position recognition unit 54 recognizes the one LM lane A as the LM own lane R. In addition, in the case where there are multiple LM lanes A in the specific area Y, the position recognition unit 54 compares the type of the boundary line B1 of the camera own lane B with the type of the boundary lines A1 of the multiple LM lanes A. Then, in the case where the type of the boundary line B1 of the camera own lane B matches the type of the boundary line A1 of only one LM lane A among the multiple LM lanes A, the position recognition unit 54 recognizes the one LM lane A among the multiple LM lanes A as the LM own lane R. In this way, by changing the recognition method of the LM own lane R according to the number of LM lanes A existing in the specific area Y, the LM own lane R can be effectively recognized.

[0112] Furthermore, in the case where the type of the dividing line B1 of the camera own lane B matches the type of the dividing line A1 of the plurality of LM lanes A and there is a road shoulder D on one lateral side of the camera own lane B, the position recognition unit 54 recognizes the end LM lane A (the LM lane A arranged at the end of one lateral side in the LM lane A) as the LM own lane R. Therefore, even if the type of the dividing line B1 of the camera own lane B matches the type of the dividing line A1 of the plurality of LM lanes A, the LM own lane R can be recognized based on the presence of the road shoulder D. Therefore, the LM own lane R can be recognized more effectively.

[0113] Furthermore, in the case where the type of the boundary line B1 of the camera own lane B matches the type of the boundary lines A1 of the plurality of LM lanes A, boundary lines exist on both lateral sides of the camera own lane B and both lateral sides of the camera adjacent lane F, and there are three LM lanes A in the specific area Y on the local map, the position recognition unit 54 recognizes the center LM lane A among the three LM lanes A as the LM own lane R. Therefore, even if the type of the boundary line B1 of the camera own lane B matches the type of the boundary lines A1 of the plurality of LM lanes A, the LM own lane R can be recognized based on the presence of the boundary lines on both lateral sides of the camera own lane B and the camera adjacent lane F. Therefore, the LM own lane R can be recognized more effectively.

[0114] Furthermore, when determining that the vehicle V has changed lanes on the local map after recognizing the LM own lane R, the position recognition unit 54 changes the LM own lane R according to the direction of the lane change. Therefore, the LM own lane R can be appropriately changed according to the lane change.

[0115] Furthermore, in the case where the type of the camera boundary line can be identified and the lane number of the newly identified LM own lane R does not match the lane number of the previously identified LM own lane R, the position identification unit 54 resets the lane number of the LM own lane R. Therefore, continued erroneous identification of the LM own lane R can be avoided.

[0116] Furthermore, when estimating the LM own vehicle position is stopped after recognizing the LM own lane R, the position recognition unit 54 resets the lane number of the LM own lane R. Therefore, it is possible to avoid continuing to erroneously recognize the LM own lane R.

[0117] However, even if the estimation of the LM own vehicle position is stopped after identifying one LM lane A, which is the only lane existing in the specific area Y on the local map, as the LM own lane R, the position identification unit 54 maintains the lane number of the LM own lane R as long as it is determined based on the DR movement amount of the vehicle V that the vehicle V does not deviate from the LM own lane R. Therefore, when it is determined that the vehicle V does not deviate from the LM own lane R, the LM own lane R can be identified more effectively by exceptionally maintaining the lane number of the LM own lane R.

[0118] The specific embodiments of the present invention have been described above, but the present invention should not be limited to the foregoing embodiments, and various modifications and changes may be made within the scope of the present invention.

Claims

1. A vehicle control system, the vehicle control system comprising: an imaging device configured to capture an image of a travel path along which the vehicle is traveling; a mode setting unit configured to switch a driving mode of the vehicle between a manual driving mode and an autonomous driving mode; a map generation unit configured to generate a map of an area surrounding the vehicle; as well as a lane recognition unit configured to recognize, on the map, a lane in which the vehicle is traveling, Wherein, the lane recognition unit is configured as follows: estimating a position of the vehicle on the map; calculating the number of lanes present in a specific area including the position of the vehicle on the map; If a lane is the only lane existing in the specific area on the map, identifying the lane as the host lane on the map; In a case where there are a plurality of lanes in the specific area on the map, comparing a type of a boundary line of a captured own lane with types of boundary lines of the plurality of lanes on the map, the captured own lane being the own lane identified from the image captured by the imaging device; and in a case where the type of the captured boundary line of the own lane matches the type of the boundary line of only one lane among the multiple lanes on the map, identifying the one lane among the multiple lanes on the map as the own lane on the map, Wherein, when the vehicle is autonomously driving in the autonomous driving mode, the own lane recognition unit updates the position of the own lane on the map according to the driving position of the vehicle, wherein, when the vehicle changes lanes on the map after determining that the own lane on the map is identified, the own lane identification unit changes the own lane on the map according to the direction of the lane change, At a location where a merging lane on the map merges with a main lane on the map, if there is no dividing line between the merging lane and the main lane, the own lane recognition unit sets a virtual dividing line between the merging lane and the main lane so that a distance from the merging lane to the virtual dividing line is equal to a distance from the main lane to the virtual dividing line, and When the center of the vehicle on the map has crossed the virtual dividing line and deviated from the virtual dividing line by a specified length or more, the own lane recognition unit determines that the vehicle has changed lanes from the merging lane to the main lane across the virtual dividing line.

2. The vehicle control system according to claim 1, wherein: When the type of the dividing line of the captured own lane matches the type of the dividing lines of the multiple lanes on the map and there is a shoulder on one lateral side of the captured own lane, the own lane identification unit identifies the end lane as the own lane on the map, and the end lane is arranged at the end of the one lateral side among the multiple lanes on the map.

3. The vehicle control system according to claim 1, wherein: When the type of the dividing line of the captured own lane matches the type of the dividing lines of the multiple lanes on the map, there are dividing lines on two lateral sides of the captured own lane and on two lateral sides of the left and right adjacent lanes arranged on the two lateral sides of the captured own lane, and when there are three lanes in the specific area on the map, the own lane identification unit identifies the central lane among the three lanes as the own lane on the map.

4. The vehicle control system according to any one of claims 1 to 3, wherein: When the type of the dividing line identified in the image captured by the imaging device can be identified and the lane number of the newly identified own lane on the map does not match the lane number of the previously identified own lane on the map, the own lane identification unit resets the information about the own lane on the map.

5. The vehicle control system according to any one of claims 1 to 3, wherein: When estimating the position of the vehicle on the map is stopped after recognizing the own lane on the map, the own lane recognition unit resets information about the own lane on the map.

6. The vehicle control system according to claim 5, further comprising a movement amount calculation unit configured to calculate the movement amount of the vehicle by using a dead reckoning method, in, Even if estimation of the position of the vehicle on the map is stopped after the one lane that is the only lane existing in the specific area on the map is identified as the own lane on the map, the own lane identification unit maintains the information about the own lane on the map as long as it is determined based on the movement amount of the vehicle calculated by the movement amount calculation unit that the vehicle does not deviate from the own lane on the map.