Driving path generation method and device, computer equipment and storage medium

By building virtual lane lines and generating driving paths, the problem that the vehicle's intelligent driving assistance system is difficult to plan the path under road conditions with large lane lines dislocation is solved, the smooth transition of the vehicle and the continuity of intelligent driving assistance functions are achieved, and the user experience is improved and driving safety.

CN119078875AActive Publication Date: 2024-12-06BYD CO LTD
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202411233579.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-12-06
Estimated Expiration
2044-09-03

AI Technical Summary

Technical Problem

In the vehicle intelligent driving assistance system, when the lane line has a large misalignment range, it is difficult for the existing technology to effectively plan the driving path, resulting in the risk of vehicle out of control and poor user experience. The intelligent driving assistance function is frequently withdrawn, affecting driving safety and experience .

Method used

By determining the current and target lane lines of the vehicle, building virtual lane lines, generating the vehicle's driving path, ensuring that the vehicle can transition smoothly when the lane lines are dislocation, avoiding users' need to manually take over the steering wheel, and maintaining the continuity of intelligent driving assistance functions .

Benefits of technology

It realizes a smooth transition of vehicles under road conditions with large lane line dislocation, improves the user's experience of intelligent driving, avoids the risk of vehicle out of control and the frequent exit of intelligent driving assistance functions, and ensures driving safety and system continuity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119078875A_ABST
    Figure CN119078875A_ABST
Patent Text Reader

Abstract

The invention relates to a driving path generation method and device, computer equipment and a storage medium, and the method comprises the steps: determining a first lane line of a current lane where a vehicle is located, and determining a second lane line of a target lane where the vehicle is about to enter; constructing a virtual lane line based on the first lane line and the second lane line; and generating a driving path of the vehicle based on the virtual lane line. By the adoption of the scheme, the vehicle driving path meeting the transverse vehicle control requirement can be generated in the road condition that the front and back transverse dislocation amplitude of the lane line is large, and good intelligent driving experience can be provided for a user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a driving path generation method, device, computer equipment and storage medium. Background Art

[0002] At present, the intelligent driving assistance system of automobiles has high-level lateral and longitudinal auxiliary control functions. During the driving process of the vehicle, the intelligent driving assistance system detects the lane lines on both sides of the vehicle lane in real time through the on-board high-definition camera and plans the driving path accordingly, so that the vehicle can keep driving in the center and realize the lateral auxiliary control of the vehicle.

[0003] In the vehicle lateral auxiliary control, too large a lateral deviation will lead to the risk of vehicle loss of control, which poses a great safety hazard. In the related technology, the driver is usually required to manually drive the vehicle to ensure the safety of the vehicle during the lateral deviation process, which greatly affects the user's driving experience. Summary of the invention

[0004] The embodiments of the present application provide a driving path generation method, apparatus, computer equipment and storage medium, which can perform driving path planning under road conditions where lane lines have a large misalignment range, so as to at least partially solve the above-mentioned technical problems.

[0005] In order to achieve the above object, according to a first aspect of the present application, a driving path generation method is provided, the method comprising:

[0006] Determine a first lane line of a current lane where the vehicle is located, and determine a second lane line of a target lane that the vehicle is about to enter;

[0007] Constructing a virtual lane line based on the first lane line and the second lane line;

[0008] A driving path of the vehicle is generated based on the virtual lane line.

[0009] According to a second aspect of the present application, a driving path generation device is provided, the device comprising:

[0010] A determination module, used to determine a first lane line of a current lane where the vehicle is located, and to determine a second lane line of a target lane that the vehicle is about to enter;

[0011] A construction module, configured to construct a virtual lane line based on the first lane line and the second lane line;

[0012] A generation module is used to generate a driving path of the vehicle based on the virtual lane line.

[0013] According to a third aspect of the present application, a computer device is provided, including a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads the instructions from the memory to execute the steps of the driving path generation method as described in the first aspect.

[0014] According to a fourth aspect of the present application, a computer-readable storage medium is provided, which stores a plurality of instructions suitable for loading by a processor to execute the steps of the driving path generation method as described in the first aspect.

[0015] According to a fifth aspect of the present application, a computer program product is provided, comprising a computer program or instructions, which, when executed by a processor, implements the steps of the driving path generation method as described in the first aspect.

[0016] The driving path generation method, device, computer equipment and storage medium of the embodiments of the present application can determine the starting position and the end position of the vehicle for path planning under the road condition where the lane lines have a misalignment range by determining the first lane line of the current lane where the vehicle is located and determining the second lane line of the target lane that the vehicle is about to enter; thereby, based on the first lane line and the second lane line, a virtual lane line is constructed, and when the lane lines on both sides of the lane where the vehicle is located temporarily disappear, or the lateral misalignment range of the front and rear lane lines is large, the intelligent driving assistance or automatic driving of the vehicle can be maintained by constructing a virtual lane, without the need for the user to take over the steering wheel and drive manually, thereby avoiding the safety hazard caused by the user not taking over the steering wheel in time; the driving path of the vehicle is generated based on the virtual lane line, and the path planning can be carried out in time based on the virtual lane line, so as to correctly control the driving direction of the vehicle without exiting the lateral assistance function in the intelligent driving function, and realize the smooth transition of the vehicle from the current lane to the target lane under the road condition where the lane lines have a misalignment range, thereby improving the user's intelligent driving experience.

[0017] Other features and advantages of the present application will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0019] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings, wherein the same figure numbers represent the same parts in the following description.

[0020] Figure 1is a top view schematic diagram of a diversion road condition provided in some embodiments of the present application;

[0021] Figure 2 is a schematic diagram of an application scenario of a driving path generation method provided in some embodiments of the present application;

[0022] Figure 3 is a flowchart of a driving path generation method provided in some embodiments of the present application;

[0023] Figure 4 is a schematic diagram of an image coordinate system provided in some embodiments of the present application;

[0024] Figure 5 is a schematic diagram of virtual lane lines provided in some embodiments of the present application;

[0025] Figure 6 is a schematic diagram of virtual lane lines and driving paths provided in some embodiments of the present application;

[0026] Figure 7 is a schematic diagram of the principle of constructing a virtual lane line provided in some embodiments of the present application;

[0027] Figure 8 is a schematic diagram of the principle of determining a segmentation point provided in some embodiments of the present application;

[0028] Fig. 9 is a schematic diagram of a scene of a driving area provided in some embodiments of the present application;

[0029] Fig.10 is a flowchart of steps respectively performed by a lane line information extraction module and a vehicle driving path planning module provided in some embodiments of the present application;

[0030] Fig.11 is a schematic diagram of the structure of a driving path generating device provided in some embodiments of the present application;

[0031] Fig.12 It is a schematic diagram of the structure of a computer device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0032] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0033] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0034] At present, the intelligent driving assistance system of automobiles has been more and more widely used. Intelligent driving assistance can detect the lane lines on both sides of the vehicle lane in real time through the vehicle's high-definition camera during driving and plan the driving path accordingly, so as to keep the vehicle centered and realize the lateral auxiliary control of the vehicle. During the driving process of the vehicle, it is often encountered with diversion road conditions, such as Figure 1 As shown. In this road condition where the lane lines are about to diverge, the lane lines on both sides will be temporarily lost, and the lane lines before and after the divergence are misaligned to a large extent, resulting in the inability of the intelligent driving assistance system to correctly control the vehicle. In this case, most of the existing technologies adopt the same processing method as the intersection, solving this problem by exiting the intelligent driving lateral assistance function and using a variety of alarm methods such as vision and sound to remind the user to take over the vehicle. Therefore, in the diverging road condition where the lane lines have a large misalignment, the existing technology does not consider the vehicle driving path planning based on the lane line information before and after the divergence, but directly exits the intelligent driving lateral assistance function, which is easy to cause the vehicle to have a driving path deviation when the user does not take over the steering wheel in time, thereby increasing the driving risk factor and affecting driving safety. In addition, for roads with more lane line divergence conditions, the frequent exit of the intelligent driving assistance function will have a great impact on the continuity of the function operation, and cannot meet the user's intelligent driving needs; while the auxiliary function is frequently exited, the system reminds the user to take over the vehicle through various alarm methods, which also greatly affects the user's driving experience.

[0035] In view of this, the embodiments of the present application provide a driving path generation method, device, system, equipment and storage medium, which are intended to extract the front and rear lane line information and then construct virtual lane lines when the vehicle recognizes the road condition based on the camera or other camera devices on the vehicle, so that the intelligent driving assistance system can timely perform path planning based on the virtual lane lines, thereby correctly controlling the vehicle's driving direction without exiting the lateral assistance function, achieving a smooth transition of the vehicle under the road condition where the lane line has a lateral misalignment, and improving the user's intelligent driving experience. Compared with the prior art, the driving path generation method provided in the embodiments of the present application is proposed for the lane line conditions with a large front and rear lateral misalignment, which can effectively solve the problem of frequent exit of the intelligent driving assistance function under such road conditions, and help improve the driver's intelligent driving experience; and the driving path generation method provided in the present application has low computing power requirements, simple process, high algorithm robustness and environmental adaptability, and can be applied to various types of lane line diversion road conditions and lane change scenarios.

[0036] Among them, the road conditions in which the lane lines have a lateral misalignment include at least two scenarios: lane line divergence scenario and lane change scenario. Under the above road conditions, the front and rear lane lines have a certain degree of misalignment in the lateral direction (with the vehicle's travel direction as the vertical direction, and the lateral direction is the direction perpendicular to the vertical direction). In addition, under the above road conditions, the front and rear lane lines may be at a certain distance in the vertical direction.

[0037] In some embodiments, see Figure 2 The embodiments of the present application can be applied to Figure 2 In the application scenario shown. Figure 2 The application scenario shown can be a traffic diversion scenario or a lane change scenario. Figure 2 The number of front and rear lanes in the road scenario shown in is only an example. In the diversion scenario and lane change scenario used in the embodiments of the present application, the number of lanes before and after the diversion / lane change may be the same or different, and the present application does not limit this.

[0038] The terminal device 202 may be a device including both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. The terminal device 202 may communicate with the server 204 through a network. The terminal device 202 may also communicate with the vehicle through a network.

[0039] Exemplarily, the terminal device 202 can obtain the image taken by the camera of the vehicle, and obtain the road surface top view through processing. Alternatively, the terminal device 202 can also obtain the road surface top view sent by the server 204. The terminal device 202 can determine the first lane line of the current lane where the vehicle is located, and determine the second lane line of the target lane that the vehicle is about to enter, and then construct a virtual lane line based on the first lane line and the second lane line, and finally generate the vehicle's driving path based on the virtual lane line. Alternatively, the above steps can also be performed by the server 204, and the driving path is sent to the terminal device 202, and the terminal device 202 controls the vehicle to drive according to the driving path, and so on.

[0040] The terminal device includes but is not limited to one or more of a mobile phone, a computer, an IoT device, a vehicle-mounted terminal, and a portable wearable device. The IoT device may be a smart vehicle-mounted device. The portable wearable device may be one or more of a smart watch, a smart bracelet, smart glasses, and a head-mounted device.

[0041] The server may be an independent server, or a server network, server cluster or distributed system consisting of multiple servers. The server includes but is not limited to a computer, a network host, a single network server, a set of multiple network servers or a cloud server consisting of multiple servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0042] The vehicle may be a fuel vehicle, a plug-in hybrid vehicle or a new energy vehicle, etc., and this application does not make any specific limitation on this.

[0043] The following is a detailed description of the embodiments in conjunction with the accompanying drawings. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments. Although the logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different from that shown in the accompanying drawings.

[0044] See also Figure 3 , provides a driving route generation method, which is applied to a computer device. The computer device may be a terminal device or a server. The method includes:

[0045] Step S301, determining a first lane line of a current lane where the vehicle is located, and determining a second lane line of a target lane that the vehicle is about to enter.

[0046] As mentioned above, embodiments of the present application can be applied in diverging road conditions and lane change scenarios. Taking diverging road conditions as an example, in some embodiments, the computer device determines the first lane line of the current lane where the vehicle is located before the divergence, and determines the second lane line of the target lane that the vehicle will enter after the divergence. Specifically, the computer device determines whether it belongs to a diverging road condition. One of the characteristics of a diverging road condition is that the lane lines are disconnected in the longitudinal direction and have misalignment in the lateral direction. Under the diverging road condition, the computer device determines the lane where the vehicle is located before the divergence (ie, the current lane), and the lane that the vehicle will enter after the divergence, i.e., the target lane. Furthermore, the computer device extracts the lane line of the current lane as the first lane line, and extracts the second lane line of the target lane as the second lane line.

[0047] The computer device may extract the first lane line and the second lane line based on the image collected by the vehicle or road facilities and equipment. In some embodiments, the computer device also performs image processing such as resizing, noise reduction filtering, binarization, and coordinate system mapping on the image to highlight the lane line information.

[0048] For example, the computer device can extract lane lines from road monitoring images collected by vehicles or road facilities, and further distinguish the first lane line from the second lane line. Exemplarily, the computer device obtains a road top view, and determines the first lane line and the second lane line in the road top view. The road top view is an image of the road from a bird's-eye view, such as Figure 1 As shown. For example, the computer device can obtain the road surface image collected by the vehicle and generate a road surface top view by means of reverse perspective mapping or the like.

[0049] In some embodiments, the computer device may obtain the road top view in the following manner: obtain a traffic monitoring image captured by a camera of the vehicle; and convert the traffic monitoring image into the road top view based on a preset coordinate system mapping relationship. The preset coordinate system mapping relationship may be, for example, a mapping relationship between a coordinate system of the real physical world and an image coordinate system.

[0050] In other embodiments, the computer device may also acquire point cloud data and determine the first lane line and the second lane line based on the point cloud data. For example, point cloud data belonging to the lane line may be extracted from the point cloud data, and then the first lane line and the second lane line may be extracted.

[0051] For the sake of simplicity and ease of understanding, the following will take image processing as an example for explanation.

[0052] It should be noted that, for the sake of simplicity, the longitudinal direction in the present application embodiment refers to the Y-axis direction of the image coordinate system, and the transverse direction refers to the X-axis direction of the image coordinate system. For example, the X-axis and Y-axis directions of the image coordinate system are as follows: Figure 4 As shown, the upper left corner of the image is taken as the origin of the coordinate axis.

[0053] Therefore, the computer device can extract all the lane lines in the image and determine whether the vehicle is currently in a diversion road condition based on the distance characteristics between the lane lines in the image.

[0054] If so, the computer device determines the first lane line of the current lane where the vehicle is located before the divergence, and the second lane line of the target lane that the vehicle will enter after the divergence. The current lane where the vehicle is located before the divergence can be the lane lines on both sides of the vehicle in the image. The target lane to be entered after the divergence can be automatically determined by the computer device or manually set by the user.

[0055] In some embodiments, the computer device determines the lane line with the shortest distance as the lane line of the target lane based on the lateral distance between each lane line after diversion and the lane line of the current lane, that is, the distance in the X-axis direction.

[0056] The computer device may construct a virtual lane line through lane lines located on the same side of the lane. For example, the computer device may use the left lane line of the current lane as the first lane line and the left lane line of the target lane as the second lane line; or, the computer device may use the right lane line of the current lane as the first lane line and the right lane line of the target lane as the second lane line.

[0057] In other embodiments, the computer device may use the left lane line and the right lane line of the current lane as the first lane line, and use the left lane line and the right lane line of the target lane as the second lane line. It is easy to understand that when the determined lane line includes the left lane line and the right lane line, the first left lane line corresponds to the second left lane line, and the first right lane line corresponds to the second right lane line, thereby generating smooth virtual lane lines on both sides.

[0058] Step S302: construct a virtual lane line based on the first lane line and the second lane line.

[0059] Specifically, the computer device constructs a virtual lane line based on the first lane line of the current lane and the second lane line of the target lane, so that the computer device can timely perform path planning based on the virtual lane line, thereby correctly controlling the vehicle's driving direction and achieving a smooth transition of the vehicle under diversion road conditions.

[0060] Among them, when the first lane line and the second lane line are both lane lines on the left side of the lane, the constructed virtual lane line is also the left lane line of the virtual lane, such as Figure 5 As shown in Figure (a) in ; when the first lane line and the second lane line are both lane lines on the right side of the lane, the constructed virtual lane line is also the right lane line of the virtual lane, such as Figure 5 As shown in Figure (b) in FIG; and when the first lane line and the second lane line both include the left lane line and the right lane line, the constructed virtual lane line also includes the left and right lane lines of the virtual lane, such as Figure 5 As shown in Figure (c).

[0061] Step S303: generating a driving path of the vehicle based on the virtual lane line.

[0062] Specifically, the computer device plans a driving path based on the generated virtual lane lines, so that the vehicle travels along the driving path, thereby achieving a smooth transition from the current lane to the target lane under diverging road conditions, avoiding the vehicle's exit from the intelligent driving function due to excessive lateral deviation and the resulting safety hazards.

[0063] In some embodiments, the computer device may generate a virtual lane line along the virtual lane line and at a distance from the virtual lane line according to a preset distance. When the virtual lane line includes lane lines on the left and right sides, that is, Figure 5 For the two virtual lane lines shown in Figure (c) in FIG, the computer device can generate a driving path in the middle of the virtual lane lines on both sides, such as Figure 6 As shown, the vehicle travels along the driving path represented by the solid line with an arrow. The driving path is equidistant from the virtual lane lines on the left and right sides in the X-axis direction, thereby ensuring that the vehicle is on the inside of the virtual lane lines, ensuring a safe driving distance between the vehicle and other lanes and other vehicles.

[0064] The driving path generation method of the embodiment of the present application can determine the starting position and the end position of the vehicle for path planning under the diversion road condition by determining the first lane line of the current lane where the vehicle is located before the diversion, and determining the second lane line of the target lane that the vehicle will enter after the diversion; thus, based on the first lane line and the second lane line, a virtual lane line is constructed, and in the case that the lane lines on both sides of the lane where the vehicle is located temporarily disappear in the diversion road condition, or the front and rear lane lines are misaligned to a large extent, the intelligent driving assistance or automatic driving of the vehicle can be maintained by constructing a virtual lane, without the user taking over the steering wheel and driving manually, and generating the driving path of the vehicle based on the virtual lane line, and can timely perform path planning based on the virtual lane line, so as to correctly control the driving direction of the vehicle without exiting the lateral assistance function in the intelligent driving function, and realize the smooth transition of the vehicle from the front lane to the rear lane under the diversion road condition, effectively solving the problem of frequent exit of the intelligent driving assistance function on roads with more lane line diversion road conditions, and improving the user's intelligent driving experience. In addition, the driving path generation method of the embodiment of the present application has small computing power requirements, simple process, high algorithm robustness and environmental adaptability, and can be applied to various types of lane line diversion road conditions.

[0065] Since the lane lines of the front and rear lanes of the diverging road condition are misaligned, if the front and rear lanes of the diverging road condition are directly connected to construct a virtual lane line, the lateral deviation of the vehicle during driving will be too large, which poses a serious safety hazard. To this end, in some embodiments, based on the first lane line and the second lane line, a virtual lane line is constructed, including: determining a first tangent point on the first lane line and a second tangent point on the second lane line; wherein the first lane line belongs to the current lane where the vehicle is located before the diverging road condition, and the second lane line belongs to the target lane that the vehicle will enter after the diverging road condition; constructing a first virtual lane line based on the first tangent point, and constructing a second virtual lane line based on the second tangent point; constructing a virtual lane line based on the first virtual lane line and the second virtual lane line.

[0066] Specifically, the computer device determines a first tangent point on the first lane line and a second tangent point on the second lane line, respectively. The first tangent point is at least a certain distance away from the end point of the first lane line, and the second tangent point is at least a certain distance away from the start point of the second lane line, and the distances between the two can be equal or different.

[0067] Thus, the computer device can construct the first virtual lane line based on the first tangent point, and construct the second virtual lane line based on the second tangent point. The computer device can connect the first virtual lane line and the second virtual lane line to construct the virtual lane line.

[0068] In the above embodiment, a two-stage fitting method is constructed to construct virtual lane lines during the diversion process, so that the generated virtual lane lines can ensure smooth driving of the vehicle, meet the lateral control requirements of the vehicle, and avoid safety hazards caused by excessive lateral deviation during driving.

[0069] In some embodiments, the first lane line includes a first left lane line and a first right lane line, and the second lane line includes a second left lane line and a second right lane line. The first tangent point includes: a first left tangent point located on the first left lane line, and a first right tangent point located on the first right lane line; the second tangent point includes: a second left tangent point located on the second left lane line, and a second right tangent point located on the second right lane line.

[0070] Thus, the constructed first virtual lane line includes: a first virtual left lane line constructed based on the first left tangent point, and a first virtual right lane line constructed based on the first right tangent point; the second virtual lane line includes: a second virtual left lane line constructed based on the second left tangent point, and a second virtual right lane line constructed based on the second right tangent point. Furthermore, based on the first virtual lane line and the second virtual lane line, constructing a virtual lane line includes: connecting the first virtual left lane line with the second virtual left lane line to generate a virtual left lane line; connecting the first virtual right lane line with the second virtual right lane line to generate a virtual right lane line; constructing a virtual lane line based on the virtual left lane line and the virtual right lane line.

[0071] In the above embodiment, a two-stage fitting method is constructed to construct virtual lane lines during the diversion process, and virtual lane lines on the left and right sides of the lane are constructed respectively. The virtual lane lines on both sides can constitute a complete virtual lane. The driving path is planned within the virtual lane, which can make the driving path more accurate, ensure the smooth driving of the vehicle, meet the lateral control requirements of the vehicle, and avoid safety hazards caused by excessive lateral deviation during driving.

[0072] In some embodiments, determining a first tangent point on a first lane line and a second tangent point on a second lane line includes: determining an end point of the first lane line and a starting point of the second lane line; on the first lane line, using a point that is a first preset value away from the end point as the first tangent point; and on the second lane line, using a point that is a second preset value away from the starting point as the second tangent point.

[0073] Specifically, the computer device uses the end point of the first lane line at the divergence as the termination point, indicating that the lane line before the divergence is disconnected here; and uses the starting end point of the second lane line at the divergence as the starting point, indicating that the lane line after the divergence starts from here.

[0074] Thus, the computer device determines a point on the first lane line that is separated from the end point by a first preset value as the first tangent point, and determines a point on the second lane line that is separated from the start point by a second preset value as the second tangent point. The first preset value and the second preset value may be equal or different.

[0075] In the above embodiment, by selecting a point that is a certain distance away from the lane line breakpoints before and after the diversion as the tangent point, the generated virtual lane line can have a certain extension in the longitudinal direction, and the lateral offset amplitude of the driving path generated based on the virtual lane line can meet the lateral control requirements of the vehicle, avoiding safety hazards caused by excessive lateral offset.

[0076] In some embodiments, constructing a first virtual lane line based on a first tangent point includes: determining a first virtual auxiliary line based on the first tangent point and a lane line equation corresponding to the first lane line; determining a split point, and determining a second virtual auxiliary line based on the split point and the first tangent point; constructing the first virtual lane line based on the first virtual auxiliary line and the second virtual auxiliary line.

[0077] Specifically, when determining the first lane line, the computer device also determines a lane line equation corresponding to the first lane line. Exemplarily, the computer device can generate a lane line equation corresponding to the first lane line through a lane line fitting method. Lane line fitting methods include but are not limited to the least squares method based on a hyperbolic model, an image processing method based on edge detection and transformation, lane line fitting based on a fitting function and a residual function, etc., and this application does not limit this.

[0078] In addition, the computer device also determines the segmentation point. Since the vehicle usually travels in an "S" shape when changing lanes, the turning point of the curve in the middle of the "S" shape is the segmentation point of the virtual lane line. The computer device can determine the segmentation point when extracting the lane line.

[0079] The computer device generates a first virtual auxiliary line according to the first tangent point and the lane line equation corresponding to the first lane line, and generates a second virtual auxiliary line according to the determined split point of the virtual lane point. Thus, according to the first virtual auxiliary line and the second virtual auxiliary line, a virtual circle tangent to the first tangent point can be determined, and the line segment on the virtual circle from the first tangent point to the split point is the first virtual lane line.

[0080] For example, Figure 7As shown, the computer device determines the tangent equation of the first lane arc on the left at the tangent point based on the first tangent point of the first lane line and its lane line equation, thereby obtaining the perpendicular line L1 through the center O, that is, the first virtual auxiliary line; and the computer device can obtain the perpendicular bisector L2 of the line connecting the dividing point and the first tangent point, that is, the second virtual auxiliary line, based on the dividing point and the first tangent point. Therefore, the intersection of L1 and L2 is the center O of the first virtual lane arc on the left, and the arc segment of the circle with the center O and the distance between the center O and the first tangent point as the radius between the first tangent point and the dividing point is the first virtual lane line on the left, that is, the first virtual lane line.

[0081] It is easy to understand that, similar to the above embodiment, constructing the second virtual lane line based on the second tangent point includes: determining the third virtual auxiliary line based on the second tangent point and the lane line equation corresponding to the second lane line; determining the split point, and determining the fourth virtual auxiliary line based on the split point and the second tangent point; constructing the second virtual lane line based on the third virtual auxiliary line and the fourth virtual auxiliary line. The specific steps can be seen in the above embodiment, and will not be repeated here. Thus, by connecting the first virtual lane line before the diversion with the second virtual lane line after the diversion, an "S"-shaped virtual lane line can be generated.

[0082] In the above embodiment, by constructing a virtual auxiliary line and constructing a virtual lane line before or after the diversion, the first virtual lane line and the second virtual lane line are respectively constructed in a two-stage construction manner, and then the first virtual lane line before the diversion is connected with the second virtual lane line after the diversion, a smooth "S"-shaped virtual lane line can be generated, so that the generated virtual lane line can smoothly transition at the diversion point, and there will be no large lateral deviation when the vehicle is driving, thereby ensuring driving safety.

[0083] In some embodiments, determining the segmentation point of the virtual lane line includes: respectively determining the first coordinates of the end point of the first lane line and the second coordinates of the starting point of the second lane line; and determining the segmentation point of the virtual lane line based on the first coordinates and the second coordinates.

[0084] Specifically, the computer device obtains the coordinates of the end point of the first lane line, i.e., the first coordinates, and the coordinates of the starting point of the second lane line, i.e., the second coordinates. The computer device can determine a point located in the middle of the first coordinate and the second coordinate on both the X-axis and the Y-axis according to the first coordinate and the second coordinate, and the point is the segmentation point of the virtual lane line.

[0085] For example, Figure 8 As shown, the computer device calculates the means of the horizontal coordinate and the vertical coordinate respectively according to the first coordinate (x1, y1) and the second coordinate (x2, y2) to obtain the segmentation point, and the coordinates of the segmentation point are ((x1+x2) / 2, (y1+y2) / 2).

[0086] In the above embodiment, the split point is determined by calculating the breakpoints of the lane line before and after the divergence, so that the generated virtual lane line can transition at the divergence in a smoother "S" shape, and there will be no large lateral deviation when the vehicle is driving, thereby ensuring driving safety.

[0087] After the virtual lane lines are constructed, the computer device can plan a path for the vehicle under the diversion road condition according to the virtual lane lines. To this end, in some embodiments, generating a driving path of the vehicle based on the virtual lane lines includes: determining a driving area formed by a virtual left lane line and a virtual right lane line; and generating a driving path of the vehicle in the driving area.

[0088] Specifically, when the virtual lane line includes a virtual left lane line and a virtual right lane line, the computer device can determine a driving area formed by the virtual left lane line and the virtual right lane line. The driving area can be the entire area formed by the virtual left lane line and the virtual right lane line, or a driving area slightly smaller than the entire area, etc. For example, Fig. 9 As shown. Thus, the computer device can plan and generate the driving path of the vehicle within the driving area.

[0089] It should be noted that when the virtual lane line includes only one virtual lane line, for example, a virtual left lane line or a virtual right lane line, the right side of the virtual left lane line is the driving area, and the left side of the virtual right lane line is the driving area.

[0090] In the above embodiment, by determining a driving area composed of a virtual left lane line and a virtual right lane line, and planning a driving path within the driving area, the driving safety of the vehicle is further guaranteed.

[0091] In order to further ensure the lateral deviation of the vehicle before and after the diversion, in some embodiments, the above method also includes: determining the lane line curvature of the virtual lane line; when the lane line curvature does not meet the curvature condition, adjusting the position of the first tangent point and / or the second tangent point, and returning to the step of constructing the virtual lane line based on the first lane line and the second lane line until the curvature of the generated virtual lane line meets the curvature condition.

[0092] Specifically, after generating the virtual lane line, the computer device further calculates the lane line curvature of the virtual lane line. The lane line curvature can be calculated by, for example, calculating the curvature based on a parameter curve of an arc length, etc. The specific method is not limited in this application.

[0093] The computer device can obtain a preset curvature threshold, and determine whether the calculated lane line curvature is less than the curvature threshold, thereby determining whether the lane line curvature meets the curvature condition. When the lane line curvature exceeds the curvature threshold, it means that the lane line curvature does not meet the curvature condition, and the computer device returns to step S302 to re-execute, and re-determines the positions of the first tangent point and the second tangent point, thereby regenerating a new virtual lane line.

[0094] When the computer device regenerates the virtual lane line, the first tangent point is farther from the end point of the first lane line than when the virtual lane line was last generated, and / or the second tangent point is farther from the start point of the second lane line than when the virtual lane line was last generated. Exemplarily, when regenerating, the computer device increases the first preset value and / or increases the second preset value to re-determine the first tangent point and / or the second tangent point.

[0095] In the above embodiment, the lane line curvature of the generated virtual lane line is controlled by the curvature condition, thereby ensuring that the vehicle's driving path can meet the vehicle's lateral control requirements, ensuring driving safety, and ensuring the continuous operation of the intelligent driving function under diversion road conditions without the user taking over the steering wheel for manual driving; when the lane line curvature does not meet the curvature condition, the position of the intersection point of the two-segment lane line can also be adjusted in an adaptive manner to construct a virtual lane line that meets the curvature requirements, thereby generating a driving path that meets the lateral control requirements.

[0096] Wherein, when the virtual lane line is constructed based on the first virtual lane line and the second virtual lane line, determining the lane line curvature of the virtual lane line includes: respectively determining the first curvature of the first virtual lane line, and the second curvature of the second virtual lane line; wherein the lane line curvature does not meet the curvature condition includes: the first curvature does not meet the first curvature condition, and the second curvature does not meet the second curvature condition.

[0097] Specifically, the computer device calculates the first curvature of the first virtual lane line and the second curvature of the second virtual lane line, and determines whether the first curvature satisfies the first curvature condition and whether the second curvature satisfies the second curvature condition. For example, the computer device can determine whether the first curvature is less than the first curvature threshold and whether the second curvature is less than the second curvature threshold. Only when the first curvature and the second curvature both meet the corresponding curvature conditions, the computer device determines that the lane line curvature of the virtual lane line meets the curvature condition, and the generated driving path can meet the lateral control requirements of the vehicle.

[0098] In the above embodiment, by constructing a two-stage virtual lane line and controlling the lane line curvature of the virtual lane line before and after the diversion respectively, the generated "S"-shaped virtual lane line can be made smoother, thereby effectively ensuring that the generated driving path meets the lateral vehicle control requirements.

[0099] In any of the above embodiments or their combination, how to construct a virtual lane line is described in detail. In actual scenarios, one of the keys to constructing a virtual lane line is to determine the lane line divergence road conditions and accurately detect the breakpoints of the lane lines before and after the divergence, that is, to determine where the lane line of the current lane ends and where the lane line of the target lane starts. In addition, since the lane lines in the actual scene may have problems such as dim color and partial missing, it will affect the accurate extraction of the lane lines and thus affect the accurate construction of the virtual lane lines. Therefore, the accurate extraction of the lane lines before and after the divergence is particularly important. To this end, in some embodiments, determining the first lane line of the current lane where the vehicle is located before the divergence, and determining the second lane line of the target lane that the vehicle will enter after the divergence, includes: extracting multiple lane lines in the image, and dividing the multiple lane lines into the lane line before the divergence and the lane line after the divergence; in the lane line before the divergence, determining the first lane line of the current lane where the vehicle is located; in the lane line after the divergence, screening out the second lane line of the target lane that the vehicle will enter after the divergence.

[0100] Specifically, the computer device first extracts multiple lane lines included in the image, and divides each of the extracted lane lines into a front divergence lane line or a rear divergence lane line. Thus, the computer device can determine the first lane line of the current lane where the vehicle is located from the front divergence lane line. Exemplarily, the computer device obtains the current position of the vehicle, and calculates the lateral distance between each front divergence lane line and the current position, and uses the front divergence lane line with the smallest lateral distance as the first lane line of the current lane where the vehicle is located.

[0101] Furthermore, the computer device may select the second lane line of the target lane that the vehicle will enter after the divergence from the diverging lane lines. For example, the computer device may calculate the lateral distance between each diverging lane line and the current position, and use the diverging lane line with the smallest lateral distance as the second lane line of the target lane. For another example, the computer device may calculate the lateral distance between each diverging lane line and the first lane line based on the determined first lane line, and use the diverging lane line with the smallest lateral distance as the second lane line of the target lane.

[0102] In the above embodiment, by dividing the detected lane lines, distinguishing whether the lane lines under the diverging road conditions belong to the front lane lines or the rear lane lines, and further determining the first lane lines of the current lane and the second lane lines of the target lane, the amount of calculation is reduced, the computing power requirement is low, the efficiency of generating the driving path can be improved, and it is suitable for the actual needs under various diverging road conditions.

[0103] Among them, extracting multiple lane lines in the image includes: performing peak search on the image to determine multiple peak points; for any peak point, taking the targeted peak point as the starting point, searching through multiple sliding windows to determine the valid pixels in each sliding window; performing lane line fitting based on the valid pixels in each sliding window to obtain the lane line corresponding to the targeted peak point.

[0104] Specifically, the computer device can determine the center point of each lane line by peak search. For example, the computer device can use a histogram statistical method to perform peak search on the image and preliminarily locate the center position of each lane line in the lateral direction, and the pixel point at the center position is the peak point.

[0105] Then, the computer device uses the peak point as the starting point to search all the pixels and their coordinate information that make up each lane line at once through a sliding window. For example, the computer device defines the sliding window height as h, the lane marking width as w, and the correspondence between the pixels in the X-axis direction and the Y-axis direction of the image and the real-world coordinate system as f(x) and f(y). The width of the sliding window can be set to 2*w / f(x), so that it can more completely search for the valid pixel information of the lane line. Among them, valid pixels refer to pixels belonging to the lane line. Valid pixel information includes, for example, the number and coordinates of valid pixels.

[0106] Therefore, for each peak point, the computer device starts from its position, searches through multiple sliding windows, determines the valid pixels within each sliding window, and performs lane line fitting based on the valid pixels within each sliding window to obtain the lane line corresponding to the peak point.

[0107] In the above embodiment, the center position of the lane line is initially determined by peak search, and a sliding search is performed at the center position, so that the lane line is fitted according to the effective pixels in the sliding search. This allows for rapid extraction of lane line information in the image, with low computing power requirements and high efficiency in extracting lane lines.

[0108] During the sliding search, the computer device can also synchronously determine whether each lane line belongs to a front-divergence lane line or a rear-divergence lane line. That is, in some embodiments, dividing multiple lane lines into front-divergence lane lines and rear-divergence lane lines includes: determining a preset interval length of the lane lines; under the condition that the number of valid pixels in a preset number of consecutive sliding windows is less than a first threshold, when the interval condition is met based on the preset number and the preset interval length, the targeted lane line is determined as the rear-divergence lane line; when the interval condition is not met based on the first number and the preset interval length, the targeted lane line is determined as the front-divergence lane line.

[0109] Specifically, the computer device determines a preset interval length Line_gap of the lane line in the Y-axis direction. When the computer device performs a sliding search in the Y-axis direction through a sliding window, if the number of valid pixels in the current window is less than a first threshold, it indicates that the window does not contain valid lane line information.

[0110] If the number of valid pixels in N consecutive sliding windows is less than the first threshold and meets the interval condition of N*h*f(y)>Line_gap, that is, when the lane lines on the image are mapped to reality, the interval between the lane lines is greater than the preset interval length, the computer device determines the lane line as the lane line after the divergence. On the contrary, if the interval condition of N*h*f(y)>Line_gap is not met, the computer device determines the lane line as the lane line before the divergence.

[0111] In the above embodiment, by judging whether the lane line is the lane line before diversion or the lane line after diversion based on the effective pixel information in multiple consecutive sliding windows, the extracted lane line is more accurate, and the above method does not require complex image processing, has low computing power requirements, simple procedures, high algorithm robustness and environmental adaptability, and can be applied to various types of lane line diversion road conditions.

[0112] Among them, in order to extract each lane line more accurately, the computer device also updates the center position of the lane line in the X-axis direction, that is, the peak point, in real time during the sliding search process. To this end, in some embodiments, when the number of valid pixels in any sliding window exceeds the second threshold, a new peak point is determined based on the coordinates of each valid pixel in any sliding window. Specifically, when the number of valid pixels in the current sliding window exceeds the second threshold, the computer device obtains the horizontal coordinates of all valid pixels in the current sliding window, and calculates the mean of the horizontal coordinates of all valid pixels, and uses the pixel at the horizontal coordinate position represented by the mean as the new peak point of the current lane line. Therefore, by implementing the update of the center position of the lane line, the accuracy of lane line extraction and fitting is improved, thereby improving the accuracy of the virtual lane line and the driving path.

[0113] In the above embodiment, determining the valid pixels in each sliding window includes: obtaining the pixel value of each pixel in each sliding window; for any pixel, when the pixel value of the targeted pixel exceeds the third threshold, determining the targeted pixel as a valid pixel. Specifically, the computer device obtains the pixel value of each pixel in each sliding window, and for each pixel, determines whether the pixel value of the targeted pixel exceeds the third threshold. If so, the computer device determines the targeted pixel as a valid pixel. Thus, lane line fitting is performed based on the valid pixel information in the sliding window, and the obtained lane line is more accurate; based on the valid pixel information in multiple consecutive sliding windows, the front and rear lane lines are judged, and the current lane and the target lane can be quickly determined, thereby improving the efficiency of generating the driving path.

[0114] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0115] As mentioned above, the embodiments of the present application can also be applied in lane changing scenarios. In an ideal state, the lane lines before and after the lane change in the lane changing scenario are continuous in the vertical direction, but in actual road conditions, the lane changing scenario may also have a certain degree of misalignment in the horizontal direction between the lane lines before and after the lane change.

[0116] The embodiment of the present application can also be applied to this scenario, that is, the driving path generation method provided by the embodiment of the present application also includes: determining the first lane line of the current lane where the vehicle is located before changing lanes, and determining the second lane line of the target lane that the vehicle will enter after changing lanes; constructing a virtual lane line based on the first lane line and the second lane line; generating the driving path of the vehicle based on the virtual lane line. In the lane changing scenario, the computer device determines the lane where the vehicle is located before changing lanes (that is, the current lane), and the lane that the vehicle will enter after changing lanes, that is, the target lane. Then, the computer device extracts the lane line of the current lane as the first lane line, and extracts the second lane line of the target lane as the second lane line.

[0117] The computer device may extract the first lane line and the second lane line based on images collected by vehicles or road facilities and equipment. In some embodiments, the computer device also performs image processing such as resizing, noise reduction filtering, binarization, and coordinate system mapping on the image to highlight the lane line information. For example, the computer device may extract lane lines from road monitoring images collected by vehicles or road facilities and equipment, and further distinguish between the first lane line and the second lane line. Exemplarily, the computer device obtains a top view of the road surface, and determines the first lane line and the second lane line in the top view of the road surface. The top view of the road surface is an image of the road surface from a top-down perspective, for example Figure 1 As shown. For example, the computer device can obtain the road surface image collected by the vehicle and generate a road surface top view by means of reverse perspective mapping or the like.

[0118] In some embodiments, the computer device may obtain a road top view in the following manner: obtain a traffic monitoring image collected by a camera of the vehicle; and convert the traffic monitoring image into a road top view based on a preset coordinate system mapping relationship. The preset coordinate system mapping relationship may be, for example, a mapping relationship between a coordinate system of the real physical world and an image coordinate system. In other embodiments, the computer device may also obtain point cloud data, and determine the first lane line and the second lane line based on the point cloud data. For example, point cloud data belonging to the lane line is extracted from the point cloud data, and then the first lane line and the second lane line are extracted. Therefore, the computer device may extract all lane lines in the image, and determine whether the vehicle is currently in a lane change scene based on the distance characteristics between the lane lines in the image; or, the computer device may determine that the vehicle is currently in a lane change scene based on the driving instructions of the vehicle (for example, the driver instructs the vehicle to change lanes by means of buttons, touch, voice, etc.), that is, the vehicle is about to change lanes.

[0119] In some embodiments, the computer device determines the lane line with the smallest distance as the lane line of the target lane based on the lateral distance between each lane line after the lane change and the lane line of the current lane, that is, the distance in the X-axis direction. The computer device can construct virtual lane lines through lane lines located on the same side of the lane. For example, the computer device can use the left lane line of the current lane as the first lane line and the left lane line of the target lane as the second lane line; or, the computer device uses the right lane line of the current lane as the first lane line and the right lane line of the target lane as the second lane line. In other embodiments, the computer device can use the left lane line and the right lane line of the current lane as the first lane line, and use the left lane line and the right lane line of the target lane as the second lane line. It is easy to understand that when the determined lane line includes a left lane line and a right lane line, the first left lane line corresponds to the second left lane line, and the first right lane line corresponds to the second right lane line, thereby generating smooth virtual lane lines on both sides.

[0120] In order to make the process of vehicle lane change smoother, in some embodiments, a virtual lane line is constructed based on a first lane line and a second lane line, including: determining a first tangent point on the first lane line and a second tangent point on the second lane line; wherein the first lane line belongs to the current lane where the vehicle is located before the lane change, and the second lane line belongs to the target lane that the vehicle will enter after the lane change; constructing a first virtual lane line based on the first tangent point, and constructing a second virtual lane line based on the second tangent point; constructing a virtual lane line based on the first virtual lane line and the second virtual lane line. Specifically, the computer device determines the first tangent point on the first lane line and the second tangent point on the second lane line respectively. The first tangent point is at least a certain distance away from the end point of the first lane line, and the second tangent point is at least a certain distance away from the starting point of the second lane line, and the distances between the two can be equal or unequal. Thus, the computer device can construct the first virtual lane line based on the first tangent point, and construct the second virtual lane line based on the second tangent point. The computer device can connect the first virtual lane line and the second virtual lane line to construct the virtual lane line.

[0121] In the above embodiment, a two-stage fitting method is constructed to construct virtual lane lines during the lane change process, so that the generated virtual lane lines can ensure smooth driving of the vehicle, meet the lateral control requirements of the vehicle, and avoid safety hazards caused by excessive lateral deviation during driving.

[0122] In some embodiments, the first lane line includes a first left lane line and a first right lane line, and the second lane line includes a second left lane line and a second right lane line. Then, the first tangent point includes: a first left tangent point located on the first left lane line, and a first right tangent point located on the first right lane line; the second tangent point includes: a second left tangent point located on the second left lane line, and a second right tangent point located on the second right lane line. Thus, the constructed first virtual lane line includes: a first virtual left lane line constructed based on the first left tangent point, and a first virtual right lane line constructed based on the first right tangent point; the second virtual lane line includes: a second virtual left lane line constructed based on the second left tangent point, and a second virtual right lane line constructed based on the second right tangent point. Furthermore, constructing a virtual lane line based on the first virtual lane line and the second virtual lane line includes: connecting the first virtual left lane line with the second virtual left lane line to generate a virtual left lane line; connecting the first virtual right lane line with the second virtual right lane line to generate a virtual right lane line; constructing a virtual lane line based on the virtual left lane line and the virtual right lane line.

[0123] In the above embodiment, a two-stage fitting method is constructed to construct virtual lane lines during the lane change process, and virtual lane lines on the left and right sides of the lane are constructed respectively. The virtual lane lines on both sides can constitute a complete virtual lane. The driving path is planned within the virtual lane, which can make the driving path more accurate, ensure the smooth driving of the vehicle, meet the lateral control requirements of the vehicle, and avoid safety hazards caused by excessive lateral deviation during driving.

[0124] In some embodiments, determining a first tangent point on a first lane line and a second tangent point on a second lane line includes: determining an end point of the first lane line and a start point of the second lane line; on the first lane line, using a point that is a first preset value away from the end point as the first tangent point; and on the second lane line, using a point that is a second preset value away from the start point as the second tangent point. Specifically, the computer device uses the end point of the first lane line at the lane change as the end point, representing that the lane line before the lane change is disconnected here; and uses the start point of the second lane line at the lane change as the start point, representing that the lane line after the lane change starts from here.

[0125] Thus, the computer device determines a point on the first lane line that is separated from the end point by a first preset value as the first tangent point, and determines a point on the second lane line that is separated from the start point by a second preset value as the second tangent point. The first preset value and the second preset value may be equal or different.

[0126] In the above embodiment, by selecting a point that is a certain distance away from the lane line breakpoints before and after the lane change as the tangent point, the generated virtual lane line can have a certain extension in the longitudinal direction, and the lateral offset amplitude of the driving path generated based on the virtual lane line can meet the lateral control requirements of the vehicle, avoiding safety hazards caused by excessive lateral offset.

[0127] In some embodiments, constructing a first virtual lane line based on a first tangent point includes: determining a first virtual auxiliary line based on the first tangent point and a lane line equation corresponding to the first lane line; determining a segmentation point, and determining a second virtual auxiliary line based on the segmentation point and the first tangent point; constructing the first virtual lane line based on the first virtual auxiliary line and the second virtual auxiliary line. Specifically, when determining the first lane line, the computer device also determines a lane line equation corresponding to the first lane line. Exemplarily, the computer device may generate a lane line equation corresponding to the first lane line through a lane line fitting method. Lane line fitting methods include, but are not limited to, a least squares method based on a hyperbolic model, an image processing method based on edge detection and transformation, a lane line fitting based on a fitting function and a residual function, and the like, which are not limited in the present application.

[0128] In addition, the computer device also determines the segmentation point. Since the vehicle usually travels in an "S" shape when changing lanes, the turning point of the curve in the middle of the "S" shape is the segmentation point of the virtual lane line. The computer device can determine the segmentation point when extracting the lane line.

[0129] The computer device generates a first virtual auxiliary line according to the first tangent point and the lane line equation corresponding to the first lane line, and generates a second virtual auxiliary line according to the determined split point of the virtual lane point. Thus, according to the first virtual auxiliary line and the second virtual auxiliary line, a virtual circle tangent to the first tangent point can be determined, and the line segment on the virtual circle from the first tangent point to the split point is the first virtual lane line.

[0130] In some embodiments, determining the segmentation point of the virtual lane line includes: respectively determining the first coordinates of the end point of the first lane line and the second coordinates of the starting point of the second lane line; and determining the segmentation point of the virtual lane line based on the first coordinates and the second coordinates.

[0131] Specifically, the computer device obtains the coordinates of the end point of the first lane line, i.e., the first coordinates, and the coordinates of the starting point of the second lane line, i.e., the second coordinates. The computer device can determine a point located in the middle of the first coordinate and the second coordinate on both the X-axis and the Y-axis according to the first coordinate and the second coordinate, and the point is the segmentation point of the virtual lane line.

[0132] Therefore, the segmentation point is determined by calculating the breakpoints of the lane line before and after the lane change, so that the generated virtual lane line can transition in a smoother "S" shape at the lane change point. There will be no large lateral deviation when the vehicle is driving, ensuring driving safety.

[0133] In some embodiments, generating a driving path of a vehicle based on a virtual lane line includes: determining a driving area formed by a virtual left lane line and a virtual right lane line; and generating a driving path of the vehicle within the driving area. Specifically, when the virtual lane line includes a virtual left lane line and a virtual right lane line, the computer device may determine a driving area formed by the virtual left lane line and the virtual right lane line, and the driving area may be the entire area formed by the virtual left lane line and the virtual right lane line, or a driving area slightly smaller than the entire area, etc.

[0134] Therefore, by determining a driving area composed of a virtual left lane line and a virtual right lane line and planning a driving path within the driving area, the driving safety of the vehicle is further guaranteed.

[0135] In some embodiments, the above method also includes: determining the lane line curvature of the virtual lane line; when the lane line curvature does not meet the curvature condition, adjusting the position of the first tangent point and / or the second tangent point, and returning to the step of constructing the virtual lane line based on the first lane line and the second lane line until the curvature of the generated virtual lane line meets the curvature condition.

[0136] Wherein, when the virtual lane line is constructed based on the first virtual lane line and the second virtual lane line, determining the lane line curvature of the virtual lane line includes: respectively determining the first curvature of the first virtual lane line, and the second curvature of the second virtual lane line; wherein the lane line curvature does not meet the curvature condition includes: the first curvature does not meet the first curvature condition, and the second curvature does not meet the second curvature condition.

[0137] Therefore, the lane line curvature of the generated virtual lane line is controlled by the curvature condition, thereby ensuring that the vehicle's driving path can meet the vehicle's lateral control needs, ensuring driving safety, and ensuring the continuous operation of the intelligent driving function under changing road conditions without the user taking over the steering wheel for manual driving; when the lane line curvature does not meet the curvature condition, the position of the intersection point of the two-segment lane line can also be adjusted in an adaptive manner to construct a virtual lane line that meets the curvature requirements, thereby generating a driving path that meets the lateral control requirements.

[0138] In some embodiments, determining a first lane line of a current lane where a vehicle is located before lane changing, and determining a second lane line of a target lane that the vehicle will enter after lane changing, include: extracting multiple lane lines in an image, and dividing the multiple lane lines into lane lines before lane changing and lane lines after lane changing; determining the first lane line of the current lane where the vehicle is located among the lane lines before lane changing; and screening out the second lane line of the target lane that the vehicle will enter after lane changing among the lane lines after lane changing.

[0139] Specifically, the computer device calculates the first curvature of the first virtual lane line and the second curvature of the second virtual lane line, and determines whether the first curvature satisfies the first curvature condition and whether the second curvature satisfies the second curvature condition. For example, the computer device can determine whether the first curvature is less than the first curvature threshold and whether the second curvature is less than the second curvature threshold. Only when the first curvature and the second curvature both meet the corresponding curvature conditions, the computer device determines that the lane line curvature of the virtual lane line meets the curvature condition, and the generated driving path can meet the lateral control requirements of the vehicle.

[0140] In the above embodiment, by constructing a two-stage virtual lane line and controlling the lane line curvature of the virtual lane line before and after the lane change respectively, the generated "S"-shaped virtual lane line can be made smoother, thereby effectively ensuring that the generated driving path meets the lateral vehicle control requirements.

[0141] Wherein, extracting multiple lane lines in the image includes: performing peak search on the image to determine multiple peak points; for any peak point, taking the targeted peak point as the starting point, searching through multiple sliding windows to determine the valid pixels in each sliding window; performing lane line fitting based on the valid pixels in each sliding window to obtain the lane line corresponding to the targeted peak point. During the sliding search process, the computer device can also synchronously determine whether each lane line belongs to a lane line before lane change or a lane line after lane change. That is, in some embodiments, dividing multiple lane lines into lane lines before lane change and lane lines after lane change includes: determining a preset interval length of the lane lines; under the condition that the number of valid pixels in a continuous preset number of sliding windows is less than a first threshold, when the interval condition is met based on the preset number and the preset interval length, the targeted lane line is determined as the lane line after lane change; when the interval condition is not met based on the first number and the preset interval length, the targeted lane line is determined as the lane line before lane change. Determining the valid pixels in each sliding window includes: acquiring the pixel value of each pixel in each sliding window; for any pixel, when the pixel value of the pixel exceeds a third threshold, determining the pixel as a valid pixel.

[0142] The specific implementation methods and beneficial effects of the lane changing scenarios in the above embodiments can be referred to the description of the road conditions in the previous embodiments, which will not be repeated here.

[0143] In a specific example, an embodiment of the present application also provides a driving path generation system, which may include a lane line information extraction module and a vehicle driving path planning module.

[0144] Among them, the lane line information extraction module is the key module for subsequent vehicle path planning at the divergence (or lane change). The content of the lane line information extraction includes all the pixel information constituting the lane lines in the road surface top view, the judgment information of the lane line category (that is, judging whether each lane line belongs to the lane line before the divergence (or lane change) or the lane line after the divergence (or lane change)), the starting point or ending point (that is, the breakpoint) position information of the lane line at the divergence (or lane change), and the lane line matching information at the divergence (or lane change). Among them, the lane line detection process includes four types of lane lines: white solid line, white dotted line, yellow solid line and yellow dotted line. The lane line information extraction module converts the driving view into a road surface top view for subsequent detection and planning based on the conversion relationship between the driving view (usually the front view) and the internal and external parameters of the camera, as well as the coordinate conversion relationship determined based on the internal and external parameters. Therefore, if Fig.10 As shown in the figure (taking the diversion scenario as an example), the lane line information extraction module can perform the following steps:

[0145] Step 1: Image preprocessing. In order to reduce the influence of factors such as lane line color, ground light brightness, and ground texture feature changes in complex environments, the lane line information extraction module can first use edge detection combined with multiple color space thresholds to perform preliminary lane line feature information extraction on the input image. Specifically, the lane line information extraction module can use the Sobel operator to detect lane line pixels in the horizontal and vertical directions respectively, and perform threshold detection in four color spaces: RGB, HSV, Lab, and LUV. The detection results of the two are combined to obtain a more robust and clear binary image containing lane line features.

[0146] During the detection process, the lane line information extraction module uses a lane line detection method based on histogram statistics to analyze the binary image. However, this method cannot directly obtain the multiple lane line categories and their breakpoint location information before and after the divergence (or lane change), so it is impossible to plan the target lane and driving path to be merged after the divergence (or lane change). Therefore, the lane line information extraction module first screens the pixel information related to the lane line in the current frame image; on this basis, the pixel position information corresponding to each lane line is extracted based on the histogram and sliding window, and the lane line category is determined simultaneously; in addition, the lane line is fitted according to the pixel information corresponding to each lane line, so as to further determine the lane line breakpoint location information using the fitting results, and finally obtain the matching information of the lane lines before and after the divergence (or lane change).

[0147] Step 2: Detection of lane lines before and after diversion (or lane change). The lane line information extraction module searches for peak values ​​of binary images based on the histogram statistics method, and preliminarily locates the center position x_current of each lane line in the X-axis direction of the image; and starts from the center position, searches for all pixel position information of each lane line in sequence through the sliding window. Among them, the sliding window height is defined as w_h, the lane marking width is l_w, and the correspondence between the pixels in the X-axis and Y-axis directions of the image and the real-world coordinate system is expressed as xm_per_pix and ym_per_pix. The width of the sliding window can be set to 2*l_w / xm_per_pix, so that the effective pixel information of the lane line can be searched more completely. At the same time, during the search process, the lane line information extraction module synchronously determines the category of each lane line. Specifically, the gap length between the dotted lane lines is defined as line_gap. Considering the noise interference problem, for each sliding window, if the number of valid pixels in the current window is less than the threshold T1, it is considered that the window does not contain valid lane line information; if the number of valid pixels in N consecutive sliding windows is less than the threshold T1, and satisfies N*w_h*ym_per_pix>line_gap, it can be determined that the lane line is the lane line after the divergence (or lane change) (that is, the opposite lane line that may merge), otherwise the lane line is the lane line before the divergence (or lane change) (that is, the current lane line). In addition, during the detection process, the lane line information extraction module also updates the center position x_current of the lane line in the X-axis direction in the image in real time, so as to detect the lane line more accurately. Specifically, if the number of valid pixels in the current window is greater than the threshold T2, the lane line information extraction module uses the average of the X coordinates of all valid pixel points in the window as the new center position x_current. After the search is completed, the lane line information extraction module performs lane line fitting based on the effective pixel information of each lane line to obtain the parameters of all lane lines before and after the divergence (or lane change).

[0148] Step 3: Detect lane line breakpoints at divergence (or lane change). The lane line information extraction module determines the position coordinates of all lane line breakpoints in the Y-axis direction of the image based on the lane line effective pixel information and lane line category information obtained in step 2, and then calculates the position coordinates of the breakpoints in the X-axis direction of the image according to the lane line fitting equation, and finally obtains the breakpoint position information of all lane lines before and after the divergence (or lane change).

[0149] Step 4: Lane line matching at the divergence (or lane change). The center position of the image in the X-axis direction is used as the center of the vehicle. The lane line information extraction module calculates the center position between the two lane lines before the divergence (or lane change), thereby determining the lane where the vehicle is located before the divergence (or lane change) and the left and right lane lines line_now_left and line_now_right that make up the lane; the lane line information extraction module calculates the center position between the two lane lines after the divergence (or lane change), and selects the lane with the shortest lateral distance to the lane of the vehicle (i.e., the smallest lateral turning angle) as the opposite target lane to be merged, thereby determining the left and right lane lines line_coming_left and line_coming_right of the lane to be merged after the divergence (or lane change), and completing the lane line matching.

[0150] For the extraction results of the lane line information extraction module, the vehicle driving path planning module can determine the lane line breakpoint position information of the lane where the vehicle is located before the divergence (or lane change), and the opposite target lane that the vehicle is about to merge into after the divergence (or lane change) and its lane line breakpoint position information. The vehicle driving path planning module aims to design a virtual lane path based on this information, so that the vehicle can smoothly transition to the opposite target lane along the virtual lane during the divergence (or lane change) process, thereby reducing the exit probability of the intelligent assisted driving function in the case of lane line divergence (or lane change) and improving the continuity of the intelligent assisted driving function. The key to vehicle driving path planning is to construct a suitable virtual lane line on the divergence (or lane change) section. The virtual lane line can not only smoothly connect the lane lines before and after the divergence (or lane change), but more importantly, its curvature meets the lateral vehicle control requirements as much as possible (that is, less than the preset curvature). However, the current one-stage lane line fitting method cannot meet the above conditions. Therefore, the driving path generation method provided in the embodiment of the present application constructs a virtual lane line through a two-stage fitting method, which is still like Fig.10 As shown, the specific implementation steps can be expressed as:

[0151] Step 1: Determine the split point and tangent point of the two-segment virtual lane line at the divergence (or lane change). The vehicle driving path planning module uses the left and right lane line breakpoint coordinates corner_now_left and corner_now_right of the lane where the vehicle is located before the divergence (or lane change) obtained in the above steps, and the left and right lane line breakpoint coordinates corner_coming_left and corner_coming_right of the opposite target lane after the divergence (or lane change), and takes the midpoint as the split point of the two-segment lane arc, that is:

[0152] corner_mid_left=1 / 2*(corner_now_left+corner_coming_left)

[0153] corner_mid_right=1 / 2*(corner_now_right+corner_coming_right)

[0154] Among them, corner_mid_left and corner_mid_right represent the dividing points of the left and right lane arcs respectively.

[0155] In addition to the segmentation point, constructing the lane arc also requires determining another tangent point of the arc. Therefore, the vehicle driving path planning module defines that the path planning starts when the distance from the left and right lane line breakpoints of the vehicle is D1 meters before the divergence (or lane change), and ends the path planning when the distance exceeds the target lane line breakpoint D2 meters after the divergence (or lane change), that is, the virtual two-segment lane line is tangent to the lane lines before and after the divergence (or lane change) at this point. For example, D1=D2. According to the correspondence between the pixels in the X-axis and Y-axis directions in the image and the real-world coordinate system, the vehicle driving path planning module can determine the Y-axis coordinates of the tangent points of the left and right lane lines before and after the divergence (or lane change) as:

[0156] cut_now_left_y=corner_now_left_y+D1 / ym_per_pix

[0157] cut_coming_left_y=corner_coming_left_y-D2 / ym_per_pix

[0158] cut_now_right_y=corner_now_right_y+D1 / ym_per_pix

[0159] cut_coming_right_y=corner_coming_right_y-D2 / ym_per_pix

[0160] Among them, cut_now_left, cut_coming_left, cut_now_right, and cut_coming_right represent the four tangent points of the left and right lane lines before and after the divergence (or lane change) and the virtual lane arc, respectively, and the suffix "_y" represents the Y-axis coordinate. Based on the Y-axis coordinate of the tangent point and the lane line equation obtained in the above steps, the vehicle driving path planning module can further calculate the X-axis coordinate of the tangent point to determine the tangent point position.

[0161] Step 2: Construct a two-segment virtual lane line at the divergence (or lane change). Taking the left lane line as an example, according to the tangent point cut_now_left of the left lane line before the divergence (or lane change) and its lane line equation, the vehicle driving path planning module can determine the tangent equation of the first lane arc on the left at the tangent point, thereby obtaining the vertical line L1 through the center of the circle; according to the dividing point corner_mid_left and the tangent point cut_now_left of the left lane line before the divergence (or lane change), the vehicle driving path planning module can obtain the midpoint perpendicular line L2 of the connecting line; then the intersection of L1 and L2 is the location of the center of the first virtual lane arc on the left, center_now_left.

[0162] Similarly, the vehicle driving path planning module can locate the center of the second virtual lane arc on the left side, center_coming_left, based on the split point corner_mid_left, the left lane line tangent point cut_coming_left after the divergence (or lane change), and the lane line equation, thereby determining the two-segment lane line on the left side of the divergence (or lane change). Similarly, the two-segment virtual lane line on the right side is obtained using the same method.

[0163] Step 3: Calculate the virtual lane curvature C. As mentioned above, the constructed two-segment lane line should not only smoothly connect the lane lines before and after the divergence (or lane change), but also its curvature should meet the lateral vehicle control requirements as much as possible (i.e. less than the preset curvature threshold C_Set), so that the intelligent assisted driving function can operate normally under the lane divergence (or lane change) road conditions. Therefore, it is necessary to calculate the curvature of the constructed lane arc, and when the curvature exceeds the preset value, the position of the tangent point (i.e. the value of D1 and D2) is adaptively adjusted to plan a virtual lane line that meets the curvature requirements.

[0164] Step 4: Determine whether the virtual lane curvature C of the lane line is less than the preset curvature threshold C_Set. If yes, proceed to step 5, otherwise return to step 2 and execute again.

[0165] Step 5: Generate the vehicle driving path at the divergence (or lane change) according to the virtual lane line. The vehicle driving path planning module can generate the driving path of the vehicle during the divergence (or lane change) process based on the two-segment lane arc constructed above, so that the vehicle can move forward smoothly along the preset path under the action of the intelligent assisted driving function.

[0166] As a result, the final driving path generation system outputs two-segment virtual lane lines and the vehicle's driving path.

[0167] Based on the same inventive concept, the embodiment of the present application also provides a driving path generation device for implementing the driving path generation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more driving path generation device embodiments provided below can refer to the limitations of the driving path generation method above, and will not be repeated here.

[0168] See also Fig.11 , a driving path generation device is provided, which can be integrated in a computer device, including a determination module 1101, a construction module 1102 and a generation module 1103, wherein:

[0169] A determination module 1101 is used to determine a first lane line of a current lane where the vehicle is located, and to determine a second lane line of a target lane that the vehicle is about to enter;

[0170] A construction module 1102, configured to construct a virtual lane line based on the first lane line and the second lane line;

[0171] The generation module 1103 is used to generate a driving path of the vehicle based on the virtual lane line.

[0172] In some embodiments, the construction module is also used to determine a first tangent point on the first lane line and a second tangent point on the second lane line; wherein the first lane line belongs to the current lane where the vehicle is located before the diversion, and the second lane line belongs to the target lane that the vehicle will enter after the diversion; construct a first virtual lane line based on the first tangent point, and construct a second virtual lane line based on the second tangent point; construct a virtual lane line based on the first virtual lane line and the second virtual lane line.

[0173] In some embodiments, the construction module is also used to determine a first tangent point on the first lane line and a second tangent point on the second lane line; wherein the first lane line belongs to the current lane where the vehicle is located before changing lanes, and the second lane line belongs to the target lane that the vehicle will enter after changing lanes; a first virtual lane line is constructed based on the first tangent point, and a second virtual lane line is constructed based on the second tangent point; a virtual lane line is constructed based on the first virtual lane line and the second virtual lane line.

[0174] In some embodiments, the construction module is also used to determine the end point of the first lane line and the starting point of the second lane line; on the first lane line, the point at a distance of a first preset value from the end point is used as the first tangent point; on the second lane line, the point at a distance of a second preset value from the starting point is used as the second tangent point.

[0175] In some embodiments, the construction module is also used to determine a first virtual auxiliary line based on the first tangent point and a lane line equation corresponding to the first lane line; determine a split point, and determine a second virtual auxiliary line based on the split point and the first tangent point; and construct the first virtual lane line based on the first virtual auxiliary line and the second virtual auxiliary line.

[0176] In some embodiments, the construction module is further used to respectively determine the first coordinates of the end point of the first lane line and the second coordinates of the starting point of the second lane line; and determine the segmentation point of the virtual lane line based on the first coordinates and the second coordinates.

[0177] In some embodiments, the first virtual lane line includes a first virtual left lane line and a first virtual right lane line, and the second virtual lane line includes a second virtual left lane line and a second virtual right lane line; the construction module is also used to connect the first virtual left lane line with the second virtual left lane line to generate a virtual left lane line; connect the first virtual right lane line with the second virtual right lane line to generate a virtual right lane line; and construct the virtual lane line based on the virtual left lane line and the virtual right lane line.

[0178] In some embodiments, the construction module is further used to determine a driving area composed of a virtual left lane line and a virtual right lane line; and generate a driving path of the vehicle within the driving area.

[0179] In some embodiments, the above-mentioned device also includes a verification module for determining the lane line curvature of the virtual lane line; when the lane line curvature does not meet the curvature condition, adjusting the position of the first tangent point and / or the second tangent point, and returning to the step of constructing the virtual lane line based on the first lane line and the second lane line until the curvature of the generated virtual lane line meets the curvature condition.

[0180] In some embodiments, when the virtual lane line is constructed based on the first virtual lane line and the second virtual lane line, the verification module is also used to respectively determine the first curvature of the first virtual lane line and the second curvature of the second virtual lane line; wherein the lane line curvature does not meet the curvature condition includes: the first curvature does not meet the first curvature condition, and the second curvature does not meet the second curvature condition.

[0181] In some embodiments, the determination module is also used to extract multiple lane lines in the image and divide the multiple lane lines into front-divergence lane lines and rear-divergence lane lines; among the front-divergence lane lines, determine the first lane line of the current lane where the vehicle is located; and among the rear-divergence lane lines, screen out the second lane line of the target lane that the vehicle will enter after the divergence.

[0182] In some embodiments, the determination module is also used to extract multiple lane lines in the image and divide the multiple lane lines into lane lines before lane change and lane lines after lane change; among the lane lines before lane change, determine the first lane line of the current lane where the vehicle is located; among the lane lines after lane change, screen out the second lane line of the target lane that the vehicle will enter after lane change.

[0183] In some embodiments, the determination module is also used to perform peak search on the image to determine multiple peak points; for any peak point, taking the targeted peak point as the starting point, searching through multiple sliding windows to determine the valid pixels within each sliding window; lane line fitting is performed based on the valid pixels within each sliding window to obtain the lane line corresponding to the targeted peak point.

[0184] In some embodiments, the determination module is also used to determine a preset interval length of the lane line; under the condition that the number of valid pixels in a preset number of consecutive sliding windows is less than a first threshold, when the interval condition is met based on the preset number and the preset interval length, the targeted lane line is determined as the lane line after diversion; when the interval condition is not met based on the first number and the preset interval length, the targeted lane line is determined as the lane line before diversion.

[0185] In some embodiments, the determination module is further configured to determine a new peak point based on the coordinates of each valid pixel in any sliding window when the number of valid pixels in any sliding window exceeds a second threshold.

[0186] In some embodiments, the determination module is further used to obtain the pixel value of each pixel in each sliding window; for any pixel, when the pixel value of the pixel exceeds a third threshold, the pixel is determined to be a valid pixel.

[0187] Each module in the above-mentioned devices can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of the processor in the control device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

[0188] In some embodiments, a computer device is provided, whose internal structure diagram can be as follows: Fig.12As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a driving path generation method is implemented.

[0189] Optionally, the computer device further includes a display unit. The display unit of the computer device is used to form a visually visible picture, and may be a display screen, a projection device, or a virtual reality imaging device. The display screen may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or may be a key, trackball, or touchpad provided on the computer device housing, or may be an external keyboard, touchpad, or mouse, etc.

[0190] Those skilled in the art will understand that Fig.12 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the control device to which the scheme of the present application is applied. The specific control device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0191] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The processor involved in each embodiment provided in this application can be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, etc., but is not limited thereto.

[0192] Correspondingly, an embodiment of the present application also provides a computer device, which may be a terminal device or a server.

[0193] like Fig.12 As shown, Fig.12 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device 1200 includes a processor 1201 having one or more processing cores, a memory 1202 having one or more computer-readable storage media, and a computer program stored in the memory 1202 and executable on the processor. The processor 1201 is electrically connected to the memory 1202. It will be understood by those skilled in the art that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0194] The processor 1201 is the control center of the computer device 1200, and uses various interfaces and lines to connect various parts of the entire computer device 1200. By running or loading software programs and / or units stored in the memory 1202, and calling data stored in the memory 1202, the processor 1201 executes various functions of the computer device 1200 and processes data, thereby monitoring the computer device 1200 as a whole. The processor 1201 can be a central processing unit CPU, a graphics processing unit GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0195] In the embodiment of the present application, the processor 1201 in the computer device 1200 will load the instructions corresponding to the processes of one or more application programs into the memory 1202 according to the following steps, and the processor 1201 will run the application programs stored in the memory 1202, so as to realize various functions, such as: determining the first lane line of the current lane where the vehicle is located, and determining the second lane line of the target lane that the vehicle is about to enter; constructing a virtual lane line based on the first lane line and the second lane line; generating a driving path of the vehicle based on the virtual lane line. The specific implementation of each of the above operations can be referred to the previous embodiment, and will not be repeated here.

[0196] Alternatively, if Fig.12 As shown, the computer device 1200 further includes: a touch screen 1203, a radio frequency circuit 1204, an audio circuit 1205, an input unit 1206, and a power supply 1207. The processor 1201 is electrically connected to the touch screen 1203, the radio frequency circuit 1204, the audio circuit 1205, the input unit 1206, and the power supply 1207, respectively. Those skilled in the art can understand that Fig.12 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0197] The touch display screen 1203 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 1203 may include a display panel and a touch panel. Among them, the display panel may be used to display information input by the user or information provided to the user and various graphical user interfaces of the computer device, which may be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED) and the like. The touch panel may be used to collect the user's touch operation on or near it (such as the user using any suitable object or attachment such as a finger, a stylus or the like on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 1201, and can receive the command sent by the processor 1201 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1201 to determine the type of touch event, and then the processor 1201 provides corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1203 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 1203 can also be used as a part of the input unit 1206 to realize the input function.

[0198] The radio frequency circuit 1204 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other computer device through wireless communication, and to send and receive signals between the network device or other computer device.

[0199] The audio circuit 1205 can be used to provide an audio interface between the user and the computer device through a speaker and a microphone. The audio circuit 1205 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1205 and converted into audio data, and then the audio data is output to the processor 1201 for processing, and then sent to another computer device through the radio frequency circuit 1204, or the audio data is output to the memory 1202 for further processing. The audio circuit 1205 may also include an earphone jack to provide communication between an external headset and the computer device.

[0200] The input unit 1206 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0201] The power supply 1207 is used to supply power to various components of the computer device 1200. Optionally, the power supply 1207 can be logically connected to the processor 1201 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 1207 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0202] although Fig.12 Not shown, the computer device 1200 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0203] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0204] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0205] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer program can be loaded by a processor to execute any one of the driving path generation methods provided in the embodiment of the present application. The computer program can execute the following steps of the driving path generation method: determine the first lane line of the current lane where the vehicle is located, and determine the second lane line of the target lane that the vehicle is about to enter; construct a virtual lane line based on the first lane line and the second lane line; generate the driving path of the vehicle based on the virtual lane line. The specific implementation of each of the above operations can be found in the previous embodiments, and will not be repeated here.

[0206] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0207] Since the computer program stored in the computer-readable storage medium can execute any one of the driving path generation methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the driving path generation methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0208] According to one aspect of the present application, a computer program product or a computer program is also provided, the computer program product or the computer program includes a computer instruction, and the computer instruction is stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method provided in various optional implementations in the above embodiments.

[0209] In the above-mentioned driving path generation device, computer-readable storage medium, computer equipment, and computer program product embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the above-mentioned driving path generation device, computer-readable storage medium, computer program product, computer equipment and its corresponding units can refer to the description of the driving path generation method in the above embodiment, and will not be repeated here.

[0210] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0211] The above are only preferred embodiments of the present application and do not constitute any form of limitation to the present application. Although the descriptions of various embodiments in the embodiments of the present application have different focuses, for parts not described in detail in a certain embodiment, reference can be made to the relevant embodiments of other embodiments. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. A driving path generation method, It is characterized in that The method comprises: Determine a first lane line of a current lane where the vehicle is located, and determine a second lane line of a target lane that the vehicle is about to enter; Constructing a virtual lane line based on the first lane line and the second lane line; A driving path of the vehicle is generated based on the virtual lane line.

2. The method according to claim 1, It is characterized in that The constructing a virtual lane line based on the first lane line and the second lane line includes: Determine a first tangent point on the first lane line and a second tangent point on the second lane line; wherein the first lane line belongs to the current lane where the vehicle is located before the divergence, and the second lane line belongs to the target lane that the vehicle will enter after the divergence; Constructing a first virtual lane line based on the first tangent point, and constructing a second virtual lane line based on the second tangent point; A virtual lane line is constructed based on the first virtual lane line and the second virtual lane line.

3. The method according to claim 2, It is characterized in that The determining a first tangent point on the first lane line and a second tangent point on the second lane line includes: Determine an end point of the first lane line and a start point of the second lane line; On the first lane line, a point that is a first preset distance from the end point is used as a first tangent point; On the second lane line, a point that is a second preset value away from the starting point is used as a second tangent point.

4. The method according to claim 2, It is characterized in that The constructing a first virtual lane line based on the first tangent point includes: Determining a first virtual auxiliary line based on the first tangent point and a lane line equation corresponding to the first lane line; Determine a segmentation point, and determine a second virtual auxiliary line based on the segmentation point and the first tangent point; A first virtual lane line is constructed based on the first virtual auxiliary line and the second virtual auxiliary line.

5. The method according to claim 4, It is characterized in that The determining of the segmentation point comprises: Determine first coordinates of an end point of the first lane line and second coordinates of a starting point of the second lane line respectively; Based on the first coordinate and the second coordinate, a segmentation point of the virtual lane line is determined.

6. The method according to claim 2, It is characterized in that The first virtual lane line includes a first virtual left lane line and a first virtual right lane line, and the second virtual lane line includes a second virtual left lane line and a second virtual right lane line; and constructing a virtual lane line based on the first virtual lane line and the second virtual lane line includes: Connecting the first virtual left lane line with the second virtual left lane line to generate a virtual left lane line; Connecting the first virtual right lane line with the second virtual right lane line to generate a virtual right lane line; A virtual lane line is constructed based on the virtual left lane line and the virtual right lane line.

7. The method according to claim 6, It is characterized in that The generating a driving path of the vehicle based on the virtual lane line includes: Determine a driving area formed by the virtual left lane line and the virtual right lane line; A driving path of the vehicle is generated within the driving area.

8. The method according to claim 2, It is characterized in that The method further comprises: Determining a lane curvature of the virtual lane line; When the lane line curvature does not meet the curvature condition, adjust the position of the first tangent point and / or the second tangent point, and return to the step of constructing a virtual lane line based on the first lane line and the second lane line until the curvature of the generated virtual lane line meets the curvature condition.

9. The method according to claim 8, It is characterized in that In a case where the virtual lane line is constructed based on the first virtual lane line and the second virtual lane line, determining the lane line curvature of the virtual lane line includes: respectively determining a first curvature of the first virtual lane line and a second curvature of the second virtual lane line; The lane line curvature not satisfying the curvature condition includes: the first curvature not satisfying the first curvature condition, and the second curvature not satisfying the second curvature condition.

10. The method according to claim 1, It is characterized in that The determining of a first lane line of a current lane where the vehicle is located, and determining a second lane line of a target lane that the vehicle is about to enter, includes: Extracting a plurality of lane lines in the image, and dividing the plurality of lane lines into a front-divergence lane line and a rear-divergence lane line; Determine, in the pre-divergence lane line, a first lane line of a current lane where the vehicle is located; Among the post-divergence lane lines, a second lane line of the target lane that the vehicle will enter after divergence is screened out.

11. The method according to claim 10, It is characterized in that The extracting a plurality of lane lines in the image comprises: Performing peak search on the image to determine multiple peak points; For any peak point, starting from the peak point, a search is performed through multiple sliding windows to determine the valid pixels in each sliding window; Lane line fitting is performed based on the valid pixels in each sliding window to obtain the lane line corresponding to the targeted peak point.

12. The method according to claim 10, It is characterized in that The dividing the plurality of lane lines into a front-divergence lane line and a rear-divergence lane line comprises: Determine the preset interval length of lane lines; Under the condition that the number of valid pixels in a preset number of consecutive sliding windows is less than a first threshold, when an interval condition is satisfied based on the preset number and the preset interval length, determining the targeted lane line as a post-divergence lane line; When the interval condition is not satisfied based on the first number and the preset interval length, the targeted lane line is determined as the lane line before divergence.

13. The method according to claim 11, It is characterized in that The method further comprises: When the number of valid pixels in any sliding window exceeds a second threshold, a new peak point is determined based on the coordinates of each valid pixel in the any sliding window.

14. The method according to any one of claims 11 to 13, It is characterized in that The determining of valid pixels within each sliding window comprises: Get the pixel value of each pixel in each sliding window; For any pixel, when the pixel value of the pixel exceeds the third threshold, the pixel is determined to be a valid pixel.

15. A driving path generating device, It is characterized in that The device comprises: A determination module, used to determine a first lane line of a current lane where the vehicle is located, and to determine a second lane line of a target lane that the vehicle is about to enter; A construction module, configured to construct a virtual lane line based on the first lane line and the second lane line; A generation module is used to generate a driving path of the vehicle based on the virtual lane line.

16. A computer device, It is characterized in that It comprises a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the driving path generation method as described in any one of claims 1 to 14.

17. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the driving path generation method according to any one of claims 1 to 14.

18. A computer program product, It is characterized in that The method comprises a computer program, wherein the computer program is used by a processor to execute the steps of the driving path generation method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Speed constraint method based on path planning, readable storage medium and computer

    CN115892027A

  • Navigation guide surface processing method and device, electronic equipment and computer program product

    CN115937479A

  • Intersection surface data generation method and device, electronic equipment and storage medium

    CN116740667A

  • Lane line processing method and device

    CN116895061A

  • Road change detection method, computing device and storage medium

    CN117419734A